Trace number 3385364

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 9533.78 1200.23

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S1275797759-041-UNKNOWN.cnf
MD5SUM374e3ba6783d13d6d478972802d8dba0
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.32/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.69	c INFO: solving HOME/instance-3385364-1305565833.cnf
0.32/0.69	c INFO: computing task features
0.60/0.92	c INFO: computed variable-clause graph statistics
0.60/0.93	c INFO: computed clause balance statistics
1.80/2.14	c INFO: computed variable balance statistics
2.30/2.64	c INFO: computed small-clause counts
2.30/2.64	c INFO: computed Horn-clause counts
2.30/2.68	c INFO: computed variable graph statistics
2.30/2.68	c INFO: collected features for HOME/instance-3385364-1305565833.cnf in 1.99 s
2.40/2.71	c INFO: running gnovelty+2@0 for 97 with 4997 remaining (b = 0.38)
2.40/2.74	c INFO: running gnovelty+2@0 for 97 with 4997 remaining (b = 0.13)
2.40/2.77	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.08)
2.50/2.80	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.07)
2.50/2.84	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.05)
2.50/2.87	c INFO: running gnovelty+2@0 for 97 with 4997 remaining (b = 0.04)
2.60/2.90	c INFO: running FH@0 for 97 with 4997 remaining (b = 0.03)
2.60/2.96	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.03)
803.10/103.10	c INFO: running adaptg2wsat2009++@0 for 97 with 4897 remaining (b = 0.02)
803.10/103.14	c INFO: running FH@0 for 97 with 4897 remaining (b = 0.02)
803.10/103.18	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.04)
803.60/103.22	c INFO: running gnovelty+2@0 for 97 with 4897 remaining (b = 0.02)
803.60/103.26	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
803.60/103.31	c INFO: running adaptg2wsat2009++@0 for 97 with 4897 remaining (b = 0.01)
804.46/103.36	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
804.46/103.41	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.02)
1602.50/203.48	c INFO: running TNM@0 for 1552 with 4797 remaining (b = 0.18)
1603.31/203.54	c INFO: running FH@0 for 97 with 4797 remaining (b = 0.01)
1603.84/203.64	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
1603.84/203.70	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
2363.88/299.08	c INFO: running hybridGM3@98 for 97 with 4701 remaining (b = 0.01)
2364.70/299.19	c INFO: running hybridGM3@100 for 97 with 4701 remaining (b = 0.01)
2370.99/299.92	c INFO: running hybridGM3@100 for 97 with 4700 remaining (b = 0.01)
2372.58/300.13	c INFO: running hybridGM3@99 for 97 with 4700 remaining (b = 0.01)
2379.74/301.00	c INFO: running adaptg2wsat2009++@0 for 97 with 4699 remaining (b = 0.01)
2379.74/301.05	c INFO: running adaptg2wsat2009++@100 for 97 with 4699 remaining (b = 0.01)
2394.87/302.92	c INFO: running hybridGM3@0 for 194 with 4697 remaining (b = 0.02)
3130.14/395.26	c INFO: running hybridGM3@294 for 97 with 4605 remaining (b = 0.01)
3154.82/398.36	c INFO: running hybridGM3@0 for 194 with 4602 remaining (b = 0.02)
3155.56/398.42	c INFO: running TNM@0 for 1552 with 4602 remaining (b = 0.14)
3171.55/400.44	c INFO: running hybridGM3@294 for 97 with 4600 remaining (b = 0.01)
3172.23/400.55	c INFO: running adaptg2wsat2009++@100 for 97 with 4600 remaining (b = 0.01)
3179.43/401.50	c INFO: running iPAWS@0 for 97 with 4599 remaining (b = 0.01)
3931.36/495.80	c INFO: running hybridGM3@296 for 97 with 4504 remaining (b = 0.01)
3937.71/496.64	c INFO: running gnovelty+2@0 for 97 with 4504 remaining (b = 0.01)
3948.05/497.93	c INFO: running hybridGM3@395 for 97 with 4502 remaining (b = 0.01)
3979.90/501.90	c INFO: running hybridGM3@392 for 97 with 4498 remaining (b = 0.01)
4010.15/505.71	c INFO: running hybridGM3@94 for 97 with 4495 remaining (b = 0.01)
4706.21/593.18	c INFO: running hybridGM3@398 for 97 with 4407 remaining (b = 0.01)
4737.23/597.08	c INFO: running FH@0 for 291 with 4403 remaining (b = 0.02)
4738.84/597.30	c INFO: running adaptg2wsat2009++@98 for 97 with 4403 remaining (b = 0.01)
4754.75/599.28	c INFO: running FH@100 for 291 with 4401 remaining (b = 0.02)
4769.08/601.07	c INFO: running hybridGM3@191 for 97 with 4399 remaining (b = 0.01)
4786.58/603.24	c INFO: running hybridGM3@96 for 97 with 4397 remaining (b = 0.01)
5465.31/688.54	c INFO: running hybridGM3@0 for 194 with 4312 remaining (b = 0.01)
5513.76/694.68	c INFO: running TNM@0 for 1552 with 4306 remaining (b = 0.11)
5545.57/698.63	c INFO: running hybridGM3@190 for 97 with 4302 remaining (b = 0.01)
5575.82/702.45	c INFO: running hybridGM3@388 for 97 with 4298 remaining (b = 0.01)
6334.85/797.81	c INFO: running iPAWS@0 for 97 with 4202 remaining (b = 0.01)
6392.12/805.07	c INFO: running hybridGM3@483 for 97 with 4195 remaining (b = 0.01)
7015.20/883.39	c INFO: running adaptg2wsat2009++@97 for 97 with 4117 remaining (b = 0.01)
7062.03/889.26	c INFO: running FH@194 for 194 with 4111 remaining (b = 0.01)
7092.27/893.08	c INFO: running adaptg2wsat2009++@97 for 97 with 4107 remaining (b = 0.01)
7167.02/902.45	c INFO: running gnovelty+2@0 for 97 with 4098 remaining (b = 0.01)
7173.37/903.29	c INFO: running hybridGM3@97 for 97 with 4097 remaining (b = 0.01)
7790.01/980.77	c INFO: running adaptg2wsat2009++@387 for 291 with 4019 remaining (b = 0.02)
7867.15/990.46	c INFO: running NCVWr@0 for 485 with 4010 remaining (b = 0.03)
7948.26/1000.68	c INFO: running FH@0 for 97 with 4000 remaining (b = 0.01)
7966.55/1002.92	c INFO: running hybridGM3@0 for 194 with 3997 remaining (b = 0.01)
8634.79/1086.95	c INFO: running iPAWS@0 for 97 with 3913 remaining (b = 0.01)
8739.12/1100.08	c INFO: running hybridGM3@0 for 194 with 3900 remaining (b = 0.01)
9432.69/1187.36	c INFO: running FH@100 for 291 with 3813 remaining (b = 0.02)
9532.82/1199.92	c INFO: running hybridGM3@0 for 194 with 3800 remaining (b = 0.01)
9533.78/1200.12	c INFO: running TNM@0 for 1552 with 3800 remaining (b = 0.07)
9533.78/1200.19	c INFO: running NCVWr@0 for 485 with 3800 remaining (b = 0.02)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385364-1305565833/watcher-3385364-1305565833 -o /tmp/evaluation-result-3385364-1305565833/solver-3385364-1305565833 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385364-1305565833.cnf -seed 170881425 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.33 7.75 4.92 1/401 6067
/proc/meminfo: memFree=23071916/32950928 swapFree=67056568/67111528
[pid=6067] ppid=6065 vsize=15184 CPUtime=0 cores=0-7
/proc/6067/stat : 6067 (python) R 6065 6067 5798 0 -1 4202496 724 0 0 0 0 0 0 0 21 0 1 0 668180412 15548416 615 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476690789 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/6067/statm: 3796 615 321 364 0 283 0

[startup+0.0160521 s]
/proc/loadavg: 8.33 7.75 4.92 1/401 6067
/proc/meminfo: memFree=23071916/32950928 swapFree=67056568/67111528
[pid=6067] ppid=6065 vsize=15908 CPUtime=0 cores=0-7
/proc/6067/stat : 6067 (python) S 6065 6067 5798 0 -1 4202496 944 0 0 0 0 0 0 0 21 0 1 0 668180412 16289792 821 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476692992 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/6067/statm: 3978 827 357 364 0 465 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15908

[startup+0.101024 s]
/proc/loadavg: 8.33 7.75 4.92 1/401 6067
/proc/meminfo: memFree=23071916/32950928 swapFree=67056568/67111528
[pid=6067] ppid=6065 vsize=85620 CPUtime=0.06 cores=0-7
/proc/6067/stat : 6067 (python) S 6065 6067 5798 0 -1 4202496 2629 0 0 0 4 2 0 0 18 0 1 0 668180412 87674880 2348 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476692992 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/6067/statm: 21406 2349 713 364 0 1623 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85620

[startup+0.300975 s]
/proc/loadavg: 8.33 7.75 4.92 1/401 6067
/proc/meminfo: memFree=23071916/32950928 swapFree=67056568/67111528
[pid=6067] ppid=6065 vsize=135748 CPUtime=0.17 cores=0-7
/proc/6067/stat : 6067 (python) S 6065 6067 5798 0 -1 4202496 5966 932 1 0 12 5 0 0 17 0 1 0 668180412 139005952 4151 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476690949 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/6067/statm: 33937 4151 1032 364 0 3123 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 135748

[startup+0.700925 s]
/proc/loadavg: 8.33 7.75 4.92 1/401 6067
/proc/meminfo: memFree=23071916/32950928 swapFree=67056568/67111528
[pid=6067] ppid=6065 vsize=279496 CPUtime=0.41 cores=0-7
/proc/6067/stat : 6067 (python) R 6065 6067 5798 0 -1 4202496 9541 932 1 0 30 11 0 0 16 0 1 0 668180412 286203904 7221 33554432000 4194304 5683644 140734678705056 18446744073709551615 4445119 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/6067/statm: 69874 7221 1761 364 0 5798 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 279496

[startup+1.50075 s]
/proc/loadavg: 8.33 7.75 4.92 2/402 6072
/proc/meminfo: memFree=23039172/32950928 swapFree=67056568/67111528
[pid=6067] ppid=6065 vsize=289496 CPUtime=1.2 cores=0-7
/proc/6067/stat : 6067 (python) R 6065 6067 5798 0 -1 4202496 13884 932 1 0 109 11 0 0 17 0 1 0 668180412 296443904 9759 33554432000 4194304 5683644 140734678705056 18446744073709551615 46955770666564 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/6067/statm: 72374 9759 1826 364 0 8298 0
Current children cumulated CPU time (s) 1.2
Current children cumulated vsize (KiB) 289496

[startup+3.10036 s]
/proc/loadavg: 8.33 7.75 4.92 2/402 6072
/proc/meminfo: memFree=23038924/32950928 swapFree=67056568/67111528
[pid=6067] ppid=6065 vsize=429956 CPUtime=2.65 cores=0-7
/proc/6067/stat : 6067 (python) S 6065 6067 5798 0 -1 4202496 20094 932 1 0 251 14 0 0 21 0 9 0 668180412 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6067/statm: 107489 8187 1891 364 0 43386 0
Current children cumulated CPU time (s) 2.65
Current children cumulated vsize (KiB) 429956

[startup+6.30175 s]
/proc/loadavg: 8.31 7.76 4.93 9/426 6096
/proc/meminfo: memFree=22975864/32950928 swapFree=67056568/67111528
[pid=6067] ppid=6065 vsize=429956 CPUtime=2.65 cores=0-7
/proc/6067/stat : 6067 (python) S 6065 6067 5798 0 -1 4202496 20094 932 1 0 251 14 0 0 21 0 9 0 668180412 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6067/statm: 107489 8187 1891 364 0 43386 0
[pid=6073] ppid=6067 vsize=282240 CPUtime=0 cores=0-7
/proc/6073/stat : 6073 (python) S 6067 6067 5798 0 -1 4202560 738 0 0 0 0 0 0 0 18 0 1 0 668180684 289013760 6331 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715023 0 0 16781312 514 14330022185396044036 0 0 17 1 0 0 0
/proc/6073/statm: 70560 6331 355 364 0 6478 0
[pid=6075] ppid=6073 vsize=1020188 CPUtime=3.57 cores=0-7
/proc/6075/stat : 6075 (gnovelty+2) R 6073 6075 6075 0 -1 4202496 1138 0 0 0 357 0 0 0 25 0 1 0 668180684 1044672512 877 33554432000 134512640 135663704 4291864704 18446744073709551615 134545619 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/6075/statm: 255047 877 113 282 0 254763 0
[pid=6076] ppid=6067 vsize=293124 CPUtime=0 cores=0-7
/proc/6076/stat : 6076 (python) S 6067 6067 5798 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 668180687 300158976 6368 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 2438739334690472193 0 0 17 1 0 0 0
/proc/6076/statm: 73281 6368 349 364 0 9196 0
[pid=6078] ppid=6076 vsize=1020188 CPUtime=3.55 cores=0-7
/proc/6078/stat : 6078 (gnovelty+2) R 6076 6078 6078 0 -1 4202496 1138 0 0 0 355 0 0 0 25 0 1 0 668180687 1044672512 877 33554432000 134512640 135663704 4289336160 18446744073709551615 134524945 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6078/statm: 255047 877 113 282 0 254763 0
[pid=6079] ppid=6067 vsize=368432 CPUtime=0 cores=0-7
/proc/6079/stat : 6079 (python) S 6067 6067 5798 0 -1 4202560 744 0 0 0 0 0 0 0 18 0 1 0 668180690 377274368 6507 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 11167472151412310273 0 0 17 1 0 0 0
/proc/6079/statm: 92108 6507 347 364 0 28020 0
[pid=6081] ppid=6079 vsize=421140 CPUtime=3.51 cores=0-7
/proc/6081/stat : 6081 (adaptg2wsat2009) R 6079 6081 6081 0 -1 4202496 1803 0 0 0 351 0 0 0 25 0 1 0 668180690 431247360 1538 33554432000 134512640 135107411 4291033664 18446744073709551615 134523261 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6081/statm: 105285 1538 49 146 0 104161 0
[pid=6082] ppid=6067 vsize=378688 CPUtime=0 cores=0-7
/proc/6082/stat : 6082 (python) S 6067 6067 5798 0 -1 4202560 757 0 0 0 0 0 0 0 18 0 1 0 668180693 387776512 6511 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 16506080491334500610 0 0 17 4 0 0 0
/proc/6082/statm: 94672 6511 347 364 0 30581 0
[pid=6084] ppid=6082 vsize=421140 CPUtime=3.48 cores=0-7
/proc/6084/stat : 6084 (adaptg2wsat2009) R 6082 6084 6084 0 -1 4202496 1803 0 0 0 348 0 0 0 25 0 1 0 668180693 431247360 1538 33554432000 134512640 135107411 4289461392 18446744073709551615 134523457 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/6084/statm: 105285 1538 49 146 0 104161 0
[pid=6085] ppid=6067 vsize=388944 CPUtime=0 cores=0-7
/proc/6085/stat : 6085 (python) S 6067 6067 5798 0 -1 4202560 762 0 0 0 0 0 0 0 18 0 1 0 668180696 398278656 6515 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 6504008481165508867 0 0 17 1 0 0 0
/proc/6085/statm: 97236 6515 347 364 0 33142 0
[pid=6087] ppid=6085 vsize=421140 CPUtime=3.45 cores=0-7
/proc/6087/stat : 6087 (adaptg2wsat2009) R 6085 6087 6087 0 -1 4202496 1807 0 0 0 345 0 0 0 25 0 1 0 668180697 431247360 1538 33554432000 134512640 135107411 4288235264 18446744073709551615 134523300 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/6087/statm: 105285 1538 49 146 0 104161 0
[pid=6088] ppid=6067 vsize=399200 CPUtime=0 cores=0-7
/proc/6088/stat : 6088 (python) S 6067 6067 5798 0 -1 4202560 769 0 0 0 0 0 0 0 18 0 1 0 668180699 408780800 6519 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 6504012329456206083 0 0 17 1 0 0 0
/proc/6088/statm: 99800 6519 347 364 0 35703 0
[pid=6090] ppid=6088 vsize=1020188 CPUtime=3.37 cores=0-7
/proc/6090/stat : 6090 (gnovelty+2) R 6088 6090 6090 0 -1 4202496 1141 0 0 0 337 0 0 0 25 0 1 0 668180700 1044672512 877 33554432000 134512640 135663704 4286931504 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6090/statm: 255047 877 113 282 0 254763 0
[pid=6091] ppid=6067 vsize=409456 CPUtime=0 cores=0-7
/proc/6091/stat : 6091 (python) S 6067 6067 5798 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 668180703 419282944 6695 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 11167475999703007491 0 0 17 1 0 0 0
/proc/6091/statm: 102364 6695 348 364 0 38264 0
[pid=6093] ppid=6091 vsize=249144 CPUtime=3.35 cores=0-7
/proc/6093/stat : 6093 (FH) R 6091 6093 6093 0 -1 4202496 1550 0 0 0 335 0 0 0 25 0 1 0 668180705 255123456 1295 33554432000 134512640 134936988 4290050336 18446744073709551615 134523665 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/6093/statm: 62286 1295 37 104 0 61790 0
[pid=6094] ppid=6067 vsize=419712 CPUtime=0 cores=0-7
/proc/6094/stat : 6094 (python) S 6067 6067 5798 0 -1 4202560 775 0 0 0 0 0 0 0 18 0 1 0 668180708 429785088 6646 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 4424288834296971523 0 0 17 0 0 0 0
/proc/6094/statm: 104928 6646 354 364 0 40825 0
[pid=6096] ppid=6094 vsize=421140 CPUtime=3.29 cores=0-7
/proc/6096/stat : 6096 (adaptg2wsat2009) R 6094 6096 6096 0 -1 4202496 1801 0 0 0 329 0 0 0 25 0 1 0 668180708 431247360 1538 33554432000 134512640 135107411 4292462784 18446744073709551615 134523294 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/6096/statm: 105285 1538 49 146 0 104161 0
[pid=6067/tid=6074] ppid=6065 vsize=429956 CPUtime=0 cores=0-7
/proc/6067/task/6074/stat : 6074 (python) S 6065 6067 5798 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 9 0 668180684 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 6 0 0 0
[pid=6067/tid=6077] ppid=6065 vsize=429956 CPUtime=0 cores=0-7
/proc/6067/task/6077/stat : 6077 (python) S 6065 6067 5798 0 -1 4202560 20 932 0 0 0 0 0 0 18 0 9 0 668180687 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 3 0 0 0
[pid=6067/tid=6080] ppid=6065 vsize=429956 CPUtime=0 cores=0-7
/proc/6067/task/6080/stat : 6080 (python) S 6065 6067 5798 0 -1 4202560 24 932 0 0 0 0 0 0 19 0 9 0 668180690 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 6 0 0 0
[pid=6067/tid=6083] ppid=6065 vsize=429956 CPUtime=0 cores=0-7
/proc/6067/task/6083/stat : 6083 (python) S 6065 6067 5798 0 -1 4202560 24 932 0 0 0 0 0 0 20 0 9 0 668180693 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 6 0 0 0
[pid=6067/tid=6086] ppid=6065 vsize=429956 CPUtime=0 cores=0-7
/proc/6067/task/6086/stat : 6086 (python) S 6065 6067 5798 0 -1 4202560 21 932 0 0 0 0 0 0 19 0 9 0 668180696 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 4 0 0 0
[pid=6067/tid=6089] ppid=6065 vsize=429956 CPUtime=0 cores=0-7
/proc/6067/task/6089/stat : 6089 (python) S 6065 6067 5798 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 9 0 668180700 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 7 0 0 0
[pid=6067/tid=6092] ppid=6065 vsize=429956 CPUtime=0 cores=0-7
/proc/6067/task/6092/stat : 6092 (python) S 6065 6067 5798 0 -1 4202560 101 932 0 0 0 0 0 0 19 0 9 0 668180703 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 1 0 0 0
[pid=6067/tid=6095] ppid=6065 vsize=429956 CPUtime=0 cores=0-7
/proc/6067/task/6095/stat : 6095 (python) S 6065 6067 5798 0 -1 4202560 33 932 0 0 0 0 0 0 21 0 9 0 668180708 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 30.22
Current children cumulated vsize (KiB) 8364020

[startup+12.7015 s]
/proc/loadavg: 8.28 7.76 4.95 9/426 6096
/proc/meminfo: memFree=22968704/32950928 swapFree=67056568/67111528
[pid=6067] ppid=6065 vsize=429956 CPUtime=2.65 cores=0-7
/proc/6067/stat : 6067 (python) S 6065 6067 5798 0 -1 4202496 20094 932 1 0 251 14 0 0 21 0 9 0 668180412 440274944 8187 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6067/statm: 107489 8187 1891 364 0 43386 0
[pid=6073] ppid=6067 vsize=282240 CPUtime=0.01 cores=0-7
/proc/6073/stat : 6073 (python) S 6067 6067 5798 0 -1 4202560 902 0 0 0 0 1 0 0 18 0 1 0 668180684 289013760 6354 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715023 0 0 16781312 514 14330022185396044036 0 0 17 1 0 0 0
/proc/6073/statm: 70560 6354 378 364 0 6478 0
[pid=6075] ppid=6073 vsize=1020188 CPUtime=9.97 cores=0-7
/proc/6075/stat : 6075 (gnovelty+2) R 6073 6075 6075 0 -1 4202496 1138 0 0 0 997 0 0 0 25 0 1 0 668180684 1044672512 877 33554432000 134512640 135663704 4291864704 18446744073709551615 134525276 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/6075/statm: 255047 877 113 282 0 254763 0
[pid=6076] ppid=6067 vsize=293124 CPUtime=0.01 cores=0-7
/proc/6076/stat : 6076 (python) S 6067 6067 5798 0 -1 4202560 905 0 0 0 1 0 0 0 18 0 1 0 668180687 300158976 6391 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 2438739334690472193 0 0 17 1 0 0 0
/proc/6076/statm: 73281 6391 372 364 0 9196 0
[pid=6078] ppid=6076 vsize=1020188 CPUtime=9.95 cores=0-7
/proc/6078/stat : 6078 (gnovelty+2) R 6076 6078 6078 0 -1 4202496 1138 0 0 0 995 0 0 0 25 0 1 0 668180687 1044672512 877 33554432000 134512640 135663704 4289336160 18446744073709551615 134524509 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6078/statm: 255047 877 113 282 0 254763 0
[pid=6079] ppid=6067 vsize=368432 CPUtime=0 cores=0-7
/proc/6079/stat : 6079 (python) S 6067 6067 5798 0 -1 4202560 909 0 0 0 0 0 0 0 18 0 1 0 668180690 377274368 6529 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 11167472151412310273 0 0 17 1 0 0 0
/proc/6079/statm: 92108 6529 369 364 0 28020 0
[pid=6081] ppid=6079 vsize=421804 CPUtime=9.91 cores=0-7
/proc/6081/stat : 6081 (adaptg2wsat2009) R 6079 6081 6081 0 -1 4202496 2136 0 0 0 991 0 0 0 25 0 1 0 668180690 431927296 1871 33554432000 134512640 135107411 4291033664 18446744073709551615 134531435 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6081/statm: 105451 1871 59 146 0 104327 0
[pid=6082] ppid=6067 vsize=378688 CPUtime=0.01 cores=0-7
/proc/6082/stat : 6082 (python) S 6067 6067 5798 0 -1 4202560 930 0 0 0 0 1 0 0 18 0 1 0 668180693 387776512 6534 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 16506080491334500610 0 0 17 4 0 0 0
/proc/6082/statm: 94672 6534 370 364 0 30581 0
[pid=6084] ppid=6082 vsize=421804 CPUtime=9.88 cores=0-7
/proc/6084/stat : 6084 (adaptg2wsat2009) R 6082 6084 6084 0 -1 4202496 2136 0 0 0 988 0 0 0 25 0 1 0 668180693 431927296 1871 33554432000 134512640 135107411 4289461392 18446744073709551615 134532349 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/6084/statm: 105451 1871 59 146 0 104327 0
[pid=6085] ppid=6067 vsize=388944 CPUtime=0.01 cores=0-7
/proc/6085/stat : 6085 (python) S 6067 6067 5798 0 -1 4202560 924 0 0 0 0 1 0 0 18 0 1 0 668180696 398278656 6538 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 6504008481165508867 0 0 17 1 0 0 0
/proc/6085/statm: 97236 6538 370 364 0 33142 0
[pid=6087] ppid=6085 vsize=421804 CPUtime=9.83 cores=0-7
/proc/6087/stat : 6087 (adaptg2wsat2009) R 6085 6087 6087 0 -1 4202496 2141 0 0 0 983 0 0 0 25 0 1 0 668180697 431927296 1872 33554432000 134512640 135107411 4288235264 18446744073709551615 134532288 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/6087/statm: 105451 1872 59 146 0 104327 0
[pid=6088] ppid=6067 vsize=399200 CPUtime=0.01 cores=0-7
/proc/6088/stat : 6088 (python) S 6067 6067 5798 0 -1 4202560 956 0 0 0 0 1 0 0 18 0 1 0 668180699 408780800 6542 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 6504012329456206083 0 0 17 1 0 0 0
/proc/6088/statm: 99800 6542 370 364 0 35703 0
[pid=6090] ppid=6088 vsize=1020188 CPUtime=9.67 cores=0-7
/proc/6090/stat : 6090 (gnovelty+2) R 6088 6090 6090 0 -1 4202496 1141 0 0 0 967 0 0 0 25 0 1 0 668180700 1044672512 877 33554432000 134512640 135663704 4286931504 18446744073709551615 134524553 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6090/statm: 255047 877 113 282 0 254763 0
[pid=6091] ppid=6067 vsize=409456 CPUtime=0.01 cores=0-7
/proc/6091/stat : 6091 (python) S 6067 6067 5798 0 -1 4202560 815 0 0 0 1 0 0 0 18 0 1 0 668180703 419282944 6718 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 11167475999703007491 0 0 17 1 0 0 0
/proc/6091/statm: 102364 6718 371 364 0 38264 0

################
# More data... #
################

/proc/6165/statm: 83999 1749 59 147 0 83851 0
[pid=6163/tid=6172] ppid=6067 vsize=563296 CPUtime=0 cores=0-7
/proc/6163/task/6172/stat : 6172 (python) S 6067 6067 5798 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 668230597 576815104 7062 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 514 18446604470545409024 0 0 -1 0 0 0 0
[pid=6169] ppid=6067 vsize=573552 CPUtime=0.33 cores=0-7
/proc/6169/stat : 6169 (python) S 6067 6067 5798 0 -1 4202560 1194 0 0 0 15 18 0 0 19 0 2 0 668230076 587317248 7038 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/6169/statm: 143388 7038 406 364 0 79240 0
[pid=6171] ppid=6169 vsize=1020188 CPUtime=99.97 cores=0-7
/proc/6171/stat : 6171 (gnovelty+2) T 6169 6171 6171 0 -1 4202496 1161 0 0 0 9997 0 0 0 25 0 1 0 668230077 1044672512 876 33554432000 134512640 135663704 4292739344 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/6171/statm: 255047 876 113 282 0 254763 0
[pid=6169/tid=6177] ppid=6067 vsize=573552 CPUtime=0 cores=0-7
/proc/6169/task/6177/stat : 6177 (python) S 6067 6067 5798 0 -1 4202560 87 0 0 0 0 0 0 0 19 0 2 0 668240115 587317248 7038 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 514 18446604470545408128 0 0 -1 2 0 0 0
[pid=6181] ppid=6067 vsize=583808 CPUtime=0.99 cores=0-7
/proc/6181/stat : 6181 (python) S 6067 6067 5798 0 -1 4202560 1219 0 0 0 48 51 0 0 18 0 2 0 668249266 597819392 7047 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6181/statm: 145952 7047 407 364 0 81801 0
[pid=6183] ppid=6181 vsize=268424 CPUtime=292.09 cores=0-7
/proc/6183/stat : 6183 (hybridGM3) T 6181 6183 6183 0 -1 4202496 5662 0 0 0 29209 0 0 0 25 0 1 0 668249267 274866176 5376 33554432000 134512640 135204385 4291812832 18446744073709551615 134538375 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/6183/statm: 67106 5376 63 169 0 66936 0
[pid=6181/tid=6195] ppid=6067 vsize=583808 CPUtime=0 cores=0-7
/proc/6181/task/6195/stat : 6195 (python) S 6067 6067 5798 0 -1 4202560 94 0 0 0 0 0 0 0 18 0 2 0 668268746 597819392 7047 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 514 18446604460168180672 0 0 -1 4 0 0 0
[pid=6184] ppid=6067 vsize=594064 CPUtime=1.7 cores=0-7
/proc/6184/stat : 6184 (python) S 6067 6067 5798 0 -1 4202560 989 0 0 0 94 76 0 0 18 0 1 0 668249881 608321536 7112 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 13473837699232137479 0 0 17 0 0 0 0
/proc/6184/statm: 148516 7112 372 364 0 84362 0
[pid=6186] ppid=6184 vsize=459768 CPUtime=503.36 cores=0-7
/proc/6186/stat : 6186 (TNM) R 6184 6186 6186 0 -1 4202496 1940 0 0 0 50336 0 0 0 25 0 1 0 668249881 470802432 1657 33554432000 134512640 135008748 4287814464 18446744073709551615 134529367 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6186/statm: 114942 1657 46 122 0 113842 0
[pid=6190] ppid=6067 vsize=604320 CPUtime=0.36 cores=0-7
/proc/6190/stat : 6190 (python) S 6067 6067 5798 0 -1 4202560 1185 0 0 0 18 18 0 0 19 0 2 0 668260193 618823680 7055 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/6190/statm: 151080 7055 400 364 0 86923 0
[pid=6192] ppid=6190 vsize=335996 CPUtime=100.73 cores=0-7
/proc/6192/stat : 6192 (iPAWS) T 6190 6192 6192 0 -1 4202496 2034 0 0 0 10073 0 0 0 25 0 1 0 668260194 344059904 1749 33554432000 134512640 135114423 4288233888 18446744073709551615 134516669 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/6192/statm: 83999 1749 59 147 0 83851 0
[pid=6190/tid=6200] ppid=6067 vsize=604320 CPUtime=0 cores=0-7
/proc/6190/task/6200/stat : 6200 (python) S 6067 6067 5798 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 668270736 618823680 7055 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 514 18446604454373907520 0 0 -1 0 0 0 0
[pid=6197] ppid=6067 vsize=614576 CPUtime=0.34 cores=0-7
/proc/6197/stat : 6197 (python) S 6067 6067 5798 0 -1 4202560 1218 0 0 0 18 16 0 0 19 0 2 0 668270657 629325824 7063 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6197/statm: 153644 7063 400 364 0 89484 0
[pid=6199] ppid=6197 vsize=1020188 CPUtime=99.51 cores=0-7
/proc/6199/stat : 6199 (gnovelty+2) T 6197 6199 6199 0 -1 4202496 1158 0 0 0 9951 0 0 0 25 0 1 0 668270660 1044672512 877 33554432000 134512640 135663704 4292124480 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/6199/statm: 255047 877 113 282 0 254763 0
[pid=6197/tid=6209] ppid=6067 vsize=614576 CPUtime=0 cores=0-7
/proc/6197/task/6209/stat : 6209 (python) S 6067 6067 5798 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 668280698 629325824 7063 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 514 18446604455697543424 0 0 -1 0 0 0 0
[pid=6203] ppid=6067 vsize=624832 CPUtime=0.72 cores=0-7
/proc/6203/stat : 6203 (python) S 6067 6067 5798 0 -1 4202560 1012 0 0 0 36 36 0 0 18 0 1 0 668279459 639827968 7074 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 13473837699232137477 0 0 17 7 0 0 0
/proc/6203/statm: 156208 7074 372 364 0 92045 0
[pid=6205] ppid=6203 vsize=421344 CPUtime=209.43 cores=0-7
/proc/6205/stat : 6205 (NCVWr) R 6203 6205 6205 0 -1 4202496 1995 0 0 0 20943 0 0 0 25 0 1 0 668279459 431456256 1713 33554432000 134512640 135113558 4293506160 18446744073709551615 134531766 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/6205/statm: 105336 1713 58 147 0 104211 0
[pid=6206] ppid=6067 vsize=635088 CPUtime=0.34 cores=0-7
/proc/6206/stat : 6206 (python) S 6067 6067 5798 0 -1 4202560 1254 0 0 0 17 17 0 0 19 0 2 0 668280480 650330112 7115 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6206/statm: 158772 7115 406 364 0 94606 0
[pid=6208] ppid=6206 vsize=251292 CPUtime=98.85 cores=0-7
/proc/6208/stat : 6208 (FH) T 6206 6208 6208 0 -1 4202496 1984 0 0 0 9884 1 0 0 25 0 1 0 668280481 257323008 1694 33554432000 134512640 134936988 4293039872 18446744073709551615 134552472 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/6208/statm: 62823 1694 41 104 0 62327 0
[pid=6206/tid=6219] ppid=6067 vsize=635088 CPUtime=0 cores=0-7
/proc/6206/task/6219/stat : 6219 (python) S 6067 6067 5798 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 668290414 650330112 7115 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 514 18446604459839290304 0 0 -1 0 0 0 0
[pid=6210] ppid=6067 vsize=645344 CPUtime=0.66 cores=0-7
/proc/6210/stat : 6210 (python) S 6067 6067 5798 0 -1 4202560 1255 0 0 0 32 34 0 0 19 0 2 0 668280704 660832256 7177 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6210/statm: 161336 7177 406 364 0 97167 0
[pid=6212] ppid=6210 vsize=268428 CPUtime=195.79 cores=0-7
/proc/6212/stat : 6212 (hybridGM3) T 6210 6212 6212 0 -1 4202496 5665 0 0 0 19579 0 0 0 25 0 1 0 668280705 274870272 5378 33554432000 134512640 135204385 4288128640 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/6212/statm: 67107 5378 63 169 0 66937 0
[pid=6210/tid=6227] ppid=6067 vsize=645344 CPUtime=0 cores=0-7
/proc/6210/task/6227/stat : 6227 (python) S 6067 6067 5798 0 -1 4202560 89 0 0 0 0 0 0 0 19 0 2 0 668300398 660832256 7177 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 514 18446604462808368320 0 0 -1 6 0 0 0
[pid=6216] ppid=6067 vsize=655600 CPUtime=0.34 cores=0-7
/proc/6216/stat : 6216 (python) S 6067 6067 5798 0 -1 4202560 1268 0 0 0 19 15 0 0 19 0 2 0 668289108 671334400 7103 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6216/statm: 163900 7103 407 364 0 99728 0
[pid=6218] ppid=6216 vsize=335996 CPUtime=99.62 cores=0-7
/proc/6218/stat : 6218 (iPAWS) T 6216 6218 6218 0 -1 4202496 2037 0 0 0 9962 0 0 0 25 0 1 0 668289108 344059904 1749 33554432000 134512640 135114423 4291263504 18446744073709551615 134516669 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/6218/statm: 83999 1749 59 147 0 83851 0
[pid=6216/tid=6225] ppid=6067 vsize=655600 CPUtime=0 cores=0-7
/proc/6216/task/6225/stat : 6225 (python) S 6067 6067 5798 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 668299142 671334400 7103 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 514 18446604456944422976 0 0 -1 0 0 0 0
[pid=6220] ppid=6067 vsize=665856 CPUtime=0.34 cores=0-7
/proc/6220/stat : 6220 (python) S 6067 6067 5798 0 -1 4202560 1068 0 0 0 17 17 0 0 18 0 1 0 668290420 681836544 7202 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 13473837699232137478 0 0 17 1 0 0 0
/proc/6220/statm: 166464 7202 379 364 0 102289 0
[pid=6222] ppid=6220 vsize=268424 CPUtime=98.68 cores=0-7
/proc/6222/stat : 6222 (hybridGM3) R 6220 6222 6222 0 -1 4202496 5670 0 0 0 9868 0 0 0 25 0 1 0 668290421 274866176 5378 33554432000 134512640 135204385 4293200304 18446744073709551615 134537939 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/6222/statm: 67106 5378 63 169 0 66936 0
[pid=6228] ppid=6067 vsize=676112 CPUtime=0 cores=0-7
/proc/6228/stat : 6228 (python) S 6067 6067 5798 0 -1 4202560 973 0 0 0 0 0 0 0 19 0 1 0 668300404 692338688 7115 33554432000 4194304 5683644 140734678705056 18446744073709551615 239476715078 0 0 16781312 514 17198069129391636479 0 0 17 1 0 0 0
/proc/6228/statm: 169028 7115 356 364 0 104850 0
[pid=6230] ppid=6228 vsize=268420 CPUtime=0.09 cores=0-7
/proc/6230/stat : 6230 (hybridGM3) R 6228 6230 6230 0 -1 4202496 5668 0 0 0 9 0 0 0 21 0 1 0 668300405 274862080 5377 33554432000 134512640 135204385 4287268112 18446744073709551615 134538284 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/6230/statm: 67105 5377 63 169 0 66935 0
[pid=6067/tid=6074] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6074/stat : 6074 (python) S 6065 6067 5798 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 34 0 668180684 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 6 0 0 0
[pid=6067/tid=6077] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6077/stat : 6077 (python) S 6065 6067 5798 0 -1 4202560 20 932 0 0 0 0 0 0 18 0 34 0 668180687 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 3 0 0 0
[pid=6067/tid=6080] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6080/stat : 6080 (python) S 6065 6067 5798 0 -1 4202560 45 932 0 0 0 0 0 0 15 0 34 0 668180690 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 6 0 0 0
[pid=6067/tid=6083] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6083/stat : 6083 (python) S 6065 6067 5798 0 -1 4202560 32 932 0 0 0 0 0 0 18 0 34 0 668180693 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 6 0 0 0
[pid=6067/tid=6086] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6086/stat : 6086 (python) S 6065 6067 5798 0 -1 4202560 33 932 0 0 0 0 0 0 18 0 34 0 668180696 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 4 0 0 0
[pid=6067/tid=6089] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6089/stat : 6089 (python) S 6065 6067 5798 0 -1 4202560 29 932 0 0 0 0 0 0 18 0 34 0 668180700 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 7 0 0 0
[pid=6067/tid=6092] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6092/stat : 6092 (python) S 6065 6067 5798 0 -1 4202560 108 932 0 0 0 0 0 0 18 0 34 0 668180703 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 1 0 0 0
[pid=6067/tid=6095] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6095/stat : 6095 (python) S 6065 6067 5798 0 -1 4202560 39 932 0 0 0 0 0 0 18 0 34 0 668180708 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 0 0 0 0
[pid=6067/tid=6101] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6101/stat : 6101 (python) S 6065 6067 5798 0 -1 4202560 46 932 0 0 0 0 0 0 18 0 34 0 668190722 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 0 0 0 0
[pid=6067/tid=6108] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6108/stat : 6108 (python) S 6065 6067 5798 0 -1 4202560 42 932 0 0 0 0 0 0 18 0 34 0 668190727 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 2 0 0 0
[pid=6067/tid=6111] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6111/stat : 6111 (python) S 6065 6067 5798 0 -1 4202560 48 932 0 0 0 0 0 0 18 0 34 0 668190731 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 3 0 0 0
[pid=6067/tid=6115] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6115/stat : 6115 (python) S 6065 6067 5798 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 34 0 668190735 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 1 0 0 0
[pid=6067/tid=6119] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6119/stat : 6119 (python) S 6065 6067 5798 0 -1 4202560 57 932 0 0 0 0 0 0 18 0 34 0 668190739 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 5 0 0 0
[pid=6067/tid=6123] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6123/stat : 6123 (python) S 6065 6067 5798 0 -1 4202560 38 932 0 0 0 0 0 0 18 0 34 0 668190744 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 3 0 0 0
[pid=6067/tid=6126] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6126/stat : 6126 (python) S 6065 6067 5798 0 -1 4202560 39 932 0 0 0 0 0 0 18 0 34 0 668190749 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 3 0 0 0
[pid=6067/tid=6129] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6129/stat : 6129 (python) S 6065 6067 5798 0 -1 4202560 47 932 0 0 0 0 0 0 18 0 34 0 668190754 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 7 0 0 0
[pid=6067/tid=6137] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6137/stat : 6137 (python) S 6065 6067 5798 0 -1 4202560 33 932 0 0 0 0 0 0 19 0 34 0 668200761 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 7 0 0 0
[pid=6067/tid=6140] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6140/stat : 6140 (python) S 6065 6067 5798 0 -1 4202560 41 932 0 0 0 0 0 0 18 0 34 0 668200767 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 7 0 0 0
[pid=6067/tid=6153] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6153/stat : 6153 (python) S 6065 6067 5798 0 -1 4202560 63 932 0 0 0 0 0 0 18 0 34 0 668210705 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 7 0 0 0
[pid=6067/tid=6158] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6158/stat : 6158 (python) S 6065 6067 5798 0 -1 4202560 44 932 0 0 0 0 0 0 18 0 34 0 668220249 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 7 0 0 0
[pid=6067/tid=6161] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6161/stat : 6161 (python) S 6065 6067 5798 0 -1 4202560 37 932 0 0 0 0 0 0 22 0 34 0 668220255 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 5 0 0 0
[pid=6067/tid=6164] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6164/stat : 6164 (python) S 6065 6067 5798 0 -1 4202560 37 932 0 0 0 0 0 0 20 0 34 0 668220563 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 5 0 0 0
[pid=6067/tid=6170] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6170/stat : 6170 (python) S 6065 6067 5798 0 -1 4202560 37 932 0 0 0 0 0 0 20 0 34 0 668230076 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 0 0 0 0
[pid=6067/tid=6182] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6182/stat : 6182 (python) S 6065 6067 5798 0 -1 4202560 49 932 0 0 0 0 0 0 18 0 34 0 668249267 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 0 0 0 0
[pid=6067/tid=6185] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6185/stat : 6185 (python) S 6065 6067 5798 0 -1 4202560 34 932 0 0 0 0 0 0 19 0 34 0 668249881 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 1 0 0 0
[pid=6067/tid=6191] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6191/stat : 6191 (python) S 6065 6067 5798 0 -1 4202560 35 932 0 0 0 0 0 0 20 0 34 0 668260194 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 0 0 0 0
[pid=6067/tid=6198] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6198/stat : 6198 (python) S 6065 6067 5798 0 -1 4202560 35 932 0 0 0 0 0 0 19 0 34 0 668270658 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 1 0 0 0
[pid=6067/tid=6204] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6204/stat : 6204 (python) S 6065 6067 5798 0 -1 4202560 36 932 0 0 0 0 0 0 20 0 34 0 668279459 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 0 0 0 0
[pid=6067/tid=6207] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6207/stat : 6207 (python) S 6065 6067 5798 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 34 0 668280481 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 1 0 0 0
[pid=6067/tid=6211] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6211/stat : 6211 (python) S 6065 6067 5798 0 -1 4202560 32 932 0 0 0 0 0 0 20 0 34 0 668280705 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 1 0 0 0
[pid=6067/tid=6217] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6217/stat : 6217 (python) S 6065 6067 5798 0 -1 4202560 32 932 0 0 0 0 0 0 19 0 34 0 668289108 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 1 0 0 0
[pid=6067/tid=6221] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6221/stat : 6221 (python) S 6065 6067 5798 0 -1 4202560 34 932 0 0 0 0 0 0 20 0 34 0 668290421 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 1 0 0 0
[pid=6067/tid=6229] ppid=6065 vsize=686356 CPUtime=0 cores=0-7
/proc/6067/task/6229/stat : 6229 (python) S 6065 6067 5798 0 -1 4202560 34 932 0 0 0 0 0 0 20 0 34 0 668300404 702828544 8705 33554432000 4194304 5683644 140734678705056 18446744073709551615 239488518577 0 0 16781312 2 18446604443928450304 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9533.78
Current children cumulated vsize (KiB) 32677932

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6067 and gives
#  childrusage.ru_utime.tv_sec=2137
#  childrusage.ru_utime.tv_usec=924986
#  childrusage.ru_stime.tv_sec=14
#  childrusage.ru_stime.tv_usec=630775
# CPU time returned by wait4() is 2152.56
# while last known CPU time is 9533.78
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1200.23
CPU time (s): 9533.78
CPU user time (s): 9517.94
CPU system time (s): 15.84
CPU usage (%): 794.328
Max. virtual memory (cumulated for all children) (KiB): 32677932

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2137.92
system time used= 14.6308
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 95112
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14419
involuntary context switches= 11341

runsolver used 14.3238 second user time and 30.6133 second system time

The end

Launcher Data 

Begin job on node148 at 2011-05-16 19:10:33
IDJOB=3385364
IDBENCH=82629
IDSOLVER=1870
FILE ID=node148/3385364-1305565833
RUNJOBID= node148-1305564960-5812
PBS_JOBID= 13350102
Free space on /tmp= 72928 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S1275797759-041-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385364-1305565833/watcher-3385364-1305565833 -o /tmp/evaluation-result-3385364-1305565833/solver-3385364-1305565833 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385364-1305565833.cnf -seed 170881425 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 374e3ba6783d13d6d478972802d8dba0
RANDOM SEED=170881425

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23072320 kB
Buffers:        350464 kB
Cached:        4993124 kB
SwapCached:       8488 kB
Active:        6305372 kB
Inactive:      3215968 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23072320 kB
SwapTotal:    67111528 kB
SwapFree:     67056568 kB
Dirty:           32608 kB
Writeback:           0 kB
AnonPages:     4175464 kB
Mapped:          31724 kB
Slab:           250296 kB
PageTables:      36200 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 105086296 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72896 MiB
End job on node148 at 2011-05-16 19:30:36