Trace number 3385281

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 9331.46 1174.92

General information on the benchmark

Namerandom/large/
unif-k7-r85-v300-c25500-S1286362348-008-UNKNOWN.cnf
MD5SUM63b66954174098a654eacd27832fcf38
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses25500
Sum of the clauses size178500
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 525500

Solver Data 

0.40/0.92	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.40/0.92	c INFO: solving HOME/instance-3385281-1305564967.cnf
0.40/0.92	c INFO: computing task features
0.51/1.10	c INFO: computed variable-clause graph statistics
0.51/1.10	c INFO: computed clause balance statistics
1.39/1.98	c INFO: computed variable balance statistics
1.79/2.35	c INFO: computed small-clause counts
1.79/2.35	c INFO: computed Horn-clause counts
1.79/2.38	c INFO: computed variable graph statistics
1.79/2.38	c INFO: collected features for HOME/instance-3385281-1305564967.cnf in 1.45 s
1.90/2.41	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.37)
1.90/2.44	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
1.90/2.47	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.08)
2.00/2.50	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
2.00/2.53	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.05)
2.00/2.56	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.04)
2.00/2.59	c INFO: running FH@0 for 97 with 4998 remaining (b = 0.03)
2.10/2.62	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.03)
802.46/102.81	c INFO: running adaptg2wsat2009++@0 for 97 with 4898 remaining (b = 0.02)
802.46/102.85	c INFO: running FH@0 for 97 with 4898 remaining (b = 0.02)
802.46/102.89	c INFO: running hybridGM3@0 for 194 with 4898 remaining (b = 0.04)
803.10/102.93	c INFO: running gnovelty+2@0 for 97 with 4898 remaining (b = 0.02)
803.10/102.97	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
803.41/103.02	c INFO: running adaptg2wsat2009++@0 for 97 with 4897 remaining (b = 0.01)
803.41/103.07	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.03)
803.50/103.14	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.02)
1602.52/203.23	c INFO: running TNM@0 for 1552 with 4797 remaining (b = 0.19)
1602.52/203.28	c INFO: running FH@0 for 97 with 4797 remaining (b = 0.01)
1604.15/203.42	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
1604.15/203.47	c INFO: running adaptg2wsat2009++@0 for 97 with 4797 remaining (b = 0.01)
2370.24/299.69	c INFO: running hybridGM3@100 for 97 with 4701 remaining (b = 0.01)
2371.02/299.76	c INFO: running hybridGM3@98 for 97 with 4701 remaining (b = 0.01)
2372.59/299.93	c INFO: running hybridGM3@99 for 97 with 4701 remaining (b = 0.01)
2379.77/300.81	c INFO: running adaptg2wsat2009++@0 for 97 with 4700 remaining (b = 0.01)
2379.77/300.87	c INFO: running adaptg2wsat2009++@100 for 97 with 4700 remaining (b = 0.01)
2394.06/302.69	c INFO: running hybridGM3@0 for 194 with 4698 remaining (b = 0.02)
2412.33/304.94	c INFO: running hybridGM3@97 for 97 with 4696 remaining (b = 0.01)
3130.00/395.07	c INFO: running hybridGM3@296 for 97 with 4605 remaining (b = 0.01)
3130.81/395.13	c INFO: running hybridGM3@293 for 97 with 4605 remaining (b = 0.01)
3155.63/398.25	c INFO: running TNM@0 for 1552 with 4602 remaining (b = 0.15)
3156.24/398.31	c INFO: running adaptg2wsat2009++@100 for 97 with 4602 remaining (b = 0.01)
3181.08/401.43	c INFO: running iPAWS@0 for 97 with 4599 remaining (b = 0.01)
3219.95/406.36	c INFO: running hybridGM3@192 for 97 with 4594 remaining (b = 0.01)
3931.20/495.71	c INFO: running FH@0 for 291 with 4505 remaining (b = 0.03)
3936.76/496.48	c INFO: running hybridGM3@392 for 97 with 4504 remaining (b = 0.01)
3937.55/496.57	c INFO: running gnovelty+2@0 for 97 with 4504 remaining (b = 0.01)
3960.77/499.50	c INFO: running hybridGM3@390 for 97 with 4501 remaining (b = 0.01)
3978.92/501.75	c INFO: running adaptg2wsat2009++@100 for 97 with 4499 remaining (b = 0.01)
4027.49/507.87	c INFO: running hybridGM3@0 for 194 with 4493 remaining (b = 0.02)
4696.43/591.87	c INFO: running FH@100 for 291 with 4409 remaining (b = 0.02)
4705.19/592.94	c INFO: running hybridGM3@484 for 97 with 4408 remaining (b = 0.01)
4729.73/596.04	c INFO: running hybridGM3@0 for 194 with 4404 remaining (b = 0.02)
4754.40/599.16	c INFO: running TNM@0 for 1455 with 4401 remaining (b = 0.11)
5511.66/694.35	c INFO: running iPAWS@0 for 97 with 4306 remaining (b = 0.01)
5593.57/704.70	c INFO: running hybridGM3@94 for 97 with 4296 remaining (b = 0.01)
6295.23/792.86	c INFO: running hybridGM3@96 for 97 with 4208 remaining (b = 0.01)
6310.33/794.78	c INFO: running hybridGM3@0 for 194 with 4206 remaining (b = 0.02)
6335.75/797.96	c INFO: running adaptg2wsat2009++@100 for 97 with 4203 remaining (b = 0.01)
6400.98/806.12	c INFO: running gnovelty+2@0 for 97 with 4194 remaining (b = 0.01)
7003.92/881.96	c INFO: running hybridGM3@0 for 194 with 4119 remaining (b = 0.01)
7094.55/893.30	c INFO: running adaptg2wsat2009++@97 for 97 with 4107 remaining (b = 0.01)
7102.63/894.39	c INFO: running FH@0 for 97 with 4106 remaining (b = 0.01)
7199.51/906.60	c INFO: running hybridGM3@0 for 194 with 4094 remaining (b = 0.01)
7869.18/990.74	c INFO: running NCVWr@0 for 485 with 4010 remaining (b = 0.03)
7876.32/991.63	c INFO: running hybridGM3@291 for 194 with 4009 remaining (b = 0.01)
7949.45/1000.88	c INFO: running adaptg2wsat2009++@193 for 97 with 4000 remaining (b = 0.01)
8569.29/1078.82	c INFO: running hybridGM3@100 for 97 with 3922 remaining (b = 0.01)
8724.23/1098.32	c INFO: running adaptg2wsat2009++@389 for 194 with 3902 remaining (b = 0.01)
8764.74/1103.47	c INFO: running hybridGM3@97 for 97 with 3897 remaining (b = 0.01)
9327.26/1174.23	c INFO: running iPAWS@0 for 97 with 3826 remaining (b = 0.01)
9331.46/1174.90	c INFO: running hybridGM3@0 for 194 with 3826 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385281-1305564967/watcher-3385281-1305564967 -o /tmp/evaluation-result-3385281-1305564967/solver-3385281-1305564967 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385281-1305564967.cnf -seed 592305601 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 1/447 23683
/proc/meminfo: memFree=24607712/32951124 swapFree=53501260/67111528
[pid=23683] ppid=23681 vsize=16240 CPUtime=0 cores=0-7
/proc/23683/stat : 23683 (python) R 23681 23683 23657 0 -1 4202496 996 0 0 0 0 0 0 0 17 0 1 0 668099347 16629760 870 33554432000 4194304 5683644 140737470003408 18446744073709551615 4509181 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23683/statm: 4060 870 368 364 0 547 0

[startup+0.0378991 s]
/proc/loadavg: 0.00 0.00 0.00 1/447 23683
/proc/meminfo: memFree=24607712/32951124 swapFree=53501260/67111528
[pid=23683] ppid=23681 vsize=16536 CPUtime=0.01 cores=0-7
/proc/23683/stat : 23683 (python) S 23681 23683 23657 0 -1 4202496 1183 0 0 0 1 0 0 0 17 0 1 0 668099347 16932864 1046 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634513408 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/23683/statm: 4134 1046 417 364 0 621 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16536

[startup+0.100863 s]
/proc/loadavg: 0.00 0.00 0.00 1/447 23683
/proc/meminfo: memFree=24607712/32951124 swapFree=53501260/67111528
[pid=23683] ppid=23681 vsize=54536 CPUtime=0.04 cores=0-7
/proc/23683/stat : 23683 (python) S 23681 23683 23657 0 -1 4202496 2055 0 0 0 3 1 0 0 17 0 1 0 668099347 55844864 1814 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634513408 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/23683/statm: 13634 1814 492 364 0 1284 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 54536

[startup+0.300823 s]
/proc/loadavg: 0.00 0.00 0.00 1/447 23683
/proc/meminfo: memFree=24607712/32951124 swapFree=53501260/67111528
[pid=23683] ppid=23681 vsize=126800 CPUtime=0.14 cores=0-7
/proc/23683/stat : 23683 (python) R 23681 23683 23657 0 -1 4202496 5406 931 1 0 11 3 0 0 18 0 1 0 668099347 129843200 4005 33554432000 4194304 5683644 140737470003408 18446744073709551615 5213738 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23683/statm: 31700 4005 1007 364 0 2995 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 126800

[startup+0.700773 s]
/proc/loadavg: 0.00 0.00 0.00 1/447 23683
/proc/meminfo: memFree=24607712/32951124 swapFree=53501260/67111528
[pid=23683] ppid=23681 vsize=170752 CPUtime=0.28 cores=0-7
/proc/23683/stat : 23683 (python) S 23681 23683 23657 0 -1 4202496 6738 931 1 0 19 9 0 0 16 0 1 0 668099347 174850048 4807 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634513408 0 2147483391 16781312 2 18446744071699199166 0 0 17 4 0 0 0
/proc/23683/statm: 42688 4807 1336 364 0 3453 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 170752

[startup+1.50061 s]
/proc/loadavg: 0.00 0.00 0.00 2/448 23688
/proc/meminfo: memFree=24582656/32951124 swapFree=53501260/67111528
[pid=23683] ppid=23681 vsize=285636 CPUtime=0.99 cores=0-7
/proc/23683/stat : 23683 (python) R 23681 23683 23657 0 -1 4202496 12504 931 1 0 88 11 0 0 16 0 1 0 668099347 292491264 8794 33554432000 4194304 5683644 140737470003408 18446744073709551615 4619584 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23683/statm: 71409 8794 1826 364 0 7333 0
Current children cumulated CPU time (s) 0.99
Current children cumulated vsize (KiB) 285636

[startup+3.10029 s]
/proc/loadavg: 0.08 0.02 0.01 2/448 23688
/proc/meminfo: memFree=24577448/32951124 swapFree=53501260/67111528
[pid=23683] ppid=23681 vsize=427848 CPUtime=2.12 cores=0-7
/proc/23683/stat : 23683 (python) S 23681 23683 23657 0 -1 4202496 18291 931 1 0 198 14 0 0 21 0 9 0 668099347 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23683/statm: 106962 7678 1891 364 0 42859 0
Current children cumulated CPU time (s) 2.12
Current children cumulated vsize (KiB) 427848
heavy processes:

[startup+6.30173 s]
/proc/loadavg: 0.08 0.02 0.01 9/472 23712
/proc/meminfo: memFree=24523316/32951124 swapFree=53501260/67111528
[pid=23683] ppid=23681 vsize=427848 CPUtime=2.12 cores=0-7
/proc/23683/stat : 23683 (python) S 23681 23683 23657 0 -1 4202496 18291 931 1 0 198 14 0 0 21 0 9 0 668099347 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23683/statm: 106962 7678 1891 364 0 42859 0
[pid=23689] ppid=23683 vsize=280760 CPUtime=0 cores=0-7
/proc/23689/stat : 23689 (python) S 23683 23683 23657 0 -1 4202560 731 0 0 0 0 0 0 0 18 0 1 0 668099588 287498240 5978 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535439 0 0 16781312 514 11665097920004194564 0 0 17 1 0 0 0
/proc/23689/statm: 70190 5978 355 364 0 6108 0
[pid=23691] ppid=23689 vsize=1019708 CPUtime=3.87 cores=0-7
/proc/23691/stat : 23691 (gnovelty+2) R 23689 23691 23691 0 -1 4202496 956 0 0 0 387 0 0 0 25 0 1 0 668099588 1044180992 689 33554432000 134512640 135663704 4287832560 18446744073709551615 134524507 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/23691/statm: 254927 689 113 282 0 254643 0
[pid=23692] ppid=23683 vsize=291084 CPUtime=0 cores=0-7
/proc/23692/stat : 23692 (python) S 23683 23683 23657 0 -1 4202560 743 0 0 0 0 0 0 0 18 0 1 0 668099591 298070016 5976 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 1440960020274446595 0 0 17 1 0 0 0
/proc/23692/statm: 72771 5976 349 364 0 8686 0
[pid=23694] ppid=23692 vsize=1019708 CPUtime=3.85 cores=0-7
/proc/23694/stat : 23694 (gnovelty+2) R 23692 23694 23694 0 -1 4202496 955 0 0 0 385 0 0 0 25 0 1 0 668099591 1044180992 690 33554432000 134512640 135663704 4291712592 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/23694/statm: 254927 690 113 282 0 254643 0
[pid=23695] ppid=23683 vsize=366324 CPUtime=0 cores=0-7
/proc/23695/stat : 23695 (python) S 23683 23683 23657 0 -1 4202560 706 0 0 0 0 0 0 0 18 0 1 0 668099594 375115776 6151 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 16883013968057041155 0 0 17 1 0 0 0
/proc/23695/statm: 91581 6151 348 364 0 27493 0
[pid=23697] ppid=23695 vsize=419820 CPUtime=3.82 cores=0-7
/proc/23697/stat : 23697 (adaptg2wsat2009) R 23695 23697 23697 0 -1 4202496 1428 0 0 0 382 0 0 0 25 0 1 0 668099594 429895680 1172 33554432000 134512640 135107411 4287322480 18446744073709551615 134523261 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/23697/statm: 104955 1172 49 146 0 103831 0
[pid=23698] ppid=23683 vsize=376580 CPUtime=0 cores=0-7
/proc/23698/stat : 23698 (python) S 23683 23683 23657 0 -1 4202560 717 0 0 0 0 0 0 0 18 0 1 0 668099597 385617920 6127 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 2773919681981939968 0 0 17 1 0 0 0
/proc/23698/statm: 94145 6127 348 364 0 30054 0
[pid=23700] ppid=23698 vsize=419820 CPUtime=3.79 cores=0-7
/proc/23700/stat : 23700 (adaptg2wsat2009) R 23698 23700 23700 0 -1 4202496 1427 0 0 0 379 0 0 0 25 0 1 0 668099597 429895680 1172 33554432000 134512640 135107411 4290301072 18446744073709551615 134523312 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/23700/statm: 104955 1172 49 146 0 103831 0
[pid=23701] ppid=23683 vsize=386836 CPUtime=0 cores=0-7
/proc/23701/stat : 23701 (python) S 23683 23683 23657 0 -1 4202560 726 0 0 0 0 0 0 0 18 0 1 0 668099600 396120064 6119 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 13762864675853140225 0 0 17 1 0 0 0
/proc/23701/statm: 96709 6119 348 364 0 32615 0
[pid=23703] ppid=23701 vsize=419820 CPUtime=3.74 cores=0-7
/proc/23703/stat : 23703 (adaptg2wsat2009) R 23701 23703 23703 0 -1 4202496 1431 0 0 0 374 0 0 0 25 0 1 0 668099600 429895680 1173 33554432000 134512640 135107411 4287632608 18446744073709551615 134523296 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/23703/statm: 104955 1173 49 146 0 103831 0
[pid=23704] ppid=23683 vsize=397092 CPUtime=0 cores=0-7
/proc/23704/stat : 23704 (python) S 23683 23683 23657 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 668099603 406622208 6243 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 8513909414548177155 0 0 17 1 0 0 0
/proc/23704/statm: 99273 6243 348 364 0 35176 0
[pid=23706] ppid=23704 vsize=1019708 CPUtime=3.66 cores=0-7
/proc/23706/stat : 23706 (gnovelty+2) R 23704 23706 23706 0 -1 4202496 949 0 0 0 366 0 0 0 25 0 1 0 668099603 1044180992 690 33554432000 134512640 135663704 4286957024 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/23706/statm: 254927 690 113 282 0 254643 0
[pid=23707] ppid=23683 vsize=407348 CPUtime=0 cores=0-7
/proc/23707/stat : 23707 (python) S 23683 23683 23657 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 668099606 417124352 6129 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 4602455622607143168 0 0 17 1 0 0 0
/proc/23707/statm: 101837 6129 348 364 0 37737 0
[pid=23709] ppid=23707 vsize=247956 CPUtime=3.67 cores=0-7
/proc/23709/stat : 23709 (FH) R 23707 23709 23709 0 -1 4202496 1243 0 0 0 367 0 0 0 25 0 1 0 668099607 253906944 986 33554432000 134512640 134936988 4288734160 18446744073709551615 134523683 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/23709/statm: 61989 986 37 104 0 61493 0
[pid=23710] ppid=23683 vsize=417604 CPUtime=0 cores=0-7
/proc/23710/stat : 23710 (python) S 23683 23683 23657 0 -1 4202560 775 0 0 0 0 0 0 0 18 0 1 0 668099609 427626496 6137 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 11665105616585588993 0 0 17 1 0 0 0
/proc/23710/statm: 104401 6137 354 364 0 40298 0
[pid=23712] ppid=23710 vsize=419820 CPUtime=3.62 cores=0-7
/proc/23712/stat : 23712 (adaptg2wsat2009) R 23710 23712 23712 0 -1 4202496 1439 0 0 0 362 0 0 0 25 0 1 0 668099612 429895680 1173 33554432000 134512640 135107411 4293783824 18446744073709551615 134523220 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/23712/statm: 104955 1173 49 146 0 103831 0
[pid=23683/tid=23690] ppid=23681 vsize=427848 CPUtime=0 cores=0-7
/proc/23683/task/23690/stat : 23690 (python) S 23681 23683 23657 0 -1 4202560 26 931 0 0 0 0 0 0 18 0 9 0 668099588 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 6 0 0 0
[pid=23683/tid=23693] ppid=23681 vsize=427848 CPUtime=0 cores=0-7
/proc/23683/task/23693/stat : 23693 (python) S 23681 23683 23657 0 -1 4202560 27 931 0 0 0 0 0 0 18 0 9 0 668099591 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 3 0 0 0
[pid=23683/tid=23696] ppid=23681 vsize=427848 CPUtime=0 cores=0-7
/proc/23683/task/23696/stat : 23696 (python) S 23681 23683 23657 0 -1 4202560 82 931 0 0 0 0 0 0 19 0 9 0 668099594 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 6 0 0 0
[pid=23683/tid=23699] ppid=23681 vsize=427848 CPUtime=0 cores=0-7
/proc/23683/task/23699/stat : 23699 (python) S 23681 23683 23657 0 -1 4202560 29 931 0 0 0 0 0 0 18 0 9 0 668099597 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 5 0 0 0
[pid=23683/tid=23702] ppid=23681 vsize=427848 CPUtime=0 cores=0-7
/proc/23683/task/23702/stat : 23702 (python) S 23681 23683 23657 0 -1 4202560 36 931 0 0 0 0 0 0 19 0 9 0 668099600 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 0 0 0 0
[pid=23683/tid=23705] ppid=23681 vsize=427848 CPUtime=0 cores=0-7
/proc/23683/task/23705/stat : 23705 (python) S 23681 23683 23657 0 -1 4202560 32 931 0 0 0 0 0 0 20 0 9 0 668099603 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 7 0 0 0
[pid=23683/tid=23708] ppid=23681 vsize=427848 CPUtime=0 cores=0-7
/proc/23683/task/23708/stat : 23708 (python) S 23681 23683 23657 0 -1 4202560 32 931 0 0 0 0 0 0 21 0 9 0 668099606 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
[pid=23683/tid=23711] ppid=23681 vsize=427848 CPUtime=0 cores=0-7
/proc/23683/task/23711/stat : 23711 (python) S 23681 23683 23657 0 -1 4202560 34 931 0 0 0 0 0 0 22 0 9 0 668099609 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 32.14
Current children cumulated vsize (KiB) 8337836

[startup+12.7016 s]
/proc/loadavg: 1.30 0.28 0.09 9/472 23712
/proc/meminfo: memFree=24517652/32951124 swapFree=53501260/67111528
[pid=23683] ppid=23681 vsize=427848 CPUtime=2.12 cores=0-7
/proc/23683/stat : 23683 (python) S 23681 23683 23657 0 -1 4202496 18291 931 1 0 198 14 0 0 21 0 9 0 668099347 438116352 7678 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646342091 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/23683/statm: 106962 7678 1891 364 0 42859 0
[pid=23689] ppid=23683 vsize=280760 CPUtime=0.03 cores=0-7
/proc/23689/stat : 23689 (python) S 23683 23683 23657 0 -1 4202560 893 0 0 0 2 1 0 0 18 0 1 0 668099588 287498240 6001 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535439 0 0 16781312 514 14881318135901683972 0 0 17 1 0 0 0
/proc/23689/statm: 70190 6001 378 364 0 6108 0
[pid=23691] ppid=23689 vsize=1019708 CPUtime=10.27 cores=0-7
/proc/23691/stat : 23691 (gnovelty+2) R 23689 23691 23691 0 -1 4202496 956 0 0 0 1027 0 0 0 25 0 1 0 668099588 1044180992 689 33554432000 134512640 135663704 4287832560 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/23691/statm: 254927 689 113 282 0 254643 0
[pid=23692] ppid=23683 vsize=291084 CPUtime=0.04 cores=0-7
/proc/23692/stat : 23692 (python) S 23683 23683 23657 0 -1 4202560 912 0 0 0 2 2 0 0 18 0 1 0 668099591 298070016 5999 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 14881318135901683971 0 0 17 1 0 0 0
/proc/23692/statm: 72771 5999 372 364 0 8686 0
[pid=23694] ppid=23692 vsize=1019708 CPUtime=10.25 cores=0-7
/proc/23694/stat : 23694 (gnovelty+2) R 23692 23694 23694 0 -1 4202496 955 0 0 0 1025 0 0 0 25 0 1 0 668099591 1044180992 690 33554432000 134512640 135663704 4291712592 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/23694/statm: 254927 690 113 282 0 254643 0
[pid=23695] ppid=23683 vsize=366324 CPUtime=0.03 cores=0-7
/proc/23695/stat : 23695 (python) S 23683 23683 23657 0 -1 4202560 786 0 0 0 1 2 0 0 18 0 1 0 668099594 375115776 6174 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 14881318135901683971 0 0 17 1 0 0 0
/proc/23695/statm: 91581 6174 371 364 0 27493 0
[pid=23697] ppid=23695 vsize=420220 CPUtime=10.22 cores=0-7
/proc/23697/stat : 23697 (adaptg2wsat2009) R 23695 23697 23697 0 -1 4202496 1655 0 0 0 1022 0 0 0 25 0 1 0 668099594 430305280 1399 33554432000 134512640 135107411 4287322480 18446744073709551615 134531806 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/23697/statm: 105055 1399 59 146 0 103931 0
[pid=23698] ppid=23683 vsize=376580 CPUtime=0.03 cores=0-7
/proc/23698/stat : 23698 (python) S 23683 23683 23657 0 -1 4202560 802 0 0 0 1 2 0 0 18 0 1 0 668099597 385617920 6150 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 14881318135901683968 0 0 17 1 0 0 0
/proc/23698/statm: 94145 6150 371 364 0 30054 0
[pid=23700] ppid=23698 vsize=420220 CPUtime=10.19 cores=0-7
/proc/23700/stat : 23700 (adaptg2wsat2009) R 23698 23700 23700 0 -1 4202496 1654 0 0 0 1019 0 0 0 25 0 1 0 668099597 430305280 1399 33554432000 134512640 135107411 4290301072 18446744073709551615 134531781 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/23700/statm: 105055 1399 59 146 0 103931 0
[pid=23701] ppid=23683 vsize=386836 CPUtime=0.03 cores=0-7
/proc/23701/stat : 23701 (python) S 23683 23683 23657 0 -1 4202560 808 0 0 0 2 1 0 0 18 0 1 0 668099600 396120064 6142 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 14881318135901683969 0 0 17 1 0 0 0
/proc/23701/statm: 96709 6142 371 364 0 32615 0
[pid=23703] ppid=23701 vsize=420220 CPUtime=10.14 cores=0-7
/proc/23703/stat : 23703 (adaptg2wsat2009) R 23701 23703 23703 0 -1 4202496 1658 0 0 0 1014 0 0 0 25 0 1 0 668099600 430305280 1400 33554432000 134512640 135107411 4287632608 18446744073709551615 134531942 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/23703/statm: 105055 1400 59 146 0 103931 0
[pid=23704] ppid=23683 vsize=397092 CPUtime=0.04 cores=0-7
/proc/23704/stat : 23704 (python) S 23683 23683 23657 0 -1 4202560 817 0 0 0 2 2 0 0 18 0 1 0 668099603 406622208 6266 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 14881318135901683971 0 0 17 1 0 0 0
/proc/23704/statm: 99273 6266 371 364 0 35176 0
[pid=23706] ppid=23704 vsize=1019708 CPUtime=9.95 cores=0-7
/proc/23706/stat : 23706 (gnovelty+2) R 23704 23706 23706 0 -1 4202496 949 0 0 0 995 0 0 0 25 0 1 0 668099603 1044180992 690 33554432000 134512640 135663704 4286957024 18446744073709551615 134524972 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/23706/statm: 254927 690 113 282 0 254643 0
[pid=23707] ppid=23683 vsize=407348 CPUtime=0.03 cores=0-7
/proc/23707/stat : 23707 (python) S 23683 23683 23657 0 -1 4202560 825 0 0 0 1 2 0 0 18 0 1 0 668099606 417124352 6152 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 14881318135901683968 0 0 17 1 0 0 0

################
# More data... #
################

/proc/23794/statm: 140297 6526 407 364 0 76152 0
[pid=23796] ppid=23794 vsize=1019708 CPUtime=99.32 cores=0-7
/proc/23796/stat : 23796 (gnovelty+2) T 23794 23796 23796 0 -1 4202496 969 0 0 0 9932 0 0 0 25 0 1 0 668149005 1044180992 689 33554432000 134512640 135663704 4289314128 18446744073709551615 134545631 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/23796/statm: 254927 689 113 282 0 254643 0
[pid=23794/tid=23805] ppid=23683 vsize=561188 CPUtime=0 cores=0-7
/proc/23794/task/23805/stat : 23805 (python) S 23683 23683 23657 0 -1 4202560 85 0 0 0 0 0 0 0 19 0 2 0 668158945 574656512 6526 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 514 18446604469835458688 0 0 -1 0 0 0 0
[pid=23800] ppid=23683 vsize=571444 CPUtime=1.09 cores=0-7
/proc/23800/stat : 23800 (python) S 23683 23683 23657 0 -1 4202560 1200 0 0 0 54 55 0 0 18 0 2 0 668150134 585158656 6579 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/23800/statm: 142861 6579 407 364 0 78713 0
[pid=23802] ppid=23800 vsize=268424 CPUtime=292.88 cores=0-7
/proc/23802/stat : 23802 (hybridGM3) T 23800 23802 23802 0 -1 4202496 5413 0 0 0 29288 0 0 0 25 0 1 0 668150135 274866176 5127 33554432000 134512640 135204385 4286810016 18446744073709551615 134538041 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/23802/statm: 67106 5127 63 169 0 66936 0
[pid=23800/tid=23818] ppid=23683 vsize=571444 CPUtime=0 cores=0-7
/proc/23800/task/23818/stat : 23818 (python) S 23683 23683 23657 0 -1 4202560 81 0 0 0 0 0 0 0 18 0 2 0 668169811 585158656 6579 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 514 18446604469640070400 0 0 -1 2 0 0 0
[pid=23806] ppid=23683 vsize=581700 CPUtime=1.09 cores=0-7
/proc/23806/stat : 23806 (python) S 23683 23683 23657 0 -1 4202560 1215 0 0 0 54 55 0 0 18 0 2 0 668158951 595660800 6601 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/23806/statm: 145425 6601 406 364 0 81274 0
[pid=23808] ppid=23806 vsize=268424 CPUtime=296.48 cores=0-7
/proc/23808/stat : 23808 (hybridGM3) T 23806 23808 23808 0 -1 4202496 5410 0 0 0 29647 1 0 0 25 0 1 0 668158951 274866176 5127 33554432000 134512640 135204385 4291773392 18446744073709551615 134538323 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/23808/statm: 67106 5127 63 169 0 66936 0
[pid=23806/tid=23821] ppid=23683 vsize=581700 CPUtime=0 cores=0-7
/proc/23806/task/23821/stat : 23821 (python) S 23683 23683 23657 0 -1 4202560 87 0 0 0 0 0 0 0 18 0 2 0 668178628 595660800 6601 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 514 18446604468178614400 0 0 -1 5 0 0 0
[pid=23809] ppid=23683 vsize=591956 CPUtime=2.16 cores=0-7
/proc/23809/stat : 23809 (python) S 23683 23683 23657 0 -1 4202560 992 0 0 0 112 104 0 0 18 0 1 0 668159264 606162944 6619 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 14881318135901683973 0 0 17 5 0 0 0
/proc/23809/statm: 147989 6619 372 364 0 83835 0
[pid=23811] ppid=23809 vsize=458348 CPUtime=572.6 cores=0-7
/proc/23811/stat : 23811 (TNM) R 23809 23811 23811 0 -1 4202496 1528 0 0 0 57259 1 0 0 25 0 1 0 668159264 469348352 1240 33554432000 134512640 135008748 4293129792 18446744073709551615 134529483 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/23811/statm: 114587 1240 46 122 0 113487 0
[pid=23815] ppid=23683 vsize=602212 CPUtime=0.36 cores=0-7
/proc/23815/stat : 23815 (python) S 23683 23683 23657 0 -1 4202560 1194 0 0 0 19 17 0 0 19 0 2 0 668168782 616665088 6595 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/23815/statm: 150553 6595 400 364 0 86396 0
[pid=23817] ppid=23815 vsize=335996 CPUtime=100.15 cores=0-7
/proc/23817/stat : 23817 (iPAWS) T 23815 23817 23817 0 -1 4202496 1816 0 0 0 10015 0 0 0 25 0 1 0 668168783 344059904 1536 33554432000 134512640 135114423 4291866032 18446744073709551615 134515545 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/23817/statm: 83999 1536 59 147 0 83851 0
[pid=23815/tid=23822] ppid=23683 vsize=602212 CPUtime=0 cores=0-7
/proc/23815/task/23822/stat : 23822 (python) S 23683 23683 23657 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 668178819 616665088 6595 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 514 18446604467337774272 0 0 -1 5 0 0 0
[pid=23823] ppid=23683 vsize=612468 CPUtime=1.44 cores=0-7
/proc/23823/stat : 23823 (python) S 23683 23683 23657 0 -1 4202560 1217 0 0 0 73 71 0 0 18 0 2 0 668178825 627167232 6629 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/23823/statm: 153117 6629 400 364 0 88957 0
[pid=23825] ppid=23823 vsize=268424 CPUtime=368.4 cores=0-7
/proc/23825/stat : 23825 (hybridGM3) R 23823 23825 23825 0 -1 4202496 5411 0 0 0 36838 2 0 0 25 0 1 0 668178825 274866176 5127 33554432000 134512640 135204385 4287939440 18446744073709551615 134538375 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/23825/statm: 67106 5127 63 169 0 66936 0
[pid=23823/tid=23847] ppid=23683 vsize=612468 CPUtime=0 cores=0-7
/proc/23823/task/23847/stat : 23847 (python) S 23683 23683 23657 0 -1 4202560 89 0 0 0 0 0 0 0 19 0 2 0 668198504 627167232 6629 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 514 18446604467281375552 0 0 -1 5 0 0 0
[pid=23827] ppid=23683 vsize=622724 CPUtime=0.38 cores=0-7
/proc/23827/stat : 23827 (python) S 23683 23683 23657 0 -1 4202560 1221 0 0 0 21 17 0 0 19 0 2 0 668179959 637669376 6619 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/23827/statm: 155681 6619 401 364 0 91518 0
[pid=23829] ppid=23827 vsize=1019708 CPUtime=99.8 cores=0-7
/proc/23829/stat : 23829 (gnovelty+2) T 23827 23829 23829 0 -1 4202496 973 0 0 0 9980 0 0 0 25 0 1 0 668179959 1044180992 689 33554432000 134512640 135663704 4291594960 18446744073709551615 134545631 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/23829/statm: 254927 689 113 282 0 254643 0
[pid=23827/tid=23838] ppid=23683 vsize=622724 CPUtime=0 cores=0-7
/proc/23827/task/23838/stat : 23838 (python) S 23683 23683 23657 0 -1 4202560 89 0 0 0 0 0 0 0 19 0 2 0 668190001 637669376 6619 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 514 18446604464664168512 0 0 -1 3 0 0 0
[pid=23832] ppid=23683 vsize=632980 CPUtime=1.12 cores=0-7
/proc/23832/stat : 23832 (python) S 23683 23683 23657 0 -1 4202560 1266 0 0 0 59 53 0 0 18 0 2 0 668187543 648171520 6685 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/23832/statm: 158245 6685 406 364 0 94079 0
[pid=23834] ppid=23832 vsize=268420 CPUtime=291.44 cores=0-7
/proc/23834/stat : 23834 (hybridGM3) T 23832 23834 23834 0 -1 4202496 5424 0 0 0 29143 1 0 0 25 0 1 0 668187544 274862080 5126 33554432000 134512640 135204385 4287624000 18446744073709551615 134538171 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/23834/statm: 67105 5126 63 169 0 66935 0
[pid=23832/tid=23852] ppid=23683 vsize=632980 CPUtime=0 cores=0-7
/proc/23832/task/23852/stat : 23852 (python) S 23683 23683 23657 0 -1 4202560 89 0 0 0 0 0 0 0 18 0 2 0 668207223 648171520 6685 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 514 18446604459366495552 0 0 -1 2 0 0 0
[pid=23835] ppid=23683 vsize=643236 CPUtime=0.41 cores=0-7
/proc/23835/stat : 23835 (python) S 23683 23683 23657 0 -1 4202560 1266 0 0 0 20 21 0 0 19 0 2 0 668188786 658673664 6667 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646342091 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/23835/statm: 160809 6667 407 364 0 96640 0
[pid=23837] ppid=23835 vsize=249868 CPUtime=101.45 cores=0-7
/proc/23837/stat : 23837 (FH) T 23835 23837 23837 0 -1 4202496 1550 0 0 0 10145 0 0 0 25 0 1 0 668188787 255864832 1263 33554432000 134512640 134936988 4289060432 18446744073709551615 134554227 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/23837/statm: 62467 1263 41 104 0 61971 0
[pid=23835/tid=23849] ppid=23683 vsize=643236 CPUtime=0 cores=0-7
/proc/23835/task/23849/stat : 23849 (python) S 23683 23683 23657 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 668199429 658673664 6667 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 514 18446604459366494656 0 0 -1 1 0 0 0
[pid=23839] ppid=23683 vsize=653492 CPUtime=1.03 cores=0-7
/proc/23839/stat : 23839 (python) S 23683 23683 23657 0 -1 4202560 1279 0 0 0 51 52 0 0 18 0 2 0 668190008 669175808 6731 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/23839/statm: 163373 6731 407 364 0 99201 0
[pid=23841] ppid=23839 vsize=268424 CPUtime=265.34 cores=0-7
/proc/23841/stat : 23841 (hybridGM3) R 23839 23841 23841 0 -1 4202496 5420 0 0 0 26534 0 0 0 25 0 1 0 668190008 274866176 5127 33554432000 134512640 135204385 4292097712 18446744073709551615 134537717 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/23841/statm: 67106 5127 63 169 0 66936 0
[pid=23839/tid=23853] ppid=23683 vsize=653492 CPUtime=0 cores=0-7
/proc/23839/task/23853/stat : 23853 (python) S 23683 23683 23657 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 668209688 669175808 6731 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 514 18446604456239919552 0 0 -1 2 0 0 0
[pid=23844] ppid=23683 vsize=663748 CPUtime=0.68 cores=0-7
/proc/23844/stat : 23844 (python) S 23683 23683 23657 0 -1 4202560 1077 0 0 0 34 34 0 0 18 0 1 0 668198421 679677952 6677 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 14881318135901683974 0 0 17 1 0 0 0
/proc/23844/statm: 165937 6677 378 364 0 101762 0
[pid=23846] ppid=23844 vsize=419776 CPUtime=182.58 cores=0-7
/proc/23846/stat : 23846 (NCVWr) R 23844 23846 23846 0 -1 4202496 1572 0 0 0 18258 0 0 0 25 0 1 0 668198422 429850624 1281 33554432000 134512640 135113558 4289795600 18446744073709551615 134533479 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/23846/statm: 104944 1281 58 147 0 103819 0
[pid=23856] ppid=23683 vsize=674004 CPUtime=0 cores=0-7
/proc/23856/stat : 23856 (python) S 23683 23683 23657 0 -1 4202560 946 0 0 0 0 0 0 0 19 0 1 0 668216771 690180096 6655 33554432000 4194304 5683644 140737470003408 18446744073709551615 216634535494 0 0 16781312 514 3020326285080526847 0 0 17 1 0 0 0
/proc/23856/statm: 168501 6655 352 364 0 104323 0
[pid=23858] ppid=23856 vsize=335996 CPUtime=0.46 cores=0-7
/proc/23858/stat : 23858 (iPAWS) R 23856 23858 23858 0 -1 4202496 1823 0 0 0 46 0 0 0 21 0 1 0 668216771 344059904 1533 33554432000 134512640 135114423 4288975184 18446744073709551615 134515622 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/23858/statm: 83999 1533 59 147 0 83851 0
[pid=23683/tid=23690] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23690/stat : 23690 (python) S 23681 23683 23657 0 -1 4202560 26 931 0 0 0 0 0 0 18 0 34 0 668099588 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 6 0 0 0
[pid=23683/tid=23693] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23693/stat : 23693 (python) S 23681 23683 23657 0 -1 4202560 27 931 0 0 0 0 0 0 18 0 34 0 668099591 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 3 0 0 0
[pid=23683/tid=23696] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23696/stat : 23696 (python) S 23681 23683 23657 0 -1 4202560 92 931 0 0 0 0 0 0 15 0 34 0 668099594 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 2 0 0 0
[pid=23683/tid=23699] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23699/stat : 23699 (python) S 23681 23683 23657 0 -1 4202560 33 931 0 0 0 0 0 0 18 0 34 0 668099597 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 5 0 0 0
[pid=23683/tid=23702] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23702/stat : 23702 (python) S 23681 23683 23657 0 -1 4202560 51 931 0 0 0 0 0 0 15 0 34 0 668099600 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
[pid=23683/tid=23705] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23705/stat : 23705 (python) S 23681 23683 23657 0 -1 4202560 32 931 0 0 0 0 0 0 20 0 34 0 668099603 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 7 0 0 0
[pid=23683/tid=23708] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23708/stat : 23708 (python) S 23681 23683 23657 0 -1 4202560 39 931 0 0 0 0 0 0 18 0 34 0 668099606 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
[pid=23683/tid=23711] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23711/stat : 23711 (python) S 23681 23683 23657 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 34 0 668099609 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
[pid=23683/tid=23719] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23719/stat : 23719 (python) S 23681 23683 23657 0 -1 4202560 43 931 0 0 0 0 0 0 18 0 34 0 668109629 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 5 0 0 0
[pid=23683/tid=23723] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23723/stat : 23723 (python) S 23681 23683 23657 0 -1 4202560 36 931 0 0 0 0 0 0 18 0 34 0 668109632 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 0 0 0 0
[pid=23683/tid=23728] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23728/stat : 23728 (python) S 23681 23683 23657 0 -1 4202560 56 931 0 0 0 0 0 0 18 0 34 0 668109636 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 3 0 0 0
[pid=23683/tid=23732] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23732/stat : 23732 (python) S 23681 23683 23657 0 -1 4202560 31 931 0 0 0 0 0 0 19 0 34 0 668109640 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 0 0 0 0
[pid=23683/tid=23736] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23736/stat : 23736 (python) S 23681 23683 23657 0 -1 4202560 50 931 0 0 0 0 0 0 18 0 34 0 668109645 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 2 0 0 0
[pid=23683/tid=23740] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23740/stat : 23740 (python) S 23681 23683 23657 0 -1 4202560 36 931 0 0 0 0 0 0 18 0 34 0 668109649 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 2 0 0 0
[pid=23683/tid=23743] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23743/stat : 23743 (python) S 23681 23683 23657 0 -1 4202560 45 931 0 0 0 0 0 0 18 0 34 0 668109654 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
[pid=23683/tid=23746] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23746/stat : 23746 (python) S 23681 23683 23657 0 -1 4202560 39 931 0 0 0 0 0 0 18 0 34 0 668109661 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 0 0 0 0
[pid=23683/tid=23753] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23753/stat : 23753 (python) S 23681 23683 23657 0 -1 4202560 31 931 0 0 0 0 0 0 20 0 34 0 668119670 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 6 0 0 0
[pid=23683/tid=23756] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23756/stat : 23756 (python) S 23681 23683 23657 0 -1 4202560 33 931 0 0 0 0 0 0 22 0 34 0 668119675 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 0 0 0 0
[pid=23683/tid=23777] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23777/stat : 23777 (python) S 23681 23683 23657 0 -1 4202560 42 931 0 0 0 0 0 0 19 0 34 0 668129616 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
[pid=23683/tid=23784] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23784/stat : 23784 (python) S 23681 23683 23657 0 -1 4202560 38 931 0 0 0 0 0 0 20 0 34 0 668139172 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 5 0 0 0
[pid=23683/tid=23787] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23787/stat : 23787 (python) S 23681 23683 23657 0 -1 4202560 35 931 0 0 0 0 0 0 20 0 34 0 668139490 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
[pid=23683/tid=23795] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23795/stat : 23795 (python) S 23681 23683 23657 0 -1 4202560 36 931 0 0 0 0 0 0 20 0 34 0 668149004 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 0 0 0 0
[pid=23683/tid=23801] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23801/stat : 23801 (python) S 23681 23683 23657 0 -1 4202560 42 931 0 0 0 0 0 0 18 0 34 0 668150135 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 5 0 0 0
[pid=23683/tid=23807] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23807/stat : 23807 (python) S 23681 23683 23657 0 -1 4202560 37 931 0 0 0 0 0 0 18 0 34 0 668158951 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 5 0 0 0
[pid=23683/tid=23810] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23810/stat : 23810 (python) S 23681 23683 23657 0 -1 4202560 33 931 0 0 0 0 0 0 20 0 34 0 668159264 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 5 0 0 0
[pid=23683/tid=23816] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23816/stat : 23816 (python) S 23681 23683 23657 0 -1 4202560 32 931 0 0 0 0 0 0 20 0 34 0 668168783 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 0 0 0 0
[pid=23683/tid=23824] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23824/stat : 23824 (python) S 23681 23683 23657 0 -1 4202560 40 931 0 0 0 0 0 0 18 0 34 0 668178825 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 5 0 0 0
[pid=23683/tid=23828] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23828/stat : 23828 (python) S 23681 23683 23657 0 -1 4202560 33 931 0 0 0 0 0 0 20 0 34 0 668179959 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
[pid=23683/tid=23833] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23833/stat : 23833 (python) S 23681 23683 23657 0 -1 4202560 38 931 0 0 0 0 0 0 18 0 34 0 668187543 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 0 0 0 0
[pid=23683/tid=23836] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23836/stat : 23836 (python) S 23681 23683 23657 0 -1 4202560 35 931 0 0 0 0 0 0 20 0 34 0 668188787 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
[pid=23683/tid=23840] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23840/stat : 23840 (python) S 23681 23683 23657 0 -1 4202560 38 931 0 0 0 0 0 0 18 0 34 0 668190008 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 1 0 0 0
[pid=23683/tid=23845] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23845/stat : 23845 (python) S 23681 23683 23657 0 -1 4202560 33 931 0 0 0 0 0 0 20 0 34 0 668198422 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 0 0 0 0
[pid=23683/tid=23857] ppid=23681 vsize=684248 CPUtime=0 cores=0-7
/proc/23683/task/23857/stat : 23857 (python) S 23681 23683 23657 0 -1 4202560 37 931 0 0 0 0 0 0 20 0 34 0 668216771 700669952 8249 33554432000 4194304 5683644 140737470003408 18446744073709551615 216646338993 0 0 16781312 2 18446604443502766784 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9331.46
Current children cumulated vsize (KiB) 32517508

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23683 and gives
#  childrusage.ru_utime.tv_sec=2003
#  childrusage.ru_utime.tv_usec=546414
#  childrusage.ru_stime.tv_sec=17
#  childrusage.ru_stime.tv_usec=24411
# CPU time returned by wait4() is 2020.57
# while last known CPU time is 9331.46
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1174.92
CPU time (s): 9331.46
CPU user time (s): 9314.25
CPU system time (s): 17.21
CPU usage (%): 794.222
Max. virtual memory (cumulated for all children) (KiB): 32517508

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2003.55
system time used= 17.0244
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 102103
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15312
involuntary context switches= 14286

runsolver used 14.1189 second user time and 31.8412 second system time

The end

Launcher Data 

Begin job on node103 at 2011-05-16 18:56:07
IDJOB=3385281
IDBENCH=82546
IDSOLVER=1870
FILE ID=node103/3385281-1305564967
RUNJOBID= node103-1305564967-23671
PBS_JOBID= 13350147
Free space on /tmp= 73088 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k7-r85-v300-c25500-S1286362348-008-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385281-1305564967/watcher-3385281-1305564967 -o /tmp/evaluation-result-3385281-1305564967/solver-3385281-1305564967 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385281-1305564967.cnf -seed 592305601 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 63b66954174098a654eacd27832fcf38
RANDOM SEED=592305601

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24608124 kB
Buffers:        342400 kB
Cached:        4527144 kB
SwapCached:     340168 kB
Active:        2517080 kB
Inactive:      5526992 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24608124 kB
SwapTotal:    67111528 kB
SwapFree:     53501260 kB
Dirty:           32652 kB
Writeback:           0 kB
AnonPages:     2845012 kB
Mapped:          20912 kB
Slab:           164500 kB
PageTables:      66024 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 137670664 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73056 MiB
End job on node103 at 2011-05-16 19:15:44