Trace number 3321857

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 10709.7 1515.91

General information on the benchmark

Namerandom/large/
unif-k5-r20-v2000-c40000-S61914820-087-UNKNOWN.cnf
MD5SUM1b9b43753c02a2c226adda648a956e92
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2120.06
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of clauses40000
Sum of the clauses size200000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 540000
Number of clauses of size over 50

Solver Data 

0.31/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.31/0.47	c INFO: solving HOME/instance-3321857-1304368463.cnf
0.31/0.47	c INFO: computing task features
0.50/0.68	c INFO: computed variable-clause graph statistics
0.50/0.69	c INFO: computed clause balance statistics
1.50/1.69	c INFO: computed variable balance statistics
2.11/2.24	c INFO: computed small-clause counts
2.11/2.24	c INFO: computed Horn-clause counts
2.11/2.29	c INFO: computed variable graph statistics
2.11/2.29	c INFO: collected features for HOME/instance-3321857-1304368463.cnf in 1.81 s
2.20/2.33	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
2.20/2.37	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
2.29/2.41	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.08)
2.29/2.44	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.07)
2.29/2.48	c INFO: running adaptg2wsat2009++@0 for 97 with 39998 remaining (b = 0.05)
2.39/2.52	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.05)
2.39/2.56	c INFO: running FH@0 for 97 with 39997 remaining (b = 0.03)
2.49/2.60	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.03)
702.54/102.64	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.02)
702.54/102.68	c INFO: running FH@0 for 97 with 39897 remaining (b = 0.02)
703.21/102.73	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.04)
703.73/102.82	c INFO: running gnovelty+2@0 for 97 with 39897 remaining (b = 0.02)
703.73/102.88	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
704.57/103.15	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.01)
1062.11/150.72	c INFO: running hybridGM3@0 for 194 with 39849 remaining (b = 0.03)
1062.11/150.78	c INFO: running hybridGM3@0 for 194 with 39849 remaining (b = 0.02)
1426.66/202.97	c INFO: running TNM@0 for 1552 with 39797 remaining (b = 0.19)
1428.60/203.21	c INFO: running FH@0 for 97 with 39797 remaining (b = 0.01)
1597.04/227.00	c INFO: running adaptg2wsat2009++@0 for 97 with 39773 remaining (b = 0.01)
1685.74/239.65	c INFO: running adaptg2wsat2009++@0 for 97 with 39760 remaining (b = 0.01)
2102.36/299.32	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2103.76/299.56	c INFO: running hybridGM3@97 for 97 with 39700 remaining (b = 0.01)
2250.29/320.57	c INFO: running adaptg2wsat2009++@98 for 97 with 39679 remaining (b = 0.01)
2318.04/330.28	c INFO: running hybridGM3@0 for 194 with 39670 remaining (b = 0.02)
2437.34/347.34	c INFO: running hybridGM3@100 for 97 with 39653 remaining (b = 0.01)
2574.11/366.98	c INFO: running hybridGM3@0 for 194 with 39633 remaining (b = 0.02)
2682.98/382.60	c INFO: running hybridGM3@99 for 97 with 39617 remaining (b = 0.01)
2809.32/400.63	c INFO: running hybridGM3@296 for 97 with 39599 remaining (b = 0.01)
2936.75/417.85	c INFO: running TNM@0 for 1552 with 39582 remaining (b = 0.15)
2943.73/418.88	c INFO: running adaptg2wsat2009++@0 for 97 with 39581 remaining (b = 0.01)
3345.34/472.67	c INFO: running adaptg2wsat2009++@99 for 97 with 39527 remaining (b = 0.01)
3507.83/495.90	c INFO: running FH@0 for 291 with 39504 remaining (b = 0.03)
3648.76/516.17	c INFO: running gnovelty+2@0 for 97 with 39484 remaining (b = 0.01)
3675.24/519.95	c INFO: running hybridGM3@393 for 97 with 39480 remaining (b = 0.01)
3800.80/537.95	c INFO: running iPAWS@0 for 97 with 39462 remaining (b = 0.01)
4024.76/569.58	c INFO: running adaptg2wsat2009++@99 for 97 with 39430 remaining (b = 0.01)
4117.43/581.98	c INFO: running hybridGM3@0 for 194 with 39418 remaining (b = 0.02)
4360.52/616.52	c INFO: running FH@99 for 291 with 39384 remaining (b = 0.02)
4393.29/621.24	c INFO: running hybridGM3@0 for 194 with 39379 remaining (b = 0.01)
4715.03/666.89	c INFO: running TNM@0 for 1552 with 39333 remaining (b = 0.11)
4767.58/674.34	c INFO: running iPAWS@0 for 97 with 39326 remaining (b = 0.01)
5563.56/786.73	c INFO: running adaptg2wsat2009++@101 for 97 with 39213 remaining (b = 0.01)
5887.09/832.77	c INFO: running hybridGM3@99 for 97 with 39167 remaining (b = 0.01)
6006.77/849.80	c INFO: running gnovelty+2@0 for 97 with 39150 remaining (b = 0.01)
6063.54/857.98	c INFO: running hybridGM3@93 for 97 with 39142 remaining (b = 0.01)
6456.37/914.11	c INFO: running hybridGM3@0 for 194 with 39086 remaining (b = 0.01)
6637.99/940.10	c INFO: running hybridGM3@395 for 97 with 39060 remaining (b = 0.01)
6695.04/948.34	c INFO: running adaptg2wsat2009++@295 for 291 with 39052 remaining (b = 0.02)
6750.79/956.36	c INFO: running FH@200 for 194 with 39044 remaining (b = 0.01)
7239.01/1023.47	c INFO: running hybridGM3@189 for 97 with 38977 remaining (b = 0.01)
7507.49/1059.47	c INFO: running NCVWr@0 for 485 with 38941 remaining (b = 0.03)
8046.23/1136.85	c INFO: running FH@0 for 97 with 38863 remaining (b = 0.01)
8115.82/1146.83	c INFO: running hybridGM3@98 for 97 with 38853 remaining (b = 0.01)
8346.16/1179.96	c INFO: running FH@297 for 97 with 38820 remaining (b = 0.01)
8821.35/1248.20	c INFO: running adaptg2wsat2009++@395 for 194 with 38752 remaining (b = 0.01)
8870.06/1255.23	c INFO: running FH@195 for 194 with 38745 remaining (b = 0.01)
8988.33/1272.21	c INFO: running hybridGM3@294 for 194 with 38728 remaining (b = 0.01)
9176.81/1299.33	c INFO: running iPAWS@0 for 97 with 38701 remaining (b = 0.01)
9919.94/1405.69	c INFO: running adaptg2wsat2009++@97 for 97 with 38594 remaining (b = 0.01)
10254.31/1452.77	c INFO: running FH@294 for 97 with 38547 remaining (b = 0.01)
10591.61/1498.90	c INFO: running adaptg2wsat2009++@494 for 97 with 38501 remaining (b = 0.01)
10682.10/1511.84	c INFO: running hybridGM3@392 for 97 with 38488 remaining (b = 0.01)
10704.38/1515.05	c INFO: running iPAWS@0 for 97 with 38485 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321857-1304368463/watcher-3321857-1304368463 -o /tmp/evaluation-result-3321857-1304368463/solver-3321857-1304368463 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321857-1304368463.cnf -seed 1132285276 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.17 8.33 6.56 2/264 18830
/proc/meminfo: memFree=28182660/32950928 swapFree=67086616/67111528
[pid=18830] ppid=18828 vsize=15776 CPUtime=0 cores=0-7
/proc/18830/stat : 18830 (python) R 18828 18830 18491 0 -1 4202496 895 0 0 0 0 0 0 0 24 0 1 0 548443435 16154624 776 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476694672 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18830/statm: 3944 777 343 364 0 431 0

[startup+0.0441819 s]
/proc/loadavg: 8.17 8.33 6.56 2/264 18830
/proc/meminfo: memFree=28182660/32950928 swapFree=67086616/67111528
[pid=18830] ppid=18828 vsize=25292 CPUtime=0.03 cores=0-7
/proc/18830/stat : 18830 (python) S 18828 18830 18491 0 -1 4202496 1348 0 0 0 3 0 0 0 24 0 1 0 548443435 25899008 1193 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476692992 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/18830/statm: 6323 1193 438 364 0 724 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 25292

[startup+0.101165 s]
/proc/loadavg: 8.17 8.33 6.56 2/264 18830
/proc/meminfo: memFree=28182660/32950928 swapFree=67086616/67111528
[pid=18830] ppid=18828 vsize=104224 CPUtime=0.07 cores=0-7
/proc/18830/stat : 18830 (python) R 18828 18830 18491 0 -1 4202496 3051 0 0 0 5 2 0 0 24 0 1 0 548443435 106725376 2734 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476690789 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18830/statm: 26056 2734 847 364 0 1804 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104224

[startup+0.301128 s]
/proc/loadavg: 8.17 8.33 6.56 2/264 18830
/proc/meminfo: memFree=28182660/32950928 swapFree=67086616/67111528
[pid=18830] ppid=18828 vsize=170756 CPUtime=0.23 cores=0-7
/proc/18830/stat : 18830 (python) S 18828 18830 18491 0 -1 4202496 6732 935 1 0 17 6 0 0 17 0 1 0 548443435 174854144 4806 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476692992 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/18830/statm: 42690 4807 1336 364 0 3455 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 170756

[startup+0.701055 s]
/proc/loadavg: 8.17 8.33 6.56 2/264 18830
/proc/meminfo: memFree=28182660/32950928 swapFree=67086616/67111528
[pid=18830] ppid=18828 vsize=290804 CPUtime=0.6 cores=0-7
/proc/18830/stat : 18830 (python) R 18828 18830 18491 0 -1 4202496 14012 935 1 0 51 9 0 0 17 0 1 0 548443435 297783296 10086 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476381536 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18830/statm: 72701 10086 1826 364 0 8625 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 290804

[startup+1.50089 s]
/proc/loadavg: 8.17 8.33 6.56 3/265 18835
/proc/meminfo: memFree=28148552/32950928 swapFree=67086616/67111528
[pid=18830] ppid=18828 vsize=290804 CPUtime=1.4 cores=0-7
/proc/18830/stat : 18830 (python) R 18828 18830 18491 0 -1 4202496 14012 935 1 0 131 9 0 0 19 0 1 0 548443435 297783296 10086 33554432000 4194304 5683644 140735727620160 18446744073709551615 47093171095083 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/18830/statm: 72701 10086 1826 364 0 8625 0
Current children cumulated CPU time (s) 1.4
Current children cumulated vsize (KiB) 290804

[startup+3.10051 s]
/proc/loadavg: 8.17 8.33 6.56 3/265 18835
/proc/meminfo: memFree=28148560/32950928 swapFree=67086616/67111528
[pid=18830] ppid=18828 vsize=366872 CPUtime=2.5 cores=0-7
/proc/18830/stat : 18830 (python) S 18828 18830 18491 0 -1 4202496 20621 935 1 0 239 11 0 0 22 0 9 0 548443435 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18830/statm: 91718 8685 1891 364 0 27615 0
Current children cumulated CPU time (s) 2.5
Current children cumulated vsize (KiB) 366872

[startup+6.3019 s]
/proc/loadavg: 7.99 8.29 6.56 10/289 18859
/proc/meminfo: memFree=28065644/32950928 swapFree=67086616/67111528
[pid=18830] ppid=18828 vsize=366872 CPUtime=2.5 cores=0-7
/proc/18830/stat : 18830 (python) S 18828 18830 18491 0 -1 4202496 20621 935 1 0 239 11 0 0 22 0 9 0 548443435 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18830/statm: 91718 8685 1891 364 0 27615 0
[pid=18836] ppid=18830 vsize=284984 CPUtime=0 cores=0-7
/proc/18836/stat : 18836 (python) S 18830 18830 18491 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 548443668 291823616 6899 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715023 0 0 16781312 514 4400381878096331012 0 0 17 6 0 0 0
/proc/18836/statm: 71246 6899 355 364 0 7164 0
[pid=18838] ppid=18836 vsize=1020308 CPUtime=3.96 cores=0-7
/proc/18838/stat : 18838 (gnovelty+2) R 18836 18838 18838 0 -1 4202496 1155 0 0 0 396 0 0 0 25 0 1 0 548443669 1044795392 891 33554432000 134512640 135663704 4290689552 18446744073709551615 134525544 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18838/statm: 255077 891 113 282 0 254793 0
[pid=18839] ppid=18830 vsize=294900 CPUtime=0 cores=0-7
/proc/18839/stat : 18839 (python) S 18830 18830 18491 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 548443673 301977600 7032 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 4223361880413929732 0 0 17 2 0 0 0
/proc/18839/statm: 73725 7032 349 364 0 9640 0
[pid=18841] ppid=18839 vsize=1020308 CPUtime=3.89 cores=0-7
/proc/18841/stat : 18841 (gnovelty+2) R 18839 18841 18841 0 -1 4202496 1153 0 0 0 389 0 0 0 25 0 1 0 548443673 1044795392 892 33554432000 134512640 135663704 4292235872 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18841/statm: 255077 892 113 282 0 254793 0
[pid=18842] ppid=18830 vsize=305764 CPUtime=0 cores=0-7
/proc/18842/stat : 18842 (python) S 18830 18830 18491 0 -1 4202560 737 0 0 0 0 0 0 0 18 0 1 0 548443676 313102336 7036 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 1199025130966057219 0 0 17 6 0 0 0
/proc/18842/statm: 76441 7036 349 364 0 12353 0
[pid=18844] ppid=18842 vsize=423400 CPUtime=2.11 cores=0-7
/proc/18844/stat : 18844 (adaptg2wsat2009) R 18842 18844 18844 0 -1 4202496 2620 0 0 0 211 0 0 0 25 0 1 0 548443677 433561600 2356 33554432000 134512640 135107411 4294636704 18446744073709551615 134531656 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18844/statm: 105850 2356 59 146 0 104726 0
[pid=18845] ppid=18830 vsize=316088 CPUtime=0 cores=0-7
/proc/18845/stat : 18845 (python) S 18830 18830 18491 0 -1 4202560 751 0 0 0 0 0 0 0 18 0 1 0 548443680 323674112 7040 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 4424277289424879873 0 0 17 2 0 0 0
/proc/18845/statm: 79022 7040 349 364 0 14931 0
[pid=18847] ppid=18845 vsize=423400 CPUtime=3.84 cores=0-7
/proc/18847/stat : 18847 (adaptg2wsat2009) R 18845 18847 18847 0 -1 4202496 2624 0 0 0 384 0 0 0 25 0 1 0 548443680 433561600 2358 33554432000 134512640 135107411 4294095200 18446744073709551615 134531848 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18847/statm: 105850 2358 59 146 0 104726 0
[pid=18848] ppid=18830 vsize=325860 CPUtime=0 cores=0-7
/proc/18848/stat : 18848 (python) S 18830 18830 18491 0 -1 4202560 749 0 0 0 0 0 0 0 18 0 1 0 548443684 333680640 7125 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 4316771165629546753 0 0 17 2 0 0 0
/proc/18848/statm: 81465 7125 347 364 0 17371 0
[pid=18850] ppid=18848 vsize=423400 CPUtime=3.8 cores=0-7
/proc/18850/stat : 18850 (adaptg2wsat2009) R 18848 18850 18850 0 -1 4202496 2622 0 0 0 380 0 0 0 25 0 1 0 548443684 433561600 2357 33554432000 134512640 135107411 4290480224 18446744073709551615 134531600 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18850/statm: 105850 2357 59 146 0 104726 0
[pid=18851] ppid=18830 vsize=336116 CPUtime=0 cores=0-7
/proc/18851/stat : 18851 (python) S 18830 18830 18491 0 -1 4202560 757 0 0 0 0 0 0 0 18 0 1 0 548443688 344182784 7129 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 10871630955773133058 0 0 17 3 0 0 0
/proc/18851/statm: 84029 7129 347 364 0 19932 0
[pid=18853] ppid=18851 vsize=1020308 CPUtime=3.76 cores=0-7
/proc/18853/stat : 18853 (gnovelty+2) R 18851 18853 18853 0 -1 4202496 1155 0 0 0 376 0 0 0 25 0 1 0 548443689 1044795392 891 33554432000 134512640 135663704 4290150000 18446744073709551615 134544196 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18853/statm: 255077 891 113 282 0 254793 0
[pid=18854] ppid=18830 vsize=346856 CPUtime=0 cores=0-7
/proc/18854/stat : 18854 (python) S 18830 18830 18491 0 -1 4202560 762 0 0 0 0 0 0 0 18 0 1 0 548443692 355180544 7136 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 10831074369870987524 0 0 17 4 0 0 0
/proc/18854/statm: 86714 7136 349 364 0 22614 0
[pid=18858] ppid=18854 vsize=253028 CPUtime=1.76 cores=0-7
/proc/18858/stat : 18858 (FH) R 18854 18858 18858 0 -1 4202496 2499 0 0 0 176 0 0 0 25 0 1 0 548443696 259100672 2232 33554432000 134512640 134936988 4292153856 18446744073709551615 134553579 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18858/statm: 63257 2232 41 104 0 62761 0
[pid=18856] ppid=18830 vsize=357044 CPUtime=0 cores=0-7
/proc/18856/stat : 18856 (python) S 18830 18830 18491 0 -1 4202560 801 0 0 0 0 0 0 0 18 0 1 0 548443696 365613056 7146 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 12377850010518126850 0 0 17 1 0 0 0
/proc/18856/statm: 89261 7146 355 364 0 25158 0
[pid=18859] ppid=18856 vsize=423400 CPUtime=3.68 cores=0-7
/proc/18859/stat : 18859 (adaptg2wsat2009) R 18856 18859 18859 0 -1 4202496 2628 0 0 0 368 0 0 0 25 0 1 0 548443696 433561600 2357 33554432000 134512640 135107411 4287832448 18446744073709551615 134539354 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18859/statm: 105850 2357 59 146 0 104726 0
[pid=18830/tid=18837] ppid=18828 vsize=366872 CPUtime=0 cores=0-7
/proc/18830/task/18837/stat : 18837 (python) S 18828 18830 18491 0 -1 4202560 26 935 0 0 0 0 0 0 22 0 9 0 548443669 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 6 0 0 0
[pid=18830/tid=18840] ppid=18828 vsize=366872 CPUtime=0 cores=0-7
/proc/18830/task/18840/stat : 18840 (python) S 18828 18830 18491 0 -1 4202560 22 935 0 0 0 0 0 0 24 0 9 0 548443673 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 2 0 0 0
[pid=18830/tid=18843] ppid=18828 vsize=366872 CPUtime=0 cores=0-7
/proc/18830/task/18843/stat : 18843 (python) S 18828 18830 18491 0 -1 4202560 22 935 0 0 0 0 0 0 20 0 9 0 548443677 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 6 0 0 0
[pid=18830/tid=18846] ppid=18828 vsize=366872 CPUtime=0 cores=0-7
/proc/18830/task/18846/stat : 18846 (python) S 18828 18830 18491 0 -1 4202560 25 935 0 0 0 0 0 0 20 0 9 0 548443680 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 2 0 0 0
[pid=18830/tid=18849] ppid=18828 vsize=366872 CPUtime=0 cores=0-7
/proc/18830/task/18849/stat : 18849 (python) S 18828 18830 18491 0 -1 4202560 23 935 0 0 0 0 0 0 20 0 9 0 548443684 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 2 0 0 0
[pid=18830/tid=18852] ppid=18828 vsize=366872 CPUtime=0 cores=0-7
/proc/18830/task/18852/stat : 18852 (python) S 18828 18830 18491 0 -1 4202560 22 935 0 0 0 0 0 0 19 0 9 0 548443688 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 3 0 0 0
[pid=18830/tid=18855] ppid=18828 vsize=366872 CPUtime=0 cores=0-7
/proc/18830/task/18855/stat : 18855 (python) S 18828 18830 18491 0 -1 4202560 36 935 0 0 0 0 0 0 21 0 9 0 548443692 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 4 0 0 0
[pid=18830/tid=18857] ppid=18828 vsize=366872 CPUtime=0 cores=0-7
/proc/18830/task/18857/stat : 18857 (python) S 18828 18830 18491 0 -1 4202560 69 935 0 0 0 0 0 0 23 0 9 0 548443696 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 29.3
Current children cumulated vsize (KiB) 7942036

[startup+12.7017 s]
/proc/loadavg: 8.07 8.30 6.57 10/289 18859
/proc/meminfo: memFree=28064568/32950928 swapFree=67086616/67111528
[pid=18830] ppid=18828 vsize=366872 CPUtime=2.5 cores=0-7
/proc/18830/stat : 18830 (python) S 18828 18830 18491 0 -1 4202496 20621 935 1 0 239 11 0 0 22 0 9 0 548443435 375676928 8685 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488521675 0 0 16781312 2 18446744073709551615 0 0 17 4 0 0 0
/proc/18830/statm: 91718 8685 1891 364 0 27615 0
[pid=18836] ppid=18830 vsize=284984 CPUtime=0.01 cores=0-7
/proc/18836/stat : 18836 (python) S 18830 18830 18491 0 -1 4202560 895 0 0 0 0 1 0 0 18 0 1 0 548443668 291823616 6922 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715023 0 0 16781312 514 13297089006043889924 0 0 17 6 0 0 0
/proc/18836/statm: 71246 6922 378 364 0 7164 0
[pid=18838] ppid=18836 vsize=1020308 CPUtime=7.19 cores=0-7
/proc/18838/stat : 18838 (gnovelty+2) R 18836 18838 18838 0 -1 4202496 1155 0 0 0 719 0 0 0 25 0 1 0 548443669 1044795392 891 33554432000 134512640 135663704 4290689552 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18838/statm: 255077 891 113 282 0 254793 0
[pid=18839] ppid=18830 vsize=294900 CPUtime=0.01 cores=0-7
/proc/18839/stat : 18839 (python) S 18830 18830 18491 0 -1 4202560 915 0 0 0 0 1 0 0 18 0 1 0 548443673 301977600 7055 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 13297089006043889924 0 0 17 2 0 0 0
/proc/18839/statm: 73725 7055 372 364 0 9640 0
[pid=18841] ppid=18839 vsize=1020308 CPUtime=10.22 cores=0-7
/proc/18841/stat : 18841 (gnovelty+2) R 18839 18841 18841 0 -1 4202496 1153 0 0 0 1022 0 0 0 25 0 1 0 548443673 1044795392 892 33554432000 134512640 135663704 4292235872 18446744073709551615 134546752 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/18841/statm: 255077 892 113 282 0 254793 0
[pid=18842] ppid=18830 vsize=305764 CPUtime=0.02 cores=0-7
/proc/18842/stat : 18842 (python) S 18830 18830 18491 0 -1 4202560 903 0 0 0 1 1 0 0 18 0 1 0 548443676 313102336 7059 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 13297089006043889923 0 0 17 6 0 0 0
/proc/18842/statm: 76441 7059 372 364 0 12353 0
[pid=18844] ppid=18842 vsize=423400 CPUtime=8.45 cores=0-7
/proc/18844/stat : 18844 (adaptg2wsat2009) R 18842 18844 18844 0 -1 4202496 2620 0 0 0 845 0 0 0 25 0 1 0 548443677 433561600 2356 33554432000 134512640 135107411 4294636704 18446744073709551615 134531781 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/18844/statm: 105850 2356 59 146 0 104726 0
[pid=18845] ppid=18830 vsize=316088 CPUtime=0.02 cores=0-7
/proc/18845/stat : 18845 (python) S 18830 18830 18491 0 -1 4202560 933 0 0 0 1 1 0 0 18 0 1 0 548443680 323674112 7063 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 13297089006043889921 0 0 17 2 0 0 0
/proc/18845/statm: 79022 7063 372 364 0 14931 0
[pid=18847] ppid=18845 vsize=423400 CPUtime=7.11 cores=0-7
/proc/18847/stat : 18847 (adaptg2wsat2009) R 18845 18847 18847 0 -1 4202496 2624 0 0 0 711 0 0 0 25 0 1 0 548443680 433561600 2358 33554432000 134512640 135107411 4294095200 18446744073709551615 134531428 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18847/statm: 105850 2358 59 146 0 104726 0
[pid=18848] ppid=18830 vsize=325860 CPUtime=0.02 cores=0-7
/proc/18848/stat : 18848 (python) S 18830 18830 18491 0 -1 4202560 948 0 0 0 1 1 0 0 18 0 1 0 548443684 333680640 7148 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 13297089006043889921 0 0 17 2 0 0 0
/proc/18848/statm: 81465 7148 370 364 0 17371 0
[pid=18850] ppid=18848 vsize=423400 CPUtime=10.13 cores=0-7
/proc/18850/stat : 18850 (adaptg2wsat2009) R 18848 18850 18850 0 -1 4202496 2622 0 0 0 1013 0 0 0 25 0 1 0 548443684 433561600 2357 33554432000 134512640 135107411 4290480224 18446744073709551615 134531613 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18850/statm: 105850 2357 59 146 0 104726 0
[pid=18851] ppid=18830 vsize=336116 CPUtime=0.02 cores=0-7
/proc/18851/stat : 18851 (python) S 18830 18830 18491 0 -1 4202560 965 0 0 0 1 1 0 0 18 0 1 0 548443688 344182784 7152 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 13297089006043889922 0 0 17 3 0 0 0
/proc/18851/statm: 84029 7152 370 364 0 19932 0
[pid=18853] ppid=18851 vsize=1020308 CPUtime=10.13 cores=0-7
/proc/18853/stat : 18853 (gnovelty+2) R 18851 18853 18853 0 -1 4202496 1155 0 0 0 1013 0 0 0 25 0 1 0 548443689 1044795392 891 33554432000 134512640 135663704 4290150000 18446744073709551615 134544196 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/18853/statm: 255077 891 113 282 0 254793 0
[pid=18854] ppid=18830 vsize=346856 CPUtime=0 cores=0-7
/proc/18854/stat : 18854 (python) S 18830 18830 18491 0 -1 4202560 963 0 0 0 0 0 0 0 18 0 1 0 548443692 355180544 7159 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 10831074369870987524 0 0 17 4 0 0 0
/proc/18854/statm: 86714 7159 372 364 0 22614 0

################
# More data... #
################

/proc/18929/statm: 141437 7643 407 364 0 77292 0
[pid=18931] ppid=18929 vsize=1020308 CPUtime=99.9 cores=0-7
/proc/18931/stat : 18931 (gnovelty+2) T 18929 18931 18931 0 -1 4202496 1170 0 0 0 9990 0 0 0 25 0 1 0 548495053 1044795392 892 33554432000 134512640 135663704 4287576032 18446744073709551615 134546811 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/18931/statm: 255077 892 113 282 0 254793 0
[pid=18929/tid=18943] ppid=18830 vsize=565748 CPUtime=0 cores=0-7
/proc/18929/task/18943/stat : 18943 (python) S 18830 18830 18491 0 -1 4202560 95 0 0 0 0 0 0 0 19 0 2 0 548505079 579325952 7643 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 514 18446604471149811712 0 0 -1 5 0 0 0
[pid=18934] ppid=18830 vsize=576004 CPUtime=0.3 cores=0-7
/proc/18934/stat : 18934 (python) S 18830 18830 18491 0 -1 4202560 1180 0 0 0 15 15 0 0 19 0 2 0 548497231 589828096 7649 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18934/statm: 144001 7649 406 364 0 79853 0
[pid=18936] ppid=18934 vsize=335996 CPUtime=97.16 cores=0-7
/proc/18936/stat : 18936 (iPAWS) T 18934 18936 18936 0 -1 4202496 2051 0 0 0 9716 0 0 0 25 0 1 0 548497232 344059904 1774 33554432000 134512640 135114423 4292406512 18446744073709551615 134546146 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/18936/statm: 83999 1774 59 147 0 83851 0
[pid=18934/tid=18952] ppid=18830 vsize=576004 CPUtime=0 cores=0-7
/proc/18934/task/18952/stat : 18952 (python) S 18830 18830 18491 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 548510860 589828096 7649 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 514 18446604454223780800 0 0 -1 0 0 0 0
[pid=18939] ppid=18830 vsize=586260 CPUtime=1.1 cores=0-7
/proc/18939/stat : 18939 (python) S 18830 18830 18491 0 -1 4202560 1205 0 0 0 60 50 0 0 18 0 2 0 548501634 600330240 7795 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 6 0 0 0
/proc/18939/statm: 146565 7795 407 364 0 82414 0
[pid=18941] ppid=18939 vsize=268420 CPUtime=391.16 cores=0-7
/proc/18941/stat : 18941 (hybridGM3) T 18939 18941 18941 0 -1 4202496 6202 0 0 0 39115 1 0 0 25 0 1 0 548501634 274862080 5919 33554432000 134512640 135204385 4290864352 18446744073709551615 134537726 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/18941/statm: 67105 5919 63 169 0 66935 0
[pid=18939/tid=18961] ppid=18830 vsize=586260 CPUtime=0 cores=0-7
/proc/18939/task/18961/stat : 18961 (python) S 18830 18830 18491 0 -1 4202560 92 0 0 0 0 0 0 0 18 0 2 0 548526703 600330240 7795 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 514 18446604470207982400 0 0 -1 1 0 0 0
[pid=18944] ppid=18830 vsize=597204 CPUtime=1.22 cores=0-7
/proc/18944/stat : 18944 (python) S 18830 18830 18491 0 -1 4202560 1304 0 0 0 60 62 0 0 18 0 2 0 548505560 611536896 7599 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 7 0 0 0
/proc/18944/statm: 149301 7599 402 364 0 85147 0
[pid=18946] ppid=18944 vsize=268424 CPUtime=388.46 cores=0-7
/proc/18946/stat : 18946 (hybridGM3) T 18944 18946 18946 0 -1 4202496 6203 0 0 0 38844 2 0 0 25 0 1 0 548505560 274866176 5920 33554432000 134512640 135204385 4293427456 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/18946/statm: 67106 5920 63 169 0 66936 0
[pid=18944/tid=18965] ppid=18830 vsize=597204 CPUtime=0 cores=0-7
/proc/18944/task/18965/stat : 18965 (python) S 18830 18830 18491 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 548529223 611536896 7599 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 514 18446604470207979712 0 0 -1 0 0 0 0
[pid=18948] ppid=18830 vsize=607864 CPUtime=1.97 cores=0-7
/proc/18948/stat : 18948 (python) S 18830 18830 18491 0 -1 4202560 1129 0 0 0 99 98 0 0 18 0 1 0 548510125 622452736 7679 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 13297089006043889926 0 0 17 7 0 0 0
/proc/18948/statm: 151966 7679 374 364 0 87809 0
[pid=18950] ppid=18948 vsize=461504 CPUtime=820.2 cores=0-7
/proc/18950/stat : 18950 (TNM) R 18948 18950 18950 0 -1 4202496 2478 0 0 0 82020 0 0 0 25 0 1 0 548510126 472580096 2194 33554432000 134512640 135008748 4294066208 18446744073709551615 134536415 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/18950/statm: 115376 2194 46 122 0 114276 0
[pid=18953] ppid=18830 vsize=617688 CPUtime=0.25 cores=0-7
/proc/18953/stat : 18953 (python) S 18830 18830 18491 0 -1 4202560 1314 0 0 0 13 12 0 0 19 0 2 0 548510870 632512512 7717 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18953/statm: 154422 7717 401 364 0 90262 0
[pid=18955] ppid=18953 vsize=335996 CPUtime=102.39 cores=0-7
/proc/18955/stat : 18955 (iPAWS) T 18953 18955 18955 0 -1 4202496 2060 0 0 0 10239 0 0 0 25 0 1 0 548510874 344059904 1774 33554432000 134512640 135114423 4294750768 18446744073709551615 134546547 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/18955/statm: 83999 1774 59 147 0 83851 0
[pid=18953/tid=18958] ppid=18830 vsize=617688 CPUtime=0 cores=0-7
/proc/18953/task/18958/stat : 18958 (python) S 18830 18830 18491 0 -1 4202560 45 0 0 0 0 0 0 0 19 0 2 0 548522099 632512512 7717 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 514 18446604471159273344 0 0 -1 1 0 0 0
[pid=18962] ppid=18830 vsize=628312 CPUtime=0.25 cores=0-7
/proc/18962/stat : 18962 (python) S 18830 18830 18491 0 -1 4202560 1284 0 0 0 12 13 0 0 19 0 2 0 548528416 643391488 7723 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18962/statm: 157078 7723 402 364 0 92915 0
[pid=18964] ppid=18962 vsize=1020308 CPUtime=99.58 cores=0-7
/proc/18964/stat : 18964 (gnovelty+2) T 18962 18964 18964 0 -1 4202496 1181 0 0 0 9958 0 0 0 25 0 1 0 548528417 1044795392 892 33554432000 134512640 135663704 4291187584 18446744073709551615 134544183 0 0 16781312 0 18446744071562691360 0 0 17 1 0 0 0
/proc/18964/statm: 255077 892 113 282 0 254793 0
[pid=18962/tid=18972] ppid=18830 vsize=628312 CPUtime=0 cores=0-7
/proc/18962/task/18972/stat : 18972 (python) S 18830 18830 18491 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 548539061 643391488 7723 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 514 18446604471146707072 0 0 -1 1 0 0 0
[pid=18968] ppid=18830 vsize=638200 CPUtime=1.4 cores=0-7
/proc/18968/stat : 18968 (python) S 18830 18830 18491 0 -1 4202560 1382 0 0 0 75 65 0 0 18 0 2 0 548534847 653516800 7900 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18968/statm: 159550 7900 407 364 0 95384 0
[pid=18970] ppid=18968 vsize=268420 CPUtime=490.24 cores=0-7
/proc/18970/stat : 18970 (hybridGM3) R 18968 18970 18970 0 -1 4202496 6208 0 0 0 49021 3 0 0 25 0 1 0 548534848 274862080 5919 33554432000 134512640 135204385 4287586624 18446744073709551615 134545414 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/18970/statm: 67105 5919 63 169 0 66935 0
[pid=18968/tid=18984] ppid=18830 vsize=638200 CPUtime=0 cores=0-7
/proc/18968/task/18984/stat : 18984 (python) S 18830 18830 18491 0 -1 4202560 226 0 0 0 0 0 0 0 18 0 2 0 548558107 653516800 7900 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 514 18446604471139154880 0 0 -1 1 0 0 0
[pid=18976] ppid=18830 vsize=648456 CPUtime=1.06 cores=0-7
/proc/18976/stat : 18976 (python) S 18830 18830 18491 0 -1 4202560 1039 0 0 0 60 46 0 0 18 0 1 0 548549382 664018944 7881 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 13297089006043889925 0 0 17 0 0 0 0
/proc/18976/statm: 162114 7881 379 364 0 97945 0
[pid=18978] ppid=18976 vsize=423308 CPUtime=376.91 cores=0-7
/proc/18978/stat : 18978 (NCVWr) R 18976 18978 18978 0 -1 4202496 2548 0 0 0 37689 2 0 0 25 0 1 0 548549391 433467392 2265 33554432000 134512640 135113558 4293758928 18446744073709551615 134531867 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/18978/statm: 105827 2265 58 147 0 104702 0
[pid=18981] ppid=18830 vsize=658712 CPUtime=0.88 cores=0-7
/proc/18981/stat : 18981 (python) S 18830 18830 18491 0 -1 4202560 1271 0 0 0 51 37 0 0 18 0 2 0 548557121 674521088 8002 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/18981/statm: 164678 8002 407 364 0 100506 0
[pid=18983] ppid=18981 vsize=253032 CPUtime=340.81 cores=0-7
/proc/18983/stat : 18983 (FH) R 18981 18983 18983 0 -1 4202496 2520 0 0 0 34080 1 0 0 25 0 1 0 548557121 259104768 2233 33554432000 134512640 134936988 4293505360 18446744073709551615 134554397 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/18983/statm: 63258 2233 41 104 0 62762 0
[pid=18981/tid=18988] ppid=18830 vsize=658712 CPUtime=0 cores=0-7
/proc/18981/task/18988/stat : 18988 (python) S 18830 18830 18491 0 -1 4202560 110 0 0 0 0 0 0 0 18 0 2 0 548568947 674521088 8002 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 514 18446604462808367424 0 0 -1 1 0 0 0
[pid=18990] ppid=18830 vsize=668968 CPUtime=0.24 cores=0-7
/proc/18990/stat : 18990 (python) S 18830 18830 18491 0 -1 4202560 1278 0 0 0 13 11 0 0 19 0 2 0 548573368 685023232 7929 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488521675 0 0 16781312 514 18446744073709551615 0 0 17 5 0 0 0
/proc/18990/statm: 167242 7929 407 364 0 103067 0
[pid=18992] ppid=18990 vsize=335996 CPUtime=102.24 cores=0-7
/proc/18992/stat : 18992 (iPAWS) T 18990 18992 18992 0 -1 4202496 2063 0 0 0 10224 0 0 0 25 0 1 0 548573370 344059904 1775 33554432000 134512640 135114423 4292121584 18446744073709551615 134516646 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/18992/statm: 83999 1775 59 147 0 83851 0
[pid=18990/tid=18996] ppid=18830 vsize=668968 CPUtime=0 cores=0-7
/proc/18990/task/18996/stat : 18996 (python) S 18830 18830 18491 0 -1 4202560 114 0 0 0 0 0 0 0 19 0 2 0 548583993 685023232 7929 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 514 18446604462808369216 0 0 -1 1 0 0 0
[pid=19000] ppid=18830 vsize=679224 CPUtime=0 cores=0-7
/proc/19000/stat : 19000 (python) S 18830 18830 18491 0 -1 4202560 934 0 0 0 0 0 0 0 19 0 1 0 548594941 695525376 7818 33554432000 4194304 5683644 140735727620160 18446744073709551615 239476715078 0 0 16781312 514 5608112662958309375 0 0 17 4 0 0 0
/proc/19000/statm: 169806 7818 346 364 0 105628 0
[pid=19002] ppid=19000 vsize=335996 CPUtime=0.35 cores=0-7
/proc/19002/stat : 19002 (iPAWS) R 19000 19002 19002 0 -1 4202496 2064 0 0 0 35 0 0 0 21 0 1 0 548594941 344059904 1773 33554432000 134512640 135114423 4287744560 18446744073709551615 134519906 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/19002/statm: 83999 1773 59 147 0 83851 0
[pid=18830/tid=18837] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18837/stat : 18837 (python) S 18828 18830 18491 0 -1 4202560 26 935 0 0 0 0 0 0 22 0 34 0 548443669 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 6 0 0 0
[pid=18830/tid=18840] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18840/stat : 18840 (python) S 18828 18830 18491 0 -1 4202560 22 935 0 0 0 0 0 0 24 0 34 0 548443673 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 2 0 0 0
[pid=18830/tid=18843] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18843/stat : 18843 (python) S 18828 18830 18491 0 -1 4202560 44 935 0 0 0 0 0 0 18 0 34 0 548443677 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18846] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18846/stat : 18846 (python) S 18828 18830 18491 0 -1 4202560 36 935 0 0 0 0 0 0 18 0 34 0 548443680 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 2 0 0 0
[pid=18830/tid=18849] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18849/stat : 18849 (python) S 18828 18830 18491 0 -1 4202560 26 935 0 0 0 0 0 0 18 0 34 0 548443684 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 2 0 0 0
[pid=18830/tid=18852] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18852/stat : 18852 (python) S 18828 18830 18491 0 -1 4202560 22 935 0 0 0 0 0 0 19 0 34 0 548443688 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 3 0 0 0
[pid=18830/tid=18855] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18855/stat : 18855 (python) S 18828 18830 18491 0 -1 4202560 43 935 0 0 0 0 0 0 18 0 34 0 548443692 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18857] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18857/stat : 18857 (python) S 18828 18830 18491 0 -1 4202560 74 935 0 0 0 0 0 0 18 0 34 0 548443696 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 4 0 0 0
[pid=18830/tid=18865] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18865/stat : 18865 (python) S 18828 18830 18491 0 -1 4202560 33 935 0 0 0 0 0 0 18 0 34 0 548453700 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 2 0 0 0
[pid=18830/tid=18869] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18869/stat : 18869 (python) S 18828 18830 18491 0 -1 4202560 40 935 0 0 0 0 0 0 18 0 34 0 548453704 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 4 0 0 0
[pid=18830/tid=18872] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18872/stat : 18872 (python) S 18828 18830 18491 0 -1 4202560 51 935 0 0 0 0 0 0 18 0 34 0 548453709 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 4 0 0 0
[pid=18830/tid=18877] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18877/stat : 18877 (python) S 18828 18830 18491 0 -1 4202560 23 935 0 0 0 0 0 0 24 0 34 0 548453719 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 0 0 0 0
[pid=18830/tid=18880] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18880/stat : 18880 (python) S 18828 18830 18491 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 34 0 548453724 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 0 0 0 0
[pid=18830/tid=18884] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18884/stat : 18884 (python) S 18828 18830 18491 0 -1 4202560 42 935 0 0 0 0 0 0 18 0 34 0 548453751 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 0 0 0 0
[pid=18830/tid=18890] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18890/stat : 18890 (python) S 18828 18830 18491 0 -1 4202560 36 935 0 0 0 0 0 0 18 0 34 0 548458507 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 3 0 0 0
[pid=18830/tid=18894] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18894/stat : 18894 (python) S 18828 18830 18491 0 -1 4202560 135 935 0 0 0 0 0 0 18 0 34 0 548458515 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18899] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18899/stat : 18899 (python) S 18828 18830 18491 0 -1 4202560 27 935 0 0 0 0 0 0 19 0 34 0 548463733 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 2 0 0 0
[pid=18830/tid=18903] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18903/stat : 18903 (python) S 18828 18830 18491 0 -1 4202560 131 935 0 0 0 0 0 0 19 0 34 0 548463757 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18914] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18914/stat : 18914 (python) S 18828 18830 18491 0 -1 4202560 41 935 0 0 0 0 0 0 20 0 34 0 548476464 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18919] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18919/stat : 18919 (python) S 18828 18830 18491 0 -1 4202560 37 935 0 0 0 0 0 0 20 0 34 0 548480134 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18925] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18925/stat : 18925 (python) S 18828 18830 18491 0 -1 4202560 40 935 0 0 0 0 0 0 19 0 34 0 548485220 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18930] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18930/stat : 18930 (python) S 18828 18830 18491 0 -1 4202560 40 935 0 0 0 0 0 0 20 0 34 0 548495053 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18935] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18935/stat : 18935 (python) S 18828 18830 18491 0 -1 4202560 37 935 0 0 0 0 0 0 19 0 34 0 548497231 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18940] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18940/stat : 18940 (python) S 18828 18830 18491 0 -1 4202560 46 935 0 0 0 0 0 0 18 0 34 0 548501634 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18945] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18945/stat : 18945 (python) S 18828 18830 18491 0 -1 4202560 35 935 0 0 0 0 0 0 18 0 34 0 548505560 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18949] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18949/stat : 18949 (python) S 18828 18830 18491 0 -1 4202560 27 935 0 0 0 0 0 0 20 0 34 0 548510125 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18954] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18954/stat : 18954 (python) S 18828 18830 18491 0 -1 4202560 28 935 0 0 0 0 0 0 20 0 34 0 548510870 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18963] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18963/stat : 18963 (python) S 18828 18830 18491 0 -1 4202560 30 935 0 0 0 0 0 0 20 0 34 0 548528416 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 0 0 0 0
[pid=18830/tid=18969] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18969/stat : 18969 (python) S 18828 18830 18491 0 -1 4202560 183 935 0 0 0 0 0 0 18 0 34 0 548534847 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18977] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18977/stat : 18977 (python) S 18828 18830 18491 0 -1 4202560 35 935 0 0 0 0 0 0 20 0 34 0 548549383 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18982] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18982/stat : 18982 (python) S 18828 18830 18491 0 -1 4202560 42 935 0 0 0 0 0 0 18 0 34 0 548557121 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=18991] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/18991/stat : 18991 (python) S 18828 18830 18491 0 -1 4202560 42 935 0 0 0 0 0 0 20 0 34 0 548573369 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
[pid=18830/tid=19001] ppid=18828 vsize=689468 CPUtime=0 cores=0-7
/proc/18830/task/19001/stat : 19001 (python) S 18828 18830 18491 0 -1 4202560 46 935 0 0 0 0 0 0 20 0 34 0 548594941 706015232 9418 33554432000 4194304 5683644 140735727620160 18446744073709551615 239488518577 0 0 16781312 2 18446604445374898304 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10709.7
Current children cumulated vsize (KiB) 32011744

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18830 and gives
#  childrusage.ru_utime.tv_sec=7
#  childrusage.ru_utime.tv_usec=132915
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=256960
# CPU time returned by wait4() is 7.38987
# while last known CPU time is 10709.7
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1515.91
CPU time (s): 10709.7
CPU user time (s): 10696.4
CPU system time (s): 13.29
CPU usage (%): 706.489
Max. virtual memory (cumulated for all children) (KiB): 32011744

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 7.13291
system time used= 0.25696
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 74243
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1244
involuntary context switches= 157

runsolver used 15.8026 second user time and 37.3183 second system time

The end

Launcher Data 

Begin job on node148 at 2011-05-02 22:34:24
IDJOB=3321857
IDBENCH=82635
IDSOLVER=1712
FILE ID=node148/3321857-1304368463
RUNJOBID= node148-1304366464-18505
PBS_JOBID= 13181726
Free space on /tmp= 73448 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k5-r20-v2000-c40000-S61914820-087-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321857-1304368463/watcher-3321857-1304368463 -o /tmp/evaluation-result-3321857-1304368463/solver-3321857-1304368463 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321857-1304368463.cnf -seed 1132285276 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1b9b43753c02a2c226adda648a956e92
RANDOM SEED=1132285276

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      28182940 kB
Buffers:        828812 kB
Cached:        2314400 kB
SwapCached:       3916 kB
Active:        1687364 kB
Inactive:      2683840 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      28182940 kB
SwapTotal:    67111528 kB
SwapFree:     67086616 kB
Dirty:           33052 kB
Writeback:           0 kB
AnonPages:     1226568 kB
Mapped:          22740 kB
Slab:           313476 kB
PageTables:      17040 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 50162076 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73416 MiB
End job on node148 at 2011-05-02 22:59:42