Trace number 3385410

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)? (MO) 9512 1214.52

General information on the benchmark

Namerandom/large/
unif-k5-r20-v2000-c40000-S922811046-076-UNKNOWN.cnf
MD5SUMe99bff721d695892a53f60adc73d403b
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark625.84
Satisfiable
(Un)Satisfiability was proved
Number of variables2000
Number of clauses40000
Sum of the clauses size200000
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 540000
Number of clauses of size over 50

Solver Data 

0.36/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.36/0.68	c INFO: solving HOME/instance-3385410-1305566318.cnf
0.36/0.68	c INFO: computing task features
0.53/0.89	c INFO: computed variable-clause graph statistics
0.53/0.89	c INFO: computed clause balance statistics
1.64/1.90	c INFO: computed variable balance statistics
2.14/2.44	c INFO: computed small-clause counts
2.14/2.44	c INFO: computed Horn-clause counts
2.14/2.48	c INFO: computed variable graph statistics
2.14/2.48	c INFO: collected features for HOME/instance-3385410-1305566318.cnf in 1.80 s
2.23/2.51	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.38)
2.23/2.55	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.13)
2.23/2.57	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.08)
2.33/2.61	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.07)
2.33/2.64	c INFO: running adaptg2wsat2009++@0 for 97 with 4998 remaining (b = 0.05)
2.33/2.67	c INFO: running gnovelty+2@0 for 97 with 4998 remaining (b = 0.05)
2.43/2.72	c INFO: running FH@0 for 97 with 4997 remaining (b = 0.03)
2.43/2.76	c INFO: running adaptg2wsat2009++@0 for 97 with 4997 remaining (b = 0.03)
705.67/100.93	c INFO: running adaptg2wsat2009++@0 for 97 with 4899 remaining (b = 0.02)
718.91/102.90	c INFO: running FH@0 for 97 with 4897 remaining (b = 0.02)
719.57/102.94	c INFO: running hybridGM3@0 for 194 with 4897 remaining (b = 0.04)
720.73/103.17	c INFO: running gnovelty+2@0 for 97 with 4897 remaining (b = 0.02)
766.48/109.25	c INFO: running hybridGM3@0 for 194 with 4891 remaining (b = 0.03)
810.60/115.11	c INFO: running adaptg2wsat2009++@0 for 97 with 4885 remaining (b = 0.01)
936.99/132.07	c INFO: running hybridGM3@0 for 194 with 4868 remaining (b = 0.03)
943.91/133.03	c INFO: running hybridGM3@0 for 194 with 4867 remaining (b = 0.02)
1448.90/201.28	c INFO: running TNM@0 for 1552 with 4799 remaining (b = 0.19)
1505.37/208.31	c INFO: running FH@0 for 97 with 4792 remaining (b = 0.01)
1610.52/221.51	c INFO: running adaptg2wsat2009++@0 for 97 with 4779 remaining (b = 0.01)
1611.31/221.66	c INFO: running adaptg2wsat2009++@98 for 97 with 4779 remaining (b = 0.01)
2233.53/299.75	c INFO: running hybridGM3@99 for 97 with 4700 remaining (b = 0.01)
2304.41/308.67	c INFO: running hybridGM3@0 for 194 with 4692 remaining (b = 0.02)
2330.72/311.99	c INFO: running hybridGM3@98 for 97 with 4688 remaining (b = 0.01)
2385.69/318.87	c INFO: running hybridGM3@0 for 194 with 4681 remaining (b = 0.02)
2386.49/319.00	c INFO: running TNM@0 for 1552 with 4681 remaining (b = 0.15)
2513.10/334.89	c INFO: running hybridGM3@97 for 97 with 4665 remaining (b = 0.01)
2617.47/347.92	c INFO: running hybridGM3@99 for 97 with 4652 remaining (b = 0.01)
3040.70/401.11	c INFO: running adaptg2wsat2009++@0 for 97 with 4599 remaining (b = 0.01)
3137.72/413.35	c INFO: running adaptg2wsat2009++@0 for 97 with 4587 remaining (b = 0.01)
3320.16/436.25	c INFO: running hybridGM3@293 for 97 with 4564 remaining (b = 0.01)
3423.69/449.28	c INFO: running adaptg2wsat2009++@100 for 97 with 4551 remaining (b = 0.01)
3815.70/498.47	c INFO: running FH@0 for 291 with 4502 remaining (b = 0.03)
3888.18/507.56	c INFO: running gnovelty+2@0 for 97 with 4493 remaining (b = 0.01)
3952.69/515.66	c INFO: running hybridGM3@97 for 97 with 4485 remaining (b = 0.01)
3962.24/516.80	c INFO: running iPAWS@0 for 97 with 4483 remaining (b = 0.01)
4079.25/531.60	c INFO: running hybridGM3@394 for 97 with 4469 remaining (b = 0.01)
4199.51/546.64	c INFO: running adaptg2wsat2009++@293 for 291 with 4454 remaining (b = 0.02)
4681.23/607.13	c INFO: running hybridGM3@0 for 194 with 4393 remaining (b = 0.02)
4712.18/611.00	c INFO: running hybridGM3@0 for 194 with 4389 remaining (b = 0.01)
4753.48/616.24	c INFO: running TNM@0 for 1552 with 4384 remaining (b = 0.11)
4886.30/632.97	c INFO: running FH@100 for 291 with 4367 remaining (b = 0.02)
6171.43/794.43	c INFO: running iPAWS@0 for 97 with 4206 remaining (b = 0.01)
6277.22/807.78	c INFO: running hybridGM3@98 for 97 with 4192 remaining (b = 0.01)
6342.48/815.93	c INFO: running hybridGM3@95 for 97 with 4184 remaining (b = 0.01)
6554.21/842.60	c INFO: running adaptg2wsat2009++@392 for 194 with 4158 remaining (b = 0.02)
6962.36/893.83	c INFO: running FH@197 for 194 with 4106 remaining (b = 0.01)
7084.09/909.15	c INFO: running hybridGM3@298 for 97 with 4091 remaining (b = 0.01)
7100.81/911.29	c INFO: running hybridGM3@389 for 97 with 4089 remaining (b = 0.01)
7241.61/928.92	c INFO: running adaptg2wsat2009++@98 for 97 with 4071 remaining (b = 0.01)
7859.85/1006.64	c INFO: running FH@0 for 97 with 3994 remaining (b = 0.01)
7890.87/1010.54	c INFO: running hybridGM3@393 for 97 with 3990 remaining (b = 0.01)
8015.84/1026.29	c INFO: running NCVWr@0 for 485 with 3974 remaining (b = 0.03)
8079.40/1034.24	c INFO: running adaptg2wsat2009++@490 for 97 with 3966 remaining (b = 0.01)
8503.50/1087.51	c INFO: running FH@295 for 97 with 3913 remaining (b = 0.01)
8697.64/1111.92	c INFO: running iPAWS@0 for 97 with 3888 remaining (b = 0.01)
8706.36/1113.05	c INFO: running gnovelty+2@0 for 97 with 3887 remaining (b = 0.01)
8886.07/1135.62	c INFO: running adaptg2wsat2009++@682 for 97 with 3865 remaining (b = 0.01)
9261.48/1182.87	c INFO: running hybridGM3@0 for 194 with 3817 remaining (b = 0.01)
9504.69/1213.50	c INFO: running hybridGM3@0 for 194 with 3787 remaining (b = 0.01)
9512.00/1214.44	c INFO: running NCVWr@0 for 485 with 3786 remaining (b = 0.03)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385410-1305566318/watcher-3385410-1305566318 -o /tmp/evaluation-result-3385410-1305566318/solver-3385410-1305566318 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385410-1305566318.cnf -seed 1321995845 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.64 8.28 6.39 2/380 10121
/proc/meminfo: memFree=22479624/32951124 swapFree=67023148/67111528
[pid=10121] ppid=10119 vsize=15184 CPUtime=0 cores=0-7
/proc/10121/stat : 10121 (python) S 10119 10121 9715 0 -1 4202496 732 0 0 0 0 0 0 0 25 0 1 0 649047653 15548416 622 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510295552 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/10121/statm: 3796 622 322 364 0 283 0

[startup+0.096876 s]
/proc/loadavg: 8.64 8.28 6.39 2/380 10121
/proc/meminfo: memFree=22479624/32951124 swapFree=67023148/67111528
[pid=10121] ppid=10119 vsize=85360 CPUtime=0.05 cores=0-7
/proc/10121/stat : 10121 (python) R 10119 10121 9715 0 -1 4202496 2580 0 0 0 4 1 0 0 18 0 1 0 649047653 87408640 2307 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510295552 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/10121/statm: 21340 2307 707 364 0 1557 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85360

[startup+0.100869 s]
/proc/loadavg: 8.64 8.28 6.39 2/380 10121
/proc/meminfo: memFree=22479624/32951124 swapFree=67023148/67111528
[pid=10121] ppid=10119 vsize=85624 CPUtime=0.05 cores=0-7
/proc/10121/stat : 10121 (python) S 10119 10121 9715 0 -1 4202496 2629 0 0 0 4 1 0 0 18 0 1 0 649047653 87678976 2348 33554432000 4194304 5683644 140734990738320 18446744073709551615 233505373831 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/10121/statm: 21406 2348 713 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85624

[startup+0.300869 s]
/proc/loadavg: 8.64 8.28 6.39 2/380 10121
/proc/meminfo: memFree=22479624/32951124 swapFree=67023148/67111528
[pid=10121] ppid=10119 vsize=135752 CPUtime=0.19 cores=0-7
/proc/10121/stat : 10121 (python) R 10119 10121 9715 0 -1 4202496 5967 933 1 0 13 6 0 0 18 0 1 0 649047653 139010048 4151 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510293509 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/10121/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.700789 s]
/proc/loadavg: 8.64 8.28 6.39 2/380 10121
/proc/meminfo: memFree=22479624/32951124 swapFree=67023148/67111528
[pid=10121] ppid=10119 vsize=280156 CPUtime=0.43 cores=0-7
/proc/10121/stat : 10121 (python) R 10119 10121 9715 0 -1 4202496 9678 933 1 0 32 11 0 0 17 0 1 0 649047653 286879744 7358 33554432000 4194304 5683644 140734990738320 18446744073709551615 4531895 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/10121/statm: 70039 7358 1761 364 0 5963 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 280156

[startup+1.50065 s]
/proc/loadavg: 8.64 8.28 6.39 3/381 10126
/proc/meminfo: memFree=22445144/32951124 swapFree=67023148/67111528
[pid=10121] ppid=10119 vsize=290804 CPUtime=1.24 cores=0-7
/proc/10121/stat : 10121 (python) R 10119 10121 9715 0 -1 4202496 14011 933 1 0 112 12 0 0 18 0 1 0 649047653 297783296 10085 33554432000 4194304 5683644 140734990738320 18446744073709551615 233509993904 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/10121/statm: 72701 10085 1826 364 0 8625 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 290804

[startup+3.1003 s]
/proc/loadavg: 8.64 8.28 6.39 3/381 10126
/proc/meminfo: memFree=22444772/32951124 swapFree=67023148/67111528
[pid=10121] ppid=10119 vsize=432072 CPUtime=2.48 cores=0-7
/proc/10121/stat : 10121 (python) S 10119 10121 9715 0 -1 4202496 20123 933 1 0 234 14 0 0 23 0 9 0 649047653 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/10121/statm: 108018 8734 1891 364 0 43915 0
Current children cumulated CPU time (s) 2.48
Current children cumulated vsize (KiB) 432072
heavy processes:

[startup+6.30172 s]
/proc/loadavg: 8.67 8.30 6.40 10/405 10150
/proc/meminfo: memFree=22364972/32951124 swapFree=67023148/67111528
[pid=10121] ppid=10119 vsize=432072 CPUtime=2.48 cores=0-7
/proc/10121/stat : 10121 (python) S 10119 10121 9715 0 -1 4202496 20123 933 1 0 234 14 0 0 23 0 9 0 649047653 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/10121/statm: 108018 8734 1891 364 0 43915 0
[pid=10127] ppid=10121 vsize=284984 CPUtime=0 cores=0-7
/proc/10127/stat : 10127 (python) S 10121 10121 9715 0 -1 4202560 732 0 0 0 0 0 0 0 18 0 1 0 649047905 291823616 6898 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317583 0 0 16781312 514 9340667391845040386 0 0 17 2 0 0 0
/proc/10127/statm: 71246 6898 355 364 0 7164 0
[pid=10129] ppid=10127 vsize=1020308 CPUtime=3.76 cores=0-7
/proc/10129/stat : 10129 (gnovelty+2) R 10127 10129 10129 0 -1 4202496 1153 0 0 0 376 0 0 0 25 0 1 0 649047905 1044795392 892 33554432000 134512640 135663704 4287506160 18446744073709551615 134545646 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/10129/statm: 255077 892 113 282 0 254793 0
[pid=10130] ppid=10121 vsize=294904 CPUtime=0 cores=0-7
/proc/10130/stat : 10130 (python) S 10121 10121 9715 0 -1 4202560 741 0 0 0 0 0 0 0 18 0 1 0 649047908 301981696 7031 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 9340659695263645953 0 0 17 7 0 0 0
/proc/10130/statm: 73726 7031 349 364 0 9641 0
[pid=10132] ppid=10130 vsize=1020308 CPUtime=3.74 cores=0-7
/proc/10132/stat : 10132 (gnovelty+2) R 10130 10132 10132 0 -1 4202496 1156 0 0 0 374 0 0 0 25 0 1 0 649047908 1044795392 891 33554432000 134512640 135663704 4292885296 18446744073709551615 134524548 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10132/statm: 255077 891 113 282 0 254793 0
[pid=10133] ppid=10121 vsize=305160 CPUtime=0 cores=0-7
/proc/10133/stat : 10133 (python) S 10121 10121 9715 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 649047911 312483840 7035 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 3164658626702835970 0 0 17 6 0 0 0
/proc/10133/statm: 76290 7035 349 364 0 12202 0
[pid=10135] ppid=10133 vsize=423400 CPUtime=3.71 cores=0-7
/proc/10135/stat : 10135 (adaptg2wsat2009) R 10133 10135 10135 0 -1 4202496 2622 0 0 0 371 0 0 0 25 0 1 0 649047911 433561600 2357 33554432000 134512640 135107411 4294463184 18446744073709551615 134532293 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/10135/statm: 105850 2357 59 146 0 104726 0
[pid=10136] ppid=10121 vsize=316020 CPUtime=0 cores=0-7
/proc/10136/stat : 10136 (python) S 10121 10121 9715 0 -1 4202560 750 0 0 0 0 0 0 0 18 0 1 0 649047914 323604480 7039 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 506720933071782146 0 0 17 1 0 0 0
/proc/10136/statm: 79005 7039 349 364 0 14914 0
[pid=10138] ppid=10136 vsize=423400 CPUtime=3.67 cores=0-7
/proc/10138/stat : 10138 (adaptg2wsat2009) R 10136 10138 10138 0 -1 4202496 2623 0 0 0 367 0 0 0 25 0 1 0 649047914 433561600 2359 33554432000 134512640 135107411 4292833344 18446744073709551615 134531905 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/10138/statm: 105850 2359 59 146 0 104726 0
[pid=10139] ppid=10121 vsize=326176 CPUtime=0 cores=0-7
/proc/10139/stat : 10139 (python) S 10121 10121 9715 0 -1 4202560 759 0 0 0 0 0 0 0 18 0 1 0 649047917 334004224 7043 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 4351035521363837188 0 0 17 1 0 0 0
/proc/10139/statm: 81544 7043 349 364 0 17450 0
[pid=10141] ppid=10139 vsize=423400 CPUtime=3.59 cores=0-7
/proc/10141/stat : 10141 (adaptg2wsat2009) R 10139 10141 10141 0 -1 4202496 2625 0 0 0 359 0 0 0 25 0 1 0 649047917 433561600 2357 33554432000 134512640 135107411 4286930352 18446744073709551615 134531604 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10141/statm: 105850 2357 59 146 0 104726 0
[pid=10142] ppid=10121 vsize=401316 CPUtime=0 cores=0-7
/proc/10142/stat : 10142 (python) S 10121 10121 9715 0 -1 4202560 724 0 0 0 0 0 0 0 18 0 1 0 649047920 410947584 7218 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 5524580015817064706 0 0 17 0 0 0 0
/proc/10142/statm: 100329 7218 348 364 0 36232 0
[pid=10144] ppid=10142 vsize=1020308 CPUtime=1.91 cores=0-7
/proc/10144/stat : 10144 (gnovelty+2) R 10142 10144 10144 0 -1 4202496 1147 0 0 0 191 0 0 0 25 0 1 0 649047922 1044795392 891 33554432000 134512640 135663704 4287996000 18446744073709551615 134544196 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/10144/statm: 255077 891 113 282 0 254793 0
[pid=10145] ppid=10121 vsize=411572 CPUtime=0 cores=0-7
/proc/10145/stat : 10145 (python) S 10121 10121 9715 0 -1 4202560 730 0 0 0 0 0 0 0 18 0 1 0 649047925 421449728 7182 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 3888181533122461960 0 0 17 1 0 0 0
/proc/10145/statm: 102893 7182 348 364 0 38793 0
[pid=10147] ppid=10145 vsize=253032 CPUtime=3.53 cores=0-7
/proc/10147/stat : 10147 (FH) R 10145 10147 10147 0 -1 4202496 2490 0 0 0 353 0 0 0 25 0 1 0 649047928 259104768 2234 33554432000 134512640 134936988 4292092464 18446744073709551615 134554594 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10147/statm: 63258 2234 41 104 0 62762 0
[pid=10148] ppid=10121 vsize=421828 CPUtime=0 cores=0-7
/proc/10148/stat : 10148 (python) S 10121 10121 9715 0 -1 4202560 772 0 0 0 0 0 0 0 18 0 1 0 649047929 431951872 7193 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 4407857457653580036 0 0 17 0 0 0 0
/proc/10148/statm: 105457 7193 354 364 0 41354 0
[pid=10150] ppid=10148 vsize=423400 CPUtime=1.67 cores=0-7
/proc/10150/stat : 10150 (adaptg2wsat2009) R 10148 10150 10150 0 -1 4202496 2625 0 0 0 167 0 0 0 25 0 1 0 649047935 433561600 2358 33554432000 134512640 135107411 4291714672 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/10150/statm: 105850 2358 59 146 0 104726 0
[pid=10121/tid=10128] ppid=10119 vsize=432072 CPUtime=0 cores=0-7
/proc/10121/task/10128/stat : 10128 (python) S 10119 10121 9715 0 -1 4202560 27 933 0 0 0 0 0 0 22 0 9 0 649047905 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 0 0 0 0
[pid=10121/tid=10131] ppid=10119 vsize=432072 CPUtime=0 cores=0-7
/proc/10121/task/10131/stat : 10131 (python) S 10119 10121 9715 0 -1 4202560 22 933 0 0 0 0 0 0 19 0 9 0 649047908 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 0 0 0 0
[pid=10121/tid=10134] ppid=10119 vsize=432072 CPUtime=0 cores=0-7
/proc/10121/task/10134/stat : 10134 (python) S 10119 10121 9715 0 -1 4202560 22 933 0 0 0 0 0 0 21 0 9 0 649047911 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 4 0 0 0
[pid=10121/tid=10137] ppid=10119 vsize=432072 CPUtime=0 cores=0-7
/proc/10121/task/10137/stat : 10137 (python) S 10119 10121 9715 0 -1 4202560 28 933 0 0 0 0 0 0 19 0 9 0 649047914 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 6 0 0 0
[pid=10121/tid=10140] ppid=10119 vsize=432072 CPUtime=0 cores=0-7
/proc/10121/task/10140/stat : 10140 (python) S 10119 10121 9715 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 9 0 649047917 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 7 0 0 0
[pid=10121/tid=10143] ppid=10119 vsize=432072 CPUtime=0 cores=0-7
/proc/10121/task/10143/stat : 10143 (python) S 10119 10121 9715 0 -1 4202560 99 933 0 0 0 0 0 0 21 0 9 0 649047921 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 1 0 0 0
[pid=10121/tid=10146] ppid=10119 vsize=432072 CPUtime=0 cores=0-7
/proc/10121/task/10146/stat : 10146 (python) S 10119 10121 9715 0 -1 4202560 33 933 0 0 0 0 0 0 23 0 9 0 649047926 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 1 0 0 0
[pid=10121/tid=10149] ppid=10119 vsize=432072 CPUtime=0 cores=0-7
/proc/10121/task/10149/stat : 10149 (python) S 10119 10121 9715 0 -1 4202560 35 933 0 0 0 0 0 0 24 0 9 0 649047929 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 28.06
Current children cumulated vsize (KiB) 8201588

[startup+12.7016 s]
/proc/loadavg: 8.70 8.31 6.42 10/405 10150
/proc/meminfo: memFree=22363700/32951124 swapFree=67023148/67111528
[pid=10121] ppid=10119 vsize=432072 CPUtime=2.48 cores=0-7
/proc/10121/stat : 10121 (python) S 10119 10121 9715 0 -1 4202496 20123 933 1 0 234 14 0 0 23 0 9 0 649047653 442441728 8734 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522124235 0 0 16781312 2 18446744073709551615 0 0 17 1 0 0 0
/proc/10121/statm: 108018 8734 1891 364 0 43915 0
[pid=10127] ppid=10121 vsize=284984 CPUtime=0.03 cores=0-7
/proc/10127/stat : 10127 (python) S 10121 10121 9715 0 -1 4202560 897 0 0 0 1 2 0 0 18 0 1 0 649047905 291823616 6921 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317583 0 0 16781312 514 11665167459819684098 0 0 17 2 0 0 0
/proc/10127/statm: 71246 6921 378 364 0 7164 0
[pid=10129] ppid=10127 vsize=1020308 CPUtime=10.12 cores=0-7
/proc/10129/stat : 10129 (gnovelty+2) R 10127 10129 10129 0 -1 4202496 1153 0 0 0 1012 0 0 0 25 0 1 0 649047905 1044795392 892 33554432000 134512640 135663704 4287506160 18446744073709551615 134525157 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/10129/statm: 255077 892 113 282 0 254793 0
[pid=10130] ppid=10121 vsize=294904 CPUtime=0.03 cores=0-7
/proc/10130/stat : 10130 (python) S 10121 10121 9715 0 -1 4202560 909 0 0 0 1 2 0 0 18 0 1 0 649047908 301981696 7054 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 11665167459819684097 0 0 17 7 0 0 0
/proc/10130/statm: 73726 7054 372 364 0 9641 0
[pid=10132] ppid=10130 vsize=1020308 CPUtime=10.14 cores=0-7
/proc/10132/stat : 10132 (gnovelty+2) R 10130 10132 10132 0 -1 4202496 1156 0 0 0 1014 0 0 0 25 0 1 0 649047908 1044795392 891 33554432000 134512640 135663704 4292885296 18446744073709551615 135007711 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10132/statm: 255077 891 113 282 0 254793 0
[pid=10133] ppid=10121 vsize=305160 CPUtime=0.02 cores=0-7
/proc/10133/stat : 10133 (python) S 10121 10121 9715 0 -1 4202560 900 0 0 0 1 1 0 0 18 0 1 0 649047911 312483840 7058 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 11665167459819684098 0 0 17 6 0 0 0
/proc/10133/statm: 76290 7058 372 364 0 12202 0
[pid=10135] ppid=10133 vsize=423400 CPUtime=10.11 cores=0-7
/proc/10135/stat : 10135 (adaptg2wsat2009) R 10133 10135 10135 0 -1 4202496 2622 0 0 0 1011 0 0 0 25 0 1 0 649047911 433561600 2357 33554432000 134512640 135107411 4294463184 18446744073709551615 134531615 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/10135/statm: 105850 2357 59 146 0 104726 0
[pid=10136] ppid=10121 vsize=316020 CPUtime=0.02 cores=0-7
/proc/10136/stat : 10136 (python) S 10121 10121 9715 0 -1 4202560 944 0 0 0 1 1 0 0 18 0 1 0 649047914 323604480 7062 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 11665167459819684098 0 0 17 1 0 0 0
/proc/10136/statm: 79005 7062 372 364 0 14914 0
[pid=10138] ppid=10136 vsize=423400 CPUtime=10.04 cores=0-7
/proc/10138/stat : 10138 (adaptg2wsat2009) R 10136 10138 10138 0 -1 4202496 2623 0 0 0 1004 0 0 0 25 0 1 0 649047914 433561600 2359 33554432000 134512640 135107411 4292833344 18446744073709551615 134531709 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/10138/statm: 105850 2359 59 146 0 104726 0
[pid=10139] ppid=10121 vsize=326176 CPUtime=0.02 cores=0-7
/proc/10139/stat : 10139 (python) S 10121 10121 9715 0 -1 4202560 949 0 0 0 1 1 0 0 18 0 1 0 649047917 334004224 7066 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 11665167459819684100 0 0 17 1 0 0 0
/proc/10139/statm: 81544 7066 372 364 0 17450 0
[pid=10141] ppid=10139 vsize=423400 CPUtime=9.86 cores=0-7
/proc/10141/stat : 10141 (adaptg2wsat2009) R 10139 10141 10141 0 -1 4202496 2625 0 0 0 986 0 0 0 25 0 1 0 649047917 433561600 2357 33554432000 134512640 135107411 4286930352 18446744073709551615 134532232 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10141/statm: 105850 2357 59 146 0 104726 0
[pid=10142] ppid=10121 vsize=401316 CPUtime=0.01 cores=0-7
/proc/10142/stat : 10142 (python) S 10121 10121 9715 0 -1 4202560 803 0 0 0 0 1 0 0 18 0 1 0 649047920 410947584 7241 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 5524580015817064706 0 0 17 0 0 0 0
/proc/10142/statm: 100329 7241 371 364 0 36232 0
[pid=10144] ppid=10142 vsize=1020308 CPUtime=5.11 cores=0-7
/proc/10144/stat : 10144 (gnovelty+2) R 10142 10144 10144 0 -1 4202496 1147 0 0 0 511 0 0 0 25 0 1 0 649047922 1044795392 891 33554432000 134512640 135663704 4287996000 18446744073709551615 134545646 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/10144/statm: 255077 891 113 282 0 254793 0
[pid=10145] ppid=10121 vsize=411572 CPUtime=0.01 cores=0-7
/proc/10145/stat : 10145 (python) S 10121 10121 9715 0 -1 4202560 814 0 0 0 0 1 0 0 18 0 1 0 649047925 421449728 7205 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 3888181533122461960 0 0 17 1 0 0 0

################
# More data... #
################

/proc/10212/stat : 10212 (TNM) R 10210 10212 10212 0 -1 4202496 2471 0 0 0 89345 2 0 0 25 0 1 0 649079554 472580096 2194 33554432000 134512640 135008748 4287095536 18446744073709551615 134527847 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/10212/statm: 115376 2194 46 122 0 114276 0
[pid=10224] ppid=10121 vsize=565412 CPUtime=0.31 cores=0-7
/proc/10224/stat : 10224 (python) S 10121 10121 9715 0 -1 4202560 1190 0 0 0 16 15 0 0 19 0 2 0 649098409 578981888 7616 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/10224/statm: 141353 7616 406 364 0 77208 0
[pid=10226] ppid=10224 vsize=1020308 CPUtime=98.36 cores=0-7
/proc/10226/stat : 10226 (gnovelty+2) T 10224 10226 10226 0 -1 4202496 1175 0 0 0 9836 0 0 0 25 0 1 0 649098410 1044795392 891 33554432000 134512640 135663704 4292771216 18446744073709551615 134524882 0 0 16781312 0 18446744071562691360 0 0 17 3 0 0 0
/proc/10226/statm: 255077 891 113 282 0 254793 0
[pid=10224/tid=10234] ppid=10121 vsize=565412 CPUtime=0 cores=0-7
/proc/10224/task/10234/stat : 10234 (python) S 10121 10121 9715 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 649108361 578981888 7616 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 514 18446604459822383232 0 0 -1 3 0 0 0
[pid=10229] ppid=10121 vsize=575668 CPUtime=0.32 cores=0-7
/proc/10229/stat : 10229 (python) S 10121 10121 9715 0 -1 4202560 1188 0 0 0 17 15 0 0 19 0 2 0 649099334 589484032 7634 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10229/statm: 143917 7634 406 364 0 79769 0
[pid=10231] ppid=10229 vsize=335996 CPUtime=98.7 cores=0-7
/proc/10231/stat : 10231 (iPAWS) T 10229 10231 10231 0 -1 4202496 2054 0 0 0 9869 1 0 0 25 0 1 0 649099334 344059904 1774 33554432000 134512640 135114423 4293994656 18446744073709551615 134514767 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/10231/statm: 83999 1774 59 147 0 83851 0
[pid=10229/tid=10241] ppid=10121 vsize=575668 CPUtime=0 cores=0-7
/proc/10229/task/10241/stat : 10241 (python) S 10121 10121 9715 0 -1 4202560 82 0 0 0 0 0 0 0 19 0 2 0 649109271 589484032 7634 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 514 18446604468134565824 0 0 -1 0 0 0 0
[pid=10235] ppid=10121 vsize=585924 CPUtime=1.29 cores=0-7
/proc/10235/stat : 10235 (python) S 10121 10121 9715 0 -1 4202560 1209 0 0 0 76 53 0 0 18 0 2 0 649108367 599986176 7632 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/10235/statm: 146481 7632 407 364 0 82330 0
[pid=10237] ppid=10235 vsize=268424 CPUtime=389.66 cores=0-7
/proc/10237/stat : 10237 (hybridGM3) T 10235 10237 10237 0 -1 4202496 6204 0 0 0 38966 0 0 0 25 0 1 0 649108367 274866176 5920 33554432000 134512640 135204385 4289069568 18446744073709551615 134538395 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/10237/statm: 67106 5920 63 169 0 66936 0
[pid=10235/tid=10255] ppid=10121 vsize=585924 CPUtime=0 cores=0-7
/proc/10235/task/10255/stat : 10255 (python) S 10121 10121 9715 0 -1 4202560 86 0 0 0 0 0 0 0 18 0 2 0 649129240 599986176 7632 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 514 18446604466687353024 0 0 -1 7 0 0 0
[pid=10238] ppid=10121 vsize=596180 CPUtime=1.62 cores=0-7
/proc/10238/stat : 10238 (python) S 10121 10121 9715 0 -1 4202560 1196 0 0 0 86 76 0 0 18 0 2 0 649108754 610488320 7678 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/10238/statm: 149045 7678 400 364 0 84891 0
[pid=10240] ppid=10238 vsize=268424 CPUtime=490.32 cores=0-7
/proc/10240/stat : 10240 (hybridGM3) T 10238 10240 10240 0 -1 4202496 6204 0 0 0 49029 3 0 0 25 0 1 0 649108754 274866176 5918 33554432000 134512640 135204385 4288970064 18446744073709551615 134538000 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/10240/statm: 67106 5918 63 169 0 66936 0
[pid=10238/tid=10253] ppid=10121 vsize=596180 CPUtime=0 cores=0-7
/proc/10238/task/10253/stat : 10253 (python) S 10121 10121 9715 0 -1 4202560 88 0 0 0 0 0 0 0 18 0 2 0 649128425 610488320 7678 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 514 18446604466687354816 0 0 -1 7 0 0 0
[pid=10242] ppid=10121 vsize=606436 CPUtime=1.94 cores=0-7
/proc/10242/stat : 10242 (python) S 10121 10121 9715 0 -1 4202560 996 0 0 0 96 98 0 0 18 0 1 0 649109277 620990464 7610 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 11665167459819684103 0 0 17 3 0 0 0
/proc/10242/statm: 151609 7610 372 364 0 87452 0
[pid=10244] ppid=10242 vsize=461512 CPUtime=597.99 cores=0-7
/proc/10244/stat : 10244 (TNM) R 10242 10244 10244 0 -1 4202496 2474 0 0 0 59799 0 0 0 25 0 1 0 649109277 472588288 2194 33554432000 134512640 135008748 4291282704 18446744073709551615 134529389 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/10244/statm: 115378 2194 46 122 0 114278 0
[pid=10250] ppid=10121 vsize=616692 CPUtime=0.33 cores=0-7
/proc/10250/stat : 10250 (python) S 10121 10121 9715 0 -1 4202560 1194 0 0 0 18 15 0 0 19 0 2 0 649127096 631492608 7616 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10250/statm: 154173 7616 400 364 0 90013 0
[pid=10252] ppid=10250 vsize=335996 CPUtime=98.33 cores=0-7
/proc/10252/stat : 10252 (iPAWS) T 10250 10252 10252 0 -1 4202496 2054 0 0 0 9831 2 0 0 25 0 1 0 649127096 344059904 1775 33554432000 134512640 135114423 4286841792 18446744073709551615 134517504 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/10252/statm: 83999 1775 59 147 0 83851 0
[pid=10250/tid=10258] ppid=10121 vsize=616692 CPUtime=0 cores=0-7
/proc/10250/task/10258/stat : 10258 (python) S 10121 10121 9715 0 -1 4202560 86 0 0 0 0 0 0 0 19 0 2 0 649137030 631492608 7616 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 514 18446604466687355712 0 0 -1 0 0 0 0
[pid=10262] ppid=10121 vsize=626948 CPUtime=0.35 cores=0-7
/proc/10262/stat : 10262 (python) S 10121 10121 9715 0 -1 4202560 1201 0 0 0 14 21 0 0 19 0 2 0 649148317 641994752 7602 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10262/statm: 156737 7602 400 364 0 92574 0
[pid=10264] ppid=10262 vsize=253036 CPUtime=101.9 cores=0-7
/proc/10264/stat : 10264 (FH) T 10262 10264 10264 0 -1 4202496 2516 0 0 0 10190 0 0 0 25 0 1 0 649148318 259108864 2234 33554432000 134512640 134936988 4293510688 18446744073709551615 134553554 0 0 16781312 0 18446744071562691360 0 0 17 7 0 0 0
/proc/10264/statm: 63259 2234 41 104 0 62763 0
[pid=10262/tid=10273] ppid=10121 vsize=626948 CPUtime=0 cores=0-7
/proc/10262/task/10273/stat : 10273 (python) S 10121 10121 9715 0 -1 4202560 91 0 0 0 0 0 0 0 19 0 2 0 649158952 641994752 7602 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 514 18446604471118844032 0 0 -1 7 0 0 0
[pid=10265] ppid=10121 vsize=637204 CPUtime=0.62 cores=0-7
/proc/10265/stat : 10265 (python) S 10121 10121 9715 0 -1 4202560 1097 0 0 0 27 35 0 0 18 0 1 0 649150282 652496896 7586 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 11665167459819684102 0 0 17 3 0 0 0
/proc/10265/statm: 159301 7586 379 364 0 95135 0
[pid=10267] ppid=10265 vsize=423312 CPUtime=186.97 cores=0-7
/proc/10267/stat : 10267 (NCVWr) R 10265 10267 10267 0 -1 4202496 2550 0 0 0 18696 1 0 0 25 0 1 0 649150282 433471488 2265 33554432000 134512640 135113558 4292802304 18446744073709551615 134531797 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/10267/statm: 105828 2265 58 147 0 104703 0
[pid=10270] ppid=10121 vsize=647460 CPUtime=0.33 cores=0-7
/proc/10270/stat : 10270 (python) S 10121 10121 9715 0 -1 4202560 1045 0 0 0 15 18 0 0 18 0 1 0 649158846 662999040 7650 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 11665167459819684101 0 0 17 3 0 0 0
/proc/10270/statm: 161865 7650 379 364 0 97696 0
[pid=10272] ppid=10270 vsize=335996 CPUtime=97.51 cores=0-7
/proc/10272/stat : 10272 (iPAWS) R 10270 10272 10272 0 -1 4202496 2059 0 0 0 9751 0 0 0 25 0 1 0 649158846 344059904 1775 33554432000 134512640 135114423 4287747616 18446744073709551615 134515601 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/10272/statm: 83999 1775 59 147 0 83851 0
[pid=10274] ppid=10121 vsize=657716 CPUtime=0.33 cores=0-7
/proc/10274/stat : 10274 (python) S 10121 10121 9715 0 -1 4202560 1261 0 0 0 20 13 0 0 19 0 2 0 649158958 673501184 7743 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522124235 0 0 16781312 514 18446744073709551615 0 0 17 3 0 0 0
/proc/10274/statm: 164429 7743 407 364 0 100257 0
[pid=10276] ppid=10274 vsize=1020308 CPUtime=99.71 cores=0-7
/proc/10276/stat : 10276 (gnovelty+2) T 10274 10276 10276 0 -1 4202496 1182 0 0 0 9970 1 0 0 25 0 1 0 649158959 1044795392 892 33554432000 134512640 135663704 4287967808 18446744073709551615 134524548 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/10276/statm: 255077 892 113 282 0 254793 0
[pid=10274/tid=10283] ppid=10121 vsize=657716 CPUtime=0 cores=0-7
/proc/10274/task/10283/stat : 10283 (python) S 10121 10121 9715 0 -1 4202560 87 0 0 0 0 0 0 0 19 0 2 0 649168997 673501184 7743 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 514 18446604467497175936 0 0 -1 0 0 0 0
[pid=10279] ppid=10121 vsize=667972 CPUtime=0.1 cores=0-7
/proc/10279/stat : 10279 (python) S 10121 10121 9715 0 -1 4202560 1076 0 0 0 5 5 0 0 18 0 1 0 649165940 684003328 7724 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 11665167459819684104 0 0 17 3 0 0 0
/proc/10279/statm: 166993 7724 378 364 0 102818 0
[pid=10281] ppid=10279 vsize=268428 CPUtime=30.89 cores=0-7
/proc/10281/stat : 10281 (hybridGM3) R 10279 10281 10281 0 -1 4202496 6208 0 0 0 3088 1 0 0 25 0 1 0 649165941 274870272 5919 33554432000 134512640 135204385 4287150016 18446744073709551615 134538375 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/10281/statm: 67107 5919 63 169 0 66937 0
[pid=10284] ppid=10121 vsize=678228 CPUtime=0 cores=0-7
/proc/10284/stat : 10284 (python) S 10121 10121 9715 0 -1 4202560 962 0 0 0 0 0 0 0 19 0 1 0 649169003 694505472 7650 33554432000 4194304 5683644 140734990738320 18446744073709551615 233510317638 0 0 16781312 514 7299636260623089663 0 0 17 0 0 0 0
/proc/10284/statm: 169557 7650 356 364 0 105379 0
[pid=10286] ppid=10284 vsize=268420 CPUtime=0.75 cores=0-7
/proc/10286/stat : 10286 (hybridGM3) R 10284 10286 10286 0 -1 4202496 6209 0 0 0 75 0 0 0 22 0 1 0 649169004 274862080 5918 33554432000 134512640 135204385 4290801536 18446744073709551615 134538395 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/10286/statm: 67105 5918 63 169 0 66935 0
[pid=10121/tid=10128] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10128/stat : 10128 (python) S 10119 10121 9715 0 -1 4202560 27 933 0 0 0 0 0 0 22 0 34 0 649047905 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 0 0 0 0
[pid=10121/tid=10131] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10131/stat : 10131 (python) S 10119 10121 9715 0 -1 4202560 22 933 0 0 0 0 0 0 19 0 34 0 649047908 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 0 0 0 0
[pid=10121/tid=10134] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10134/stat : 10134 (python) S 10119 10121 9715 0 -1 4202560 28 933 0 0 0 0 0 0 18 0 34 0 649047911 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 4 0 0 0
[pid=10121/tid=10137] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10137/stat : 10137 (python) S 10119 10121 9715 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 34 0 649047914 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 6 0 0 0
[pid=10121/tid=10140] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10140/stat : 10140 (python) S 10119 10121 9715 0 -1 4202560 34 933 0 0 0 0 0 0 18 0 34 0 649047917 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 7 0 0 0
[pid=10121/tid=10143] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10143/stat : 10143 (python) S 10119 10121 9715 0 -1 4202560 99 933 0 0 0 0 0 0 21 0 34 0 649047921 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 1 0 0 0
[pid=10121/tid=10146] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10146/stat : 10146 (python) S 10119 10121 9715 0 -1 4202560 46 933 0 0 0 0 0 0 15 0 34 0 649047926 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 1 0 0 0
[pid=10121/tid=10149] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10149/stat : 10149 (python) S 10119 10121 9715 0 -1 4202560 69 933 0 0 0 0 0 0 18 0 34 0 649047929 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 1 0 0 0
[pid=10121/tid=10156] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10156/stat : 10156 (python) S 10119 10121 9715 0 -1 4202560 49 933 0 0 0 0 0 0 18 0 34 0 649057747 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 1 0 0 0
[pid=10121/tid=10161] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10161/stat : 10161 (python) S 10119 10121 9715 0 -1 4202560 39 933 0 0 0 0 0 0 18 0 34 0 649057943 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 4 0 0 0
[pid=10121/tid=10164] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10164/stat : 10164 (python) S 10119 10121 9715 0 -1 4202560 44 933 0 0 0 0 0 0 18 0 34 0 649057947 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 3 0 0 0
[pid=10121/tid=10168] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10168/stat : 10168 (python) S 10119 10121 9715 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 34 0 649057970 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 4 0 0 0
[pid=10121/tid=10172] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10172/stat : 10172 (python) S 10119 10121 9715 0 -1 4202560 40 933 0 0 0 0 0 0 18 0 34 0 649058579 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 4 0 0 0
[pid=10121/tid=10176] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10176/stat : 10176 (python) S 10119 10121 9715 0 -1 4202560 43 933 0 0 0 0 0 0 18 0 34 0 649059165 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 4 0 0 0
[pid=10121/tid=10180] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10180/stat : 10180 (python) S 10119 10121 9715 0 -1 4202560 47 933 0 0 0 0 0 0 18 0 34 0 649060861 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 4 0 0 0
[pid=10121/tid=10184] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10184/stat : 10184 (python) S 10119 10121 9715 0 -1 4202560 38 933 0 0 0 0 0 0 18 0 34 0 649060957 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 3 0 0 0
[pid=10121/tid=10190] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10190/stat : 10190 (python) S 10119 10121 9715 0 -1 4202560 34 933 0 0 0 0 0 0 20 0 34 0 649067781 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 1 0 0 0
[pid=10121/tid=10194] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10194/stat : 10194 (python) S 10119 10121 9715 0 -1 4202560 34 933 0 0 0 0 0 0 19 0 34 0 649068484 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 4 0 0 0
[pid=10121/tid=10204] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10204/stat : 10204 (python) S 10119 10121 9715 0 -1 4202560 41 933 0 0 0 0 0 0 20 0 34 0 649078521 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 3 0 0 0
[pid=10121/tid=10208] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10208/stat : 10208 (python) S 10119 10121 9715 0 -1 4202560 41 933 0 0 0 0 0 0 18 0 34 0 649079541 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 3 0 0 0
[pid=10121/tid=10211] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10211/stat : 10211 (python) S 10119 10121 9715 0 -1 4202560 37 933 0 0 0 0 0 0 20 0 34 0 649079554 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 3 0 0 0
[pid=10121/tid=10225] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10225/stat : 10225 (python) S 10119 10121 9715 0 -1 4202560 46 933 0 0 0 0 0 0 20 0 34 0 649098409 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 0 0 0 0
[pid=10121/tid=10230] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10230/stat : 10230 (python) S 10119 10121 9715 0 -1 4202560 39 933 0 0 0 0 0 0 20 0 34 0 649099334 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 0 0 0 0
[pid=10121/tid=10236] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10236/stat : 10236 (python) S 10119 10121 9715 0 -1 4202560 44 933 0 0 0 0 0 0 18 0 34 0 649108367 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 2 0 0 0
[pid=10121/tid=10239] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10239/stat : 10239 (python) S 10119 10121 9715 0 -1 4202560 46 933 0 0 0 0 0 0 18 0 34 0 649108754 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 3 0 0 0
[pid=10121/tid=10243] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10243/stat : 10243 (python) S 10119 10121 9715 0 -1 4202560 32 933 0 0 0 0 0 0 20 0 34 0 649109277 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 3 0 0 0
[pid=10121/tid=10251] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10251/stat : 10251 (python) S 10119 10121 9715 0 -1 4202560 34 933 0 0 0 0 0 0 20 0 34 0 649127096 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 2 0 0 0
[pid=10121/tid=10263] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10263/stat : 10263 (python) S 10119 10121 9715 0 -1 4202560 40 933 0 0 0 0 0 0 20 0 34 0 649148317 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 0 0 0 0
[pid=10121/tid=10266] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10266/stat : 10266 (python) S 10119 10121 9715 0 -1 4202560 39 933 0 0 0 0 0 0 20 0 34 0 649150282 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 3 0 0 0
[pid=10121/tid=10271] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10271/stat : 10271 (python) S 10119 10121 9715 0 -1 4202560 40 933 0 0 0 0 0 0 20 0 34 0 649158846 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 0 0 0 0
[pid=10121/tid=10275] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10275/stat : 10275 (python) S 10119 10121 9715 0 -1 4202560 33 933 0 0 0 0 0 0 20 0 34 0 649158959 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 3 0 0 0
[pid=10121/tid=10280] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10280/stat : 10280 (python) S 10119 10121 9715 0 -1 4202560 36 933 0 0 0 0 0 0 20 0 34 0 649165941 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 0 0 0 0
[pid=10121/tid=10285] ppid=10119 vsize=688472 CPUtime=0 cores=0-7
/proc/10121/task/10285/stat : 10285 (python) S 10119 10121 9715 0 -1 4202560 33 933 0 0 0 0 0 0 19 0 34 0 649169003 704995328 9240 33554432000 4194304 5683644 140734990738320 18446744073709551615 233522121137 0 0 16781312 2 18446604452741322880 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 9512
Current children cumulated vsize (KiB) 32645088

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 10121 and gives
#  childrusage.ru_utime.tv_sec=874
#  childrusage.ru_utime.tv_usec=325082
#  childrusage.ru_stime.tv_sec=9
#  childrusage.ru_stime.tv_usec=203600
# CPU time returned by wait4() is 883.529
# while last known CPU time is 9512
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1214.52
CPU time (s): 9512
CPU user time (s): 9496.97
CPU system time (s): 15.03
CPU usage (%): 783.193
Max. virtual memory (cumulated for all children) (KiB): 32645088

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 874.325
system time used= 9.2036
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 82382
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11597
involuntary context switches= 4342

runsolver used 13.184 second user time and 31.0453 second system time

The end

Launcher Data 

Begin job on node145 at 2011-05-16 19:18:38
IDJOB=3385410
IDBENCH=82675
IDSOLVER=1870
FILE ID=node145/3385410-1305566318
RUNJOBID= node145-1305564961-9729
PBS_JOBID= 13350105
Free space on /tmp= 73652 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/large/unif-k5-r20-v2000-c40000-S922811046-076-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385410-1305566318/watcher-3385410-1305566318 -o /tmp/evaluation-result-3385410-1305566318/solver-3385410-1305566318 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3385410-1305566318.cnf -seed 1321995845 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e99bff721d695892a53f60adc73d403b
RANDOM SEED=1321995845

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22479788 kB
Buffers:         93740 kB
Cached:         930472 kB
SwapCached:       4796 kB
Active:        6679088 kB
Inactive:      3541612 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22479788 kB
SwapTotal:    67111528 kB
SwapFree:     67023148 kB
Dirty:           32796 kB
Writeback:           0 kB
AnonPages:     9191408 kB
Mapped:          29668 kB
Slab:           135992 kB
PageTables:      46284 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 96214024 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73624 MiB
End job on node145 at 2011-05-16 19:38:54