Trace number 3321735

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (MO) 9576.21 1204.71

General information on the benchmark

Namerandom/large/
unif-k7-r85-v400-c34000-S832901479-042-UNKNOWN.cnf
MD5SUMa5a87dc48ba0573fb8f2b8721bafcab2
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables400
Number of clauses34000
Sum of the clauses size238000
Maximum clause length7
Minimum clause length7
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 534000

Solver Data 

0.34/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.34/0.67	c INFO: solving HOME/instance-3321735-1304366528.cnf
0.34/0.67	c INFO: computing task features
0.61/0.90	c INFO: computed variable-clause graph statistics
0.61/0.91	c INFO: computed clause balance statistics
1.81/2.12	c INFO: computed variable balance statistics
2.21/2.59	c INFO: computed small-clause counts
2.21/2.59	c INFO: computed Horn-clause counts
2.31/2.63	c INFO: computed variable graph statistics
2.31/2.63	c INFO: collected features for HOME/instance-3321735-1304366528.cnf in 1.95 s
2.31/2.67	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.38)
2.41/2.71	c INFO: running gnovelty+2@0 for 97 with 39998 remaining (b = 0.13)
2.41/2.74	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.08)
2.41/2.78	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.07)
2.51/2.82	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.05)
2.51/2.86	c INFO: running gnovelty+2@0 for 97 with 39997 remaining (b = 0.04)
2.61/2.90	c INFO: running FH@0 for 97 with 39997 remaining (b = 0.03)
2.61/2.95	c INFO: running adaptg2wsat2009++@0 for 97 with 39997 remaining (b = 0.03)
802.26/102.94	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.02)
802.26/102.99	c INFO: running FH@0 for 97 with 39897 remaining (b = 0.02)
802.87/103.04	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.04)
802.87/103.09	c INFO: running gnovelty+2@0 for 97 with 39897 remaining (b = 0.02)
803.27/103.15	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
803.45/103.20	c INFO: running adaptg2wsat2009++@0 for 97 with 39897 remaining (b = 0.01)
803.45/103.26	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.03)
803.56/103.33	c INFO: running hybridGM3@0 for 194 with 39897 remaining (b = 0.02)
1601.96/203.21	c INFO: running TNM@0 for 1552 with 39797 remaining (b = 0.18)
1601.96/203.29	c INFO: running FH@0 for 97 with 39797 remaining (b = 0.01)
1603.25/203.41	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
1603.25/203.48	c INFO: running adaptg2wsat2009++@0 for 97 with 39797 remaining (b = 0.01)
2369.51/299.57	c INFO: running hybridGM3@100 for 97 with 39701 remaining (b = 0.01)
2370.32/299.67	c INFO: running hybridGM3@99 for 97 with 39701 remaining (b = 0.01)
2371.89/299.82	c INFO: running hybridGM3@99 for 97 with 39700 remaining (b = 0.01)
2378.30/300.67	c INFO: running adaptg2wsat2009++@0 for 97 with 39700 remaining (b = 0.01)
2379.09/300.74	c INFO: running adaptg2wsat2009++@100 for 97 with 39699 remaining (b = 0.01)
2385.53/301.58	c INFO: running hybridGM3@0 for 194 with 39699 remaining (b = 0.02)
2419.77/305.90	c INFO: running hybridGM3@99 for 97 with 39694 remaining (b = 0.01)
3129.20/394.82	c INFO: running hybridGM3@296 for 97 with 39605 remaining (b = 0.01)
3153.92/398.00	c INFO: running hybridGM3@0 for 194 with 39602 remaining (b = 0.02)
3177.81/400.94	c INFO: running hybridGM3@294 for 97 with 39599 remaining (b = 0.01)
3178.61/401.08	c INFO: running TNM@0 for 1552 with 39599 remaining (b = 0.14)
3179.38/401.16	c INFO: running adaptg2wsat2009++@100 for 97 with 39599 remaining (b = 0.01)
3193.70/402.96	c INFO: running FH@0 for 291 with 39597 remaining (b = 0.03)
3935.82/496.10	c INFO: running gnovelty+2@0 for 97 with 39504 remaining (b = 0.01)
3936.66/496.21	c INFO: running hybridGM3@393 for 97 with 39504 remaining (b = 0.01)
3954.99/498.43	c INFO: running hybridGM3@396 for 97 with 39502 remaining (b = 0.01)
4000.28/504.14	c INFO: running iPAWS@0 for 97 with 39496 remaining (b = 0.01)
4696.02/591.50	c INFO: running adaptg2wsat2009++@100 for 97 with 39409 remaining (b = 0.01)
4720.74/594.56	c INFO: running hybridGM3@100 for 97 with 39406 remaining (b = 0.01)
4735.88/596.45	c INFO: running FH@100 for 291 with 39404 remaining (b = 0.02)
4746.21/597.72	c INFO: running iPAWS@0 for 97 with 39403 remaining (b = 0.01)
4799.52/604.43	c INFO: running adaptg2wsat2009++@100 for 97 with 39396 remaining (b = 0.01)
5470.75/688.79	c INFO: running hybridGM3@0 for 194 with 39311 remaining (b = 0.01)
5479.50/689.84	c INFO: running TNM@0 for 1552 with 39310 remaining (b = 0.11)
5542.30/697.71	c INFO: running adaptg2wsat2009++@296 for 291 with 39303 remaining (b = 0.02)
5544.67/698.03	c INFO: running gnovelty+2@0 for 97 with 39302 remaining (b = 0.01)
5574.15/701.73	c INFO: running hybridGM3@0 for 194 with 39299 remaining (b = 0.01)
6343.23/798.39	c INFO: running FH@0 for 97 with 39202 remaining (b = 0.01)
7035.88/885.39	c INFO: running hybridGM3@95 for 97 with 39115 remaining (b = 0.01)
7137.74/898.17	c INFO: running hybridGM3@0 for 194 with 39102 remaining (b = 0.01)
7139.24/898.34	c INFO: running hybridGM3@100 for 97 with 39102 remaining (b = 0.01)
7142.53/898.72	c INFO: running FH@196 for 194 with 39102 remaining (b = 0.01)
7794.50/980.69	c INFO: running hybridGM3@385 for 194 with 39020 remaining (b = 0.01)
7848.63/987.40	c INFO: running adaptg2wsat2009++@396 for 194 with 39013 remaining (b = 0.01)
7945.71/999.65	c INFO: running NCVWr@0 for 485 with 39001 remaining (b = 0.03)
8703.33/1094.83	c INFO: running FH@196 for 194 with 38905 remaining (b = 0.01)
8762.26/1102.26	c INFO: running FH@291 for 97 with 38898 remaining (b = 0.01)
9366.22/1178.21	c INFO: running iPAWS@0 for 97 with 38822 remaining (b = 0.01)
9412.29/1183.94	c INFO: running adaptg2wsat2009++@497 for 97 with 38816 remaining (b = 0.01)
9568.21/1203.59	c INFO: running hybridGM3@0 for 194 with 38797 remaining (b = 0.01)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321735-1304366528/watcher-3321735-1304366528 -o /tmp/evaluation-result-3321735-1304366528/solver-3321735-1304366528 -C 40000 -W 5100 -M 31000 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321735-1304366528.cnf -seed 357172669 -budget 40000 -cores 8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.05 0.75 0.73 2/246 6656
/proc/meminfo: memFree=21505440/32951124 swapFree=67111448/67111528
[pid=6656] ppid=6654 vsize=15188 CPUtime=0 cores=0-7
/proc/6656/stat : 6656 (python) R 6654 6656 6594 0 -1 4202496 725 0 0 0 0 0 0 0 17 0 1 0 529068944 15552512 615 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106768640 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6656/statm: 3797 616 321 364 0 284 0

[startup+0.109193 s]
/proc/loadavg: 3.05 0.75 0.73 2/246 6656
/proc/meminfo: memFree=21505440/32951124 swapFree=67111448/67111528
[pid=6656] ppid=6654 vsize=94184 CPUtime=0.06 cores=0-7
/proc/6656/stat : 6656 (python) S 6654 6656 6594 0 -1 4202496 2768 0 0 0 4 2 0 0 17 0 1 0 529068944 96444416 2475 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106766848 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/6656/statm: 23546 2475 764 364 0 1678 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 94184

[startup+0.20117 s]
/proc/loadavg: 3.05 0.75 0.73 2/246 6656
/proc/meminfo: memFree=21505440/32951124 swapFree=67111448/67111528
[pid=6656] ppid=6654 vsize=124236 CPUtime=0.12 cores=0-7
/proc/6656/stat : 6656 (python) R 6654 6656 6594 0 -1 4202496 4261 0 1 0 8 4 0 0 17 0 1 0 529068944 127217664 3868 33554432000 4194304 5683644 140737443857904 18446744073709551615 5116756 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6656/statm: 31059 3868 995 364 0 2870 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 124236

[startup+0.301149 s]
/proc/loadavg: 3.05 0.75 0.73 2/246 6656
/proc/meminfo: memFree=21505440/32951124 swapFree=67111448/67111528
[pid=6656] ppid=6654 vsize=135752 CPUtime=0.19 cores=0-7
/proc/6656/stat : 6656 (python) S 6654 6656 6594 0 -1 4202496 5965 936 1 0 13 6 0 0 17 0 1 0 529068944 139010048 4151 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106764805 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/6656/statm: 33938 4151 1032 364 0 3124 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 135752

[startup+0.701116 s]
/proc/loadavg: 3.05 0.75 0.73 2/246 6656
/proc/meminfo: memFree=21505440/32951124 swapFree=67111448/67111528
[pid=6656] ppid=6654 vsize=279984 CPUtime=0.41 cores=0-7
/proc/6656/stat : 6656 (python) R 6654 6656 6594 0 -1 4202496 9650 936 1 0 29 12 0 0 16 0 1 0 529068944 286703616 7329 33554432000 4194304 5683644 140737443857904 18446744073709551615 4602366 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6656/statm: 69996 7329 1761 364 0 5920 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 279984

[startup+1.50095 s]
/proc/loadavg: 3.05 0.75 0.73 2/247 6661
/proc/meminfo: memFree=21473136/32951124 swapFree=67111448/67111528
[pid=6656] ppid=6654 vsize=289496 CPUtime=1.21 cores=0-7
/proc/6656/stat : 6656 (python) R 6654 6656 6594 0 -1 4202496 13884 936 1 0 109 12 0 0 17 0 1 0 529068944 296443904 9758 33554432000 4194304 5683644 140737443857904 18446744073709551615 47293807289368 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/6656/statm: 72374 9758 1826 364 0 8298 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 289496

[startup+3.10062 s]
/proc/loadavg: 2.88 0.76 0.73 2/247 6661
/proc/meminfo: memFree=21472640/32951124 swapFree=67111448/67111528
[pid=6656] ppid=6654 vsize=429952 CPUtime=2.65 cores=0-7
/proc/6656/stat : 6656 (python) S 6654 6656 6594 0 -1 4202496 20320 936 1 0 251 14 0 0 24 0 9 0 529068944 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6656/statm: 107488 8072 1891 364 0 43385 0
Current children cumulated CPU time (s) 2.65
Current children cumulated vsize (KiB) 429952

[startup+6.30105 s]
/proc/loadavg: 2.88 0.76 0.73 9/271 6685
/proc/meminfo: memFree=21406632/32951124 swapFree=67111448/67111528
[pid=6656] ppid=6654 vsize=429952 CPUtime=2.65 cores=0-7
/proc/6656/stat : 6656 (python) S 6654 6656 6594 0 -1 4202496 20320 936 1 0 251 14 0 0 24 0 9 0 529068944 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6656/statm: 107488 8072 1891 364 0 43385 0
[pid=6662] ppid=6656 vsize=282236 CPUtime=0 cores=0-7
/proc/6662/stat : 6662 (python) S 6656 6656 6594 0 -1 4202560 734 0 0 0 0 0 0 0 18 0 1 0 529069211 289009664 6329 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788879 0 0 16781312 514 4326930653070196996 0 0 17 1 0 0 0
/proc/6662/statm: 70559 6329 355 364 0 6477 0
[pid=6664] ppid=6662 vsize=1020188 CPUtime=3.61 cores=0-7
/proc/6664/stat : 6664 (gnovelty+2) R 6662 6664 6664 0 -1 4202496 1143 0 0 0 361 0 0 0 25 0 1 0 529069212 1044672512 877 33554432000 134512640 135663704 4292018672 18446744073709551615 134524897 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/6664/statm: 255047 877 113 282 0 254763 0
[pid=6665] ppid=6656 vsize=293120 CPUtime=0 cores=0-7
/proc/6665/stat : 6665 (python) S 6656 6656 6594 0 -1 4202560 742 0 0 0 0 0 0 0 18 0 1 0 529069215 300154880 6366 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4326697281727201540 0 0 17 1 0 0 0
/proc/6665/statm: 73280 6366 349 364 0 9195 0
[pid=6667] ppid=6665 vsize=1020188 CPUtime=3.58 cores=0-7
/proc/6667/stat : 6667 (gnovelty+2) R 6665 6667 6667 0 -1 4202496 1137 0 0 0 358 0 0 0 25 0 1 0 529069215 1044672512 877 33554432000 134512640 135663704 4288533792 18446744073709551615 134524498 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6667/statm: 255047 877 113 282 0 254763 0
[pid=6668] ppid=6656 vsize=302892 CPUtime=0 cores=0-7
/proc/6668/stat : 6668 (python) S 6656 6656 6594 0 -1 4202560 739 0 0 0 0 0 0 0 18 0 1 0 529069219 310161408 6503 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4484513484196774147 0 0 17 1 0 0 0
/proc/6668/statm: 75723 6503 347 364 0 11635 0
[pid=6670] ppid=6668 vsize=421140 CPUtime=3.53 cores=0-7
/proc/6670/stat : 6670 (adaptg2wsat2009) R 6668 6670 6670 0 -1 4202496 1807 0 0 0 353 0 0 0 25 0 1 0 529069219 431247360 1539 33554432000 134512640 135107411 4291195024 18446744073709551615 134523503 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/6670/statm: 105285 1539 49 146 0 104161 0
[pid=6671] ppid=6656 vsize=313148 CPUtime=0 cores=0-7
/proc/6671/stat : 6671 (python) S 6656 6656 6594 0 -1 4202560 747 0 0 0 0 0 0 0 18 0 1 0 529069222 320663552 6506 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4484525029068865796 0 0 17 1 0 0 0
/proc/6671/statm: 78287 6506 347 364 0 14196 0
[pid=6673] ppid=6671 vsize=421140 CPUtime=3.5 cores=0-7
/proc/6673/stat : 6673 (adaptg2wsat2009) R 6671 6673 6673 0 -1 4202496 1805 0 0 0 350 0 0 0 25 0 1 0 529069223 431247360 1539 33554432000 134512640 135107411 4289656016 18446744073709551615 134523298 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6673/statm: 105285 1539 49 146 0 104161 0
[pid=6674] ppid=6656 vsize=389512 CPUtime=0 cores=0-7
/proc/6674/stat : 6674 (python) S 6656 6656 6594 0 -1 4202560 761 0 0 0 0 0 0 0 18 0 1 0 529069226 398860288 6515 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4337559082220093699 0 0 17 7 0 0 0
/proc/6674/statm: 97378 6515 349 364 0 33284 0
[pid=6676] ppid=6674 vsize=421140 CPUtime=3.44 cores=0-7
/proc/6676/stat : 6676 (adaptg2wsat2009) R 6674 6676 6676 0 -1 4202496 1808 0 0 0 344 0 0 0 25 0 1 0 529069227 431247360 1539 33554432000 134512640 135107411 4290278672 18446744073709551615 134523310 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6676/statm: 105285 1539 49 146 0 104161 0
[pid=6677] ppid=6656 vsize=399836 CPUtime=0 cores=0-7
/proc/6677/stat : 6677 (python) S 6656 6656 6594 0 -1 4202560 770 0 0 0 0 0 0 0 18 0 1 0 529069230 409432064 6519 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4337555233929396482 0 0 17 6 0 0 0
/proc/6677/statm: 99959 6519 349 364 0 35862 0
[pid=6679] ppid=6677 vsize=1020188 CPUtime=3.43 cores=0-7
/proc/6679/stat : 6679 (gnovelty+2) R 6677 6679 6679 0 -1 4202496 1143 0 0 0 343 0 0 0 25 0 1 0 529069230 1044672512 877 33554432000 134512640 135663704 4289136944 18446744073709551615 134524918 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/6679/statm: 255047 877 113 282 0 254763 0
[pid=6680] ppid=6656 vsize=409452 CPUtime=0 cores=0-7
/proc/6680/stat : 6680 (python) S 6656 6656 6594 0 -1 4202560 767 0 0 0 0 0 0 0 18 0 1 0 529069234 419278848 6521 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4575468659459195138 0 0 17 1 0 0 0
/proc/6680/statm: 102363 6521 347 364 0 38263 0
[pid=6682] ppid=6680 vsize=249144 CPUtime=3.37 cores=0-7
/proc/6682/stat : 6682 (FH) R 6680 6682 6682 0 -1 4202496 1559 0 0 0 337 0 0 0 25 0 1 0 529069236 255123456 1295 33554432000 134512640 134936988 4290956912 18446744073709551615 134523657 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/6682/statm: 62286 1295 37 104 0 61790 0
[pid=6683] ppid=6656 vsize=419708 CPUtime=0 cores=0-7
/proc/6683/stat : 6683 (python) S 6656 6656 6594 0 -1 4202560 788 0 0 0 0 0 0 0 18 0 1 0 529069240 429780992 6531 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4471044466756518148 0 0 17 0 0 0 0
/proc/6683/statm: 104927 6531 353 364 0 40824 0
[pid=6685] ppid=6683 vsize=421140 CPUtime=3.29 cores=0-7
/proc/6685/stat : 6685 (adaptg2wsat2009) R 6683 6685 6685 0 -1 4202496 1811 0 0 0 329 0 0 0 25 0 1 0 529069240 431247360 1540 33554432000 134512640 135107411 4286853248 18446744073709551615 134523298 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/6685/statm: 105285 1540 49 146 0 104161 0
[pid=6656/tid=6663] ppid=6654 vsize=429952 CPUtime=0 cores=0-7
/proc/6656/task/6663/stat : 6663 (python) S 6654 6656 6594 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 9 0 529069211 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6666] ppid=6654 vsize=429952 CPUtime=0 cores=0-7
/proc/6656/task/6666/stat : 6666 (python) S 6654 6656 6594 0 -1 4202560 24 936 0 0 0 0 0 0 18 0 9 0 529069215 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 3 0 0 0
[pid=6656/tid=6669] ppid=6654 vsize=429952 CPUtime=0 cores=0-7
/proc/6656/task/6669/stat : 6669 (python) S 6654 6656 6594 0 -1 4202560 23 936 0 0 0 0 0 0 22 0 9 0 529069219 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 4 0 0 0
[pid=6656/tid=6672] ppid=6654 vsize=429952 CPUtime=0 cores=0-7
/proc/6656/task/6672/stat : 6672 (python) S 6654 6656 6594 0 -1 4202560 19 936 0 0 0 0 0 0 18 0 9 0 529069223 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 5 0 0 0
[pid=6656/tid=6675] ppid=6654 vsize=429952 CPUtime=0 cores=0-7
/proc/6656/task/6675/stat : 6675 (python) S 6654 6656 6594 0 -1 4202560 27 936 0 0 0 0 0 0 19 0 9 0 529069226 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6678] ppid=6654 vsize=429952 CPUtime=0 cores=0-7
/proc/6656/task/6678/stat : 6678 (python) S 6654 6656 6594 0 -1 4202560 26 936 0 0 0 0 0 0 21 0 9 0 529069230 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 6 0 0 0
[pid=6656/tid=6681] ppid=6654 vsize=429952 CPUtime=0 cores=0-7
/proc/6656/task/6681/stat : 6681 (python) S 6654 6656 6594 0 -1 4202560 26 936 0 0 0 0 0 0 22 0 9 0 529069234 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6684] ppid=6654 vsize=429952 CPUtime=0 cores=0-7
/proc/6656/task/6684/stat : 6684 (python) S 6654 6656 6594 0 -1 4202560 77 936 0 0 0 0 0 0 25 0 9 0 529069240 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 30.4
Current children cumulated vsize (KiB) 8234124

[startup+12.7019 s]
/proc/loadavg: 3.67 1.00 0.81 9/271 6685
/proc/meminfo: memFree=21397980/32951124 swapFree=67111448/67111528
[pid=6656] ppid=6654 vsize=429952 CPUtime=2.65 cores=0-7
/proc/6656/stat : 6656 (python) S 6654 6656 6594 0 -1 4202496 20320 936 1 0 251 14 0 0 24 0 9 0 529068944 440270848 8072 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118595531 0 0 16781312 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6656/statm: 107488 8072 1891 364 0 43385 0
[pid=6662] ppid=6656 vsize=282236 CPUtime=0 cores=0-7
/proc/6662/stat : 6662 (python) S 6656 6656 6594 0 -1 4202560 893 0 0 0 0 0 0 0 18 0 1 0 529069211 289009664 6352 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788879 0 0 16781312 514 4326930653070196996 0 0 17 1 0 0 0
/proc/6662/statm: 70559 6352 378 364 0 6477 0
[pid=6664] ppid=6662 vsize=1020188 CPUtime=10.01 cores=0-7
/proc/6664/stat : 6664 (gnovelty+2) R 6662 6664 6664 0 -1 4202496 1143 0 0 0 1001 0 0 0 25 0 1 0 529069212 1044672512 877 33554432000 134512640 135663704 4292018672 18446744073709551615 134525286 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/6664/statm: 255047 877 113 282 0 254763 0
[pid=6665] ppid=6656 vsize=293120 CPUtime=0 cores=0-7
/proc/6665/stat : 6665 (python) S 6656 6656 6594 0 -1 4202560 903 0 0 0 0 0 0 0 18 0 1 0 529069215 300154880 6389 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4326697281727201540 0 0 17 1 0 0 0
/proc/6665/statm: 73280 6389 372 364 0 9195 0
[pid=6667] ppid=6665 vsize=1020188 CPUtime=9.98 cores=0-7
/proc/6667/stat : 6667 (gnovelty+2) R 6665 6667 6667 0 -1 4202496 1137 0 0 0 998 0 0 0 25 0 1 0 529069215 1044672512 877 33554432000 134512640 135663704 4288533792 18446744073709551615 134525699 0 0 16781312 0 0 0 0 17 3 0 0 0
/proc/6667/statm: 255047 877 113 282 0 254763 0
[pid=6668] ppid=6656 vsize=302892 CPUtime=0 cores=0-7
/proc/6668/stat : 6668 (python) S 6656 6656 6594 0 -1 4202560 911 0 0 0 0 0 0 0 18 0 1 0 529069219 310161408 6526 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4484513484196774147 0 0 17 1 0 0 0
/proc/6668/statm: 75723 6526 370 364 0 11635 0
[pid=6670] ppid=6668 vsize=421804 CPUtime=9.93 cores=0-7
/proc/6670/stat : 6670 (adaptg2wsat2009) R 6668 6670 6670 0 -1 4202496 2140 0 0 0 993 0 0 0 25 0 1 0 529069219 431927296 1872 33554432000 134512640 135107411 4291195024 18446744073709551615 134532224 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/6670/statm: 105451 1872 59 146 0 104327 0
[pid=6671] ppid=6656 vsize=313148 CPUtime=0 cores=0-7
/proc/6671/stat : 6671 (python) S 6656 6656 6594 0 -1 4202560 937 0 0 0 0 0 0 0 18 0 1 0 529069222 320663552 6528 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4484525029068865796 0 0 17 1 0 0 0
/proc/6671/statm: 78287 6528 369 364 0 14196 0
[pid=6673] ppid=6671 vsize=421804 CPUtime=9.9 cores=0-7
/proc/6673/stat : 6673 (adaptg2wsat2009) R 6671 6673 6673 0 -1 4202496 2138 0 0 0 990 0 0 0 25 0 1 0 529069223 431927296 1872 33554432000 134512640 135107411 4289656016 18446744073709551615 134532291 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6673/statm: 105451 1872 59 146 0 104327 0
[pid=6674] ppid=6656 vsize=389512 CPUtime=0 cores=0-7
/proc/6674/stat : 6674 (python) S 6656 6656 6594 0 -1 4202560 948 0 0 0 0 0 0 0 18 0 1 0 529069226 398860288 6538 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4337559082220093699 0 0 17 7 0 0 0
/proc/6674/statm: 97378 6538 372 364 0 33284 0
[pid=6676] ppid=6674 vsize=421804 CPUtime=9.76 cores=0-7
/proc/6676/stat : 6676 (adaptg2wsat2009) R 6674 6676 6676 0 -1 4202496 2141 0 0 0 976 0 0 0 25 0 1 0 529069227 431927296 1872 33554432000 134512640 135107411 4290278672 18446744073709551615 134531779 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6676/statm: 105451 1872 59 146 0 104327 0
[pid=6677] ppid=6656 vsize=399836 CPUtime=0 cores=0-7
/proc/6677/stat : 6677 (python) S 6656 6656 6594 0 -1 4202560 956 0 0 0 0 0 0 0 18 0 1 0 529069230 409432064 6542 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4337555233929396482 0 0 17 6 0 0 0
/proc/6677/statm: 99959 6542 372 364 0 35862 0
[pid=6679] ppid=6677 vsize=1020188 CPUtime=9.82 cores=0-7
/proc/6679/stat : 6679 (gnovelty+2) R 6677 6679 6679 0 -1 4202496 1143 0 0 0 982 0 0 0 25 0 1 0 529069230 1044672512 877 33554432000 134512640 135663704 4289136944 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/6679/statm: 255047 877 113 282 0 254763 0
[pid=6680] ppid=6656 vsize=409452 CPUtime=0 cores=0-7
/proc/6680/stat : 6680 (python) S 6656 6656 6594 0 -1 4202560 964 0 0 0 0 0 0 0 18 0 1 0 529069234 419278848 6544 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4575468659459195138 0 0 17 1 0 0 0
/proc/6680/statm: 102363 6544 370 364 0 38263 0

################
# More data... #
################

/proc/6757/statm: 255047 877 113 282 0 254763 0
[pid=6755/tid=6766] ppid=6656 vsize=563600 CPUtime=0 cores=0-7
/proc/6755/task/6766/stat : 6766 (python) S 6656 6656 6594 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 529128581 577126400 6972 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 514 18446604453934570496 0 0 -1 1 0 0 0
[pid=6759] ppid=6656 vsize=573856 CPUtime=0.21 cores=0-7
/proc/6759/stat : 6759 (python) S 6656 6656 6594 0 -1 4202560 1176 0 0 0 10 11 0 0 19 0 2 0 529119358 587628544 6993 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6759/statm: 143464 6993 407 364 0 79316 0
[pid=6761] ppid=6759 vsize=335996 CPUtime=99.8 cores=0-7
/proc/6761/stat : 6761 (iPAWS) T 6759 6761 6761 0 -1 4202496 2026 0 0 0 9979 1 0 0 25 0 1 0 529119358 344059904 1748 33554432000 134512640 135114423 4293192112 18446744073709551615 134514774 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/6761/statm: 83999 1748 59 147 0 83851 0
[pid=6759/tid=6770] ppid=6656 vsize=573856 CPUtime=0 cores=0-7
/proc/6759/task/6770/stat : 6770 (python) S 6656 6656 6594 0 -1 4202560 88 0 0 0 0 0 0 0 19 0 2 0 529129379 587628544 6993 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 514 18446604453947205760 0 0 -1 5 0 0 0
[pid=6767] ppid=6656 vsize=584112 CPUtime=0.21 cores=0-7
/proc/6767/stat : 6767 (python) S 6656 6656 6594 0 -1 4202560 1190 0 0 0 12 9 0 0 19 0 2 0 529128716 598130688 6998 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6767/statm: 146028 6998 406 364 0 81877 0
[pid=6769] ppid=6767 vsize=335996 CPUtime=100.13 cores=0-7
/proc/6769/stat : 6769 (iPAWS) T 6767 6769 6769 0 -1 4202496 2032 0 0 0 10013 0 0 0 25 0 1 0 529128717 344059904 1749 33554432000 134512640 135114423 4293675264 18446744073709551615 134515629 0 0 16781312 0 18446744071562691360 0 0 17 5 0 0 0
/proc/6769/statm: 83999 1749 59 147 0 83851 0
[pid=6767/tid=6779] ppid=6656 vsize=584112 CPUtime=0 cores=0-7
/proc/6767/task/6779/stat : 6779 (python) S 6656 6656 6594 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 529138737 598130688 6998 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 514 18446604453979961536 0 0 -1 5 0 0 0
[pid=6773] ppid=6656 vsize=595172 CPUtime=1.06 cores=0-7
/proc/6773/stat : 6773 (python) S 6656 6656 6594 0 -1 4202560 1278 0 0 0 54 52 0 0 18 0 2 0 529137824 609456128 7038 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6773/statm: 148793 7038 401 364 0 84639 0
[pid=6775] ppid=6773 vsize=268424 CPUtime=489.07 cores=0-7
/proc/6775/stat : 6775 (hybridGM3) T 6773 6775 6775 0 -1 4202496 5666 0 0 0 48907 0 0 0 25 0 1 0 529137824 274866176 5378 33554432000 134512640 135204385 4294239072 18446744073709551615 134538494 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/6775/statm: 67106 5378 63 169 0 66936 0
[pid=6773/tid=6795] ppid=6656 vsize=595172 CPUtime=0 cores=0-7
/proc/6773/task/6795/stat : 6795 (python) S 6656 6656 6594 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 529157473 609456128 7038 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 514 18446604453946389696 0 0 -1 0 0 0 0
[pid=6776] ppid=6656 vsize=604908 CPUtime=1.1 cores=0-7
/proc/6776/stat : 6776 (python) S 6656 6656 6594 0 -1 4202560 969 0 0 0 57 53 0 0 18 0 1 0 529137929 619425792 7063 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 8037130931879772418 0 0 17 0 0 0 0
/proc/6776/statm: 151227 7063 373 364 0 87070 0
[pid=6778] ppid=6776 vsize=459768 CPUtime=514.61 cores=0-7
/proc/6778/stat : 6778 (TNM) R 6776 6778 6778 0 -1 4202496 1939 0 0 0 51461 0 0 0 25 0 1 0 529137929 470802432 1658 33554432000 134512640 135008748 4293255984 18446744073709551615 134529148 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/6778/statm: 114942 1658 46 122 0 113842 0
[pid=6780] ppid=6656 vsize=615164 CPUtime=0.21 cores=0-7
/proc/6780/stat : 6780 (python) S 6656 6656 6594 0 -1 4202560 1185 0 0 0 11 10 0 0 19 0 2 0 529138747 629927936 7200 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6780/statm: 153791 7200 400 364 0 89631 0
[pid=6782] ppid=6780 vsize=1020188 CPUtime=100.01 cores=0-7
/proc/6782/stat : 6782 (gnovelty+2) T 6780 6782 6782 0 -1 4202496 1156 0 0 0 10001 0 0 0 25 0 1 0 529138747 1044672512 876 33554432000 134512640 135663704 4294544720 18446744073709551615 134525255 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/6782/statm: 255047 876 113 282 0 254763 0
[pid=6780/tid=6789] ppid=6656 vsize=615164 CPUtime=0 cores=0-7
/proc/6780/task/6789/stat : 6789 (python) S 6656 6656 6594 0 -1 4202560 92 0 0 0 0 0 0 0 19 0 2 0 529148774 629927936 7200 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 514 18446604453931593792 0 0 -1 0 0 0 0
[pid=6783] ppid=6656 vsize=625420 CPUtime=0.65 cores=0-7
/proc/6783/stat : 6783 (python) S 6656 6656 6594 0 -1 4202560 1214 0 0 0 35 30 0 0 18 0 2 0 529139118 640430080 7173 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6783/statm: 156355 7173 401 364 0 92192 0
[pid=6785] ppid=6783 vsize=268428 CPUtime=296.34 cores=0-7
/proc/6785/stat : 6785 (hybridGM3) T 6783 6785 6785 0 -1 4202496 5663 0 0 0 29632 2 0 0 25 0 1 0 529139118 274870272 5378 33554432000 134512640 135204385 4294867552 18446744073709551615 134538000 0 0 16781312 0 18446744071562691360 0 0 17 2 0 0 0
/proc/6785/statm: 67107 5378 63 169 0 66937 0
[pid=6783/tid=6800] ppid=6656 vsize=625420 CPUtime=0 cores=0-7
/proc/6783/task/6800/stat : 6800 (python) S 6656 6656 6594 0 -1 4202560 98 0 0 0 0 0 0 0 18 0 2 0 529158767 640430080 7173 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 514 18446604453973508416 0 0 -1 1 0 0 0
[pid=6790] ppid=6656 vsize=635676 CPUtime=0.48 cores=0-7
/proc/6790/stat : 6790 (python) S 6656 6656 6594 0 -1 4202560 1238 0 0 0 24 24 0 0 18 0 2 0 529148784 650932224 7238 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 18446744073709551615 0 0 17 1 0 0 0
/proc/6790/statm: 158919 7238 406 364 0 94753 0
[pid=6792] ppid=6790 vsize=251288 CPUtime=209.23 cores=0-7
/proc/6792/stat : 6792 (FH) R 6790 6792 6792 0 -1 4202496 1984 0 0 0 20923 0 0 0 25 0 1 0 529148784 257318912 1693 33554432000 134512640 134936988 4292910480 18446744073709551615 134544814 0 0 16781312 0 0 0 0 17 1 0 0 0
/proc/6792/statm: 62822 1693 41 104 0 62326 0
[pid=6790/tid=6801] ppid=6656 vsize=635676 CPUtime=0 cores=0-7
/proc/6790/task/6801/stat : 6801 (python) S 6656 6656 6594 0 -1 4202560 93 0 0 0 0 0 0 0 19 0 2 0 529158805 650932224 7238 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 514 18446604453920458624 0 0 -1 2 0 0 0
[pid=6797] ppid=6656 vsize=645932 CPUtime=0.43 cores=0-7
/proc/6797/stat : 6797 (python) S 6656 6656 6594 0 -1 4202560 1245 0 0 0 24 19 0 0 19 0 2 0 529158761 661434368 7267 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118595531 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/6797/statm: 161483 7267 407 364 0 97314 0
[pid=6799] ppid=6797 vsize=268428 CPUtime=194.56 cores=0-7
/proc/6799/stat : 6799 (hybridGM3) T 6797 6799 6799 0 -1 4202496 5667 0 0 0 19453 3 0 0 25 0 1 0 529158762 274870272 5378 33554432000 134512640 135204385 4292326896 18446744073709551615 134545414 0 0 16781312 0 18446744071562691360 0 0 17 0 0 0 0
/proc/6799/statm: 67107 5378 63 169 0 66937 0
[pid=6797/tid=6810] ppid=6656 vsize=645932 CPUtime=0 cores=0-7
/proc/6797/task/6810/stat : 6810 (python) S 6656 6656 6594 0 -1 4202560 96 0 0 0 0 0 0 0 19 0 2 0 529178416 661434368 7267 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 514 18446604453972175744 0 0 -1 0 0 0 0
[pid=6804] ppid=6656 vsize=656188 CPUtime=0.44 cores=0-7
/proc/6804/stat : 6804 (python) S 6656 6656 6594 0 -1 4202560 1044 0 0 0 24 20 0 0 18 0 1 0 529168910 671936512 7168 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 8037130931879772424 0 0 17 1 0 0 0
/proc/6804/statm: 164047 7168 378 364 0 99875 0
[pid=6806] ppid=6804 vsize=421340 CPUtime=203.75 cores=0-7
/proc/6806/stat : 6806 (NCVWr) R 6804 6806 6806 0 -1 4202496 1998 0 0 0 20374 1 0 0 25 0 1 0 529168910 431452160 1712 33554432000 134512640 135113558 4293479424 18446744073709551615 134533891 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/6806/statm: 105335 1712 58 147 0 104210 0
[pid=6813] ppid=6656 vsize=666444 CPUtime=0.05 cores=0-7
/proc/6813/stat : 6813 (python) S 6656 6656 6594 0 -1 4202560 1052 0 0 0 4 1 0 0 18 0 1 0 529186765 682438656 7268 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 8037130931879772421 0 0 17 1 0 0 0
/proc/6813/statm: 166611 7268 378 364 0 102436 0
[pid=6815] ppid=6813 vsize=335996 CPUtime=26.13 cores=0-7
/proc/6815/stat : 6815 (iPAWS) R 6813 6815 6815 0 -1 4202496 2037 0 0 0 2613 0 0 0 25 0 1 0 529186766 344059904 1748 33554432000 134512640 135114423 4290130048 18446744073709551615 134516646 0 0 16781312 0 0 0 0 17 7 0 0 0
/proc/6815/statm: 83999 1748 59 147 0 83851 0
[pid=6817] ppid=6656 vsize=676700 CPUtime=0 cores=0-7
/proc/6817/stat : 6817 (python) S 6656 6656 6594 0 -1 4202560 938 0 0 0 0 0 0 0 19 0 1 0 529189304 692940800 7279 33554432000 4194304 5683644 140737443857904 18446744073709551615 255106788934 0 0 16781312 514 4490836225812332543 0 0 17 1 0 0 0
/proc/6817/statm: 169175 7279 350 364 0 104997 0
[pid=6819] ppid=6817 vsize=268420 CPUtime=0.91 cores=0-7
/proc/6819/stat : 6819 (hybridGM3) R 6817 6819 6819 0 -1 4202496 5671 0 0 0 91 0 0 0 23 0 1 0 529189304 274862080 5377 33554432000 134512640 135204385 4290339344 18446744073709551615 134538475 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/6819/statm: 67105 5377 63 169 0 66935 0
[pid=6656/tid=6663] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6663/stat : 6663 (python) S 6654 6656 6594 0 -1 4202560 28 936 0 0 0 0 0 0 20 0 34 0 529069211 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6666] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6666/stat : 6666 (python) S 6654 6656 6594 0 -1 4202560 24 936 0 0 0 0 0 0 18 0 34 0 529069215 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 3 0 0 0
[pid=6656/tid=6669] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6669/stat : 6669 (python) S 6654 6656 6594 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 34 0 529069219 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 4 0 0 0
[pid=6656/tid=6672] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6672/stat : 6672 (python) S 6654 6656 6594 0 -1 4202560 27 936 0 0 0 0 0 0 18 0 34 0 529069223 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 5 0 0 0
[pid=6656/tid=6675] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6675/stat : 6675 (python) S 6654 6656 6594 0 -1 4202560 32 936 0 0 0 0 0 0 18 0 34 0 529069226 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6678] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6678/stat : 6678 (python) S 6654 6656 6594 0 -1 4202560 26 936 0 0 0 0 0 0 21 0 34 0 529069230 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 6 0 0 0
[pid=6656/tid=6681] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6681/stat : 6681 (python) S 6654 6656 6594 0 -1 4202560 31 936 0 0 0 0 0 0 18 0 34 0 529069234 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6684] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6684/stat : 6684 (python) S 6654 6656 6594 0 -1 4202560 80 936 0 0 0 0 0 0 18 0 34 0 529069240 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6692] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6692/stat : 6692 (python) S 6654 6656 6594 0 -1 4202560 32 936 0 0 0 0 0 0 18 0 34 0 529079239 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6696] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6696/stat : 6696 (python) S 6654 6656 6594 0 -1 4202560 44 936 0 0 0 0 0 0 18 0 34 0 529079244 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6700] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6700/stat : 6700 (python) S 6654 6656 6594 0 -1 4202560 43 936 0 0 0 0 0 0 18 0 34 0 529079249 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6705] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6705/stat : 6705 (python) S 6654 6656 6594 0 -1 4202560 26 936 0 0 0 0 0 0 19 0 34 0 529079254 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6708] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6708/stat : 6708 (python) S 6654 6656 6594 0 -1 4202560 41 936 0 0 0 0 0 0 18 0 34 0 529079259 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 3 0 0 0
[pid=6656/tid=6712] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6712/stat : 6712 (python) S 6654 6656 6594 0 -1 4202560 69 936 0 0 0 0 0 0 18 0 34 0 529079265 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 2 0 0 0
[pid=6656/tid=6715] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6715/stat : 6715 (python) S 6654 6656 6594 0 -1 4202560 120 936 0 0 0 0 0 0 18 0 34 0 529079271 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6718] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6718/stat : 6718 (python) S 6654 6656 6594 0 -1 4202560 37 936 0 0 0 0 0 0 18 0 34 0 529079277 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6725] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6725/stat : 6725 (python) S 6654 6656 6594 0 -1 4202560 23 936 0 0 0 0 0 0 19 0 34 0 529089266 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6729] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6729/stat : 6729 (python) S 6654 6656 6594 0 -1 4202560 29 936 0 0 0 0 0 0 21 0 34 0 529089274 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 7 0 0 0
[pid=6656/tid=6741] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6741/stat : 6741 (python) S 6654 6656 6594 0 -1 4202560 31 936 0 0 0 0 0 0 20 0 34 0 529099103 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6747] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6747/stat : 6747 (python) S 6654 6656 6594 0 -1 4202560 108 936 0 0 0 0 0 0 18 0 34 0 529108744 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 4 0 0 0
[pid=6656/tid=6750] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6750/stat : 6750 (python) S 6654 6656 6594 0 -1 4202560 34 936 0 0 0 0 0 0 20 0 34 0 529109052 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 4 0 0 0
[pid=6656/tid=6756] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6756/stat : 6756 (python) S 6654 6656 6594 0 -1 4202560 44 936 0 0 0 0 0 0 20 0 34 0 529118555 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6760] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6760/stat : 6760 (python) S 6654 6656 6594 0 -1 4202560 37 936 0 0 0 0 0 0 20 0 34 0 529119358 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6768] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6768/stat : 6768 (python) S 6654 6656 6594 0 -1 4202560 43 936 0 0 0 0 0 0 20 0 34 0 529128717 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6774] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6774/stat : 6774 (python) S 6654 6656 6594 0 -1 4202560 41 936 0 0 0 0 0 0 18 0 34 0 529137824 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6777] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6777/stat : 6777 (python) S 6654 6656 6594 0 -1 4202560 166 936 0 0 0 0 0 0 20 0 34 0 529137929 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6781] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6781/stat : 6781 (python) S 6654 6656 6594 0 -1 4202560 36 936 0 0 0 0 0 0 20 0 34 0 529138747 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6784] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6784/stat : 6784 (python) S 6654 6656 6594 0 -1 4202560 39 936 0 0 0 0 0 0 18 0 34 0 529139118 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6791] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6791/stat : 6791 (python) S 6654 6656 6594 0 -1 4202560 41 936 0 0 0 0 0 0 18 0 34 0 529148784 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 3 0 0 0
[pid=6656/tid=6798] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6798/stat : 6798 (python) S 6654 6656 6594 0 -1 4202560 36 936 0 0 0 0 0 0 20 0 34 0 529158762 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
[pid=6656/tid=6805] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6805/stat : 6805 (python) S 6654 6656 6594 0 -1 4202560 44 936 0 0 0 0 0 0 20 0 34 0 529168910 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6814] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6814/stat : 6814 (python) S 6654 6656 6594 0 -1 4202560 40 936 0 0 0 0 0 0 20 0 34 0 529186765 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 0 0 0 0
[pid=6656/tid=6818] ppid=6654 vsize=686944 CPUtime=0 cores=0-7
/proc/6656/task/6818/stat : 6818 (python) S 6654 6656 6594 0 -1 4202560 39 936 0 0 0 0 0 0 20 0 34 0 529189304 703430656 8875 33554432000 4194304 5683644 140737443857904 18446744073709551615 255118592433 0 0 16781312 2 18446604453924207296 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 9576.21
Current children cumulated vsize (KiB) 32560768

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6656 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=805965
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=265959
# CPU time returned by wait4() is 7.07192
# while last known CPU time is 9576.21
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1204.71
CPU time (s): 9576.21
CPU user time (s): 9566.19
CPU system time (s): 10.02
CPU usage (%): 794.9
Max. virtual memory (cumulated for all children) (KiB): 32560768

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.80596
system time used= 0.265959
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 68487
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3524
involuntary context switches= 118

runsolver used 11.4093 second user time and 26.9459 second system time

The end

Launcher Data 

Begin job on node144 at 2011-05-02 22:02:08
IDJOB=3321735
IDBENCH=82513
IDSOLVER=1712
FILE ID=node144/3321735-1304366528
RUNJOBID= node144-1304366464-6608
PBS_JOBID= 13181730
Free space on /tmp= 73548 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/large/unif-k7-r85-v400-c34000-S832901479-042-UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321735-1304366528/watcher-3321735-1304366528 -o /tmp/evaluation-result-3321735-1304366528/solver-3321735-1304366528 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321735-1304366528.cnf -seed 357172669 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a5a87dc48ba0573fb8f2b8721bafcab2
RANDOM SEED=357172669

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21505844 kB
Buffers:       2151252 kB
Cached:        5375700 kB
SwapCached:         80 kB
Active:        4037508 kB
Inactive:      6840384 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21505844 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:           32648 kB
Writeback:           0 kB
AnonPages:     3350612 kB
Mapped:          21736 kB
Slab:           486556 kB
PageTables:      18836 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 37122948 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73516 MiB
End job on node144 at 2011-05-02 22:22:15