Trace number 3378551

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-par-random (fixed)SAT 4363.78 1094.99

General information on the benchmark

Namerandom/medium/
unif-k5-r21.3-v150-c3195-S1632870961-099.SATISFIABLE.cnf
MD5SUMeac2f4cbe4e61cc8bd9f28b333bf1b8e
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark8.03578
Satisfiable
(Un)Satisfiability was proved
Number of variables150
Number of clauses3195
Sum of the clauses size15975
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 53195
Number of clauses of size over 50

Solver Data 

0.29/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.29/0.47	c INFO: solving HOME/instance-3378551-1305466145.cnf
0.29/0.47	c INFO: computing task features
0.29/0.49	c INFO: computed variable-clause graph statistics
0.29/0.49	c INFO: computed clause balance statistics
0.38/0.57	c INFO: computed variable balance statistics
0.48/0.61	c INFO: computed small-clause counts
0.48/0.61	c INFO: computed Horn-clause counts
0.48/0.62	c INFO: computed variable graph statistics
0.48/0.62	c INFO: collected features for HOME/instance-3378551-1305466145.cnf in 0.15 s
0.48/0.63	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.63)
0.48/0.64	c INFO: running gnovelty+2@0 for 97 with 1199 remaining (b = 0.08)
0.48/0.64	c INFO: running march_hi@0 for 679 with 1199 remaining (b = 0.36)
0.48/0.66	c INFO: running march_hi@0 for 388 with 1199 remaining (b = 0.23)
208.04/52.78	c INFO: running march_hi@0 for 679 with 1147 remaining (b = 0.29)
400.14/100.92	c INFO: running march_hi@0 for 679 with 1099 remaining (b = 0.26)
1573.19/395.12	c INFO: running march_hi@51 for 291 with 805 remaining (b = 0.14)
2719.08/682.56	c INFO: running march_hi@0 for 97 with 517 remaining (b = 0.05)
2732.65/685.94	c INFO: running march_hi@0 for 514 with 514 remaining (b = 0.20)
2950.71/740.67	c INFO: running march_hi@99 for 459 with 459 remaining (b = 0.18)
3118.97/782.85	c INFO: running march_hi@289 for 291 with 417 remaining (b = 0.15)
3138.90/787.88	c INFO: running march_hi@393 for 97 with 412 remaining (b = 0.06)
3514.95/882.15	c INFO: running march_hi@486 for 194 with 318 remaining (b = 0.10)
4292.41/1077.13	c INFO: running march_hi@731 for 123 with 123 remaining (b = 0.03)
4306.36/1080.67	c INFO: running adaptg2wsat2009++@0 for 119 with 119 remaining (b = 0.03)
4363.36/1094.96	s SATISFIABLE
4363.36/1094.96	v -1 2 -3 4 5 6 7 -8 -9 -10 11 12 -13 14 15 -16 -17 18 -19 20 21 -22 23 -24 25 26 27 28 29 -30 -31 32 -33 34 -35 -36 37 -38 39 -40 41 -42 43 44 -45 -46 47 48 49 50 -51 52 -53 -54 55 -56 57 -58 59 -60 -61 -62 63 64 -65 -66 67 -68 -69 70 -71 72 73 74 -75 -76 -77 -78 79 -80 -81 -82 83 -84 85 86 87 -88 -89 -90 -91 -92 -93 -94 -95 -96 97 -98 99 100 -101 -102 -103 -104 -105 106 -107 108 -109 -110 -111 -112 -113 114 -115 116 117 -118 -119 -120 121 -122 123 124 125 126 -127 -128 -129 130 -131 132 133 134 135 136 137 -138 139 -140 -141 142 -143 -144 -145 146 -147 148 -149 -150 0

Verifier Data 

OK

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3378551-1305466145/watcher-3378551-1305466145 -o /tmp/evaluation-result-3378551-1305466145/solver-3378551-1305466145 -C 4800 -W 1300 -M 15500 python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378551-1305466145.cnf -seed 1129288223 -budget 4800 -cores 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.01 8.44 8.12 5/412 23553
/proc/meminfo: memFree=18835628/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=16240 CPUtime=0 cores=0,2,4,6
/proc/23553/stat : 23553 (python) R 23551 23553 21694 0 -1 4202496 1041 0 0 0 0 0 0 0 25 0 1 0 658216861 16629760 913 33554432000 4194304 5683644 140734086763584 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23553/statm: 4060 913 380 364 0 547 0

[startup+0.0256759 s]
/proc/loadavg: 9.01 8.44 8.12 5/412 23553
/proc/meminfo: memFree=18835628/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=16812 CPUtime=0.01 cores=0,2,4,6
/proc/23553/stat : 23553 (python) R 23551 23553 21694 0 -1 4202496 1226 0 0 0 1 0 0 0 25 0 1 0 658216861 17215488 1084 33554432000 4194304 5683644 140734086763584 18446744073709551615 4509424 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/23553/statm: 4203 1084 417 364 0 690 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16812

[startup+0.100643 s]
/proc/loadavg: 9.01 8.44 8.12 5/412 23553
/proc/meminfo: memFree=18835628/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=104228 CPUtime=0.07 cores=0,2,4,6
/proc/23553/stat : 23553 (python) S 23551 23553 21694 0 -1 4202496 3059 0 0 0 5 2 0 0 25 0 1 0 658216861 106729472 2742 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436015104 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/23553/statm: 26057 2742 847 364 0 1805 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 104228

[startup+0.300608 s]
/proc/loadavg: 9.01 8.44 8.12 5/412 23553
/proc/meminfo: memFree=18835628/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=170752 CPUtime=0.21 cores=0,2,4,6
/proc/23553/stat : 23553 (python) S 23551 23553 21694 0 -1 4202496 6734 936 1 0 16 5 0 0 17 0 1 0 658216861 174850048 4806 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436015104 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/23553/statm: 42688 4806 1336 364 0 3453 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 170752

[startup+0.700502 s]
/proc/loadavg: 9.01 8.44 8.12 5/412 23553
/proc/meminfo: memFree=18835628/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=320160 CPUtime=0.54 cores=0,2,4,6
/proc/23553/stat : 23553 (python) S 23551 23553 21694 0 -1 4202496 12349 936 1 0 45 9 0 0 25 0 5 0 658216861 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/23553/statm: 80040 7229 1873 364 0 15949 0
Current children cumulated CPU time (s) 0.54
Current children cumulated vsize (KiB) 320160

[startup+1.50135 s]
/proc/loadavg: 9.01 8.44 8.12 9/425 23570
/proc/meminfo: memFree=18795728/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=320160 CPUtime=0.54 cores=0,2,4,6
/proc/23553/stat : 23553 (python) S 23551 23553 21694 0 -1 4202496 12349 936 1 0 45 9 0 0 25 0 5 0 658216861 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/23553/statm: 80040 7229 1873 364 0 15949 0
[pid=23559] ppid=23553 vsize=278676 CPUtime=0 cores=0,2,4,6
/proc/23559/stat : 23559 (python) S 23553 23553 21694 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 658216924 285364224 5588 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037135 0 0 16781312 514 13012509287669301247 0 0 17 4 0 0 0
/proc/23559/statm: 69669 5588 354 364 0 5587 0
[pid=23561] ppid=23559 vsize=1017940 CPUtime=0.85 cores=0,2,4,6
/proc/23561/stat : 23561 (gnovelty+2) R 23559 23561 23561 0 -1 4202496 455 0 0 0 85 0 0 0 21 0 1 0 658216924 1042370560 191 33554432000 134512640 135663704 4291017888 18446744073709551615 134545566 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/23561/statm: 254485 191 113 282 0 254201 0
[pid=23562] ppid=23553 vsize=289304 CPUtime=0 cores=0,2,4,6
/proc/23562/stat : 23562 (python) S 23553 23553 21694 0 -1 4202560 740 0 0 0 0 0 0 0 20 0 1 0 658216925 296247296 5684 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 997266671414542335 0 0 17 2 0 0 0
/proc/23562/statm: 72326 5684 348 364 0 8241 0
[pid=23564] ppid=23562 vsize=1017940 CPUtime=0.85 cores=0,2,4,6
/proc/23564/stat : 23564 (gnovelty+2) R 23562 23564 23564 0 -1 4202496 457 0 0 0 85 0 0 0 25 0 1 0 658216925 1042370560 192 33554432000 134512640 135663704 4292249744 18446744073709551615 134544124 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/23564/statm: 254485 192 113 282 0 254201 0
[pid=23565] ppid=23553 vsize=299052 CPUtime=0 cores=0,2,4,6
/proc/23565/stat : 23565 (python) S 23553 23553 21694 0 -1 4202560 753 0 0 0 0 0 0 0 17 0 1 0 658216926 306229248 5576 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 16115181292793856257 0 0 17 0 0 0 0
/proc/23565/statm: 74763 5576 348 364 0 10675 0
[pid=23567] ppid=23565 vsize=2216 CPUtime=0.83 cores=0,2,4,6
/proc/23567/stat : 23567 (march_hi) R 23565 23567 23567 0 -1 4202496 646 0 0 0 83 0 0 0 25 0 1 0 658216926 2269184 360 33554432000 4194304 4955518 140733324434400 18446744073709551615 4237818 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/23567/statm: 554 360 106 186 0 367 0
[pid=23568] ppid=23553 vsize=309916 CPUtime=0 cores=0,2,4,6
/proc/23568/stat : 23568 (python) S 23553 23553 21694 0 -1 4202560 757 0 0 0 0 0 0 0 22 0 1 0 658216927 317353984 5700 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 7517875574841245953 0 0 17 2 0 0 0
/proc/23568/statm: 77479 5700 348 364 0 13388 0
[pid=23570] ppid=23568 vsize=2216 CPUtime=0.83 cores=0,2,4,6
/proc/23570/stat : 23570 (march_hi) R 23568 23570 23570 0 -1 4202496 647 0 0 0 83 0 0 0 25 0 1 0 658216927 2269184 361 33554432000 4194304 4955518 140735306168192 18446744073709551615 4297556 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/23570/statm: 554 361 106 186 0 367 0
[pid=23553/tid=23560] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23560/stat : 23560 (python) S 23551 23553 21694 0 -1 4202560 25 936 0 0 0 0 0 0 19 0 5 0 658216924 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 0 0 0 0
[pid=23553/tid=23563] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23563/stat : 23563 (python) S 23551 23553 21694 0 -1 4202560 25 936 0 0 0 0 0 0 21 0 5 0 658216925 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 4 0 0 0
[pid=23553/tid=23566] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23566/stat : 23566 (python) S 23551 23553 21694 0 -1 4202560 25 936 0 0 0 0 0 0 23 0 5 0 658216926 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23569] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23569/stat : 23569 (python) S 23551 23553 21694 0 -1 4202560 29 936 0 0 0 0 0 0 25 0 5 0 658216927 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3.9
Current children cumulated vsize (KiB) 3537420

[startup+3.10105 s]
/proc/loadavg: 9.01 8.44 8.12 9/425 23570
/proc/meminfo: memFree=18793000/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=320160 CPUtime=0.54 cores=0,2,4,6
/proc/23553/stat : 23553 (python) S 23551 23553 21694 0 -1 4202496 12349 936 1 0 45 9 0 0 25 0 5 0 658216861 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/23553/statm: 80040 7229 1873 364 0 15949 0
[pid=23559] ppid=23553 vsize=278676 CPUtime=0 cores=0,2,4,6
/proc/23559/stat : 23559 (python) S 23553 23553 21694 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 658216924 285364224 5588 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037135 0 0 16781312 514 13012509287669268739 0 0 17 4 0 0 0
/proc/23559/statm: 69669 5588 354 364 0 5587 0
[pid=23561] ppid=23559 vsize=1017940 CPUtime=2.43 cores=0,2,4,6
/proc/23561/stat : 23561 (gnovelty+2) R 23559 23561 23561 0 -1 4202496 455 0 0 0 243 0 0 0 25 0 1 0 658216924 1042370560 191 33554432000 134512640 135663704 4291017888 18446744073709551615 134525255 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/23561/statm: 254485 191 113 282 0 254201 0
[pid=23562] ppid=23553 vsize=289304 CPUtime=0 cores=0,2,4,6
/proc/23562/stat : 23562 (python) S 23553 23553 21694 0 -1 4202560 740 0 0 0 0 0 0 0 18 0 1 0 658216925 296247296 5684 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 997266671414509825 0 0 17 2 0 0 0
/proc/23562/statm: 72326 5684 348 364 0 8241 0
[pid=23564] ppid=23562 vsize=1017940 CPUtime=2.45 cores=0,2,4,6
/proc/23564/stat : 23564 (gnovelty+2) R 23562 23564 23564 0 -1 4202496 457 0 0 0 245 0 0 0 25 0 1 0 658216925 1042370560 192 33554432000 134512640 135663704 4292249744 18446744073709551615 134545670 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/23564/statm: 254485 192 113 282 0 254201 0
[pid=23565] ppid=23553 vsize=299052 CPUtime=0 cores=0,2,4,6
/proc/23565/stat : 23565 (python) S 23553 23553 21694 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 658216926 306229248 5576 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 16115181292793856257 0 0 17 0 0 0 0
/proc/23565/statm: 74763 5576 348 364 0 10675 0
[pid=23567] ppid=23565 vsize=2596 CPUtime=2.43 cores=0,2,4,6
/proc/23567/stat : 23567 (march_hi) R 23565 23567 23567 0 -1 4202496 741 0 0 0 243 0 0 0 25 0 1 0 658216926 2658304 455 33554432000 4194304 4955518 140733324434400 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/23567/statm: 649 455 106 186 0 462 0
[pid=23568] ppid=23553 vsize=309916 CPUtime=0 cores=0,2,4,6
/proc/23568/stat : 23568 (python) S 23553 23553 21694 0 -1 4202560 760 0 0 0 0 0 0 0 15 0 1 0 658216927 317353984 5700 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 7517875574841245953 0 0 17 2 0 0 0
/proc/23568/statm: 77479 5700 348 364 0 13388 0
[pid=23570] ppid=23568 vsize=2596 CPUtime=2.43 cores=0,2,4,6
/proc/23570/stat : 23570 (march_hi) R 23568 23570 23570 0 -1 4202496 743 0 0 0 243 0 0 0 25 0 1 0 658216927 2658304 457 33554432000 4194304 4955518 140735306168192 18446744073709551615 4208656 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/23570/statm: 649 457 106 186 0 462 0
[pid=23553/tid=23560] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23560/stat : 23560 (python) S 23551 23553 21694 0 -1 4202560 25 936 0 0 0 0 0 0 19 0 5 0 658216924 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 0 0 0 0
[pid=23553/tid=23563] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23563/stat : 23563 (python) S 23551 23553 21694 0 -1 4202560 25 936 0 0 0 0 0 0 21 0 5 0 658216925 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 4 0 0 0
[pid=23553/tid=23566] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23566/stat : 23566 (python) S 23551 23553 21694 0 -1 4202560 25 936 0 0 0 0 0 0 23 0 5 0 658216926 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23569] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23569/stat : 23569 (python) S 23551 23553 21694 0 -1 4202560 29 936 0 0 0 0 0 0 25 0 5 0 658216927 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 10.28
Current children cumulated vsize (KiB) 3538180

[startup+6.30044 s]
/proc/loadavg: 8.93 8.43 8.12 9/425 23571
/proc/meminfo: memFree=18787916/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=320160 CPUtime=0.54 cores=0,2,4,6
/proc/23553/stat : 23553 (python) S 23551 23553 21694 0 -1 4202496 12349 936 1 0 45 9 0 0 25 0 5 0 658216861 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/23553/statm: 80040 7229 1873 364 0 15949 0
[pid=23559] ppid=23553 vsize=278676 CPUtime=0.01 cores=0,2,4,6
/proc/23559/stat : 23559 (python) S 23553 23553 21694 0 -1 4202560 903 0 0 0 0 1 0 0 18 0 1 0 658216924 285364224 5611 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037135 0 0 16781312 514 13012509287669268739 0 0 17 4 0 0 0
/proc/23559/statm: 69669 5611 377 364 0 5587 0
[pid=23561] ppid=23559 vsize=1017940 CPUtime=5.59 cores=0,2,4,6
/proc/23561/stat : 23561 (gnovelty+2) R 23559 23561 23561 0 -1 4202496 455 0 0 0 559 0 0 0 25 0 1 0 658216924 1042370560 191 33554432000 134512640 135663704 4291017888 18446744073709551615 134544298 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/23561/statm: 254485 191 113 282 0 254201 0
[pid=23562] ppid=23553 vsize=289304 CPUtime=0 cores=0,2,4,6
/proc/23562/stat : 23562 (python) S 23553 23553 21694 0 -1 4202560 918 0 0 0 0 0 0 0 18 0 1 0 658216925 296247296 5706 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 997266671414509825 0 0 17 2 0 0 0
/proc/23562/statm: 72326 5706 370 364 0 8241 0
[pid=23564] ppid=23562 vsize=1017940 CPUtime=5.63 cores=0,2,4,6
/proc/23564/stat : 23564 (gnovelty+2) R 23562 23564 23564 0 -1 4202496 457 0 0 0 563 0 0 0 25 0 1 0 658216925 1042370560 192 33554432000 134512640 135663704 4292249744 18446744073709551615 134525678 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/23564/statm: 254485 192 113 282 0 254201 0
[pid=23565] ppid=23553 vsize=299052 CPUtime=0.01 cores=0,2,4,6
/proc/23565/stat : 23565 (python) S 23553 23553 21694 0 -1 4202560 910 0 0 0 1 0 0 0 15 0 1 0 658216926 306229248 5599 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 16115181292793856257 0 0 17 0 0 0 0
/proc/23565/statm: 74763 5599 371 364 0 10675 0
[pid=23567] ppid=23565 vsize=3448 CPUtime=5.6 cores=0,2,4,6
/proc/23567/stat : 23567 (march_hi) R 23565 23567 23567 0 -1 4202496 929 0 0 0 560 0 0 0 25 0 1 0 658216926 3530752 643 33554432000 4194304 4955518 140733324434400 18446744073709551615 4224850 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/23567/statm: 862 643 106 186 0 675 0
[pid=23568] ppid=23553 vsize=309916 CPUtime=0.01 cores=0,2,4,6
/proc/23568/stat : 23568 (python) S 23553 23553 21694 0 -1 4202560 921 0 0 0 0 1 0 0 15 0 1 0 658216927 317353984 5723 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 7517875574841245953 0 0 17 2 0 0 0
/proc/23568/statm: 77479 5723 371 364 0 13388 0
[pid=23570] ppid=23568 vsize=3448 CPUtime=5.59 cores=0,2,4,6
/proc/23570/stat : 23570 (march_hi) R 23568 23570 23570 0 -1 4202496 929 0 0 0 559 0 0 0 25 0 1 0 658216927 3530752 643 33554432000 4194304 4955518 140735306168192 18446744073709551615 4224853 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/23570/statm: 862 643 106 186 0 675 0
[pid=23553/tid=23560] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23560/stat : 23560 (python) S 23551 23553 21694 0 -1 4202560 25 936 0 0 0 0 0 0 19 0 5 0 658216924 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 0 0 0 0
[pid=23553/tid=23563] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23563/stat : 23563 (python) S 23551 23553 21694 0 -1 4202560 25 936 0 0 0 0 0 0 21 0 5 0 658216925 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 4 0 0 0
[pid=23553/tid=23566] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23566/stat : 23566 (python) S 23551 23553 21694 0 -1 4202560 25 936 0 0 0 0 0 0 23 0 5 0 658216926 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23569] ppid=23551 vsize=320160 CPUtime=0 cores=0,2,4,6
/proc/23553/task/23569/stat : 23569 (python) S 23551 23553 21694 0 -1 4202560 29 936 0 0 0 0 0 0 25 0 5 0 658216927 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 22.98
Current children cumulated vsize (KiB) 3539884

[startup+12.7012 s]
/proc/loadavg: 8.85 8.42 8.12 9/425 23571
/proc/meminfo: memFree=18778896/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=320160 CPUtime=0.54 cores=0,2,4,6
/proc/23553/stat : 23553 (python) S 23551 23553 21694 0 -1 4202496 12349 936 1 0 45 9 0 0 25 0 5 0 658216861 327843840 7229 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/23553/statm: 80040 7229 1873 364 0 15949 0
[pid=23559] ppid=23553 vsize=278676 CPUtime=0.03 cores=0,2,4,6
/proc/23559/stat : 23559 (python) S 23553 23553 21694 0 -1 4202560 906 0 0 0 1 2 0 0 18 0 1 0 658216924 285364224 5611 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037135 0 0 16781312 514 7444450184043397379 0 0 17 4 0 0 0
/proc/23559/statm: 69669 5611 377 364 0 5587 0
[pid=23561] ppid=23559 vsize=1017940 CPUtime=11.91 cores=0,2,4,6
/proc/23561/stat : 23561 (gnovelty+2) R 23559 23561 23561 0 -1 4202496 455 0 0 0 1191 0 0 0 25 0 1 0 658216924 1042370560 191 33554432000 134512640 135663704 4291017888 18446744073709551615 134524916 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/23561/statm: 254485 191 113 282 0 254201 0
[pid=23562] ppid=23553 vsize=289304 CPUtime=0.02 cores=0,2,4,6

################
# More data... #
################

[pid=23553/tid=23563] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23563/stat : 23563 (python) S 23551 23553 21694 0 -1 4202560 25 2561 0 0 0 0 5207 7 21 0 9 0 658216925 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 4 0 0 0
[pid=23553/tid=23566] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23566/stat : 23566 (python) S 23551 23553 21694 0 -1 4202560 34 2561 0 0 0 0 5207 7 18 0 9 0 658216926 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23569] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23569/stat : 23569 (python) S 23551 23553 21694 0 -1 4202560 40 2561 0 0 0 0 5207 7 18 0 9 0 658216927 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23575] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23575/stat : 23575 (python) S 23551 23553 21694 0 -1 4202560 29 2561 0 0 0 0 5207 7 18 0 9 0 658222140 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23580] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23580/stat : 23580 (python) S 23551 23553 21694 0 -1 4202560 31 2561 0 0 0 0 5207 7 18 0 9 0 658226953 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23611] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23611/stat : 23611 (python) S 23551 23553 21694 0 -1 4202560 27 2561 0 0 0 0 5207 7 20 0 9 0 658285455 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23644] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23644/stat : 23644 (python) S 23551 23553 21694 0 -1 4202560 26 2561 0 0 0 0 5207 7 20 0 9 0 658324929 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4360.97
Current children cumulated vsize (KiB) 4491032

[startup+1094.7 s]
/proc/loadavg: 6.33 7.76 8.02 6/414 23646
/proc/meminfo: memFree=18157296/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=361380 CPUtime=52.75 cores=0,2,4,6
/proc/23553/stat : 23553 (python) S 23551 23553 21694 0 -1 4202496 16144 2561 1 0 52 9 5207 7 19 0 9 0 658216861 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/23553/statm: 90345 7325 1882 364 0 26242 0
[pid=23559] ppid=23553 vsize=288920 CPUtime=0.28 cores=0,2,4,6
/proc/23559/stat : 23559 (python) S 23553 23553 21694 0 -1 4202560 1187 0 0 0 14 14 0 0 19 0 2 0 658216924 295854080 5664 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/23559/statm: 72230 5664 425 364 0 8148 0
[pid=23561] ppid=23559 vsize=1017940 CPUtime=99 cores=0,2,4,6
/proc/23561/stat : 23561 (gnovelty+2) T 23559 23561 23561 0 -1 4202496 455 0 0 0 9900 0 0 0 25 0 1 0 658216924 1042370560 191 33554432000 134512640 135663704 4291017888 18446744073709551615 134543945 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/23561/statm: 254485 191 113 282 0 254201 0
[pid=23559/tid=23578] ppid=23553 vsize=288920 CPUtime=0 cores=0,2,4,6
/proc/23559/task/23578/stat : 23578 (python) S 23553 23553 21694 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 658226952 295854080 5664 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 514 18446604443057502272 0 0 -1 4 0 0 0
[pid=23565] ppid=23553 vsize=299052 CPUtime=3.29 cores=0,2,4,6
/proc/23565/stat : 23565 (python) S 23553 23553 21694 0 -1 4202560 1156 0 0 0 179 150 0 0 15 0 2 0 658216926 306229248 5629 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/23565/statm: 74763 5629 400 364 0 10675 0
[pid=23567] ppid=23565 vsize=216748 CPUtime=1072.57 cores=0,2,4,6
/proc/23567/stat : 23567 (march_hi) T 23565 23567 23567 0 -1 4202496 49623 0 0 0 107234 23 0 0 25 0 1 0 658216926 221949952 49308 33554432000 4194304 4955518 140733324434400 18446744073709551615 4296788 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/23567/statm: 54187 49308 106 186 0 54000 0
[pid=23565/tid=23609] ppid=23553 vsize=299052 CPUtime=0 cores=0,2,4,6
/proc/23565/task/23609/stat : 23609 (python) S 23553 23553 21694 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658285117 306229248 5629 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 514 18446604442652873984 0 0 -1 0 0 0 0
[pid=23568] ppid=23553 vsize=309916 CPUtime=2.11 cores=0,2,4,6
/proc/23568/stat : 23568 (python) S 23553 23553 21694 0 -1 4202560 1163 0 0 0 114 97 0 0 15 0 2 0 658216927 317353984 5753 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/23568/statm: 77479 5753 400 364 0 13388 0
[pid=23570] ppid=23568 vsize=142516 CPUtime=699.73 cores=0,2,4,6
/proc/23570/stat : 23570 (march_hi) R 23568 23570 23570 0 -1 4202496 33407 0 0 0 69966 7 0 0 25 0 1 0 658216927 145936384 33092 33554432000 4194304 4955518 140735306168192 18446744073709551615 4208724 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/23570/statm: 35629 33092 106 186 0 35442 0
[pid=23568/tid=23592] ppid=23553 vsize=309916 CPUtime=0 cores=0,2,4,6
/proc/23568/task/23592/stat : 23592 (python) S 23553 23553 21694 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658256373 317353984 5753 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 514 18446604448666916672 0 0 -1 2 0 0 0
[pid=23574] ppid=23553 vsize=320172 CPUtime=3.16 cores=0,2,4,6
/proc/23574/stat : 23574 (python) S 23553 23553 21694 0 -1 4202560 1165 0 0 0 174 142 0 0 15 0 2 0 658222140 327856128 5774 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/23574/statm: 80043 5774 400 364 0 15949 0
[pid=23576] ppid=23574 vsize=208816 CPUtime=1032.17 cores=0,2,4,6
/proc/23576/stat : 23576 (march_hi) R 23574 23576 23576 0 -1 4202496 47566 0 0 0 103205 12 0 0 25 0 1 0 658222140 213827584 47249 33554432000 4194304 4955518 140736117520768 18446744073709551615 4208653 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/23576/statm: 52204 47249 106 186 0 52017 0
[pid=23574/tid=23614] ppid=23553 vsize=320172 CPUtime=0 cores=0,2,4,6
/proc/23574/task/23614/stat : 23614 (python) S 23553 23553 21694 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 658290928 327856128 5774 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 514 18446604441456880640 0 0 -1 4 0 0 0
[pid=23579] ppid=23553 vsize=330428 CPUtime=2.98 cores=0,2,4,6
/proc/23579/stat : 23579 (python) S 23553 23553 21694 0 -1 4202560 1162 0 0 0 164 134 0 0 15 0 2 0 658226953 338358272 5778 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/23579/statm: 82607 5778 400 364 0 18510 0
[pid=23581] ppid=23579 vsize=208816 CPUtime=975.37 cores=0,2,4,6
/proc/23581/stat : 23581 (march_hi) T 23579 23581 23581 0 -1 4202496 45481 0 0 0 97528 9 0 0 25 0 1 0 658226953 213827584 45167 33554432000 4194304 4955518 140737137310480 18446744073709551615 4237856 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/23581/statm: 52204 45167 106 186 0 52017 0
[pid=23579/tid=23616] ppid=23553 vsize=330428 CPUtime=0 cores=0,2,4,6
/proc/23579/task/23616/stat : 23616 (python) S 23553 23553 21694 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 658295649 338358272 5778 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 514 18446604453948545856 0 0 -1 2 0 0 0
[pid=23610] ppid=23553 vsize=340844 CPUtime=1.25 cores=0,2,4,6
/proc/23610/stat : 23610 (python) S 23553 23553 21694 0 -1 4202560 1000 0 0 0 66 59 0 0 15 0 1 0 658285455 349024256 5795 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 7444450184043397379 0 0 17 4 0 0 0
/proc/23610/statm: 85211 5795 371 364 0 21111 0
[pid=23612] ppid=23610 vsize=94348 CPUtime=403.92 cores=0,2,4,6
/proc/23612/stat : 23612 (march_hi) R 23610 23612 23612 0 -1 4202496 20124 0 0 0 40388 4 0 0 25 0 1 0 658285456 96612352 19810 33554432000 4194304 4955518 140734468346496 18446744073709551615 4263685 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/23612/statm: 23587 19810 106 186 0 23400 0
[pid=23643] ppid=23553 vsize=351136 CPUtime=1.86 cores=0,2,4,6
/proc/23643/stat : 23643 (python) R 23553 23553 21694 0 -1 4202560 936 0 0 0 167 19 0 0 18 0 1 0 658324929 359563264 5816 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/23643/statm: 87784 5816 377 364 0 23681 0
[pid=23645] ppid=23643 vsize=0 CPUtime=12.11 cores=0,2,4,6
/proc/23645/stat : 23645 (adaptg2wsat2009) R 23643 23645 23645 0 -1 4202500 536 0 0 0 1211 0 0 0 25 0 1 0 658324929 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/23645/statm: 0 0 0 0 0 0 0
[pid=23553/tid=23560] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23560/stat : 23560 (python) S 23551 23553 21694 0 -1 4202560 25 2561 0 0 0 0 5207 7 19 0 9 0 658216924 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 0 0 0 0
[pid=23553/tid=23563] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23563/stat : 23563 (python) S 23551 23553 21694 0 -1 4202560 25 2561 0 0 0 0 5207 7 21 0 9 0 658216925 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 4 0 0 0
[pid=23553/tid=23566] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23566/stat : 23566 (python) S 23551 23553 21694 0 -1 4202560 34 2561 0 0 0 0 5207 7 18 0 9 0 658216926 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23569] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23569/stat : 23569 (python) S 23551 23553 21694 0 -1 4202560 40 2561 0 0 0 0 5207 7 18 0 9 0 658216927 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23575] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23575/stat : 23575 (python) S 23551 23553 21694 0 -1 4202560 29 2561 0 0 0 0 5207 7 18 0 9 0 658222140 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23580] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23580/stat : 23580 (python) S 23551 23553 21694 0 -1 4202560 31 2561 0 0 0 0 5207 7 18 0 9 0 658226953 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23611] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23611/stat : 23611 (python) S 23551 23553 21694 0 -1 4202560 27 2561 0 0 0 0 5207 7 20 0 9 0 658285455 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23644] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23644/stat : 23644 (python) S 23551 23553 21694 0 -1 4202560 26 2561 0 0 0 0 5207 7 20 0 9 0 658324929 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4362.55
Current children cumulated vsize (KiB) 4491032

[startup+1094.9 s]
/proc/loadavg: 6.33 7.76 8.02 6/414 23646
/proc/meminfo: memFree=18157296/32951124 swapFree=57331800/67111528
[pid=23553] ppid=23551 vsize=361380 CPUtime=52.75 cores=0,2,4,6
/proc/23553/stat : 23553 (python) S 23551 23553 21694 0 -1 4202496 16144 2561 1 0 52 9 5207 7 19 0 9 0 658216861 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 2 18446744073709551615 0 0 17 2 0 0 0
/proc/23553/statm: 90345 7325 1882 364 0 26242 0
[pid=23559] ppid=23553 vsize=288920 CPUtime=0.28 cores=0,2,4,6
/proc/23559/stat : 23559 (python) S 23553 23553 21694 0 -1 4202560 1187 0 0 0 14 14 0 0 19 0 2 0 658216924 295854080 5664 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/23559/statm: 72230 5664 425 364 0 8148 0
[pid=23561] ppid=23559 vsize=1017940 CPUtime=99 cores=0,2,4,6
/proc/23561/stat : 23561 (gnovelty+2) T 23559 23561 23561 0 -1 4202496 455 0 0 0 9900 0 0 0 25 0 1 0 658216924 1042370560 191 33554432000 134512640 135663704 4291017888 18446744073709551615 134543945 0 0 16781312 0 18446744071562691360 0 0 17 6 0 0 0
/proc/23561/statm: 254485 191 113 282 0 254201 0
[pid=23559/tid=23578] ppid=23553 vsize=288920 CPUtime=0 cores=0,2,4,6
/proc/23559/task/23578/stat : 23578 (python) S 23553 23553 21694 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 658226952 295854080 5664 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 514 18446604443057502272 0 0 -1 4 0 0 0
[pid=23565] ppid=23553 vsize=299052 CPUtime=3.29 cores=0,2,4,6
/proc/23565/stat : 23565 (python) S 23553 23553 21694 0 -1 4202560 1156 0 0 0 179 150 0 0 15 0 2 0 658216926 306229248 5629 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/23565/statm: 74763 5629 400 364 0 10675 0
[pid=23567] ppid=23565 vsize=216748 CPUtime=1072.57 cores=0,2,4,6
/proc/23567/stat : 23567 (march_hi) T 23565 23567 23567 0 -1 4202496 49623 0 0 0 107234 23 0 0 25 0 1 0 658216926 221949952 49308 33554432000 4194304 4955518 140733324434400 18446744073709551615 4296788 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/23567/statm: 54187 49308 106 186 0 54000 0
[pid=23565/tid=23609] ppid=23553 vsize=299052 CPUtime=0 cores=0,2,4,6
/proc/23565/task/23609/stat : 23609 (python) S 23553 23553 21694 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658285117 306229248 5629 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 514 18446604442652873984 0 0 -1 0 0 0 0
[pid=23568] ppid=23553 vsize=309916 CPUtime=2.11 cores=0,2,4,6
/proc/23568/stat : 23568 (python) S 23553 23553 21694 0 -1 4202560 1163 0 0 0 114 97 0 0 15 0 2 0 658216927 317353984 5753 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 18446744073709551615 0 0 17 0 0 0 0
/proc/23568/statm: 77479 5753 400 364 0 13388 0
[pid=23570] ppid=23568 vsize=142516 CPUtime=699.93 cores=0,2,4,6
/proc/23570/stat : 23570 (march_hi) R 23568 23570 23570 0 -1 4202496 33415 0 0 0 69986 7 0 0 25 0 1 0 658216927 145936384 33100 33554432000 4194304 4955518 140735306168192 18446744073709551615 4208667 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/23570/statm: 35629 33100 106 186 0 35442 0
[pid=23568/tid=23592] ppid=23553 vsize=309916 CPUtime=0 cores=0,2,4,6
/proc/23568/task/23592/stat : 23592 (python) S 23553 23553 21694 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 658256373 317353984 5753 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 514 18446604448666916672 0 0 -1 2 0 0 0
[pid=23574] ppid=23553 vsize=320172 CPUtime=3.16 cores=0,2,4,6
/proc/23574/stat : 23574 (python) S 23553 23553 21694 0 -1 4202560 1165 0 0 0 174 142 0 0 15 0 2 0 658222140 327856128 5774 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 18446744073709551615 0 0 17 4 0 0 0
/proc/23574/statm: 80043 5774 400 364 0 15949 0
[pid=23576] ppid=23574 vsize=208816 CPUtime=1032.37 cores=0,2,4,6
/proc/23576/stat : 23576 (march_hi) R 23574 23576 23576 0 -1 4202496 47573 0 0 0 103225 12 0 0 25 0 1 0 658222140 213827584 47256 33554432000 4194304 4955518 140736117520768 18446744073709551615 4208638 0 0 16781312 0 0 0 0 17 4 0 0 0
/proc/23576/statm: 52204 47256 106 186 0 52017 0
[pid=23574/tid=23614] ppid=23553 vsize=320172 CPUtime=0 cores=0,2,4,6
/proc/23574/task/23614/stat : 23614 (python) S 23553 23553 21694 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 658290928 327856128 5774 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 514 18446604441456880640 0 0 -1 4 0 0 0
[pid=23579] ppid=23553 vsize=330428 CPUtime=2.98 cores=0,2,4,6
/proc/23579/stat : 23579 (python) S 23553 23553 21694 0 -1 4202560 1162 0 0 0 164 134 0 0 15 0 2 0 658226953 338358272 5778 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447843787 0 0 16781312 514 18446744073709551615 0 0 17 2 0 0 0
/proc/23579/statm: 82607 5778 400 364 0 18510 0
[pid=23581] ppid=23579 vsize=208816 CPUtime=975.37 cores=0,2,4,6
/proc/23581/stat : 23581 (march_hi) T 23579 23581 23581 0 -1 4202496 45481 0 0 0 97528 9 0 0 25 0 1 0 658226953 213827584 45167 33554432000 4194304 4955518 140737137310480 18446744073709551615 4237856 0 0 16781312 0 18446744071562691360 0 0 17 4 0 0 0
/proc/23581/statm: 52204 45167 106 186 0 52017 0
[pid=23579/tid=23616] ppid=23553 vsize=330428 CPUtime=0 cores=0,2,4,6
/proc/23579/task/23616/stat : 23616 (python) S 23553 23553 21694 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 658295649 338358272 5778 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 514 18446604453948545856 0 0 -1 2 0 0 0
[pid=23610] ppid=23553 vsize=340844 CPUtime=1.25 cores=0,2,4,6
/proc/23610/stat : 23610 (python) S 23553 23553 21694 0 -1 4202560 1000 0 0 0 66 59 0 0 15 0 1 0 658285455 349024256 5795 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 7444450184043397379 0 0 17 4 0 0 0
/proc/23610/statm: 85211 5795 371 364 0 21111 0
[pid=23612] ppid=23610 vsize=94348 CPUtime=404.12 cores=0,2,4,6
/proc/23612/stat : 23612 (march_hi) R 23610 23612 23612 0 -1 4202496 20133 0 0 0 40408 4 0 0 25 0 1 0 658285456 96612352 19819 33554432000 4194304 4955518 140734468346496 18446744073709551615 4208624 0 0 16781312 0 0 0 0 17 6 0 0 0
/proc/23612/statm: 23587 19819 106 186 0 23400 0
[pid=23643] ppid=23553 vsize=351136 CPUtime=2.07 cores=0,2,4,6
/proc/23643/stat : 23643 (python) R 23553 23553 21694 0 -1 4202560 936 0 0 0 185 22 0 0 18 0 1 0 658324929 359563264 5816 33554432000 4194304 5683644 140734086763584 18446744073709551615 212436037190 0 0 16781312 514 0 0 0 17 2 0 0 0
/proc/23643/statm: 87784 5816 377 364 0 23681 0
[pid=23645] ppid=23643 vsize=0 CPUtime=12.11 cores=0,2,4,6
/proc/23645/stat : 23645 (adaptg2wsat2009) R 23643 23645 23645 0 -1 4202500 536 0 0 0 1211 0 0 0 25 0 1 0 658324929 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/23645/statm: 0 0 0 0 0 0 0
[pid=23553/tid=23560] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23560/stat : 23560 (python) S 23551 23553 21694 0 -1 4202560 25 2561 0 0 0 0 5207 7 19 0 9 0 658216924 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 0 0 0 0
[pid=23553/tid=23563] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23563/stat : 23563 (python) S 23551 23553 21694 0 -1 4202560 25 2561 0 0 0 0 5207 7 21 0 9 0 658216925 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 4 0 0 0
[pid=23553/tid=23566] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23566/stat : 23566 (python) S 23551 23553 21694 0 -1 4202560 34 2561 0 0 0 0 5207 7 18 0 9 0 658216926 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23569] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23569/stat : 23569 (python) S 23551 23553 21694 0 -1 4202560 40 2561 0 0 0 0 5207 7 18 0 9 0 658216927 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23575] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23575/stat : 23575 (python) S 23551 23553 21694 0 -1 4202560 29 2561 0 0 0 0 5207 7 18 0 9 0 658222140 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23580] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23580/stat : 23580 (python) S 23551 23553 21694 0 -1 4202560 31 2561 0 0 0 0 5207 7 18 0 9 0 658226953 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23611] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23611/stat : 23611 (python) S 23551 23553 21694 0 -1 4202560 27 2561 0 0 0 0 5207 7 20 0 9 0 658285455 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
[pid=23553/tid=23644] ppid=23551 vsize=361380 CPUtime=52.14 cores=0,2,4,6
/proc/23553/task/23644/stat : 23644 (python) S 23551 23553 21694 0 -1 4202560 26 2561 0 0 0 0 5207 7 20 0 9 0 658324929 370053120 7325 33554432000 4194304 5683644 140734086763584 18446744073709551615 212447840689 0 0 16781312 2 18446604445288707008 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4363.36
Current children cumulated vsize (KiB) 4491032

Child status: 0
Real time (s): 1094.99
CPU time (s): 4363.78
CPU user time (s): 4356.74
CPU system time (s): 7.03093
CPU usage (%): 398.522
Max. virtual memory (cumulated for all children) (KiB): 4907316

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4356.74
system time used= 7.03093
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 228525
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7599
involuntary context switches= 26588

runsolver used 4.34934 second user time and 9.57454 second system time

The end

Launcher Data 

Begin job on node102 at 2011-05-15 15:29:05
IDJOB=3378551
IDBENCH=82960
IDSOLVER=1859
FILE ID=node102/3378551-1305466145
RUNJOBID= node102-1305462764-21712
PBS_JOBID= 13324973
Free space on /tmp= 73580 MiB

SOLVER NAME= borg-sat 11.03.02-par-random (fixed)
BENCH NAME= SAT11/random/medium/unif-k5-r21.3-v150-c3195-S1632870961-099.SATISFIABLE.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3378551-1305466145/watcher-3378551-1305466145 -o /tmp/evaluation-result-3378551-1305466145/solver-3378551-1305466145 -C 4800 -W 1300 -M 15500  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3378551-1305466145.cnf -seed 1129288223 -budget 4800 -cores 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= eac2f4cbe4e61cc8bd9f28b333bf1b8e
RANDOM SEED=1129288223

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18835908 kB
Buffers:         47424 kB
Cached:         768052 kB
SwapCached:      89980 kB
Active:        4619952 kB
Inactive:      9289900 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18835908 kB
SwapTotal:    67111528 kB
SwapFree:     57331800 kB
Dirty:           32344 kB
Writeback:           0 kB
AnonPages:    13015184 kB
Mapped:          25708 kB
Slab:            65184 kB
PageTables:      73956 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 96452648 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73580 MiB
End job on node102 at 2011-05-15 15:47:20