Trace number 3393874

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.4 5011.7

General information on the benchmark

Namecrafted/spence/
hard/s113-100.cnf
MD5SUM346cb413e25976ab9ce2952e1d53c865
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1113.71
Satisfiable
(Un)Satisfiability was proved
Number of variables113
Number of clauses236
Sum of the clauses size708
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3236
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3393874-1306070119/watcher-3393874-1306070119 -o /tmp/evaluation-result-3393874-1306070119/solver-3393874-1306070119 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3393874-1306070119.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.79 2.60 0.95 2/543 21284
/proc/meminfo: memFree=13587868/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=222768 CPUtime=0.08 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 606 1251 0 0 8 0 0 0 25 0 9 0 718612283 228114432 533 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 55692 533 178 55 0 53578 0
[pid=21284/tid=21290] ppid=21282 vsize=222768 CPUtime=0.01 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 43 1251 0 0 1 0 0 0 25 0 9 0 718612284 228114432 536 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=222768 CPUtime=0.01 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 10 1251 0 0 1 0 0 0 18 0 9 0 718612284 228114432 536 33554432000 4194304 4417452 140736927349040 18446744073709551615 4253027 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=222768 CPUtime=0 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 1 1251 0 0 0 0 0 0 25 0 9 0 718612284 228114432 536 33554432000 4194304 4417452 140736927349040 18446744073709551615 4284301 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=222768 CPUtime=0.01 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 72 1251 0 0 1 0 0 0 25 0 9 0 718612284 228114432 536 33554432000 4194304 4417452 140736927349040 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=222768 CPUtime=0.01 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 21 1251 0 0 1 0 0 0 18 0 9 0 718612284 228114432 536 33554432000 4194304 4417452 140736927349040 18446744073709551615 4365936 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=222768 CPUtime=0.01 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 26 1251 0 0 1 0 0 0 25 0 9 0 718612284 228114432 536 33554432000 4194304 4417452 140736927349040 18446744073709551615 253640553428 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=222768 CPUtime=0.01 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 100 1251 0 0 1 0 0 0 25 0 9 0 718612284 228114432 536 33554432000 4194304 4417452 140736927349040 18446744073709551615 253640964639 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=222768 CPUtime=0.01 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 18 1251 0 0 1 0 0 0 18 0 9 0 718612284 228114432 536 33554432000 4194304 4417452 140736927349040 18446744073709551615 4250947 0 0 4096 17442 0 0 0 -1 0 0 0 0

[startup+0.0449611 s]
/proc/loadavg: 6.79 2.60 0.95 2/543 21284
/proc/meminfo: memFree=13587868/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=224252 CPUtime=0.26 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 1033 1251 0 0 26 0 0 0 25 0 9 0 718612283 229634048 960 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 56063 960 179 55 0 53949 0
[pid=21284/tid=21290] ppid=21282 vsize=224252 CPUtime=0.03 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 95 1251 0 0 3 0 0 0 25 0 9 0 718612284 229634048 960 33554432000 4194304 4417452 140736927349040 18446744073709551615 253640552144 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=224252 CPUtime=0.03 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 76 1251 0 0 3 0 0 0 18 0 9 0 718612284 229634048 960 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=224252 CPUtime=0 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 1 1251 0 0 0 0 0 0 25 0 9 0 718612284 229634048 960 33554432000 4194304 4417452 140736927349040 18446744073709551615 4284301 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=224252 CPUtime=0.03 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 116 1251 0 0 3 0 0 0 25 0 9 0 718612284 229634048 960 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=224252 CPUtime=0.03 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 103 1251 0 0 3 0 0 0 18 0 9 0 718612284 229634048 960 33554432000 4194304 4417452 140736927349040 18446744073709551615 4250936 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=224252 CPUtime=0.03 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 111 1251 0 0 3 0 0 0 18 0 9 0 718612284 229634048 960 33554432000 4194304 4417452 140736927349040 18446744073709551615 4284636 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=224252 CPUtime=0.03 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 141 1251 0 0 3 0 0 0 25 0 9 0 718612284 229634048 960 33554432000 4194304 4417452 140736927349040 18446744073709551615 253640964639 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=224252 CPUtime=0.03 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 72 1251 0 0 3 0 0 0 18 0 9 0 718612284 229634048 960 33554432000 4194304 4417452 140736927349040 18446744073709551615 4366402 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 224252

[startup+0.10807 s]
/proc/loadavg: 6.79 2.60 0.95 2/543 21284
/proc/meminfo: memFree=13587868/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=227712 CPUtime=0.76 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 2216 1251 0 0 76 0 0 0 25 0 9 0 718612283 233177088 1959 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 56928 1959 179 55 0 54814 0
[pid=21284/tid=21290] ppid=21282 vsize=227712 CPUtime=0.09 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 232 1251 0 0 9 0 0 0 25 0 9 0 718612284 233177088 1959 33554432000 4194304 4417452 140736927349040 18446744073709551615 4256532 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=227712 CPUtime=0.1 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 240 1251 0 0 10 0 0 0 18 0 9 0 718612284 233177088 1959 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=227712 CPUtime=0.06 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 72 1251 0 0 6 0 0 0 25 0 9 0 718612284 233177088 1959 33554432000 4194304 4417452 140736927349040 18446744073709551615 253640553453 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=227712 CPUtime=0.09 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 182 1251 0 0 9 0 0 0 25 0 9 0 718612284 233177088 1959 33554432000 4194304 4417452 140736927349040 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=227712 CPUtime=0.1 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 267 1251 0 0 10 0 0 0 18 0 9 0 718612284 233177088 1959 33554432000 4194304 4417452 140736927349040 18446744073709551615 4275960 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=227712 CPUtime=0.1 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) D 21282 21284 21187 0 -1 4202560 334 1251 0 0 10 0 0 0 18 0 9 0 718612284 233177088 1959 33554432000 4194304 4417452 140736927349040 18446744073709551615 253640917418 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=227712 CPUtime=0.1 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 289 1251 0 0 10 0 0 0 25 0 9 0 718612284 233177088 1959 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=227712 CPUtime=0.1 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 282 1251 0 0 10 0 0 0 18 0 9 0 718612284 233177088 1959 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364500 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.76
Current children cumulated vsize (KiB) 227712

[startup+0.300883 s]
/proc/loadavg: 6.79 2.60 0.95 2/543 21284
/proc/meminfo: memFree=13587868/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=232580 CPUtime=2.31 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 6299 1251 0 0 230 1 0 0 25 0 9 0 718612283 238161920 3065 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 58145 3065 179 55 0 56031 0
[pid=21284/tid=21290] ppid=21282 vsize=232580 CPUtime=0.29 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 745 1251 0 0 29 0 0 0 25 0 9 0 718612284 238161920 3065 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=232580 CPUtime=0.29 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 791 1251 0 0 29 0 0 0 18 0 9 0 718612284 238161920 3065 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=232580 CPUtime=0.25 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 565 1251 0 0 25 0 0 0 25 0 9 0 718612284 238161920 3065 33554432000 4194304 4417452 140736927349040 18446744073709551615 4252365 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=232580 CPUtime=0.29 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 534 1251 0 0 29 0 0 0 25 0 9 0 718612284 238161920 3065 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=232580 CPUtime=0.29 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 771 1251 0 0 29 0 0 0 18 0 9 0 718612284 238161920 3065 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=232632 CPUtime=0.29 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 865 1251 0 0 29 0 0 0 18 0 9 0 718612284 238215168 3078 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=232632 CPUtime=0.29 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 782 1251 0 0 29 0 0 0 25 0 9 0 718612284 238215168 3078 33554432000 4194304 4417452 140736927349040 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=232632 CPUtime=0.29 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 928 1251 0 0 29 0 0 0 18 0 9 0 718612284 238215168 3078 33554432000 4194304 4417452 140736927349040 18446744073709551615 4353879 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.31
Current children cumulated vsize (KiB) 232580

[startup+0.700813 s]
/proc/loadavg: 6.79 2.60 0.95 2/543 21284
/proc/meminfo: memFree=13587868/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=233792 CPUtime=5.51 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 12312 1251 0 0 549 2 0 0 25 0 9 0 718612283 239403008 3368 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 58448 3368 179 55 0 56334 0
[pid=21284/tid=21290] ppid=21282 vsize=233792 CPUtime=0.68 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 1406 1251 0 0 68 0 0 0 25 0 9 0 718612284 239403008 3368 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364684 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=233792 CPUtime=0.69 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 1674 1251 0 0 69 0 0 0 18 0 9 0 718612284 239403008 3368 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=233792 CPUtime=0.65 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 1301 1251 0 0 65 0 0 0 25 0 9 0 718612284 239403008 3368 33554432000 4194304 4417452 140736927349040 18446744073709551615 4246388 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=233792 CPUtime=0.69 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 1027 1251 0 0 69 0 0 0 25 0 9 0 718612284 239403008 3368 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=233792 CPUtime=0.69 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 1612 1251 0 0 69 0 0 0 18 0 9 0 718612284 239403008 3368 33554432000 4194304 4417452 140736927349040 18446744073709551615 4366105 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=233792 CPUtime=0.69 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 1646 1251 0 0 69 0 0 0 18 0 9 0 718612284 239403008 3368 33554432000 4194304 4417452 140736927349040 18446744073709551615 4356706 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=233792 CPUtime=0.69 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 1497 1251 0 0 69 0 0 0 25 0 9 0 718612284 239403008 3368 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=233792 CPUtime=0.69 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 1831 1251 0 0 69 0 0 0 18 0 9 0 718612284 239403008 3368 33554432000 4194304 4417452 140736927349040 18446744073709551615 4353661 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.51
Current children cumulated vsize (KiB) 233792

[startup+1.50067 s]
/proc/loadavg: 6.79 2.60 0.95 10/552 21298
/proc/meminfo: memFree=13569492/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=242232 CPUtime=11.88 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 22741 1251 0 0 1185 3 0 0 25 0 9 0 718612283 248045568 5455 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 60558 5455 179 55 0 58444 0
[pid=21284/tid=21290] ppid=21282 vsize=242232 CPUtime=1.48 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 2464 1251 0 0 148 0 0 0 25 0 9 0 718612284 248045568 5455 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=242232 CPUtime=1.49 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 3014 1251 0 0 149 0 0 0 20 0 9 0 718612284 248045568 5455 33554432000 4194304 4417452 140736927349040 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=242232 CPUtime=1.43 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 2705 1251 0 0 143 0 0 0 25 0 9 0 718612284 248045568 5455 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=242232 CPUtime=1.48 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 2373 1251 0 0 148 0 0 0 25 0 9 0 718612284 248045568 5455 33554432000 4194304 4417452 140736927349040 18446744073709551615 4365996 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=242232 CPUtime=1.48 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 3013 1251 0 0 148 0 0 0 20 0 9 0 718612284 248045568 5455 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=242232 CPUtime=1.48 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 3014 1251 0 0 148 0 0 0 20 0 9 0 718612284 248045568 5455 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=242232 CPUtime=1.48 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 2812 1251 0 0 148 0 0 0 25 0 9 0 718612284 248045568 5455 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=242232 CPUtime=1.48 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 3028 1251 0 0 148 0 0 0 20 0 9 0 718612284 248045568 5455 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.88
Current children cumulated vsize (KiB) 242232

[startup+3.10038 s]
/proc/loadavg: 6.89 2.68 0.99 9/552 21298
/proc/meminfo: memFree=13561804/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=249712 CPUtime=24.66 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 37388 1251 0 0 2460 6 0 0 25 0 9 0 718612283 255705088 7348 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 62428 7348 179 55 0 60314 0
[pid=21284/tid=21290] ppid=21282 vsize=249712 CPUtime=3.09 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 4528 1251 0 0 308 1 0 0 25 0 9 0 718612284 255705088 7348 33554432000 4194304 4417452 140736927349040 18446744073709551615 4251104 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=249712 CPUtime=3.08 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 4845 1251 0 0 308 0 0 0 25 0 9 0 718612284 255705088 7348 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=249712 CPUtime=3 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 4678 1251 0 0 300 0 0 0 25 0 9 0 718612284 255705088 7348 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=249712 CPUtime=3.08 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 3692 1251 0 0 308 0 0 0 25 0 9 0 718612284 255705088 7348 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=249712 CPUtime=3.08 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 5225 1251 0 0 308 0 0 0 25 0 9 0 718612284 255705088 7348 33554432000 4194304 4417452 140736927349040 18446744073709551615 4365984 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=249712 CPUtime=3.08 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 4621 1251 0 0 308 0 0 0 25 0 9 0 718612284 255705088 7348 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=249712 CPUtime=3.08 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 4690 1251 0 0 308 0 0 0 25 0 9 0 718612284 255705088 7348 33554432000 4194304 4417452 140736927349040 18446744073709551615 4242064 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=249712 CPUtime=3.08 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 4791 1251 0 0 308 0 0 0 25 0 9 0 718612284 255705088 7348 33554432000 4194304 4417452 140736927349040 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.66
Current children cumulated vsize (KiB) 249712

[startup+6.3008 s]
/proc/loadavg: 6.89 2.68 0.99 9/552 21298
/proc/meminfo: memFree=13546940/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=259284 CPUtime=50.2 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 68353 1251 0 0 5008 12 0 0 25 0 9 0 718612283 265506816 9715 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 64821 9715 179 55 0 62707 0

################
# More data... #
################

/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 787002 1251 0 0 465960 142 0 0 25 0 9 0 718612284 1604341760 336579 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364696 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=1566740 CPUtime=4662.41 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 820427 1251 0 0 466113 128 0 0 25 0 9 0 718612284 1604341760 336579 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=1566740 CPUtime=4662.42 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 666670 1251 0 0 466122 120 0 0 25 0 9 0 718612284 1604341760 336579 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=1566740 CPUtime=4661.59 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 667354 1251 0 0 466039 120 0 0 25 0 9 0 718612284 1604341760 336579 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=1566740 CPUtime=4662.28 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 682910 1251 0 0 466101 127 0 0 25 0 9 0 718612284 1604341760 336579 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37212.1
Current children cumulated vsize (KiB) 1566740

[startup+4722.32 s]
/proc/loadavg: 8.17 8.10 8.01 9/552 21436
/proc/meminfo: memFree=12232248/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=1572056 CPUtime=37691.1 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 5923326 1251 0 0 3768074 1037 0 0 25 0 9 0 718612283 1609785344 337908 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 393014 337908 179 55 0 390900 0
[pid=21284/tid=21290] ppid=21282 vsize=1572056 CPUtime=4722.44 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 861049 1251 0 0 472100 144 0 0 25 0 9 0 718612284 1609785344 337908 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=1572056 CPUtime=4722.43 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 705336 1251 0 0 472120 123 0 0 25 0 9 0 718612284 1609785344 337908 33554432000 4194304 4417452 140736927349040 18446744073709551615 4365103 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=1572056 CPUtime=4636.35 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 725175 1251 0 0 463506 129 0 0 25 0 9 0 718612284 1609785344 337908 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=1572056 CPUtime=4721.03 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 794087 1251 0 0 471960 143 0 0 25 0 9 0 718612284 1609785344 337908 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=1572056 CPUtime=4722.43 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 820427 1251 0 0 472115 128 0 0 25 0 9 0 718612284 1609785344 337908 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=1572056 CPUtime=4722.44 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 666670 1251 0 0 472124 120 0 0 25 0 9 0 718612284 1609785344 337908 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=1572056 CPUtime=4721.61 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 667354 1251 0 0 472041 120 0 0 25 0 9 0 718612284 1609785344 337908 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=1572056 CPUtime=4722.3 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 682910 1251 0 0 472103 127 0 0 25 0 9 0 718612284 1609785344 337908 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37691.1
Current children cumulated vsize (KiB) 1572056

[startup+4782.3 s]
/proc/loadavg: 8.09 8.09 8.01 9/552 21438
/proc/meminfo: memFree=12381752/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=1422096 CPUtime=38169.9 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 5948133 1251 0 0 3815946 1041 0 0 25 0 9 0 718612283 1456226304 300418 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 355524 300418 179 55 0 353410 0
[pid=21284/tid=21290] ppid=21282 vsize=1422096 CPUtime=4782.42 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 863624 1251 0 0 478098 144 0 0 25 0 9 0 718612284 1456226304 300418 33554432000 4194304 4417452 140736927349040 18446744073709551615 4235973 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=1422096 CPUtime=4782.41 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 705336 1251 0 0 478118 123 0 0 25 0 9 0 718612284 1456226304 300418 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=1422096 CPUtime=4695.25 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 725175 1251 0 0 469396 129 0 0 25 0 9 0 718612284 1456226304 300418 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=1422096 CPUtime=4781 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 798939 1251 0 0 477956 144 0 0 25 0 9 0 718612284 1456226304 300418 33554432000 4194304 4417452 140736927349040 18446744073709551615 253640621968 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=1422096 CPUtime=4782.42 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 820427 1251 0 0 478114 128 0 0 25 0 9 0 718612284 1456226304 300418 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=1422096 CPUtime=4782.42 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 684050 1251 0 0 478120 122 0 0 25 0 9 0 718612284 1456226304 300418 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=1422096 CPUtime=4781.59 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 667354 1251 0 0 478039 120 0 0 25 0 9 0 718612284 1456226304 300418 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=1422096 CPUtime=4782.28 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 682910 1251 0 0 478101 127 0 0 25 0 9 0 718612284 1456226304 300418 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38169.9
Current children cumulated vsize (KiB) 1422096

[startup+4842.3 s]
/proc/loadavg: 8.14 8.10 8.02 9/552 21439
/proc/meminfo: memFree=12305840/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=1498952 CPUtime=38648.8 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 5967347 1251 0 0 3863830 1045 0 0 25 0 9 0 718612283 1534926848 319632 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 374738 319632 179 55 0 372624 0
[pid=21284/tid=21290] ppid=21282 vsize=1498952 CPUtime=4842.42 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 871988 1251 0 0 484096 146 0 0 25 0 9 0 718612284 1534926848 319632 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=1498952 CPUtime=4842.41 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 705336 1251 0 0 484118 123 0 0 25 0 9 0 718612284 1534926848 319632 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=1498952 CPUtime=4754.15 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 725175 1251 0 0 475286 129 0 0 25 0 9 0 718612284 1534926848 319632 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=1498952 CPUtime=4840.98 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 806213 1251 0 0 483953 145 0 0 25 0 9 0 718612284 1534926848 319632 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364542 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=1498952 CPUtime=4842.42 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 820427 1251 0 0 484114 128 0 0 25 0 9 0 718612284 1534926848 319632 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=1498952 CPUtime=4842.42 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 684050 1251 0 0 484120 122 0 0 25 0 9 0 718612284 1534926848 319632 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=1498952 CPUtime=4841.6 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 667354 1251 0 0 484040 120 0 0 25 0 9 0 718612284 1534926848 319632 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=1498952 CPUtime=4842.27 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 686486 1251 0 0 484099 128 0 0 25 0 9 0 718612284 1534926848 319632 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38648.8
Current children cumulated vsize (KiB) 1498952

[startup+4902.3 s]
/proc/loadavg: 8.12 8.10 8.01 9/552 21441
/proc/meminfo: memFree=12066268/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=1738284 CPUtime=39127.6 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 6068780 1251 0 0 3911693 1072 0 0 25 0 9 0 718612283 1780002816 379465 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 434571 379465 179 55 0 432457 0
[pid=21284/tid=21290] ppid=21282 vsize=1738284 CPUtime=4902.42 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 871988 1251 0 0 490096 146 0 0 25 0 9 0 718612284 1780002816 379465 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=1738284 CPUtime=4902.41 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 736766 1251 0 0 490109 132 0 0 25 0 9 0 718612284 1780002816 379465 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=1738284 CPUtime=4813.05 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 750239 1251 0 0 481170 135 0 0 25 0 9 0 718612284 1780002816 379465 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=1738284 CPUtime=4900.98 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 811674 1251 0 0 489951 147 0 0 25 0 9 0 718612284 1780002816 379465 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=1738284 CPUtime=4902.42 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 826007 1251 0 0 490112 130 0 0 25 0 9 0 718612284 1780002816 379465 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=1738284 CPUtime=4902.42 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 685914 1251 0 0 490120 122 0 0 25 0 9 0 718612284 1780002816 379465 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=1738284 CPUtime=4901.59 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 699388 1251 0 0 490031 128 0 0 25 0 9 0 718612284 1780002816 379465 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=1738284 CPUtime=4902.27 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 686486 1251 0 0 490099 128 0 0 25 0 9 0 718612284 1780002816 379465 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39127.6
Current children cumulated vsize (KiB) 1738284

[startup+4962.3 s]
/proc/loadavg: 8.11 8.09 8.01 9/552 21443
/proc/meminfo: memFree=12085956/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=1718016 CPUtime=39606.5 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 6143634 1251 0 0 3959563 1090 0 0 25 0 9 0 718612283 1759248384 374398 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 429504 374398 179 55 0 427390 0
[pid=21284/tid=21290] ppid=21282 vsize=1718016 CPUtime=4962.42 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 879347 1251 0 0 496094 148 0 0 25 0 9 0 718612284 1759248384 374398 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=1718016 CPUtime=4962.41 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 771710 1251 0 0 496101 140 0 0 25 0 9 0 718612284 1759248384 374398 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=1718016 CPUtime=4871.95 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 750239 1251 0 0 487060 135 0 0 25 0 9 0 718612284 1759248384 374398 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=1718016 CPUtime=4960.96 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 822838 1251 0 0 495948 148 0 0 25 0 9 0 718612284 1759248384 374398 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=1718016 CPUtime=4962.42 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 831010 1251 0 0 496111 131 0 0 25 0 9 0 718612284 1759248384 374398 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=1718016 CPUtime=4962.42 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 685914 1251 0 0 496120 122 0 0 25 0 9 0 718612284 1759248384 374398 33554432000 4194304 4417452 140736927349040 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=1718016 CPUtime=4961.6 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 715772 1251 0 0 496026 134 0 0 25 0 9 0 718612284 1759248384 374398 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=1718016 CPUtime=4962.28 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 686486 1251 0 0 496099 129 0 0 25 0 9 0 718612284 1759248384 374398 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39606.5
Current children cumulated vsize (KiB) 1718016



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.62 s]
/proc/loadavg: 8.12 8.09 8.01 9/552 21444
/proc/meminfo: memFree=12194936/32951124 swapFree=56449260/67111528
[pid=21284] ppid=21282 vsize=1608600 CPUtime=40000.3 cores=0-7
/proc/21284/stat : 21284 (plingeling) S 21282 21284 21187 0 -1 4202496 6157972 1251 0 0 3998941 1093 0 0 25 0 9 0 718612283 1647206400 347044 33554432000 4194304 4417452 140736927349040 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/21284/statm: 402150 347044 179 55 0 400036 0
[pid=21284/tid=21290] ppid=21282 vsize=1608600 CPUtime=5011.77 cores=0-7
/proc/21284/task/21290/stat : 21290 (plingeling) R 21282 21284 21187 0 -1 4202560 884967 1251 0 0 501028 149 0 0 25 0 9 0 718612284 1647206400 347044 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21284/tid=21291] ppid=21282 vsize=1608600 CPUtime=5011.75 cores=0-7
/proc/21284/task/21291/stat : 21291 (plingeling) R 21282 21284 21187 0 -1 4202560 771710 1251 0 0 501035 140 0 0 25 0 9 0 718612284 1647206400 347044 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=21284/tid=21292] ppid=21282 vsize=1608600 CPUtime=4920.36 cores=0-7
/proc/21284/task/21292/stat : 21292 (plingeling) R 21282 21284 21187 0 -1 4202560 750239 1251 0 0 491901 135 0 0 25 0 9 0 718612284 1647206400 347044 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21284/tid=21293] ppid=21282 vsize=1608600 CPUtime=5010.29 cores=0-7
/proc/21284/task/21293/stat : 21293 (plingeling) R 21282 21284 21187 0 -1 4202560 824435 1251 0 0 500881 148 0 0 25 0 9 0 718612284 1647206400 347044 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21284/tid=21294] ppid=21282 vsize=1608600 CPUtime=5011.76 cores=0-7
/proc/21284/task/21294/stat : 21294 (plingeling) R 21282 21284 21187 0 -1 4202560 838131 1251 0 0 501044 132 0 0 25 0 9 0 718612284 1647206400 347044 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=21284/tid=21295] ppid=21282 vsize=1608600 CPUtime=5011.77 cores=0-7
/proc/21284/task/21295/stat : 21295 (plingeling) R 21282 21284 21187 0 -1 4202560 685914 1251 0 0 501055 122 0 0 25 0 9 0 718612284 1647206400 347044 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=21284/tid=21296] ppid=21282 vsize=1608600 CPUtime=5010.95 cores=0-7
/proc/21284/task/21296/stat : 21296 (plingeling) R 21282 21284 21187 0 -1 4202560 715772 1251 0 0 500961 134 0 0 25 0 9 0 718612284 1647206400 347044 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21284/tid=21297] ppid=21282 vsize=1608600 CPUtime=5011.62 cores=0-7
/proc/21284/task/21297/stat : 21297 (plingeling) R 21282 21284 21187 0 -1 4202560 686486 1251 0 0 501033 129 0 0 25 0 9 0 718612284 1647206400 347044 33554432000 4194304 4417452 140736927349040 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 1608600

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.7
CPU time (s): 40000.4
CPU user time (s): 39989.5
CPU system time (s): 10.9883
CPU usage (%): 798.141
Max. virtual memory (cumulated for all children) (KiB): 1934548

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39989.5
system time used= 10.9883
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6159223
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 345
involuntary context switches= 141155

runsolver used 24.9322 second user time and 66.4569 second system time

The end

Launcher Data

Begin job on node106 at 2011-05-22 15:15:19
IDJOB=3393874
IDBENCH=20442
IDSOLVER=1851
FILE ID=node106/3393874-1306070119
RUNJOBID= node106-1306069999-21201
PBS_JOBID= 13387897
Free space on /tmp= 73260 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT07/crafted/spence/hard/s113-100.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3393874-1306070119/watcher-3393874-1306070119 -o /tmp/evaluation-result-3393874-1306070119/solver-3393874-1306070119 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3393874-1306070119.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 346cb413e25976ab9ce2952e1d53c865
RANDOM SEED=1251252464

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13588396 kB
Buffers:        339228 kB
Cached:       10938520 kB
SwapCached:      27520 kB
Active:        8010504 kB
Inactive:     11046068 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13588396 kB
SwapTotal:    67111528 kB
SwapFree:     56449260 kB
Dirty:             148 kB
Writeback:           0 kB
AnonPages:     7759968 kB
Mapped:          25808 kB
Slab:           156972 kB
PageTables:      77808 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 167518524 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73260 MiB
End job on node106 at 2011-05-22 16:38:53