Trace number 3309522

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.5 5007.29

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf
MD5SUMf52ec4dacdcf65c3aedb61fb46ade01b
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1007.46
Satisfiable
(Un)Satisfiability was proved
Number of variables153284
Number of clauses2473656
Sum of the clauses size5647736
Maximum clause length78
Minimum clause length1
Number of clauses of size 1696
Number of clauses of size 22387280
Number of clauses of size 36720
Number of clauses of size 431080
Number of clauses of size 513440
Number of clauses of size over 534440

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309522-1304004261/watcher-3309522-1304004261 -o /tmp/evaluation-result-3309522-1304004261/solver-3309522-1304004261 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309522-1304004261.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.46 2.99 1.82 2/170 12786
/proc/meminfo: memFree=18469188/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=11776 CPUtime=0 cores=0-7
/proc/12786/stat : 12786 (plingeling) R 12784 12786 12635 0 -1 4202496 1034 1252 0 0 0 0 0 0 23 0 1 0 590656959 12058624 963 33554432000 4194304 4417332 140737282445088 18446744073709551615 224284619727 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/12786/statm: 2944 963 143 55 0 830 0

[startup+0.0825239 s]
/proc/loadavg: 6.46 2.99 1.82 2/170 12786
/proc/meminfo: memFree=18469188/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=18684 CPUtime=0.07 cores=0-7
/proc/12786/stat : 12786 (plingeling) R 12784 12786 12635 0 -1 4202496 2770 1252 0 0 7 0 0 0 23 0 1 0 590656959 19132416 2695 33554432000 4194304 4417332 140737282445088 18446744073709551615 224284983722 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/12786/statm: 4735 2724 148 55 0 2621 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 18684

[startup+0.100518 s]
/proc/loadavg: 6.46 2.99 1.82 2/170 12786
/proc/meminfo: memFree=18469188/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=23280 CPUtime=0.09 cores=0-7
/proc/12786/stat : 12786 (plingeling) R 12784 12786 12635 0 -1 4202496 3887 1252 0 0 9 0 0 0 23 0 1 0 590656959 23838720 3812 33554432000 4194304 4417332 140737282445088 18446744073709551615 224284925696 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/12786/statm: 5820 3812 148 55 0 3706 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 23280

[startup+0.300487 s]
/proc/loadavg: 6.46 2.99 1.82 2/170 12786
/proc/meminfo: memFree=18469188/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=39652 CPUtime=0.29 cores=0-7
/proc/12786/stat : 12786 (plingeling) R 12784 12786 12635 0 -1 4202496 8020 1252 0 0 28 1 0 0 24 0 1 0 590656959 40603648 7937 33554432000 4194304 4417332 140737282445088 18446744073709551615 4209666 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/12786/statm: 9913 7937 148 55 0 7799 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 39652

[startup+0.700419 s]
/proc/loadavg: 6.46 2.99 1.82 2/170 12786
/proc/meminfo: memFree=18469188/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=90900 CPUtime=0.69 cores=0-7
/proc/12786/stat : 12786 (plingeling) R 12784 12786 12635 0 -1 4202496 20832 1252 0 0 66 3 0 0 25 0 1 0 590656959 93081600 20749 33554432000 4194304 4417332 140737282445088 18446744073709551615 4231291 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/12786/statm: 22725 20749 148 55 0 20611 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 90900

[startup+1.50029 s]
/proc/loadavg: 6.46 2.99 1.82 2/171 12792
/proc/meminfo: memFree=18349308/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=238880 CPUtime=1.48 cores=0-7
/proc/12786/stat : 12786 (plingeling) R 12784 12786 12635 0 -1 4202496 57827 1252 0 0 140 8 0 0 25 0 1 0 590656959 244613120 57744 33554432000 4194304 4417332 140737282445088 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/12786/statm: 59720 57744 148 55 0 57606 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 238880

[startup+3.10102 s]
/proc/loadavg: 6.46 2.99 1.82 2/171 12792
/proc/meminfo: memFree=18238204/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=386336 CPUtime=3.09 cores=0-7
/proc/12786/stat : 12786 (plingeling) R 12784 12786 12635 0 -1 4202496 94691 1252 0 0 294 15 0 0 25 0 1 0 590656959 395608064 94608 33554432000 4194304 4417332 140737282445088 18446744073709551615 4231377 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/12786/statm: 96584 94608 148 55 0 94470 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 386336

[startup+6.30045 s]
/proc/loadavg: 6.02 2.96 1.82 9/179 12800
/proc/meminfo: memFree=18039504/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=553628 CPUtime=23.43 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 155646 1252 0 0 2317 26 0 0 18 0 9 0 590656959 566915072 102372 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 138407 102372 175 55 0 136293 0
[pid=12786/tid=12793] ppid=12784 vsize=553628 CPUtime=2.44 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 6183 1252 0 0 243 1 0 0 25 0 9 0 590657344 566915072 102372 33554432000 4194304 4417332 140737282445088 18446744073709551615 4215107 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=553628 CPUtime=2.43 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 6381 1252 0 0 242 1 0 0 22 0 9 0 590657344 566915072 102372 33554432000 4194304 4417332 140737282445088 18446744073709551615 4275756 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=553628 CPUtime=2.44 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 6033 1252 0 0 244 0 0 0 22 0 9 0 590657344 566915072 102372 33554432000 4194304 4417332 140737282445088 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=553628 CPUtime=2.44 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 2329 1252 0 0 244 0 0 0 22 0 9 0 590657344 566915072 102372 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364329 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=553628 CPUtime=2.44 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 6516 1252 0 0 243 1 0 0 22 0 9 0 590657344 566915072 102372 33554432000 4194304 4417332 140737282445088 18446744073709551615 4277861 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=553628 CPUtime=2.44 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 5065 1252 0 0 243 1 0 0 22 0 9 0 590657344 566915072 102372 33554432000 4194304 4417332 140737282445088 18446744073709551615 4277019 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12786/tid=12799] ppid=12784 vsize=553628 CPUtime=2.44 cores=0-7
/proc/12786/task/12799/stat : 12799 (plingeling) R 12784 12786 12635 0 -1 4202560 4120 1252 0 0 244 0 0 0 22 0 9 0 590657344 566915072 102372 33554432000 4194304 4417332 140737282445088 18446744073709551615 4261282 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=553628 CPUtime=2.43 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4202560 5556 1252 0 0 243 0 0 0 25 0 9 0 590657344 566915072 102372 33554432000 4194304 4417332 140737282445088 18446744073709551615 4281230 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 23.43
Current children cumulated vsize (KiB) 553628

[startup+12.7004 s]
/proc/loadavg: 6.18 3.04 1.85 9/179 12800
/proc/meminfo: memFree=18034956/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=575292 CPUtime=74.59 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 207832 1252 0 0 7425 34 0 0 18 0 9 0 590656959 589099008 109147 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 143823 109147 181 55 0 141709 0
[pid=12786/tid=12793] ppid=12784 vsize=575292 CPUtime=8.84 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 11473 1252 0 0 883 1 0 0 25 0 9 0 590657344 589099008 109147 33554432000 4194304 4417332 140737282445088 18446744073709551615 4365833 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=575292 CPUtime=8.79 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 12700 1252 0 0 877 2 0 0 25 0 9 0 590657344 589099008 109147 33554432000 4194304 4417332 140737282445088 18446744073709551615 4232772 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=575292 CPUtime=8.85 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 17915 1252 0 0 882 3 0 0 25 0 9 0 590657344 589099008 109147 33554432000 4194304 4417332 140737282445088 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=575292 CPUtime=8.84 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 3468 1252 0 0 884 0 0 0 25 0 9 0 590657344 589099008 109147 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=575292 CPUtime=8.84 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 15186 1252 0 0 882 2 0 0 25 0 9 0 590657344 589099008 109147 33554432000 4194304 4417332 140737282445088 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=575292 CPUtime=8.83 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 9397 1252 0 0 882 1 0 0 25 0 9 0 590657344 589099008 109147 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12786/tid=12799] ppid=12784 vsize=575292 CPUtime=8.84 cores=0-7
/proc/12786/task/12799/stat : 12799 (plingeling) R 12784 12786 12635 0 -1 4202560 13760 1252 0 0 882 2 0 0 25 0 9 0 590657344 589099008 109147 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=575292 CPUtime=8.84 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4202560 10470 1252 0 0 883 1 0 0 25 0 9 0 590657344 589099008 109147 33554432000 4194304 4417332 140737282445088 18446744073709551615 4363700 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 74.59
Current children cumulated vsize (KiB) 575292

[startup+25.5012 s]
/proc/loadavg: 6.58 3.28 1.95 9/179 12800
/proc/meminfo: memFree=18020552/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=592468 CPUtime=176.92 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 212131 1252 0 0 17658 34 0 0 18 0 9 0 590656959 606687232 113441 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 148117 113441 181 55 0 146003 0
[pid=12786/tid=12793] ppid=12784 vsize=592468 CPUtime=21.63 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 11538 1252 0 0 2162 1 0 0 25 0 9 0 590657344 606687232 113441 33554432000 4194304 4417332 140737282445088 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=592468 CPUtime=21.52 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 13162 1252 0 0 2150 2 0 0 25 0 9 0 590657344 606687232 113441 33554432000 4194304 4417332 140737282445088 18446744073709551615 4236971 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=592468 CPUtime=21.65 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 18043 1252 0 0 2162 3 0 0 25 0 9 0 590657344 606687232 113441 33554432000 4194304 4417332 140737282445088 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=592468 CPUtime=21.64 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 6288 1252 0 0 2163 1 0 0 25 0 9 0 590657344 606687232 113441 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=592468 CPUtime=21.64 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 15628 1252 0 0 2162 2 0 0 25 0 9 0 590657344 606687232 113441 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=592468 CPUtime=21.64 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 9779 1252 0 0 2163 1 0 0 25 0 9 0 590657344 606687232 113441 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364365 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12786/tid=12799] ppid=12784 vsize=592468 CPUtime=21.64 cores=0-7
/proc/12786/task/12799/stat : 12799 (plingeling) R 12784 12786 12635 0 -1 4202560 13760 1252 0 0 2162 2 0 0 25 0 9 0 590657344 606687232 113441 33554432000 4194304 4417332 140737282445088 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=592468 CPUtime=21.64 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4202560 10470 1252 0 0 2163 1 0 0 25 0 9 0 590657344 606687232 113441 33554432000 4194304 4417332 140737282445088 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 176.92
Current children cumulated vsize (KiB) 592468

[startup+51.101 s]
/proc/loadavg: 7.07 3.66 2.11 9/179 12800
/proc/meminfo: memFree=17975076/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=646804 CPUtime=381.57 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 223971 1252 0 0 38121 36 0 0 18 0 9 0 590656959 662327296 124198 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 161701 124198 181 55 0 159587 0
[pid=12786/tid=12793] ppid=12784 vsize=646804 CPUtime=47.24 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 12575 1252 0 0 4722 2 0 0 25 0 9 0 590657344 662327296 124198 33554432000 4194304 4417332 140737282445088 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=646804 CPUtime=46.98 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 13363 1252 0 0 4696 2 0 0 25 0 9 0 590657344 662327296 124198 33554432000 4194304 4417332 140737282445088 18446744073709551615 4236569 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=646804 CPUtime=47.25 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 18235 1252 0 0 4722 3 0 0 25 0 9 0 590657344 662327296 124198 33554432000 4194304 4417332 140737282445088 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=646804 CPUtime=47.24 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 10481 1252 0 0 4723 1 0 0 25 0 9 0 590657344 662327296 124198 33554432000 4194304 4417332 140737282445088 18446744073709551615 4356928 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=646804 CPUtime=47.25 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 20331 1252 0 0 4722 3 0 0 25 0 9 0 590657344 662327296 124198 33554432000 4194304 4417332 140737282445088 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=646804 CPUtime=47.24 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 11274 1252 0 0 4722 2 0 0 25 0 9 0 590657344 662327296 124198 33554432000 4194304 4417332 140737282445088 18446744073709551615 4264199 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12786/tid=12799] ppid=12784 vsize=646804 CPUtime=47.24 cores=0-7
/proc/12786/task/12799/stat : 12799 (plingeling) R 12784 12786 12635 0 -1 4202560 13779 1252 0 0 4722 2 0 0 25 0 9 0 590657344 662327296 124198 33554432000 4194304 4417332 140737282445088 18446744073709551615 4251109 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=646804 CPUtime=47.23 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4202560 10470 1252 0 0 4722 1 0 0 25 0 9 0 590657344 662327296 124198 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 381.57
Current children cumulated vsize (KiB) 646804

[startup+102.306 s]
/proc/loadavg: 7.59 4.33 2.41 9/179 12802
/proc/meminfo: memFree=17918492/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=691972 CPUtime=790.93 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 247028 1252 0 0 79054 39 0 0 18 0 9 0 590656959 708579328 138263 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 172993 138263 181 55 0 170879 0
[pid=12786/tid=12793] ppid=12784 vsize=691972 CPUtime=98.44 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 12575 1252 0 0 9842 2 0 0 25 0 9 0 590657344 708579328 138263 33554432000 4194304 4417332 140737282445088 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=691972 CPUtime=97.9 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 14213 1252 0 0 9788 2 0 0 25 0 9 0 590657344 708579328 138263 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364953 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=691972 CPUtime=98.45 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 19282 1252 0 0 9842 3 0 0 25 0 9 0 590657344 708579328 138263 33554432000 4194304 4417332 140737282445088 18446744073709551615 4321685 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=691972 CPUtime=98.45 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 19856 1252 0 0 9842 3 0 0 25 0 9 0 590657344 708579328 138263 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357790 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=691972 CPUtime=98.45 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 21057 1252 0 0 9842 3 0 0 25 0 9 0 590657344 708579328 138263 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=691972 CPUtime=98.44 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 15756 1252 0 0 9842 2 0 0 25 0 9 0 590657344 708579328 138263 33554432000 4194304 4417332 140737282445088 18446744073709551615 4366605 0 0 4096 17442 0 0 0 -1 5 0 0 0

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.06 8.08 8.00 9/179 12939
/proc/meminfo: memFree=14896444/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=3694040 CPUtime=37723.4 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 9782092 1252 0 0 3770635 1705 0 0 18 0 9 0 590656959 3782696960 892313 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 923510 892313 181 55 0 921396 0
[pid=12786/tid=12793] ppid=12784 vsize=3694040 CPUtime=4718 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 1076668 1252 0 0 471621 179 0 0 25 0 9 0 590657344 3782696960 892313 33554432000 4194304 4417332 140737282445088 18446744073709551615 4232580 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=3694040 CPUtime=4703.58 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 956720 1252 0 0 470194 164 0 0 25 0 9 0 590657344 3782696960 892313 33554432000 4194304 4417332 140737282445088 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=3694040 CPUtime=4718.45 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 824380 1252 0 0 471700 145 0 0 25 0 9 0 590657344 3782696960 892313 33554432000 4194304 4417332 140737282445088 18446744073709551615 4236835 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=3694040 CPUtime=4718.48 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 2382236 1252 0 0 471396 452 0 0 25 0 9 0 590657344 3782696960 892313 33554432000 4194304 4417332 140737282445088 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=3694040 CPUtime=4716.76 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 659643 1252 0 0 471574 102 0 0 25 0 9 0 590657344 3782696960 892313 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=3694040 CPUtime=4710.54 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 1545595 1252 0 0 470794 260 0 0 25 0 9 0 590657344 3782696960 892313 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357874 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12786/tid=12799] ppid=12784 vsize=3694040 CPUtime=4718.44 cores=0-7
/proc/12786/task/12799/stat : 12799 (plingeling) R 12784 12786 12635 0 -1 4202560 1039812 1252 0 0 471662 182 0 0 25 0 9 0 590657344 3782696960 892313 33554432000 4194304 4417332 140737282445088 18446744073709551615 4354373 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=3694040 CPUtime=4715.23 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4202560 1183575 1252 0 0 471325 198 0 0 25 0 9 0 590657344 3782696960 892313 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37723.4
Current children cumulated vsize (KiB) 3694040

[startup+4782.3 s]
/proc/loadavg: 8.02 8.06 8.00 9/179 12941
/proc/meminfo: memFree=15216868/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=3367128 CPUtime=38203 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 9917354 1252 0 0 3818576 1727 0 0 18 0 9 0 590656959 3447939072 814685 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 841782 814685 181 55 0 839668 0
[pid=12786/tid=12793] ppid=12784 vsize=3367128 CPUtime=4777.99 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 1078363 1252 0 0 477620 179 0 0 25 0 9 0 590657344 3447939072 814685 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=3367128 CPUtime=4763.58 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 971285 1252 0 0 476190 168 0 0 25 0 9 0 590657344 3447939072 814685 33554432000 4194304 4417332 140737282445088 18446744073709551615 4354428 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=3367128 CPUtime=4778.45 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 828477 1252 0 0 477699 146 0 0 25 0 9 0 590657344 3447939072 814685 33554432000 4194304 4417332 140737282445088 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=3367128 CPUtime=4778.47 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 2402933 1252 0 0 477393 454 0 0 25 0 9 0 590657344 3447939072 814685 33554432000 4194304 4417332 140737282445088 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=3367128 CPUtime=4776.77 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 659968 1252 0 0 477574 103 0 0 25 0 9 0 590657344 3447939072 814685 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357164 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=3367128 CPUtime=4770.53 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 1552331 1252 0 0 476792 261 0 0 25 0 9 0 590657344 3447939072 814685 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357493 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12786/tid=12799] ppid=12784 vsize=3367128 CPUtime=4778.43 cores=0-7
/proc/12786/task/12799/stat : 12799 (plingeling) R 12784 12786 12635 0 -1 4202560 1105991 1252 0 0 477650 193 0 0 25 0 9 0 590657344 3447939072 814685 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357111 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=3367128 CPUtime=4774.91 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4202560 1204543 1252 0 0 477289 202 0 0 25 0 9 0 590657344 3447939072 814685 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357846 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38203
Current children cumulated vsize (KiB) 3367128

[startup+4842.3 s]
/proc/loadavg: 8.04 8.06 8.00 9/179 12943
/proc/meminfo: memFree=14497324/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=4092560 CPUtime=38682.7 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 10155296 1252 0 0 3866512 1758 0 0 18 0 9 0 590656959 4190781440 991979 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 1023140 991979 181 55 0 1021026 0
[pid=12786/tid=12793] ppid=12784 vsize=4092560 CPUtime=4837.98 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 1081753 1252 0 0 483618 180 0 0 25 0 9 0 590657344 4190781440 991979 33554432000 4194304 4417332 140737282445088 18446744073709551615 4356756 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=4092560 CPUtime=4823.58 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 981647 1252 0 0 482188 170 0 0 25 0 9 0 590657344 4190781440 991979 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=4092560 CPUtime=4838.45 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 828477 1252 0 0 483699 146 0 0 25 0 9 0 590657344 4190781440 991979 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357806 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=4092560 CPUtime=4838.48 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 2450063 1252 0 0 483388 460 0 0 25 0 9 0 590657344 4190781440 991979 33554432000 4194304 4417332 140737282445088 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=4092560 CPUtime=4836.76 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 714511 1252 0 0 483567 109 0 0 25 0 9 0 590657344 4190781440 991979 33554432000 4194304 4417332 140737282445088 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=4092560 CPUtime=4830.53 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 1567097 1252 0 0 482791 262 0 0 25 0 9 0 590657344 4190781440 991979 33554432000 4194304 4417332 140737282445088 18446744073709551615 4355739 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12786/tid=12799] ppid=12784 vsize=4092560 CPUtime=4838.43 cores=0-7
/proc/12786/task/12799/stat : 12799 (plingeling) R 12784 12786 12635 0 -1 4202560 1129854 1252 0 0 483645 198 0 0 25 0 9 0 590657344 4190781440 991979 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357046 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=4092560 CPUtime=4834.57 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4202560 1288431 1252 0 0 483246 211 0 0 25 0 9 0 590657344 4190781440 991979 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38682.7
Current children cumulated vsize (KiB) 4092560

[startup+4902.3 s]
/proc/loadavg: 8.01 8.05 8.00 9/179 12945
/proc/meminfo: memFree=14388932/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=4184700 CPUtime=39162.4 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 10365620 1252 0 0 3914434 1801 0 0 18 0 9 0 590656959 4285132800 1019236 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 1046175 1019236 181 55 0 1044061 0
[pid=12786/tid=12793] ppid=12784 vsize=4184700 CPUtime=4897.96 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 1085012 1252 0 0 489615 181 0 0 25 0 9 0 590657344 4285132800 1019236 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=4184700 CPUtime=4883.58 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 1008141 1252 0 0 488182 176 0 0 25 0 9 0 590657344 4285132800 1019236 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=4184700 CPUtime=4898.44 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 833462 1252 0 0 489698 146 0 0 25 0 9 0 590657344 4285132800 1019236 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=4184700 CPUtime=4898.48 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 2514164 1252 0 0 489377 471 0 0 25 0 9 0 590657344 4285132800 1019236 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357160 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=4184700 CPUtime=4896.76 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 724799 1252 0 0 489565 111 0 0 25 0 9 0 590657344 4285132800 1019236 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=4184700 CPUtime=4890.53 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 1586709 1252 0 0 488787 266 0 0 25 0 9 0 590657344 4285132800 1019236 33554432000 4194304 4417332 140737282445088 18446744073709551615 4251056 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12786/tid=12799] ppid=12784 vsize=4184700 CPUtime=4898.43 cores=0-7
/proc/12786/task/12799/stat : 12799 (plingeling) R 12784 12786 12635 0 -1 4202560 1185774 1252 0 0 489632 211 0 0 25 0 9 0 590657344 4285132800 1019236 33554432000 4194304 4417332 140737282445088 18446744073709551615 4237136 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=4184700 CPUtime=4894.25 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4202560 1314096 1252 0 0 489207 218 0 0 25 0 9 0 590657344 4285132800 1019236 33554432000 4194304 4417332 140737282445088 18446744073709551615 4281686 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39162.4
Current children cumulated vsize (KiB) 4184700

[startup+4962.3 s]
/proc/loadavg: 8.08 8.05 8.00 9/179 12947
/proc/meminfo: memFree=14647444/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=3966564 CPUtime=39642 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 10480747 1252 0 0 3962380 1822 0 0 18 0 9 0 590656959 4061761536 962655 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 991641 962655 181 55 0 989527 0
[pid=12786/tid=12793] ppid=12784 vsize=3966564 CPUtime=4957.96 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 1088272 1252 0 0 495614 182 0 0 25 0 9 0 590657344 4061761536 962655 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=3966564 CPUtime=4943.58 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 1008141 1252 0 0 494182 176 0 0 25 0 9 0 590657344 4061761536 962655 33554432000 4194304 4417332 140737282445088 18446744073709551615 4366460 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=3966564 CPUtime=4958.44 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 833462 1252 0 0 495698 146 0 0 25 0 9 0 590657344 4061761536 962655 33554432000 4194304 4417332 140737282445088 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=3966564 CPUtime=4958.48 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 2514164 1252 0 0 495377 471 0 0 25 0 9 0 590657344 4061761536 962655 33554432000 4194304 4417332 140737282445088 18446744073709551615 4320983 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=3966564 CPUtime=4956.76 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 743035 1252 0 0 495560 116 0 0 25 0 9 0 590657344 4061761536 962655 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=3966564 CPUtime=4950.53 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 1633461 1252 0 0 494780 273 0 0 25 0 9 0 590657344 4061761536 962655 33554432000 4194304 4417332 140737282445088 18446744073709551615 4358020 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12786/tid=12799] ppid=12784 vsize=3966564 CPUtime=4958.44 cores=0-7
/proc/12786/task/12799/stat : 12799 (plingeling) R 12784 12786 12635 0 -1 4202560 1207842 1252 0 0 495629 215 0 0 25 0 9 0 590657344 4061761536 962655 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=3966564 CPUtime=4953.92 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4202560 1338907 1252 0 0 495171 221 0 0 25 0 9 0 590657344 4061761536 962655 33554432000 4194304 4417332 140737282445088 18446744073709551615 4320867 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39642
Current children cumulated vsize (KiB) 3966564



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5007.1 s]
/proc/loadavg: 8.03 8.04 8.00 9/179 12947
/proc/meminfo: memFree=14415660/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=4197716 CPUtime=40000.3 cores=0-7
/proc/12786/stat : 12786 (plingeling) S 12784 12786 12635 0 -1 4202496 10595256 1252 0 0 3998187 1839 0 0 18 0 9 0 590656959 4298461184 1012252 33554432000 4194304 4417332 140737282445088 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 1049429 1012252 181 55 0 1047315 0
[pid=12786/tid=12793] ppid=12784 vsize=4197716 CPUtime=5002.77 cores=0-7
/proc/12786/task/12793/stat : 12793 (plingeling) R 12784 12786 12635 0 -1 4202560 1088725 1252 0 0 500095 182 0 0 25 0 9 0 590657344 4298461184 1012252 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=12786/tid=12794] ppid=12784 vsize=4197716 CPUtime=4988.39 cores=0-7
/proc/12786/task/12794/stat : 12794 (plingeling) R 12784 12786 12635 0 -1 4202560 1008141 1252 0 0 498663 176 0 0 25 0 9 0 590657344 4298461184 1012252 33554432000 4194304 4417332 140737282445088 18446744073709551615 4358020 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=12786/tid=12795] ppid=12784 vsize=4197716 CPUtime=5003.27 cores=0-7
/proc/12786/task/12795/stat : 12795 (plingeling) R 12784 12786 12635 0 -1 4202560 840580 1252 0 0 500179 148 0 0 25 0 9 0 590657344 4298461184 1012252 33554432000 4194304 4417332 140737282445088 18446744073709551615 4236564 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=12786/tid=12796] ppid=12784 vsize=4197716 CPUtime=5003.29 cores=0-7
/proc/12786/task/12796/stat : 12796 (plingeling) R 12784 12786 12635 0 -1 4202560 2530548 1252 0 0 499856 473 0 0 25 0 9 0 590657344 4298461184 1012252 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357164 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=12786/tid=12797] ppid=12784 vsize=4197716 CPUtime=5001.58 cores=0-7
/proc/12786/task/12797/stat : 12797 (plingeling) R 12784 12786 12635 0 -1 4202560 766989 1252 0 0 500037 121 0 0 25 0 9 0 590657344 4298461184 1012252 33554432000 4194304 4417332 140737282445088 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=12786/tid=12798] ppid=12784 vsize=4197716 CPUtime=4995.34 cores=0-7
/proc/12786/task/12798/stat : 12798 (plingeling) R 12784 12786 12635 0 -1 4202560 1664860 1252 0 0 499255 279 0 0 25 0 9 0 590657344 4298461184 1012252 33554432000 4194304 4417332 140737282445088 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=12786/tid=12799] ppid=12784 vsize=4197716 CPUtime=5003.25 cores=0-7
/proc/12786/task/12799/stat : 12799 (plingeling) R 12784 12786 12635 0 -1 4202560 1225626 1252 0 0 500108 217 0 0 25 0 9 0 590657344 4298461184 1012252 33554432000 4194304 4417332 140737282445088 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=4197716 CPUtime=4998.47 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4202560 1356324 1252 0 0 499625 222 0 0 25 0 9 0 590657344 4298461184 1012252 33554432000 4194304 4417332 140737282445088 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 4197716

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5007.22 s]
/proc/loadavg: 8.03 8.04 8.00 9/179 12947
/proc/meminfo: memFree=14415660/32951124 swapFree=67110396/67111528
[pid=12786] ppid=12784 vsize=0 CPUtime=40000.4 cores=0-7
/proc/12786/stat : 12786 (plingeling) Z 12784 12786 12635 0 -1 4203548 10595256 1252 0 0 3998192 1849 0 0 18 0 2 0 590656959 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/12786/statm: 0 0 0 0 0 0 0
[pid=12786/tid=12800] ppid=12784 vsize=0 CPUtime=4998.58 cores=0-7
/proc/12786/task/12800/stat : 12800 (plingeling) R 12784 12786 12635 0 -1 4203588 1356324 1252 0 0 499626 232 0 0 25 0 2 0 590657344 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5007.29
CPU time (s): 40000.5
CPU user time (s): 39981.9
CPU system time (s): 18.5642
CPU usage (%): 798.845
Max. virtual memory (cumulated for all children) (KiB): 5364480

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39981.9
system time used= 18.5642
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10596508
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 807
involuntary context switches= 191301

runsolver used 7.98879 second user time and 19.3301 second system time

The end

Launcher Data 

Begin job on node118 at 2011-04-28 17:24:23
IDJOB=3309522
IDBENCH=82363
IDSOLVER=1695
FILE ID=node118/3309522-1304004261
RUNJOBID= node118-1304004155-12649
PBS_JOBID= 13168814
Free space on /tmp= 71576 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/rintanen/SATPlanning/sokoban-sequential-p145-microban-sequential.070-NOTKNOWN.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309522-1304004261/watcher-3309522-1304004261 -o /tmp/evaluation-result-3309522-1304004261/solver-3309522-1304004261 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309522-1304004261.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f52ec4dacdcf65c3aedb61fb46ade01b
RANDOM SEED=2078796076

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18469344 kB
Buffers:       1895204 kB
Cached:       11984148 kB
SwapCached:        600 kB
Active:        9404476 kB
Inactive:      4539108 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18469344 kB
SwapTotal:    67111528 kB
SwapFree:     67110396 kB
Dirty:           43932 kB
Writeback:           0 kB
AnonPages:       63676 kB
Mapped:          14628 kB
Slab:           472444 kB
PageTables:       4304 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   187052 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71576 MiB
End job on node118 at 2011-04-28 18:47:52