Trace number 3309537

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.7 5005.81

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
MD5SUM0385ba51f44fb47d0b0726e26312816f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables171676
Number of clauses858766
Sum of the clauses size2046721
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2847665
Number of clauses of size 32700
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58190

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309537-1304004398/watcher-3309537-1304004398 -o /tmp/evaluation-result-3309537-1304004398/solver-3309537-1304004398 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309537-1304004398.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.33 1.60 1.20 1/170 2801
/proc/meminfo: memFree=19596680/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=9400 CPUtime=0 cores=0-7
/proc/2801/stat : 2801 (plingeling) R 2799 2801 2685 0 -1 4202496 372 1251 0 0 0 0 0 0 21 0 1 0 492856002 9625600 302 33554432000 4194304 4417332 140734675118960 18446744073709551615 255106462813 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/2801/statm: 2350 315 138 55 0 236 0

[startup+0.083152 s]
/proc/loadavg: 3.33 1.60 1.20 1/170 2801
/proc/meminfo: memFree=19596680/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=23100 CPUtime=0.07 cores=0-7
/proc/2801/stat : 2801 (plingeling) R 2799 2801 2685 0 -1 4202496 3869 1251 0 0 7 0 0 0 21 0 1 0 492856002 23654400 3798 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236008 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/2801/statm: 5775 3798 148 55 0 3661 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 23100

[startup+0.101149 s]
/proc/loadavg: 3.33 1.60 1.20 1/170 2801
/proc/meminfo: memFree=19596680/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=26568 CPUtime=0.08 cores=0-7
/proc/2801/stat : 2801 (plingeling) R 2799 2801 2685 0 -1 4202496 4736 1251 0 0 8 0 0 0 21 0 1 0 492856002 27205632 4665 33554432000 4194304 4417332 140734675118960 18446744073709551615 255106387456 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/2801/statm: 6642 4665 148 55 0 4528 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 26568

[startup+0.301114 s]
/proc/loadavg: 3.33 1.60 1.20 1/170 2801
/proc/meminfo: memFree=19596680/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=63384 CPUtime=0.28 cores=0-7
/proc/2801/stat : 2801 (plingeling) R 2799 2801 2685 0 -1 4202496 13940 1251 0 0 27 1 0 0 22 0 1 0 492856002 64905216 13869 33554432000 4194304 4417332 140734675118960 18446744073709551615 4264834 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/2801/statm: 15846 13869 148 55 0 13732 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 63384

[startup+0.701046 s]
/proc/loadavg: 3.33 1.60 1.20 1/170 2801
/proc/meminfo: memFree=19596680/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=129016 CPUtime=0.68 cores=0-7
/proc/2801/stat : 2801 (plingeling) R 2799 2801 2685 0 -1 4202496 30364 1251 0 0 65 3 0 0 23 0 1 0 492856002 132112384 30277 33554432000 4194304 4417332 140734675118960 18446744073709551615 4262041 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/2801/statm: 32254 30277 148 55 0 30140 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 129016

[startup+1.50092 s]
/proc/loadavg: 3.15 1.58 1.20 2/171 2808
/proc/meminfo: memFree=19475656/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=240320 CPUtime=1.48 cores=0-7
/proc/2801/stat : 2801 (plingeling) R 2799 2801 2685 0 -1 4202496 58206 1251 0 0 142 6 0 0 25 0 1 0 492856002 246087680 58103 33554432000 4194304 4417332 140734675118960 18446744073709551615 4231537 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/2801/statm: 60080 58103 148 55 0 57966 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 240320

[startup+3.1006 s]
/proc/loadavg: 3.15 1.58 1.20 9/179 2816
/proc/meminfo: memFree=19346596/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=356288 CPUtime=13.98 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 123440 1251 0 0 1381 17 0 0 25 0 9 0 492856002 364838912 64718 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 89072 64718 176 55 0 86958 0
[pid=2801/tid=2809] ppid=2799 vsize=356288 CPUtime=1.55 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 10951 1251 0 0 154 1 0 0 20 0 9 0 492856155 364838912 64718 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=356288 CPUtime=1.55 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 9026 1251 0 0 155 0 0 0 25 0 9 0 492856155 364838912 64718 33554432000 4194304 4417332 140734675118960 18446744073709551615 4275856 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=356288 CPUtime=1.56 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 5706 1251 0 0 155 1 0 0 25 0 9 0 492856155 364838912 64718 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=356288 CPUtime=1.55 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 4090 1251 0 0 155 0 0 0 20 0 9 0 492856156 364838912 64718 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=356288 CPUtime=1.54 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 6228 1251 0 0 154 0 0 0 25 0 9 0 492856156 364838912 64718 33554432000 4194304 4417332 140734675118960 18446744073709551615 4275953 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=356288 CPUtime=1.54 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 11662 1251 0 0 152 2 0 0 25 0 9 0 492856156 364838912 64718 33554432000 4194304 4417332 140734675118960 18446744073709551615 4277621 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=356288 CPUtime=1.52 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 8724 1251 0 0 152 0 0 0 25 0 9 0 492856156 364838912 64718 33554432000 4194304 4417332 140734675118960 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=356288 CPUtime=1.54 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 8830 1251 0 0 153 1 0 0 25 0 9 0 492856156 364838912 64718 33554432000 4194304 4417332 140734675118960 18446744073709551615 4277638 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13.98
Current children cumulated vsize (KiB) 356288

[startup+6.30103 s]
/proc/loadavg: 3.53 1.69 1.23 9/179 2816
/proc/meminfo: memFree=19307784/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=428256 CPUtime=39.55 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 174763 1251 0 0 3931 24 0 0 25 0 9 0 492856002 438534144 82600 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 107064 82600 181 55 0 104950 0
[pid=2801/tid=2809] ppid=2799 vsize=428256 CPUtime=4.75 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 18839 1251 0 0 473 2 0 0 25 0 9 0 492856155 438534144 82600 33554432000 4194304 4417332 140734675118960 18446744073709551615 4253198 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=428256 CPUtime=4.75 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 17460 1251 0 0 474 1 0 0 25 0 9 0 492856155 438534144 82600 33554432000 4194304 4417332 140734675118960 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=428256 CPUtime=4.75 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 11854 1251 0 0 473 2 0 0 25 0 9 0 492856155 438534144 82600 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236324 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=428256 CPUtime=4.75 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 5268 1251 0 0 475 0 0 0 25 0 9 0 492856156 438534144 82600 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236772 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=428256 CPUtime=4.75 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 9853 1251 0 0 474 1 0 0 25 0 9 0 492856156 438534144 82600 33554432000 4194304 4417332 140734675118960 18446744073709551615 4253198 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=428256 CPUtime=4.72 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 20709 1251 0 0 469 3 0 0 25 0 9 0 492856156 438534144 82600 33554432000 4194304 4417332 140734675118960 18446744073709551615 4273667 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=428256 CPUtime=4.72 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 19397 1251 0 0 470 2 0 0 25 0 9 0 492856156 438534144 82600 33554432000 4194304 4417332 140734675118960 18446744073709551615 4378090 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=428256 CPUtime=4.75 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 13160 1251 0 0 473 2 0 0 25 0 9 0 492856156 438534144 82600 33554432000 4194304 4417332 140734675118960 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39.55
Current children cumulated vsize (KiB) 428256

[startup+12.7009 s]
/proc/loadavg: 3.89 1.80 1.27 9/179 2816
/proc/meminfo: memFree=19233168/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=462852 CPUtime=90.72 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 183810 1251 0 0 9046 26 0 0 25 0 9 0 492856002 473960448 91254 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 115713 91254 181 55 0 113599 0
[pid=2801/tid=2809] ppid=2799 vsize=462852 CPUtime=11.15 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 18840 1251 0 0 1113 2 0 0 25 0 9 0 492856155 473960448 91254 33554432000 4194304 4417332 140734675118960 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=462852 CPUtime=11.15 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 17460 1251 0 0 1114 1 0 0 25 0 9 0 492856155 473960448 91254 33554432000 4194304 4417332 140734675118960 18446744073709551615 4250715 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=462852 CPUtime=11.15 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 12110 1251 0 0 1113 2 0 0 25 0 9 0 492856155 473960448 91254 33554432000 4194304 4417332 140734675118960 18446744073709551615 4357874 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=462852 CPUtime=11.15 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 13438 1251 0 0 1113 2 0 0 25 0 9 0 492856156 473960448 91254 33554432000 4194304 4417332 140734675118960 18446744073709551615 4250795 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=462852 CPUtime=11.15 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 9855 1251 0 0 1114 1 0 0 25 0 9 0 492856156 473960448 91254 33554432000 4194304 4417332 140734675118960 18446744073709551615 4356928 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=462852 CPUtime=11.09 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 20967 1251 0 0 1106 3 0 0 25 0 9 0 492856156 473960448 91254 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236812 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=462852 CPUtime=11.12 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 19757 1251 0 0 1110 2 0 0 25 0 9 0 492856156 473960448 91254 33554432000 4194304 4417332 140734675118960 18446744073709551615 4232664 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=462852 CPUtime=11.15 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 13160 1251 0 0 1113 2 0 0 25 0 9 0 492856156 473960448 91254 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 90.72
Current children cumulated vsize (KiB) 462852

[startup+25.5007 s]
/proc/loadavg: 4.80 2.10 1.38 9/179 2817
/proc/meminfo: memFree=19160060/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=593904 CPUtime=193.04 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 208645 1251 0 0 19275 29 0 0 25 0 9 0 492856002 608157696 109829 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 148476 109829 181 55 0 146362 0
[pid=2801/tid=2809] ppid=2799 vsize=593904 CPUtime=23.96 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 20888 1251 0 0 2393 3 0 0 25 0 9 0 492856155 608157696 109829 33554432000 4194304 4417332 140734675118960 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=593904 CPUtime=23.96 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 18408 1251 0 0 2394 2 0 0 25 0 9 0 492856155 608157696 109829 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=593904 CPUtime=23.96 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 15352 1251 0 0 2393 3 0 0 25 0 9 0 492856155 608157696 109829 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236945 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=593904 CPUtime=23.95 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 27048 1251 0 0 2392 3 0 0 25 0 9 0 492856156 608157696 109829 33554432000 4194304 4417332 140734675118960 18446744073709551615 4354588 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=593904 CPUtime=23.95 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 12072 1251 0 0 2394 1 0 0 25 0 9 0 492856156 608157696 109829 33554432000 4194304 4417332 140734675118960 18446744073709551615 4233095 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=593904 CPUtime=23.81 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 22847 1251 0 0 2378 3 0 0 25 0 9 0 492856156 608157696 109829 33554432000 4194304 4417332 140734675118960 18446744073709551615 4232584 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=593904 CPUtime=23.92 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 19822 1251 0 0 2390 2 0 0 25 0 9 0 492856156 608157696 109829 33554432000 4194304 4417332 140734675118960 18446744073709551615 4232605 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=593904 CPUtime=23.95 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 13985 1251 0 0 2393 2 0 0 25 0 9 0 492856156 608157696 109829 33554432000 4194304 4417332 140734675118960 18446744073709551615 4232795 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 193.04
Current children cumulated vsize (KiB) 593904

[startup+51.1012 s]
/proc/loadavg: 5.89 2.57 1.55 9/179 2817
/proc/meminfo: memFree=19030336/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=706952 CPUtime=397.69 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 278709 1251 0 0 39732 37 0 0 25 0 9 0 492856002 723918848 142145 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 176738 142145 181 55 0 174624 0
[pid=2801/tid=2809] ppid=2799 vsize=706952 CPUtime=49.55 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 24755 1251 0 0 4952 3 0 0 25 0 9 0 492856155 723918848 142145 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=706952 CPUtime=49.56 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 34865 1251 0 0 4952 4 0 0 25 0 9 0 492856155 723918848 142145 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=706952 CPUtime=49.55 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 16928 1251 0 0 4952 3 0 0 25 0 9 0 492856155 723918848 142145 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=706952 CPUtime=49.54 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 56683 1251 0 0 4948 6 0 0 25 0 9 0 492856156 723918848 142145 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=706952 CPUtime=49.54 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 15879 1251 0 0 4953 1 0 0 25 0 9 0 492856156 723918848 142145 33554432000 4194304 4417332 140734675118960 18446744073709551615 4232648 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=706952 CPUtime=49.28 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 29737 1251 0 0 4924 4 0 0 25 0 9 0 492856156 723918848 142145 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=706952 CPUtime=49.53 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 20382 1251 0 0 4950 3 0 0 25 0 9 0 492856156 723918848 142145 33554432000 4194304 4417332 140734675118960 18446744073709551615 4357164 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=706952 CPUtime=49.54 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 21257 1251 0 0 4951 3 0 0 25 0 9 0 492856156 723918848 142145 33554432000 4194304 4417332 140734675118960 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 397.69
Current children cumulated vsize (KiB) 706952

[startup+102.306 s]
/proc/loadavg: 7.08 3.41 1.89 9/179 2819

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.04 8.04 7.96 9/179 2969
/proc/meminfo: memFree=11020484/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=8671996 CPUtime=37737.2 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 50230090 1251 0 0 3763838 9886 0 0 25 0 9 0 492856002 8880123904 2140977 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 2167999 2140977 181 55 0 2165885 0
[pid=2801/tid=2809] ppid=2799 vsize=8671996 CPUtime=4713.28 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 5231730 1251 0 0 470361 967 0 0 25 0 9 0 492856155 8880123904 2140977 33554432000 4194304 4417332 140734675118960 18446744073709551615 4262499 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=8671996 CPUtime=4719.11 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 7873629 1251 0 0 470382 1529 0 0 25 0 9 0 492856155 8880123904 2140977 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=8671996 CPUtime=4720.5 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 6208417 1251 0 0 470746 1304 0 0 25 0 9 0 492856155 8880123904 2140977 33554432000 4194304 4417332 140734675118960 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=8671996 CPUtime=4713.15 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 9357390 1251 0 0 469367 1948 0 0 25 0 9 0 492856156 8880123904 2140977 33554432000 4194304 4417332 140734675118960 18446744073709551615 4358022 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=8671996 CPUtime=4720.08 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 5877310 1251 0 0 470777 1231 0 0 25 0 9 0 492856156 8880123904 2140977 33554432000 4194304 4417332 140734675118960 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=8671996 CPUtime=4713.83 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 5455721 1251 0 0 470397 986 0 0 25 0 9 0 492856156 8880123904 2140977 33554432000 4194304 4417332 140734675118960 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=8671996 CPUtime=4715.58 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 4429430 1251 0 0 470763 795 0 0 25 0 9 0 492856156 8880123904 2140977 33554432000 4194304 4417332 140734675118960 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=8671996 CPUtime=4720.12 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 5738240 1251 0 0 470895 1117 0 0 25 0 9 0 492856156 8880123904 2140977 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364811 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37737.2
Current children cumulated vsize (KiB) 8671996

[startup+4782.3 s]
/proc/loadavg: 8.01 8.03 7.96 9/179 2970
/proc/meminfo: memFree=9667300/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=10081112 CPUtime=38216.8 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 50839122 1251 0 0 3811673 10011 0 0 25 0 9 0 492856002 10323058688 2480302 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 2520278 2480302 181 55 0 2518164 0
[pid=2801/tid=2809] ppid=2799 vsize=10081112 CPUtime=4773.26 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 5297014 1251 0 0 476344 982 0 0 25 0 9 0 492856155 10323058688 2480302 33554432000 4194304 4417332 140734675118960 18446744073709551615 4357910 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=10081112 CPUtime=4779.1 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 7964437 1251 0 0 476364 1546 0 0 25 0 9 0 492856155 10323058688 2480302 33554432000 4194304 4417332 140734675118960 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=10081112 CPUtime=4780.5 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 6208481 1251 0 0 476746 1304 0 0 25 0 9 0 492856155 10323058688 2480302 33554432000 4194304 4417332 140734675118960 18446744073709551615 4250832 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=10081112 CPUtime=4773.14 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 9399209 1251 0 0 475357 1957 0 0 25 0 9 0 492856156 10323058688 2480302 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=10081112 CPUtime=4780.08 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 5960246 1251 0 0 476767 1241 0 0 25 0 9 0 492856156 10323058688 2480302 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=10081112 CPUtime=4773.5 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 5673923 1251 0 0 476314 1036 0 0 25 0 9 0 492856156 10323058688 2480302 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=10081112 CPUtime=4775.58 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 4487258 1251 0 0 476753 805 0 0 25 0 9 0 492856156 10323058688 2480302 33554432000 4194304 4417332 140734675118960 18446744073709551615 4320983 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=10081112 CPUtime=4780.11 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 5790331 1251 0 0 476879 1132 0 0 25 0 9 0 492856156 10323058688 2480302 33554432000 4194304 4417332 140734675118960 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38216.8
Current children cumulated vsize (KiB) 10081112

[startup+4842.3 s]
/proc/loadavg: 8.00 8.02 7.96 9/179 2972
/proc/meminfo: memFree=9825672/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=9978408 CPUtime=38696.5 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 51499420 1251 0 0 3859496 10155 0 0 25 0 9 0 492856002 10217889792 2455324 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 2494602 2455324 181 55 0 2492488 0
[pid=2801/tid=2809] ppid=2799 vsize=9978408 CPUtime=4833.26 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 5351577 1251 0 0 482338 988 0 0 25 0 9 0 492856155 10217889792 2455324 33554432000 4194304 4417332 140734675118960 18446744073709551615 4357874 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=9978408 CPUtime=4839.08 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 8055023 1251 0 0 482348 1560 0 0 25 0 9 0 492856155 10217889792 2455324 33554432000 4194304 4417332 140734675118960 18446744073709551615 4250967 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=9978408 CPUtime=4840.49 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 6208481 1251 0 0 482744 1305 0 0 25 0 9 0 492856155 10217889792 2455324 33554432000 4194304 4417332 140734675118960 18446744073709551615 4270110 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=9978408 CPUtime=4833.14 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 9441886 1251 0 0 481350 1964 0 0 25 0 9 0 492856156 10217889792 2455324 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=9978408 CPUtime=4840.09 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 5973918 1251 0 0 482766 1243 0 0 25 0 9 0 492856156 10217889792 2455324 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=9978408 CPUtime=4833.17 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 5862718 1251 0 0 482242 1075 0 0 25 0 9 0 492856156 10217889792 2455324 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=9978408 CPUtime=4835.57 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 4592007 1251 0 0 482723 834 0 0 25 0 9 0 492856156 10217889792 2455324 33554432000 4194304 4417332 140734675118960 18446744073709551615 4351980 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=9978408 CPUtime=4840.11 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 5955587 1251 0 0 482836 1175 0 0 25 0 9 0 492856156 10217889792 2455324 33554432000 4194304 4417332 140734675118960 18446744073709551615 4356771 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38696.5
Current children cumulated vsize (KiB) 9978408

[startup+4902.3 s]
/proc/loadavg: 8.03 8.03 7.97 9/179 2974
/proc/meminfo: memFree=9287692/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=10424708 CPUtime=39176 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 52658579 1251 0 0 3907200 10404 0 0 25 0 9 0 492856002 10674900992 2573919 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 2606177 2573919 181 55 0 2604063 0
[pid=2801/tid=2809] ppid=2799 vsize=10424708 CPUtime=4893.27 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 5401280 1251 0 0 488325 1002 0 0 25 0 9 0 492856155 10674900992 2573919 33554432000 4194304 4417332 140734675118960 18446744073709551615 4356928 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=10424708 CPUtime=4899.08 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 8112584 1251 0 0 488334 1574 0 0 25 0 9 0 492856155 10674900992 2573919 33554432000 4194304 4417332 140734675118960 18446744073709551615 4307420 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=10424708 CPUtime=4900.49 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 6481314 1251 0 0 488683 1366 0 0 25 0 9 0 492856155 10674900992 2573919 33554432000 4194304 4417332 140734675118960 18446744073709551615 4234678 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=10424708 CPUtime=4893.1 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 9697733 1251 0 0 487289 2021 0 0 25 0 9 0 492856156 10674900992 2573919 33554432000 4194304 4417332 140734675118960 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=10424708 CPUtime=4900.05 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 6095807 1251 0 0 488743 1262 0 0 25 0 9 0 492856156 10674900992 2573919 33554432000 4194304 4417332 140734675118960 18446744073709551615 4302950 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=10424708 CPUtime=4892.84 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 6066385 1251 0 0 488175 1109 0 0 25 0 9 0 492856156 10674900992 2573919 33554432000 4194304 4417332 140734675118960 18446744073709551615 4275606 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=10424708 CPUtime=4895.5 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 4761197 1251 0 0 488674 876 0 0 25 0 9 0 492856156 10674900992 2573919 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236644 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=10424708 CPUtime=4900.11 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 5984056 1251 0 0 488828 1183 0 0 25 0 9 0 492856156 10674900992 2573919 33554432000 4194304 4417332 140734675118960 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39176
Current children cumulated vsize (KiB) 10424708

[startup+4962.3 s]
/proc/loadavg: 8.01 8.02 7.97 9/179 2975
/proc/meminfo: memFree=10759512/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=8981068 CPUtime=39655.7 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 53737969 1251 0 0 3954936 10632 0 0 25 0 9 0 492856002 9196613632 2205988 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 2245267 2205988 181 55 0 2243153 0
[pid=2801/tid=2809] ppid=2799 vsize=8981068 CPUtime=4953.26 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 5423041 1251 0 0 494321 1005 0 0 25 0 9 0 492856155 9196613632 2205988 33554432000 4194304 4417332 140734675118960 18446744073709551615 4237202 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=8981068 CPUtime=4959.06 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 8270421 1251 0 0 494298 1608 0 0 25 0 9 0 492856155 9196613632 2205988 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=8981068 CPUtime=4960.48 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 6753300 1251 0 0 494621 1427 0 0 25 0 9 0 492856155 9196613632 2205988 33554432000 4194304 4417332 140734675118960 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=8981068 CPUtime=4953.1 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 9697733 1251 0 0 493289 2021 0 0 25 0 9 0 492856156 9196613632 2205988 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=8981068 CPUtime=4960.05 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 6453799 1251 0 0 494672 1333 0 0 25 0 9 0 492856156 9196613632 2205988 33554432000 4194304 4417332 140734675118960 18446744073709551615 4357798 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=8981068 CPUtime=4952.51 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 6191151 1251 0 0 494113 1138 0 0 25 0 9 0 492856156 9196613632 2205988 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=8981068 CPUtime=4955.51 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 4850228 1251 0 0 494657 894 0 0 25 0 9 0 492856156 9196613632 2205988 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=8981068 CPUtime=4960.11 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 6040073 1251 0 0 494816 1195 0 0 25 0 9 0 492856156 9196613632 2205988 33554432000 4194304 4417332 140734675118960 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39655.7
Current children cumulated vsize (KiB) 8981068



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5005.4 s]
/proc/loadavg: 8.00 8.02 7.97 9/179 2976
/proc/meminfo: memFree=9686668/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=10052216 CPUtime=40000.2 cores=0-7
/proc/2801/stat : 2801 (plingeling) S 2799 2801 2685 0 -1 4202496 54172482 1251 0 0 3989313 10712 0 0 25 0 9 0 492856002 10293469184 2473775 33554432000 4194304 4417332 140734675118960 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 2513054 2473775 181 55 0 2510940 0
[pid=2801/tid=2809] ppid=2799 vsize=10052216 CPUtime=4996.36 cores=0-7
/proc/2801/task/2809/stat : 2809 (plingeling) R 2799 2801 2685 0 -1 4202560 5472195 1251 0 0 498625 1011 0 0 25 0 9 0 492856155 10293469184 2473775 33554432000 4194304 4417332 140734675118960 18446744073709551615 4356896 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=2801/tid=2810] ppid=2799 vsize=10052216 CPUtime=5002.15 cores=0-7
/proc/2801/task/2810/stat : 2810 (plingeling) R 2799 2801 2685 0 -1 4202560 8316018 1251 0 0 498599 1616 0 0 25 0 9 0 492856155 10293469184 2473775 33554432000 4194304 4417332 140734675118960 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2801/tid=2811] ppid=2799 vsize=10052216 CPUtime=5003.59 cores=0-7
/proc/2801/task/2811/stat : 2811 (plingeling) R 2799 2801 2685 0 -1 4202560 6766730 1251 0 0 498930 1429 0 0 25 0 9 0 492856155 10293469184 2473775 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2801/tid=2812] ppid=2799 vsize=10052216 CPUtime=4996.21 cores=0-7
/proc/2801/task/2812/stat : 2812 (plingeling) R 2799 2801 2685 0 -1 4202560 9697733 1251 0 0 497600 2021 0 0 25 0 9 0 492856156 10293469184 2473775 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=2801/tid=2813] ppid=2799 vsize=10052216 CPUtime=5003.15 cores=0-7
/proc/2801/task/2813/stat : 2813 (plingeling) R 2799 2801 2685 0 -1 4202560 6606440 1251 0 0 498948 1367 0 0 25 0 9 0 492856156 10293469184 2473775 33554432000 4194304 4417332 140734675118960 18446744073709551615 4320975 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=10052216 CPUtime=4995.38 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4202560 6221605 1251 0 0 498396 1142 0 0 25 0 9 0 492856156 10293469184 2473775 33554432000 4194304 4417332 140734675118960 18446744073709551615 4232787 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=2801/tid=2815] ppid=2799 vsize=10052216 CPUtime=4998.6 cores=0-7
/proc/2801/task/2815/stat : 2815 (plingeling) R 2799 2801 2685 0 -1 4202560 4916142 1251 0 0 498953 907 0 0 25 0 9 0 492856156 10293469184 2473775 33554432000 4194304 4417332 140734675118960 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=2801/tid=2816] ppid=2799 vsize=10052216 CPUtime=5003.22 cores=0-7
/proc/2801/task/2816/stat : 2816 (plingeling) R 2799 2801 2685 0 -1 4202560 6117396 1251 0 0 499114 1208 0 0 25 0 9 0 492856156 10293469184 2473775 33554432000 4194304 4417332 140734675118960 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 10052216

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5005.8 s]
/proc/loadavg: 8.00 8.02 7.97 9/179 2976
/proc/meminfo: memFree=9686668/32951124 swapFree=67111524/67111528
[pid=2801] ppid=2799 vsize=0 CPUtime=40000.7 cores=0-7
/proc/2801/stat : 2801 (plingeling) Z 2799 2801 2685 0 -1 4203548 54172482 1251 0 0 3989319 10751 0 0 18 0 2 0 492856002 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/2801/statm: 0 0 0 0 0 0 0
[pid=2801/tid=2814] ppid=2799 vsize=0 CPUtime=4995.77 cores=0-7
/proc/2801/task/2814/stat : 2814 (plingeling) R 2799 2801 2685 0 -1 4203588 6221605 1251 0 0 498396 1181 0 0 25 0 2 0 492856156 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5005.81
CPU time (s): 40000.7
CPU user time (s): 39893.2
CPU system time (s): 107.526
CPU usage (%): 799.085
Max. virtual memory (cumulated for all children) (KiB): 13636612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39893.2
system time used= 107.526
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 54173733
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2001
involuntary context switches= 187810

runsolver used 7.8648 second user time and 19.0961 second system time

The end

Launcher Data 

Begin job on node144 at 2011-04-28 17:26:39
IDJOB=3309537
IDBENCH=82369
IDSOLVER=1695
FILE ID=node144/3309537-1304004398
RUNJOBID= node144-1304004361-2699
PBS_JOBID= 13168818
Free space on /tmp= 72396 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309537-1304004398/watcher-3309537-1304004398 -o /tmp/evaluation-result-3309537-1304004398/solver-3309537-1304004398 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309537-1304004398.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 0385ba51f44fb47d0b0726e26312816f
RANDOM SEED=1119317026

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19597208 kB
Buffers:       2201516 kB
Cached:       10523784 kB
SwapCached:          4 kB
Active:        4551040 kB
Inactive:      8237512 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19597208 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           15632 kB
Writeback:           0 kB
AnonPages:       62556 kB
Mapped:          14532 kB
Slab:           499660 kB
PageTables:       4304 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   183568 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72396 MiB
End job on node144 at 2011-04-28 18:50:06