Trace number 3372416

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40001 5007.31

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
MD5SUM0385ba51f44fb47d0b0726e26312816f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables171676
Number of clauses858766
Sum of the clauses size2046721
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2847665
Number of clauses of size 32700
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58190

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372416-1305437464/watcher-3372416-1305437464 -o /tmp/evaluation-result-3372416-1305437464/solver-3372416-1305437464 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372416-1305437464.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.07 1.76 2.54 2/243 22335
/proc/meminfo: memFree=21078944/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=11824 CPUtime=0 cores=0-7
/proc/22335/stat : 22335 (plingeling) R 22333 22335 22268 0 -1 4202496 1038 1250 0 0 0 0 0 0 21 0 1 0 655344366 12107776 967 33554432000 4194304 4417452 140733741114560 18446744073709551615 271550537472 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/22335/statm: 2956 967 144 55 0 842 0

[startup+0.0882151 s]
/proc/loadavg: 3.07 1.76 2.54 2/243 22335
/proc/meminfo: memFree=21078944/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=23100 CPUtime=0.07 cores=0-7
/proc/22335/stat : 22335 (plingeling) R 22333 22335 22268 0 -1 4202496 3870 1250 0 0 7 0 0 0 21 0 1 0 655344366 23654400 3799 33554432000 4194304 4417452 140733741114560 18446744073709551615 4262159 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/22335/statm: 5775 3799 149 55 0 3661 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 23100

[startup+0.10023 s]
/proc/loadavg: 3.07 1.76 2.54 2/243 22335
/proc/meminfo: memFree=21078944/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=26952 CPUtime=0.08 cores=0-7
/proc/22335/stat : 22335 (plingeling) R 22333 22335 22268 0 -1 4202496 4819 1250 0 0 8 0 0 0 21 0 1 0 655344366 27598848 4749 33554432000 4194304 4417452 140733741114560 18446744073709551615 271550231533 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/22335/statm: 6803 4768 149 55 0 4689 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 26952

[startup+0.300174 s]
/proc/loadavg: 3.07 1.76 2.54 2/243 22335
/proc/meminfo: memFree=21078944/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=63384 CPUtime=0.29 cores=0-7
/proc/22335/stat : 22335 (plingeling) R 22333 22335 22268 0 -1 4202496 13941 1250 0 0 28 1 0 0 22 0 1 0 655344366 64905216 13870 33554432000 4194304 4417452 140733741114560 18446744073709551615 4260137 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/22335/statm: 15846 13870 149 55 0 13732 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 63384

[startup+0.701101 s]
/proc/loadavg: 3.07 1.76 2.54 2/243 22335
/proc/meminfo: memFree=21078944/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=129016 CPUtime=0.69 cores=0-7
/proc/22335/stat : 22335 (plingeling) R 22333 22335 22268 0 -1 4202496 30365 1250 0 0 66 3 0 0 23 0 1 0 655344366 132112384 30278 33554432000 4194304 4417452 140733741114560 18446744073709551615 4262065 0 0 4096 17442 0 0 0 17 6 0 0 0
/proc/22335/statm: 32254 30278 149 55 0 30140 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 129016

[startup+1.50097 s]
/proc/loadavg: 3.07 1.76 2.54 2/244 22341
/proc/meminfo: memFree=20954856/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=291188 CPUtime=1.49 cores=0-7
/proc/22335/stat : 22335 (plingeling) D 22333 22335 22268 0 -1 4202496 58230 1250 0 0 142 7 0 0 25 0 7 0 655344366 298176512 52913 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562337222 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22335/statm: 72797 52913 156 55 0 70683 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 291188

[startup+3.10064 s]
/proc/loadavg: 3.07 1.76 2.54 10/252 22349
/proc/meminfo: memFree=20824964/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=366516 CPUtime=14.12 cores=0-7
/proc/22335/stat : 22335 (plingeling) S 22333 22335 22268 0 -1 4202496 113989 1250 0 0 1397 15 0 0 25 0 9 0 655344366 375312384 62399 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 91629 62399 176 55 0 89515 0
[pid=22335/tid=22342] ppid=22333 vsize=366516 CPUtime=1.59 cores=0-7
/proc/22335/task/22342/stat : 22342 (plingeling) R 22333 22335 22268 0 -1 4202560 6720 1250 0 0 159 0 0 0 20 0 9 0 655344516 375312384 62399 33554432000 4194304 4417452 140733741114560 18446744073709551615 4277638 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22335/tid=22343] ppid=22333 vsize=366516 CPUtime=1.58 cores=0-7
/proc/22335/task/22343/stat : 22343 (plingeling) R 22333 22335 22268 0 -1 4202560 5176 1250 0 0 158 0 0 0 20 0 9 0 655344516 375312384 62399 33554432000 4194304 4417452 140733741114560 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22335/tid=22344] ppid=22333 vsize=366516 CPUtime=1.59 cores=0-7
/proc/22335/task/22344/stat : 22344 (plingeling) R 22333 22335 22268 0 -1 4202560 4043 1250 0 0 159 0 0 0 25 0 9 0 655344516 375312384 62399 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236596 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22335/tid=22345] ppid=22333 vsize=366516 CPUtime=1.59 cores=0-7
/proc/22335/task/22345/stat : 22345 (plingeling) R 22333 22335 22268 0 -1 4202560 3429 1250 0 0 159 0 0 0 20 0 9 0 655344516 375312384 62399 33554432000 4194304 4417452 140733741114560 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22335/tid=22346] ppid=22333 vsize=366516 CPUtime=1.54 cores=0-7
/proc/22335/task/22346/stat : 22346 (plingeling) R 22333 22335 22268 0 -1 4202560 12271 1250 0 0 153 1 0 0 25 0 9 0 655344516 375312384 62399 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236634 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22335/tid=22347] ppid=22333 vsize=366516 CPUtime=1.56 cores=0-7
/proc/22335/task/22347/stat : 22347 (plingeling) R 22333 22335 22268 0 -1 4202560 10218 1250 0 0 155 1 0 0 20 0 9 0 655344516 375312384 62399 33554432000 4194304 4417452 140733741114560 18446744073709551615 4281633 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=22335/tid=22348] ppid=22333 vsize=366516 CPUtime=1.56 cores=0-7
/proc/22335/task/22348/stat : 22348 (plingeling) R 22333 22335 22268 0 -1 4202560 7923 1250 0 0 155 1 0 0 25 0 9 0 655344519 375312384 62399 33554432000 4194304 4417452 140733741114560 18446744073709551615 4275953 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=366516 CPUtime=1.54 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 5986 1250 0 0 153 1 0 0 25 0 9 0 655344519 375312384 62399 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236598 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 14.12
Current children cumulated vsize (KiB) 366516

[startup+6.30105 s]
/proc/loadavg: 3.47 1.87 2.57 9/252 22349
/proc/meminfo: memFree=20806000/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=433776 CPUtime=39.68 cores=0-7
/proc/22335/stat : 22335 (plingeling) S 22333 22335 22268 0 -1 4202496 158784 1250 0 0 3946 22 0 0 25 0 9 0 655344366 444186624 81202 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 108444 81202 180 55 0 106330 0
[pid=22335/tid=22342] ppid=22333 vsize=433776 CPUtime=4.79 cores=0-7
/proc/22335/task/22342/stat : 22342 (plingeling) R 22333 22335 22268 0 -1 4202560 13576 1250 0 0 477 2 0 0 25 0 9 0 655344516 444186624 81202 33554432000 4194304 4417452 140733741114560 18446744073709551615 4252041 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22335/tid=22343] ppid=22333 vsize=433776 CPUtime=4.79 cores=0-7
/proc/22335/task/22343/stat : 22343 (plingeling) R 22333 22335 22268 0 -1 4202560 11081 1250 0 0 478 1 0 0 25 0 9 0 655344516 444186624 81202 33554432000 4194304 4417452 140733741114560 18446744073709551615 4258201 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22335/tid=22344] ppid=22333 vsize=433776 CPUtime=4.79 cores=0-7
/proc/22335/task/22344/stat : 22344 (plingeling) R 22333 22335 22268 0 -1 4202560 12318 1250 0 0 478 1 0 0 25 0 9 0 655344516 444186624 81202 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236008 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22335/tid=22345] ppid=22333 vsize=433776 CPUtime=4.79 cores=0-7
/proc/22335/task/22345/stat : 22345 (plingeling) R 22333 22335 22268 0 -1 4202560 4496 1250 0 0 479 0 0 0 25 0 9 0 655344516 444186624 81202 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22335/tid=22346] ppid=22333 vsize=433776 CPUtime=4.73 cores=0-7
/proc/22335/task/22346/stat : 22346 (plingeling) R 22333 22335 22268 0 -1 4202560 15869 1250 0 0 471 2 0 0 25 0 9 0 655344516 444186624 81202 33554432000 4194304 4417452 140733741114560 18446744073709551615 4253176 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22335/tid=22347] ppid=22333 vsize=433776 CPUtime=4.76 cores=0-7
/proc/22335/task/22347/stat : 22347 (plingeling) R 22333 22335 22268 0 -1 4202560 16668 1250 0 0 474 2 0 0 25 0 9 0 655344516 444186624 81202 33554432000 4194304 4417452 140733741114560 18446744073709551615 4235378 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=22335/tid=22348] ppid=22333 vsize=433776 CPUtime=4.75 cores=0-7
/proc/22335/task/22348/stat : 22348 (plingeling) R 22333 22335 22268 0 -1 4202560 12572 1250 0 0 474 1 0 0 25 0 9 0 655344519 444186624 81202 33554432000 4194304 4417452 140733741114560 18446744073709551615 4377445 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=433776 CPUtime=4.73 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 13981 1250 0 0 471 2 0 0 25 0 9 0 655344519 444186624 81202 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236508 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39.68
Current children cumulated vsize (KiB) 433776

[startup+12.7009 s]
/proc/loadavg: 3.83 1.97 2.60 9/252 22349
/proc/meminfo: memFree=20747264/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=463392 CPUtime=90.84 cores=0-7
/proc/22335/stat : 22335 (plingeling) S 22333 22335 22268 0 -1 4202496 168392 1250 0 0 9060 24 0 0 25 0 9 0 655344366 474513408 88613 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 115848 88613 180 55 0 113734 0
[pid=22335/tid=22342] ppid=22333 vsize=463392 CPUtime=11.19 cores=0-7
/proc/22335/task/22342/stat : 22342 (plingeling) R 22333 22335 22268 0 -1 4202560 13823 1250 0 0 1117 2 0 0 25 0 9 0 655344516 474513408 88613 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22335/tid=22343] ppid=22333 vsize=463392 CPUtime=11.19 cores=0-7
/proc/22335/task/22343/stat : 22343 (plingeling) R 22333 22335 22268 0 -1 4202560 11081 1250 0 0 1118 1 0 0 25 0 9 0 655344516 474513408 88613 33554432000 4194304 4417452 140733741114560 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22335/tid=22344] ppid=22333 vsize=463392 CPUtime=11.19 cores=0-7
/proc/22335/task/22344/stat : 22344 (plingeling) R 22333 22335 22268 0 -1 4202560 13382 1250 0 0 1117 2 0 0 25 0 9 0 655344516 474513408 88613 33554432000 4194304 4417452 140733741114560 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22335/tid=22345] ppid=22333 vsize=463392 CPUtime=11.19 cores=0-7
/proc/22335/task/22345/stat : 22345 (plingeling) R 22333 22335 22268 0 -1 4202560 10555 1250 0 0 1118 1 0 0 25 0 9 0 655344516 474513408 88613 33554432000 4194304 4417452 140733741114560 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22335/tid=22346] ppid=22333 vsize=463392 CPUtime=11.07 cores=0-7
/proc/22335/task/22346/stat : 22346 (plingeling) R 22333 22335 22268 0 -1 4202560 15871 1250 0 0 1105 2 0 0 25 0 9 0 655344516 474513408 88613 33554432000 4194304 4417452 140733741114560 18446744073709551615 4232680 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22335/tid=22347] ppid=22333 vsize=463392 CPUtime=11.16 cores=0-7
/proc/22335/task/22347/stat : 22347 (plingeling) R 22333 22335 22268 0 -1 4202560 17623 1250 0 0 1114 2 0 0 25 0 9 0 655344516 474513408 88613 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236764 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=22335/tid=22348] ppid=22333 vsize=463392 CPUtime=11.16 cores=0-7
/proc/22335/task/22348/stat : 22348 (plingeling) R 22333 22335 22268 0 -1 4202560 12828 1250 0 0 1114 2 0 0 25 0 9 0 655344519 474513408 88613 33554432000 4194304 4417452 140733741114560 18446744073709551615 4250569 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=463392 CPUtime=11.13 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 15006 1250 0 0 1110 3 0 0 25 0 9 0 655344519 474513408 88613 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 90.84
Current children cumulated vsize (KiB) 463392

[startup+25.5006 s]
/proc/loadavg: 4.75 2.26 2.68 9/252 22350
/proc/meminfo: memFree=20594204/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=579296 CPUtime=193.12 cores=0-7
/proc/22335/stat : 22335 (plingeling) S 22333 22335 22268 0 -1 4202496 208019 1250 0 0 19283 29 0 0 25 0 9 0 655344366 593199104 121441 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 144824 121441 180 55 0 142710 0
[pid=22335/tid=22342] ppid=22333 vsize=579296 CPUtime=23.99 cores=0-7
/proc/22335/task/22342/stat : 22342 (plingeling) R 22333 22335 22268 0 -1 4202560 14847 1250 0 0 2397 2 0 0 25 0 9 0 655344516 593199104 121441 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22335/tid=22343] ppid=22333 vsize=579296 CPUtime=23.99 cores=0-7
/proc/22335/task/22343/stat : 22343 (plingeling) R 22333 22335 22268 0 -1 4202560 13847 1250 0 0 2397 2 0 0 25 0 9 0 655344516 593199104 121441 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22335/tid=22344] ppid=22333 vsize=579296 CPUtime=23.99 cores=0-7
/proc/22335/task/22344/stat : 22344 (plingeling) R 22333 22335 22268 0 -1 4202560 14896 1250 0 0 2397 2 0 0 25 0 9 0 655344516 593199104 121441 33554432000 4194304 4417452 140733741114560 18446744073709551615 4357970 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22335/tid=22345] ppid=22333 vsize=579296 CPUtime=23.99 cores=0-7
/proc/22335/task/22345/stat : 22345 (plingeling) R 22333 22335 22268 0 -1 4202560 37701 1250 0 0 2395 4 0 0 25 0 9 0 655344516 593199104 121441 33554432000 4194304 4417452 140733741114560 18446744073709551615 4365204 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22335/tid=22346] ppid=22333 vsize=579296 CPUtime=23.76 cores=0-7
/proc/22335/task/22346/stat : 22346 (plingeling) R 22333 22335 22268 0 -1 4202560 19278 1250 0 0 2374 2 0 0 25 0 9 0 655344516 593199104 121441 33554432000 4194304 4417452 140733741114560 18446744073709551615 4357283 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22335/tid=22347] ppid=22333 vsize=579296 CPUtime=23.96 cores=0-7
/proc/22335/task/22347/stat : 22347 (plingeling) R 22333 22335 22268 0 -1 4202560 17623 1250 0 0 2394 2 0 0 25 0 9 0 655344516 593199104 121441 33554432000 4194304 4417452 140733741114560 18446744073709551615 4365150 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=22335/tid=22348] ppid=22333 vsize=579296 CPUtime=23.95 cores=0-7
/proc/22335/task/22348/stat : 22348 (plingeling) R 22333 22335 22268 0 -1 4202560 16598 1250 0 0 2393 2 0 0 25 0 9 0 655344519 593199104 121441 33554432000 4194304 4417452 140733741114560 18446744073709551615 4354448 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=579296 CPUtime=23.93 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 15006 1250 0 0 2390 3 0 0 25 0 9 0 655344519 593199104 121441 33554432000 4194304 4417452 140733741114560 18446744073709551615 4358082 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 193.12
Current children cumulated vsize (KiB) 579296

[startup+51.1009 s]
/proc/loadavg: 5.93 2.74 2.83 9/252 22350
/proc/meminfo: memFree=20424292/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=737972 CPUtime=397.71 cores=0-7
/proc/22335/stat : 22335 (plingeling) S 22333 22335 22268 0 -1 4202496 296348 1250 0 0 39729 42 0 0 25 0 9 0 655344366 755683328 159730 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 184493 159730 180 55 0 182379 0
[pid=22335/tid=22342] ppid=22333 vsize=737972 CPUtime=49.58 cores=0-7
/proc/22335/task/22342/stat : 22342 (plingeling) R 22333 22335 22268 0 -1 4202560 18210 1250 0 0 4956 2 0 0 25 0 9 0 655344516 755683328 159730 33554432000 4194304 4417452 140733741114560 18446744073709551615 4264976 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22335/tid=22343] ppid=22333 vsize=737972 CPUtime=49.58 cores=0-7
/proc/22335/task/22343/stat : 22343 (plingeling) R 22333 22335 22268 0 -1 4202560 27134 1250 0 0 4954 4 0 0 25 0 9 0 655344516 755683328 159730 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22335/tid=22344] ppid=22333 vsize=737972 CPUtime=49.59 cores=0-7
/proc/22335/task/22344/stat : 22344 (plingeling) R 22333 22335 22268 0 -1 4202560 14896 1250 0 0 4957 2 0 0 25 0 9 0 655344516 755683328 159730 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22335/tid=22345] ppid=22333 vsize=737972 CPUtime=49.59 cores=0-7
/proc/22335/task/22345/stat : 22345 (plingeling) R 22333 22335 22268 0 -1 4202560 75641 1250 0 0 4949 10 0 0 25 0 9 0 655344516 755683328 159730 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22335/tid=22346] ppid=22333 vsize=737972 CPUtime=49.16 cores=0-7
/proc/22335/task/22346/stat : 22346 (plingeling) R 22333 22335 22268 0 -1 4202560 32630 1250 0 0 4912 4 0 0 25 0 9 0 655344516 755683328 159730 33554432000 4194304 4417452 140733741114560 18446744073709551615 4356960 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22335/tid=22347] ppid=22333 vsize=737972 CPUtime=49.56 cores=0-7
/proc/22335/task/22347/stat : 22347 (plingeling) R 22333 22335 22268 0 -1 4202560 27306 1250 0 0 4953 3 0 0 25 0 9 0 655344516 755683328 159730 33554432000 4194304 4417452 140733741114560 18446744073709551615 4355830 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=22335/tid=22348] ppid=22333 vsize=737972 CPUtime=49.55 cores=0-7
/proc/22335/task/22348/stat : 22348 (plingeling) R 22333 22335 22268 0 -1 4202560 19345 1250 0 0 4953 2 0 0 25 0 9 0 655344519 755683328 159730 33554432000 4194304 4417452 140733741114560 18446744073709551615 4356867 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=737972 CPUtime=49.53 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 22963 1250 0 0 4949 4 0 0 25 0 9 0 655344519 755683328 159730 33554432000 4194304 4417452 140733741114560 18446744073709551615 4233095 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 397.71
Current children cumulated vsize (KiB) 737972

[startup+102.31 s]
/proc/loadavg: 7.20 3.58 3.11 9/252 22352

################
# More data... #
################

/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 5318679 1250 0 0 470950 1014 0 0 25 0 9 0 655344519 15776555008 3828856 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37726.4
Current children cumulated vsize (KiB) 15406792

[startup+4782.3 s]
/proc/loadavg: 8.11 8.12 8.05 10/252 22489
/proc/meminfo: memFree=5573620/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=15116908 CPUtime=38205.7 cores=0-7
/proc/22335/stat : 22335 (plingeling) S 22333 22335 22268 0 -1 4202496 47723627 1250 0 0 3811417 9151 0 0 25 0 9 0 655344366 15479713792 3756385 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 3779227 3756385 180 55 0 3777113 0
[pid=22335/tid=22342] ppid=22333 vsize=15116908 CPUtime=4779.99 cores=0-7
/proc/22335/task/22342/stat : 22342 (plingeling) R 22333 22335 22268 0 -1 4202560 5031068 1250 0 0 477055 944 0 0 25 0 9 0 655344516 15479713792 3756385 33554432000 4194304 4417452 140733741114560 18446744073709551615 4357339 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22335/tid=22343] ppid=22333 vsize=15116908 CPUtime=4779.4 cores=0-7
/proc/22335/task/22343/stat : 22343 (plingeling) R 22333 22335 22268 0 -1 4202560 7031989 1250 0 0 476710 1230 0 0 25 0 9 0 655344516 15479713792 3756385 33554432000 4194304 4417452 140733741114560 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22335/tid=22344] ppid=22333 vsize=15116908 CPUtime=4779.64 cores=0-7
/proc/22335/task/22344/stat : 22344 (plingeling) R 22333 22335 22268 0 -1 4202560 5115280 1250 0 0 476998 966 0 0 25 0 9 0 655344516 15479713792 3756385 33554432000 4194304 4417452 140733741114560 18446744073709551615 4354483 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22335/tid=22345] ppid=22333 vsize=15116908 CPUtime=4776.92 cores=0-7
/proc/22335/task/22345/stat : 22345 (plingeling) R 22333 22335 22268 0 -1 4202560 8890299 1250 0 0 475701 1991 0 0 25 0 9 0 655344516 15479713792 3756385 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=22335/tid=22346] ppid=22333 vsize=15116908 CPUtime=4757.49 cores=0-7
/proc/22335/task/22346/stat : 22346 (plingeling) R 22333 22335 22268 0 -1 4202560 6317120 1250 0 0 474566 1183 0 0 25 0 9 0 655344516 15479713792 3756385 33554432000 4194304 4417452 140733741114560 18446744073709551615 4357894 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22335/tid=22347] ppid=22333 vsize=15116908 CPUtime=4774.69 cores=0-7
/proc/22335/task/22347/stat : 22347 (plingeling) R 22333 22335 22268 0 -1 4202560 5558173 1250 0 0 476479 990 0 0 25 0 9 0 655344516 15479713792 3756385 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22335/tid=22348] ppid=22333 vsize=15116908 CPUtime=4776.8 cores=0-7
/proc/22335/task/22348/stat : 22348 (plingeling) R 22333 22335 22268 0 -1 4202560 4225239 1250 0 0 476894 786 0 0 25 0 9 0 655344519 15479713792 3756385 33554432000 4194304 4417452 140733741114560 18446744073709551615 4357907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=15116908 CPUtime=4779.17 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 5496236 1250 0 0 476867 1050 0 0 25 0 9 0 655344519 15479713792 3756385 33554432000 4194304 4417452 140733741114560 18446744073709551615 4244345 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38205.7
Current children cumulated vsize (KiB) 15116908

[startup+4842.3 s]
/proc/loadavg: 8.14 8.12 8.06 9/252 22490
/proc/meminfo: memFree=4889604/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=16250976 CPUtime=38685.2 cores=0-7
/proc/22335/stat : 22335 (plingeling) S 22333 22335 22268 0 -1 4202496 48637249 1250 0 0 3859186 9335 0 0 25 0 9 0 655344366 16640999424 4039902 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 4062744 4039902 180 55 0 4060630 0
[pid=22335/tid=22342] ppid=22333 vsize=16250976 CPUtime=4839.99 cores=0-7
/proc/22335/task/22342/stat : 22342 (plingeling) R 22333 22335 22268 0 -1 4202560 5086500 1250 0 0 483046 953 0 0 25 0 9 0 655344516 16640999424 4039902 33554432000 4194304 4417452 140733741114560 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22335/tid=22343] ppid=22333 vsize=16250976 CPUtime=4839.4 cores=0-7
/proc/22335/task/22343/stat : 22343 (plingeling) R 22333 22335 22268 0 -1 4202560 7252865 1250 0 0 482657 1283 0 0 25 0 9 0 655344516 16640999424 4039902 33554432000 4194304 4417452 140733741114560 18446744073709551615 4366074 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22335/tid=22344] ppid=22333 vsize=16250976 CPUtime=4839.64 cores=0-7
/proc/22335/task/22344/stat : 22344 (plingeling) R 22333 22335 22268 0 -1 4202560 5291658 1250 0 0 482962 1002 0 0 25 0 9 0 655344516 16640999424 4039902 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22335/tid=22345] ppid=22333 vsize=16250976 CPUtime=4836.92 cores=0-7
/proc/22335/task/22345/stat : 22345 (plingeling) R 22333 22335 22268 0 -1 4202560 9021371 1250 0 0 481664 2028 0 0 25 0 9 0 655344516 16640999424 4039902 33554432000 4194304 4417452 140733741114560 18446744073709551615 4357204 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=22335/tid=22346] ppid=22333 vsize=16250976 CPUtime=4817.48 cores=0-7
/proc/22335/task/22346/stat : 22346 (plingeling) R 22333 22335 22268 0 -1 4202560 6410472 1250 0 0 480550 1198 0 0 25 0 9 0 655344516 16640999424 4039902 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22335/tid=22347] ppid=22333 vsize=16250976 CPUtime=4834.69 cores=0-7
/proc/22335/task/22347/stat : 22347 (plingeling) R 22333 22335 22268 0 -1 4202560 5662832 1250 0 0 482462 1007 0 0 25 0 9 0 655344516 16640999424 4039902 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22335/tid=22348] ppid=22333 vsize=16250976 CPUtime=4836.8 cores=0-7
/proc/22335/task/22348/stat : 22348 (plingeling) R 22333 22335 22268 0 -1 4202560 4308116 1250 0 0 482885 795 0 0 25 0 9 0 655344519 16640999424 4039902 33554432000 4194304 4417452 140733741114560 18446744073709551615 4250715 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=16250976 CPUtime=4838.72 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 5545212 1250 0 0 482813 1059 0 0 25 0 9 0 655344519 16640999424 4039902 33554432000 4194304 4417452 140733741114560 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38685.2
Current children cumulated vsize (KiB) 16250976

[startup+4902.3 s]
/proc/loadavg: 8.20 8.14 8.07 9/252 22492
/proc/meminfo: memFree=12002912/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=8610632 CPUtime=39164.5 cores=0-7
/proc/22335/stat : 22335 (plingeling) S 22333 22335 22268 0 -1 4202496 49556121 1250 0 0 3906935 9515 0 0 25 0 9 0 655344366 8817287168 2129816 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 2152658 2129816 180 55 0 2150544 0
[pid=22335/tid=22342] ppid=22333 vsize=8610632 CPUtime=4899.99 cores=0-7
/proc/22335/task/22342/stat : 22342 (plingeling) R 22333 22335 22268 0 -1 4202560 5142059 1250 0 0 489037 962 0 0 25 0 9 0 655344516 8817287168 2129816 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=22335/tid=22343] ppid=22333 vsize=8610632 CPUtime=4899.3 cores=0-7
/proc/22335/task/22343/stat : 22343 (plingeling) R 22333 22335 22268 0 -1 4202560 7351935 1250 0 0 488628 1302 0 0 25 0 9 0 655344516 8817287168 2129816 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22335/tid=22344] ppid=22333 vsize=8610632 CPUtime=4899.64 cores=0-7
/proc/22335/task/22344/stat : 22344 (plingeling) R 22333 22335 22268 0 -1 4202560 5291658 1250 0 0 488962 1002 0 0 25 0 9 0 655344516 8817287168 2129816 33554432000 4194304 4417452 140733741114560 18446744073709551615 4356916 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22335/tid=22345] ppid=22333 vsize=8610632 CPUtime=4896.89 cores=0-7
/proc/22335/task/22345/stat : 22345 (plingeling) R 22333 22335 22268 0 -1 4202560 9391832 1250 0 0 487582 2107 0 0 25 0 9 0 655344516 8817287168 2129816 33554432000 4194304 4417452 140733741114560 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22335/tid=22346] ppid=22333 vsize=8610632 CPUtime=4877.48 cores=0-7
/proc/22335/task/22346/stat : 22346 (plingeling) R 22333 22335 22268 0 -1 4202560 6475155 1250 0 0 486536 1212 0 0 25 0 9 0 655344516 8817287168 2129816 33554432000 4194304 4417452 140733741114560 18446744073709551615 4353636 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22335/tid=22347] ppid=22333 vsize=8610632 CPUtime=4894.64 cores=0-7
/proc/22335/task/22347/stat : 22347 (plingeling) R 22333 22335 22268 0 -1 4202560 5760306 1250 0 0 488438 1026 0 0 25 0 9 0 655344516 8817287168 2129816 33554432000 4194304 4417452 140733741114560 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22335/tid=22348] ppid=22333 vsize=8610632 CPUtime=4896.8 cores=0-7
/proc/22335/task/22348/stat : 22348 (plingeling) R 22333 22335 22268 0 -1 4202560 4372075 1250 0 0 488874 806 0 0 25 0 9 0 655344519 8817287168 2129816 33554432000 4194304 4417452 140733741114560 18446744073709551615 4356995 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=8610632 CPUtime=4898.2 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 5712878 1250 0 0 488732 1088 0 0 25 0 9 0 655344519 8817287168 2129816 33554432000 4194304 4417452 140733741114560 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39164.5
Current children cumulated vsize (KiB) 8610632

[startup+4962.3 s]
/proc/loadavg: 8.12 8.13 8.07 9/252 22493
/proc/meminfo: memFree=11324764/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=9888352 CPUtime=39644 cores=0-7
/proc/22335/stat : 22335 (plingeling) S 22333 22335 22268 0 -1 4202496 50203169 1250 0 0 3954775 9628 0 0 25 0 9 0 655344366 10125672448 2449246 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 2472088 2449246 180 55 0 2469974 0
[pid=22335/tid=22342] ppid=22333 vsize=9888352 CPUtime=4959.97 cores=0-7
/proc/22335/task/22342/stat : 22342 (plingeling) R 22333 22335 22268 0 -1 4202560 5236531 1250 0 0 495015 982 0 0 25 0 9 0 655344516 10125672448 2449246 33554432000 4194304 4417452 140733741114560 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=22335/tid=22343] ppid=22333 vsize=9888352 CPUtime=4959.29 cores=0-7
/proc/22335/task/22343/stat : 22343 (plingeling) R 22333 22335 22268 0 -1 4202560 7438509 1250 0 0 494609 1320 0 0 25 0 9 0 655344516 10125672448 2449246 33554432000 4194304 4417452 140733741114560 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22335/tid=22344] ppid=22333 vsize=9888352 CPUtime=4959.64 cores=0-7
/proc/22335/task/22344/stat : 22344 (plingeling) R 22333 22335 22268 0 -1 4202560 5291658 1250 0 0 494962 1002 0 0 25 0 9 0 655344516 10125672448 2449246 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22335/tid=22345] ppid=22333 vsize=9888352 CPUtime=4956.9 cores=0-7
/proc/22335/task/22345/stat : 22345 (plingeling) R 22333 22335 22268 0 -1 4202560 9506380 1250 0 0 493572 2118 0 0 25 0 9 0 655344516 10125672448 2449246 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22335/tid=22346] ppid=22333 vsize=9888352 CPUtime=4937.49 cores=0-7
/proc/22335/task/22346/stat : 22346 (plingeling) R 22333 22335 22268 0 -1 4202560 6536639 1250 0 0 492526 1223 0 0 25 0 9 0 655344516 10125672448 2449246 33554432000 4194304 4417452 140733741114560 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22335/tid=22347] ppid=22333 vsize=9888352 CPUtime=4954.63 cores=0-7
/proc/22335/task/22347/stat : 22347 (plingeling) R 22333 22335 22268 0 -1 4202560 5792851 1250 0 0 494432 1031 0 0 25 0 9 0 655344516 10125672448 2449246 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22335/tid=22348] ppid=22333 vsize=9888352 CPUtime=4956.8 cores=0-7
/proc/22335/task/22348/stat : 22348 (plingeling) R 22333 22335 22268 0 -1 4202560 4484557 1250 0 0 494849 831 0 0 25 0 9 0 655344519 10125672448 2449246 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=9888352 CPUtime=4957.75 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 5857821 1250 0 0 494664 1111 0 0 25 0 9 0 655344519 10125672448 2449246 33554432000 4194304 4417452 140733741114560 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39644
Current children cumulated vsize (KiB) 9888352



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5006.9 s]
/proc/loadavg: 8.29 8.17 8.08 9/252 22495
/proc/meminfo: memFree=11026440/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=10126028 CPUtime=40000.5 cores=0-7
/proc/22335/stat : 22335 (plingeling) S 22333 22335 22268 0 -1 4202496 50945976 1250 0 0 3990282 9772 0 0 25 0 9 0 655344366 10369052672 2508664 33554432000 4194304 4417452 140733741114560 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 2531507 2508664 180 55 0 2529393 0
[pid=22335/tid=22342] ppid=22333 vsize=10126028 CPUtime=5004.58 cores=0-7
/proc/22335/task/22342/stat : 22342 (plingeling) R 22333 22335 22268 0 -1 4202560 5276897 1250 0 0 499466 992 0 0 25 0 9 0 655344516 10369052672 2508664 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=22335/tid=22343] ppid=22333 vsize=10126028 CPUtime=5003.9 cores=0-7
/proc/22335/task/22343/stat : 22343 (plingeling) R 22333 22335 22268 0 -1 4202560 7557355 1250 0 0 499043 1347 0 0 25 0 9 0 655344516 10369052672 2508664 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22335/tid=22344] ppid=22333 vsize=10126028 CPUtime=5004.25 cores=0-7
/proc/22335/task/22344/stat : 22344 (plingeling) R 22333 22335 22268 0 -1 4202560 5371381 1250 0 0 499408 1017 0 0 25 0 9 0 655344516 10369052672 2508664 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22335/tid=22345] ppid=22333 vsize=10126028 CPUtime=5001.51 cores=0-7
/proc/22335/task/22345/stat : 22345 (plingeling) R 22333 22335 22268 0 -1 4202560 9630286 1250 0 0 498017 2134 0 0 25 0 9 0 655344516 10369052672 2508664 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22335/tid=22346] ppid=22333 vsize=10126028 CPUtime=4982.1 cores=0-7
/proc/22335/task/22346/stat : 22346 (plingeling) R 22333 22335 22268 0 -1 4202560 6622626 1250 0 0 496973 1237 0 0 25 0 9 0 655344516 10369052672 2508664 33554432000 4194304 4417452 140733741114560 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22335/tid=22347] ppid=22333 vsize=10126028 CPUtime=4999.23 cores=0-7
/proc/22335/task/22347/stat : 22347 (plingeling) R 22333 22335 22268 0 -1 4202560 5936798 1250 0 0 498869 1054 0 0 25 0 9 0 655344516 10369052672 2508664 33554432000 4194304 4417452 140733741114560 18446744073709551615 4236577 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22335/tid=22348] ppid=22333 vsize=10126028 CPUtime=5001.42 cores=0-7
/proc/22335/task/22348/stat : 22348 (plingeling) R 22333 22335 22268 0 -1 4202560 4517234 1250 0 0 499300 842 0 0 25 0 9 0 655344519 10369052672 2508664 33554432000 4194304 4417452 140733741114560 18446744073709551615 4250678 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=10126028 CPUtime=5002.02 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4202560 5975176 1250 0 0 499063 1139 0 0 25 0 9 0 655344519 10369052672 2508664 33554432000 4194304 4417452 140733741114560 18446744073709551615 4357222 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 10126028

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5007.01 s]
/proc/loadavg: 8.29 8.17 8.08 9/252 22495
/proc/meminfo: memFree=11026440/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=0 CPUtime=40000.7 cores=0-7
/proc/22335/stat : 22335 (plingeling) Z 22333 22335 22268 0 -1 4203548 50945976 1250 0 0 3990288 9782 0 0 18 0 2 0 655344366 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 0 0 0 0 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=0 CPUtime=5002.13 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4203588 5975176 1250 0 0 499064 1149 0 0 25 0 2 0 655344519 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 0

[startup+5007.21 s]
/proc/loadavg: 8.29 8.17 8.08 2/246 22496
/proc/meminfo: memFree=15588916/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=0 CPUtime=40000.9 cores=0-7
/proc/22335/stat : 22335 (plingeling) Z 22333 22335 22268 0 -1 4203548 50945976 1250 0 0 3990288 9801 0 0 18 0 2 0 655344366 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 0 0 0 0 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=0 CPUtime=5002.32 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4203588 5975176 1250 0 0 499064 1168 0 0 25 0 2 0 655344519 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 0

[startup+5007.3 s]
/proc/loadavg: 8.29 8.17 8.08 2/246 22496
/proc/meminfo: memFree=15588916/32951124 swapFree=67056788/67111528
[pid=22335] ppid=22333 vsize=0 CPUtime=40001 cores=0-7
/proc/22335/stat : 22335 (plingeling) Z 22333 22335 22268 0 -1 4203548 50945976 1250 0 0 3990288 9811 0 0 18 0 2 0 655344366 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/22335/statm: 0 0 0 0 0 0 0
[pid=22335/tid=22349] ppid=22333 vsize=0 CPUtime=5002.42 cores=0-7
/proc/22335/task/22349/stat : 22349 (plingeling) R 22333 22335 22268 0 -1 4203588 5975176 1250 0 0 499064 1178 0 0 25 0 2 0 655344519 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5007.31
CPU time (s): 40001
CPU user time (s): 39902.9
CPU system time (s): 98.1271
CPU usage (%): 798.852
Max. virtual memory (cumulated for all children) (KiB): 17253056

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39902.9
system time used= 98.1271
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 50947226
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1953
involuntary context switches= 394821

runsolver used 11.0293 second user time and 27.2089 second system time

The end

Launcher Data 

Begin job on node133 at 2011-05-15 07:31:05
IDJOB=3372416
IDBENCH=82369
IDSOLVER=1851
FILE ID=node133/3372416-1305437464
RUNJOBID= node133-1305437408-22282
PBS_JOBID= 13324773
Free space on /tmp= 73660 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372416-1305437464/watcher-3372416-1305437464 -o /tmp/evaluation-result-3372416-1305437464/solver-3372416-1305437464 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372416-1305437464.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 0385ba51f44fb47d0b0726e26312816f
RANDOM SEED=1371695182

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21079356 kB
Buffers:        287644 kB
Cached:        3877212 kB
SwapCached:       8724 kB
Active:        8582384 kB
Inactive:      3007232 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21079356 kB
SwapTotal:    67111528 kB
SwapFree:     67056788 kB
Dirty:           15868 kB
Writeback:           0 kB
AnonPages:     7422080 kB
Mapped:          20532 kB
Slab:           195316 kB
PageTables:      23104 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 19196412 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73660 MiB
End job on node133 at 2011-05-15 08:54:34