Trace number 3273862

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.44 1201.72

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n130-s30940966-unsat.cnf
MD5SUMca44a78076b8228fbb99ecc0147f157f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4645.03
Satisfiable
(Un)Satisfiability was proved
Number of variables133
Number of clauses276
Sum of the clauses size828
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3276
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3273862-1304084275/watcher-3273862-1304084275 -o /tmp/evaluation-result-3273862-1304084275/solver-3273862-1304084275 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3273862-1304084275.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.56 8.06 8.13 5/185 5607
/proc/meminfo: memFree=29735788/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=49832 CPUtime=0 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 347 1252 0 0 0 0 0 0 23 0 5 0 520025405 51027968 272 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 12458 272 174 55 0 10344 0
[pid=5607/tid=5613] ppid=5605 vsize=49832 CPUtime=0 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 26 1252 0 0 0 0 0 0 25 0 5 0 520025406 51027968 272 33554432000 4194304 4417332 140737065291600 18446744073709551615 255377406446 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=49832 CPUtime=0 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 5 1252 0 0 0 0 0 0 18 0 5 0 520025406 51027968 272 33554432000 4194304 4417332 140737065291600 18446744073709551615 4271529 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=49832 CPUtime=0 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 0 1252 0 0 0 0 0 0 25 0 5 0 520025406 51027968 272 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389099062 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=49832 CPUtime=0 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 7 1252 0 0 0 0 0 0 25 0 5 0 520025406 51027968 272 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 3 0 0 0

[startup+0.0202149 s]
/proc/loadavg: 7.56 8.06 8.13 5/185 5607
/proc/meminfo: memFree=29735788/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=50524 CPUtime=0.05 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 514 1252 0 0 5 0 0 0 23 0 5 0 520025405 51736576 439 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 12631 439 178 55 0 10517 0
[pid=5607/tid=5613] ppid=5605 vsize=50524 CPUtime=0.01 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 35 1252 0 0 1 0 0 0 25 0 5 0 520025406 51736576 439 33554432000 4194304 4417332 140737065291600 18446744073709551615 4252121 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=50524 CPUtime=0.01 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 23 1252 0 0 1 0 0 0 18 0 5 0 520025406 51736576 439 33554432000 4194304 4417332 140737065291600 18446744073709551615 4253288 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=50524 CPUtime=0.01 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 89 1252 0 0 1 0 0 0 25 0 5 0 520025406 51736576 439 33554432000 4194304 4417332 140737065291600 18446744073709551615 4353540 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=50524 CPUtime=0.01 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 58 1252 0 0 1 0 0 0 25 0 5 0 520025406 51736576 439 33554432000 4194304 4417332 140737065291600 18446744073709551615 4357781 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 50524

[startup+0.101201 s]
/proc/loadavg: 7.56 8.06 8.13 5/185 5607
/proc/meminfo: memFree=29735788/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=118576 CPUtime=0.37 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 1228 1252 0 0 37 0 0 0 23 0 5 0 520025405 121421824 1063 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 29644 1063 179 55 0 27530 0
[pid=5607/tid=5613] ppid=5605 vsize=118576 CPUtime=0.09 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 191 1252 0 0 9 0 0 0 25 0 5 0 520025406 121421824 1063 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=118576 CPUtime=0.09 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 159 1252 0 0 9 0 0 0 18 0 5 0 520025406 121421824 1063 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=118576 CPUtime=0.09 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 220 1252 0 0 9 0 0 0 25 0 5 0 520025406 121421824 1063 33554432000 4194304 4417332 140737065291600 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=118576 CPUtime=0.09 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 349 1252 0 0 9 0 0 0 25 0 5 0 520025406 121421824 1063 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 118576

[startup+0.301164 s]
/proc/loadavg: 7.56 8.06 8.13 5/185 5607
/proc/meminfo: memFree=29735788/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=121416 CPUtime=1.17 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 3422 1252 0 0 117 0 0 0 23 0 5 0 520025405 124329984 1796 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 30354 1796 179 55 0 28240 0
[pid=5607/tid=5613] ppid=5605 vsize=121416 CPUtime=0.29 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 749 1252 0 0 29 0 0 0 25 0 5 0 520025406 124329984 1796 33554432000 4194304 4417332 140737065291600 18446744073709551615 4365977 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=121416 CPUtime=0.29 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 707 1252 0 0 29 0 0 0 18 0 5 0 520025406 124329984 1796 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=121416 CPUtime=0.29 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 824 1252 0 0 29 0 0 0 25 0 5 0 520025406 124329984 1796 33554432000 4194304 4417332 140737065291600 18446744073709551615 4353458 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=121416 CPUtime=0.29 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 833 1252 0 0 29 0 0 0 25 0 5 0 520025406 124329984 1796 33554432000 4194304 4417332 140737065291600 18446744073709551615 4353974 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 121416

[startup+0.701091 s]
/proc/loadavg: 7.56 8.06 8.13 5/185 5607
/proc/meminfo: memFree=29735788/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=124528 CPUtime=2.78 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 6725 1252 0 0 277 1 0 0 23 0 5 0 520025405 127516672 2583 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 31132 2583 179 55 0 29018 0
[pid=5607/tid=5613] ppid=5605 vsize=124528 CPUtime=0.69 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 1576 1252 0 0 69 0 0 0 25 0 5 0 520025406 127516672 2583 33554432000 4194304 4417332 140737065291600 18446744073709551615 4357470 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=124528 CPUtime=0.69 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 1538 1252 0 0 69 0 0 0 18 0 5 0 520025406 127516672 2583 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=124528 CPUtime=0.68 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 1686 1252 0 0 68 0 0 0 25 0 5 0 520025406 127516672 2583 33554432000 4194304 4417332 140737065291600 18446744073709551615 4236564 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=124528 CPUtime=0.69 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 1616 1252 0 0 69 0 0 0 25 0 5 0 520025406 127516672 2583 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.78
Current children cumulated vsize (KiB) 124528

[startup+1.50094 s]
/proc/loadavg: 7.56 8.06 8.13 10/190 5617
/proc/meminfo: memFree=29716204/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=126456 CPUtime=5.97 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 11329 1252 0 0 596 1 0 0 23 0 5 0 520025405 129490944 3033 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 31614 3033 179 55 0 29500 0
[pid=5607/tid=5613] ppid=5605 vsize=126456 CPUtime=1.48 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 2930 1252 0 0 148 0 0 0 25 0 5 0 520025406 129490944 3033 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=126456 CPUtime=1.49 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 2931 1252 0 0 149 0 0 0 20 0 5 0 520025406 129490944 3033 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=126456 CPUtime=1.48 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 2646 1252 0 0 148 0 0 0 25 0 5 0 520025406 129490944 3033 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=126456 CPUtime=1.49 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 2513 1252 0 0 149 0 0 0 25 0 5 0 520025406 129490944 3033 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 126456

[startup+3.10065 s]
/proc/loadavg: 7.56 8.06 8.13 10/190 5617
/proc/meminfo: memFree=29711484/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=130000 CPUtime=12.36 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 20371 1252 0 0 1233 3 0 0 23 0 5 0 520025405 133120000 3945 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 32500 3945 179 55 0 30386 0
[pid=5607/tid=5613] ppid=5605 vsize=130000 CPUtime=3.08 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 4917 1252 0 0 308 0 0 0 25 0 5 0 520025406 133120000 3945 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=130000 CPUtime=3.08 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 5600 1252 0 0 308 0 0 0 25 0 5 0 520025406 133120000 3945 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=130000 CPUtime=3.07 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 4670 1252 0 0 307 0 0 0 25 0 5 0 520025406 133120000 3945 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=130000 CPUtime=3.08 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 4875 1252 0 0 308 0 0 0 25 0 5 0 520025406 133120000 3945 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 130000

[startup+6.30106 s]
/proc/loadavg: 7.67 8.08 8.14 10/190 5617
/proc/meminfo: memFree=29699964/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=135068 CPUtime=25.14 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 36356 1252 0 0 2510 4 0 0 23 0 5 0 520025405 138309632 5211 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 33767 5211 179 55 0 31653 0
[pid=5607/tid=5613] ppid=5605 vsize=135068 CPUtime=6.29 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 9327 1252 0 0 628 1 0 0 25 0 5 0 520025406 138309632 5211 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=135068 CPUtime=6.29 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 9442 1252 0 0 628 1 0 0 25 0 5 0 520025406 138309632 5211 33554432000 4194304 4417332 140737065291600 18446744073709551615 4320876 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=135068 CPUtime=6.26 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 9021 1252 0 0 625 1 0 0 25 0 5 0 520025406 138309632 5211 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=135068 CPUtime=6.29 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 8257 1252 0 0 628 1 0 0 25 0 5 0 520025406 138309632 5211 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.14
Current children cumulated vsize (KiB) 135068

[startup+12.7009 s]
/proc/loadavg: 7.70 8.08 8.14 9/190 5617
/proc/meminfo: memFree=29682504/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=141480 CPUtime=50.7 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 56022 1252 0 0 5061 9 0 0 23 0 5 0 520025405 144875520 6808 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 35370 6808 179 55 0 33256 0
[pid=5607/tid=5613] ppid=5605 vsize=141480 CPUtime=12.68 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 14110 1252 0 0 1267 1 0 0 25 0 5 0 520025406 144875520 6808 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=141480 CPUtime=12.69 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 14342 1252 0 0 1267 2 0 0 25 0 5 0 520025406 144875520 6808 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=141480 CPUtime=12.61 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 14198 1252 0 0 1259 2 0 0 25 0 5 0 520025406 144875520 6808 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=141480 CPUtime=12.69 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 13063 1252 0 0 1267 2 0 0 25 0 5 0 520025406 144875520 6808 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 141480

[startup+25.5005 s]
/proc/loadavg: 7.77 8.07 8.13 10/190 5618
/proc/meminfo: memFree=29666264/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=152012 CPUtime=101.83 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 98256 1252 0 0 10166 17 0 0 23 0 5 0 520025405 155660288 9448 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 38003 9448 179 55 0 35889 0
[pid=5607/tid=5613] ppid=5605 vsize=152012 CPUtime=25.48 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 24825 1252 0 0 2545 3 0 0 25 0 5 0 520025406 155660288 9448 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=152012 CPUtime=25.49 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 24353 1252 0 0 2545 4 0 0 25 0 5 0 520025406 155660288 9448 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=152012 CPUtime=25.34 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 23794 1252 0 0 2530 4 0 0 25 0 5 0 520025406 155660288 9448 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=152012 CPUtime=25.49 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 24975 1252 0 0 2545 4 0 0 25 0 5 0 520025406 155660288 9448 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 152012

[startup+51.1008 s]
/proc/loadavg: 7.84 8.07 8.13 9/190 5619
/proc/meminfo: memFree=29637720/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=175528 CPUtime=204.1 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 159942 1252 0 0 20384 26 0 0 23 0 5 0 520025405 179740672 15301 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 43882 15301 179 55 0 41768 0
[pid=5607/tid=5613] ppid=5605 vsize=175528 CPUtime=51.09 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 40447 1252 0 0 5103 6 0 0 25 0 5 0 520025406 179740672 15301 33554432000 4194304 4417332 140737065291600 18446744073709551615 4344048 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=175528 CPUtime=51.09 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 41934 1252 0 0 5103 6 0 0 25 0 5 0 520025406 179740672 15301 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=175528 CPUtime=50.81 cores=1,3,5,7

################
# More data... #
################

[pid=5607/tid=5614] ppid=5605 vsize=372360 CPUtime=762.31 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 287263 1252 0 0 76186 45 0 0 25 0 5 0 520025406 381296640 64540 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=372360 CPUtime=758.16 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 296407 1252 0 0 75768 48 0 0 25 0 5 0 520025406 381296640 64540 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=372360 CPUtime=762.32 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 287509 1252 0 0 76188 44 0 0 25 0 5 0 520025406 381296640 64540 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3045.13
Current children cumulated vsize (KiB) 372360

[startup+822.301 s]
/proc/loadavg: 8.27 8.20 8.15 10/190 5639
/proc/meminfo: memFree=29392632/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=314964 CPUtime=3284.8 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 1193744 1252 0 0 328291 189 0 0 23 0 5 0 520025405 322523136 50191 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 78741 50191 179 55 0 76627 0
[pid=5607/tid=5613] ppid=5605 vsize=314964 CPUtime=822.31 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 274206 1252 0 0 82189 42 0 0 25 0 5 0 520025406 322523136 50191 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=314964 CPUtime=822.31 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 299509 1252 0 0 82184 47 0 0 25 0 5 0 520025406 322523136 50191 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=314964 CPUtime=817.82 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 312191 1252 0 0 81732 50 0 0 25 0 5 0 520025406 322523136 50191 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=314964 CPUtime=822.32 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 307529 1252 0 0 82184 48 0 0 25 0 5 0 520025406 322523136 50191 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3284.8
Current children cumulated vsize (KiB) 314964

[startup+882.301 s]
/proc/loadavg: 8.17 8.18 8.14 10/190 5641
/proc/meminfo: memFree=29389504/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=329584 CPUtime=3524.47 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 1237032 1252 0 0 352253 194 0 0 23 0 5 0 520025405 337494016 53846 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 82396 53846 179 55 0 80282 0
[pid=5607/tid=5613] ppid=5605 vsize=329584 CPUtime=882.32 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 279066 1252 0 0 88189 43 0 0 25 0 5 0 520025406 337494016 53846 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=329584 CPUtime=882.31 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 312216 1252 0 0 88183 48 0 0 25 0 5 0 520025406 337494016 53846 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=329584 CPUtime=877.5 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 329856 1252 0 0 87697 53 0 0 25 0 5 0 520025406 337494016 53846 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=329584 CPUtime=882.32 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 315585 1252 0 0 88183 49 0 0 25 0 5 0 520025406 337494016 53846 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.47
Current children cumulated vsize (KiB) 329584

[startup+942.301 s]
/proc/loadavg: 8.22 8.19 8.15 9/190 5642
/proc/meminfo: memFree=29389368/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=336320 CPUtime=3764.16 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 1273395 1252 0 0 376216 200 0 0 23 0 5 0 520025405 344391680 55530 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 84080 55530 179 55 0 81966 0
[pid=5607/tid=5613] ppid=5605 vsize=336320 CPUtime=942.32 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 279211 1252 0 0 94189 43 0 0 25 0 5 0 520025406 344391680 55530 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=336320 CPUtime=942.32 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 321742 1252 0 0 94182 50 0 0 25 0 5 0 520025406 344391680 55530 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=336320 CPUtime=937.18 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 345521 1252 0 0 93662 56 0 0 25 0 5 0 520025406 344391680 55530 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=336320 CPUtime=942.32 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 326612 1252 0 0 94182 50 0 0 25 0 5 0 520025406 344391680 55530 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3764.16
Current children cumulated vsize (KiB) 336320

[startup+1002.3 s]
/proc/loadavg: 8.19 8.18 8.15 9/190 5644
/proc/meminfo: memFree=29404964/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=297040 CPUtime=4003.83 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 1334725 1252 0 0 400173 210 0 0 23 0 5 0 520025405 304168960 45710 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 74260 45710 179 55 0 72146 0
[pid=5607/tid=5613] ppid=5605 vsize=297040 CPUtime=1002.32 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 300255 1252 0 0 100185 47 0 0 25 0 5 0 520025406 304168960 45710 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=297040 CPUtime=1002.31 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 334126 1252 0 0 100180 51 0 0 25 0 5 0 520025406 304168960 45710 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=297040 CPUtime=996.85 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 362205 1252 0 0 99627 58 0 0 25 0 5 0 520025406 304168960 45710 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=297040 CPUtime=1002.32 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 337830 1252 0 0 100180 52 0 0 25 0 5 0 520025406 304168960 45710 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.83
Current children cumulated vsize (KiB) 297040

[startup+1062.3 s]
/proc/loadavg: 8.12 8.16 8.14 10/190 5645
/proc/meminfo: memFree=29354964/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=355924 CPUtime=4243.52 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 1382489 1252 0 0 424136 216 0 0 23 0 5 0 520025405 364466176 60440 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 88981 60440 179 55 0 86867 0
[pid=5607/tid=5613] ppid=5605 vsize=355924 CPUtime=1062.32 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 310370 1252 0 0 106184 48 0 0 25 0 5 0 520025406 364466176 60440 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=355924 CPUtime=1062.31 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 349879 1252 0 0 106178 53 0 0 25 0 5 0 520025406 364466176 60440 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=355924 CPUtime=1056.53 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 376091 1252 0 0 105593 60 0 0 25 0 5 0 520025406 364466176 60440 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364308 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=355924 CPUtime=1062.32 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 345840 1252 0 0 106179 53 0 0 25 0 5 0 520025406 364466176 60440 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.52
Current children cumulated vsize (KiB) 355924

[startup+1122.3 s]
/proc/loadavg: 8.20 8.17 8.15 10/190 5647
/proc/meminfo: memFree=29349120/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=363312 CPUtime=4483.2 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 1421913 1252 0 0 448099 221 0 0 23 0 5 0 520025405 372031488 62297 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 90828 62297 179 55 0 88714 0
[pid=5607/tid=5613] ppid=5605 vsize=363312 CPUtime=1122.32 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 313464 1252 0 0 112184 48 0 0 25 0 5 0 520025406 372031488 62297 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=363312 CPUtime=1122.32 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 359945 1252 0 0 112177 55 0 0 25 0 5 0 520025406 372031488 62297 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=363312 CPUtime=1116.2 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 392625 1252 0 0 111558 62 0 0 25 0 5 0 520025406 372031488 62297 33554432000 4194304 4417332 140737065291600 18446744073709551615 4366716 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=363312 CPUtime=1122.32 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 355570 1252 0 0 112178 54 0 0 25 0 5 0 520025406 372031488 62297 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4483.2
Current children cumulated vsize (KiB) 363312

[startup+1182.3 s]
/proc/loadavg: 8.12 8.16 8.14 10/190 5649
/proc/meminfo: memFree=29370168/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=337192 CPUtime=4722.88 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 1466876 1252 0 0 472061 227 0 0 23 0 5 0 520025405 345284608 55748 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 84298 55748 179 55 0 82184 0
[pid=5607/tid=5613] ppid=5605 vsize=337192 CPUtime=1182.33 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 323544 1252 0 0 118183 50 0 0 25 0 5 0 520025406 345284608 55748 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=337192 CPUtime=1182.32 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 374999 1252 0 0 118176 56 0 0 25 0 5 0 520025406 345284608 55748 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=337192 CPUtime=1175.88 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 404699 1252 0 0 117524 64 0 0 25 0 5 0 520025406 345284608 55748 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=337192 CPUtime=1182.33 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 363325 1252 0 0 118177 56 0 0 25 0 5 0 520025406 345284608 55748 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4722.88
Current children cumulated vsize (KiB) 337192



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.09 8.14 8.14 5/185 5650
/proc/meminfo: memFree=29508712/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=340900 CPUtime=4800.39 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 1481923 1252 0 0 479810 229 0 0 23 0 5 0 520025405 349081600 56675 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 85225 56675 179 55 0 83111 0
[pid=5607/tid=5613] ppid=5605 vsize=340900 CPUtime=1201.73 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 323691 1252 0 0 120123 50 0 0 25 0 5 0 520025406 349081600 56675 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=340900 CPUtime=1201.73 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 378366 1252 0 0 120116 57 0 0 25 0 5 0 520025406 349081600 56675 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=340900 CPUtime=1195.17 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 410867 1252 0 0 119452 65 0 0 25 0 5 0 520025406 349081600 56675 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=340900 CPUtime=1201.73 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 368690 1252 0 0 120117 56 0 0 25 0 5 0 520025406 349081600 56675 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 340900

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.09 8.14 8.14 5/185 5650
/proc/meminfo: memFree=29508712/32951124 swapFree=67111352/67111528
[pid=5607] ppid=5605 vsize=340900 CPUtime=4800.39 cores=1,3,5,7
/proc/5607/stat : 5607 (plingeling) S 5605 5607 4914 0 -1 4202496 1481923 1252 0 0 479810 229 0 0 23 0 5 0 520025405 349081600 56675 33554432000 4194304 4417332 140737065291600 18446744073709551615 255389104101 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/5607/statm: 85225 56675 179 55 0 83111 0
[pid=5607/tid=5613] ppid=5605 vsize=340900 CPUtime=1201.73 cores=1,3,5,7
/proc/5607/task/5613/stat : 5613 (plingeling) R 5605 5607 4914 0 -1 4202560 323691 1252 0 0 120123 50 0 0 25 0 5 0 520025406 349081600 56675 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=5607/tid=5614] ppid=5605 vsize=340900 CPUtime=1201.73 cores=1,3,5,7
/proc/5607/task/5614/stat : 5614 (plingeling) R 5605 5607 4914 0 -1 4202560 378366 1252 0 0 120116 57 0 0 25 0 5 0 520025406 349081600 56675 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5607/tid=5615] ppid=5605 vsize=340900 CPUtime=1195.17 cores=1,3,5,7
/proc/5607/task/5615/stat : 5615 (plingeling) R 5605 5607 4914 0 -1 4202560 410867 1252 0 0 119452 65 0 0 25 0 5 0 520025406 349081600 56675 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5607/tid=5616] ppid=5605 vsize=340900 CPUtime=1201.73 cores=1,3,5,7
/proc/5607/task/5616/stat : 5616 (plingeling) R 5605 5607 4914 0 -1 4202560 368690 1252 0 0 120117 56 0 0 25 0 5 0 520025406 349081600 56675 33554432000 4194304 4417332 140737065291600 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 340900

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.72
CPU time (s): 4800.44
CPU user time (s): 4798.13
CPU system time (s): 2.31365
CPU usage (%): 399.463
Max. virtual memory (cumulated for all children) (KiB): 385440

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.13
system time used= 2.31365
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1483175
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 122
involuntary context switches= 33126

runsolver used 1.87771 second user time and 4.68629 second system time

The end

Launcher Data 

Begin job on node135 at 2011-04-29 15:37:55
IDJOB=3273862
IDBENCH=83148
IDSOLVER=1605
FILE ID=node135/3273862-1304084275
RUNJOBID= node135-1304084275-5579
PBS_JOBID= 13170518
Free space on /tmp= 71120 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n130-s30940966-unsat.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3273862-1304084275/watcher-3273862-1304084275 -o /tmp/evaluation-result-3273862-1304084275/solver-3273862-1304084275 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3273862-1304084275.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ca44a78076b8228fbb99ecc0147f157f
RANDOM SEED=646903886

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29736192 kB
Buffers:        905772 kB
Cached:        1723568 kB
SwapCached:        172 kB
Active:         111448 kB
Inactive:      2586260 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29736192 kB
SwapTotal:    67111528 kB
SwapFree:     67111352 kB
Dirty:             148 kB
Writeback:          20 kB
AnonPages:       68396 kB
Mapped:          15080 kB
Slab:           453708 kB
PageTables:       4920 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   256240 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71120 MiB
End job on node135 at 2011-04-29 15:57:59