Trace number 3285711

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.16 1203.45

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
sokoban-sequential-p145-microban-sequential.080-SAT.cnf
MD5SUM1ca09a2b911e29894c6603aee8d3e672
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark153.91
Satisfiable
(Un)Satisfiability was proved
Number of variables175084
Number of clauses2826936
Sum of the clauses size6454456
Maximum clause length78
Minimum clause length1
Number of clauses of size 1696
Number of clauses of size 22728320
Number of clauses of size 37680
Number of clauses of size 435520
Number of clauses of size 515360
Number of clauses of size over 539360

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3285711-1304060615/watcher-3285711-1304060615 -o /tmp/evaluation-result-3285711-1304060615/solver-3285711-1304060615 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3285711-1304060615.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.93 8.06 8.01 5/181 31438
/proc/meminfo: memFree=13434300/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=11732 CPUtime=0 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) R 31436 31438 31098 0 -1 4202496 990 1260 0 0 0 0 0 0 23 0 1 0 517661380 12013568 919 33554432000 4194304 4417332 140734969949488 18446744073709551615 274473967360 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/31438/statm: 2933 919 143 55 0 819 0

[startup+0.0232451 s]
/proc/loadavg: 7.93 8.06 8.01 5/181 31438
/proc/meminfo: memFree=13434300/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=13988 CPUtime=0.01 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) R 31436 31438 31098 0 -1 4202496 1591 1260 0 0 1 0 0 0 23 0 1 0 517661380 14323712 1520 33554432000 4194304 4417332 140734969949488 18446744073709551615 274473586144 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/31438/statm: 3497 1520 148 55 0 1383 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 13988

[startup+0.100234 s]
/proc/loadavg: 7.93 8.06 8.01 5/181 31438
/proc/meminfo: memFree=13434300/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=17220 CPUtime=0.09 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) R 31436 31438 31098 0 -1 4202496 2395 1260 0 0 9 0 0 0 23 0 1 0 517661380 17633280 2312 33554432000 4194304 4417332 140734969949488 18446744073709551615 4209644 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/31438/statm: 4305 2312 148 55 0 2191 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 17220

[startup+0.300201 s]
/proc/loadavg: 7.93 8.06 8.01 5/181 31438
/proc/meminfo: memFree=13434300/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=41964 CPUtime=0.29 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) R 31436 31438 31098 0 -1 4202496 8605 1260 0 0 28 1 0 0 24 0 1 0 517661380 42971136 8514 33554432000 4194304 4417332 140734969949488 18446744073709551615 4209566 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/31438/statm: 10491 8514 148 55 0 8377 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 41964

[startup+0.70013 s]
/proc/loadavg: 7.93 8.06 8.01 5/181 31438
/proc/meminfo: memFree=13434300/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=69612 CPUtime=0.69 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) R 31436 31438 31098 0 -1 4202496 15517 1260 0 0 67 2 0 0 25 0 1 0 517661380 71282688 15426 33554432000 4194304 4417332 140734969949488 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/31438/statm: 17403 15426 148 55 0 15289 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 69612

[startup+1.50099 s]
/proc/loadavg: 7.93 8.06 8.01 6/182 31444
/proc/meminfo: memFree=13452032/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=198896 CPUtime=1.49 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) R 31436 31438 31098 0 -1 4202496 47838 1260 0 0 143 6 0 0 25 0 1 0 517661380 203669504 47747 33554432000 4194304 4417332 140734969949488 18446744073709551615 4322129 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/31438/statm: 49724 47747 148 55 0 47610 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 198896

[startup+3.10071 s]
/proc/loadavg: 7.93 8.06 8.01 6/182 31444
/proc/meminfo: memFree=13337612/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=325960 CPUtime=5.32 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 70879 1260 0 0 521 11 0 0 25 0 5 0 517661380 333783040 55587 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 81490 55587 167 55 0 79376 0
Current children cumulated CPU time (s) 5.32
Current children cumulated vsize (KiB) 325960

[startup+6.30115 s]
/proc/loadavg: 7.94 8.06 8.01 9/186 31448
/proc/meminfo: memFree=13340236/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=330184 CPUtime=18.1 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 136781 1260 0 0 1788 22 0 0 25 0 5 0 517661380 338108416 55944 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 82546 55944 178 55 0 80432 0
[pid=31438/tid=31445] ppid=31436 vsize=330184 CPUtime=3.94 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 23731 1260 0 0 390 4 0 0 25 0 5 0 517661615 338108416 55944 33554432000 4194304 4417332 140734969949488 18446744073709551615 4346152 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=330184 CPUtime=3.93 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 28434 1260 0 0 388 5 0 0 25 0 5 0 517661615 338108416 55944 33554432000 4194304 4417332 140734969949488 18446744073709551615 4346594 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=330184 CPUtime=3.93 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 24163 1260 0 0 391 2 0 0 25 0 5 0 517661615 338108416 55944 33554432000 4194304 4417332 140734969949488 18446744073709551615 4330532 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=330184 CPUtime=3.92 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 3257 1260 0 0 392 0 0 0 25 0 5 0 517661615 338108416 55944 33554432000 4194304 4417332 140734969949488 18446744073709551615 4232664 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 18.1
Current children cumulated vsize (KiB) 330184

[startup+12.701 s]
/proc/loadavg: 7.94 8.06 8.01 9/186 31448
/proc/meminfo: memFree=13664776/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=361668 CPUtime=43.66 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 147151 1260 0 0 4343 23 0 0 25 0 5 0 517661380 370348032 66314 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 90417 66314 180 55 0 88303 0
[pid=31438/tid=31445] ppid=31436 vsize=361668 CPUtime=10.34 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 23737 1260 0 0 1030 4 0 0 25 0 5 0 517661615 370348032 66314 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=361668 CPUtime=10.33 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 30925 1260 0 0 1028 5 0 0 25 0 5 0 517661615 370348032 66314 33554432000 4194304 4417332 140734969949488 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=361668 CPUtime=10.34 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 26099 1260 0 0 1031 3 0 0 25 0 5 0 517661615 370348032 66314 33554432000 4194304 4417332 140734969949488 18446744073709551615 4232664 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=361668 CPUtime=10.29 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 9194 1260 0 0 1028 1 0 0 25 0 5 0 517661615 370348032 66314 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 43.66
Current children cumulated vsize (KiB) 361668

[startup+25.5008 s]
/proc/loadavg: 8.19 8.10 8.02 10/187 31451
/proc/meminfo: memFree=13542924/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=349516 CPUtime=94.79 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 148006 1260 0 0 9456 23 0 0 25 0 5 0 517661380 357904384 63276 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 87379 63276 180 55 0 85265 0
[pid=31438/tid=31445] ppid=31436 vsize=349516 CPUtime=23.14 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 23801 1260 0 0 2310 4 0 0 25 0 5 0 517661615 357904384 63276 33554432000 4194304 4417332 140734969949488 18446744073709551615 4232772 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=349516 CPUtime=23.13 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 30925 1260 0 0 2308 5 0 0 25 0 5 0 517661615 357904384 63276 33554432000 4194304 4417332 140734969949488 18446744073709551615 4232693 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=349516 CPUtime=23.14 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 26099 1260 0 0 2311 3 0 0 25 0 5 0 517661615 357904384 63276 33554432000 4194304 4417332 140734969949488 18446744073709551615 4250936 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=349516 CPUtime=23.01 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 9985 1260 0 0 2300 1 0 0 25 0 5 0 517661615 357904384 63276 33554432000 4194304 4417332 140734969949488 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 94.79
Current children cumulated vsize (KiB) 349516

[startup+51.1003 s]
/proc/loadavg: 8.31 8.14 8.04 9/186 31452
/proc/meminfo: memFree=13615720/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=385044 CPUtime=197.05 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 173514 1260 0 0 19678 27 0 0 25 0 5 0 517661380 394285056 69673 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 96261 69673 180 55 0 94147 0
[pid=31438/tid=31445] ppid=31436 vsize=385044 CPUtime=48.74 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 24595 1260 0 0 4870 4 0 0 25 0 5 0 517661615 394285056 69673 33554432000 4194304 4417332 140734969949488 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=385044 CPUtime=48.73 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 31289 1260 0 0 4868 5 0 0 25 0 5 0 517661615 394285056 69673 33554432000 4194304 4417332 140734969949488 18446744073709551615 4275950 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=385044 CPUtime=48.74 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 43148 1260 0 0 4868 6 0 0 25 0 5 0 517661615 394285056 69673 33554432000 4194304 4417332 140734969949488 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=385044 CPUtime=48.47 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 17286 1260 0 0 4846 1 0 0 25 0 5 0 517661615 394285056 69673 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 197.05
Current children cumulated vsize (KiB) 385044

[startup+102.306 s]
/proc/loadavg: 8.22 8.14 8.04 9/186 31454
/proc/meminfo: memFree=13525008/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=434788 CPUtime=401.59 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 224564 1260 0 0 40125 34 0 0 25 0 5 0 517661380 445222912 82110 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 108697 82110 181 55 0 106583 0
[pid=31438/tid=31445] ppid=31436 vsize=434788 CPUtime=99.94 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 44744 1260 0 0 9987 7 0 0 25 0 5 0 517661615 445222912 82110 33554432000 4194304 4417332 140734969949488 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=434788 CPUtime=99.93 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 50651 1260 0 0 9986 7 0 0 25 0 5 0 517661615 445222912 82110 33554432000 4194304 4417332 140734969949488 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=434788 CPUtime=99.95 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 43947 1260 0 0 9989 6 0 0 25 0 5 0 517661615 445222912 82110 33554432000 4194304 4417332 140734969949488 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=434788 CPUtime=99.4 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 28026 1260 0 0 9937 3 0 0 25 0 5 0 517661615 445222912 82110 33554432000 4194304 4417332 140734969949488 18446744073709551615 4320867 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 401.59
Current children cumulated vsize (KiB) 434788

[startup+162.301 s]
/proc/loadavg: 8.16 8.14 8.05 9/186 31455
/proc/meminfo: memFree=13406060/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=489180 CPUtime=641.25 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 243961 1260 0 0 64089 36 0 0 25 0 5 0 517661380 500920320 95708 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 122295 95708 181 55 0 120181 0
[pid=31438/tid=31445] ppid=31436 vsize=489180 CPUtime=159.93 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 45859 1260 0 0 15986 7 0 0 25 0 5 0 517661615 500920320 95708 33554432000 4194304 4417332 140734969949488 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=489180 CPUtime=159.93 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 53628 1260 0 0 15986 7 0 0 25 0 5 0 517661615 500920320 95708 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=489180 CPUtime=159.94 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 52522 1260 0 0 15987 7 0 0 25 0 5 0 517661615 500920320 95708 33554432000 4194304 4417332 140734969949488 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=489180 CPUtime=159.07 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 34756 1260 0 0 15903 4 0 0 25 0 5 0 517661615 500920320 95708 33554432000 4194304 4417332 140734969949488 18446744073709551615 4232629 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 641.25
Current children cumulated vsize (KiB) 489180

[startup+222.301 s]
/proc/loadavg: 8.17 8.15 8.05 9/186 31457
/proc/meminfo: memFree=13182092/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=533692 CPUtime=880.93 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 255099 1260 0 0 88056 37 0 0 25 0 5 0 517661380 546500608 106842 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 133423 106842 181 55 0 131309 0
[pid=31438/tid=31445] ppid=31436 vsize=533692 CPUtime=219.94 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 48060 1260 0 0 21986 8 0 0 25 0 5 0 517661615 546500608 106842 33554432000 4194304 4417332 140734969949488 18446744073709551615 4358020 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=533692 CPUtime=219.93 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 55181 1260 0 0 21986 7 0 0 25 0 5 0 517661615 546500608 106842 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=533692 CPUtime=219.94 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 52528 1260 0 0 21987 7 0 0 25 0 5 0 517661615 546500608 106842 33554432000 4194304 4417332 140734969949488 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=533692 CPUtime=218.74 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 42134 1260 0 0 21870 4 0 0 25 0 5 0 517661615 546500608 106842 33554432000 4194304 4417332 140734969949488 18446744073709551615 4236991 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 880.93
Current children cumulated vsize (KiB) 533692

################
# More data... #
################

[pid=31438/tid=31446] ppid=31436 vsize=883228 CPUtime=699.94 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 84094 1260 0 0 69983 11 0 0 25 0 5 0 517661615 904425472 194226 33554432000 4194304 4417332 140734969949488 18446744073709551615 4275930 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=883228 CPUtime=699.95 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 64957 1260 0 0 69985 10 0 0 25 0 5 0 517661615 904425472 194226 33554432000 4194304 4417332 140734969949488 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=883228 CPUtime=696.14 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 221359 1260 0 0 69588 26 0 0 25 0 5 0 517661615 904425472 194226 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2798.34
Current children cumulated vsize (KiB) 883228

[startup+762.307 s]
/proc/loadavg: 8.08 7.98 7.99 9/186 31508
/proc/meminfo: memFree=12459076/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=847784 CPUtime=3038.05 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 512951 1260 0 0 303734 71 0 0 25 0 5 0 517661380 868130816 185365 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 211946 185365 181 55 0 209832 0
[pid=31438/tid=31445] ppid=31436 vsize=847784 CPUtime=759.94 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 71017 1260 0 0 75984 10 0 0 25 0 5 0 517661615 868130816 185365 33554432000 4194304 4417332 140734969949488 18446744073709551615 4309986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=847784 CPUtime=759.95 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 84676 1260 0 0 75984 11 0 0 25 0 5 0 517661615 868130816 185365 33554432000 4194304 4417332 140734969949488 18446744073709551615 4250648 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=847784 CPUtime=759.96 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 65535 1260 0 0 75986 10 0 0 25 0 5 0 517661615 868130816 185365 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=847784 CPUtime=755.81 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 234527 1260 0 0 75553 28 0 0 25 0 5 0 517661615 868130816 185365 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3038.05
Current children cumulated vsize (KiB) 847784

[startup+822.301 s]
/proc/loadavg: 8.08 8.00 8.00 9/186 31510
/proc/meminfo: memFree=12338756/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=890488 CPUtime=3277.7 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 535587 1260 0 0 327696 74 0 0 25 0 5 0 517661380 911859712 196041 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 222622 196041 181 55 0 220508 0
[pid=31438/tid=31445] ppid=31436 vsize=890488 CPUtime=819.93 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 71595 1260 0 0 81983 10 0 0 25 0 5 0 517661615 911859712 196041 33554432000 4194304 4417332 140734969949488 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=890488 CPUtime=819.95 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 84676 1260 0 0 81984 11 0 0 25 0 5 0 517661615 911859712 196041 33554432000 4194304 4417332 140734969949488 18446744073709551615 4264914 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=890488 CPUtime=819.96 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 65535 1260 0 0 81986 10 0 0 25 0 5 0 517661615 911859712 196041 33554432000 4194304 4417332 140734969949488 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=890488 CPUtime=815.48 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 256585 1260 0 0 81517 31 0 0 25 0 5 0 517661615 911859712 196041 33554432000 4194304 4417332 140734969949488 18446744073709551615 4356875 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3277.7
Current children cumulated vsize (KiB) 890488

[startup+882.301 s]
/proc/loadavg: 8.03 8.00 8.00 9/186 31511
/proc/meminfo: memFree=12150996/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=1039880 CPUtime=3517.37 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 619753 1260 0 0 351652 85 0 0 25 0 5 0 517661380 1064837120 233389 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 259970 233389 181 55 0 257856 0
[pid=31438/tid=31445] ppid=31436 vsize=1039880 CPUtime=879.94 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 76806 1260 0 0 87983 11 0 0 25 0 5 0 517661615 1064837120 233389 33554432000 4194304 4417332 140734969949488 18446744073709551615 4354401 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=1039880 CPUtime=879.95 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 98536 1260 0 0 87982 13 0 0 25 0 5 0 517661615 1064837120 233389 33554432000 4194304 4417332 140734969949488 18446744073709551615 4236569 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=1039880 CPUtime=879.96 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 72597 1260 0 0 87985 11 0 0 25 0 5 0 517661615 1064837120 233389 33554432000 4194304 4417332 140734969949488 18446744073709551615 4356771 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=1039880 CPUtime=875.15 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 314618 1260 0 0 87476 39 0 0 25 0 5 0 517661615 1064837120 233389 33554432000 4194304 4417332 140734969949488 18446744073709551615 4358020 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3517.37
Current children cumulated vsize (KiB) 1039880

[startup+942.3 s]
/proc/loadavg: 8.07 8.01 8.00 9/186 31513
/proc/meminfo: memFree=12089452/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=1021544 CPUtime=3757.05 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 674403 1260 0 0 375612 93 0 0 25 0 5 0 517661380 1046061056 228805 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 255386 228805 181 55 0 253272 0
[pid=31438/tid=31445] ppid=31436 vsize=1021544 CPUtime=939.94 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 81533 1260 0 0 93982 12 0 0 25 0 5 0 517661615 1046061056 228805 33554432000 4194304 4417332 140734969949488 18446744073709551615 4262524 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=1021544 CPUtime=939.94 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 112833 1260 0 0 93980 14 0 0 25 0 5 0 517661615 1046061056 228805 33554432000 4194304 4417332 140734969949488 18446744073709551615 4232770 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=1021544 CPUtime=939.96 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 84328 1260 0 0 93984 12 0 0 25 0 5 0 517661615 1046061056 228805 33554432000 4194304 4417332 140734969949488 18446744073709551615 4357978 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=1021544 CPUtime=934.83 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 338513 1260 0 0 93440 43 0 0 25 0 5 0 517661615 1046061056 228805 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364362 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3757.05
Current children cumulated vsize (KiB) 1021544

[startup+1002.3 s]
/proc/loadavg: 8.08 8.02 8.00 9/186 31514
/proc/meminfo: memFree=12125376/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=965432 CPUtime=3996.73 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 717217 1260 0 0 399573 100 0 0 25 0 5 0 517661380 988602368 214809 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 241358 214809 181 55 0 239244 0
[pid=31438/tid=31445] ppid=31436 vsize=965432 CPUtime=999.94 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 81533 1260 0 0 99982 12 0 0 25 0 5 0 517661615 988602368 214809 33554432000 4194304 4417332 140734969949488 18446744073709551615 4353463 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=965432 CPUtime=999.94 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 115522 1260 0 0 99979 15 0 0 25 0 5 0 517661615 988602368 214809 33554432000 4194304 4417332 140734969949488 18446744073709551615 4330532 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=965432 CPUtime=999.96 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 86576 1260 0 0 99983 13 0 0 25 0 5 0 517661615 988602368 214809 33554432000 4194304 4417332 140734969949488 18446744073709551615 4356771 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=965432 CPUtime=994.51 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 376390 1260 0 0 99402 49 0 0 25 0 5 0 517661615 988602368 214809 33554432000 4194304 4417332 140734969949488 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3996.73
Current children cumulated vsize (KiB) 965432

[startup+1062.3 s]
/proc/loadavg: 8.14 8.05 8.01 9/186 31516
/proc/meminfo: memFree=12185612/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=922580 CPUtime=4236.41 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 816258 1260 0 0 423524 117 0 0 25 0 5 0 517661380 944721920 204096 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 230645 204096 181 55 0 228531 0
[pid=31438/tid=31445] ppid=31436 vsize=922580 CPUtime=1059.94 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 82088 1260 0 0 105982 12 0 0 25 0 5 0 517661615 944721920 204096 33554432000 4194304 4417332 140734969949488 18446744073709551615 4263155 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=922580 CPUtime=1059.95 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 118965 1260 0 0 105979 16 0 0 25 0 5 0 517661615 944721920 204096 33554432000 4194304 4417332 140734969949488 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=922580 CPUtime=1059.96 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 89769 1260 0 0 105983 13 0 0 25 0 5 0 517661615 944721920 204096 33554432000 4194304 4417332 140734969949488 18446744073709551615 4355734 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=922580 CPUtime=1054.19 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 468240 1260 0 0 105354 65 0 0 25 0 5 0 517661615 944721920 204096 33554432000 4194304 4417332 140734969949488 18446744073709551615 4357926 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4236.41
Current children cumulated vsize (KiB) 922580

[startup+1122.3 s]
/proc/loadavg: 8.15 8.07 8.01 9/186 31518
/proc/meminfo: memFree=12067536/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=926916 CPUtime=4476.09 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 879557 1260 0 0 447484 125 0 0 25 0 5 0 517661380 949161984 205180 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 231729 205180 181 55 0 229615 0
[pid=31438/tid=31445] ppid=31436 vsize=926916 CPUtime=1119.94 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 82088 1260 0 0 111982 12 0 0 25 0 5 0 517661615 949161984 205180 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=926916 CPUtime=1119.94 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 122406 1260 0 0 111978 16 0 0 25 0 5 0 517661615 949161984 205180 33554432000 4194304 4417332 140734969949488 18446744073709551615 4358022 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=926916 CPUtime=1119.96 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 91489 1260 0 0 111983 13 0 0 25 0 5 0 517661615 949161984 205180 33554432000 4194304 4417332 140734969949488 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=926916 CPUtime=1113.86 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 526378 1260 0 0 111314 72 0 0 25 0 5 0 517661615 949161984 205180 33554432000 4194304 4417332 140734969949488 18446744073709551615 4352306 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4476.09
Current children cumulated vsize (KiB) 926916

[startup+1182.3 s]
/proc/loadavg: 8.10 8.07 8.01 9/186 31519
/proc/meminfo: memFree=11903572/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=998664 CPUtime=4715.77 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 915925 1260 0 0 471448 129 0 0 25 0 5 0 517661380 1022631936 223117 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 249666 223117 181 55 0 247552 0
[pid=31438/tid=31445] ppid=31436 vsize=998664 CPUtime=1179.94 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 83018 1260 0 0 117982 12 0 0 25 0 5 0 517661615 1022631936 223117 33554432000 4194304 4417332 140734969949488 18446744073709551615 4255662 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=998664 CPUtime=1179.95 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 124682 1260 0 0 117978 17 0 0 25 0 5 0 517661615 1022631936 223117 33554432000 4194304 4417332 140734969949488 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=998664 CPUtime=1179.97 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 93756 1260 0 0 117983 14 0 0 25 0 5 0 517661615 1022631936 223117 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=998664 CPUtime=1173.53 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 557273 1260 0 0 117278 75 0 0 25 0 5 0 517661615 1022631936 223117 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4715.77
Current children cumulated vsize (KiB) 998664



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.41 s]
/proc/loadavg: 8.14 8.08 8.02 9/186 31520
/proc/meminfo: memFree=11817748/32950928 swapFree=67111528/67111528
[pid=31438] ppid=31436 vsize=935392 CPUtime=4800.09 cores=1,3,5,7
/proc/31438/stat : 31438 (plingeling) S 31436 31438 31098 0 -1 4202496 940509 1260 0 0 479876 133 0 0 25 0 5 0 517661380 957841408 207299 33554432000 4194304 4417332 140734969949488 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/31438/statm: 233848 207299 181 55 0 231734 0
[pid=31438/tid=31445] ppid=31436 vsize=935392 CPUtime=1201.05 cores=1,3,5,7
/proc/31438/task/31445/stat : 31445 (plingeling) R 31436 31438 31098 0 -1 4202560 83018 1260 0 0 120093 12 0 0 25 0 5 0 517661615 957841408 207299 33554432000 4194304 4417332 140734969949488 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=31438/tid=31446] ppid=31436 vsize=935392 CPUtime=1201.06 cores=1,3,5,7
/proc/31438/task/31446/stat : 31446 (plingeling) R 31436 31438 31098 0 -1 4202560 126534 1260 0 0 120089 17 0 0 25 0 5 0 517661615 957841408 207299 33554432000 4194304 4417332 140734969949488 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=31438/tid=31447] ppid=31436 vsize=935392 CPUtime=1201.07 cores=1,3,5,7
/proc/31438/task/31447/stat : 31447 (plingeling) R 31436 31438 31098 0 -1 4202560 96609 1260 0 0 120093 14 0 0 25 0 5 0 517661615 957841408 207299 33554432000 4194304 4417332 140734969949488 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=31438/tid=31448] ppid=31436 vsize=935392 CPUtime=1194.52 cores=1,3,5,7
/proc/31438/task/31448/stat : 31448 (plingeling) R 31436 31438 31098 0 -1 4202560 577152 1260 0 0 119374 78 0 0 25 0 5 0 517661615 957841408 207299 33554432000 4194304 4417332 140734969949488 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.09
Current children cumulated vsize (KiB) 935392

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.45
CPU time (s): 4800.16
CPU user time (s): 4798.79
CPU system time (s): 1.37479
CPU usage (%): 398.866
Max. virtual memory (cumulated for all children) (KiB): 1223296

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.79
system time used= 1.37479
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 941769
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 204
involuntary context switches= 32599

runsolver used 1.80272 second user time and 4.77127 second system time

The end

Launcher Data 

Begin job on node125 at 2011-04-29 09:03:37
IDJOB=3285711
IDBENCH=82394
IDSOLVER=1605
FILE ID=node125/3285711-1304060615
RUNJOBID= node125-1304058205-31117
PBS_JOBID= 13170441
Free space on /tmp= 72700 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT11/application/rintanen/SATPlanning/sokoban-sequential-p145-microban-sequential.080-SAT.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3285711-1304060615/watcher-3285711-1304060615 -o /tmp/evaluation-result-3285711-1304060615/solver-3285711-1304060615 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3285711-1304060615.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1ca09a2b911e29894c6603aee8d3e672
RANDOM SEED=1712989249

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      13434580 kB
Buffers:       2219024 kB
Cached:       15057500 kB
SwapCached:          0 kB
Active:       10825544 kB
Inactive:      8155660 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      13434580 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           50448 kB
Writeback:           0 kB
AnonPages:     1703680 kB
Mapped:          15352 kB
Slab:           470056 kB
PageTables:       7756 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1892216 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72552 MiB
End job on node125 at 2011-04-29 09:23:43