Trace number 3371162

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.44 1202.77

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2400c266431gyes6.cnf
MD5SUMe23fefb786281285c1d045e8bc698d74
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371162-1305419263/watcher-3371162-1305419263 -o /tmp/evaluation-result-3371162-1305419263/solver-3371162-1305419263 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371162-1305419263.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.59 6.24 6.59 2/264 18598
/proc/meminfo: memFree=23108888/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 215 0 0 0 0 0 0 0 20 0 1 0 653524463 8937472 146 33554432000 4194304 4417452 140734034712768 18446744073709551615 246516834048 0 0 4096 0 18446744071562362840 0 0 17 2 0 0 0
/proc/18598/statm: 2182 146 122 55 0 68 0

[startup+0.0306981 s]
/proc/loadavg: 4.59 6.24 6.59 2/264 18598
/proc/meminfo: memFree=23108888/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=10556 CPUtime=0.01 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) R 18596 18598 17979 0 -1 4202496 716 1255 0 2 1 0 0 0 20 0 1 0 653524463 10809344 646 33554432000 4194304 4417452 140734034712768 18446744073709551615 246516834048 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/18598/statm: 2639 646 148 55 0 525 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 10556

[startup+0.1007 s]
/proc/loadavg: 4.59 6.24 6.59 2/264 18598
/proc/meminfo: memFree=23108888/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=26604 CPUtime=0.08 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) R 18596 18598 17979 0 -1 4202496 4712 1255 0 2 8 0 0 0 20 0 1 0 653524463 27242496 4642 33554432000 4194304 4417452 140734034712768 18446744073709551615 246516452864 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/18598/statm: 6651 4642 148 55 0 4537 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 26604

[startup+0.300585 s]
/proc/loadavg: 4.59 6.24 6.59 2/264 18598
/proc/meminfo: memFree=23108888/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=85004 CPUtime=0.58 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 9591 1255 0 2 58 0 0 0 20 0 5 0 653524463 87044096 9065 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 21251 9065 175 55 0 19137 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 85004

[startup+0.700513 s]
/proc/loadavg: 4.59 6.24 6.59 2/264 18598
/proc/meminfo: memFree=23108888/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=164024 CPUtime=2.18 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 21521 1255 0 2 216 2 0 0 20 0 5 0 653524463 167960576 12134 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 41006 12134 180 55 0 38892 0
Current children cumulated CPU time (s) 2.18
Current children cumulated vsize (KiB) 164024

[startup+1.50037 s]
/proc/loadavg: 4.59 6.24 6.59 10/271 18613
/proc/meminfo: memFree=23007032/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=173104 CPUtime=5.38 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 26320 1255 0 2 535 3 0 0 20 0 5 0 653524463 177258496 14712 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 43276 14712 180 55 0 41162 0
[pid=18598/tid=18610] ppid=18596 vsize=173104 CPUtime=1.3 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 3118 1255 0 2 130 0 0 0 25 0 5 0 653524482 177258496 14712 33554432000 4194304 4417452 140734034712768 18446744073709551615 4249577 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=173104 CPUtime=1.29 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 3411 1255 0 2 129 0 0 0 25 0 5 0 653524482 177258496 14712 33554432000 4194304 4417452 140734034712768 18446744073709551615 4236224 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=173104 CPUtime=1.29 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 3131 1255 0 2 129 0 0 0 25 0 5 0 653524482 177258496 14712 33554432000 4194304 4417452 140734034712768 18446744073709551615 4336723 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=173104 CPUtime=1.29 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 7840 1255 0 2 129 0 0 0 25 0 5 0 653524482 177258496 14712 33554432000 4194304 4417452 140734034712768 18446744073709551615 4250502 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.38
Current children cumulated vsize (KiB) 173104

[startup+3.10107 s]
/proc/loadavg: 4.86 6.27 6.60 10/271 18613
/proc/meminfo: memFree=22994508/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=187396 CPUtime=11.77 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 39630 1255 0 2 1173 4 0 0 20 0 5 0 653524463 191893504 18285 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 46849 18285 180 55 0 44735 0
[pid=18598/tid=18610] ppid=18596 vsize=187396 CPUtime=2.9 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 4356 1255 0 2 290 0 0 0 25 0 5 0 653524482 191893504 18285 33554432000 4194304 4417452 140734034712768 18446744073709551615 4236224 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=187396 CPUtime=2.89 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 4649 1255 0 2 289 0 0 0 25 0 5 0 653524482 191893504 18285 33554432000 4194304 4417452 140734034712768 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=187396 CPUtime=2.89 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 3131 1255 0 2 289 0 0 0 25 0 5 0 653524482 191893504 18285 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=187396 CPUtime=2.88 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 18674 1255 0 2 287 1 0 0 25 0 5 0 653524482 191893504 18285 33554432000 4194304 4417452 140734034712768 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.77
Current children cumulated vsize (KiB) 187396

[startup+6.30049 s]
/proc/loadavg: 4.86 6.27 6.60 10/271 18613
/proc/meminfo: memFree=22952096/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=194956 CPUtime=24.54 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 52285 1255 0 2 2448 6 0 0 20 0 5 0 653524463 199634944 19664 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 48739 19664 180 55 0 46625 0
[pid=18598/tid=18610] ppid=18596 vsize=194956 CPUtime=6.1 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 4356 1255 0 2 610 0 0 0 25 0 5 0 653524482 199634944 19664 33554432000 4194304 4417452 140734034712768 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=194956 CPUtime=6.09 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 4649 1255 0 2 609 0 0 0 25 0 5 0 653524482 199634944 19664 33554432000 4194304 4417452 140734034712768 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=194956 CPUtime=6.09 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 3716 1255 0 2 609 0 0 0 25 0 5 0 653524482 199634944 19664 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=194956 CPUtime=6.06 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 30744 1255 0 2 602 4 0 0 25 0 5 0 653524482 199634944 19664 33554432000 4194304 4417452 140734034712768 18446744073709551615 4250502 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.54
Current children cumulated vsize (KiB) 194956

[startup+12.7003 s]
/proc/loadavg: 5.34 6.32 6.61 10/271 18613
/proc/meminfo: memFree=22883636/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=203996 CPUtime=50.08 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 83960 1255 0 2 4996 12 0 0 20 0 5 0 653524463 208891904 22435 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 50999 22435 180 55 0 48885 0
[pid=18598/tid=18610] ppid=18596 vsize=203996 CPUtime=12.5 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 5594 1255 0 2 1250 0 0 0 25 0 5 0 653524482 208891904 22435 33554432000 4194304 4417452 140734034712768 18446744073709551615 4249158 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=203996 CPUtime=12.49 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 5887 1255 0 2 1249 0 0 0 25 0 5 0 653524482 208891904 22435 33554432000 4194304 4417452 140734034712768 18446744073709551615 4248893 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=203996 CPUtime=12.49 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 3716 1255 0 2 1249 0 0 0 25 0 5 0 653524482 208891904 22435 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=203996 CPUtime=12.4 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 59943 1255 0 2 1231 9 0 0 25 0 5 0 653524482 208891904 22435 33554432000 4194304 4417452 140734034712768 18446744073709551615 4356980 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.08
Current children cumulated vsize (KiB) 203996

[startup+25.501 s]
/proc/loadavg: 5.91 6.41 6.64 10/271 18613
/proc/meminfo: memFree=22757544/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=295020 CPUtime=101.18 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 129650 1255 0 2 10101 17 0 0 20 0 5 0 653524463 302100480 45191 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 73755 45191 180 55 0 71641 0
[pid=18598/tid=18610] ppid=18596 vsize=295020 CPUtime=25.3 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 6582 1255 0 2 2530 0 0 0 25 0 5 0 653524482 302100480 45191 33554432000 4194304 4417452 140734034712768 18446744073709551615 4250961 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=295020 CPUtime=25.29 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 5887 1255 0 2 2529 0 0 0 25 0 5 0 653524482 302100480 45191 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=295020 CPUtime=25.29 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 6253 1255 0 2 2529 0 0 0 25 0 5 0 653524482 302100480 45191 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=295020 CPUtime=25.09 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 102108 1255 0 2 2495 14 0 0 25 0 5 0 653524482 302100480 45191 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.18
Current children cumulated vsize (KiB) 295020

[startup+51.1003 s]
/proc/loadavg: 6.78 6.57 6.68 10/271 18614
/proc/meminfo: memFree=22521284/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=439308 CPUtime=203.37 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 199877 1255 0 2 20309 28 0 0 20 0 5 0 653524463 449851392 81263 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 109827 81263 180 55 0 107713 0
[pid=18598/tid=18610] ppid=18596 vsize=439308 CPUtime=50.9 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 8945 1255 0 2 5090 0 0 0 25 0 5 0 653524482 449851392 81263 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=439308 CPUtime=50.89 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 7601 1255 0 2 5088 1 0 0 25 0 5 0 653524482 449851392 81263 33554432000 4194304 4417452 140734034712768 18446744073709551615 4244345 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=439308 CPUtime=50.88 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 7816 1255 0 2 5088 0 0 0 25 0 5 0 653524482 449851392 81263 33554432000 4194304 4417452 140734034712768 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=439308 CPUtime=50.49 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 166695 1255 0 2 5025 24 0 0 25 0 5 0 653524482 449851392 81263 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.37
Current children cumulated vsize (KiB) 439308

[startup+102.31 s]
/proc/loadavg: 7.55 6.82 6.76 10/271 18615
/proc/meminfo: memFree=22408808/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=384040 CPUtime=407.78 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 332546 1255 0 2 40732 46 0 0 20 0 5 0 653524463 393256960 67446 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 96010 67446 180 55 0 93896 0
[pid=18598/tid=18610] ppid=18596 vsize=384040 CPUtime=102.11 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 11585 1255 0 2 10211 0 0 0 25 0 5 0 653524482 393256960 67446 33554432000 4194304 4417452 140734034712768 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=384040 CPUtime=102.1 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 8652 1255 0 2 10209 1 0 0 25 0 5 0 653524482 393256960 67446 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=384040 CPUtime=102.09 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 11697 1255 0 2 10208 1 0 0 25 0 5 0 653524482 393256960 67446 33554432000 4194304 4417452 140734034712768 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=384040 CPUtime=101.27 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 291792 1255 0 2 10086 41 0 0 25 0 5 0 653524482 393256960 67446 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 407.78
Current children cumulated vsize (KiB) 384040

[startup+162.301 s]
/proc/loadavg: 8.01 7.09 6.86 10/271 18617
/proc/meminfo: memFree=22065668/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=720956 CPUtime=647.26 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 417645 1255 0 2 64667 59 0 0 20 0 5 0 653524463 738258944 151675 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 180239 151675 180 55 0 178125 0
[pid=18598/tid=18610] ppid=18596 vsize=720956 CPUtime=162.11 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 15421 1255 0 2 16210 1 0 0 25 0 5 0 653524482 738258944 151675 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=720956 CPUtime=162.09 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 9934 1255 0 2 16208 1 0 0 25 0 5 0 653524482 738258944 151675 33554432000 4194304 4417452 140734034712768 18446744073709551615 4355852 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=720956 CPUtime=162.08 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 13740 1255 0 2 16207 1 0 0 25 0 5 0 653524482 738258944 151675 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=720956 CPUtime=160.79 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 369730 1255 0 2 16025 54 0 0 25 0 5 0 653524482 738258944 151675 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 647.26
Current children cumulated vsize (KiB) 720956


################
# More data... #
################

[pid=18598/tid=18611] ppid=18596 vsize=1613228 CPUtime=762.12 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 43143 1255 0 2 76206 6 0 0 25 0 5 0 653524482 1651945472 374775 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=1613228 CPUtime=762 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 33457 1255 0 2 76197 3 0 0 25 0 5 0 653524482 1651945472 374775 33554432000 4194304 4417452 140734034712768 18446744073709551615 4354244 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=1613228 CPUtime=755.91 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 835679 1255 0 2 75470 121 0 0 25 0 5 0 653524482 1651945472 374775 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364896 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3042.36
Current children cumulated vsize (KiB) 1613228

[startup+822.301 s]
/proc/loadavg: 8.20 8.09 7.53 10/271 18635
/proc/meminfo: memFree=20229248/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=1670960 CPUtime=3281.84 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 994367 1255 0 2 328042 142 0 0 20 0 5 0 653524463 1711063040 389208 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 417740 389208 180 55 0 415626 0
[pid=18598/tid=18610] ppid=18596 vsize=1670960 CPUtime=822.12 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 58835 1255 0 2 82205 7 0 0 25 0 5 0 653524482 1711063040 389208 33554432000 4194304 4417452 140734034712768 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=1670960 CPUtime=822.11 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 43143 1255 0 2 82205 6 0 0 25 0 5 0 653524482 1711063040 389208 33554432000 4194304 4417452 140734034712768 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=1670960 CPUtime=821.99 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 33457 1255 0 2 82196 3 0 0 25 0 5 0 653524482 1711063040 389208 33554432000 4194304 4417452 140734034712768 18446744073709551615 4259600 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=1670960 CPUtime=815.42 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 850112 1255 0 2 81418 124 0 0 25 0 5 0 653524482 1711063040 389208 33554432000 4194304 4417452 140734034712768 18446744073709551615 4366169 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3281.84
Current children cumulated vsize (KiB) 1670960

[startup+882.301 s]
/proc/loadavg: 8.18 8.10 7.57 10/271 18636
/proc/meminfo: memFree=19974792/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=1670960 CPUtime=3521.34 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 994367 1255 0 2 351992 142 0 0 20 0 5 0 653524463 1711063040 389208 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 417740 389208 180 55 0 415626 0
[pid=18598/tid=18610] ppid=18596 vsize=1670960 CPUtime=882.12 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 58835 1255 0 2 88205 7 0 0 25 0 5 0 653524482 1711063040 389208 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=1670960 CPUtime=882.11 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 43143 1255 0 2 88205 6 0 0 25 0 5 0 653524482 1711063040 389208 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=1670960 CPUtime=881.99 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 33457 1255 0 2 88196 3 0 0 25 0 5 0 653524482 1711063040 389208 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=1670960 CPUtime=874.92 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 850112 1255 0 2 87368 124 0 0 25 0 5 0 653524482 1711063040 389208 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3521.34
Current children cumulated vsize (KiB) 1670960

[startup+942.301 s]
/proc/loadavg: 8.19 8.12 7.61 10/271 18638
/proc/meminfo: memFree=20581496/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=1065388 CPUtime=3760.85 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 1066189 1255 0 2 375928 157 0 0 20 0 5 0 653524463 1090957312 237815 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 266347 237815 180 55 0 264233 0
[pid=18598/tid=18610] ppid=18596 vsize=1065388 CPUtime=942.12 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 58835 1255 0 2 94205 7 0 0 25 0 5 0 653524482 1090957312 237815 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=1065388 CPUtime=942.12 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 43143 1255 0 2 94206 6 0 0 25 0 5 0 653524482 1090957312 237815 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=1065388 CPUtime=941.97 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 33457 1255 0 2 94194 3 0 0 25 0 5 0 653524482 1090957312 237815 33554432000 4194304 4417452 140734034712768 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=1065388 CPUtime=934.44 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 921934 1255 0 2 93305 139 0 0 25 0 5 0 653524482 1090957312 237815 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3760.85
Current children cumulated vsize (KiB) 1065388

[startup+1002.3 s]
/proc/loadavg: 8.37 8.17 7.66 10/271 18639
/proc/meminfo: memFree=20238368/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=1123908 CPUtime=4000.36 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 1097466 1255 0 2 399875 161 0 0 20 0 5 0 653524463 1150881792 252413 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 280977 252413 180 55 0 278863 0
[pid=18598/tid=18610] ppid=18596 vsize=1123908 CPUtime=1002.12 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 60016 1255 0 2 100205 7 0 0 25 0 5 0 653524482 1150881792 252413 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=1123908 CPUtime=1002.11 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 48536 1255 0 2 100205 6 0 0 25 0 5 0 653524482 1150881792 252413 33554432000 4194304 4417452 140734034712768 18446744073709551615 4343993 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=1123908 CPUtime=1001.97 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 33457 1255 0 2 100194 3 0 0 25 0 5 0 653524482 1150881792 252413 33554432000 4194304 4417452 140734034712768 18446744073709551615 4270282 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=1123908 CPUtime=993.94 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 946637 1255 0 2 99253 141 0 0 25 0 5 0 653524482 1150881792 252413 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4000.36
Current children cumulated vsize (KiB) 1123908

[startup+1062.3 s]
/proc/loadavg: 8.34 8.19 7.69 10/271 18641
/proc/meminfo: memFree=20011548/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=1277964 CPUtime=4239.88 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 1135980 1255 0 2 423823 165 0 0 20 0 5 0 653524463 1308635136 290927 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 319491 290927 180 55 0 317377 0
[pid=18598/tid=18610] ppid=18596 vsize=1277964 CPUtime=1062.13 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 64112 1255 0 2 106205 8 0 0 25 0 5 0 653524482 1308635136 290927 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=1277964 CPUtime=1062.12 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 56212 1255 0 2 106205 7 0 0 25 0 5 0 653524482 1308635136 290927 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=1277964 CPUtime=1061.97 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 38001 1255 0 2 106193 4 0 0 25 0 5 0 653524482 1308635136 290927 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=1277964 CPUtime=1053.46 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 968835 1255 0 2 105203 143 0 0 25 0 5 0 653524482 1308635136 290927 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4239.88
Current children cumulated vsize (KiB) 1277964

[startup+1122.3 s]
/proc/loadavg: 8.26 8.18 7.72 10/271 18643
/proc/meminfo: memFree=19930068/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=1358764 CPUtime=4479.38 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 1156180 1255 0 2 447771 167 0 0 20 0 5 0 653524463 1391374336 311127 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 339691 311127 180 55 0 337577 0
[pid=18598/tid=18610] ppid=18596 vsize=1358764 CPUtime=1122.13 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 64112 1255 0 2 112205 8 0 0 25 0 5 0 653524482 1391374336 311127 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=1358764 CPUtime=1122.12 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 56212 1255 0 2 112205 7 0 0 25 0 5 0 653524482 1391374336 311127 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=1358764 CPUtime=1121.96 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 38001 1255 0 2 112192 4 0 0 25 0 5 0 653524482 1391374336 311127 33554432000 4194304 4417452 140734034712768 18446744073709551615 4320831 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=1358764 CPUtime=1112.97 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 989035 1255 0 2 111152 145 0 0 25 0 5 0 653524482 1391374336 311127 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4479.38
Current children cumulated vsize (KiB) 1358764

[startup+1182.3 s]
/proc/loadavg: 8.09 8.15 7.73 11/271 18644
/proc/meminfo: memFree=20722296/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=1380204 CPUtime=4718.89 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 1182093 1255 0 2 471720 169 0 0 20 0 5 0 653524463 1413328896 316487 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 345051 316487 180 55 0 342937 0
[pid=18598/tid=18610] ppid=18596 vsize=1380204 CPUtime=1182.13 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 64112 1255 0 2 118205 8 0 0 25 0 5 0 653524482 1413328896 316487 33554432000 4194304 4417452 140734034712768 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=1380204 CPUtime=1182.12 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 61275 1255 0 2 118204 8 0 0 25 0 5 0 653524482 1413328896 316487 33554432000 4194304 4417452 140734034712768 18446744073709551615 4358937 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=1380204 CPUtime=1181.96 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 42487 1255 0 2 118191 5 0 0 25 0 5 0 653524482 1413328896 316487 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=1380204 CPUtime=1172.49 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 1005399 1255 0 2 117102 147 0 0 25 0 5 0 653524482 1413328896 316487 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4718.89
Current children cumulated vsize (KiB) 1380204



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.7 s]
/proc/loadavg: 8.07 8.14 7.74 5/266 18646
/proc/meminfo: memFree=21676388/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=1541804 CPUtime=4800.34 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 1222493 1255 0 2 479856 178 0 0 20 0 5 0 653524463 1578807296 356887 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 385451 356887 180 55 0 383337 0
[pid=18598/tid=18610] ppid=18596 vsize=1541804 CPUtime=1202.54 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 64112 1255 0 2 120246 8 0 0 25 0 5 0 653524482 1578807296 356887 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=1541804 CPUtime=1202.53 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 61275 1255 0 2 120245 8 0 0 25 0 5 0 653524482 1578807296 356887 33554432000 4194304 4417452 140734034712768 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=1541804 CPUtime=1202.37 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 42487 1255 0 2 120232 5 0 0 25 0 5 0 653524482 1578807296 356887 33554432000 4194304 4417452 140734034712768 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=1541804 CPUtime=1192.71 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 1045799 1255 0 2 119116 155 0 0 25 0 5 0 653524482 1578807296 356887 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 1541804

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.7 s]
/proc/loadavg: 8.07 8.14 7.74 5/266 18646
/proc/meminfo: memFree=21676388/32951124 swapFree=61565116/67111528
[pid=18598] ppid=18596 vsize=1541804 CPUtime=4800.34 cores=0,2,4,6
/proc/18598/stat : 18598 (plingeling) S 18596 18598 17979 0 -1 4202496 1222493 1255 0 2 479856 178 0 0 20 0 5 0 653524463 1578807296 356887 33554432000 4194304 4417452 140734034712768 18446744073709551615 246528636901 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/18598/statm: 385451 356887 180 55 0 383337 0
[pid=18598/tid=18610] ppid=18596 vsize=1541804 CPUtime=1202.54 cores=0,2,4,6
/proc/18598/task/18610/stat : 18610 (plingeling) R 18596 18598 17979 0 -1 4202560 64112 1255 0 2 120246 8 0 0 25 0 5 0 653524482 1578807296 356887 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=18598/tid=18611] ppid=18596 vsize=1541804 CPUtime=1202.53 cores=0,2,4,6
/proc/18598/task/18611/stat : 18611 (plingeling) R 18596 18598 17979 0 -1 4202560 61275 1255 0 2 120245 8 0 0 25 0 5 0 653524482 1578807296 356887 33554432000 4194304 4417452 140734034712768 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=18598/tid=18612] ppid=18596 vsize=1541804 CPUtime=1202.37 cores=0,2,4,6
/proc/18598/task/18612/stat : 18612 (plingeling) R 18596 18598 17979 0 -1 4202560 42487 1255 0 2 120232 5 0 0 25 0 5 0 653524482 1578807296 356887 33554432000 4194304 4417452 140734034712768 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=18598/tid=18613] ppid=18596 vsize=1541804 CPUtime=1192.71 cores=0,2,4,6
/proc/18598/task/18613/stat : 18613 (plingeling) R 18596 18598 17979 0 -1 4202560 1045799 1255 0 2 119116 155 0 0 25 0 5 0 653524482 1578807296 356887 33554432000 4194304 4417452 140734034712768 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 1541804

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.77
CPU time (s): 4800.44
CPU user time (s): 4798.59
CPU system time (s): 1.84072
CPU usage (%): 399.116
Max. virtual memory (cumulated for all children) (KiB): 1853704

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.59
system time used= 1.84072
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1223749
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 112
involuntary context switches= 80175

runsolver used 2.95955 second user time and 6.88095 second system time

The end

Launcher Data 

Begin job on node134 at 2011-05-15 02:27:43
IDJOB=3371162
IDBENCH=71366
IDSOLVER=1848
FILE ID=node134/3371162-1305419263
RUNJOBID= node134-1305419262-18574
PBS_JOBID= 13324561
Free space on /tmp= 73444 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2400c266431gyes6.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371162-1305419263/watcher-3371162-1305419263 -o /tmp/evaluation-result-3371162-1305419263/solver-3371162-1305419263 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371162-1305419263.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e23fefb786281285c1d045e8bc698d74
RANDOM SEED=134722660

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23110012 kB
Buffers:        263312 kB
Cached:        6030504 kB
SwapCached:      13768 kB
Active:         930384 kB
Inactive:      8696400 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23110012 kB
SwapTotal:    67111528 kB
SwapFree:     61565116 kB
Dirty:            6244 kB
Writeback:           0 kB
AnonPages:     3326760 kB
Mapped:          12188 kB
Slab:           122660 kB
PageTables:      31384 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 38885148 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73448 MiB
End job on node134 at 2011-05-15 02:47:47