Trace number 3258514

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.26 1201.75

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2100c215164gyes7.cnf
MD5SUM140eea74f7e66501965365160d02fa4d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2100
Number of clauses215164
Sum of the clauses size432288
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2215094
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 570

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3258514-1304050554/watcher-3258514-1304050554 -o /tmp/evaluation-result-3258514-1304050554/solver-3258514-1304050554 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3258514-1304050554.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.02 8.04 7.60 3/177 3886
/proc/meminfo: memFree=31784288/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=8728 CPUtime=0 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) R 3884 3886 3183 0 -1 4202496 267 1261 0 0 0 0 0 0 25 0 1 0 497471028 8937472 195 33554432000 4194304 4417332 140733284836768 18446744073709551615 270338044613 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/3886/statm: 2182 199 145 55 0 68 0

[startup+0.05167 s]
/proc/loadavg: 8.02 8.04 7.60 3/177 3886
/proc/meminfo: memFree=31784288/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=18384 CPUtime=0.04 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) R 3884 3886 3183 0 -1 4202496 2658 1261 0 0 4 0 0 0 25 0 1 0 497471028 18825216 2586 33554432000 4194304 4417332 140733284836768 18446744073709551615 4209589 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/3886/statm: 4596 2586 147 55 0 2482 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 18384

[startup+0.100662 s]
/proc/loadavg: 8.02 8.04 7.60 3/177 3886
/proc/meminfo: memFree=31784288/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=26576 CPUtime=0.09 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) R 3884 3886 3183 0 -1 4202496 4706 1261 0 0 9 0 0 0 25 0 1 0 497471028 27213824 4634 33554432000 4194304 4417332 140733284836768 18446744073709551615 270338383616 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/3886/statm: 6644 4634 147 55 0 4530 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26576

[startup+0.300587 s]
/proc/loadavg: 8.02 8.04 7.60 3/177 3886
/proc/meminfo: memFree=31784288/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=70472 CPUtime=0.75 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 5728 1261 0 0 75 0 0 0 25 0 5 0 497471028 72163328 5433 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 17618 5433 176 55 0 15504 0
Current children cumulated CPU time (s) 0.75
Current children cumulated vsize (KiB) 70472

[startup+0.700506 s]
/proc/loadavg: 8.02 8.04 7.60 3/177 3886
/proc/meminfo: memFree=31784288/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=148884 CPUtime=2.35 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 17610 1261 0 0 233 2 0 0 25 0 5 0 497471028 152457216 8657 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 37221 8657 180 55 0 35107 0
Current children cumulated CPU time (s) 2.35
Current children cumulated vsize (KiB) 148884

[startup+1.50035 s]
/proc/loadavg: 8.02 8.04 7.60 10/186 3901
/proc/meminfo: memFree=31687248/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=164964 CPUtime=5.54 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 23964 1261 0 0 552 2 0 0 25 0 5 0 497471028 168923136 12181 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 41241 12181 181 55 0 39127 0
[pid=3886/tid=3893] ppid=3884 vsize=164964 CPUtime=1.35 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 4294 1261 0 0 135 0 0 0 25 0 5 0 497471042 168923136 12181 33554432000 4194304 4417332 140733284836768 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=164964 CPUtime=1.35 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 3791 1261 0 0 135 0 0 0 25 0 5 0 497471042 168923136 12181 33554432000 4194304 4417332 140733284836768 18446744073709551615 4258604 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=164964 CPUtime=1.34 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 4655 1261 0 0 134 0 0 0 25 0 5 0 497471042 168923136 12181 33554432000 4194304 4417332 140733284836768 18446744073709551615 4249897 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=164964 CPUtime=1.33 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 6506 1261 0 0 133 0 0 0 25 0 5 0 497471042 168923136 12181 33554432000 4194304 4417332 140733284836768 18446744073709551615 270338077667 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.54
Current children cumulated vsize (KiB) 164964

[startup+3.10103 s]
/proc/loadavg: 8.02 8.03 7.60 10/186 3901
/proc/meminfo: memFree=31666912/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=188456 CPUtime=11.94 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 32806 1261 0 0 1191 3 0 0 25 0 5 0 497471028 192978944 18485 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 47114 18485 181 55 0 45000 0
[pid=3886/tid=3893] ppid=3884 vsize=188456 CPUtime=2.95 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 5380 1261 0 0 295 0 0 0 25 0 5 0 497471042 192978944 18485 33554432000 4194304 4417332 140733284836768 18446744073709551615 4236311 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=188456 CPUtime=2.95 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 4877 1261 0 0 295 0 0 0 25 0 5 0 497471042 192978944 18485 33554432000 4194304 4417332 140733284836768 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=188456 CPUtime=2.94 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 4655 1261 0 0 294 0 0 0 25 0 5 0 497471042 192978944 18485 33554432000 4194304 4417332 140733284836768 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=188456 CPUtime=2.93 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 13176 1261 0 0 292 1 0 0 25 0 5 0 497471042 192978944 18485 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.94
Current children cumulated vsize (KiB) 188456

[startup+6.3004 s]
/proc/loadavg: 8.02 8.03 7.60 9/186 3901
/proc/meminfo: memFree=31639952/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=202592 CPUtime=24.72 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 46069 1261 0 0 2467 5 0 0 25 0 5 0 497471028 207454208 22019 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 50648 22019 181 55 0 48534 0
[pid=3886/tid=3893] ppid=3884 vsize=202592 CPUtime=6.15 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 5380 1261 0 0 615 0 0 0 25 0 5 0 497471042 207454208 22019 33554432000 4194304 4417332 140733284836768 18446744073709551615 4249193 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=202592 CPUtime=6.15 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 4877 1261 0 0 615 0 0 0 25 0 5 0 497471042 207454208 22019 33554432000 4194304 4417332 140733284836768 18446744073709551615 4239418 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=202592 CPUtime=6.14 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 4655 1261 0 0 614 0 0 0 25 0 5 0 497471042 207454208 22019 33554432000 4194304 4417332 140733284836768 18446744073709551615 4258491 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=202592 CPUtime=6.11 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 26439 1261 0 0 608 3 0 0 25 0 5 0 497471042 207454208 22019 33554432000 4194304 4417332 140733284836768 18446744073709551615 4321697 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.72
Current children cumulated vsize (KiB) 202592

[startup+12.7011 s]
/proc/loadavg: 8.09 8.05 7.61 10/186 3901
/proc/meminfo: memFree=31579344/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=237480 CPUtime=50.3 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 72039 1261 0 0 5021 9 0 0 25 0 5 0 497471028 243179520 30807 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 59370 30807 181 55 0 57256 0
[pid=3886/tid=3893] ppid=3884 vsize=237480 CPUtime=12.55 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 6465 1261 0 0 1255 0 0 0 25 0 5 0 497471042 243179520 30807 33554432000 4194304 4417332 140733284836768 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=237480 CPUtime=12.55 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 5962 1261 0 0 1255 0 0 0 25 0 5 0 497471042 243179520 30807 33554432000 4194304 4417332 140733284836768 18446744073709551615 4236427 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=237480 CPUtime=12.54 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 4655 1261 0 0 1254 0 0 0 25 0 5 0 497471042 243179520 30807 33554432000 4194304 4417332 140733284836768 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=237480 CPUtime=12.49 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 50239 1261 0 0 1242 7 0 0 25 0 5 0 497471042 243179520 30807 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.3
Current children cumulated vsize (KiB) 237480

[startup+25.5006 s]
/proc/loadavg: 8.08 8.05 7.61 9/186 3901
/proc/meminfo: memFree=31430892/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=286732 CPUtime=101.43 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 107547 1261 0 0 10129 14 0 0 25 0 5 0 497471028 293613568 43120 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 71683 43120 181 55 0 69569 0
[pid=3886/tid=3893] ppid=3884 vsize=286732 CPUtime=25.35 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 7222 1261 0 0 2535 0 0 0 25 0 5 0 497471042 293613568 43120 33554432000 4194304 4417332 140733284836768 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=286732 CPUtime=25.34 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 5962 1261 0 0 2534 0 0 0 25 0 5 0 497471042 293613568 43120 33554432000 4194304 4417332 140733284836768 18446744073709551615 4235713 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=286732 CPUtime=25.35 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 7942 1261 0 0 2534 1 0 0 25 0 5 0 497471042 293613568 43120 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=286732 CPUtime=25.22 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 81703 1261 0 0 2511 11 0 0 25 0 5 0 497471042 293613568 43120 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.43
Current children cumulated vsize (KiB) 286732

[startup+51.1005 s]
/proc/loadavg: 8.11 8.06 7.63 10/186 3902
/proc/meminfo: memFree=31327556/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=380528 CPUtime=203.71 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 166353 1261 0 0 20348 23 0 0 25 0 5 0 497471028 389660672 66569 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 95132 66569 181 55 0 93018 0
[pid=3886/tid=3893] ppid=3884 vsize=380528 CPUtime=50.95 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 9140 1261 0 0 5094 1 0 0 25 0 5 0 497471042 389660672 66569 33554432000 4194304 4417332 140733284836768 18446744073709551615 4250771 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=380528 CPUtime=50.94 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 6891 1261 0 0 5094 0 0 0 25 0 5 0 497471042 389660672 66569 33554432000 4194304 4417332 140733284836768 18446744073709551615 18446744073699065863 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=380528 CPUtime=50.95 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 9806 1261 0 0 5094 1 0 0 25 0 5 0 497471042 389660672 66569 33554432000 4194304 4417332 140733284836768 18446744073709551615 4258377 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=380528 CPUtime=50.7 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 135798 1261 0 0 5051 19 0 0 25 0 5 0 497471042 389660672 66569 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.71
Current children cumulated vsize (KiB) 380528

[startup+102.306 s]
/proc/loadavg: 8.11 8.06 7.65 10/186 3903
/proc/meminfo: memFree=31054356/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=545260 CPUtime=408.28 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 250228 1261 0 0 40792 36 0 0 25 0 5 0 497471028 558346240 107752 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 136315 107752 181 55 0 134201 0
[pid=3886/tid=3893] ppid=3884 vsize=545260 CPUtime=102.16 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 11088 1261 0 0 10215 1 0 0 25 0 5 0 497471042 558346240 107752 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=545260 CPUtime=102.15 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 7857 1261 0 0 10215 0 0 0 25 0 5 0 497471042 558346240 107752 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=545260 CPUtime=102.15 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 12727 1261 0 0 10214 1 0 0 25 0 5 0 497471042 558346240 107752 33554432000 4194304 4417332 140733284836768 18446744073709551615 4356760 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=545260 CPUtime=101.64 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 213838 1261 0 0 10133 31 0 0 25 0 5 0 497471042 558346240 107752 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.28
Current children cumulated vsize (KiB) 545260

[startup+162.3 s]
/proc/loadavg: 8.11 8.07 7.67 10/186 3905
/proc/meminfo: memFree=30724000/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=554384 CPUtime=647.96 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 330002 1261 0 0 64750 46 0 0 25 0 5 0 497471028 567689216 110033 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 138596 110033 181 55 0 136482 0
[pid=3886/tid=3893] ppid=3884 vsize=554384 CPUtime=162.15 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 15430 1261 0 0 16214 1 0 0 25 0 5 0 497471042 567689216 110033 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364736 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=554384 CPUtime=162.15 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 8014 1261 0 0 16215 0 0 0 25 0 5 0 497471042 567689216 110033 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=554384 CPUtime=162.15 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 15155 1261 0 0 16213 2 0 0 25 0 5 0 497471042 567689216 110033 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=554384 CPUtime=161.33 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 286685 1261 0 0 16093 40 0 0 25 0 5 0 497471042 567689216 110033 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 647.96
Current children cumulated vsize (KiB) 554384


################
# More data... #
################

[pid=3886/tid=3894] ppid=3884 vsize=1367952 CPUtime=762.18 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 38615 1261 0 0 76214 4 0 0 25 0 5 0 497471042 1400782848 313425 33554432000 4194304 4417332 140733284836768 18446744073709551615 4353615 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=1367952 CPUtime=762.18 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 60836 1261 0 0 76211 7 0 0 25 0 5 0 497471042 1400782848 313425 33554432000 4194304 4417332 140733284836768 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=1367952 CPUtime=758.18 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 726778 1261 0 0 75718 100 0 0 25 0 5 0 497471042 1400782848 313425 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3044.9
Current children cumulated vsize (KiB) 1367952

[startup+822.3 s]
/proc/loadavg: 8.09 8.11 7.89 10/186 3925
/proc/meminfo: memFree=28911260/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=1455580 CPUtime=3284.56 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 876811 1261 0 0 328339 117 0 0 25 0 5 0 497471028 1490513920 335332 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 363895 335332 181 55 0 361781 0
[pid=3886/tid=3893] ppid=3884 vsize=1455580 CPUtime=822.18 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 23957 1261 0 0 82216 2 0 0 25 0 5 0 497471042 1490513920 335332 33554432000 4194304 4417332 140733284836768 18446744073709551615 4263011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=1455580 CPUtime=822.18 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 40663 1261 0 0 82214 4 0 0 25 0 5 0 497471042 1490513920 335332 33554432000 4194304 4417332 140733284836768 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=1455580 CPUtime=822.18 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 60836 1261 0 0 82211 7 0 0 25 0 5 0 497471042 1490513920 335332 33554432000 4194304 4417332 140733284836768 18446744073709551615 4366359 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=1455580 CPUtime=817.85 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 746637 1261 0 0 81683 102 0 0 25 0 5 0 497471042 1490513920 335332 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3284.56
Current children cumulated vsize (KiB) 1455580

[startup+882.301 s]
/proc/loadavg: 8.21 8.13 7.91 10/186 3927
/proc/meminfo: memFree=28534256/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=1647872 CPUtime=3524.24 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 940227 1261 0 0 352300 124 0 0 25 0 5 0 497471028 1687420928 383437 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 411968 383437 181 55 0 409854 0
[pid=3886/tid=3893] ppid=3884 vsize=1647872 CPUtime=882.18 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 23957 1261 0 0 88216 2 0 0 25 0 5 0 497471042 1687420928 383437 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=1647872 CPUtime=882.18 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 40663 1261 0 0 88214 4 0 0 25 0 5 0 497471042 1687420928 383437 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=1647872 CPUtime=882.18 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 60836 1261 0 0 88211 7 0 0 25 0 5 0 497471042 1687420928 383437 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=1647872 CPUtime=877.53 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 810053 1261 0 0 87644 109 0 0 25 0 5 0 497471042 1687420928 383437 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3524.24
Current children cumulated vsize (KiB) 1647872

[startup+942.301 s]
/proc/loadavg: 8.15 8.12 7.91 10/186 3929
/proc/meminfo: memFree=29227772/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=1713408 CPUtime=3763.94 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 958730 1261 0 0 376268 126 0 0 25 0 5 0 497471028 1754529792 401803 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 428352 401803 181 55 0 426238 0
[pid=3886/tid=3893] ppid=3884 vsize=1713408 CPUtime=942.18 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 23957 1261 0 0 94216 2 0 0 25 0 5 0 497471042 1754529792 401803 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=1713408 CPUtime=942.18 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 40663 1261 0 0 94214 4 0 0 25 0 5 0 497471042 1754529792 401803 33554432000 4194304 4417332 140733284836768 18446744073709551615 4250548 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=1713408 CPUtime=942.19 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 79339 1261 0 0 94210 9 0 0 25 0 5 0 497471042 1754529792 401803 33554432000 4194304 4417332 140733284836768 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=1713408 CPUtime=937.21 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 810053 1261 0 0 93612 109 0 0 25 0 5 0 497471042 1754529792 401803 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3763.94
Current children cumulated vsize (KiB) 1713408

[startup+1002.3 s]
/proc/loadavg: 8.09 8.11 7.92 10/186 3930
/proc/meminfo: memFree=28751216/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=1998356 CPUtime=4003.62 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 1061806 1261 0 0 400218 144 0 0 25 0 5 0 497471028 2046316544 480936 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 499589 480936 181 55 0 497475 0
[pid=3886/tid=3893] ppid=3884 vsize=1998356 CPUtime=1002.19 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 23957 1261 0 0 100217 2 0 0 25 0 5 0 497471042 2046316544 480936 33554432000 4194304 4417332 140733284836768 18446744073709551615 4250660 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=1998356 CPUtime=1002.19 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 40663 1261 0 0 100215 4 0 0 25 0 5 0 497471042 2046316544 480936 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=1998356 CPUtime=1002.19 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 111178 1261 0 0 100206 13 0 0 25 0 5 0 497471042 2046316544 480936 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=1998356 CPUtime=996.88 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 881290 1261 0 0 99565 123 0 0 25 0 5 0 497471042 2046316544 480936 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4003.62
Current children cumulated vsize (KiB) 1998356

[startup+1062.3 s]
/proc/loadavg: 8.10 8.11 7.93 10/186 3932
/proc/meminfo: memFree=28692164/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=1971892 CPUtime=4243.31 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 1091325 1261 0 0 424183 148 0 0 25 0 5 0 497471028 2019217408 470823 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 492973 470823 181 55 0 490859 0
[pid=3886/tid=3893] ppid=3884 vsize=1971892 CPUtime=1062.19 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 23957 1261 0 0 106217 2 0 0 25 0 5 0 497471042 2019217408 470823 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=1971892 CPUtime=1062.19 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 40663 1261 0 0 106215 4 0 0 25 0 5 0 497471042 2019217408 470823 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=1971892 CPUtime=1062.19 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 130929 1261 0 0 106204 15 0 0 25 0 5 0 497471042 2019217408 470823 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=1971892 CPUtime=1056.57 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 891058 1261 0 0 105533 124 0 0 25 0 5 0 497471042 2019217408 470823 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4243.31
Current children cumulated vsize (KiB) 1971892

[startup+1122.3 s]
/proc/loadavg: 8.14 8.11 7.94 9/186 3933
/proc/meminfo: memFree=28623812/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=2037428 CPUtime=4482.99 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 1115887 1261 0 0 448148 151 0 0 25 0 5 0 497471028 2086326272 478480 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 509357 478480 181 55 0 507243 0
[pid=3886/tid=3893] ppid=3884 vsize=2037428 CPUtime=1122.19 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 23957 1261 0 0 112217 2 0 0 25 0 5 0 497471042 2086326272 478480 33554432000 4194304 4417332 140733284836768 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=2037428 CPUtime=1122.19 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 40663 1261 0 0 112215 4 0 0 25 0 5 0 497471042 2086326272 478480 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=2037428 CPUtime=1122.19 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 155491 1261 0 0 112201 18 0 0 25 0 5 0 497471042 2086326272 478480 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=2037428 CPUtime=1116.24 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 891058 1261 0 0 111500 124 0 0 25 0 5 0 497471042 2086326272 478480 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4482.99
Current children cumulated vsize (KiB) 2037428

[startup+1182.3 s]
/proc/loadavg: 8.12 8.11 7.94 10/186 3935
/proc/meminfo: memFree=29232388/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=1223064 CPUtime=4722.68 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 1258493 1261 0 0 472097 171 0 0 25 0 5 0 497471028 1252417536 279270 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 305766 279270 181 55 0 303652 0
[pid=3886/tid=3893] ppid=3884 vsize=1223064 CPUtime=1182.19 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 23957 1261 0 0 118217 2 0 0 25 0 5 0 497471042 1252417536 279270 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=1223064 CPUtime=1182.19 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 48314 1261 0 0 118214 5 0 0 25 0 5 0 497471042 1252417536 279270 33554432000 4194304 4417332 140733284836768 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=1223064 CPUtime=1182.2 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 185777 1261 0 0 118198 22 0 0 25 0 5 0 497471042 1252417536 279270 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364919 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=1223064 CPUtime=1175.92 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 995727 1261 0 0 117453 139 0 0 25 0 5 0 497471042 1252417536 279270 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4722.68
Current children cumulated vsize (KiB) 1223064



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.08 8.10 7.94 9/186 3936
/proc/meminfo: memFree=29244144/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=1223064 CPUtime=4800.19 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 1275880 1261 0 0 479846 173 0 0 25 0 5 0 497471028 1252417536 276107 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 305766 276107 181 55 0 303652 0
[pid=3886/tid=3893] ppid=3884 vsize=1223064 CPUtime=1201.6 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 23957 1261 0 0 120158 2 0 0 25 0 5 0 497471042 1252417536 276107 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=1223064 CPUtime=1201.6 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 48314 1261 0 0 120155 5 0 0 25 0 5 0 497471042 1252417536 276107 33554432000 4194304 4417332 140733284836768 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=1223064 CPUtime=1201.6 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 203164 1261 0 0 120136 24 0 0 25 0 5 0 497471042 1252417536 276107 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=1223064 CPUtime=1195.21 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 995727 1261 0 0 119382 139 0 0 25 0 5 0 497471042 1252417536 276107 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 1223064

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.08 8.10 7.94 9/186 3936
/proc/meminfo: memFree=29244144/32951124 swapFree=67111356/67111528
[pid=3886] ppid=3884 vsize=1223064 CPUtime=4800.19 cores=1,3,5,7
/proc/3886/stat : 3886 (plingeling) S 3884 3886 3183 0 -1 4202496 1275880 1261 0 0 479846 173 0 0 25 0 5 0 497471028 1252417536 276107 33554432000 4194304 4417332 140733284836768 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/3886/statm: 305766 276107 181 55 0 303652 0
[pid=3886/tid=3893] ppid=3884 vsize=1223064 CPUtime=1201.6 cores=1,3,5,7
/proc/3886/task/3893/stat : 3893 (plingeling) R 3884 3886 3183 0 -1 4202560 23957 1261 0 0 120158 2 0 0 25 0 5 0 497471042 1252417536 276107 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=3886/tid=3894] ppid=3884 vsize=1223064 CPUtime=1201.6 cores=1,3,5,7
/proc/3886/task/3894/stat : 3894 (plingeling) R 3884 3886 3183 0 -1 4202560 48314 1261 0 0 120155 5 0 0 25 0 5 0 497471042 1252417536 276107 33554432000 4194304 4417332 140733284836768 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3886/tid=3895] ppid=3884 vsize=1223064 CPUtime=1201.6 cores=1,3,5,7
/proc/3886/task/3895/stat : 3895 (plingeling) R 3884 3886 3183 0 -1 4202560 203164 1261 0 0 120136 24 0 0 25 0 5 0 497471042 1252417536 276107 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3886/tid=3896] ppid=3884 vsize=1223064 CPUtime=1195.21 cores=1,3,5,7
/proc/3886/task/3896/stat : 3896 (plingeling) R 3884 3886 3183 0 -1 4202560 995727 1261 0 0 119382 139 0 0 25 0 5 0 497471042 1252417536 276107 33554432000 4194304 4417332 140733284836768 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 1223064

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.75
CPU time (s): 4800.26
CPU user time (s): 4798.49
CPU system time (s): 1.77573
CPU usage (%): 399.438
Max. virtual memory (cumulated for all children) (KiB): 2102964

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.49
system time used= 1.77573
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1277141
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 191
involuntary context switches= 35415

runsolver used 1.92271 second user time and 4.44432 second system time

The end

Launcher Data 

Begin job on node143 at 2011-04-29 06:15:54
IDJOB=3258514
IDBENCH=71367
IDSOLVER=1605
FILE ID=node143/3258514-1304050554
RUNJOBID= node143-1304049350-3747
PBS_JOBID= 13170399
Free space on /tmp= 72920 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2100c215164gyes7.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3258514-1304050554/watcher-3258514-1304050554 -o /tmp/evaluation-result-3258514-1304050554/solver-3258514-1304050554 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3258514-1304050554.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 140eea74f7e66501965365160d02fa4d
RANDOM SEED=160344849

node143.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31784568 kB
Buffers:        182500 kB
Cached:         641160 kB
SwapCached:        168 kB
Active:         250964 kB
Inactive:       639396 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31784568 kB
SwapTotal:    67111528 kB
SwapFree:     67111356 kB
Dirty:            6268 kB
Writeback:           0 kB
AnonPages:       66640 kB
Mapped:          15280 kB
Slab:           211704 kB
PageTables:       4304 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   208748 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72920 MiB
End job on node143 at 2011-04-29 06:35:58