Trace number 3371168

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.39 1203.16

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v1150c84314g7.cnf
MD5SUMf39e50b5cd7b50d1971722973512a1b8
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark6.09707
Satisfiable
(Un)Satisfiability was proved
Number of variables1150
Number of clauses84314
Sum of the clauses size169678
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 284264
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 550

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371168-1305419144/watcher-3371168-1305419144 -o /tmp/evaluation-result-3371168-1305419144/solver-3371168-1305419144 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371168-1305419144.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.68 4.13 5.21 2/304 20798
/proc/meminfo: memFree=18069616/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=9196 CPUtime=0 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) R 20796 20798 19509 0 -1 4202496 365 1254 0 0 0 0 0 0 25 0 1 0 653514101 9416704 294 33554432000 4194304 4417452 140734362808944 18446744073709551615 274473967360 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/20798/statm: 2299 294 147 55 0 185 0

[startup+0.034037 s]
/proc/loadavg: 3.68 4.13 5.21 2/304 20798
/proc/meminfo: memFree=18069616/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=13448 CPUtime=0.02 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) R 20796 20798 19509 0 -1 4202496 1457 1254 0 0 2 0 0 0 25 0 1 0 653514101 13770752 1386 33554432000 4194304 4417452 140734362808944 18446744073709551615 4262065 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/20798/statm: 3362 1386 148 55 0 1248 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 13448

[startup+0.163917 s]
/proc/loadavg: 3.68 4.13 5.21 2/304 20798
/proc/meminfo: memFree=18069616/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=125576 CPUtime=0.46 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 4428 1254 0 0 46 0 0 0 25 0 5 0 653514101 128589824 2830 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 31394 2830 177 55 0 29280 0
Current children cumulated CPU time (s) 0.46
Current children cumulated vsize (KiB) 125576

[startup+0.300894 s]
/proc/loadavg: 3.68 4.13 5.21 2/304 20798
/proc/meminfo: memFree=18069616/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=130768 CPUtime=1 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 5975 1254 0 0 100 0 0 0 25 0 5 0 653514101 133906432 4099 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 32692 4099 180 55 0 30578 0
Current children cumulated CPU time (s) 1
Current children cumulated vsize (KiB) 130768

[startup+0.700821 s]
/proc/loadavg: 3.68 4.13 5.21 2/304 20798
/proc/meminfo: memFree=18069616/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=135828 CPUtime=2.6 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 8109 1254 0 0 260 0 0 0 25 0 5 0 653514101 139087872 5364 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 33957 5364 180 55 0 31843 0
Current children cumulated CPU time (s) 2.6
Current children cumulated vsize (KiB) 135828

[startup+1.50068 s]
/proc/loadavg: 3.68 4.13 5.21 9/316 20823
/proc/meminfo: memFree=17998224/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=137948 CPUtime=5.79 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 12511 1254 0 0 578 1 0 0 25 0 5 0 653514101 141258752 5926 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 34487 5926 180 55 0 32373 0
[pid=20798/tid=20805] ppid=20796 vsize=137948 CPUtime=1.44 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 1359 1254 0 0 144 0 0 0 25 0 5 0 653514107 141258752 5926 33554432000 4194304 4417452 140734362808944 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=137948 CPUtime=1.43 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 1235 1254 0 0 143 0 0 0 25 0 5 0 653514107 141258752 5926 33554432000 4194304 4417452 140734362808944 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=137948 CPUtime=1.43 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 799 1254 0 0 143 0 0 0 25 0 5 0 653514107 141258752 5926 33554432000 4194304 4417452 140734362808944 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=137948 CPUtime=1.42 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 6625 1254 0 0 141 1 0 0 25 0 5 0 653514107 141258752 5926 33554432000 4194304 4417452 140734362808944 18446744073709551615 4250502 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.79
Current children cumulated vsize (KiB) 137948

[startup+3.1004 s]
/proc/loadavg: 3.68 4.13 5.21 9/316 20823
/proc/meminfo: memFree=17969332/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=151716 CPUtime=12.19 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 18342 1254 0 0 1217 2 0 0 25 0 5 0 653514101 155357184 9336 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 37929 9336 180 55 0 35815 0
[pid=20798/tid=20805] ppid=20796 vsize=151716 CPUtime=3.04 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 1359 1254 0 0 304 0 0 0 25 0 5 0 653514107 155357184 9336 33554432000 4194304 4417452 140734362808944 18446744073709551615 4250341 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=151716 CPUtime=3.03 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 1235 1254 0 0 303 0 0 0 25 0 5 0 653514107 155357184 9336 33554432000 4194304 4417452 140734362808944 18446744073709551615 4236017 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=151716 CPUtime=3.03 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 1412 1254 0 0 303 0 0 0 25 0 5 0 653514107 155357184 9336 33554432000 4194304 4417452 140734362808944 18446744073709551615 4378556 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=151716 CPUtime=3.01 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 11843 1254 0 0 300 1 0 0 25 0 5 0 653514107 155357184 9336 33554432000 4194304 4417452 140734362808944 18446744073709551615 4251272 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.19
Current children cumulated vsize (KiB) 151716

[startup+6.30084 s]
/proc/loadavg: 4.11 4.21 5.23 9/316 20823
/proc/meminfo: memFree=17957248/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=165204 CPUtime=24.95 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 27737 1254 0 0 2492 3 0 0 25 0 5 0 653514101 169168896 12708 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 41301 12708 180 55 0 39187 0
[pid=20798/tid=20805] ppid=20796 vsize=165204 CPUtime=6.24 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 1959 1254 0 0 624 0 0 0 25 0 5 0 653514107 169168896 12708 33554432000 4194304 4417452 140734362808944 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=165204 CPUtime=6.23 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 1835 1254 0 0 623 0 0 0 25 0 5 0 653514107 169168896 12708 33554432000 4194304 4417452 140734362808944 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=165204 CPUtime=6.23 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 2829 1254 0 0 623 0 0 0 25 0 5 0 653514107 169168896 12708 33554432000 4194304 4417452 140734362808944 18446744073709551615 4250975 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=165204 CPUtime=6.18 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 18621 1254 0 0 616 2 0 0 25 0 5 0 653514107 169168896 12708 33554432000 4194304 4417452 140734362808944 18446744073709551615 4236601 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.95
Current children cumulated vsize (KiB) 165204

[startup+12.7007 s]
/proc/loadavg: 4.42 4.28 5.25 9/316 20823
/proc/meminfo: memFree=17874428/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=194960 CPUtime=50.49 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 41408 1254 0 0 5044 5 0 0 25 0 5 0 653514101 199639040 20147 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 48740 20147 180 55 0 46626 0
[pid=20798/tid=20805] ppid=20796 vsize=194960 CPUtime=12.63 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 1959 1254 0 0 1263 0 0 0 25 0 5 0 653514107 199639040 20147 33554432000 4194304 4417452 140734362808944 18446744073709551615 4249151 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=194960 CPUtime=12.63 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 1835 1254 0 0 1263 0 0 0 25 0 5 0 653514107 199639040 20147 33554432000 4194304 4417452 140734362808944 18446744073709551615 4258491 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=194960 CPUtime=12.63 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 4290 1254 0 0 1263 0 0 0 25 0 5 0 653514107 199639040 20147 33554432000 4194304 4417452 140734362808944 18446744073709551615 4250006 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=194960 CPUtime=12.52 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 30831 1254 0 0 1248 4 0 0 25 0 5 0 653514107 199639040 20147 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.49
Current children cumulated vsize (KiB) 194960

[startup+25.5005 s]
/proc/loadavg: 5.21 4.46 5.29 9/316 20823
/proc/meminfo: memFree=17745352/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=231140 CPUtime=101.56 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 65304 1254 0 0 10147 9 0 0 25 0 5 0 653514101 236687360 29212 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 57785 29212 180 55 0 55671 0
[pid=20798/tid=20805] ppid=20796 vsize=231140 CPUtime=25.43 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 3707 1254 0 0 2543 0 0 0 25 0 5 0 653514107 236687360 29212 33554432000 4194304 4417452 140734362808944 18446744073709551615 4232693 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=231140 CPUtime=25.42 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 2950 1254 0 0 2542 0 0 0 25 0 5 0 653514107 236687360 29212 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364669 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=231140 CPUtime=25.42 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 6069 1254 0 0 2542 0 0 0 25 0 5 0 653514107 236687360 29212 33554432000 4194304 4417452 140734362808944 18446744073709551615 4254983 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=231140 CPUtime=25.2 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 50085 1254 0 0 2513 7 0 0 25 0 5 0 653514107 236687360 29212 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364805 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.56
Current children cumulated vsize (KiB) 231140

[startup+51.101 s]
/proc/loadavg: 6.24 4.76 5.37 9/316 20824
/proc/meminfo: memFree=17691040/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=285736 CPUtime=203.73 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 93453 1254 0 0 20360 13 0 0 25 0 5 0 653514101 292593664 42855 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 71434 42855 180 55 0 69320 0
[pid=20798/tid=20805] ppid=20796 vsize=285736 CPUtime=51.03 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 5920 1254 0 0 5103 0 0 0 25 0 5 0 653514107 292593664 42855 33554432000 4194304 4417452 140734362808944 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=285736 CPUtime=51.02 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 4391 1254 0 0 5102 0 0 0 25 0 5 0 653514107 292593664 42855 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=285736 CPUtime=51.02 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 7191 1254 0 0 5102 0 0 0 25 0 5 0 653514107 292593664 42855 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364567 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=285736 CPUtime=50.57 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 73458 1254 0 0 5047 10 0 0 25 0 5 0 653514107 292593664 42855 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.73
Current children cumulated vsize (KiB) 285736

[startup+102.311 s]
/proc/loadavg: 7.28 5.27 5.51 9/316 20826
/proc/meminfo: memFree=17470532/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=363932 CPUtime=408.07 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 144333 1254 0 0 40786 21 0 0 25 0 5 0 653514101 372666368 62404 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 90983 62404 180 55 0 88869 0
[pid=20798/tid=20805] ppid=20796 vsize=363932 CPUtime=102.25 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 7769 1254 0 0 10224 1 0 0 25 0 5 0 653514107 372666368 62404 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=363932 CPUtime=102.22 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 5673 1254 0 0 10222 0 0 0 25 0 5 0 653514107 372666368 62404 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=363932 CPUtime=102.24 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 9144 1254 0 0 10223 1 0 0 25 0 5 0 653514107 372666368 62404 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=363932 CPUtime=101.29 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 119254 1254 0 0 10111 18 0 0 25 0 5 0 653514107 372666368 62404 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.07
Current children cumulated vsize (KiB) 363932

[startup+162.3 s]
/proc/loadavg: 7.88 5.81 5.68 9/316 20827
/proc/meminfo: memFree=17497160/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=391664 CPUtime=647.45 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 197333 1254 0 0 64716 29 0 0 25 0 5 0 653514101 401063936 69337 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 97916 69337 180 55 0 95802 0
[pid=20798/tid=20805] ppid=20796 vsize=391664 CPUtime=162.23 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 11743 1254 0 0 16222 1 0 0 25 0 5 0 653514107 401063936 69337 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=391664 CPUtime=162.2 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 9941 1254 0 0 16219 1 0 0 25 0 5 0 653514107 401063936 69337 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=391664 CPUtime=162.23 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 15639 1254 0 0 16221 2 0 0 25 0 5 0 653514107 401063936 69337 33554432000 4194304 4417452 140734362808944 18446744073709551615 4344176 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=391664 CPUtime=160.71 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 157517 1254 0 0 16047 24 0 0 25 0 5 0 653514107 401063936 69337 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 647.45
Current children cumulated vsize (KiB) 391664


################
# More data... #
################

[pid=20798/tid=20806] ppid=20796 vsize=869116 CPUtime=762.12 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 92190 1254 0 0 76201 11 0 0 25 0 5 0 653514107 889974784 188961 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=869116 CPUtime=762.23 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 100138 1254 0 0 76210 13 0 0 25 0 5 0 653514107 889974784 188961 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=869116 CPUtime=758.64 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 357622 1254 0 0 75809 55 0 0 25 0 5 0 653514107 889974784 188961 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3041.56
Current children cumulated vsize (KiB) 869116

[startup+822.3 s]
/proc/loadavg: 8.16 7.89 6.91 9/316 20845
/proc/meminfo: memFree=16234568/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=878112 CPUtime=3280.91 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 673763 1254 0 0 327992 99 0 0 25 0 5 0 653514101 899186688 191210 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 219528 191210 180 55 0 217414 0
[pid=20798/tid=20805] ppid=20796 vsize=878112 CPUtime=817.86 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 95085 1254 0 0 81774 12 0 0 25 0 5 0 653514107 899186688 191210 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=878112 CPUtime=822.11 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 107365 1254 0 0 82197 14 0 0 25 0 5 0 653514107 899186688 191210 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=878112 CPUtime=822.22 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 102830 1254 0 0 82208 14 0 0 25 0 5 0 653514107 899186688 191210 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=878112 CPUtime=818.63 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 365990 1254 0 0 81806 57 0 0 25 0 5 0 653514107 899186688 191210 33554432000 4194304 4417452 140734362808944 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3280.91
Current children cumulated vsize (KiB) 878112

[startup+882.301 s]
/proc/loadavg: 8.06 7.91 6.98 9/316 20846
/proc/meminfo: memFree=15889808/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=927940 CPUtime=3520.3 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 705965 1254 0 0 351926 104 0 0 25 0 5 0 653514101 950210560 203667 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 231985 203667 180 55 0 229871 0
[pid=20798/tid=20805] ppid=20796 vsize=927940 CPUtime=877.26 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 105484 1254 0 0 87712 14 0 0 25 0 5 0 653514107 950210560 203667 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=927940 CPUtime=882.09 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 118438 1254 0 0 88194 15 0 0 25 0 5 0 653514107 950210560 203667 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=927940 CPUtime=882.22 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 113560 1254 0 0 88206 16 0 0 25 0 5 0 653514107 950210560 203667 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=927940 CPUtime=878.64 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 365990 1254 0 0 87807 57 0 0 25 0 5 0 653514107 950210560 203667 33554432000 4194304 4417452 140734362808944 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3520.3
Current children cumulated vsize (KiB) 927940

[startup+942.301 s]
/proc/loadavg: 8.06 7.94 7.04 9/316 20848
/proc/meminfo: memFree=15754360/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=936536 CPUtime=3759.7 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 768590 1254 0 0 375856 114 0 0 25 0 5 0 653514101 959012864 205816 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 234134 205816 180 55 0 232020 0
[pid=20798/tid=20805] ppid=20796 vsize=936536 CPUtime=936.66 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 110254 1254 0 0 93652 14 0 0 25 0 5 0 653514107 959012864 205816 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=936536 CPUtime=942.09 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 127862 1254 0 0 94192 17 0 0 25 0 5 0 653514107 959012864 205816 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=936536 CPUtime=942.22 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 145607 1254 0 0 94201 21 0 0 25 0 5 0 653514107 959012864 205816 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=936536 CPUtime=938.64 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 382374 1254 0 0 93803 61 0 0 25 0 5 0 653514107 959012864 205816 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3759.7
Current children cumulated vsize (KiB) 936536

[startup+1002.3 s]
/proc/loadavg: 8.02 7.95 7.10 9/316 20850
/proc/meminfo: memFree=15365448/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=1097300 CPUtime=3999.1 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 829594 1254 0 0 399785 125 0 0 25 0 5 0 653514101 1123635200 246007 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 274325 246007 180 55 0 272211 0
[pid=20798/tid=20805] ppid=20796 vsize=1097300 CPUtime=996.06 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 118603 1254 0 0 99590 16 0 0 25 0 5 0 653514107 1123635200 246007 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=1097300 CPUtime=1002.08 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 142714 1254 0 0 100190 18 0 0 25 0 5 0 653514107 1123635200 246007 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=1097300 CPUtime=1002.22 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 161766 1254 0 0 100198 24 0 0 25 0 5 0 653514107 1123635200 246007 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=1097300 CPUtime=998.64 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 404018 1254 0 0 99799 65 0 0 25 0 5 0 653514107 1123635200 246007 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3999.1
Current children cumulated vsize (KiB) 1097300

[startup+1062.3 s]
/proc/loadavg: 8.08 7.98 7.17 9/316 20851
/proc/meminfo: memFree=15319408/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=1143684 CPUtime=4238.5 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 849519 1254 0 0 423722 128 0 0 25 0 5 0 653514101 1171132416 257603 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 285921 257603 180 55 0 283807 0
[pid=20798/tid=20805] ppid=20796 vsize=1143684 CPUtime=1055.47 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 126240 1254 0 0 105530 17 0 0 25 0 5 0 653514107 1171132416 257603 33554432000 4194304 4417452 140734362808944 18446744073709551615 4236549 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=1143684 CPUtime=1062.07 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 142714 1254 0 0 106189 18 0 0 25 0 5 0 653514107 1171132416 257603 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=1143684 CPUtime=1062.23 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 165862 1254 0 0 106198 25 0 0 25 0 5 0 653514107 1171132416 257603 33554432000 4194304 4417452 140734362808944 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=1143684 CPUtime=1058.64 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 412210 1254 0 0 105798 66 0 0 25 0 5 0 653514107 1171132416 257603 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4238.5
Current children cumulated vsize (KiB) 1143684

[startup+1122.3 s]
/proc/loadavg: 8.13 8.01 7.22 9/316 20853
/proc/meminfo: memFree=15286616/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=1175932 CPUtime=4477.89 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 924134 1254 0 0 447646 143 0 0 25 0 5 0 653514101 1204154368 265665 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 293983 265665 180 55 0 291869 0
[pid=20798/tid=20805] ppid=20796 vsize=1175932 CPUtime=1114.87 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 133192 1254 0 0 111469 18 0 0 25 0 5 0 653514107 1204154368 265665 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=1175932 CPUtime=1122.07 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 186831 1254 0 0 112180 27 0 0 25 0 5 0 653514107 1204154368 265665 33554432000 4194304 4417452 140734362808944 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=1175932 CPUtime=1122.23 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 189408 1254 0 0 112193 30 0 0 25 0 5 0 653514107 1204154368 265665 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=1175932 CPUtime=1118.65 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 412210 1254 0 0 111798 67 0 0 25 0 5 0 653514107 1204154368 265665 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4477.89
Current children cumulated vsize (KiB) 1175932

[startup+1182.3 s]
/proc/loadavg: 8.16 8.04 7.28 9/316 20854
/proc/meminfo: memFree=15317576/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=927220 CPUtime=4717.29 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 959636 1254 0 0 471579 150 0 0 25 0 5 0 653514101 949473280 203487 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 231805 203487 180 55 0 229691 0
[pid=20798/tid=20805] ppid=20796 vsize=927220 CPUtime=1174.28 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 142345 1254 0 0 117409 19 0 0 25 0 5 0 653514107 949473280 203487 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=927220 CPUtime=1182.06 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 197397 1254 0 0 118178 28 0 0 25 0 5 0 653514107 949473280 203487 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=927220 CPUtime=1182.23 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 189408 1254 0 0 118193 30 0 0 25 0 5 0 653514107 949473280 203487 33554432000 4194304 4417452 140734362808944 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=927220 CPUtime=1178.64 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 427993 1254 0 0 117793 71 0 0 25 0 5 0 653514107 949473280 203487 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4717.29
Current children cumulated vsize (KiB) 927220



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.1 s]
/proc/loadavg: 8.11 8.04 7.30 9/316 20855
/proc/meminfo: memFree=15282344/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=943780 CPUtime=4800.3 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 963776 1254 0 0 479879 151 0 0 25 0 5 0 653514101 966430720 207627 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 235945 207627 180 55 0 233831 0
[pid=20798/tid=20805] ppid=20796 vsize=943780 CPUtime=1194.87 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 143477 1254 0 0 119468 19 0 0 25 0 5 0 653514107 966430720 207627 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=943780 CPUtime=1202.87 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 200405 1254 0 0 120258 29 0 0 25 0 5 0 653514107 966430720 207627 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=943780 CPUtime=1203.04 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 189408 1254 0 0 120274 30 0 0 25 0 5 0 653514107 966430720 207627 33554432000 4194304 4417452 140734362808944 18446744073709551615 4344164 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=943780 CPUtime=1199.45 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 427993 1254 0 0 119874 71 0 0 25 0 5 0 653514107 966430720 207627 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 943780

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.1 s]
/proc/loadavg: 8.11 8.04 7.30 9/316 20855
/proc/meminfo: memFree=15282344/32950928 swapFree=67111348/67111528
[pid=20798] ppid=20796 vsize=943780 CPUtime=4800.3 cores=0,2,4,6
/proc/20798/stat : 20798 (plingeling) S 20796 20798 19509 0 -1 4202496 963776 1254 0 0 479879 151 0 0 25 0 5 0 653514101 966430720 207627 33554432000 4194304 4417452 140734362808944 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/20798/statm: 235945 207627 180 55 0 233831 0
[pid=20798/tid=20805] ppid=20796 vsize=943780 CPUtime=1194.87 cores=0,2,4,6
/proc/20798/task/20805/stat : 20805 (plingeling) R 20796 20798 19509 0 -1 4202560 143477 1254 0 0 119468 19 0 0 25 0 5 0 653514107 966430720 207627 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=20798/tid=20806] ppid=20796 vsize=943780 CPUtime=1202.87 cores=0,2,4,6
/proc/20798/task/20806/stat : 20806 (plingeling) R 20796 20798 19509 0 -1 4202560 200405 1254 0 0 120258 29 0 0 25 0 5 0 653514107 966430720 207627 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=20798/tid=20807] ppid=20796 vsize=943780 CPUtime=1203.04 cores=0,2,4,6
/proc/20798/task/20807/stat : 20807 (plingeling) R 20796 20798 19509 0 -1 4202560 189408 1254 0 0 120274 30 0 0 25 0 5 0 653514107 966430720 207627 33554432000 4194304 4417452 140734362808944 18446744073709551615 4344164 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=20798/tid=20808] ppid=20796 vsize=943780 CPUtime=1199.45 cores=0,2,4,6
/proc/20798/task/20808/stat : 20808 (plingeling) R 20796 20798 19509 0 -1 4202560 427993 1254 0 0 119874 71 0 0 25 0 5 0 653514107 966430720 207627 33554432000 4194304 4417452 140734362808944 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 943780

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.16
CPU time (s): 4800.39
CPU user time (s): 4798.83
CPU system time (s): 1.55776
CPU usage (%): 398.983
Max. virtual memory (cumulated for all children) (KiB): 1243316

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.83
system time used= 1.55776
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 965030
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 73
involuntary context switches= 25980

runsolver used 3.58845 second user time and 8.22475 second system time

The end

Launcher Data 

Begin job on node125 at 2011-05-15 02:25:44
IDJOB=3371168
IDBENCH=71337
IDSOLVER=1848
FILE ID=node125/3371168-1305419144
RUNJOBID= node125-1305419144-20784
PBS_JOBID= 13324523
Free space on /tmp= 73196 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v1150c84314g7.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371168-1305419144/watcher-3371168-1305419144 -o /tmp/evaluation-result-3371168-1305419144/solver-3371168-1305419144 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371168-1305419144.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f39e50b5cd7b50d1971722973512a1b8
RANDOM SEED=1650097658

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      18070036 kB
Buffers:        261604 kB
Cached:        4187064 kB
SwapCached:          0 kB
Active:       11133416 kB
Inactive:      3374020 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      18070036 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            1952 kB
Writeback:           0 kB
AnonPages:    10058448 kB
Mapped:          28996 kB
Slab:           274544 kB
PageTables:      35652 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 50990696 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73192 MiB
End job on node125 at 2011-05-15 02:45:50