Trace number 3371018

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.44 1203.16

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v945c61409g7.cnf
MD5SUMcffaf116c6c0eb21439a109753d19c34
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.284955
Satisfiable
(Un)Satisfiability was proved
Number of variables945
Number of clauses61409
Sum of the clauses size123673
Maximum clause length21
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 261364
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371018-1305417935/watcher-3371018-1305417935 -o /tmp/evaluation-result-3371018-1305417935/solver-3371018-1305417935 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371018-1305417935.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.28 7.19 6.97 6/311 20706
/proc/meminfo: memFree=17769360/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=9004 CPUtime=0 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) R 20704 20706 19509 0 -1 4202496 312 1252 0 0 0 0 0 0 25 0 1 0 653393209 9220096 242 33554432000 4194304 4417452 140734721888176 18446744073709551615 4227779 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/20706/statm: 2251 242 147 55 0 137 0

[startup+0.01494 s]
/proc/loadavg: 8.28 7.19 6.97 6/311 20706
/proc/meminfo: memFree=17769360/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=10236 CPUtime=0 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) R 20704 20706 19509 0 -1 4202496 634 1252 0 0 0 0 0 0 25 0 1 0 653393209 10481664 564 33554432000 4194304 4417452 140734721888176 18446744073709551615 4227769 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/20706/statm: 2559 564 148 55 0 445 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 10236

[startup+0.102941 s]
/proc/loadavg: 8.28 7.19 6.97 6/311 20706
/proc/meminfo: memFree=17769360/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=125740 CPUtime=0.26 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 3649 1252 0 0 26 0 0 0 25 0 5 0 653393209 128757760 2883 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 31435 2883 177 55 0 29321 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 125740

[startup+0.300893 s]
/proc/loadavg: 8.28 7.19 6.97 6/311 20706
/proc/meminfo: memFree=17769360/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=128748 CPUtime=1.05 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 6253 1252 0 0 105 0 0 0 25 0 5 0 653393209 131837952 3637 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 32187 3637 180 55 0 30073 0
Current children cumulated CPU time (s) 1.05
Current children cumulated vsize (KiB) 128748

[startup+0.700823 s]
/proc/loadavg: 8.28 7.19 6.97 6/311 20706
/proc/meminfo: memFree=17769360/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=132692 CPUtime=2.66 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 8422 1252 0 0 265 1 0 0 25 0 5 0 653393209 135876608 4609 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 33173 4609 180 55 0 31059 0
Current children cumulated CPU time (s) 2.66
Current children cumulated vsize (KiB) 132692

[startup+1.50068 s]
/proc/loadavg: 8.28 7.19 6.97 9/316 20716
/proc/meminfo: memFree=17793260/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=138232 CPUtime=5.84 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 11084 1252 0 0 583 1 0 0 25 0 5 0 653393209 141549568 5977 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 34558 5977 180 55 0 32444 0
[pid=20706/tid=20713] ppid=20704 vsize=138232 CPUtime=1.45 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 749 1252 0 0 145 0 0 0 25 0 5 0 653393213 141549568 5977 33554432000 4194304 4417452 140734721888176 18446744073709551615 4236008 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=138232 CPUtime=1.45 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 1166 1252 0 0 145 0 0 0 25 0 5 0 653393213 141549568 5977 33554432000 4194304 4417452 140734721888176 18446744073709551615 4258161 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=138232 CPUtime=1.44 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 1116 1252 0 0 144 0 0 0 25 0 5 0 653393213 141549568 5977 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=138232 CPUtime=1.45 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 5615 1252 0 0 144 1 0 0 25 0 5 0 653393213 141549568 5977 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.84
Current children cumulated vsize (KiB) 138232

[startup+3.1004 s]
/proc/loadavg: 8.28 7.19 6.97 9/316 20716
/proc/meminfo: memFree=17790660/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=144776 CPUtime=12.23 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 16073 1252 0 0 1221 2 0 0 25 0 5 0 653393209 148250624 7613 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 36194 7613 180 55 0 34080 0
[pid=20706/tid=20713] ppid=20704 vsize=144776 CPUtime=3.05 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 1245 1252 0 0 305 0 0 0 25 0 5 0 653393213 148250624 7613 33554432000 4194304 4417452 140734721888176 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=144776 CPUtime=3.05 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 1662 1252 0 0 305 0 0 0 25 0 5 0 653393213 148250624 7613 33554432000 4194304 4417452 140734721888176 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=144776 CPUtime=3.03 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 1448 1252 0 0 303 0 0 0 25 0 5 0 653393213 148250624 7613 33554432000 4194304 4417452 140734721888176 18446744073709551615 4259651 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=144776 CPUtime=3.05 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 9280 1252 0 0 304 1 0 0 25 0 5 0 653393213 148250624 7613 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.23
Current children cumulated vsize (KiB) 144776

[startup+6.30084 s]
/proc/loadavg: 8.26 7.21 6.98 9/316 20716
/proc/meminfo: memFree=17758704/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=145184 CPUtime=25 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 25343 1252 0 0 2497 3 0 0 25 0 5 0 653393209 148668416 7715 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 36296 7715 180 55 0 34182 0
[pid=20706/tid=20713] ppid=20704 vsize=145184 CPUtime=6.25 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 1245 1252 0 0 625 0 0 0 25 0 5 0 653393213 148668416 7715 33554432000 4194304 4417452 140734721888176 18446744073709551615 4236895 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=145184 CPUtime=6.25 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 1662 1252 0 0 625 0 0 0 25 0 5 0 653393213 148668416 7715 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=145184 CPUtime=6.19 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 2451 1252 0 0 619 0 0 0 25 0 5 0 653393213 148668416 7715 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=145184 CPUtime=6.24 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 17547 1252 0 0 622 2 0 0 25 0 5 0 653393213 148668416 7715 33554432000 4194304 4417452 140734721888176 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25
Current children cumulated vsize (KiB) 145184

[startup+12.7007 s]
/proc/loadavg: 8.24 7.22 6.98 9/316 20716
/proc/meminfo: memFree=17786816/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=160700 CPUtime=50.53 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 38691 1252 0 0 5048 5 0 0 25 0 5 0 653393209 164556800 11594 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 40175 11594 180 55 0 38061 0
[pid=20706/tid=20713] ppid=20704 vsize=160700 CPUtime=12.65 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 2437 1252 0 0 1265 0 0 0 25 0 5 0 653393213 164556800 11594 33554432000 4194304 4417452 140734721888176 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=160700 CPUtime=12.65 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 2995 1252 0 0 1265 0 0 0 25 0 5 0 653393213 164556800 11594 33554432000 4194304 4417452 140734721888176 18446744073709551615 4236835 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=160700 CPUtime=12.53 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 3430 1252 0 0 1253 0 0 0 25 0 5 0 653393213 164556800 11594 33554432000 4194304 4417452 140734721888176 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=160700 CPUtime=12.65 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 27391 1252 0 0 1261 4 0 0 25 0 5 0 653393213 164556800 11594 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364854 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.53
Current children cumulated vsize (KiB) 160700

[startup+25.5005 s]
/proc/loadavg: 8.18 7.26 7.00 9/316 20716
/proc/meminfo: memFree=17771824/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=205460 CPUtime=101.61 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 81062 1252 0 0 10149 12 0 0 25 0 5 0 653393209 210391040 22784 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 51365 22784 180 55 0 49251 0
[pid=20706/tid=20713] ppid=20704 vsize=205460 CPUtime=25.44 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 9961 1252 0 0 2544 0 0 0 25 0 5 0 653393213 210391040 22784 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=205460 CPUtime=25.45 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 11759 1252 0 0 2544 1 0 0 25 0 5 0 653393213 210391040 22784 33554432000 4194304 4417452 140734721888176 18446744073709551615 4353666 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=205460 CPUtime=25.19 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 11734 1252 0 0 2518 1 0 0 25 0 5 0 653393213 210391040 22784 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=205460 CPUtime=25.45 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 45170 1252 0 0 2538 7 0 0 25 0 5 0 653393213 210391040 22784 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.61
Current children cumulated vsize (KiB) 205460

[startup+51.101 s]
/proc/loadavg: 8.12 7.32 7.02 9/316 20717
/proc/meminfo: memFree=17712136/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=230464 CPUtime=203.76 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 146198 1252 0 0 20354 22 0 0 25 0 5 0 653393209 235995136 29035 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 57616 29035 180 55 0 55502 0
[pid=20706/tid=20713] ppid=20704 vsize=230464 CPUtime=51.05 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 19725 1252 0 0 5103 2 0 0 25 0 5 0 653393213 235995136 29035 33554432000 4194304 4417452 140734721888176 18446744073709551615 4278051 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=230464 CPUtime=51.05 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 30288 1252 0 0 5100 5 0 0 25 0 5 0 653393213 235995136 29035 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=230464 CPUtime=50.54 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 24021 1252 0 0 5051 3 0 0 25 0 5 0 653393213 235995136 29035 33554432000 4194304 4417452 140734721888176 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=230464 CPUtime=51.05 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 69726 1252 0 0 5095 10 0 0 25 0 5 0 653393213 235995136 29035 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.76
Current children cumulated vsize (KiB) 230464

[startup+102.312 s]
/proc/loadavg: 8.15 7.45 7.08 9/316 20718
/proc/meminfo: memFree=17626180/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=245840 CPUtime=408.09 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 247889 1252 0 0 40769 40 0 0 25 0 5 0 653393209 251740160 32879 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 61460 32879 180 55 0 59346 0
[pid=20706/tid=20713] ppid=20704 vsize=245840 CPUtime=102.26 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 39140 1252 0 0 10220 6 0 0 25 0 5 0 653393213 251740160 32879 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=245840 CPUtime=102.26 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 59350 1252 0 0 10217 9 0 0 25 0 5 0 653393213 251740160 32879 33554432000 4194304 4417452 140734721888176 18446744073709551615 4358181 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=245840 CPUtime=101.23 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 47197 1252 0 0 10117 6 0 0 25 0 5 0 653393213 251740160 32879 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=245840 CPUtime=102.26 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 99764 1252 0 0 10210 16 0 0 25 0 5 0 653393213 251740160 32879 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.09
Current children cumulated vsize (KiB) 245840

[startup+162.3 s]
/proc/loadavg: 8.11 7.56 7.14 9/316 20720
/proc/meminfo: memFree=17428364/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=310192 CPUtime=647.45 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 365596 1252 0 0 64686 59 0 0 25 0 5 0 653393209 317636608 48967 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 77548 48967 180 55 0 75434 0
[pid=20706/tid=20713] ppid=20704 vsize=310192 CPUtime=162.25 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 72294 1252 0 0 16213 12 0 0 25 0 5 0 653393213 317636608 48967 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=310192 CPUtime=162.25 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 85295 1252 0 0 16211 14 0 0 25 0 5 0 653393213 317636608 48967 33554432000 4194304 4417452 140734721888176 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=310192 CPUtime=160.64 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 74140 1252 0 0 16053 11 0 0 25 0 5 0 653393213 317636608 48967 33554432000 4194304 4417452 140734721888176 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=310192 CPUtime=162.25 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 131429 1252 0 0 16204 21 0 0 25 0 5 0 653393213 317636608 48967 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 647.45
Current children cumulated vsize (KiB) 310192


################
# More data... #
################

[pid=20706/tid=20714] ppid=20704 vsize=819728 CPUtime=762.27 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 280559 1252 0 0 76183 44 0 0 25 0 5 0 653393213 839401472 176351 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=819728 CPUtime=754.66 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 237531 1252 0 0 75426 40 0 0 25 0 5 0 653393213 839401472 176351 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=819728 CPUtime=762.27 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 306114 1252 0 0 76176 51 0 0 25 0 5 0 653393213 839401472 176351 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3041.53
Current children cumulated vsize (KiB) 819728

[startup+822.3 s]
/proc/loadavg: 4.08 4.70 5.88 5/306 20755
/proc/meminfo: memFree=17251828/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=952844 CPUtime=3280.9 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 1125245 1252 0 0 327902 188 0 0 25 0 5 0 653393209 975712256 209630 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 238211 209630 180 55 0 236097 0
[pid=20706/tid=20713] ppid=20704 vsize=952844 CPUtime=822.25 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 250716 1252 0 0 82183 42 0 0 25 0 5 0 653393213 975712256 209630 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=952844 CPUtime=822.27 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 307375 1252 0 0 82177 50 0 0 25 0 5 0 653393213 975712256 209630 33554432000 4194304 4417452 140734721888176 18446744073709551615 4310057 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=952844 CPUtime=814.05 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 254506 1252 0 0 81363 42 0 0 25 0 5 0 653393213 975712256 209630 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=952844 CPUtime=822.26 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 310210 1252 0 0 82174 52 0 0 25 0 5 0 653393213 975712256 209630 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3280.9
Current children cumulated vsize (KiB) 952844

[startup+882.301 s]
/proc/loadavg: 4.03 4.57 5.76 5/306 20756
/proc/meminfo: memFree=17268768/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=919264 CPUtime=3520.31 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 1173537 1252 0 0 351835 196 0 0 25 0 5 0 653393209 941326336 201235 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 229816 201235 180 55 0 227702 0
[pid=20706/tid=20713] ppid=20704 vsize=919264 CPUtime=882.25 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 261542 1252 0 0 88182 43 0 0 25 0 5 0 653393213 941326336 201235 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=919264 CPUtime=882.27 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 342793 1252 0 0 88171 56 0 0 25 0 5 0 653393213 941326336 201235 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=919264 CPUtime=873.45 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 254506 1252 0 0 87303 42 0 0 25 0 5 0 653393213 941326336 201235 33554432000 4194304 4417452 140734721888176 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=919264 CPUtime=882.27 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 312258 1252 0 0 88174 53 0 0 25 0 5 0 653393213 941326336 201235 33554432000 4194304 4417452 140734721888176 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3520.31
Current children cumulated vsize (KiB) 919264

[startup+942.301 s]
/proc/loadavg: 4.07 4.48 5.65 5/306 20758
/proc/meminfo: memFree=17126992/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=1060704 CPUtime=3759.72 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 1208897 1252 0 0 375769 203 0 0 25 0 5 0 653393209 1086160896 236595 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 265176 236595 180 55 0 263062 0
[pid=20706/tid=20713] ppid=20704 vsize=1060704 CPUtime=942.25 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 261542 1252 0 0 94182 43 0 0 25 0 5 0 653393213 1086160896 236595 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=1060704 CPUtime=942.27 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 342793 1252 0 0 94171 56 0 0 25 0 5 0 653393213 1086160896 236595 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=1060704 CPUtime=932.86 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 265385 1252 0 0 93242 44 0 0 25 0 5 0 653393213 1086160896 236595 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=1060704 CPUtime=942.27 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 336739 1252 0 0 94169 58 0 0 25 0 5 0 653393213 1086160896 236595 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3759.72
Current children cumulated vsize (KiB) 1060704

[startup+1002.3 s]
/proc/loadavg: 4.08 4.40 5.55 5/306 20759
/proc/meminfo: memFree=17327700/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=859896 CPUtime=3999.12 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 1266966 1252 0 0 399696 216 0 0 25 0 5 0 653393209 880533504 186393 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 214974 186393 180 55 0 212860 0
[pid=20706/tid=20713] ppid=20704 vsize=859896 CPUtime=1002.25 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 284112 1252 0 0 100178 47 0 0 25 0 5 0 653393213 880533504 186393 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=859896 CPUtime=1002.27 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 350377 1252 0 0 100170 57 0 0 25 0 5 0 653393213 880533504 186393 33554432000 4194304 4417452 140734721888176 18446744073709551615 4357791 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=859896 CPUtime=992.25 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 290415 1252 0 0 99175 50 0 0 25 0 5 0 653393213 880533504 186393 33554432000 4194304 4417452 140734721888176 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=859896 CPUtime=1002.26 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 339624 1252 0 0 100167 59 0 0 25 0 5 0 653393213 880533504 186393 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3999.12
Current children cumulated vsize (KiB) 859896

[startup+1062.3 s]
/proc/loadavg: 4.06 4.34 5.46 5/306 20761
/proc/meminfo: memFree=17226612/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=961388 CPUtime=4238.53 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 1328870 1252 0 0 423627 226 0 0 25 0 5 0 653393209 984461312 211766 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 240347 211766 180 55 0 238233 0
[pid=20706/tid=20713] ppid=20704 vsize=961388 CPUtime=1062.25 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 305818 1252 0 0 106173 52 0 0 25 0 5 0 653393213 984461312 211766 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=961388 CPUtime=1062.27 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 364738 1252 0 0 106168 59 0 0 25 0 5 0 653393213 984461312 211766 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=961388 CPUtime=1051.66 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 290415 1252 0 0 105116 50 0 0 25 0 5 0 653393213 984461312 211766 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=961388 CPUtime=1062.27 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 365461 1252 0 0 106164 63 0 0 25 0 5 0 653393213 984461312 211766 33554432000 4194304 4417452 140734721888176 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4238.53
Current children cumulated vsize (KiB) 961388

[startup+1122.3 s]
/proc/loadavg: 4.02 4.28 5.36 5/306 20763
/proc/meminfo: memFree=17183280/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=1004784 CPUtime=4477.93 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 1352007 1252 0 0 447564 229 0 0 25 0 5 0 653393209 1028898816 222615 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 251196 222615 180 55 0 249082 0
[pid=20706/tid=20713] ppid=20704 vsize=1004784 CPUtime=1122.25 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 305818 1252 0 0 112173 52 0 0 25 0 5 0 653393213 1028898816 222615 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=1004784 CPUtime=1122.27 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 367426 1252 0 0 112168 59 0 0 25 0 5 0 653393213 1028898816 222615 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=1004784 CPUtime=1111.06 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 290415 1252 0 0 111056 50 0 0 25 0 5 0 653393213 1028898816 222615 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=1004784 CPUtime=1122.28 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 385910 1252 0 0 112162 66 0 0 25 0 5 0 653393213 1028898816 222615 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4477.93
Current children cumulated vsize (KiB) 1004784

[startup+1182.3 s]
/proc/loadavg: 4.01 4.22 5.27 5/306 20764
/proc/meminfo: memFree=17165264/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=1022720 CPUtime=4717.34 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 1398734 1252 0 0 471496 238 0 0 25 0 5 0 653393209 1047265280 227098 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 255680 227098 180 55 0 253566 0
[pid=20706/tid=20713] ppid=20704 vsize=1022720 CPUtime=1182.26 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 316683 1252 0 0 118172 54 0 0 25 0 5 0 653393213 1047265280 227098 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=1022720 CPUtime=1182.27 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 393692 1252 0 0 118163 64 0 0 25 0 5 0 653393213 1047265280 227098 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=1022720 CPUtime=1170.46 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 298607 1252 0 0 116995 51 0 0 25 0 5 0 653393213 1047265280 227098 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=1022720 CPUtime=1182.27 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 387314 1252 0 0 118161 66 0 0 25 0 5 0 653393213 1047265280 227098 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4717.34
Current children cumulated vsize (KiB) 1022720



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.1 s]
/proc/loadavg: 4.00 4.20 5.24 5/306 20765
/proc/meminfo: memFree=17149012/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=1038848 CPUtime=4800.34 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 1402766 1252 0 0 479796 238 0 0 25 0 5 0 653393209 1063780352 231130 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 259712 231130 180 55 0 257598 0
[pid=20706/tid=20713] ppid=20704 vsize=1038848 CPUtime=1203.07 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 316683 1252 0 0 120253 54 0 0 25 0 5 0 653393213 1063780352 231130 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=1038848 CPUtime=1203.08 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 393692 1252 0 0 120244 64 0 0 25 0 5 0 653393213 1063780352 231130 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=1038848 CPUtime=1191.05 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 298607 1252 0 0 119054 51 0 0 25 0 5 0 653393213 1063780352 231130 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=1038848 CPUtime=1203.09 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 391346 1252 0 0 120242 67 0 0 25 0 5 0 653393213 1063780352 231130 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 1038848

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.1 s]
/proc/loadavg: 4.00 4.20 5.24 5/306 20765
/proc/meminfo: memFree=17149012/32950928 swapFree=67111348/67111528
[pid=20706] ppid=20704 vsize=1038848 CPUtime=4800.34 cores=1,3,5,7
/proc/20706/stat : 20706 (plingeling) S 20704 20706 19509 0 -1 4202496 1402766 1252 0 0 479796 238 0 0 25 0 5 0 653393209 1063780352 231130 33554432000 4194304 4417452 140734721888176 18446744073709551615 274485770213 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/20706/statm: 259712 231130 180 55 0 257598 0
[pid=20706/tid=20713] ppid=20704 vsize=1038848 CPUtime=1203.07 cores=1,3,5,7
/proc/20706/task/20713/stat : 20713 (plingeling) R 20704 20706 19509 0 -1 4202560 316683 1252 0 0 120253 54 0 0 25 0 5 0 653393213 1063780352 231130 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=20706/tid=20714] ppid=20704 vsize=1038848 CPUtime=1203.08 cores=1,3,5,7
/proc/20706/task/20714/stat : 20714 (plingeling) R 20704 20706 19509 0 -1 4202560 393692 1252 0 0 120244 64 0 0 25 0 5 0 653393213 1063780352 231130 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=20706/tid=20715] ppid=20704 vsize=1038848 CPUtime=1191.05 cores=1,3,5,7
/proc/20706/task/20715/stat : 20715 (plingeling) R 20704 20706 19509 0 -1 4202560 298607 1252 0 0 119054 51 0 0 25 0 5 0 653393213 1063780352 231130 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=20706/tid=20716] ppid=20704 vsize=1038848 CPUtime=1203.09 cores=1,3,5,7
/proc/20706/task/20716/stat : 20716 (plingeling) R 20704 20706 19509 0 -1 4202560 391346 1252 0 0 120242 67 0 0 25 0 5 0 653393213 1063780352 231130 33554432000 4194304 4417452 140734721888176 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 1038848

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.16
CPU time (s): 4800.44
CPU user time (s): 4798.01
CPU system time (s): 2.43563
CPU usage (%): 398.985
Max. virtual memory (cumulated for all children) (KiB): 1179780

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.01
system time used= 2.43563
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1404018
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 147
involuntary context switches= 31262

runsolver used 3.35749 second user time and 8.68268 second system time

The end

Launcher Data 

Begin job on node125 at 2011-05-15 02:05:35
IDJOB=3371018
IDBENCH=71284
IDSOLVER=1848
FILE ID=node125/3371018-1305417935
RUNJOBID= node125-1305417379-20327
PBS_JOBID= 13324523
Free space on /tmp= 73196 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v945c61409g7.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371018-1305417935/watcher-3371018-1305417935 -o /tmp/evaluation-result-3371018-1305417935/solver-3371018-1305417935 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371018-1305417935.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cffaf116c6c0eb21439a109753d19c34
RANDOM SEED=1660422094

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17769500 kB
Buffers:        261316 kB
Cached:        4186908 kB
SwapCached:          0 kB
Active:       11435584 kB
Inactive:      3372568 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17769500 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:             808 kB
Writeback:           0 kB
AnonPages:    10359144 kB
Mapped:          30004 kB
Slab:           274448 kB
PageTables:      36076 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 51356676 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73196 MiB
End job on node125 at 2011-05-15 02:25:41