Trace number 3394988

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.5 5010.81

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m37-q446.25-n35-p15-s25120921.cnf
MD5SUM4b4e8a8187c1b8536d6b504b16289d38
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.081987
Satisfiable
(Un)Satisfiability was proved
Number of variables1106
Number of clauses129272
Sum of the clauses size259580
Maximum clause length37
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2129237
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 535

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394988-1306110040/watcher-3394988-1306110040 -o /tmp/evaluation-result-3394988-1306110040/solver-3394988-1306110040 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394988-1306110040.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.05 7.79 7.91 2/481 4728
/proc/meminfo: memFree=16908424/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=10132 CPUtime=0 cores=0-7
/proc/4728/stat : 4728 (plingeling) R 4726 4728 4667 0 -1 4202496 622 1255 0 0 0 0 0 0 25 0 1 0 455195308 10375168 553 33554432000 4194304 4417452 140735478249952 18446744073709551615 268660662016 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/4728/statm: 2571 559 147 55 0 457 0

[startup+0.075343 s]
/proc/loadavg: 7.05 7.79 7.91 2/481 4728
/proc/meminfo: memFree=16908424/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=18328 CPUtime=0.06 cores=0-7
/proc/4728/stat : 4728 (plingeling) R 4726 4728 4667 0 -1 4202496 2815 1255 0 0 6 0 0 0 25 0 1 0 455195308 18767872 2605 33554432000 4194304 4417452 140735478249952 18446744073709551615 4231283 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/4728/statm: 4582 2605 148 55 0 2468 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 18328

[startup+0.10036 s]
/proc/loadavg: 7.05 7.79 7.91 2/481 4728
/proc/meminfo: memFree=16908424/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=26520 CPUtime=0.09 cores=0-7
/proc/4728/stat : 4728 (plingeling) R 4726 4728 4667 0 -1 4202496 4863 1255 0 0 9 0 0 0 25 0 1 0 455195308 27156480 4653 33554432000 4194304 4417452 140735478249952 18446744073709551615 4231537 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/4728/statm: 6630 4653 148 55 0 4516 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26520

[startup+0.300267 s]
/proc/loadavg: 7.05 7.79 7.91 2/481 4728
/proc/meminfo: memFree=16908424/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=193196 CPUtime=1.23 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 16792 1255 0 0 121 2 0 0 25 0 9 0 455195308 197832704 9547 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 48299 9547 177 55 0 46185 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 193196

[startup+0.700194 s]
/proc/loadavg: 7.05 7.79 7.91 2/481 4728
/proc/meminfo: memFree=16908424/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=206956 CPUtime=4.44 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 22248 1255 0 0 441 3 0 0 25 0 9 0 455195308 211922944 12991 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 51739 12991 180 55 0 49625 0
Current children cumulated CPU time (s) 4.44
Current children cumulated vsize (KiB) 206956

[startup+1.50105 s]
/proc/loadavg: 7.05 7.79 7.91 9/490 4742
/proc/meminfo: memFree=16852684/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=215604 CPUtime=10.82 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 25261 1255 0 0 1079 3 0 0 25 0 9 0 455195308 220778496 15153 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 53901 15153 180 55 0 51787 0
[pid=4728/tid=4735] ppid=4726 vsize=215604 CPUtime=1.34 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 1866 1255 0 0 134 0 0 0 19 0 9 0 455195323 220778496 15153 33554432000 4194304 4417452 140735478249952 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=215604 CPUtime=1.33 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 1647 1255 0 0 133 0 0 0 19 0 9 0 455195323 220778496 15153 33554432000 4194304 4417452 140735478249952 18446744073709551615 4250080 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=215604 CPUtime=1.3 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 1714 1255 0 0 130 0 0 0 25 0 9 0 455195323 220778496 15153 33554432000 4194304 4417452 140735478249952 18446744073709551615 4376702 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=215604 CPUtime=1.33 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 5050 1255 0 0 133 0 0 0 25 0 9 0 455195323 220778496 15153 33554432000 4194304 4417452 140735478249952 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=215604 CPUtime=1.33 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 1518 1255 0 0 133 0 0 0 25 0 9 0 455195323 220778496 15153 33554432000 4194304 4417452 140735478249952 18446744073709551615 4248904 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=215604 CPUtime=1.34 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 651 1255 0 0 134 0 0 0 25 0 9 0 455195323 220778496 15153 33554432000 4194304 4417452 140735478249952 18446744073709551615 4250072 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=215604 CPUtime=1.33 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 1986 1255 0 0 133 0 0 0 25 0 9 0 455195323 220778496 15153 33554432000 4194304 4417452 140735478249952 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=215604 CPUtime=1.32 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 1854 1255 0 0 132 0 0 0 25 0 9 0 455195325 220778496 15153 33554432000 4194304 4417452 140735478249952 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10.82
Current children cumulated vsize (KiB) 215604

[startup+3.10078 s]
/proc/loadavg: 7.05 7.79 7.91 9/490 4742
/proc/meminfo: memFree=16842640/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=227392 CPUtime=23.6 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 33382 1255 0 0 2356 4 0 0 25 0 9 0 455195308 232849408 17845 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 56848 17845 180 55 0 54734 0
[pid=4728/tid=4735] ppid=4726 vsize=227392 CPUtime=2.94 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 2437 1255 0 0 294 0 0 0 25 0 9 0 455195323 232849408 17845 33554432000 4194304 4417452 140735478249952 18446744073709551615 4236296 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=227392 CPUtime=2.93 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 2218 1255 0 0 293 0 0 0 23 0 9 0 455195323 232849408 17845 33554432000 4194304 4417452 140735478249952 18446744073709551615 4258445 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=227392 CPUtime=2.88 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 1714 1255 0 0 288 0 0 0 25 0 9 0 455195323 232849408 17845 33554432000 4194304 4417452 140735478249952 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=227392 CPUtime=2.93 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 10828 1255 0 0 292 1 0 0 25 0 9 0 455195323 232849408 17845 33554432000 4194304 4417452 140735478249952 18446744073709551615 4366659 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=227392 CPUtime=2.93 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 1518 1255 0 0 293 0 0 0 25 0 9 0 455195323 232849408 17845 33554432000 4194304 4417452 140735478249952 18446744073709551615 4235985 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=227392 CPUtime=2.94 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 1222 1255 0 0 294 0 0 0 25 0 9 0 455195323 232849408 17845 33554432000 4194304 4417452 140735478249952 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=227392 CPUtime=2.93 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 2045 1255 0 0 293 0 0 0 25 0 9 0 455195323 232849408 17845 33554432000 4194304 4417452 140735478249952 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=227392 CPUtime=2.91 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 2425 1255 0 0 291 0 0 0 25 0 9 0 455195325 232849408 17845 33554432000 4194304 4417452 140735478249952 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 23.6
Current children cumulated vsize (KiB) 227392

[startup+6.30121 s]
/proc/loadavg: 7.13 7.79 7.91 9/490 4743
/proc/meminfo: memFree=16803784/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=244220 CPUtime=49.15 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 44725 1255 0 0 4909 6 0 0 25 0 9 0 455195308 250081280 22307 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 61055 22307 180 55 0 58941 0
[pid=4728/tid=4735] ppid=4726 vsize=244220 CPUtime=6.14 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 2437 1255 0 0 614 0 0 0 25 0 9 0 455195323 250081280 22307 33554432000 4194304 4417452 140735478249952 18446744073709551615 4236508 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=244220 CPUtime=6.13 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 2218 1255 0 0 613 0 0 0 25 0 9 0 455195323 250081280 22307 33554432000 4194304 4417452 140735478249952 18446744073709551615 4236290 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=244220 CPUtime=6.03 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 3031 1255 0 0 603 0 0 0 25 0 9 0 455195323 250081280 22307 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=244220 CPUtime=6.14 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 19567 1255 0 0 611 3 0 0 25 0 9 0 455195323 250081280 22307 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=244220 CPUtime=6.13 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 1518 1255 0 0 613 0 0 0 25 0 9 0 455195323 250081280 22307 33554432000 4194304 4417452 140735478249952 18446744073709551615 4236362 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=244220 CPUtime=6.14 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 1222 1255 0 0 614 0 0 0 25 0 9 0 455195323 250081280 22307 33554432000 4194304 4417452 140735478249952 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=244220 CPUtime=6.13 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 3332 1255 0 0 613 0 0 0 25 0 9 0 455195323 250081280 22307 33554432000 4194304 4417452 140735478249952 18446744073709551615 4376531 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=244220 CPUtime=6.12 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 2425 1255 0 0 612 0 0 0 25 0 9 0 455195325 250081280 22307 33554432000 4194304 4417452 140735478249952 18446744073709551615 4236296 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.15
Current children cumulated vsize (KiB) 244220

[startup+12.7011 s]
/proc/loadavg: 7.20 7.80 7.91 9/490 4743
/proc/meminfo: memFree=16792152/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=277460 CPUtime=100.25 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 67870 1255 0 0 10014 11 0 0 25 0 9 0 455195308 284119040 30617 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 69365 30617 180 55 0 67251 0
[pid=4728/tid=4735] ppid=4726 vsize=277460 CPUtime=12.54 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 2437 1255 0 0 1254 0 0 0 25 0 9 0 455195323 284119040 30617 33554432000 4194304 4417452 140735478249952 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=277460 CPUtime=12.53 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 2218 1255 0 0 1253 0 0 0 25 0 9 0 455195323 284119040 30617 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364597 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=277460 CPUtime=12.32 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 6893 1255 0 0 1232 0 0 0 25 0 9 0 455195323 284119040 30617 33554432000 4194304 4417452 140735478249952 18446744073709551615 4366079 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=277460 CPUtime=12.54 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 35154 1255 0 0 1248 6 0 0 25 0 9 0 455195323 284119040 30617 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364466 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=277460 CPUtime=12.52 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 1518 1255 0 0 1252 0 0 0 25 0 9 0 455195323 284119040 30617 33554432000 4194304 4417452 140735478249952 18446744073709551615 268660359216 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=277460 CPUtime=12.54 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 1222 1255 0 0 1254 0 0 0 25 0 9 0 455195323 284119040 30617 33554432000 4194304 4417452 140735478249952 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=277460 CPUtime=12.54 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 7028 1255 0 0 1253 1 0 0 25 0 9 0 455195323 284119040 30617 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=277460 CPUtime=12.52 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 2425 1255 0 0 1252 0 0 0 25 0 9 0 455195325 284119040 30617 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.25
Current children cumulated vsize (KiB) 277460

[startup+25.5009 s]
/proc/loadavg: 7.52 7.84 7.92 9/490 4743
/proc/meminfo: memFree=16691028/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=385552 CPUtime=202.43 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 126090 1255 0 0 20222 21 0 0 25 0 9 0 455195308 394805248 57640 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 96388 57640 180 55 0 94274 0
[pid=4728/tid=4735] ppid=4726 vsize=385552 CPUtime=25.33 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 6130 1255 0 0 2533 0 0 0 25 0 9 0 455195323 394805248 57640 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=385552 CPUtime=25.33 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 8071 1255 0 0 2532 1 0 0 25 0 9 0 455195323 394805248 57640 33554432000 4194304 4417452 140735478249952 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=385552 CPUtime=24.91 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 12334 1255 0 0 2490 1 0 0 25 0 9 0 455195323 394805248 57640 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=385552 CPUtime=25.34 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 52880 1255 0 0 2524 10 0 0 25 0 9 0 455195323 394805248 57640 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=385552 CPUtime=25.31 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 7981 1255 0 0 2531 0 0 0 25 0 9 0 455195323 394805248 57640 33554432000 4194304 4417452 140735478249952 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=385552 CPUtime=25.33 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 5675 1255 0 0 2533 0 0 0 25 0 9 0 455195323 394805248 57640 33554432000 4194304 4417452 140735478249952 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=385552 CPUtime=25.33 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 14576 1255 0 0 2532 1 0 0 25 0 9 0 455195323 394805248 57640 33554432000 4194304 4417452 140735478249952 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=385552 CPUtime=25.31 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 9468 1255 0 0 2530 1 0 0 25 0 9 0 455195325 394805248 57640 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 202.43
Current children cumulated vsize (KiB) 385552

[startup+51.1004 s]
/proc/loadavg: 7.68 7.85 7.92 9/490 4744
/proc/meminfo: memFree=16602680/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=485488 CPUtime=406.82 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 235793 1255 0 0 40642 40 0 0 25 0 9 0 455195308 497139712 82655 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 121372 82655 180 55 0 119258 0
[pid=4728/tid=4735] ppid=4726 vsize=485488 CPUtime=50.93 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 20316 1255 0 0 5090 3 0 0 25 0 9 0 455195323 497139712 82655 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=485488 CPUtime=50.93 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 22492 1255 0 0 5090 3 0 0 25 0 9 0 455195323 497139712 82655 33554432000 4194304 4417452 140735478249952 18446744073709551615 4355870 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=485488 CPUtime=50.11 cores=0-7

################
# More data... #
################


[startup+4722.32 s]
/proc/loadavg: 8.02 8.07 8.03 9/490 4883
/proc/meminfo: memFree=12208060/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=4846760 CPUtime=37698.6 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 17880739 1255 0 0 3767253 2610 0 0 25 0 9 0 455195308 4963082240 1172973 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 1211690 1172973 180 55 0 1209576 0
[pid=4728/tid=4735] ppid=4726 vsize=4846760 CPUtime=4721.41 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 2301103 1255 0 0 471825 316 0 0 25 0 9 0 455195323 4963082240 1172973 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=4846760 CPUtime=4722.26 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 1981157 1255 0 0 471909 317 0 0 25 0 9 0 455195323 4963082240 1172973 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=4846760 CPUtime=4703.34 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 2724779 1255 0 0 469923 411 0 0 25 0 9 0 455195323 4963082240 1172973 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=4846760 CPUtime=4722.12 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 620538 1255 0 0 472066 146 0 0 25 0 9 0 455195323 4963082240 1172973 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=4846760 CPUtime=4721 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 2705709 1255 0 0 471720 380 0 0 25 0 9 0 455195323 4963082240 1172973 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=4846760 CPUtime=4722.19 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 2721039 1255 0 0 471834 385 0 0 25 0 9 0 455195323 4963082240 1172973 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=4846760 CPUtime=4663.86 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 2545723 1255 0 0 466038 348 0 0 25 0 9 0 455195323 4963082240 1172973 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=4846760 CPUtime=4722.22 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 2271716 1255 0 0 471921 301 0 0 25 0 9 0 455195325 4963082240 1172973 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37698.6
Current children cumulated vsize (KiB) 4846760

[startup+4782.3 s]
/proc/loadavg: 8.01 8.05 8.02 9/490 4885
/proc/meminfo: memFree=12274368/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=4780832 CPUtime=38177.5 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 18020003 1255 0 0 3815124 2627 0 0 25 0 9 0 455195308 4895571968 1156491 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 1195208 1156491 180 55 0 1193094 0
[pid=4728/tid=4735] ppid=4726 vsize=4780832 CPUtime=4781.39 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 2325679 1255 0 0 477820 319 0 0 25 0 9 0 455195323 4895571968 1156491 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=4780832 CPUtime=4782.24 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 1981157 1255 0 0 477907 317 0 0 25 0 9 0 455195323 4895571968 1156491 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=4780832 CPUtime=4763.32 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 2757547 1255 0 0 475917 415 0 0 25 0 9 0 455195323 4895571968 1156491 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364711 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=4780832 CPUtime=4782.1 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 620538 1255 0 0 478064 146 0 0 25 0 9 0 455195323 4895571968 1156491 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=4780832 CPUtime=4780.96 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 2722093 1255 0 0 477714 382 0 0 25 0 9 0 455195323 4895571968 1156491 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=4780832 CPUtime=4782.19 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 2737423 1255 0 0 477831 388 0 0 25 0 9 0 455195323 4895571968 1156491 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=4780832 CPUtime=4722.87 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 2578491 1255 0 0 471935 352 0 0 25 0 9 0 455195323 4895571968 1156491 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=4780832 CPUtime=4782.2 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 2288100 1255 0 0 477917 303 0 0 25 0 9 0 455195325 4895571968 1156491 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38177.5
Current children cumulated vsize (KiB) 4780832

[startup+4842.3 s]
/proc/loadavg: 8.00 8.04 8.01 9/490 4886
/proc/meminfo: memFree=12339296/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=4715296 CPUtime=38656.5 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 18151075 1255 0 0 3863008 2643 0 0 25 0 9 0 455195308 4828463104 1140107 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 1178824 1140107 180 55 0 1176710 0
[pid=4728/tid=4735] ppid=4726 vsize=4715296 CPUtime=4841.39 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 2350255 1255 0 0 483817 322 0 0 25 0 9 0 455195323 4828463104 1140107 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=4715296 CPUtime=4842.23 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 1997541 1255 0 0 483905 318 0 0 25 0 9 0 455195323 4828463104 1140107 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=4715296 CPUtime=4823.32 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 2773931 1255 0 0 481915 417 0 0 25 0 9 0 455195323 4828463104 1140107 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=4715296 CPUtime=4842.1 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 620538 1255 0 0 484064 146 0 0 25 0 9 0 455195323 4828463104 1140107 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=4715296 CPUtime=4840.95 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 2746669 1255 0 0 483710 385 0 0 25 0 9 0 455195323 4828463104 1140107 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=4715296 CPUtime=4842.18 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 2737423 1255 0 0 483830 388 0 0 25 0 9 0 455195323 4828463104 1140107 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=4715296 CPUtime=4781.88 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 2611259 1255 0 0 477832 356 0 0 25 0 9 0 455195323 4828463104 1140107 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=4715296 CPUtime=4842.21 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 2304484 1255 0 0 483916 305 0 0 25 0 9 0 455195325 4828463104 1140107 33554432000 4194304 4417452 140735478249952 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38656.5
Current children cumulated vsize (KiB) 4715296

[startup+4902.3 s]
/proc/loadavg: 8.07 8.04 8.01 9/490 4888
/proc/meminfo: memFree=12057524/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=4998272 CPUtime=39135.5 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 18377693 1255 0 0 3910883 2670 0 0 25 0 9 0 455195308 5118230528 1210851 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 1249568 1210851 180 55 0 1247454 0
[pid=4728/tid=4735] ppid=4726 vsize=4998272 CPUtime=4901.4 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 2383023 1255 0 0 489814 326 0 0 25 0 9 0 455195323 5118230528 1210851 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=4998272 CPUtime=4902.23 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 1997541 1255 0 0 489905 318 0 0 25 0 9 0 455195323 5118230528 1210851 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=4998272 CPUtime=4883.32 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 2823083 1255 0 0 487909 423 0 0 25 0 9 0 455195323 5118230528 1210851 33554432000 4194304 4417452 140735478249952 18446744073709551615 4366063 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=4998272 CPUtime=4902.11 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 631808 1255 0 0 490063 148 0 0 25 0 9 0 455195323 5118230528 1210851 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=4998272 CPUtime=4900.94 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 2814561 1255 0 0 489699 395 0 0 25 0 9 0 455195323 5118230528 1210851 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=4998272 CPUtime=4902.18 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 2770191 1255 0 0 489827 391 0 0 25 0 9 0 455195323 5118230528 1210851 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=4998272 CPUtime=4840.91 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 2627643 1255 0 0 483733 358 0 0 25 0 9 0 455195323 5118230528 1210851 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=4998272 CPUtime=4902.2 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 2320868 1255 0 0 489914 306 0 0 25 0 9 0 455195325 5118230528 1210851 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364992 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39135.5
Current children cumulated vsize (KiB) 4998272

[startup+4962.3 s]
/proc/loadavg: 8.09 8.05 8.01 9/490 4890
/proc/meminfo: memFree=12098156/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=4956404 CPUtime=39614.5 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 18577703 1255 0 0 3958751 2702 0 0 25 0 9 0 455195308 5075357696 1200384 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 1239101 1200384 180 55 0 1236987 0
[pid=4728/tid=4735] ppid=4726 vsize=4956404 CPUtime=4961.4 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 2407599 1255 0 0 495812 328 0 0 25 0 9 0 455195323 5075357696 1200384 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=4956404 CPUtime=4962.24 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 1997541 1255 0 0 495906 318 0 0 25 0 9 0 455195323 5075357696 1200384 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=4956404 CPUtime=4943.33 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 2839467 1255 0 0 493907 426 0 0 25 0 9 0 455195323 5075357696 1200384 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=4956404 CPUtime=4962.11 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 631808 1255 0 0 496063 148 0 0 25 0 9 0 455195323 5075357696 1200384 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=4956404 CPUtime=4960.92 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 2847329 1255 0 0 495694 398 0 0 25 0 9 0 455195323 5075357696 1200384 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=4956404 CPUtime=4962.18 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 2798386 1255 0 0 495823 395 0 0 25 0 9 0 455195323 5075357696 1200384 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=4956404 CPUtime=4899.92 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 2644027 1255 0 0 489632 360 0 0 25 0 9 0 455195323 5075357696 1200384 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=4956404 CPUtime=4962.21 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 2402571 1255 0 0 495897 324 0 0 25 0 9 0 455195325 5075357696 1200384 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39614.5
Current children cumulated vsize (KiB) 4956404



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.6 s]
/proc/loadavg: 8.11 8.06 8.01 9/490 4891
/proc/meminfo: memFree=11954772/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=5099492 CPUtime=40000.2 cores=0-7
/proc/4728/stat : 4728 (plingeling) S 4726 4728 4667 0 -1 4202496 18749032 1255 0 0 3997288 2730 0 0 25 0 9 0 455195308 5221879808 1236156 33554432000 4194304 4417452 140735478249952 18446744073709551615 268672464869 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 1274873 1236156 180 55 0 1272759 0
[pid=4728/tid=4735] ppid=4726 vsize=5099492 CPUtime=5009.72 cores=0-7
/proc/4728/task/4735/stat : 4735 (plingeling) R 4726 4728 4667 0 -1 4202560 2407599 1255 0 0 500644 328 0 0 25 0 9 0 455195323 5221879808 1236156 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4728/tid=4736] ppid=4726 vsize=5099492 CPUtime=5010.56 cores=0-7
/proc/4728/task/4736/stat : 4736 (plingeling) R 4726 4728 4667 0 -1 4202560 1997541 1255 0 0 500737 319 0 0 25 0 9 0 455195323 5221879808 1236156 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4728/tid=4737] ppid=4726 vsize=5099492 CPUtime=4991.65 cores=0-7
/proc/4728/task/4737/stat : 4737 (plingeling) R 4726 4728 4667 0 -1 4202560 2872235 1255 0 0 498736 429 0 0 25 0 9 0 455195323 5221879808 1236156 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4728/tid=4738] ppid=4726 vsize=5099492 CPUtime=5010.43 cores=0-7
/proc/4728/task/4738/stat : 4738 (plingeling) R 4726 4728 4667 0 -1 4202560 631808 1255 0 0 500895 148 0 0 25 0 9 0 455195323 5221879808 1236156 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4728/tid=4739] ppid=4726 vsize=5099492 CPUtime=5009.23 cores=0-7
/proc/4728/task/4739/stat : 4739 (plingeling) R 4726 4728 4667 0 -1 4202560 2855521 1255 0 0 500523 400 0 0 25 0 9 0 455195323 5221879808 1236156 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4728/tid=4740] ppid=4726 vsize=5099492 CPUtime=5010.51 cores=0-7
/proc/4728/task/4740/stat : 4740 (plingeling) R 4726 4728 4667 0 -1 4202560 2879603 1255 0 0 500641 410 0 0 25 0 9 0 455195323 5221879808 1236156 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=5099492 CPUtime=4947.43 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4202560 2676795 1255 0 0 494376 367 0 0 25 0 9 0 455195323 5221879808 1236156 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4728/tid=4742] ppid=4726 vsize=5099492 CPUtime=5010.53 cores=0-7
/proc/4728/task/4742/stat : 4742 (plingeling) R 4726 4728 4667 0 -1 4202560 2418955 1255 0 0 500727 326 0 0 25 0 9 0 455195325 5221879808 1236156 33554432000 4194304 4417452 140735478249952 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 5099492

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.8 s]
/proc/loadavg: 8.11 8.06 8.01 9/490 4891
/proc/meminfo: memFree=11954772/32951124 swapFree=46575304/67111528
[pid=4728] ppid=4726 vsize=0 CPUtime=40000.5 cores=0-7
/proc/4728/stat : 4728 (plingeling) Z 4726 4728 4667 0 -1 4203548 18749032 1255 0 0 3997301 2748 0 0 18 0 2 0 455195308 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 6 0 0 0
/proc/4728/statm: 0 0 0 0 0 0 0
[pid=4728/tid=4741] ppid=4726 vsize=0 CPUtime=4947.62 cores=0-7
/proc/4728/task/4741/stat : 4741 (plingeling) R 4726 4728 4667 0 -1 4203588 2676795 1255 0 0 494377 385 0 0 25 0 2 0 455195323 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.81
CPU time (s): 40000.5
CPU user time (s): 39973
CPU system time (s): 27.4928
CPU usage (%): 798.285
Max. virtual memory (cumulated for all children) (KiB): 5214168

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39973
system time used= 27.4928
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18750287
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 266
involuntary context switches= 193404

runsolver used 21.8977 second user time and 60.0869 second system time

The end

Launcher Data 

Begin job on node107 at 2011-05-23 02:20:40
IDJOB=3394988
IDBENCH=88202
IDSOLVER=1851
FILE ID=node107/3394988-1306110040
RUNJOBID= node107-1306109973-4681
PBS_JOBID= 13388044
Free space on /tmp= 73188 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m37-q446.25-n35-p15-s25120921.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394988-1306110040/watcher-3394988-1306110040 -o /tmp/evaluation-result-3394988-1306110040/solver-3394988-1306110040 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394988-1306110040.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 4b4e8a8187c1b8536d6b504b16289d38
RANDOM SEED=1957404756

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16908704 kB
Buffers:        302164 kB
Cached:        6729532 kB
SwapCached:       9840 kB
Active:       11698088 kB
Inactive:      4021292 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16908704 kB
SwapTotal:    67111528 kB
SwapFree:     46575304 kB
Dirty:            1576 kB
Writeback:           0 kB
AnonPages:     8685600 kB
Mapped:          32304 kB
Slab:           157492 kB
PageTables:      95180 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 145075712 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73188 MiB
End job on node107 at 2011-05-23 03:44:13