Trace number 3372809

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.8 5016.71

General information on the benchmark

Nameapplication/leberre/
2dimensionalstrippacking/E00N23.cnf
MD5SUM1a1f0dddf727883e0973677dd00e9269
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3122.96
Satisfiable
(Un)Satisfiability was proved
Number of variables15364
Number of clauses2210893
Sum of the clauses size20370578
Maximum clause length105
Minimum clause length1
Number of clauses of size 128
Number of clauses of size 241189
Number of clauses of size 336730
Number of clauses of size 432798
Number of clauses of size 5188784
Number of clauses of size over 51911364

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372809-1305442499/watcher-3372809-1305442499 -o /tmp/evaluation-result-3372809-1305442499/solver-3372809-1305442499 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372809-1305442499.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.44 7.91 7.98 2/378 6697
/proc/meminfo: memFree=30382560/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=8728 CPUtime=0 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 214 0 0 0 0 0 0 0 22 0 1 0 655848984 8937472 146 33554432000 4194304 4417452 140734548467536 18446744073709551615 251814240000 0 0 4096 0 18446744071562362840 0 0 17 3 0 0 0
/proc/6697/statm: 2182 146 122 55 0 68 0

[startup+0.0898809 s]
/proc/loadavg: 7.44 7.91 7.98 2/378 6697
/proc/meminfo: memFree=30382560/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=18808 CPUtime=0.04 cores=0-7
/proc/6697/stat : 6697 (plingeling) R 6695 6697 6192 0 -1 4202496 2907 1249 0 3 4 0 0 0 22 0 1 0 655848984 19259392 2726 33554432000 4194304 4417452 140734548467536 18446744073709551615 251814240000 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/6697/statm: 4702 2726 149 55 0 2588 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 18808

[startup+0.100863 s]
/proc/loadavg: 7.44 7.91 7.98 2/378 6697
/proc/meminfo: memFree=30382560/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=18808 CPUtime=0.05 cores=0-7
/proc/6697/stat : 6697 (plingeling) R 6695 6697 6192 0 -1 4202496 2907 1249 0 3 5 0 0 0 22 0 1 0 655848984 19259392 2726 33554432000 4194304 4417452 140734548467536 18446744073709551615 4320914 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/6697/statm: 4702 2726 149 55 0 2588 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 18808

[startup+0.300823 s]
/proc/loadavg: 7.44 7.91 7.98 2/378 6697
/proc/meminfo: memFree=30382560/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=51576 CPUtime=0.25 cores=0-7
/proc/6697/stat : 6697 (plingeling) R 6695 6697 6192 0 -1 4202496 11099 1249 0 3 24 1 0 0 22 0 1 0 655848984 52813824 10918 33554432000 4194304 4417452 140734548467536 18446744073709551615 4209644 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/6697/statm: 12894 10918 149 55 0 10780 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 51576

[startup+0.700753 s]
/proc/loadavg: 7.44 7.91 7.98 2/378 6697
/proc/meminfo: memFree=30382560/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=92536 CPUtime=0.65 cores=0-7
/proc/6697/stat : 6697 (plingeling) R 6695 6697 6192 0 -1 4202496 21339 1249 0 3 63 2 0 0 25 0 1 0 655848984 94756864 21158 33554432000 4194304 4417452 140734548467536 18446744073709551615 4231506 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/6697/statm: 23134 21158 149 55 0 21020 0
Current children cumulated CPU time (s) 0.65
Current children cumulated vsize (KiB) 92536

[startup+1.50062 s]
/proc/loadavg: 7.44 7.91 7.98 2/379 6703
/proc/meminfo: memFree=30231176/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=215568 CPUtime=1.45 cores=0-7
/proc/6697/stat : 6697 (plingeling) R 6695 6697 6192 0 -1 4202496 52065 1249 0 3 139 6 0 0 25 0 1 0 655848984 220741632 51884 33554432000 4194304 4417452 140734548467536 18446744073709551615 251814240000 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/6697/statm: 53892 51884 149 55 0 51778 0
Current children cumulated CPU time (s) 1.45
Current children cumulated vsize (KiB) 215568

[startup+3.10035 s]
/proc/loadavg: 6.93 7.80 7.94 2/379 6703
/proc/meminfo: memFree=29976108/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=543248 CPUtime=3.06 cores=0-7
/proc/6697/stat : 6697 (plingeling) R 6695 6697 6192 0 -1 4202496 133985 1249 0 3 290 16 0 0 25 0 1 0 655848984 556285952 133804 33554432000 4194304 4417452 140734548467536 18446744073709551615 251814240000 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/6697/statm: 135812 133804 149 55 0 133698 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 543248

[startup+6.30082 s]
/proc/loadavg: 6.93 7.80 7.94 2/379 6703
/proc/meminfo: memFree=29320300/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=1067536 CPUtime=6.26 cores=0-7
/proc/6697/stat : 6697 (plingeling) R 6695 6697 6192 0 -1 4202496 265057 1249 0 3 595 31 0 0 25 0 1 0 655848984 1093156864 264876 33554432000 4194304 4417452 140734548467536 18446744073709551615 251814240000 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/6697/statm: 266884 264876 149 55 0 264770 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 1067536

[startup+12.7007 s]
/proc/loadavg: 6.58 7.69 7.90 9/387 6711
/proc/meminfo: memFree=29075732/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=1526516 CPUtime=35.35 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 448818 1249 0 3 3470 65 0 0 18 0 9 0 655848984 1563152384 359177 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 381629 359177 177 55 0 379515 0
[pid=6697/tid=6704] ppid=6695 vsize=1526516 CPUtime=3.25 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 317 1249 0 3 325 0 0 0 25 0 9 0 655849927 1563152384 359177 33554432000 4194304 4417452 140734548467536 18446744073709551615 4308497 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=1526516 CPUtime=3.2 cores=0-7
/proc/6697/task/6705/stat : 6705 (plingeling) R 6695 6697 6192 0 -1 4202560 399 1249 0 3 320 0 0 0 25 0 9 0 655849927 1563152384 359177 33554432000 4194304 4417452 140734548467536 18446744073709551615 4310483 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6697/tid=6706] ppid=6695 vsize=1526516 CPUtime=3.24 cores=0-7
/proc/6697/task/6706/stat : 6706 (plingeling) R 6695 6697 6192 0 -1 4202560 17197 1249 0 3 320 4 0 0 25 0 9 0 655849927 1563152384 359177 33554432000 4194304 4417452 140734548467536 18446744073709551615 4255687 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6697/tid=6707] ppid=6695 vsize=1526516 CPUtime=3.22 cores=0-7
/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 16822 1249 0 3 318 4 0 0 25 0 9 0 655849927 1563152384 359177 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=1526516 CPUtime=3.25 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 315 1249 0 3 325 0 0 0 25 0 9 0 655849927 1563152384 359177 33554432000 4194304 4417452 140734548467536 18446744073709551615 4309939 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=1526516 CPUtime=3.24 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 315 1249 0 3 324 0 0 0 25 0 9 0 655849928 1563152384 359177 33554432000 4194304 4417452 140734548467536 18446744073709551615 4308643 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=1526516 CPUtime=3.24 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 16895 1249 0 3 319 5 0 0 25 0 9 0 655849928 1563152384 359177 33554432000 4194304 4417452 140734548467536 18446744073709551615 4278280 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=1526516 CPUtime=3.24 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 413 1249 0 3 324 0 0 0 25 0 9 0 655849928 1563152384 359177 33554432000 4194304 4417452 140734548467536 18446744073709551615 4307843 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 35.35
Current children cumulated vsize (KiB) 1526516

[startup+25.5006 s]
/proc/loadavg: 6.79 7.70 7.91 9/387 6712
/proc/meminfo: memFree=28430308/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=2040504 CPUtime=137.55 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 821116 1249 0 3 13590 165 0 0 18 0 9 0 655848984 2089476096 487677 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 510126 487677 180 55 0 508012 0
[pid=6697/tid=6704] ppid=6695 vsize=2040504 CPUtime=16.03 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 52293 1249 0 3 1596 7 0 0 25 0 9 0 655849927 2089476096 487677 33554432000 4194304 4417452 140734548467536 18446744073709551615 4265465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=2040504 CPUtime=15.83 cores=0-7
/proc/6697/task/6705/stat : 6705 (plingeling) R 6695 6697 6192 0 -1 4202560 73811 1249 0 3 1557 26 0 0 25 0 9 0 655849927 2089476096 487677 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6697/tid=6706] ppid=6695 vsize=2040504 CPUtime=16.03 cores=0-7
/proc/6697/task/6706/stat : 6706 (plingeling) R 6695 6697 6192 0 -1 4202560 50915 1249 0 3 1586 17 0 0 25 0 9 0 655849927 2089476096 487677 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6697/tid=6707] ppid=6695 vsize=2040504 CPUtime=16.02 cores=0-7
/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 19613 1249 0 3 1597 5 0 0 25 0 9 0 655849927 2089476096 487677 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=2040504 CPUtime=16.04 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 51982 1249 0 3 1591 13 0 0 25 0 9 0 655849927 2089476096 487677 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=2040504 CPUtime=16.04 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 73858 1249 0 3 1588 16 0 0 25 0 9 0 655849928 2089476096 487677 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=2040504 CPUtime=16.04 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 49919 1249 0 3 1588 16 0 0 25 0 9 0 655849928 2089476096 487677 33554432000 4194304 4417452 140734548467536 18446744073709551615 4263109 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=2040504 CPUtime=16.04 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 52580 1249 0 3 1591 13 0 0 25 0 9 0 655849928 2089476096 487677 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 137.55
Current children cumulated vsize (KiB) 2040504

[startup+51.1013 s]
/proc/loadavg: 7.20 7.72 7.91 9/387 6712
/proc/meminfo: memFree=28428792/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=2236408 CPUtime=342.01 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 1035746 1249 0 3 34006 195 0 0 18 0 9 0 655848984 2290081792 520270 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 559102 520270 180 55 0 556988 0
[pid=6697/tid=6704] ppid=6695 vsize=2236408 CPUtime=41.6 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 85061 1249 0 3 4150 10 0 0 25 0 9 0 655849927 2290081792 520270 33554432000 4194304 4417452 140734548467536 18446744073709551615 4344131 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=2236408 CPUtime=41.11 cores=0-7
/proc/6697/task/6705/stat : 6705 (plingeling) R 6695 6697 6192 0 -1 4202560 109040 1249 0 3 4080 31 0 0 25 0 9 0 655849927 2290081792 520270 33554432000 4194304 4417452 140734548467536 18446744073709551615 4255683 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6697/tid=6706] ppid=6695 vsize=2236408 CPUtime=41.63 cores=0-7
/proc/6697/task/6706/stat : 6706 (plingeling) R 6695 6697 6192 0 -1 4202560 90201 1249 0 3 4142 21 0 0 25 0 9 0 655849927 2290081792 520270 33554432000 4194304 4417452 140734548467536 18446744073709551615 4310328 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6697/tid=6707] ppid=6695 vsize=2236408 CPUtime=41.62 cores=0-7
/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 25392 1249 0 3 4157 5 0 0 25 0 9 0 655849927 2290081792 520270 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=2236408 CPUtime=41.64 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 84750 1249 0 3 4141 23 0 0 25 0 9 0 655849927 2290081792 520270 33554432000 4194304 4417452 140734548467536 18446744073709551615 4320251 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=2236408 CPUtime=41.64 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 109664 1249 0 3 4144 20 0 0 25 0 9 0 655849928 2290081792 520270 33554432000 4194304 4417452 140734548467536 18446744073709551615 4269682 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=2236408 CPUtime=41.64 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 82913 1249 0 3 4145 19 0 0 25 0 9 0 655849928 2290081792 520270 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=2236408 CPUtime=41.64 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 52580 1249 0 3 4151 13 0 0 25 0 9 0 655849928 2290081792 520270 33554432000 4194304 4417452 140734548467536 18446744073709551615 4305891 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 342.01
Current children cumulated vsize (KiB) 2236408

[startup+102.315 s]
/proc/loadavg: 7.75 7.78 7.91 9/387 6714
/proc/meminfo: memFree=28131628/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=2403764 CPUtime=751.04 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 1280740 1249 0 3 74881 223 0 0 18 0 9 0 655848984 2461454336 562141 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 600941 562141 180 55 0 598827 0
[pid=6697/tid=6704] ppid=6695 vsize=2403764 CPUtime=92.8 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 87232 1249 0 3 9270 10 0 0 25 0 9 0 655849927 2461454336 562141 33554432000 4194304 4417452 140734548467536 18446744073709551615 4247512 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=2403764 CPUtime=91.66 cores=0-7
/proc/6697/task/6705/stat : 6705 (plingeling) R 6695 6697 6192 0 -1 4202560 144156 1249 0 3 9131 35 0 0 25 0 9 0 655849927 2461454336 562141 33554432000 4194304 4417452 140734548467536 18446744073709551615 4346493 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6697/tid=6706] ppid=6695 vsize=2403764 CPUtime=92.85 cores=0-7
/proc/6697/task/6706/stat : 6706 (plingeling) R 6695 6697 6192 0 -1 4202560 157808 1249 0 3 9256 29 0 0 25 0 9 0 655849927 2461454336 562141 33554432000 4194304 4417452 140734548467536 18446744073709551615 4239418 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6697/tid=6707] ppid=6695 vsize=2403764 CPUtime=92.83 cores=0-7
/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 29926 1249 0 3 9277 6 0 0 25 0 9 0 655849927 2461454336 562141 33554432000 4194304 4417452 140734548467536 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=2403764 CPUtime=92.86 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 86855 1249 0 3 9262 24 0 0 25 0 9 0 655849927 2461454336 562141 33554432000 4194304 4417452 140734548467536 18446744073709551615 4247490 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=2403764 CPUtime=92.85 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 177279 1249 0 3 9258 27 0 0 25 0 9 0 655849928 2461454336 562141 33554432000 4194304 4417452 140734548467536 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=2403764 CPUtime=92.86 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 115681 1249 0 3 9263 23 0 0 25 0 9 0 655849928 2461454336 562141 33554432000 4194304 4417452 140734548467536 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=2403764 CPUtime=92.85 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 85658 1249 0 3 9268 17 0 0 25 0 9 0 655849928 2461454336 562141 33554432000 4194304 4417452 140734548467536 18446744073709551615 4309822 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 751.04
Current children cumulated vsize (KiB) 2403764

[startup+162.301 s]
/proc/loadavg: 7.97 7.83 7.92 9/387 6715
/proc/meminfo: memFree=28492824/32950928 swapFree=41933832/67111528
[pid=6697] ppid=6695 vsize=2039068 CPUtime=1230.16 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 1422771 1249 0 3 122775 241 0 0 18 0 9 0 655848984 2088005632 470967 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 509767 470967 180 55 0 507653 0
[pid=6697/tid=6704] ppid=6695 vsize=2039068 CPUtime=152.77 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 121832 1249 0 3 15263 14 0 0 25 0 9 0 655849927 2088005632 470967 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364809 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=2039068 CPUtime=150.91 cores=0-7

################
# More data... #
################

/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 999996 1249 0 3 465113 176 0 0 25 0 9 0 655849927 2627850240 602890 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=2566260 CPUtime=4652.78 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 323892 1249 0 3 465213 65 0 0 25 0 9 0 655849927 2627850240 602890 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=2566260 CPUtime=4652.87 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 867585 1249 0 3 465151 136 0 0 25 0 9 0 655849928 2627850240 602890 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=2566260 CPUtime=4652.87 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 518440 1249 0 3 465193 94 0 0 25 0 9 0 655849928 2627850240 602890 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=2566260 CPUtime=4652.89 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 394981 1249 0 3 465216 73 0 0 25 0 9 0 655849928 2627850240 602890 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37170.7
Current children cumulated vsize (KiB) 2566260

[startup+4722.31 s]
/proc/loadavg: 8.05 8.04 8.01 9/387 6861
/proc/meminfo: memFree=27876880/32950928 swapFree=41933848/67111528
[pid=6697] ppid=6695 vsize=2615524 CPUtime=37650.1 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 5192841 1249 0 3 3764129 876 0 0 18 0 9 0 655848984 2678296576 615206 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 653881 615206 180 55 0 651767 0
[pid=6697/tid=6704] ppid=6695 vsize=2615524 CPUtime=4711.27 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 570672 1249 0 3 471040 87 0 0 25 0 9 0 655849927 2678296576 615206 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=2615524 CPUtime=4690.48 cores=0-7
/proc/6697/task/6705/stat : 6705 (plingeling) R 6695 6697 6192 0 -1 4202560 402256 1249 0 3 468976 72 0 0 25 0 9 0 655849927 2678296576 615206 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6697/tid=6706] ppid=6695 vsize=2615524 CPUtime=4674.46 cores=0-7
/proc/6697/task/6706/stat : 6706 (plingeling) R 6695 6697 6192 0 -1 4202560 673219 1249 0 3 467332 114 0 0 25 0 9 0 655849927 2678296576 615206 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6697/tid=6707] ppid=6695 vsize=2615524 CPUtime=4712.9 cores=0-7
/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 1022958 1249 0 3 471112 178 0 0 25 0 9 0 655849927 2678296576 615206 33554432000 4194304 4417452 140734548467536 18446744073709551615 4250795 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=2615524 CPUtime=4712.8 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 329639 1249 0 3 471214 66 0 0 25 0 9 0 655849927 2678296576 615206 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=2615524 CPUtime=4712.88 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 875744 1249 0 3 471151 137 0 0 25 0 9 0 655849928 2678296576 615206 33554432000 4194304 4417452 140734548467536 18446744073709551615 4357540 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=2615524 CPUtime=4712.88 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 524723 1249 0 3 471192 96 0 0 25 0 9 0 655849928 2678296576 615206 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=2615524 CPUtime=4712.91 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 397485 1249 0 3 471218 73 0 0 25 0 9 0 655849928 2678296576 615206 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37650.1
Current children cumulated vsize (KiB) 2615524

[startup+4782.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/387 6862
/proc/meminfo: memFree=27868364/32950928 swapFree=41933848/67111528
[pid=6697] ppid=6695 vsize=2623928 CPUtime=38129.2 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 5220985 1249 0 3 3812039 880 0 0 18 0 9 0 655848984 2686902272 617307 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 655982 617307 180 55 0 653868 0
[pid=6697/tid=6704] ppid=6695 vsize=2623928 CPUtime=4771.25 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 576910 1249 0 3 477037 88 0 0 25 0 9 0 655849927 2686902272 617307 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=2623928 CPUtime=4750.46 cores=0-7
/proc/6697/task/6705/stat : 6705 (plingeling) R 6695 6697 6192 0 -1 4202560 402256 1249 0 3 474974 72 0 0 25 0 9 0 655849927 2686902272 617307 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366586 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6697/tid=6706] ppid=6695 vsize=2623928 CPUtime=4733.69 cores=0-7
/proc/6697/task/6706/stat : 6706 (plingeling) R 6695 6697 6192 0 -1 4202560 676179 1249 0 3 473255 114 0 0 25 0 9 0 655849927 2686902272 617307 33554432000 4194304 4417452 140734548467536 18446744073709551615 4250651 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6697/tid=6707] ppid=6695 vsize=2623928 CPUtime=4772.89 cores=0-7
/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 1022958 1249 0 3 477111 178 0 0 25 0 9 0 655849927 2686902272 617307 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=2623928 CPUtime=4772.78 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 329639 1249 0 3 477212 66 0 0 25 0 9 0 655849927 2686902272 617307 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=2623928 CPUtime=4772.87 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 884959 1249 0 3 477149 138 0 0 25 0 9 0 655849928 2686902272 617307 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=2623928 CPUtime=4772.87 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 527287 1249 0 3 477191 96 0 0 25 0 9 0 655849928 2686902272 617307 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=2623928 CPUtime=4772.89 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 404652 1249 0 3 477215 74 0 0 25 0 9 0 655849928 2686902272 617307 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38129.2
Current children cumulated vsize (KiB) 2623928

[startup+4842.3 s]
/proc/loadavg: 8.04 8.04 8.00 9/387 6864
/proc/meminfo: memFree=27744608/32950928 swapFree=41933848/67111528
[pid=6697] ppid=6695 vsize=2747152 CPUtime=38608.4 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 5295763 1249 0 3 3859947 893 0 0 18 0 9 0 655848984 2813083648 648113 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 686788 648113 180 55 0 684674 0
[pid=6697/tid=6704] ppid=6695 vsize=2747152 CPUtime=4831.23 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 579124 1249 0 3 483035 88 0 0 25 0 9 0 655849927 2813083648 648113 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=2747152 CPUtime=4810.47 cores=0-7
/proc/6697/task/6705/stat : 6705 (plingeling) R 6695 6697 6192 0 -1 4202560 402256 1249 0 3 480975 72 0 0 25 0 9 0 655849927 2813083648 648113 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6697/tid=6706] ppid=6695 vsize=2747152 CPUtime=4792.91 cores=0-7
/proc/6697/task/6706/stat : 6706 (plingeling) R 6695 6697 6192 0 -1 4202560 681128 1249 0 3 479177 114 0 0 25 0 9 0 655849927 2813083648 648113 33554432000 4194304 4417452 140734548467536 18446744073709551615 4365130 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6697/tid=6707] ppid=6695 vsize=2747152 CPUtime=4832.89 cores=0-7
/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 1062216 1249 0 3 483103 186 0 0 25 0 9 0 655849927 2813083648 648113 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=2747152 CPUtime=4832.78 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 335976 1249 0 3 483211 67 0 0 25 0 9 0 655849927 2813083648 648113 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=2747152 CPUtime=4832.87 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 893220 1249 0 3 483148 139 0 0 25 0 9 0 655849928 2813083648 648113 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=2747152 CPUtime=4832.86 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 541046 1249 0 3 483188 98 0 0 25 0 9 0 655849928 2813083648 648113 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=2747152 CPUtime=4832.89 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 404652 1249 0 3 483215 74 0 0 25 0 9 0 655849928 2813083648 648113 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38608.4
Current children cumulated vsize (KiB) 2747152

[startup+4902.3 s]
/proc/loadavg: 8.20 8.07 8.01 9/387 6866
/proc/meminfo: memFree=27689904/32950928 swapFree=41933848/67111528
[pid=6697] ppid=6695 vsize=2805364 CPUtime=39087.6 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 5341549 1249 0 3 3907865 900 0 0 18 0 9 0 655848984 2872692736 662666 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 701341 662666 180 55 0 699227 0
[pid=6697/tid=6704] ppid=6695 vsize=2805364 CPUtime=4891.22 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 586777 1249 0 3 489033 89 0 0 25 0 9 0 655849927 2872692736 662666 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366391 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=2805364 CPUtime=4870.47 cores=0-7
/proc/6697/task/6705/stat : 6705 (plingeling) R 6695 6697 6192 0 -1 4202560 402256 1249 0 3 486975 72 0 0 25 0 9 0 655849927 2872692736 662666 33554432000 4194304 4417452 140734548467536 18446744073709551615 4357204 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6697/tid=6706] ppid=6695 vsize=2805364 CPUtime=4852.16 cores=0-7
/proc/6697/task/6706/stat : 6706 (plingeling) R 6695 6697 6192 0 -1 4202560 689789 1249 0 3 485100 116 0 0 25 0 9 0 655849927 2872692736 662666 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6697/tid=6707] ppid=6695 vsize=2805364 CPUtime=4892.89 cores=0-7
/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 1062216 1249 0 3 489103 186 0 0 25 0 9 0 655849927 2872692736 662666 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=2805364 CPUtime=4892.78 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 345707 1249 0 3 489209 69 0 0 25 0 9 0 655849927 2872692736 662666 33554432000 4194304 4417452 140734548467536 18446744073709551615 4302964 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=2805364 CPUtime=4892.88 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 901215 1249 0 3 489148 140 0 0 25 0 9 0 655849928 2872692736 662666 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=2805364 CPUtime=4892.87 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 549337 1249 0 3 489188 99 0 0 25 0 9 0 655849928 2872692736 662666 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=2805364 CPUtime=4892.9 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 408107 1249 0 3 489215 75 0 0 25 0 9 0 655849928 2872692736 662666 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39087.6
Current children cumulated vsize (KiB) 2805364

[startup+4962.3 s]
/proc/loadavg: 8.11 8.07 8.01 9/387 6867
/proc/meminfo: memFree=27940120/32950928 swapFree=41933848/67111528
[pid=6697] ppid=6695 vsize=2551912 CPUtime=39566.9 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 5390627 1249 0 3 3955780 907 0 0 18 0 9 0 655848984 2613157888 599303 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 637978 599303 180 55 0 635864 0
[pid=6697/tid=6704] ppid=6695 vsize=2551912 CPUtime=4951.21 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 590542 1249 0 3 495032 89 0 0 25 0 9 0 655849927 2613157888 599303 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=2551912 CPUtime=4930.47 cores=0-7
/proc/6697/task/6705/stat : 6705 (plingeling) R 6695 6697 6192 0 -1 4202560 402256 1249 0 3 492975 72 0 0 25 0 9 0 655849927 2613157888 599303 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6697/tid=6706] ppid=6695 vsize=2551912 CPUtime=4911.39 cores=0-7
/proc/6697/task/6706/stat : 6706 (plingeling) R 6695 6697 6192 0 -1 4202560 691165 1249 0 3 491023 116 0 0 25 0 9 0 655849927 2613157888 599303 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6697/tid=6707] ppid=6695 vsize=2551912 CPUtime=4952.9 cores=0-7
/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 1076792 1249 0 3 495101 189 0 0 25 0 9 0 655849927 2613157888 599303 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=2551912 CPUtime=4952.78 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 355332 1249 0 3 495207 71 0 0 25 0 9 0 655849927 2613157888 599303 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=2551912 CPUtime=4952.87 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 912112 1249 0 3 495146 141 0 0 25 0 9 0 655849928 2613157888 599303 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=2551912 CPUtime=4952.87 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 554094 1249 0 3 495187 100 0 0 25 0 9 0 655849928 2613157888 599303 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=2551912 CPUtime=4952.9 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 412189 1249 0 3 495214 76 0 0 25 0 9 0 655849928 2613157888 599303 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39566.9
Current children cumulated vsize (KiB) 2551912



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5016.6 s]
/proc/loadavg: 8.14 8.09 8.02 9/387 6869
/proc/meminfo: memFree=27900164/32950928 swapFree=41933848/67111528
[pid=6697] ppid=6695 vsize=2591764 CPUtime=40000.6 cores=0-7
/proc/6697/stat : 6697 (plingeling) S 6695 6697 6192 0 -1 4202496 5430729 1249 0 3 3999150 913 0 0 18 0 9 0 655848984 2653966336 609266 33554432000 4194304 4417452 140734548467536 18446744073709551615 251826042853 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/6697/statm: 647941 609266 180 55 0 645827 0
[pid=6697/tid=6704] ppid=6695 vsize=2591764 CPUtime=5005.51 cores=0-7
/proc/6697/task/6704/stat : 6704 (plingeling) R 6695 6697 6192 0 -1 4202560 596189 1249 0 3 500461 90 0 0 25 0 9 0 655849927 2653966336 609266 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=6697/tid=6705] ppid=6695 vsize=2591764 CPUtime=4984.79 cores=0-7
/proc/6697/task/6705/stat : 6705 (plingeling) R 6695 6697 6192 0 -1 4202560 408711 1249 0 3 498405 74 0 0 25 0 9 0 655849927 2653966336 609266 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=6697/tid=6706] ppid=6695 vsize=2591764 CPUtime=4965.01 cores=0-7
/proc/6697/task/6706/stat : 6706 (plingeling) R 6695 6697 6192 0 -1 4202560 692541 1249 0 3 496385 116 0 0 25 0 9 0 655849927 2653966336 609266 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=6697/tid=6707] ppid=6695 vsize=2591764 CPUtime=5007.21 cores=0-7
/proc/6697/task/6707/stat : 6707 (plingeling) R 6695 6697 6192 0 -1 4202560 1083222 1249 0 3 500531 190 0 0 25 0 9 0 655849927 2653966336 609266 33554432000 4194304 4417452 140734548467536 18446744073709551615 4237221 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=6697/tid=6708] ppid=6695 vsize=2591764 CPUtime=5007.1 cores=0-7
/proc/6697/task/6708/stat : 6708 (plingeling) R 6695 6697 6192 0 -1 4202560 358749 1249 0 3 500638 72 0 0 25 0 9 0 655849927 2653966336 609266 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=6697/tid=6709] ppid=6695 vsize=2591764 CPUtime=5007.19 cores=0-7
/proc/6697/task/6709/stat : 6709 (plingeling) R 6695 6697 6192 0 -1 4202560 918211 1249 0 3 500577 142 0 0 25 0 9 0 655849928 2653966336 609266 33554432000 4194304 4417452 140734548467536 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=6697/tid=6710] ppid=6695 vsize=2591764 CPUtime=5007.19 cores=0-7
/proc/6697/task/6710/stat : 6710 (plingeling) R 6695 6697 6192 0 -1 4202560 562306 1249 0 3 500618 101 0 0 25 0 9 0 655849928 2653966336 609266 33554432000 4194304 4417452 140734548467536 18446744073709551615 4364805 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=6697/tid=6711] ppid=6695 vsize=2591764 CPUtime=5007.21 cores=0-7
/proc/6697/task/6711/stat : 6711 (plingeling) R 6695 6697 6192 0 -1 4202560 414655 1249 0 3 500645 76 0 0 25 0 9 0 655849928 2653966336 609266 33554432000 4194304 4417452 140734548467536 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 2591764

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5016.71
CPU time (s): 40000.8
CPU user time (s): 39991.6
CPU system time (s): 9.2266
CPU usage (%): 797.351
Max. virtual memory (cumulated for all children) (KiB): 2934208

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39991.6
system time used= 9.2266
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5431978
page faults= 3
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 188
involuntary context switches= 193806

runsolver used 18.2602 second user time and 45.5931 second system time

The end

Launcher Data 

Begin job on node126 at 2011-05-15 08:55:02
IDJOB=3372809
IDBENCH=83466
IDSOLVER=1851
FILE ID=node126/3372809-1305442499
RUNJOBID= node126-1305437033-6206
PBS_JOBID= 13324762
Free space on /tmp= 73252 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/application/leberre/2dimensionalstrippacking/E00N23.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372809-1305442499/watcher-3372809-1305442499 -o /tmp/evaluation-result-3372809-1305442499/solver-3372809-1305442499 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372809-1305442499.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1a1f0dddf727883e0973677dd00e9269
RANDOM SEED=748974087

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      30382832 kB
Buffers:        161524 kB
Cached:        1698880 kB
SwapCached:      49084 kB
Active:         135404 kB
Inactive:      2184492 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      30382832 kB
SwapTotal:    67111528 kB
SwapFree:     41933832 kB
Dirty:          114696 kB
Writeback:           0 kB
AnonPages:      423104 kB
Mapped:           9860 kB
Slab:           104256 kB
PageTables:      75104 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 88086696 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73252 MiB
End job on node126 at 2011-05-15 10:18:41