Trace number 3394566

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.8 5013.03

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-5-5_34308.cnf
MD5SUM1ef198d3f2d717e33f4f2ba124eb7eb2
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables34306
Number of clauses708168
Sum of the clauses size3540840
Maximum clause length5
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 5708168
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394566-1306099789/watcher-3394566-1306099789 -o /tmp/evaluation-result-3394566-1306099789/solver-3394566-1306099789 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394566-1306099789.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.07 8.05 8.00 2/439 8233
/proc/meminfo: memFree=32567752/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=8728 CPUtime=0 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 215 0 0 0 0 0 0 0 22 0 1 0 721577770 8937472 147 33554432000 4194304 4417452 140734434635744 18446744073709551615 235594866432 0 0 4096 0 18446744071562362840 0 0 17 6 0 0 0
/proc/8233/statm: 2182 147 122 55 0 68 0

[startup+0.030147 s]
/proc/loadavg: 8.07 8.05 8.00 2/439 8233
/proc/meminfo: memFree=32567752/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=8728 CPUtime=0 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 215 0 0 0 0 0 0 0 22 0 1 0 721577770 8937472 147 33554432000 4194304 4417452 140734434635744 18446744073709551615 235594866432 0 0 4096 0 18446744071562362840 0 0 17 6 0 0 0
/proc/8233/statm: 2182 147 122 55 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8728

[startup+0.100134 s]
/proc/loadavg: 8.07 8.05 8.00 2/439 8233
/proc/meminfo: memFree=32567752/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=8728 CPUtime=0 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 215 0 0 0 0 0 0 0 22 0 1 0 721577770 8937472 147 33554432000 4194304 4417452 140734434635744 18446744073709551615 235594866432 0 0 4096 0 18446744071562362840 0 0 17 6 0 0 0
/proc/8233/statm: 2182 147 122 55 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8728

[startup+0.300173 s]
/proc/loadavg: 8.07 8.05 8.00 2/439 8233
/proc/meminfo: memFree=32567752/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=43888 CPUtime=0.18 cores=0-7
/proc/8233/stat : 8233 (plingeling) R 8231 8233 7837 0 -1 4202496 9065 1246 0 5 17 1 0 0 21 0 1 0 721577770 44941312 8996 33554432000 4194304 4417452 140734434635744 18446744073709551615 4323444 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/8233/statm: 10972 8996 148 55 0 8858 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 43888

[startup+0.701099 s]
/proc/loadavg: 8.07 8.05 8.00 2/439 8233
/proc/meminfo: memFree=32567752/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=93952 CPUtime=0.58 cores=0-7
/proc/8233/stat : 8233 (plingeling) R 8231 8233 7837 0 -1 4202496 21581 1246 0 5 55 3 0 0 23 0 1 0 721577770 96206848 21512 33554432000 4194304 4417452 140734434635744 18446744073709551615 4235997 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/8233/statm: 23488 21512 148 55 0 21374 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 93952

[startup+1.50089 s]
/proc/loadavg: 7.51 7.94 7.96 2/440 8239
/proc/meminfo: memFree=32448900/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=159488 CPUtime=1.38 cores=0-7
/proc/8233/stat : 8233 (plingeling) R 8231 8233 7837 0 -1 4202496 37965 1246 0 5 133 5 0 0 25 0 1 0 721577770 163315712 37896 33554432000 4194304 4417452 140734434635744 18446744073709551615 4231537 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/8233/statm: 39872 37896 148 55 0 37758 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 159488

[startup+3.10061 s]
/proc/loadavg: 7.51 7.94 7.96 2/440 8239
/proc/meminfo: memFree=32330364/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=309900 CPUtime=2.98 cores=0-7
/proc/8233/stat : 8233 (plingeling) R 8231 8233 7837 0 -1 4202496 75576 1246 0 5 288 10 0 0 25 0 1 0 721577770 317337600 75499 33554432000 4194304 4417452 140734434635744 18446744073709551615 235594866432 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/8233/statm: 77475 75499 148 55 0 75361 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 309900

[startup+6.30105 s]
/proc/loadavg: 7.51 7.94 7.96 9/448 8247
/proc/meminfo: memFree=32128312/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=521800 CPUtime=21.9 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 150788 1246 0 5 2166 24 0 0 25 0 9 0 721577770 534323200 108000 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 130450 108000 178 55 0 128336 0
[pid=8233/tid=8240] ppid=8231 vsize=521800 CPUtime=2.25 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 5336 1246 0 5 225 0 0 0 21 0 9 0 721578173 534323200 108000 33554432000 4194304 4417452 140734434635744 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=521800 CPUtime=2.23 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 5333 1246 0 5 222 1 0 0 25 0 9 0 721578173 534323200 108000 33554432000 4194304 4417452 140734434635744 18446744073709551615 4278271 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=521800 CPUtime=2.24 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 5545 1246 0 5 223 1 0 0 25 0 9 0 721578173 534323200 108000 33554432000 4194304 4417452 140734434635744 18446744073709551615 4331715 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=521800 CPUtime=2.21 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 5014 1246 0 5 221 0 0 0 21 0 9 0 721578173 534323200 108000 33554432000 4194304 4417452 140734434635744 18446744073709551615 4357297 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=521800 CPUtime=2.25 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 5262 1246 0 5 224 1 0 0 21 0 9 0 721578173 534323200 108000 33554432000 4194304 4417452 140734434635744 18446744073709551615 4278271 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=521800 CPUtime=2.25 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 5262 1246 0 5 224 1 0 0 25 0 9 0 721578173 534323200 108000 33554432000 4194304 4417452 140734434635744 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8233/tid=8246] ppid=8231 vsize=521800 CPUtime=2.24 cores=0-7
/proc/8233/task/8246/stat : 8246 (plingeling) R 8231 8233 7837 0 -1 4202560 5288 1246 0 5 223 1 0 0 25 0 9 0 721578173 534323200 108000 33554432000 4194304 4417452 140734434635744 18446744073709551615 4331715 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8233/tid=8247] ppid=8231 vsize=521800 CPUtime=2.24 cores=0-7
/proc/8233/task/8247/stat : 8247 (plingeling) R 8231 8233 7837 0 -1 4202560 5388 1246 0 5 223 1 0 0 25 0 9 0 721578175 534323200 108000 33554432000 4194304 4417452 140734434635744 18446744073709551615 4278246 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 21.9
Current children cumulated vsize (KiB) 521800

[startup+12.7009 s]
/proc/loadavg: 7.66 7.95 7.97 9/448 8247
/proc/meminfo: memFree=32127980/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=528224 CPUtime=73 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 155283 1246 0 5 7276 24 0 0 25 0 9 0 721577770 540901376 109613 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 132056 109613 179 55 0 129942 0
[pid=8233/tid=8240] ppid=8231 vsize=528224 CPUtime=8.65 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 5403 1246 0 5 865 0 0 0 25 0 9 0 721578173 540901376 109613 33554432000 4194304 4417452 140734434635744 18446744073709551615 4235378 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=528224 CPUtime=8.63 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 5531 1246 0 5 862 1 0 0 25 0 9 0 721578173 540901376 109613 33554432000 4194304 4417452 140734434635744 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=528224 CPUtime=8.64 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 6014 1246 0 5 863 1 0 0 25 0 9 0 721578173 540901376 109613 33554432000 4194304 4417452 140734434635744 18446744073709551615 4366486 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=528224 CPUtime=8.52 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 6667 1246 0 5 852 0 0 0 25 0 9 0 721578173 540901376 109613 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=528224 CPUtime=8.65 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 5926 1246 0 5 864 1 0 0 25 0 9 0 721578173 540901376 109613 33554432000 4194304 4417452 140734434635744 18446744073709551615 4355860 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=528224 CPUtime=8.65 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 5834 1246 0 5 864 1 0 0 25 0 9 0 721578173 540901376 109613 33554432000 4194304 4417452 140734434635744 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8233/tid=8246] ppid=8231 vsize=528224 CPUtime=8.64 cores=0-7
/proc/8233/task/8246/stat : 8246 (plingeling) R 8231 8233 7837 0 -1 4202560 5758 1246 0 5 863 1 0 0 25 0 9 0 721578173 540901376 109613 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8233/tid=8247] ppid=8231 vsize=528224 CPUtime=8.64 cores=0-7
/proc/8233/task/8247/stat : 8247 (plingeling) R 8231 8233 7837 0 -1 4202560 5790 1246 0 5 863 1 0 0 25 0 9 0 721578175 540901376 109613 33554432000 4194304 4417452 140734434635744 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 73
Current children cumulated vsize (KiB) 528224

[startup+25.5007 s]
/proc/loadavg: 7.71 7.96 7.97 9/448 8248
/proc/meminfo: memFree=32102204/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=621504 CPUtime=175.21 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 166123 1246 0 5 17495 26 0 0 25 0 9 0 721577770 636420096 116576 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 155376 116576 179 55 0 153262 0
[pid=8233/tid=8240] ppid=8231 vsize=621504 CPUtime=21.45 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 5768 1246 0 5 2145 0 0 0 25 0 9 0 721578173 636420096 116576 33554432000 4194304 4417452 140734434635744 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=621504 CPUtime=21.43 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 5564 1246 0 5 2142 1 0 0 25 0 9 0 721578173 636420096 116576 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=621504 CPUtime=21.44 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 7306 1246 0 5 2143 1 0 0 25 0 9 0 721578173 636420096 116576 33554432000 4194304 4417452 140734434635744 18446744073709551615 4348423 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=621504 CPUtime=21.13 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 13722 1246 0 5 2112 1 0 0 25 0 9 0 721578173 636420096 116576 33554432000 4194304 4417452 140734434635744 18446744073709551615 4366680 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=621504 CPUtime=21.44 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 6667 1246 0 5 2143 1 0 0 25 0 9 0 721578173 636420096 116576 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=621504 CPUtime=21.46 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 6101 1246 0 5 2144 2 0 0 25 0 9 0 721578173 636420096 116576 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8233/tid=8246] ppid=8231 vsize=621504 CPUtime=21.44 cores=0-7
/proc/8233/task/8246/stat : 8246 (plingeling) R 8231 8233 7837 0 -1 4202560 6812 1246 0 5 2143 1 0 0 25 0 9 0 721578173 636420096 116576 33554432000 4194304 4417452 140734434635744 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8233/tid=8247] ppid=8231 vsize=621504 CPUtime=21.44 cores=0-7
/proc/8233/task/8247/stat : 8247 (plingeling) R 8231 8233 7837 0 -1 4202560 5823 1246 0 5 2143 1 0 0 25 0 9 0 721578175 636420096 116576 33554432000 4194304 4417452 140734434635744 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 175.21
Current children cumulated vsize (KiB) 621504

[startup+51.1012 s]
/proc/loadavg: 7.82 7.96 7.97 9/448 8249
/proc/meminfo: memFree=32045684/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=670508 CPUtime=379.63 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 199754 1246 0 5 37932 31 0 0 25 0 9 0 721577770 686600192 130795 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 167627 130795 179 55 0 165513 0
[pid=8233/tid=8240] ppid=8231 vsize=670508 CPUtime=47.06 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 6194 1246 0 5 4705 1 0 0 25 0 9 0 721578173 686600192 130795 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=670508 CPUtime=47.03 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 7618 1246 0 5 4702 1 0 0 25 0 9 0 721578173 686600192 130795 33554432000 4194304 4417452 140734434635744 18446744073709551615 4356884 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=670508 CPUtime=47.03 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 8771 1246 0 5 4702 1 0 0 25 0 9 0 721578173 686600192 130795 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=670508 CPUtime=46.36 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 27296 1246 0 5 4633 3 0 0 25 0 9 0 721578173 686600192 130795 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=670508 CPUtime=47.05 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 8775 1246 0 5 4703 2 0 0 25 0 9 0 721578173 686600192 130795 33554432000 4194304 4417452 140734434635744 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=670508 CPUtime=47.05 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 13455 1246 0 5 4703 2 0 0 25 0 9 0 721578173 686600192 130795 33554432000 4194304 4417452 140734434635744 18446744073709551615 4355849 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8233/tid=8246] ppid=8231 vsize=670508 CPUtime=47.04 cores=0-7
/proc/8233/task/8246/stat : 8246 (plingeling) R 8231 8233 7837 0 -1 4202560 11002 1246 0 5 4702 2 0 0 25 0 9 0 721578173 686600192 130795 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8233/tid=8247] ppid=8231 vsize=670508 CPUtime=47.03 cores=0-7
/proc/8233/task/8247/stat : 8247 (plingeling) R 8231 8233 7837 0 -1 4202560 8283 1246 0 5 4702 1 0 0 25 0 9 0 721578175 686600192 130795 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 379.63
Current children cumulated vsize (KiB) 670508

[startup+102.317 s]
/proc/loadavg: 7.96 7.98 7.97 9/448 8250
/proc/meminfo: memFree=32009504/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=701212 CPUtime=788.6 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 310303 1246 0 5 78807 53 0 0 25 0 9 0 721577770 718041088 140560 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 175303 140560 179 55 0 173189 0
[pid=8233/tid=8240] ppid=8231 vsize=701212 CPUtime=98.27 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 11834 1246 0 5 9825 2 0 0 25 0 9 0 721578173 718041088 140560 33554432000 4194304 4417452 140734434635744 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=701212 CPUtime=98.25 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 15095 1246 0 5 9822 3 0 0 25 0 9 0 721578173 718041088 140560 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=701212 CPUtime=98.24 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 19091 1246 0 5 9821 3 0 0 25 0 9 0 721578173 718041088 140560 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=701212 CPUtime=96.83 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 59381 1246 0 5 9674 9 0 0 25 0 9 0 721578173 718041088 140560 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=701212 CPUtime=98.27 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 19784 1246 0 5 9823 4 0 0 25 0 9 0 721578173 718041088 140560 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=701212 CPUtime=98.27 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 38186 1246 0 5 9820 7 0 0 25 0 9 0 721578173 718041088 140560 33554432000 4194304 4417452 140734434635744 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 0 0 0 0

################
# More data... #
################


[startup+4722.32 s]
/proc/loadavg: 8.10 8.09 8.02 9/448 8385
/proc/meminfo: memFree=30042360/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=2641808 CPUtime=37680.1 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 10661944 1246 0 5 3766328 1679 0 0 25 0 9 0 721577770 2705211392 630284 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 660452 630284 179 55 0 658338 0
[pid=8233/tid=8240] ppid=8231 vsize=2641808 CPUtime=4718.31 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 1346327 1246 0 5 471620 211 0 0 25 0 9 0 721578173 2705211392 630284 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=2641808 CPUtime=4718.35 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 1108327 1246 0 5 471666 169 0 0 25 0 9 0 721578173 2705211392 630284 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=2641808 CPUtime=4716.57 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 1196104 1246 0 5 471471 186 0 0 25 0 9 0 721578173 2705211392 630284 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=2641808 CPUtime=4649.72 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 987589 1246 0 5 464780 192 0 0 25 0 9 0 721578173 2705211392 630284 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=2641808 CPUtime=4718.36 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 1352869 1246 0 5 471626 210 0 0 25 0 9 0 721578173 2705211392 630284 33554432000 4194304 4417452 140734434635744 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=2641808 CPUtime=4718.37 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 2110699 1246 0 5 471532 305 0 0 25 0 9 0 721578173 2705211392 630284 33554432000 4194304 4417452 140734434635744 18446744073709551615 4366319 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8233/tid=8246] ppid=8231 vsize=2641808 CPUtime=4718.07 cores=0-7
/proc/8233/task/8246/stat : 8246 (plingeling) R 8231 8233 7837 0 -1 4202560 1295039 1246 0 5 471603 204 0 0 25 0 9 0 721578173 2705211392 630284 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8233/tid=8247] ppid=8231 vsize=2641808 CPUtime=4718.36 cores=0-7
/proc/8233/task/8247/stat : 8247 (plingeling) R 8231 8233 7837 0 -1 4202560 1156630 1246 0 5 471651 185 0 0 25 0 9 0 721578175 2705211392 630284 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37680.1
Current children cumulated vsize (KiB) 2641808

[startup+4782.3 s]
/proc/loadavg: 8.15 8.10 8.02 9/448 8387
/proc/meminfo: memFree=30066636/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=2624340 CPUtime=38159.1 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 10819586 1246 0 5 3814208 1700 0 0 25 0 9 0 721577770 2687324160 625919 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 656085 625919 179 55 0 653971 0
[pid=8233/tid=8240] ppid=8231 vsize=2624340 CPUtime=4778.29 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 1354988 1246 0 5 477617 212 0 0 25 0 9 0 721578173 2687324160 625919 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=2624340 CPUtime=4778.33 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 1140124 1246 0 5 477661 172 0 0 25 0 9 0 721578173 2687324160 625919 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=2624340 CPUtime=4776.53 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 1207219 1246 0 5 477465 188 0 0 25 0 9 0 721578173 2687324160 625919 33554432000 4194304 4417452 140734434635744 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=2624340 CPUtime=4708.84 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 987589 1246 0 5 470692 192 0 0 25 0 9 0 721578173 2687324160 625919 33554432000 4194304 4417452 140734434635744 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=2624340 CPUtime=4778.33 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 1390169 1246 0 5 477617 216 0 0 25 0 9 0 721578173 2687324160 625919 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=2624340 CPUtime=4778.36 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 2143884 1246 0 5 477527 309 0 0 25 0 9 0 721578173 2687324160 625919 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8233/tid=8246] ppid=8231 vsize=2624340 CPUtime=4778.05 cores=0-7
/proc/8233/task/8246/stat : 8246 (plingeling) R 8231 8233 7837 0 -1 4202560 1302930 1246 0 5 477600 205 0 0 25 0 9 0 721578173 2687324160 625919 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8233/tid=8247] ppid=8231 vsize=2624340 CPUtime=4778.35 cores=0-7
/proc/8233/task/8247/stat : 8247 (plingeling) R 8231 8233 7837 0 -1 4202560 1184323 1246 0 5 477647 188 0 0 25 0 9 0 721578175 2687324160 625919 33554432000 4194304 4417452 140734434635744 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38159.1
Current children cumulated vsize (KiB) 2624340

[startup+4842.3 s]
/proc/loadavg: 8.11 8.09 8.02 9/448 8388
/proc/meminfo: memFree=30043904/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=2582140 CPUtime=38638.2 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 10939396 1246 0 5 3862101 1718 0 0 25 0 9 0 721577770 2644111360 620258 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 645535 620258 179 55 0 643421 0
[pid=8233/tid=8240] ppid=8231 vsize=2582140 CPUtime=4838.29 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 1365482 1246 0 5 483615 214 0 0 25 0 9 0 721578173 2644111360 620258 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=2582140 CPUtime=4838.33 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 1146612 1246 0 5 483660 173 0 0 25 0 9 0 721578173 2644111360 620258 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=2582140 CPUtime=4836.53 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 1231002 1246 0 5 483462 191 0 0 25 0 9 0 721578173 2644111360 620258 33554432000 4194304 4417452 140734434635744 18446744073709551615 4245635 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=2582140 CPUtime=4767.96 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 987589 1246 0 5 476604 192 0 0 25 0 9 0 721578173 2644111360 620258 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=2582140 CPUtime=4838.34 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 1423322 1246 0 5 483613 221 0 0 25 0 9 0 721578173 2644111360 620258 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=2582140 CPUtime=4838.35 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 2168091 1246 0 5 483523 312 0 0 25 0 9 0 721578173 2644111360 620258 33554432000 4194304 4417452 140734434635744 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8233/tid=8246] ppid=8231 vsize=2582140 CPUtime=4838.05 cores=0-7
/proc/8233/task/8246/stat : 8246 (plingeling) R 8231 8233 7837 0 -1 4202560 1304968 1246 0 5 483600 205 0 0 25 0 9 0 721578173 2644111360 620258 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8233/tid=8247] ppid=8231 vsize=2582140 CPUtime=4838.35 cores=0-7
/proc/8233/task/8247/stat : 8247 (plingeling) R 8231 8233 7837 0 -1 4202560 1203970 1246 0 5 483643 192 0 0 25 0 9 0 721578175 2644111360 620258 33554432000 4194304 4417452 140734434635744 18446744073709551615 4236891 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38638.2
Current children cumulated vsize (KiB) 2582140

[startup+4902.3 s]
/proc/loadavg: 8.08 8.09 8.02 9/448 8390
/proc/meminfo: memFree=30208040/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=2526112 CPUtime=39117.3 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 11044250 1246 0 5 3910003 1730 0 0 25 0 9 0 721577770 2586738688 604640 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 631528 604640 179 55 0 629414 0
[pid=8233/tid=8240] ppid=8231 vsize=2526112 CPUtime=4898.3 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 1387590 1246 0 5 489613 217 0 0 25 0 9 0 721578173 2586738688 604640 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=2526112 CPUtime=4898.33 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 1167804 1246 0 5 489658 175 0 0 25 0 9 0 721578173 2586738688 604640 33554432000 4194304 4417452 140734434635744 18446744073709551615 4365458 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=2526112 CPUtime=4896.51 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 1239971 1246 0 5 489459 192 0 0 25 0 9 0 721578173 2586738688 604640 33554432000 4194304 4417452 140734434635744 18446744073709551615 4232664 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=2526112 CPUtime=4827.1 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 987589 1246 0 5 482518 192 0 0 25 0 9 0 721578173 2586738688 604640 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=2526112 CPUtime=4898.34 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 1429686 1246 0 5 489612 222 0 0 25 0 9 0 721578173 2586738688 604640 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=2526112 CPUtime=4898.35 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 2180193 1246 0 5 489522 313 0 0 25 0 9 0 721578173 2586738688 604640 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8233/tid=8246] ppid=8231 vsize=2526112 CPUtime=4898.06 cores=0-7
/proc/8233/task/8246/stat : 8246 (plingeling) R 8231 8233 7837 0 -1 4202560 1329788 1246 0 5 489598 208 0 0 25 0 9 0 721578173 2586738688 604640 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8233/tid=8247] ppid=8231 vsize=2526112 CPUtime=4898.35 cores=0-7
/proc/8233/task/8247/stat : 8247 (plingeling) R 8231 8233 7837 0 -1 4202560 1213269 1246 0 5 489642 193 0 0 25 0 9 0 721578175 2586738688 604640 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39117.3
Current children cumulated vsize (KiB) 2526112

[startup+4962.3 s]
/proc/loadavg: 8.03 8.07 8.02 9/448 8391
/proc/meminfo: memFree=29993724/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=2680192 CPUtime=39596.4 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 11204208 1246 0 5 3957896 1748 0 0 25 0 9 0 721577770 2744516608 641725 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 670048 641725 179 55 0 667934 0
[pid=8233/tid=8240] ppid=8231 vsize=2680192 CPUtime=4958.3 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 1403205 1246 0 5 495611 219 0 0 25 0 9 0 721578173 2744516608 641725 33554432000 4194304 4417452 140734434635744 18446744073709551615 4354070 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=2680192 CPUtime=4958.33 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 1176548 1246 0 5 495657 176 0 0 25 0 9 0 721578173 2744516608 641725 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=2680192 CPUtime=4956.49 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 1269622 1246 0 5 495454 195 0 0 25 0 9 0 721578173 2744516608 641725 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=2680192 CPUtime=4886.22 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 987589 1246 0 5 488430 192 0 0 25 0 9 0 721578173 2744516608 641725 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=2680192 CPUtime=4958.34 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 1437875 1246 0 5 495611 223 0 0 25 0 9 0 721578173 2744516608 641725 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=2680192 CPUtime=4958.36 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 2225566 1246 0 5 495518 318 0 0 25 0 9 0 721578173 2744516608 641725 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8233/tid=8246] ppid=8231 vsize=2680192 CPUtime=4958.06 cores=0-7
/proc/8233/task/8246/stat : 8246 (plingeling) R 8231 8233 7837 0 -1 4202560 1355144 1246 0 5 495595 211 0 0 25 0 9 0 721578173 2744516608 641725 33554432000 4194304 4417452 140734434635744 18446744073709551615 4263096 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8233/tid=8247] ppid=8231 vsize=2680192 CPUtime=4958.35 cores=0-7
/proc/8233/task/8247/stat : 8247 (plingeling) R 8231 8233 7837 0 -1 4202560 1240299 1246 0 5 495640 195 0 0 25 0 9 0 721578175 2744516608 641725 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39596.4
Current children cumulated vsize (KiB) 2680192



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5012.9 s]
/proc/loadavg: 8.01 8.06 8.01 9/448 8393
/proc/meminfo: memFree=30046148/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=2618304 CPUtime=40000.6 cores=0-7
/proc/8233/stat : 8233 (plingeling) S 8231 8233 7837 0 -1 4202496 11317918 1246 0 5 3998293 1763 0 0 25 0 9 0 721577770 2681143296 628517 33554432000 4194304 4417452 140734434635744 18446744073709551615 235606669285 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 654576 628517 179 55 0 652462 0
[pid=8233/tid=8240] ppid=8231 vsize=2618304 CPUtime=5008.91 cores=0-7
/proc/8233/task/8240/stat : 8240 (plingeling) R 8231 8233 7837 0 -1 4202560 1418579 1246 0 5 500669 222 0 0 25 0 9 0 721578173 2681143296 628517 33554432000 4194304 4417452 140734434635744 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=8233/tid=8241] ppid=8231 vsize=2618304 CPUtime=5008.96 cores=0-7
/proc/8233/task/8241/stat : 8241 (plingeling) R 8231 8233 7837 0 -1 4202560 1201183 1246 0 5 500716 180 0 0 25 0 9 0 721578173 2681143296 628517 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=8233/tid=8242] ppid=8231 vsize=2618304 CPUtime=5007.09 cores=0-7
/proc/8233/task/8242/stat : 8242 (plingeling) R 8231 8233 7837 0 -1 4202560 1275155 1246 0 5 500513 196 0 0 25 0 9 0 721578173 2681143296 628517 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=2618304 CPUtime=4936.09 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4202560 1002671 1246 0 5 493415 194 0 0 25 0 9 0 721578173 2681143296 628517 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=8233/tid=8244] ppid=8231 vsize=2618304 CPUtime=5008.96 cores=0-7
/proc/8233/task/8244/stat : 8244 (plingeling) R 8231 8233 7837 0 -1 4202560 1456308 1246 0 5 500671 225 0 0 25 0 9 0 721578173 2681143296 628517 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=8233/tid=8245] ppid=8231 vsize=2618304 CPUtime=5008.97 cores=0-7
/proc/8233/task/8245/stat : 8245 (plingeling) R 8231 8233 7837 0 -1 4202560 2243553 1246 0 5 500577 320 0 0 25 0 9 0 721578173 2681143296 628517 33554432000 4194304 4417452 140734434635744 18446744073709551615 4357260 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8233/tid=8246] ppid=8231 vsize=2618304 CPUtime=5008.67 cores=0-7
/proc/8233/task/8246/stat : 8246 (plingeling) R 8231 8233 7837 0 -1 4202560 1366251 1246 0 5 500655 212 0 0 25 0 9 0 721578173 2681143296 628517 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8233/tid=8247] ppid=8231 vsize=2618304 CPUtime=5008.97 cores=0-7
/proc/8233/task/8247/stat : 8247 (plingeling) R 8231 8233 7837 0 -1 4202560 1245858 1246 0 5 500701 196 0 0 25 0 9 0 721578175 2681143296 628517 33554432000 4194304 4417452 140734434635744 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 2618304

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5013.02 s]
/proc/loadavg: 8.01 8.06 8.01 9/448 8393
/proc/meminfo: memFree=30046148/32950928 swapFree=34364968/67111528
[pid=8233] ppid=8231 vsize=0 CPUtime=40000.8 cores=0-7
/proc/8233/stat : 8233 (plingeling) Z 8231 8233 7837 0 -1 4203548 11317918 1246 0 5 3998303 1773 0 0 18 0 2 0 721577770 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/8233/statm: 0 0 0 0 0 0 0
[pid=8233/tid=8243] ppid=8231 vsize=0 CPUtime=4936.2 cores=0-7
/proc/8233/task/8243/stat : 8243 (plingeling) R 8231 8233 7837 0 -1 4203588 1002671 1246 0 5 493416 204 0 0 25 0 2 0 721578173 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5013.03
CPU time (s): 40000.8
CPU user time (s): 39983
CPU system time (s): 17.7373
CPU usage (%): 797.937
Max. virtual memory (cumulated for all children) (KiB): 2800652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39983
system time used= 17.7373
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11319164
page faults= 5
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 465
involuntary context switches= 189910

runsolver used 20.6889 second user time and 52.2451 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-22 23:29:50
IDJOB=3394566
IDBENCH=83249
IDSOLVER=1851
FILE ID=node120/3394566-1306099789
RUNJOBID= node120-1306093558-7851
PBS_JOBID= 13387948
Free space on /tmp= 73332 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-5-5_34308.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394566-1306099789/watcher-3394566-1306099789 -o /tmp/evaluation-result-3394566-1306099789/solver-3394566-1306099789 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394566-1306099789.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1ef198d3f2d717e33f4f2ba124eb7eb2
RANDOM SEED=2033710698

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      32568032 kB
Buffers:         33616 kB
Cached:         100736 kB
SwapCached:      13480 kB
Active:         104000 kB
Inactive:        49472 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      32568032 kB
SwapTotal:    67111528 kB
SwapFree:     34364968 kB
Dirty:           23052 kB
Writeback:           0 kB
AnonPages:       14888 kB
Mapped:           7276 kB
Slab:            67748 kB
PageTables:      90912 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 105369660 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73332 MiB
End job on node120 at 2011-05-23 00:53:25