Trace number 3394868

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.8 5009.44

General information on the benchmark

NameSAT05/crafted/sorge05/QG7a/
gensys-ukn009.shuffled-as.sat05-3849.cnf
MD5SUMf2a1eb7937a7cda114ce344a30ca1145
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1222.87
Satisfiable
(Un)Satisfiability was proved
Number of variables2969
Number of clauses18718
Sum of the clauses size134151
Maximum clause length13
Minimum clause length1
Number of clauses of size 142
Number of clauses of size 2435
Number of clauses of size 32341
Number of clauses of size 4498
Number of clauses of size 5677
Number of clauses of size over 514725

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394868-1306108336/watcher-3394868-1306108336 -o /tmp/evaluation-result-3394868-1306108336/solver-3394868-1306108336 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394868-1306108336.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.62 7.97 7.97 2/430 27282
/proc/meminfo: memFree=13827236/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=12152 CPUtime=0 cores=0-7
/proc/27282/stat : 27282 (plingeling) R 27280 27282 26947 0 -1 4202496 1115 1253 0 0 0 0 0 0 18 0 1 0 703249212 12443648 1045 33554432000 4194304 4417452 140733897808960 18446744073709551615 270338383616 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/27282/statm: 3038 1045 148 55 0 924 0

[startup+0.19642 s]
/proc/loadavg: 7.62 7.97 7.97 2/430 27282
/proc/meminfo: memFree=13827236/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=171816 CPUtime=0.86 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 5768 1253 0 0 85 1 0 0 21 0 9 0 703249212 175939584 4195 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 42954 4195 180 55 0 40840 0
Current children cumulated CPU time (s) 0.86
Current children cumulated vsize (KiB) 171816

[startup+0.296398 s]
/proc/loadavg: 7.62 7.97 7.97 2/430 27282
/proc/meminfo: memFree=13827236/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=174148 CPUtime=1.66 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 6380 1253 0 0 165 1 0 0 21 0 9 0 703249212 178327552 4778 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 43537 4778 180 55 0 41423 0
Current children cumulated CPU time (s) 1.66
Current children cumulated vsize (KiB) 174148

[startup+0.396379 s]
/proc/loadavg: 7.62 7.97 7.97 2/430 27282
/proc/meminfo: memFree=13827236/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=174764 CPUtime=2.46 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 7240 1253 0 0 245 1 0 0 21 0 9 0 703249212 178958336 4953 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 43691 4953 180 55 0 41577 0
Current children cumulated CPU time (s) 2.46
Current children cumulated vsize (KiB) 174764

[startup+0.700319 s]
/proc/loadavg: 7.62 7.97 7.97 2/430 27282
/proc/meminfo: memFree=13827236/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=182048 CPUtime=4.89 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 10096 1253 0 0 487 2 0 0 21 0 9 0 703249212 186417152 6783 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 45512 6783 180 55 0 43398 0
Current children cumulated CPU time (s) 4.89
Current children cumulated vsize (KiB) 182048

[startup+1.50116 s]
/proc/loadavg: 7.62 7.97 7.97 9/439 27296
/proc/meminfo: memFree=13795288/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=193608 CPUtime=11.28 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 20427 1253 0 0 1124 4 0 0 21 0 9 0 703249212 198254592 9417 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 48146 9417 180 55 0 46032 0
[pid=27282/tid=27289] ppid=27280 vsize=192584 CPUtime=1.4 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 1635 1253 0 0 140 0 0 0 20 0 9 0 703249221 197206016 9417 33554432000 4194304 4417452 140733897808960 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=192584 CPUtime=1.39 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 1618 1253 0 0 139 0 0 0 25 0 9 0 703249221 197206016 9417 33554432000 4194304 4417452 140733897808960 18446744073709551615 4249193 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=192716 CPUtime=1.39 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 2173 1253 0 0 139 0 0 0 25 0 9 0 703249221 197341184 9417 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=192716 CPUtime=1.4 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 3543 1253 0 0 140 0 0 0 25 0 9 0 703249221 197341184 9436 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=192716 CPUtime=1.4 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 1895 1253 0 0 140 0 0 0 19 0 9 0 703249221 197341184 9450 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=192716 CPUtime=1.39 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 1706 1253 0 0 139 0 0 0 25 0 9 0 703249222 197341184 9450 33554432000 4194304 4417452 140733897808960 18446744073709551615 270338077677 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=192716 CPUtime=1.39 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 1984 1253 0 0 139 0 0 0 19 0 9 0 703249222 197341184 9450 33554432000 4194304 4417452 140733897808960 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=192716 CPUtime=1.36 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 1574 1253 0 0 136 0 0 0 25 0 9 0 703249222 197341184 9450 33554432000 4194304 4417452 140733897808960 18446744073709551615 4248899 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.28
Current children cumulated vsize (KiB) 193608

[startup+3.10085 s]
/proc/loadavg: 7.65 7.97 7.97 9/439 27296
/proc/meminfo: memFree=13768256/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=210464 CPUtime=24.06 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 42342 1253 0 0 2397 9 0 0 21 0 9 0 703249212 215515136 13913 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 52616 13913 180 55 0 50502 0
[pid=27282/tid=27289] ppid=27280 vsize=210464 CPUtime=3 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 4410 1253 0 0 300 0 0 0 25 0 9 0 703249221 215515136 13913 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=210464 CPUtime=2.97 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 4550 1253 0 0 296 1 0 0 25 0 9 0 703249221 215515136 13913 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=210464 CPUtime=2.99 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 4685 1253 0 0 298 1 0 0 25 0 9 0 703249221 215515136 13913 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=210464 CPUtime=2.99 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 6039 1253 0 0 299 0 0 0 25 0 9 0 703249221 215515136 13913 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=210464 CPUtime=2.99 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 4452 1253 0 0 299 0 0 0 25 0 9 0 703249221 215515136 13913 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=210464 CPUtime=3 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 4937 1253 0 0 299 1 0 0 25 0 9 0 703249222 215515136 13913 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=210464 CPUtime=2.99 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 4572 1253 0 0 298 1 0 0 24 0 9 0 703249222 215515136 13913 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=210464 CPUtime=2.96 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 4365 1253 0 0 296 0 0 0 25 0 9 0 703249222 215515136 13913 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.06
Current children cumulated vsize (KiB) 210464

[startup+6.30121 s]
/proc/loadavg: 7.65 7.97 7.97 9/439 27296
/proc/meminfo: memFree=13760444/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=222176 CPUtime=49.62 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 69335 1253 0 0 4947 15 0 0 21 0 9 0 703249212 227508224 16827 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 55544 16827 180 55 0 53430 0
[pid=27282/tid=27289] ppid=27280 vsize=222176 CPUtime=6.2 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 7472 1253 0 0 619 1 0 0 25 0 9 0 703249221 227508224 16827 33554432000 4194304 4417452 140733897808960 18446744073709551615 4366657 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=222176 CPUtime=6.12 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 7696 1253 0 0 611 1 0 0 25 0 9 0 703249221 227508224 16827 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364669 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=222176 CPUtime=6.2 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 8624 1253 0 0 618 2 0 0 25 0 9 0 703249221 227508224 16827 33554432000 4194304 4417452 140733897808960 18446744073709551615 4356960 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=222176 CPUtime=6.2 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 9708 1253 0 0 619 1 0 0 25 0 9 0 703249221 227508224 16827 33554432000 4194304 4417452 140733897808960 18446744073709551615 4320800 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=222176 CPUtime=6.2 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 7102 1253 0 0 619 1 0 0 25 0 9 0 703249221 227508224 16827 33554432000 4194304 4417452 140733897808960 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=222176 CPUtime=6.2 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 8108 1253 0 0 618 2 0 0 25 0 9 0 703249222 227508224 16827 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=222176 CPUtime=6.19 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 9034 1253 0 0 617 2 0 0 25 0 9 0 703249222 227508224 16827 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=222176 CPUtime=6.16 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 7259 1253 0 0 615 1 0 0 25 0 9 0 703249222 227508224 16827 33554432000 4194304 4417452 140733897808960 18446744073709551615 4320811 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.62
Current children cumulated vsize (KiB) 222176

[startup+12.7009 s]
/proc/loadavg: 7.70 7.97 7.97 9/439 27296
/proc/meminfo: memFree=13713124/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=264592 CPUtime=100.71 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 120209 1253 0 0 10046 25 0 0 21 0 9 0 703249212 270942208 27457 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 66148 27457 180 55 0 64034 0
[pid=27282/tid=27289] ppid=27280 vsize=264592 CPUtime=12.6 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 14186 1253 0 0 1257 3 0 0 25 0 9 0 703249221 270942208 27457 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=264592 CPUtime=12.42 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 14411 1253 0 0 1240 2 0 0 25 0 9 0 703249221 270942208 27457 33554432000 4194304 4417452 140733897808960 18446744073709551615 4320665 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=264592 CPUtime=12.6 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 14473 1253 0 0 1257 3 0 0 25 0 9 0 703249221 270942208 27457 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=264592 CPUtime=12.59 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 15573 1253 0 0 1257 2 0 0 25 0 9 0 703249221 270942208 27457 33554432000 4194304 4417452 140733897808960 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=264592 CPUtime=12.6 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 14147 1253 0 0 1257 3 0 0 25 0 9 0 703249221 270942208 27457 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364442 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=264592 CPUtime=12.58 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 14484 1253 0 0 1256 2 0 0 25 0 9 0 703249222 270942208 27457 33554432000 4194304 4417452 140733897808960 18446744073709551615 4353531 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=264592 CPUtime=12.59 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 14446 1253 0 0 1256 3 0 0 25 0 9 0 703249222 270942208 27457 33554432000 4194304 4417452 140733897808960 18446744073709551615 4357589 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=264592 CPUtime=12.56 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 14157 1253 0 0 1254 2 0 0 25 0 9 0 703249222 270942208 27457 33554432000 4194304 4417452 140733897808960 18446744073709551615 18446744073699065904 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 100.71
Current children cumulated vsize (KiB) 264592

[startup+25.5014 s]
/proc/loadavg: 7.75 7.97 7.97 9/439 27296
/proc/meminfo: memFree=13652096/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=334160 CPUtime=202.92 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 186563 1253 0 0 20251 41 0 0 21 0 9 0 703249212 342179840 44823 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 83540 44823 180 55 0 81426 0
[pid=27282/tid=27289] ppid=27280 vsize=334160 CPUtime=25.4 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 22935 1253 0 0 2536 4 0 0 25 0 9 0 703249221 342179840 44823 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=334160 CPUtime=25.04 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 22389 1253 0 0 2499 5 0 0 25 0 9 0 703249221 342179840 44823 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=334160 CPUtime=25.4 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 23044 1253 0 0 2535 5 0 0 25 0 9 0 703249221 342179840 44823 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=334160 CPUtime=25.4 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 25777 1253 0 0 2535 5 0 0 25 0 9 0 703249221 342179840 44823 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=334160 CPUtime=25.4 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 21793 1253 0 0 2535 5 0 0 25 0 9 0 703249221 342179840 44823 33554432000 4194304 4417452 140733897808960 18446744073709551615 4308525 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=334160 CPUtime=25.39 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 21363 1253 0 0 2535 4 0 0 25 0 9 0 703249222 342179840 44823 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=334160 CPUtime=25.39 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 22271 1253 0 0 2534 5 0 0 25 0 9 0 703249222 342179840 44823 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=334160 CPUtime=25.36 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 22659 1253 0 0 2531 5 0 0 25 0 9 0 703249222 342179840 44823 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 202.92
Current children cumulated vsize (KiB) 334160

[startup+51.1013 s]
/proc/loadavg: 7.90 7.99 7.98 9/439 27297
/proc/meminfo: memFree=13579804/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=407996 CPUtime=407.36 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 272813 1253 0 0 40677 59 0 0 21 0 9 0 703249212 417787904 63282 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 101999 63282 180 55 0 99885 0
[pid=27282/tid=27289] ppid=27280 vsize=407996 CPUtime=51 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 34733 1253 0 0 5093 7 0 0 25 0 9 0 703249221 417787904 63282 33554432000 4194304 4417452 140733897808960 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=407996 CPUtime=50.27 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 34375 1253 0 0 5020 7 0 0 25 0 9 0 703249221 417787904 63282 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=407996 CPUtime=51 cores=0-7

################
# More data... #
################

Current children cumulated CPU time (s) 37229.5
Current children cumulated vsize (KiB) 3141104

[startup+4722.3 s]
/proc/loadavg: 8.05 8.03 8.00 9/439 27443
/proc/meminfo: memFree=10784596/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=3194216 CPUtime=37708.7 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 3617831 1253 0 0 3770137 736 0 0 21 0 9 0 703249212 3270877184 759837 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 798554 759837 180 55 0 796440 0
[pid=27282/tid=27289] ppid=27280 vsize=3194216 CPUtime=4722.42 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 458218 1253 0 0 472158 84 0 0 25 0 9 0 703249221 3270877184 759837 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=3194216 CPUtime=4653.75 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 484226 1253 0 0 465274 101 0 0 25 0 9 0 703249221 3270877184 759837 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=3194216 CPUtime=4721.74 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 473782 1253 0 0 472083 91 0 0 25 0 9 0 703249221 3270877184 759837 33554432000 4194304 4417452 140733897808960 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=3194216 CPUtime=4722.39 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 307016 1253 0 0 472164 75 0 0 25 0 9 0 703249221 3270877184 759837 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=3194216 CPUtime=4722.42 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 497658 1253 0 0 472143 99 0 0 25 0 9 0 703249221 3270877184 759837 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=3194216 CPUtime=4721.32 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 510030 1253 0 0 472034 98 0 0 25 0 9 0 703249222 3270877184 759837 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=3194216 CPUtime=4722.42 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 412679 1253 0 0 472156 86 0 0 25 0 9 0 703249222 3270877184 759837 33554432000 4194304 4417452 140733897808960 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=3194216 CPUtime=4722.12 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 469890 1253 0 0 472115 97 0 0 25 0 9 0 703249222 3270877184 759837 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37708.7
Current children cumulated vsize (KiB) 3194216

[startup+4782.3 s]
/proc/loadavg: 8.02 8.02 8.00 9/439 27444
/proc/meminfo: memFree=10760284/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=3218712 CPUtime=38187.8 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 3703799 1253 0 0 3818028 749 0 0 21 0 9 0 703249212 3295961088 765961 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 804678 765961 180 55 0 802564 0
[pid=27282/tid=27289] ppid=27280 vsize=3218712 CPUtime=4782.41 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 487549 1253 0 0 478151 90 0 0 25 0 9 0 703249221 3295961088 765961 33554432000 4194304 4417452 140733897808960 18446744073709551615 4366090 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=3218712 CPUtime=4712.87 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 484226 1253 0 0 471186 101 0 0 25 0 9 0 703249221 3295961088 765961 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=3218712 CPUtime=4781.73 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 473782 1253 0 0 478082 91 0 0 25 0 9 0 703249221 3295961088 765961 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=3218712 CPUtime=4782.38 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 307016 1253 0 0 478163 75 0 0 25 0 9 0 703249221 3295961088 765961 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=3218712 CPUtime=4782.41 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 497658 1253 0 0 478142 99 0 0 25 0 9 0 703249221 3295961088 765961 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=3218712 CPUtime=4781.29 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 566667 1253 0 0 478024 105 0 0 25 0 9 0 703249222 3295961088 765961 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=3218712 CPUtime=4782.4 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 412679 1253 0 0 478154 86 0 0 25 0 9 0 703249222 3295961088 765961 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=3218712 CPUtime=4782.11 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 469890 1253 0 0 478114 97 0 0 25 0 9 0 703249222 3295961088 765961 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38187.8
Current children cumulated vsize (KiB) 3218712

[startup+4842.32 s]
/proc/loadavg: 8.05 8.03 8.00 9/439 27446
/proc/meminfo: memFree=10800700/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=3178288 CPUtime=38667 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 3741765 1253 0 0 3865948 755 0 0 21 0 9 0 703249212 3254566912 755855 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 794572 755855 180 55 0 792458 0
[pid=27282/tid=27289] ppid=27280 vsize=3178288 CPUtime=4842.43 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 503933 1253 0 0 484151 92 0 0 25 0 9 0 703249221 3254566912 755855 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=3178288 CPUtime=4772.01 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 484226 1253 0 0 477100 101 0 0 25 0 9 0 703249221 3254566912 755855 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=3178288 CPUtime=4841.75 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 495364 1253 0 0 484079 96 0 0 25 0 9 0 703249221 3254566912 755855 33554432000 4194304 4417452 140733897808960 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=3178288 CPUtime=4842.4 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 307016 1253 0 0 484165 75 0 0 25 0 9 0 703249221 3254566912 755855 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364735 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=3178288 CPUtime=4842.43 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 497658 1253 0 0 484144 99 0 0 25 0 9 0 703249221 3254566912 755855 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=3178288 CPUtime=4841.3 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 566667 1253 0 0 484025 105 0 0 25 0 9 0 703249222 3254566912 755855 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=3178288 CPUtime=4842.42 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 412679 1253 0 0 484156 86 0 0 25 0 9 0 703249222 3254566912 755855 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=3178288 CPUtime=4842.13 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 469890 1253 0 0 484116 97 0 0 25 0 9 0 703249222 3254566912 755855 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38667
Current children cumulated vsize (KiB) 3178288

[startup+4902.3 s]
/proc/loadavg: 8.06 8.04 8.00 9/439 27447
/proc/meminfo: memFree=10793872/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=3184892 CPUtime=39146.1 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 3767021 1253 0 0 3913843 762 0 0 21 0 9 0 703249212 3261329408 757506 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 796223 757506 180 55 0 794109 0
[pid=27282/tid=27289] ppid=27280 vsize=3184892 CPUtime=4902.42 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 503933 1253 0 0 490150 92 0 0 25 0 9 0 703249221 3261329408 757506 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=3184892 CPUtime=4831.14 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 484226 1253 0 0 483013 101 0 0 25 0 9 0 703249221 3261329408 757506 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=3184892 CPUtime=4901.74 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 495364 1253 0 0 490078 96 0 0 25 0 9 0 703249221 3261329408 757506 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=3184892 CPUtime=4902.38 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 307016 1253 0 0 490163 75 0 0 25 0 9 0 703249221 3261329408 757506 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=3184892 CPUtime=4902.42 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 497658 1253 0 0 490143 99 0 0 25 0 9 0 703249221 3261329408 757506 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=3184892 CPUtime=4901.27 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 566667 1253 0 0 490022 105 0 0 25 0 9 0 703249222 3261329408 757506 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=3184892 CPUtime=4902.41 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 437935 1253 0 0 490148 93 0 0 25 0 9 0 703249222 3261329408 757506 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=3184892 CPUtime=4902.11 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 469890 1253 0 0 490114 97 0 0 25 0 9 0 703249222 3261329408 757506 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39146.1
Current children cumulated vsize (KiB) 3184892

[startup+4962.3 s]
/proc/loadavg: 8.06 8.04 8.00 9/439 27449
/proc/meminfo: memFree=10964728/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=3014720 CPUtime=39625.2 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 3782352 1253 0 0 3961752 765 0 0 21 0 9 0 703249212 3087073280 714963 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 753680 714963 180 55 0 751566 0
[pid=27282/tid=27289] ppid=27280 vsize=3014720 CPUtime=4962.42 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 503933 1253 0 0 496150 92 0 0 25 0 9 0 703249221 3087073280 714963 33554432000 4194304 4417452 140733897808960 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=3014720 CPUtime=4890.26 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 499557 1253 0 0 488922 104 0 0 25 0 9 0 703249221 3087073280 714963 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364737 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=3014720 CPUtime=4961.74 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 495364 1253 0 0 496078 96 0 0 25 0 9 0 703249221 3087073280 714963 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=3014720 CPUtime=4962.39 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 307016 1253 0 0 496164 75 0 0 25 0 9 0 703249221 3087073280 714963 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=3014720 CPUtime=4962.42 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 497658 1253 0 0 496143 99 0 0 25 0 9 0 703249221 3087073280 714963 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=3014720 CPUtime=4961.26 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 566667 1253 0 0 496021 105 0 0 25 0 9 0 703249222 3087073280 714963 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=3014720 CPUtime=4962.41 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 437935 1253 0 0 496148 93 0 0 25 0 9 0 703249222 3087073280 714963 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=3014720 CPUtime=4962.11 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 469890 1253 0 0 496114 97 0 0 25 0 9 0 703249222 3087073280 714963 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39625.2
Current children cumulated vsize (KiB) 3014720



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.3 s]
/proc/loadavg: 8.08 8.05 8.00 9/439 27450
/proc/meminfo: memFree=10898868/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=3080256 CPUtime=40000.6 cores=0-7
/proc/27282/stat : 27282 (plingeling) S 27280 27282 26947 0 -1 4202496 3798736 1253 0 0 3999291 767 0 0 21 0 9 0 703249212 3154182144 731347 33554432000 4194304 4417452 140733897808960 18446744073709551615 270350186469 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 770064 731347 180 55 0 767950 0
[pid=27282/tid=27289] ppid=27280 vsize=3080256 CPUtime=5009.44 cores=0-7
/proc/27282/task/27289/stat : 27289 (plingeling) R 27280 27282 26947 0 -1 4202560 503933 1253 0 0 500852 92 0 0 25 0 9 0 703249221 3154182144 731347 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=27282/tid=27290] ppid=27280 vsize=3080256 CPUtime=4936.59 cores=0-7
/proc/27282/task/27290/stat : 27290 (plingeling) R 27280 27282 26947 0 -1 4202560 499557 1253 0 0 493555 104 0 0 25 0 9 0 703249221 3154182144 731347 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=27282/tid=27291] ppid=27280 vsize=3080256 CPUtime=5008.76 cores=0-7
/proc/27282/task/27291/stat : 27291 (plingeling) R 27280 27282 26947 0 -1 4202560 495364 1253 0 0 500780 96 0 0 25 0 9 0 703249221 3154182144 731347 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=27282/tid=27292] ppid=27280 vsize=3080256 CPUtime=5009.4 cores=0-7
/proc/27282/task/27292/stat : 27292 (plingeling) R 27280 27282 26947 0 -1 4202560 307016 1253 0 0 500865 75 0 0 25 0 9 0 703249221 3154182144 731347 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=27282/tid=27293] ppid=27280 vsize=3080256 CPUtime=5009.44 cores=0-7
/proc/27282/task/27293/stat : 27293 (plingeling) R 27280 27282 26947 0 -1 4202560 497658 1253 0 0 500845 99 0 0 25 0 9 0 703249221 3154182144 731347 33554432000 4194304 4417452 140733897808960 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=27282/tid=27294] ppid=27280 vsize=3080256 CPUtime=5008.26 cores=0-7
/proc/27282/task/27294/stat : 27294 (plingeling) R 27280 27282 26947 0 -1 4202560 566667 1253 0 0 500721 105 0 0 25 0 9 0 703249222 3154182144 731347 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=27282/tid=27295] ppid=27280 vsize=3080256 CPUtime=5009.44 cores=0-7
/proc/27282/task/27295/stat : 27295 (plingeling) R 27280 27282 26947 0 -1 4202560 454319 1253 0 0 500849 95 0 0 25 0 9 0 703249222 3154182144 731347 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=27282/tid=27296] ppid=27280 vsize=3080256 CPUtime=5009.13 cores=0-7
/proc/27282/task/27296/stat : 27296 (plingeling) R 27280 27282 26947 0 -1 4202560 469890 1253 0 0 500816 97 0 0 25 0 9 0 703249222 3154182144 731347 33554432000 4194304 4417452 140733897808960 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 3080256

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009.42 s]
/proc/loadavg: 8.08 8.05 8.00 2/433 27451
/proc/meminfo: memFree=13627660/32951124 swapFree=57171228/67111528
[pid=27282] ppid=27280 vsize=0 CPUtime=40000.8 cores=0-7
/proc/27282/stat : 27282 (plingeling) Z 27280 27282 26947 0 -1 4203548 3798736 1253 0 0 3999299 778 0 0 18 0 1 0 703249212 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/27282/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5009.44
CPU time (s): 40000.8
CPU user time (s): 39993
CPU system time (s): 7.79081
CPU usage (%): 798.508
Max. virtual memory (cumulated for all children) (KiB): 3218712

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39993
system time used= 7.79082
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3799989
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 275
involuntary context switches= 194184

runsolver used 20.2409 second user time and 52.645 second system time

The end

Launcher Data 

Begin job on node143 at 2011-05-23 01:52:16
IDJOB=3394868
IDBENCH=85793
IDSOLVER=1851
FILE ID=node143/3394868-1306108336
RUNJOBID= node143-1306102930-26961
PBS_JOBID= 13387994
Free space on /tmp= 73368 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT05/crafted/sorge05/QG7a/gensys-ukn009.shuffled-as.sat05-3849.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394868-1306108336/watcher-3394868-1306108336 -o /tmp/evaluation-result-3394868-1306108336/solver-3394868-1306108336 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394868-1306108336.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f2a1eb7937a7cda114ce344a30ca1145
RANDOM SEED=375090724

node143.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13827144 kB
Buffers:        294460 kB
Cached:        5039980 kB
SwapCached:      39952 kB
Active:        9433700 kB
Inactive:      9387668 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13827144 kB
SwapTotal:    67111528 kB
SwapFree:     57171228 kB
Dirty:             860 kB
Writeback:           0 kB
AnonPages:    13447124 kB
Mapped:          30412 kB
Slab:           150772 kB
PageTables:      79672 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 115657832 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73368 MiB
End job on node143 at 2011-05-23 03:15:47