Trace number 3394802

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.9 5011.97

General information on the benchmark

NameSAT04/handmade/marijn/equilarge-l/
equilarge_l2.used-as.sat04-894.cnf
MD5SUMb3ddb2ee2bb2b83e1c98b2a9018351fc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark930.14
Satisfiable
(Un)Satisfiability was proved
Number of variables4487
Number of clauses18555
Sum of the clauses size54310
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21355
Number of clauses of size 317200
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394802-1306106423/watcher-3394802-1306106423 -o /tmp/evaluation-result-3394802-1306106423/solver-3394802-1306106423 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394802-1306106423.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.18 7.86 7.94 3/551 344
/proc/meminfo: memFree=25545572/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=8728 CPUtime=0 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 215 0 0 0 0 0 0 0 25 0 1 0 800873020 8937472 146 33554432000 4194304 4417452 140735152025040 18446744073709551615 224284925696 0 0 4096 0 18446744071562362840 0 0 17 2 0 0 0
/proc/344/statm: 2182 146 122 55 0 68 0

[startup+0.169433 s]
/proc/loadavg: 7.18 7.86 7.94 3/551 344
/proc/meminfo: memFree=25545572/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=170676 CPUtime=0.96 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 6135 1256 0 0 95 1 0 0 18 0 9 0 800873020 174772224 3850 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 42669 3877 178 55 0 40555 0
Current children cumulated CPU time (s) 0.96
Current children cumulated vsize (KiB) 170676

[startup+0.200532 s]
/proc/loadavg: 7.18 7.86 7.94 3/551 344
/proc/meminfo: memFree=25545572/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=170532 CPUtime=1.21 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 6412 1256 0 0 120 1 0 0 18 0 9 0 800873020 174624768 3861 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 42633 3861 178 55 0 40519 0
Current children cumulated CPU time (s) 1.21
Current children cumulated vsize (KiB) 170532

[startup+0.300517 s]
/proc/loadavg: 7.18 7.86 7.94 3/551 344
/proc/meminfo: memFree=25545572/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=174452 CPUtime=2.01 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 7394 1256 0 0 200 1 0 0 18 0 9 0 800873020 178638848 4843 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 43613 4843 179 55 0 41499 0
Current children cumulated CPU time (s) 2.01
Current children cumulated vsize (KiB) 174452

[startup+0.70045 s]
/proc/loadavg: 7.18 7.86 7.94 3/551 344
/proc/meminfo: memFree=25545572/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=175364 CPUtime=5.21 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 7627 1256 0 0 520 1 0 0 18 0 9 0 800873020 179572736 5076 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 43841 5076 179 55 0 41727 0
Current children cumulated CPU time (s) 5.21
Current children cumulated vsize (KiB) 175364

[startup+1.50032 s]
/proc/loadavg: 7.24 7.86 7.94 9/560 358
/proc/meminfo: memFree=25522072/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=179764 CPUtime=11.59 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 10051 1256 0 0 1158 1 0 0 18 0 9 0 800873020 184078336 6383 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 44941 6383 180 55 0 42827 0
[pid=344/tid=351] ppid=342 vsize=179764 CPUtime=1.45 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 666 1256 0 0 145 0 0 0 20 0 9 0 800873024 184078336 6383 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=179764 CPUtime=1.44 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 1061 1256 0 0 144 0 0 0 25 0 9 0 800873024 184078336 6383 33554432000 4194304 4417452 140735152025040 18446744073709551615 4236574 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=179764 CPUtime=1.45 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 1081 1256 0 0 145 0 0 0 25 0 9 0 800873024 184078336 6383 33554432000 4194304 4417452 140735152025040 18446744073709551615 4365118 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=179764 CPUtime=1.41 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 217 1256 0 0 141 0 0 0 23 0 9 0 800873024 184078336 6383 33554432000 4194304 4417452 140735152025040 18446744073709551615 4237250 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=179764 CPUtime=1.45 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 972 1256 0 0 145 0 0 0 20 0 9 0 800873024 184078336 6383 33554432000 4194304 4417452 140735152025040 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=179764 CPUtime=1.44 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 1385 1256 0 0 144 0 0 0 20 0 9 0 800873024 184078336 6383 33554432000 4194304 4417452 140735152025040 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=179764 CPUtime=1.45 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 451 1256 0 0 145 0 0 0 23 0 9 0 800873024 184078336 6383 33554432000 4194304 4417452 140735152025040 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=179764 CPUtime=1.42 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 649 1256 0 0 142 0 0 0 23 0 9 0 800873024 184078336 6383 33554432000 4194304 4417452 140735152025040 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.59
Current children cumulated vsize (KiB) 179764

[startup+3.10105 s]
/proc/loadavg: 7.24 7.86 7.94 9/560 358
/proc/meminfo: memFree=25512900/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=188396 CPUtime=24.38 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 15624 1256 0 0 2436 2 0 0 18 0 9 0 800873020 192917504 8511 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 47099 8511 180 55 0 44985 0
[pid=344/tid=351] ppid=342 vsize=188396 CPUtime=3.05 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 1507 1256 0 0 305 0 0 0 25 0 9 0 800873024 192917504 8511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4353572 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=188396 CPUtime=3.04 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 2408 1256 0 0 304 0 0 0 25 0 9 0 800873024 192917504 8511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=188396 CPUtime=3.05 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 1822 1256 0 0 305 0 0 0 25 0 9 0 800873024 192917504 8511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4365198 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=188396 CPUtime=3.02 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 870 1256 0 0 302 0 0 0 25 0 9 0 800873024 192917504 8511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=188396 CPUtime=3.04 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 1257 1256 0 0 304 0 0 0 25 0 9 0 800873024 192917504 8511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4236878 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=188396 CPUtime=3.05 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 1717 1256 0 0 305 0 0 0 25 0 9 0 800873024 192917504 8511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4236830 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=188396 CPUtime=3.05 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 1150 1256 0 0 305 0 0 0 25 0 9 0 800873024 192917504 8511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364508 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=188396 CPUtime=3 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 1324 1256 0 0 300 0 0 0 25 0 9 0 800873024 192917504 8511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.38
Current children cumulated vsize (KiB) 188396

[startup+6.30052 s]
/proc/loadavg: 7.30 7.87 7.94 9/560 358
/proc/meminfo: memFree=25500548/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=201960 CPUtime=49.91 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 29814 1256 0 0 4986 5 0 0 18 0 9 0 800873020 206807040 11771 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 50490 11771 180 55 0 48376 0
[pid=344/tid=351] ppid=342 vsize=201960 CPUtime=6.24 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 3188 1256 0 0 624 0 0 0 25 0 9 0 800873024 206807040 11771 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364958 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=201960 CPUtime=6.24 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 4272 1256 0 0 623 1 0 0 25 0 9 0 800873024 206807040 11771 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=201960 CPUtime=6.25 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 3535 1256 0 0 625 0 0 0 25 0 9 0 800873024 206807040 11771 33554432000 4194304 4417452 140735152025040 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=201960 CPUtime=6.21 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 2830 1256 0 0 621 0 0 0 25 0 9 0 800873024 206807040 11771 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=201960 CPUtime=6.24 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 2872 1256 0 0 624 0 0 0 25 0 9 0 800873024 206807040 11771 33554432000 4194304 4417452 140735152025040 18446744073709551615 4236601 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=201960 CPUtime=6.24 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 4234 1256 0 0 624 0 0 0 25 0 9 0 800873024 206807040 11771 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=201960 CPUtime=6.24 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 2170 1256 0 0 624 0 0 0 25 0 9 0 800873024 206807040 11771 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=201960 CPUtime=6.14 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 3144 1256 0 0 614 0 0 0 25 0 9 0 800873024 206807040 11771 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.91
Current children cumulated vsize (KiB) 201960

[startup+12.7005 s]
/proc/loadavg: 7.36 7.87 7.94 9/560 358
/proc/meminfo: memFree=25484320/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=215144 CPUtime=100.98 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 62664 1256 0 0 10086 12 0 0 18 0 9 0 800873020 220307456 15067 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 53786 15067 180 55 0 51672 0
[pid=344/tid=351] ppid=342 vsize=215144 CPUtime=12.64 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 8665 1256 0 0 1263 1 0 0 25 0 9 0 800873024 220307456 15067 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=215144 CPUtime=12.63 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 8721 1256 0 0 1262 1 0 0 25 0 9 0 800873024 220307456 15067 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364456 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=215144 CPUtime=12.64 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 6264 1256 0 0 1264 0 0 0 25 0 9 0 800873024 220307456 15067 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=215144 CPUtime=12.61 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 5429 1256 0 0 1260 1 0 0 25 0 9 0 800873024 220307456 15067 33554432000 4194304 4417452 140735152025040 18446744073709551615 4352414 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=215144 CPUtime=12.65 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 7778 1256 0 0 1263 2 0 0 25 0 9 0 800873024 220307456 15067 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=215144 CPUtime=12.64 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 9832 1256 0 0 1262 2 0 0 25 0 9 0 800873024 220307456 15067 33554432000 4194304 4417452 140735152025040 18446744073709551615 4365118 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=215144 CPUtime=12.64 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 5329 1256 0 0 1264 0 0 0 25 0 9 0 800873024 220307456 15067 33554432000 4194304 4417452 140735152025040 18446744073709551615 4275947 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=215144 CPUtime=12.42 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 7077 1256 0 0 1241 1 0 0 25 0 9 0 800873024 220307456 15067 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.98
Current children cumulated vsize (KiB) 215144

[startup+25.5013 s]
/proc/loadavg: 7.53 7.89 7.95 9/560 360
/proc/meminfo: memFree=25471844/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=227264 CPUtime=203.16 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 126684 1256 0 0 20289 27 0 0 18 0 9 0 800873020 232718336 18102 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 56816 18102 180 55 0 54702 0
[pid=344/tid=351] ppid=342 vsize=227264 CPUtime=25.45 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 17739 1256 0 0 2542 3 0 0 25 0 9 0 800873024 232718336 18102 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=227264 CPUtime=25.44 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 17580 1256 0 0 2540 4 0 0 25 0 9 0 800873024 232718336 18102 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=227264 CPUtime=25.44 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 12101 1256 0 0 2543 1 0 0 25 0 9 0 800873024 232718336 18102 33554432000 4194304 4417452 140735152025040 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=227264 CPUtime=25.41 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 10705 1256 0 0 2538 3 0 0 25 0 9 0 800873024 232718336 18102 33554432000 4194304 4417452 140735152025040 18446744073709551615 4236891 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=227264 CPUtime=25.44 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 16112 1256 0 0 2541 3 0 0 25 0 9 0 800873024 232718336 18102 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=227264 CPUtime=25.44 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 19610 1256 0 0 2541 3 0 0 25 0 9 0 800873024 232718336 18102 33554432000 4194304 4417452 140735152025040 18446744073709551615 4366180 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=227264 CPUtime=25.44 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 13119 1256 0 0 2542 2 0 0 25 0 9 0 800873024 232718336 18102 33554432000 4194304 4417452 140735152025040 18446744073709551615 4366074 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=227264 CPUtime=24.98 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 16149 1256 0 0 2495 3 0 0 25 0 9 0 800873024 232718336 18102 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.16
Current children cumulated vsize (KiB) 227264

[startup+51.1011 s]
/proc/loadavg: 7.71 7.90 7.95 9/560 360
/proc/meminfo: memFree=25438412/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=256516 CPUtime=407.48 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 242218 1256 0 0 40698 50 0 0 18 0 9 0 800873020 262672384 25415 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 64129 25415 180 55 0 62015 0
[pid=344/tid=351] ppid=342 vsize=256516 CPUtime=51.04 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 34894 1256 0 0 5098 6 0 0 25 0 9 0 800873024 262672384 25415 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=256516 CPUtime=51.04 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 33376 1256 0 0 5097 7 0 0 25 0 9 0 800873024 262672384 25415 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=256516 CPUtime=51.04 cores=0-7

################
# More data... #
################

/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 976868 1256 0 0 466065 162 0 0 25 0 9 0 800873024 979841024 200511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=956876 CPUtime=4660.76 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 1740913 1256 0 0 465807 269 0 0 25 0 9 0 800873024 979841024 200511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4366005 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=956876 CPUtime=4662.29 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 1447616 1256 0 0 465998 231 0 0 25 0 9 0 800873024 979841024 200511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=956876 CPUtime=4662.3 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 1324610 1256 0 0 466008 222 0 0 25 0 9 0 800873024 979841024 200511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=956876 CPUtime=4577.39 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 1241405 1256 0 0 457524 215 0 0 25 0 9 0 800873024 979841024 200511 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37211.2
Current children cumulated vsize (KiB) 956876

[startup+4722.3 s]
/proc/loadavg: 8.28 8.12 8.04 10/561 509
/proc/meminfo: memFree=24770812/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=912000 CPUtime=37689.9 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 10867688 1256 0 0 3767248 1744 0 0 18 0 9 0 800873020 933888000 189292 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 228000 189292 180 55 0 225886 0
[pid=344/tid=351] ppid=342 vsize=912000 CPUtime=4722.13 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 1424597 1256 0 0 471995 218 0 0 25 0 9 0 800873024 933888000 189292 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=912000 CPUtime=4722.32 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 1214189 1256 0 0 472028 204 0 0 25 0 9 0 800873024 933888000 189292 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=912000 CPUtime=4721.67 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 1431102 1256 0 0 471955 212 0 0 25 0 9 0 800873024 933888000 189292 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=912000 CPUtime=4722.29 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 984837 1256 0 0 472066 163 0 0 25 0 9 0 800873024 933888000 189292 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=912000 CPUtime=4720.61 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 1761552 1256 0 0 471788 273 0 0 25 0 9 0 800873024 933888000 189292 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=912000 CPUtime=4722.31 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 1459188 1256 0 0 471999 232 0 0 25 0 9 0 800873024 933888000 189292 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=912000 CPUtime=4722.32 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 1339094 1256 0 0 472009 223 0 0 25 0 9 0 800873024 933888000 189292 33554432000 4194304 4417452 140735152025040 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=912000 CPUtime=4636.3 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 1249560 1256 0 0 463414 216 0 0 25 0 9 0 800873024 933888000 189292 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37689.9
Current children cumulated vsize (KiB) 912000

[startup+4782.3 s]
/proc/loadavg: 8.27 8.15 8.06 9/560 511
/proc/meminfo: memFree=24757788/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=948612 CPUtime=38168.1 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 10988468 1256 0 0 3815052 1763 0 0 18 0 9 0 800873020 971378688 198445 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 237153 198445 180 55 0 235039 0
[pid=344/tid=351] ppid=342 vsize=948612 CPUtime=4782.1 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 1436005 1256 0 0 477991 219 0 0 25 0 9 0 800873024 971378688 198445 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=948612 CPUtime=4782.3 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 1228845 1256 0 0 478024 206 0 0 25 0 9 0 800873024 971378688 198445 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=948612 CPUtime=4781 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 1447311 1256 0 0 477886 214 0 0 25 0 9 0 800873024 971378688 198445 33554432000 4194304 4417452 140735152025040 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=948612 CPUtime=4782.26 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 997933 1256 0 0 478062 164 0 0 25 0 9 0 800873024 971378688 198445 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364690 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=948612 CPUtime=4780.58 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 1777156 1256 0 0 477783 275 0 0 25 0 9 0 800873024 971378688 198445 33554432000 4194304 4417452 140735152025040 18446744073709551615 4365150 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=948612 CPUtime=4782.29 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 1476429 1256 0 0 477993 236 0 0 25 0 9 0 800873024 971378688 198445 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=948612 CPUtime=4782.31 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 1362284 1256 0 0 478004 227 0 0 25 0 9 0 800873024 971378688 198445 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364537 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=948612 CPUtime=4695.2 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 1258936 1256 0 0 469303 217 0 0 25 0 9 0 800873024 971378688 198445 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38168.1
Current children cumulated vsize (KiB) 948612

[startup+4842.32 s]
/proc/loadavg: 8.16 8.14 8.05 9/560 513
/proc/meminfo: memFree=24799164/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=898048 CPUtime=38647.2 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 11096544 1256 0 0 3862941 1779 0 0 18 0 9 0 800873020 919601152 185804 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 224512 185804 180 55 0 222398 0
[pid=344/tid=351] ppid=342 vsize=898048 CPUtime=4842.13 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 1452387 1256 0 0 483990 223 0 0 25 0 9 0 800873024 919601152 185804 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=898048 CPUtime=4842.32 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 1237949 1256 0 0 484025 207 0 0 25 0 9 0 800873024 919601152 185804 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=898048 CPUtime=4841.02 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 1457911 1256 0 0 483887 215 0 0 25 0 9 0 800873024 919601152 185804 33554432000 4194304 4417452 140735152025040 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=898048 CPUtime=4842.29 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 1009208 1256 0 0 484063 166 0 0 25 0 9 0 800873024 919601152 185804 33554432000 4194304 4417452 140735152025040 18446744073709551615 4357444 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=898048 CPUtime=4840.58 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 1792528 1256 0 0 483782 276 0 0 25 0 9 0 800873024 919601152 185804 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=898048 CPUtime=4842.31 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 1495027 1256 0 0 483992 239 0 0 25 0 9 0 800873024 919601152 185804 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=898048 CPUtime=4842.32 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 1379407 1256 0 0 484002 230 0 0 25 0 9 0 800873024 919601152 185804 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364980 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=898048 CPUtime=4754.12 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 1268558 1256 0 0 475194 218 0 0 25 0 9 0 800873024 919601152 185804 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38647.2
Current children cumulated vsize (KiB) 898048

[startup+4902.3 s]
/proc/loadavg: 8.11 8.13 8.05 9/560 515
/proc/meminfo: memFree=24728180/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=981944 CPUtime=39125.9 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 11187952 1256 0 0 3910803 1791 0 0 18 0 9 0 800873020 1005510656 206778 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 245486 206778 180 55 0 243372 0
[pid=344/tid=351] ppid=342 vsize=981944 CPUtime=4902.11 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 1463951 1256 0 0 489987 224 0 0 25 0 9 0 800873024 1005510656 206778 33554432000 4194304 4417452 140735152025040 18446744073709551615 4353896 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=981944 CPUtime=4902.3 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 1242309 1256 0 0 490022 208 0 0 25 0 9 0 800873024 1005510656 206778 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=981944 CPUtime=4901 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 1471037 1256 0 0 489882 218 0 0 25 0 9 0 800873024 1005510656 206778 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=981944 CPUtime=4902.27 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 1021640 1256 0 0 490059 168 0 0 25 0 9 0 800873024 1005510656 206778 33554432000 4194304 4417452 140735152025040 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=981944 CPUtime=4900.54 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 1810996 1256 0 0 489775 279 0 0 25 0 9 0 800873024 1005510656 206778 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=981944 CPUtime=4902.29 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 1504563 1256 0 0 489989 240 0 0 25 0 9 0 800873024 1005510656 206778 33554432000 4194304 4417452 140735152025040 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=981944 CPUtime=4902.3 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 1395855 1256 0 0 489998 232 0 0 25 0 9 0 800873024 1005510656 206778 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=981944 CPUtime=4813.02 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 1274032 1256 0 0 481083 219 0 0 25 0 9 0 800873024 1005510656 206778 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39125.9
Current children cumulated vsize (KiB) 981944

[startup+4962.3 s]
/proc/loadavg: 8.15 8.13 8.06 9/560 515
/proc/meminfo: memFree=24638108/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=1059324 CPUtime=39604.8 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 11295228 1256 0 0 3958676 1807 0 0 18 0 9 0 800873020 1084747776 226123 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 264831 226123 180 55 0 262717 0
[pid=344/tid=351] ppid=342 vsize=1059324 CPUtime=4962.1 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 1480053 1256 0 0 495984 226 0 0 25 0 9 0 800873024 1084747776 226123 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=1059324 CPUtime=4962.31 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 1253325 1256 0 0 496020 211 0 0 25 0 9 0 800873024 1084747776 226123 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=1059324 CPUtime=4961 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 1483021 1256 0 0 495881 219 0 0 25 0 9 0 800873024 1084747776 226123 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=1059324 CPUtime=4962.27 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 1031578 1256 0 0 496058 169 0 0 25 0 9 0 800873024 1084747776 226123 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364850 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=1059324 CPUtime=4960.52 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 1825916 1256 0 0 495771 281 0 0 25 0 9 0 800873024 1084747776 226123 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=1059324 CPUtime=4962.29 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 1517522 1256 0 0 495987 242 0 0 25 0 9 0 800873024 1084747776 226123 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364572 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=1059324 CPUtime=4962.3 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 1413930 1256 0 0 495995 235 0 0 25 0 9 0 800873024 1084747776 226123 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=1059324 CPUtime=4871.91 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 1286314 1256 0 0 486971 220 0 0 25 0 9 0 800873024 1084747776 226123 33554432000 4194304 4417452 140735152025040 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39604.8
Current children cumulated vsize (KiB) 1059324



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.9 s]
/proc/loadavg: 8.12 8.12 8.06 9/560 517
/proc/meminfo: memFree=24761076/32951124 swapFree=39849776/67111528
[pid=344] ppid=342 vsize=936212 CPUtime=40000.7 cores=0-7
/proc/344/stat : 344 (plingeling) S 342 344 32736 0 -1 4202496 11371424 1256 0 0 3998252 1819 0 0 18 0 9 0 800873020 958681088 195345 33554432000 4194304 4417452 140735152025040 18446744073709551615 224296728549 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/344/statm: 234053 195345 180 55 0 231939 0
[pid=344/tid=351] ppid=342 vsize=936212 CPUtime=5011.72 cores=0-7
/proc/344/task/351/stat : 351 (plingeling) R 342 344 32736 0 -1 4202560 1490989 1256 0 0 500945 227 0 0 25 0 9 0 800873024 958681088 195345 33554432000 4194304 4417452 140735152025040 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=344/tid=352] ppid=342 vsize=936212 CPUtime=5011.93 cores=0-7
/proc/344/task/352/stat : 352 (plingeling) R 342 344 32736 0 -1 4202560 1262045 1256 0 0 500981 212 0 0 25 0 9 0 800873024 958681088 195345 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=344/tid=353] ppid=342 vsize=936212 CPUtime=5010.62 cores=0-7
/proc/344/task/353/stat : 353 (plingeling) R 342 344 32736 0 -1 4202560 1495058 1256 0 0 500841 221 0 0 25 0 9 0 800873024 958681088 195345 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=344/tid=354] ppid=342 vsize=936212 CPUtime=5011.89 cores=0-7
/proc/344/task/354/stat : 354 (plingeling) R 342 344 32736 0 -1 4202560 1039637 1256 0 0 501018 171 0 0 25 0 9 0 800873024 958681088 195345 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364589 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=344/tid=355] ppid=342 vsize=936212 CPUtime=5010.13 cores=0-7
/proc/344/task/355/stat : 355 (plingeling) R 342 344 32736 0 -1 4202560 1837450 1256 0 0 500730 283 0 0 25 0 9 0 800873024 958681088 195345 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=344/tid=356] ppid=342 vsize=936212 CPUtime=5011.91 cores=0-7
/proc/344/task/356/stat : 356 (plingeling) R 342 344 32736 0 -1 4202560 1524366 1256 0 0 500948 243 0 0 25 0 9 0 800873024 958681088 195345 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=344/tid=357] ppid=342 vsize=936212 CPUtime=5011.91 cores=0-7
/proc/344/task/357/stat : 357 (plingeling) R 342 344 32736 0 -1 4202560 1427907 1256 0 0 500954 237 0 0 25 0 9 0 800873024 958681088 195345 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=344/tid=358] ppid=342 vsize=936212 CPUtime=4920.61 cores=0-7
/proc/344/task/358/stat : 358 (plingeling) R 342 344 32736 0 -1 4202560 1290403 1256 0 0 491840 221 0 0 25 0 9 0 800873024 958681088 195345 33554432000 4194304 4417452 140735152025040 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 936212

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.97
CPU time (s): 40000.9
CPU user time (s): 39982.7
CPU system time (s): 18.2442
CPU usage (%): 798.108
Max. virtual memory (cumulated for all children) (KiB): 1060252

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39982.7
system time used= 18.2442
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11372680
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 466
involuntary context switches= 189626

runsolver used 25.3711 second user time and 65.948 second system time

The end

Launcher Data 

Begin job on node118 at 2011-05-23 01:20:24
IDJOB=3394802
IDBENCH=84761
IDSOLVER=1851
FILE ID=node118/3394802-1306106423
RUNJOBID= node118-1306106414-32750
PBS_JOBID= 13388024
Free space on /tmp= 72944 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT04/handmade/marijn/equilarge-l/equilarge_l2.used-as.sat04-894.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394802-1306106423/watcher-3394802-1306106423 -o /tmp/evaluation-result-3394802-1306106423/solver-3394802-1306106423 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394802-1306106423.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b3ddb2ee2bb2b83e1c98b2a9018351fc
RANDOM SEED=1658101400

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25545976 kB
Buffers:         15316 kB
Cached:         147296 kB
SwapCached:      51996 kB
Active:         482836 kB
Inactive:      6660508 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25545976 kB
SwapTotal:    67111528 kB
SwapFree:     39849776 kB
Dirty:             616 kB
Writeback:           0 kB
AnonPages:     6941360 kB
Mapped:          25356 kB
Slab:            74952 kB
PageTables:     115588 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 183778112 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72944 MiB
End job on node118 at 2011-05-23 02:43:58