Trace number 3370943

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.31 1204.89

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x33.cnf
MD5SUMf7c29bbc3bef00d1e7cc799553ba4813
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2772
Number of clauses448371
Sum of the clauses size1785168
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24158
Number of clauses of size 30
Number of clauses of size 4444213
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3370943-1305425173/watcher-3370943-1305425173 -o /tmp/evaluation-result-3370943-1305425173/solver-3370943-1305425173 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3370943-1305425173.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.88 8.67 7.77 6/345 2428
/proc/meminfo: memFree=17675596/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=8728 CPUtime=0 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) R 2426 2428 563 0 -1 4202496 256 1251 0 0 0 0 0 0 25 0 1 0 654118330 8937472 185 33554432000 4194304 4417452 140736362992608 18446744073709551615 4264768 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/2428/statm: 2182 191 146 55 0 68 0

[startup+0.038848 s]
/proc/loadavg: 8.88 8.67 7.77 6/345 2428
/proc/meminfo: memFree=17675596/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=16372 CPUtime=0.03 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) R 2426 2428 563 0 -1 4202496 2283 1251 0 0 3 0 0 0 25 0 1 0 654118330 16764928 2116 33554432000 4194304 4417452 140736362992608 18446744073709551615 4231539 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/2428/statm: 4093 2116 148 55 0 1979 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 16372

[startup+0.100837 s]
/proc/loadavg: 8.88 8.67 7.77 6/345 2428
/proc/meminfo: memFree=17675596/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=30708 CPUtime=0.08 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) R 2426 2428 563 0 -1 4202496 5727 1251 0 0 8 0 0 0 25 0 1 0 654118330 31444992 5560 33554432000 4194304 4417452 140736362992608 18446744073709551615 270612804691 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/2428/statm: 7677 5579 148 55 0 5563 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 30708

[startup+0.300801 s]
/proc/loadavg: 8.88 8.67 7.77 6/345 2428
/proc/meminfo: memFree=17675596/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=75764 CPUtime=0.28 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) R 2426 2428 563 0 -1 4202496 17131 1251 0 0 27 1 0 0 25 0 1 0 654118330 77582336 16964 33554432000 4194304 4417452 140736362992608 18446744073709551615 4227858 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/2428/statm: 18941 16964 148 55 0 16827 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 75764

[startup+0.700734 s]
/proc/loadavg: 8.88 8.67 7.77 6/345 2428
/proc/meminfo: memFree=17675596/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=152040 CPUtime=1.07 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 33785 1251 0 0 104 3 0 0 25 0 5 0 654118330 155688960 25808 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 38010 25808 173 55 0 35896 0
Current children cumulated CPU time (s) 1.07
Current children cumulated vsize (KiB) 152040

[startup+1.50059 s]
/proc/loadavg: 8.88 8.67 7.77 10/350 2488
/proc/meminfo: memFree=17540580/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=208288 CPUtime=4.25 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 49356 1251 0 0 419 6 0 0 25 0 5 0 654118330 213286912 39888 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 52072 39888 177 55 0 49958 0
[pid=2428/tid=2484] ppid=2426 vsize=208288 CPUtime=0.92 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 4546 1251 0 0 92 0 0 0 25 0 5 0 654118387 213286912 39888 33554432000 4194304 4417452 140736362992608 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=208288 CPUtime=0.91 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 4570 1251 0 0 91 0 0 0 25 0 5 0 654118387 213286912 39888 33554432000 4194304 4417452 140736362992608 18446744073709551615 4278345 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=208288 CPUtime=0.91 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 4144 1251 0 0 91 0 0 0 25 0 5 0 654118387 213286912 39888 33554432000 4194304 4417452 140736362992608 18446744073709551615 4320586 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=208288 CPUtime=0.91 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 2569 1251 0 0 91 0 0 0 25 0 5 0 654118387 213286912 39888 33554432000 4194304 4417452 140736362992608 18446744073709551615 4250502 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.25
Current children cumulated vsize (KiB) 208288

[startup+3.10032 s]
/proc/loadavg: 8.88 8.67 7.77 10/351 2492
/proc/meminfo: memFree=17493272/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=235076 CPUtime=10.65 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 59196 1251 0 0 1057 8 0 0 25 0 5 0 654118330 240717824 46555 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 58769 46555 179 55 0 56655 0
[pid=2428/tid=2484] ppid=2426 vsize=235076 CPUtime=2.52 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 6715 1251 0 0 252 0 0 0 25 0 5 0 654118387 240717824 46555 33554432000 4194304 4417452 140736362992608 18446744073709551615 4239401 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=235076 CPUtime=2.52 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 6739 1251 0 0 251 1 0 0 25 0 5 0 654118387 240717824 46555 33554432000 4194304 4417452 140736362992608 18446744073709551615 4323111 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=235076 CPUtime=2.52 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 6315 1251 0 0 251 1 0 0 25 0 5 0 654118387 240717824 46555 33554432000 4194304 4417452 140736362992608 18446744073709551615 4239411 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=235076 CPUtime=2.49 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 5900 1251 0 0 249 0 0 0 25 0 5 0 654118387 240717824 46555 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 10.65
Current children cumulated vsize (KiB) 235076

[startup+6.30075 s]
/proc/loadavg: 8.89 8.68 7.78 10/350 2504
/proc/meminfo: memFree=17445496/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=294624 CPUtime=23.41 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 77196 1251 0 0 2330 11 0 0 25 0 5 0 654118330 301694976 61442 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 73656 61442 179 55 0 71542 0
[pid=2428/tid=2484] ppid=2426 vsize=294624 CPUtime=5.72 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 11053 1251 0 0 571 1 0 0 25 0 5 0 654118387 301694976 61442 33554432000 4194304 4417452 140736362992608 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=294624 CPUtime=5.71 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 11077 1251 0 0 570 1 0 0 25 0 5 0 654118387 301694976 61442 33554432000 4194304 4417452 140736362992608 18446744073709551615 4239605 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=294624 CPUtime=5.72 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 10653 1251 0 0 570 2 0 0 25 0 5 0 654118387 301694976 61442 33554432000 4194304 4417452 140736362992608 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=294624 CPUtime=5.66 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 10886 1251 0 0 564 2 0 0 25 0 5 0 654118387 301694976 61442 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 23.41
Current children cumulated vsize (KiB) 294624

[startup+12.7006 s]
/proc/loadavg: 8.90 8.68 7.78 9/350 2523
/proc/meminfo: memFree=17398508/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=325824 CPUtime=48.94 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 90652 1251 0 0 4881 13 0 0 25 0 5 0 654118330 333643776 69274 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 81456 69274 179 55 0 79342 0
[pid=2428/tid=2484] ppid=2426 vsize=325824 CPUtime=12.12 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 11053 1251 0 0 1211 1 0 0 25 0 5 0 654118387 333643776 69274 33554432000 4194304 4417452 140736362992608 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=325824 CPUtime=12.11 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 11077 1251 0 0 1210 1 0 0 25 0 5 0 654118387 333643776 69274 33554432000 4194304 4417452 140736362992608 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=325824 CPUtime=12.12 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 10653 1251 0 0 1210 2 0 0 25 0 5 0 654118387 333643776 69274 33554432000 4194304 4417452 140736362992608 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=325824 CPUtime=11.98 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 24342 1251 0 0 1195 3 0 0 25 0 5 0 654118387 333643776 69274 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 48.94
Current children cumulated vsize (KiB) 325824

[startup+25.5003 s]
/proc/loadavg: 9.00 8.71 7.81 10/350 2573
/proc/meminfo: memFree=17422292/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=313368 CPUtime=99.99 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 109929 1251 0 0 9982 17 0 0 25 0 5 0 654118330 320888832 66128 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 78342 66128 179 55 0 76228 0
[pid=2428/tid=2484] ppid=2426 vsize=313368 CPUtime=24.92 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 12934 1251 0 0 2491 1 0 0 25 0 5 0 654118387 320888832 66128 33554432000 4194304 4417452 140736362992608 18446744073709551615 4249601 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=313368 CPUtime=24.91 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 12410 1251 0 0 2490 1 0 0 25 0 5 0 654118387 320888832 66128 33554432000 4194304 4417452 140736362992608 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=313368 CPUtime=24.92 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 16181 1251 0 0 2489 3 0 0 25 0 5 0 654118387 320888832 66128 33554432000 4194304 4417452 140736362992608 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=313368 CPUtime=24.65 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 34877 1251 0 0 2459 6 0 0 25 0 5 0 654118387 320888832 66128 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 99.99
Current children cumulated vsize (KiB) 313368

[startup+51.1008 s]
/proc/loadavg: 9.00 8.73 7.84 10/350 2648
/proc/meminfo: memFree=17290692/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=477424 CPUtime=202.11 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 187179 1251 0 0 20181 30 0 0 25 0 5 0 654118330 488882176 90759 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 119356 90759 179 55 0 117242 0
[pid=2428/tid=2484] ppid=2426 vsize=477424 CPUtime=50.52 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 20968 1251 0 0 5050 2 0 0 25 0 5 0 654118387 488882176 90759 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=477424 CPUtime=50.51 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 41980 1251 0 0 5045 6 0 0 25 0 5 0 654118387 488882176 90759 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=477424 CPUtime=50.52 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 39279 1251 0 0 5045 7 0 0 25 0 5 0 654118387 488882176 90759 33554432000 4194304 4417452 140736362992608 18446744073709551615 4249978 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=477424 CPUtime=49.97 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 51425 1251 0 0 4988 9 0 0 25 0 5 0 654118387 488882176 90759 33554432000 4194304 4417452 140736362992608 18446744073709551615 4250502 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 202.11
Current children cumulated vsize (KiB) 477424

[startup+102.313 s]
/proc/loadavg: 9.06 8.79 7.90 10/350 2788
/proc/meminfo: memFree=17165856/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=584720 CPUtime=406.4 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 330417 1251 0 0 40587 53 0 0 25 0 5 0 654118330 598753280 117583 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 146180 117583 179 55 0 144066 0
[pid=2428/tid=2484] ppid=2426 vsize=584720 CPUtime=101.74 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 59708 1251 0 0 10166 8 0 0 25 0 5 0 654118387 598753280 117583 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=584720 CPUtime=101.73 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 69208 1251 0 0 10163 10 0 0 25 0 5 0 654118387 598753280 117583 33554432000 4194304 4417452 140736362992608 18446744073709551615 4358082 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=584720 CPUtime=101.73 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 83671 1251 0 0 10158 15 0 0 25 0 5 0 654118387 598753280 117583 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=584720 CPUtime=100.61 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 84303 1251 0 0 10046 15 0 0 25 0 5 0 654118387 598753280 117583 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 406.4
Current children cumulated vsize (KiB) 584720

[startup+162.301 s]
/proc/loadavg: 9.13 8.86 7.98 10/351 2945
/proc/meminfo: memFree=17033764/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=724632 CPUtime=645.7 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 484745 1251 0 0 64493 77 0 0 25 0 5 0 654118330 742023168 152561 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 181158 152561 179 55 0 179044 0
[pid=2428/tid=2484] ppid=2426 vsize=724632 CPUtime=161.73 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 100241 1251 0 0 16160 13 0 0 25 0 5 0 654118387 742023168 152561 33554432000 4194304 4417452 140736362992608 18446744073709551615 4249601 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=724632 CPUtime=161.71 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 91367 1251 0 0 16158 13 0 0 25 0 5 0 654118387 742023168 152561 33554432000 4194304 4417452 140736362992608 18446744073709551615 4235999 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=724632 CPUtime=161.72 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 160118 1251 0 0 16145 27 0 0 25 0 5 0 654118387 742023168 152561 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=724632 CPUtime=159.94 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 99492 1251 0 0 15976 18 0 0 25 0 5 0 654118387 742023168 152561 33554432000 4194304 4417452 140736362992608 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 645.7
Current children cumulated vsize (KiB) 724632


################
# More data... #
################

[pid=2428/tid=2485] ppid=2426 vsize=1259768 CPUtime=701.72 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 360147 1251 0 0 70125 47 0 0 25 0 5 0 654118387 1290002432 286346 33554432000 4194304 4417452 140736362992608 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=1259768 CPUtime=701.74 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 680896 1251 0 0 70064 110 0 0 25 0 5 0 654118387 1290002432 286346 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364669 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=1259768 CPUtime=694.02 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 237777 1251 0 0 69359 43 0 0 25 0 5 0 654118387 1290002432 286346 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2799.61
Current children cumulated vsize (KiB) 1259768

[startup+762.313 s]
/proc/loadavg: 8.32 8.34 8.11 9/345 3149
/proc/meminfo: memFree=16538420/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=1201856 CPUtime=3039.01 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 1755113 1251 0 0 303634 267 0 0 25 0 5 0 654118330 1230700544 271868 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 300464 271868 180 55 0 298350 0
[pid=2428/tid=2484] ppid=2426 vsize=1201856 CPUtime=761.54 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 322860 1251 0 0 76110 44 0 0 25 0 5 0 654118387 1230700544 271868 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=1201856 CPUtime=761.73 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 402279 1251 0 0 76121 52 0 0 25 0 5 0 654118387 1230700544 271868 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=1201856 CPUtime=761.74 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 740032 1251 0 0 76057 117 0 0 25 0 5 0 654118387 1230700544 271868 33554432000 4194304 4417452 140736362992608 18446744073709551615 4331746 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=1201856 CPUtime=753.38 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 256415 1251 0 0 75290 48 0 0 25 0 5 0 654118387 1230700544 271868 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3039.01
Current children cumulated vsize (KiB) 1201856

[startup+822.3 s]
/proc/loadavg: 8.25 8.31 8.11 9/345 3151
/proc/meminfo: memFree=16354148/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=1369336 CPUtime=3278.3 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 1847744 1251 0 0 327553 277 0 0 25 0 5 0 654118330 1402200064 313738 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 342334 313738 180 55 0 340220 0
[pid=2428/tid=2484] ppid=2426 vsize=1369336 CPUtime=821.53 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 369978 1251 0 0 82104 49 0 0 25 0 5 0 654118387 1402200064 313738 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=1369336 CPUtime=821.73 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 416020 1251 0 0 82119 54 0 0 25 0 5 0 654118387 1402200064 313738 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=1369336 CPUtime=821.74 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 771804 1251 0 0 82052 122 0 0 25 0 5 0 654118387 1402200064 313738 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=1369336 CPUtime=812.72 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 256415 1251 0 0 81224 48 0 0 25 0 5 0 654118387 1402200064 313738 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3278.3
Current children cumulated vsize (KiB) 1369336

[startup+882.301 s]
/proc/loadavg: 8.16 8.26 8.10 9/345 3153
/proc/meminfo: memFree=16511116/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=1221076 CPUtime=3517.66 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 1966485 1251 0 0 351468 298 0 0 25 0 5 0 654118330 1250381824 276673 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 305269 276673 180 55 0 303155 0
[pid=2428/tid=2484] ppid=2426 vsize=1221076 CPUtime=881.53 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 400626 1251 0 0 88099 54 0 0 25 0 5 0 654118387 1250381824 276673 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=1221076 CPUtime=881.73 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 439842 1251 0 0 88115 58 0 0 25 0 5 0 654118387 1250381824 276673 33554432000 4194304 4417452 140736362992608 18446744073709551615 4251109 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=1221076 CPUtime=881.74 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 836075 1251 0 0 88041 133 0 0 25 0 5 0 654118387 1250381824 276673 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=1221076 CPUtime=872.07 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 256415 1251 0 0 87159 48 0 0 25 0 5 0 654118387 1250381824 276673 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3517.66
Current children cumulated vsize (KiB) 1221076

[startup+942.301 s]
/proc/loadavg: 8.12 8.23 8.10 9/345 3154
/proc/meminfo: memFree=16168496/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=1551840 CPUtime=3757.01 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 2087050 1251 0 0 375386 315 0 0 25 0 5 0 654118330 1589084160 359364 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 387960 359364 180 55 0 385846 0
[pid=2428/tid=2484] ppid=2426 vsize=1551840 CPUtime=941.53 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 431085 1251 0 0 94095 58 0 0 25 0 5 0 654118387 1589084160 359364 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=1551840 CPUtime=941.73 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 488620 1251 0 0 94109 64 0 0 25 0 5 0 654118387 1589084160 359364 33554432000 4194304 4417452 140736362992608 18446744073709551615 4251100 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=1551840 CPUtime=941.74 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 877403 1251 0 0 94034 140 0 0 25 0 5 0 654118387 1589084160 359364 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=1551840 CPUtime=931.42 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 256415 1251 0 0 93094 48 0 0 25 0 5 0 654118387 1589084160 359364 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3757.01
Current children cumulated vsize (KiB) 1551840

[startup+1002.3 s]
/proc/loadavg: 8.81 8.40 8.16 10/353 7241
/proc/meminfo: memFree=16073920/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=1720120 CPUtime=3995.49 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 2239362 1251 0 0 399207 342 0 0 25 0 5 0 654118330 1761402880 401434 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 430030 401434 180 55 0 427916 0
[pid=2428/tid=2484] ppid=2426 vsize=1720120 CPUtime=1000.72 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 469561 1251 0 0 100008 64 0 0 25 0 5 0 654118387 1761402880 401434 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=1720120 CPUtime=1001.7 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 515970 1251 0 0 100100 70 0 0 25 0 5 0 654118387 1761402880 401434 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=1720120 CPUtime=1001.73 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 937073 1251 0 0 100023 150 0 0 25 0 5 0 654118387 1761402880 401434 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=1720120 CPUtime=990.74 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 283231 1251 0 0 99021 53 0 0 25 0 5 0 654118387 1761402880 401434 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3995.49
Current children cumulated vsize (KiB) 1720120

[startup+1062.3 s]
/proc/loadavg: 9.11 8.55 8.23 10/353 8976
/proc/meminfo: memFree=16101352/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=1552740 CPUtime=4233.87 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 2321783 1251 0 0 423031 356 0 0 25 0 5 0 654118330 1590005760 359621 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 388185 359621 180 55 0 386071 0
[pid=2428/tid=2484] ppid=2426 vsize=1552740 CPUtime=1059.79 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 470207 1251 0 0 105914 65 0 0 25 0 5 0 654118387 1590005760 359621 33554432000 4194304 4417452 140736362992608 18446744073709551615 4366087 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=1552740 CPUtime=1061.66 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 545531 1251 0 0 106092 74 0 0 25 0 5 0 654118387 1590005760 359621 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=1552740 CPUtime=1061.74 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 978826 1251 0 0 106018 156 0 0 25 0 5 0 654118387 1590005760 359621 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=1552740 CPUtime=1050.1 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 293692 1251 0 0 104954 56 0 0 25 0 5 0 654118387 1590005760 359621 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4233.87
Current children cumulated vsize (KiB) 1552740

[startup+1122.3 s]
/proc/loadavg: 9.08 8.65 8.28 10/352 10716
/proc/meminfo: memFree=15622820/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=1878032 CPUtime=4472.27 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 2463979 1251 0 0 446852 375 0 0 25 0 5 0 654118330 1923104768 440944 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 469508 440944 180 55 0 467394 0
[pid=2428/tid=2484] ppid=2426 vsize=1878032 CPUtime=1119.01 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 496568 1251 0 0 111832 69 0 0 25 0 5 0 654118387 1923104768 440944 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=1878032 CPUtime=1121.58 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 635476 1251 0 0 112072 86 0 0 25 0 5 0 654118387 1923104768 440944 33554432000 4194304 4417452 140736362992608 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=1878032 CPUtime=1121.68 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 1004716 1251 0 0 112010 158 0 0 25 0 5 0 654118387 1923104768 440944 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=1878032 CPUtime=1109.42 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 293692 1251 0 0 110885 57 0 0 25 0 5 0 654118387 1923104768 440944 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4472.27
Current children cumulated vsize (KiB) 1878032

[startup+1182.3 s]
/proc/loadavg: 9.24 8.77 8.34 10/352 12378
/proc/meminfo: memFree=15940328/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=1555568 CPUtime=4710.78 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 2604071 1251 0 0 470677 401 0 0 25 0 5 0 654118330 1592901632 360328 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 388892 360328 180 55 0 386778 0
[pid=2428/tid=2484] ppid=2426 vsize=1555568 CPUtime=1178.42 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 513190 1251 0 0 117770 72 0 0 25 0 5 0 654118387 1592901632 360328 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=1555568 CPUtime=1181.47 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 701844 1251 0 0 118047 100 0 0 25 0 5 0 654118387 1592901632 360328 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=1555568 CPUtime=1181.58 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 1049693 1251 0 0 117993 165 0 0 25 0 5 0 654118387 1592901632 360328 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=1555568 CPUtime=1168.71 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 305817 1251 0 0 116812 59 0 0 25 0 5 0 654118387 1592901632 360328 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4710.78
Current children cumulated vsize (KiB) 1555568



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.8 s]
/proc/loadavg: 9.23 8.80 8.36 10/352 13004
/proc/meminfo: memFree=15795704/32951124 swapFree=67056804/67111528
[pid=2428] ppid=2426 vsize=1631096 CPUtime=4800.19 cores=0,2,4,6
/proc/2428/stat : 2428 (plingeling) S 2426 2428 563 0 -1 4202496 2622953 1251 0 0 479615 404 0 0 25 0 5 0 654118330 1670242304 379210 33554432000 4194304 4417452 140736362992608 18446744073709551615 270624913381 0 0 4096 17442 18446744073709551615 0 0 17 0 0 0 0
/proc/2428/statm: 407774 379210 180 55 0 405660 0
[pid=2428/tid=2484] ppid=2426 vsize=1631096 CPUtime=1200.58 cores=0,2,4,6
/proc/2428/task/2484/stat : 2484 (plingeling) R 2426 2428 563 0 -1 4202560 513190 1251 0 0 119986 72 0 0 25 0 5 0 654118387 1670242304 379210 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=2428/tid=2485] ppid=2426 vsize=1631096 CPUtime=1203.98 cores=0,2,4,6
/proc/2428/task/2485/stat : 2485 (plingeling) R 2426 2428 563 0 -1 4202560 720726 1251 0 0 120296 102 0 0 25 0 5 0 654118387 1670242304 379210 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=2428/tid=2486] ppid=2426 vsize=1631096 CPUtime=1204.1 cores=0,2,4,6
/proc/2428/task/2486/stat : 2486 (plingeling) R 2426 2428 563 0 -1 4202560 1049693 1251 0 0 120245 165 0 0 25 0 5 0 654118387 1670242304 379210 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=2428/tid=2487] ppid=2426 vsize=1631096 CPUtime=1190.96 cores=0,2,4,6
/proc/2428/task/2487/stat : 2487 (plingeling) R 2426 2428 563 0 -1 4202560 305817 1251 0 0 119036 60 0 0 25 0 5 0 654118387 1670242304 379210 33554432000 4194304 4417452 140736362992608 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.19
Current children cumulated vsize (KiB) 1631096

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.89
CPU time (s): 4800.31
CPU user time (s): 4796.2
CPU system time (s): 4.11237
CPU usage (%): 398.404
Max. virtual memory (cumulated for all children) (KiB): 1995868

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.2
system time used= 4.11237
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2624204
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 64
involuntary context switches= 31582

runsolver used 3.9664 second user time and 9.16761 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-15 04:06:14
IDJOB=3370943
IDBENCH=83165
IDSOLVER=1848
FILE ID=node108/3370943-1305425173
RUNJOBID= node108-1305423738-581
PBS_JOBID= 13324595
Free space on /tmp= 73544 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x33.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3370943-1305425173/watcher-3370943-1305425173 -o /tmp/evaluation-result-3370943-1305425173/solver-3370943-1305425173 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3370943-1305425173.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f7c29bbc3bef00d1e7cc799553ba4813
RANDOM SEED=1185132817

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17675744 kB
Buffers:        286556 kB
Cached:        4481560 kB
SwapCached:       8700 kB
Active:       11153176 kB
Inactive:      3810488 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17675744 kB
SwapTotal:    67111528 kB
SwapFree:     67056804 kB
Dirty:           11176 kB
Writeback:           0 kB
AnonPages:    10192720 kB
Mapped:          27932 kB
Slab:           209104 kB
PageTables:      38616 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 52407228 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73564 MiB
End job on node108 at 2011-05-15 04:26:21