Trace number 3266346

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.43 1201.72

General information on the benchmark

NameSAT02/handmade/pehoushek/plainoldcnf/
5cnf_4300_4300_110.shuffled.cnf
MD5SUM34f8b747bfe8e7b589b8832e56ae8363
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.022996
Satisfiable
(Un)Satisfiability was proved
Number of variables110
Number of clauses1892
Sum of the clauses size9308
Maximum clause length5
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 33
Number of clauses of size 4146
Number of clauses of size 51743
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3266346-1304108469/watcher-3266346-1304108469 -o /tmp/evaluation-result-3266346-1304108469/solver-3266346-1304108469 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3266346-1304108469.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 8.08 8.00 5/181 8024
/proc/meminfo: memFree=19868300/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=9388 CPUtime=0 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) R 8022 8024 7523 0 -1 4202496 425 1251 0 0 0 0 0 0 25 0 1 0 522446667 9613312 354 33554432000 4194304 4417332 140734629760640 18446744073709551615 237278879488 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/8024/statm: 2380 364 147 55 0 266 0

[startup+0.109304 s]
/proc/loadavg: 8.08 8.08 8.00 5/181 8024
/proc/meminfo: memFree=19868300/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=118060 CPUtime=0.4 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 1187 1251 0 0 40 0 0 0 25 0 5 0 522446667 120893440 949 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 29515 949 179 55 0 27401 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 118060

[startup+0.200289 s]
/proc/loadavg: 8.08 8.08 8.00 5/181 8024
/proc/meminfo: memFree=19868300/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=119048 CPUtime=0.77 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 2139 1251 0 0 77 0 0 0 25 0 5 0 522446667 121905152 1200 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 29762 1200 179 55 0 27648 0
Current children cumulated CPU time (s) 0.77
Current children cumulated vsize (KiB) 119048

[startup+0.300271 s]
/proc/loadavg: 8.08 8.08 8.00 5/181 8024
/proc/meminfo: memFree=19868300/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=119868 CPUtime=1.16 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 3319 1251 0 0 116 0 0 0 25 0 5 0 522446667 122744832 1405 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 29967 1405 179 55 0 27853 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 119868

[startup+0.700201 s]
/proc/loadavg: 8.08 8.08 8.00 5/181 8024
/proc/meminfo: memFree=19868300/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=122352 CPUtime=2.76 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 6148 1251 0 0 276 0 0 0 25 0 5 0 522446667 125288448 2023 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 30588 2023 179 55 0 28474 0
Current children cumulated CPU time (s) 2.76
Current children cumulated vsize (KiB) 122352

[startup+1.50106 s]
/proc/loadavg: 8.08 8.08 8.00 9/186 8034
/proc/meminfo: memFree=19853644/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=125012 CPUtime=5.96 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 11154 1251 0 0 595 1 0 0 25 0 5 0 522446667 128012288 2691 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 31253 2691 179 55 0 29139 0
[pid=8024/tid=8031] ppid=8022 vsize=125012 CPUtime=1.49 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 2421 1251 0 0 149 0 0 0 25 0 5 0 522446668 128012288 2691 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=125012 CPUtime=1.48 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 3075 1251 0 0 148 0 0 0 25 0 5 0 522446668 128012288 2691 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=125012 CPUtime=1.48 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 2636 1251 0 0 148 0 0 0 25 0 5 0 522446668 128012288 2691 33554432000 4194304 4417332 140734629760640 18446744073709551615 4366029 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=125012 CPUtime=1.48 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 2486 1251 0 0 148 0 0 0 25 0 5 0 522446668 128012288 2691 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 125012

[startup+3.10078 s]
/proc/loadavg: 8.07 8.08 8.00 9/186 8034
/proc/meminfo: memFree=19844964/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=127344 CPUtime=12.36 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 20116 1251 0 0 1234 2 0 0 25 0 5 0 522446667 130400256 3251 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 31836 3251 179 55 0 29722 0
[pid=8024/tid=8031] ppid=8022 vsize=127344 CPUtime=3.09 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 4728 1251 0 0 309 0 0 0 25 0 5 0 522446668 130400256 3251 33554432000 4194304 4417332 140734629760640 18446744073709551615 4366362 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=127344 CPUtime=3.08 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 5566 1251 0 0 308 0 0 0 25 0 5 0 522446668 130400256 3251 33554432000 4194304 4417332 140734629760640 18446744073709551615 4356771 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=127344 CPUtime=3.08 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 4695 1251 0 0 308 0 0 0 25 0 5 0 522446668 130400256 3251 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364800 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=127344 CPUtime=3.07 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 4591 1251 0 0 307 0 0 0 25 0 5 0 522446668 130400256 3251 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 127344

[startup+6.30021 s]
/proc/loadavg: 8.07 8.08 8.00 9/186 8034
/proc/meminfo: memFree=19845076/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=128532 CPUtime=25.13 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 32462 1251 0 0 2510 3 0 0 25 0 5 0 522446667 131616768 3547 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 32133 3547 179 55 0 30019 0
[pid=8024/tid=8031] ppid=8022 vsize=128532 CPUtime=6.28 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 7914 1251 0 0 628 0 0 0 25 0 5 0 522446668 131616768 3547 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=128532 CPUtime=6.28 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 8514 1251 0 0 628 0 0 0 25 0 5 0 522446668 131616768 3547 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=128532 CPUtime=6.28 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 7672 1251 0 0 628 0 0 0 25 0 5 0 522446668 131616768 3547 33554432000 4194304 4417332 140734629760640 18446744073709551615 4199406 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=128532 CPUtime=6.25 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 7826 1251 0 0 625 0 0 0 25 0 5 0 522446668 131616768 3547 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.13
Current children cumulated vsize (KiB) 128532

[startup+12.7011 s]
/proc/loadavg: 8.06 8.08 8.00 9/186 8034
/proc/meminfo: memFree=19840152/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=135100 CPUtime=50.71 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 56325 1251 0 0 5063 8 0 0 25 0 5 0 522446667 138342400 5212 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 33775 5212 179 55 0 31661 0
[pid=8024/tid=8031] ppid=8022 vsize=135100 CPUtime=12.69 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 13556 1251 0 0 1267 2 0 0 25 0 5 0 522446668 138342400 5212 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=135100 CPUtime=12.68 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 14679 1251 0 0 1267 1 0 0 25 0 5 0 522446668 138342400 5212 33554432000 4194304 4417332 140734629760640 18446744073709551615 4366006 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=135100 CPUtime=12.68 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 13700 1251 0 0 1266 2 0 0 25 0 5 0 522446668 138342400 5212 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=135100 CPUtime=12.62 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 13854 1251 0 0 1261 1 0 0 25 0 5 0 522446668 138342400 5212 33554432000 4194304 4417332 140734629760640 18446744073709551615 4357148 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 135100

[startup+25.5008 s]
/proc/loadavg: 8.05 8.08 8.00 9/186 8035
/proc/meminfo: memFree=19836432/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=142872 CPUtime=101.83 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 89026 1251 0 0 10171 12 0 0 25 0 5 0 522446667 146300928 7151 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 35718 7151 179 55 0 33604 0
[pid=8024/tid=8031] ppid=8022 vsize=142872 CPUtime=25.49 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 21712 1251 0 0 2546 3 0 0 25 0 5 0 522446668 146300928 7151 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=142872 CPUtime=25.48 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 22678 1251 0 0 2546 2 0 0 25 0 5 0 522446668 146300928 7151 33554432000 4194304 4417332 140734629760640 18446744073709551615 4344093 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=142872 CPUtime=25.48 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 22414 1251 0 0 2545 3 0 0 25 0 5 0 522446668 146300928 7151 33554432000 4194304 4417332 140734629760640 18446744073709551615 4344081 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=142872 CPUtime=25.35 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 21686 1251 0 0 2532 3 0 0 25 0 5 0 522446668 146300928 7151 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 142872

[startup+51.1012 s]
/proc/loadavg: 8.03 8.07 8.00 9/186 8036
/proc/meminfo: memFree=19810984/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=154788 CPUtime=204.1 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 144046 1251 0 0 20388 22 0 0 25 0 5 0 522446667 158502912 10103 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 38697 10103 179 55 0 36583 0
[pid=8024/tid=8031] ppid=8022 vsize=154788 CPUtime=51.09 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 35201 1251 0 0 5103 6 0 0 25 0 5 0 522446668 158502912 10103 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=154788 CPUtime=51.08 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 36447 1251 0 0 5104 4 0 0 25 0 5 0 522446668 158502912 10103 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364695 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=154788 CPUtime=51.08 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 36842 1251 0 0 5103 5 0 0 25 0 5 0 522446668 158502912 10103 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=154788 CPUtime=50.81 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 35020 1251 0 0 5076 5 0 0 25 0 5 0 522446668 158502912 10103 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364590 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 204.1
Current children cumulated vsize (KiB) 154788

[startup+102.301 s]
/proc/loadavg: 8.01 8.06 8.00 9/186 8037
/proc/meminfo: memFree=19792124/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=165040 CPUtime=408.63 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 220079 1251 0 0 40829 34 0 0 25 0 5 0 522446667 169000960 12683 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 41260 12683 179 55 0 39146 0
[pid=8024/tid=8031] ppid=8022 vsize=165040 CPUtime=102.29 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 53896 1251 0 0 10221 8 0 0 25 0 5 0 522446668 169000960 12683 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=165040 CPUtime=102.29 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 53585 1251 0 0 10221 8 0 0 25 0 5 0 522446668 169000960 12683 33554432000 4194304 4417332 140734629760640 18446744073709551615 4343913 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=165040 CPUtime=102.28 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 56697 1251 0 0 10220 8 0 0 25 0 5 0 522446668 169000960 12683 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=165040 CPUtime=101.74 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 55365 1251 0 0 10166 8 0 0 25 0 5 0 522446668 169000960 12683 33554432000 4194304 4417332 140734629760640 18446744073709551615 237278573636 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.63
Current children cumulated vsize (KiB) 165040

[startup+162.3 s]
/proc/loadavg: 8.10 8.07 8.01 9/186 8038
/proc/meminfo: memFree=19770664/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=171260 CPUtime=648.28 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 281256 1251 0 0 64784 44 0 0 25 0 5 0 522446667 175370240 14251 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 42815 14251 179 55 0 40701 0
[pid=8024/tid=8031] ppid=8022 vsize=171260 CPUtime=162.28 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 68929 1251 0 0 16218 10 0 0 25 0 5 0 522446668 175370240 14251 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=171260 CPUtime=162.28 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 67675 1251 0 0 16218 10 0 0 25 0 5 0 522446668 175370240 14251 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=171260 CPUtime=162.27 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 70680 1251 0 0 16216 11 0 0 25 0 5 0 522446668 175370240 14251 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=171260 CPUtime=161.41 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 73436 1251 0 0 16130 11 0 0 25 0 5 0 522446668 175370240 14251 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 648.28
Current children cumulated vsize (KiB) 171260


################
# More data... #
################

[pid=8024/tid=8032] ppid=8022 vsize=213224 CPUtime=702.3 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 170753 1251 0 0 70203 27 0 0 25 0 5 0 522446668 218341376 24721 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=213224 CPUtime=702.23 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 171212 1251 0 0 70196 27 0 0 25 0 5 0 522446668 218341376 24721 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=213224 CPUtime=698.48 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 175341 1251 0 0 69821 27 0 0 25 0 5 0 522446668 218341376 24721 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2805.34
Current children cumulated vsize (KiB) 213224

[startup+762.301 s]
/proc/loadavg: 8.17 8.11 8.03 9/186 8055
/proc/meminfo: memFree=19666148/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=218364 CPUtime=3045.03 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 723152 1251 0 0 304390 113 0 0 25 0 5 0 522446667 223604736 26007 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 54591 26007 179 55 0 52477 0
[pid=8024/tid=8031] ppid=8022 vsize=218364 CPUtime=762.31 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 184621 1251 0 0 76203 28 0 0 25 0 5 0 522446668 223604736 26007 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=218364 CPUtime=762.3 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 177309 1251 0 0 76203 27 0 0 25 0 5 0 522446668 223604736 26007 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=218364 CPUtime=762.24 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 178494 1251 0 0 76195 29 0 0 25 0 5 0 522446668 223604736 26007 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=218364 CPUtime=758.16 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 182192 1251 0 0 75788 28 0 0 25 0 5 0 522446668 223604736 26007 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3045.03
Current children cumulated vsize (KiB) 218364

[startup+822.3 s]
/proc/loadavg: 8.14 8.10 8.03 9/186 8056
/proc/meminfo: memFree=19703340/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=218300 CPUtime=3284.69 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 754421 1251 0 0 328351 118 0 0 25 0 5 0 522446667 223539200 25991 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 54575 25991 179 55 0 52461 0
[pid=8024/tid=8031] ppid=8022 vsize=218300 CPUtime=822.3 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 192168 1251 0 0 82201 29 0 0 25 0 5 0 522446668 223539200 25991 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=218300 CPUtime=822.3 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 187052 1251 0 0 82201 29 0 0 25 0 5 0 522446668 223539200 25991 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=218300 CPUtime=822.23 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 185721 1251 0 0 82193 30 0 0 25 0 5 0 522446668 223539200 25991 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=218300 CPUtime=817.82 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 188944 1251 0 0 81753 29 0 0 25 0 5 0 522446668 223539200 25991 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3284.69
Current children cumulated vsize (KiB) 218300

[startup+882.307 s]
/proc/loadavg: 8.11 8.09 8.03 9/186 8058
/proc/meminfo: memFree=19671464/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=224340 CPUtime=3524.38 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 781899 1251 0 0 352316 122 0 0 25 0 5 0 522446667 229724160 27501 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 56085 27501 179 55 0 53971 0
[pid=8024/tid=8031] ppid=8022 vsize=224340 CPUtime=882.31 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 199867 1251 0 0 88201 30 0 0 25 0 5 0 522446668 229724160 27501 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=224340 CPUtime=882.3 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 192834 1251 0 0 88201 29 0 0 25 0 5 0 522446668 229724160 27501 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=224340 CPUtime=882.23 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 192571 1251 0 0 88192 31 0 0 25 0 5 0 522446668 229724160 27501 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=224340 CPUtime=877.5 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 196091 1251 0 0 87720 30 0 0 25 0 5 0 522446668 229724160 27501 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3524.38
Current children cumulated vsize (KiB) 224340

[startup+942.301 s]
/proc/loadavg: 8.10 8.09 8.03 9/186 8059
/proc/meminfo: memFree=19684964/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=220996 CPUtime=3764.03 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 813740 1251 0 0 376276 127 0 0 25 0 5 0 522446667 226299904 26655 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 55249 26655 179 55 0 53135 0
[pid=8024/tid=8031] ppid=8022 vsize=220996 CPUtime=942.31 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 206368 1251 0 0 94200 31 0 0 25 0 5 0 522446668 226299904 26655 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=220996 CPUtime=942.3 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 201904 1251 0 0 94199 31 0 0 25 0 5 0 522446668 226299904 26655 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=220996 CPUtime=942.21 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 200054 1251 0 0 94189 32 0 0 25 0 5 0 522446668 226299904 26655 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=220996 CPUtime=937.18 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 204878 1251 0 0 93686 32 0 0 25 0 5 0 522446668 226299904 26655 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3764.03
Current children cumulated vsize (KiB) 220996

[startup+1002.3 s]
/proc/loadavg: 7.77 8.02 8.00 5/177 8079
/proc/meminfo: memFree=19822440/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=227100 CPUtime=4003.71 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 840731 1251 0 0 400239 132 0 0 25 0 5 0 522446667 232550400 28196 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 56775 28196 179 55 0 54661 0
[pid=8024/tid=8031] ppid=8022 vsize=227100 CPUtime=1002.31 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 215687 1251 0 0 100199 32 0 0 25 0 5 0 522446668 232550400 28196 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=227100 CPUtime=1002.3 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 208100 1251 0 0 100198 32 0 0 25 0 5 0 522446668 232550400 28196 33554432000 4194304 4417332 140734629760640 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=227100 CPUtime=1002.22 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 206480 1251 0 0 100188 34 0 0 25 0 5 0 522446668 232550400 28196 33554432000 4194304 4417332 140734629760640 18446744073709551615 4354035 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=227100 CPUtime=996.84 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 209928 1251 0 0 99652 32 0 0 25 0 5 0 522446668 232550400 28196 33554432000 4194304 4417332 140734629760640 18446744073709551615 4366004 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4003.71
Current children cumulated vsize (KiB) 227100

[startup+1062.3 s]
/proc/loadavg: 5.50 7.34 7.77 5/176 8080
/proc/meminfo: memFree=19827644/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=226492 CPUtime=4243.42 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 871644 1251 0 0 424206 136 0 0 25 0 5 0 522446667 231927808 28029 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 56623 28029 179 55 0 54509 0
[pid=8024/tid=8031] ppid=8022 vsize=226492 CPUtime=1062.31 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 222007 1251 0 0 106198 33 0 0 25 0 5 0 522446668 231927808 28029 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364680 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=226492 CPUtime=1062.31 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 218484 1251 0 0 106197 34 0 0 25 0 5 0 522446668 231927808 28029 33554432000 4194304 4417332 140734629760640 18446744073709551615 4343906 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=226492 CPUtime=1062.21 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 212835 1251 0 0 106187 34 0 0 25 0 5 0 522446668 231927808 28029 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=226492 CPUtime=1056.56 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 217782 1251 0 0 105623 33 0 0 25 0 5 0 522446668 231927808 28029 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4243.42
Current children cumulated vsize (KiB) 226492

[startup+1122.3 s]
/proc/loadavg: 4.55 6.70 7.52 5/176 8082
/proc/meminfo: memFree=19829080/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=221336 CPUtime=4483.13 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 897657 1251 0 0 448174 139 0 0 25 0 5 0 522446667 226648064 26740 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 55334 26740 179 55 0 53220 0
[pid=8024/tid=8031] ppid=8022 vsize=221336 CPUtime=1122.31 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 229185 1251 0 0 112197 34 0 0 25 0 5 0 522446668 226648064 26740 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364942 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=221336 CPUtime=1122.3 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 224814 1251 0 0 112195 35 0 0 25 0 5 0 522446668 226648064 26740 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364887 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=221336 CPUtime=1122.21 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 220309 1251 0 0 112186 35 0 0 25 0 5 0 522446668 226648064 26740 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=221336 CPUtime=1116.27 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 222813 1251 0 0 111594 33 0 0 25 0 5 0 522446668 226648064 26740 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4483.13
Current children cumulated vsize (KiB) 221336

[startup+1182.3 s]
/proc/loadavg: 4.26 6.26 7.32 5/176 8084
/proc/meminfo: memFree=19817616/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=232716 CPUtime=4722.86 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 919612 1251 0 0 472143 143 0 0 25 0 5 0 522446667 238301184 29598 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 58179 29598 179 55 0 56065 0
[pid=8024/tid=8031] ppid=8022 vsize=232716 CPUtime=1182.31 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 234914 1251 0 0 118196 35 0 0 25 0 5 0 522446668 238301184 29598 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=232716 CPUtime=1182.3 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 231195 1251 0 0 118194 36 0 0 25 0 5 0 522446668 238301184 29598 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=232716 CPUtime=1182.2 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 226335 1251 0 0 118184 36 0 0 25 0 5 0 522446668 238301184 29598 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=232716 CPUtime=1176.01 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 226632 1251 0 0 117567 34 0 0 25 0 5 0 522446668 238301184 29598 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4722.86
Current children cumulated vsize (KiB) 232716



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 4.27 6.13 7.25 5/176 8084
/proc/meminfo: memFree=19821068/32950904 swapFree=67082284/67111528
[pid=8024] ppid=8022 vsize=229108 CPUtime=4800.39 cores=0,2,4,6
/proc/8024/stat : 8024 (plingeling) S 8022 8024 7523 0 -1 4202496 927297 1251 0 0 479895 144 0 0 25 0 5 0 522446667 234606592 28696 33554432000 4194304 4417332 140734629760640 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/8024/statm: 57277 28696 179 55 0 55163 0
[pid=8024/tid=8031] ppid=8022 vsize=229108 CPUtime=1201.72 cores=0,2,4,6
/proc/8024/task/8031/stat : 8031 (plingeling) R 8022 8024 7523 0 -1 4202560 236694 1251 0 0 120137 35 0 0 25 0 5 0 522446668 234606592 28696 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=8024/tid=8032] ppid=8022 vsize=229108 CPUtime=1201.71 cores=0,2,4,6
/proc/8024/task/8032/stat : 8032 (plingeling) R 8022 8024 7523 0 -1 4202560 232587 1251 0 0 120135 36 0 0 25 0 5 0 522446668 234606592 28696 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364695 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=8024/tid=8033] ppid=8022 vsize=229108 CPUtime=1201.61 cores=0,2,4,6
/proc/8024/task/8033/stat : 8033 (plingeling) R 8022 8024 7523 0 -1 4202560 228484 1251 0 0 120125 36 0 0 25 0 5 0 522446668 234606592 28696 33554432000 4194304 4417332 140734629760640 18446744073709551615 4365007 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=8024/tid=8034] ppid=8022 vsize=229108 CPUtime=1195.31 cores=0,2,4,6
/proc/8024/task/8034/stat : 8034 (plingeling) R 8022 8024 7523 0 -1 4202560 228996 1251 0 0 119497 34 0 0 25 0 5 0 522446668 234606592 28696 33554432000 4194304 4417332 140734629760640 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.39
Current children cumulated vsize (KiB) 229108

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.72
CPU time (s): 4800.43
CPU user time (s): 4798.97
CPU system time (s): 1.45178
CPU usage (%): 399.464
Max. virtual memory (cumulated for all children) (KiB): 245404

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.97
system time used= 1.45178
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 928548
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 70
involuntary context switches= 21140

runsolver used 2.04369 second user time and 4.37233 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-29 22:21:09
IDJOB=3266346
IDBENCH=87455
IDSOLVER=1605
FILE ID=node121/3266346-1304108469
RUNJOBID= node121-1304105551-7541
PBS_JOBID= 13170657
Free space on /tmp= 72656 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT02/handmade/pehoushek/plainoldcnf/5cnf_4300_4300_110.shuffled.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3266346-1304108469/watcher-3266346-1304108469 -o /tmp/evaluation-result-3266346-1304108469/solver-3266346-1304108469 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3266346-1304108469.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 34f8b747bfe8e7b589b8832e56ae8363
RANDOM SEED=344273536

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      19868588 kB
Buffers:       2184264 kB
Cached:       10273516 kB
SwapCached:       2776 kB
Active:        9198556 kB
Inactive:      3365500 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      19868588 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:             432 kB
Writeback:           0 kB
AnonPages:      104172 kB
Mapped:          14328 kB
Slab:           456000 kB
PageTables:       5312 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   316584 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72656 MiB
End job on node121 at 2011-04-29 22:41:13