Trace number 3394444

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40001 5012.22

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x40.cnf
MD5SUM65a5698edfd6f3a12089595d81c196e3
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3360
Number of clauses661080
Sum of the clauses size2634240
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 25040
Number of clauses of size 30
Number of clauses of size 4656040
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394444-1306096221/watcher-3394444-1306096221 -o /tmp/evaluation-result-3394444-1306096221/solver-3394444-1306096221 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394444-1306096221.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.54 7.97 7.97 2/482 16784
/proc/meminfo: memFree=19908636/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=12224 CPUtime=0 cores=0-7
/proc/16784/stat : 16784 (plingeling) R 16782 16784 16572 0 -1 4202496 1116 1251 0 0 0 0 0 0 21 0 1 0 721220682 12517376 1046 33554432000 4194304 4417452 140735759297552 18446744073709551615 210204647168 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/16784/statm: 3056 1046 147 55 0 942 0

[startup+0.057327 s]
/proc/loadavg: 7.54 7.97 7.97 2/482 16784
/proc/meminfo: memFree=19908636/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=23904 CPUtime=0.04 cores=0-7
/proc/16784/stat : 16784 (plingeling) R 16782 16784 16572 0 -1 4202496 4285 1251 0 0 4 0 0 0 21 0 1 0 721220682 24477696 3999 33554432000 4194304 4417452 140735759297552 18446744073709551615 4323376 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/16784/statm: 5976 3999 148 55 0 3862 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 23904

[startup+0.100318 s]
/proc/loadavg: 7.54 7.97 7.97 2/482 16784
/proc/meminfo: memFree=19908636/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=36192 CPUtime=0.09 cores=0-7
/proc/16784/stat : 16784 (plingeling) R 16782 16784 16572 0 -1 4202496 7357 1251 0 0 8 1 0 0 21 0 1 0 721220682 37060608 7071 33554432000 4194304 4417452 140735759297552 18446744073709551615 4320684 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/16784/statm: 9048 7071 148 55 0 6934 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 36192

[startup+0.300284 s]
/proc/loadavg: 7.54 7.97 7.97 2/482 16784
/proc/meminfo: memFree=19908636/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=77152 CPUtime=0.29 cores=0-7
/proc/16784/stat : 16784 (plingeling) R 16782 16784 16572 0 -1 4202496 17597 1251 0 0 27 2 0 0 22 0 1 0 721220682 79003648 17311 33554432000 4194304 4417452 140735759297552 18446744073709551615 210204266053 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/16784/statm: 19288 17311 148 55 0 17174 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 77152

[startup+0.700217 s]
/proc/loadavg: 7.54 7.97 7.97 2/482 16784
/proc/meminfo: memFree=19908636/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=142688 CPUtime=0.69 cores=0-7
/proc/16784/stat : 16784 (plingeling) R 16782 16784 16572 0 -1 4202496 33981 1251 0 0 66 3 0 0 23 0 1 0 721220682 146112512 33695 33554432000 4194304 4417452 140735759297552 18446744073709551615 4229149 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/16784/statm: 35672 33695 148 55 0 33558 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 142688

[startup+1.50109 s]
/proc/loadavg: 7.54 7.97 7.97 2/483 16790
/proc/meminfo: memFree=19641648/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=393236 CPUtime=1.59 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 67036 1251 0 0 152 7 0 0 18 0 9 0 721220682 402673664 59530 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 98309 59530 167 55 0 96195 0
Current children cumulated CPU time (s) 1.59
Current children cumulated vsize (KiB) 393236

[startup+3.10078 s]
/proc/loadavg: 7.54 7.97 7.97 9/491 16798
/proc/meminfo: memFree=19599176/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=534200 CPUtime=14.2 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 107255 1251 0 0 1403 17 0 0 18 0 9 0 721220682 547020800 94748 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 133550 94748 178 55 0 131436 0
[pid=16784/tid=16791] ppid=16782 vsize=534200 CPUtime=1.61 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 4789 1251 0 0 161 0 0 0 20 0 9 0 721220830 547020800 94748 33554432000 4194304 4417452 140735759297552 18446744073709551615 4278180 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=534200 CPUtime=1.49 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 4763 1251 0 0 148 1 0 0 25 0 9 0 721220830 547020800 94748 33554432000 4194304 4417452 140735759297552 18446744073709551615 4278211 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=534200 CPUtime=1.6 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 4156 1251 0 0 160 0 0 0 24 0 9 0 721220830 547020800 94748 33554432000 4194304 4417452 140735759297552 18446744073709551615 4320532 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=534200 CPUtime=1.6 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 8307 1251 0 0 159 1 0 0 20 0 9 0 721220830 547020800 94748 33554432000 4194304 4417452 140735759297552 18446744073709551615 4366804 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=534200 CPUtime=1.61 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 4790 1251 0 0 160 1 0 0 24 0 9 0 721220830 547020800 94748 33554432000 4194304 4417452 140735759297552 18446744073709551615 4278585 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=534200 CPUtime=1.61 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 4802 1251 0 0 160 1 0 0 24 0 9 0 721220830 547020800 94748 33554432000 4194304 4417452 140735759297552 18446744073709551615 4277871 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=534200 CPUtime=1.61 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 4099 1251 0 0 160 1 0 0 24 0 9 0 721220830 547020800 94748 33554432000 4194304 4417452 140735759297552 18446744073709551615 4270989 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=534200 CPUtime=1.53 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 4784 1251 0 0 152 1 0 0 24 0 9 0 721220830 547020800 94748 33554432000 4194304 4417452 140735759297552 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 14.2
Current children cumulated vsize (KiB) 534200

[startup+6.30125 s]
/proc/loadavg: 7.57 7.97 7.97 9/491 16798
/proc/meminfo: memFree=19436664/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=627992 CPUtime=39.74 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 136367 1251 0 0 3953 21 0 0 18 0 9 0 721220682 643063808 118198 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 156998 118198 180 55 0 154884 0
[pid=16784/tid=16791] ppid=16782 vsize=627992 CPUtime=4.81 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 7992 1251 0 0 481 0 0 0 25 0 9 0 721220830 643063808 118198 33554432000 4194304 4417452 140735759297552 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=627992 CPUtime=4.7 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 7966 1251 0 0 468 2 0 0 25 0 9 0 721220830 643063808 118198 33554432000 4194304 4417452 140735759297552 18446744073709551615 4216603 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=627992 CPUtime=4.8 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 7366 1251 0 0 479 1 0 0 25 0 9 0 721220830 643063808 118198 33554432000 4194304 4417452 140735759297552 18446744073709551615 4239408 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=627992 CPUtime=4.81 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 14944 1251 0 0 479 2 0 0 25 0 9 0 721220830 643063808 118198 33554432000 4194304 4417452 140735759297552 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=627992 CPUtime=4.81 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 7993 1251 0 0 480 1 0 0 25 0 9 0 721220830 643063808 118198 33554432000 4194304 4417452 140735759297552 18446744073709551615 4239393 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=627992 CPUtime=4.8 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 8005 1251 0 0 479 1 0 0 25 0 9 0 721220830 643063808 118198 33554432000 4194304 4417452 140735759297552 18446744073709551615 4239418 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=627992 CPUtime=4.8 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 7349 1251 0 0 479 1 0 0 25 0 9 0 721220830 643063808 118198 33554432000 4194304 4417452 140735759297552 18446744073709551615 4322280 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=627992 CPUtime=4.67 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 7987 1251 0 0 465 2 0 0 25 0 9 0 721220830 643063808 118198 33554432000 4194304 4417452 140735759297552 18446744073709551615 4239605 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39.74
Current children cumulated vsize (KiB) 627992

[startup+12.7012 s]
/proc/loadavg: 7.61 7.97 7.97 9/491 16799
/proc/meminfo: memFree=19247280/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=818684 CPUtime=90.84 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 192774 1251 0 0 9047 37 0 0 18 0 9 0 721220682 838332416 165871 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 204671 165871 180 55 0 202557 0
[pid=16784/tid=16791] ppid=16782 vsize=818684 CPUtime=11.21 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 14399 1251 0 0 1119 2 0 0 25 0 9 0 721220830 838332416 165871 33554432000 4194304 4417452 140735759297552 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=818684 CPUtime=11.09 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 14373 1251 0 0 1105 4 0 0 25 0 9 0 721220830 838332416 165871 33554432000 4194304 4417452 140735759297552 18446744073709551615 4250074 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=818684 CPUtime=11.2 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 13773 1251 0 0 1117 3 0 0 25 0 9 0 721220830 838332416 165871 33554432000 4194304 4417452 140735759297552 18446744073709551615 4249978 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=818684 CPUtime=11.2 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 26502 1251 0 0 1116 4 0 0 25 0 9 0 721220830 838332416 165871 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=818684 CPUtime=11.21 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 14400 1251 0 0 1119 2 0 0 25 0 9 0 721220830 838332416 165871 33554432000 4194304 4417452 140735759297552 18446744073709551615 4250074 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=818684 CPUtime=11.2 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 14412 1251 0 0 1117 3 0 0 25 0 9 0 721220830 838332416 165871 33554432000 4194304 4417452 140735759297552 18446744073709551615 4249181 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=818684 CPUtime=11.2 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 13756 1251 0 0 1117 3 0 0 25 0 9 0 721220830 838332416 165871 33554432000 4194304 4417452 140735759297552 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=818684 CPUtime=10.96 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 14394 1251 0 0 1092 4 0 0 25 0 9 0 721220830 838332416 165871 33554432000 4194304 4417452 140735759297552 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 90.84
Current children cumulated vsize (KiB) 818684

[startup+25.501 s]
/proc/loadavg: 7.69 7.97 7.97 9/491 16799
/proc/meminfo: memFree=19247740/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=847600 CPUtime=193.01 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 310423 1251 0 0 19239 62 0 0 18 0 9 0 721220682 867942400 173108 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 211900 173108 180 55 0 209786 0
[pid=16784/tid=16791] ppid=16782 vsize=847600 CPUtime=24.01 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 33087 1251 0 0 2393 8 0 0 24 0 9 0 721220830 867942400 173108 33554432000 4194304 4417452 140735759297552 18446744073709551615 4254796 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=847600 CPUtime=23.88 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 33845 1251 0 0 2382 6 0 0 25 0 9 0 721220830 867942400 173108 33554432000 4194304 4417452 140735759297552 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=847600 CPUtime=24 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 23693 1251 0 0 2396 4 0 0 25 0 9 0 721220830 867942400 173108 33554432000 4194304 4417452 140735759297552 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=847600 CPUtime=24.01 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 41646 1251 0 0 2394 7 0 0 25 0 9 0 721220830 867942400 173108 33554432000 4194304 4417452 140735759297552 18446744073709551615 4366099 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=847600 CPUtime=24.01 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 31445 1251 0 0 2394 7 0 0 25 0 9 0 721220830 867942400 173108 33554432000 4194304 4417452 140735759297552 18446744073709551615 4250086 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=847600 CPUtime=24 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 31501 1251 0 0 2393 7 0 0 25 0 9 0 721220830 867942400 173108 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=847600 CPUtime=24 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 32788 1251 0 0 2392 8 0 0 25 0 9 0 721220830 867942400 173108 33554432000 4194304 4417452 140735759297552 18446744073709551615 4249859 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=847600 CPUtime=23.56 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 15653 1251 0 0 2352 4 0 0 25 0 9 0 721220830 867942400 173108 33554432000 4194304 4417452 140735759297552 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 193.01
Current children cumulated vsize (KiB) 847600

[startup+51.1007 s]
/proc/loadavg: 7.80 7.97 7.97 9/491 16800
/proc/meminfo: memFree=19152560/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=909724 CPUtime=397.38 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 581238 1251 0 0 39628 110 0 0 18 0 9 0 721220682 931557376 188945 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 227431 188945 180 55 0 225317 0
[pid=16784/tid=16791] ppid=16782 vsize=909724 CPUtime=49.61 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 54272 1251 0 0 4949 12 0 0 25 0 9 0 721220830 931557376 188945 33554432000 4194304 4417452 140735759297552 18446744073709551615 4248861 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=909724 CPUtime=49.47 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 63982 1251 0 0 4936 11 0 0 25 0 9 0 721220830 931557376 188945 33554432000 4194304 4417452 140735759297552 18446744073709551615 4277571 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=909724 CPUtime=49.59 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 78522 1251 0 0 4946 13 0 0 25 0 9 0 721220830 931557376 188945 33554432000 4194304 4417452 140735759297552 18446744073709551615 4249597 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=909724 CPUtime=49.61 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 61560 1251 0 0 4951 10 0 0 25 0 9 0 721220830 931557376 188945 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=909724 CPUtime=49.6 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 56083 1251 0 0 4948 12 0 0 25 0 9 0 721220830 931557376 188945 33554432000 4194304 4417452 140735759297552 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=909724 CPUtime=49.6 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 78498 1251 0 0 4944 16 0 0 25 0 9 0 721220830 931557376 188945 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=909724 CPUtime=49.59 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 86781 1251 0 0 4943 16 0 0 25 0 9 0 721220830 931557376 188945 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=909724 CPUtime=48.75 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 34775 1251 0 0 4867 8 0 0 25 0 9 0 721220830 931557376 188945 33554432000 4194304 4417452 140735759297552 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 397.38
Current children cumulated vsize (KiB) 909724

[startup+102.318 s]
/proc/loadavg: 7.99 8.00 7.98 9/491 16801

################
# More data... #
################


[startup+4722.32 s]
/proc/loadavg: 8.09 8.07 8.02 9/491 16936
/proc/meminfo: memFree=12576456/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=7473008 CPUtime=37688.6 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 23980016 1251 0 0 3764368 4494 0 0 18 0 9 0 721220682 7652360192 1829798 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 1868252 1829798 180 55 0 1866138 0
[pid=16784/tid=16791] ppid=16782 vsize=7473008 CPUtime=4720.8 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 2805803 1251 0 0 471601 479 0 0 25 0 9 0 721220830 7652360192 1829798 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=7473008 CPUtime=4719.26 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 2779817 1251 0 0 471374 552 0 0 25 0 9 0 721220830 7652360192 1829798 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=7473008 CPUtime=4720.64 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 2930090 1251 0 0 471502 562 0 0 25 0 9 0 721220830 7652360192 1829798 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=7473008 CPUtime=4720.85 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 939656 1251 0 0 471875 210 0 0 25 0 9 0 721220830 7652360192 1829798 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=7473008 CPUtime=4720.84 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 3715861 1251 0 0 471411 673 0 0 25 0 9 0 721220830 7652360192 1829798 33554432000 4194304 4417452 140735759297552 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=7473008 CPUtime=4720.17 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 4464052 1251 0 0 471224 793 0 0 25 0 9 0 721220830 7652360192 1829798 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=7473008 CPUtime=4720.85 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 3585890 1251 0 0 471374 711 0 0 25 0 9 0 721220830 7652360192 1829798 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=7473008 CPUtime=4643.67 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 2692082 1251 0 0 463863 504 0 0 25 0 9 0 721220830 7652360192 1829798 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37688.6
Current children cumulated vsize (KiB) 7473008

[startup+4782.3 s]
/proc/loadavg: 8.08 8.07 8.02 9/491 16938
/proc/meminfo: memFree=12081328/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=7967840 CPUtime=38167.5 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 24332373 1251 0 0 3812173 4578 0 0 18 0 9 0 721220682 8159068160 1953506 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 1991960 1953506 180 55 0 1989846 0
[pid=16784/tid=16791] ppid=16782 vsize=7967840 CPUtime=4780.78 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 2835891 1251 0 0 477590 488 0 0 25 0 9 0 721220830 8159068160 1953506 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=7967840 CPUtime=4779.24 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 2838161 1251 0 0 477359 565 0 0 25 0 9 0 721220830 8159068160 1953506 33554432000 4194304 4417452 140735759297552 18446744073709551615 4236294 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=7967840 CPUtime=4780.62 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 3086088 1251 0 0 477462 600 0 0 25 0 9 0 721220830 8159068160 1953506 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=7967840 CPUtime=4780.83 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 939656 1251 0 0 477873 210 0 0 25 0 9 0 721220830 8159068160 1953506 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=7967840 CPUtime=4780.82 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 3748629 1251 0 0 477406 676 0 0 25 0 9 0 721220830 8159068160 1953506 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=7967840 CPUtime=4780.16 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 4484116 1251 0 0 477216 800 0 0 25 0 9 0 721220830 8159068160 1953506 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=7967840 CPUtime=4780.83 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 3591629 1251 0 0 477372 711 0 0 25 0 9 0 721220830 8159068160 1953506 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=7967840 CPUtime=4702.68 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 2741438 1251 0 0 469751 517 0 0 25 0 9 0 721220830 8159068160 1953506 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38167.5
Current children cumulated vsize (KiB) 7967840

[startup+4842.3 s]
/proc/loadavg: 8.08 8.07 8.02 9/491 16939
/proc/meminfo: memFree=11905568/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=8142664 CPUtime=38646.5 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 24495650 1251 0 0 3860040 4609 0 0 18 0 9 0 721220682 8338087936 1997212 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 2035666 1997212 180 55 0 2033552 0
[pid=16784/tid=16791] ppid=16782 vsize=8142664 CPUtime=4840.78 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 2884403 1251 0 0 483575 503 0 0 25 0 9 0 721220830 8338087936 1997212 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=8142664 CPUtime=4839.22 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 2874248 1251 0 0 483350 572 0 0 25 0 9 0 721220830 8338087936 1997212 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=8142664 CPUtime=4840.62 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 3086088 1251 0 0 483462 600 0 0 25 0 9 0 721220830 8338087936 1997212 33554432000 4194304 4417452 140735759297552 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=8142664 CPUtime=4840.84 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 939656 1251 0 0 483874 210 0 0 25 0 9 0 721220830 8338087936 1997212 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=8142664 CPUtime=4840.82 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 3783559 1251 0 0 483402 680 0 0 25 0 9 0 721220830 8338087936 1997212 33554432000 4194304 4417452 140735759297552 18446744073709551615 4249181 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=8142664 CPUtime=4840.15 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 4491157 1251 0 0 483215 800 0 0 25 0 9 0 721220830 8338087936 1997212 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=8142664 CPUtime=4840.83 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 3591629 1251 0 0 483372 711 0 0 25 0 9 0 721220830 8338087936 1997212 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=8142664 CPUtime=4761.69 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 2778145 1251 0 0 475648 521 0 0 25 0 9 0 721220830 8338087936 1997212 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38646.5
Current children cumulated vsize (KiB) 8142664

[startup+4902.3 s]
/proc/loadavg: 8.12 8.08 8.02 9/491 16941
/proc/meminfo: memFree=12497032/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=7552660 CPUtime=39125.5 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 24743596 1251 0 0 3907900 4652 0 0 18 0 9 0 721220682 7733923840 1849711 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 1888165 1849711 180 55 0 1886051 0
[pid=16784/tid=16791] ppid=16782 vsize=7552660 CPUtime=4900.78 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 2916765 1251 0 0 489569 509 0 0 25 0 9 0 721220830 7733923840 1849711 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=7552660 CPUtime=4899.21 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 2874248 1251 0 0 489349 572 0 0 25 0 9 0 721220830 7733923840 1849711 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=7552660 CPUtime=4900.61 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 3118458 1251 0 0 489456 605 0 0 25 0 9 0 721220830 7733923840 1849711 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=7552660 CPUtime=4900.84 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 939656 1251 0 0 489874 210 0 0 25 0 9 0 721220830 7733923840 1849711 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=7552660 CPUtime=4900.82 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 3894460 1251 0 0 489387 695 0 0 25 0 9 0 721220830 7733923840 1849711 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=7552660 CPUtime=4900.15 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 4531285 1251 0 0 489203 812 0 0 25 0 9 0 721220830 7733923840 1849711 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=7552660 CPUtime=4900.83 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 3591629 1251 0 0 489372 711 0 0 25 0 9 0 721220830 7733923840 1849711 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=7552660 CPUtime=4820.72 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 2810330 1251 0 0 481547 525 0 0 25 0 9 0 721220830 7733923840 1849711 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39125.5
Current children cumulated vsize (KiB) 7552660

[startup+4962.3 s]
/proc/loadavg: 8.08 8.08 8.02 9/491 16943
/proc/meminfo: memFree=12421704/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=7758712 CPUtime=39604.5 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 25084081 1251 0 0 3955743 4709 0 0 18 0 9 0 721220682 7944921088 1890284 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 1939678 1890315 180 55 0 1937564 0
[pid=16784/tid=16791] ppid=16782 vsize=7758712 CPUtime=4960.78 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 2943685 1251 0 0 495565 513 0 0 25 0 9 0 721220830 7944921088 1890328 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=7758712 CPUtime=4959.19 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 2874248 1251 0 0 495347 572 0 0 25 0 9 0 721220830 7944921088 1890345 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=7758712 CPUtime=4960.61 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 3167611 1251 0 0 495450 611 0 0 25 0 9 0 721220830 7944921088 1890360 33554432000 4194304 4417452 140735759297552 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=7758712 CPUtime=4960.84 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 939656 1251 0 0 495874 210 0 0 25 0 9 0 721220830 7944921088 1890375 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364629 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=7758712 CPUtime=4960.82 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 4009455 1251 0 0 495369 713 0 0 25 0 9 0 721220830 7944921088 1890390 33554432000 4194304 4417452 140735759297552 18446744073709551615 210204341341 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=7758712 CPUtime=4960.15 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 4531285 1251 0 0 495203 812 0 0 25 0 9 0 721220830 7944921088 1890405 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=7758712 CPUtime=4960.82 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 3741152 1251 0 0 495341 741 0 0 25 0 9 0 721220830 7944921088 1890419 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=7758712 CPUtime=4879.73 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 2810330 1251 0 0 487448 525 0 0 25 0 9 0 721220830 7944921088 1890435 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39604.5
Current children cumulated vsize (KiB) 7758712



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.9 s]
/proc/loadavg: 8.03 8.06 8.02 9/491 16944
/proc/meminfo: memFree=12023884/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=8024972 CPUtime=40000.6 cores=0-7
/proc/16784/stat : 16784 (plingeling) S 16782 16784 16572 0 -1 4202496 25206650 1251 0 0 3995328 4730 0 0 18 0 9 0 721220682 8217571328 1967789 33554432000 4194304 4417452 140735759297552 18446744073709551615 210216450021 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 2006243 1967789 180 55 0 2004129 0
[pid=16784/tid=16791] ppid=16782 vsize=8024972 CPUtime=5010.4 cores=0-7
/proc/16784/task/16791/stat : 16791 (plingeling) R 16782 16784 16572 0 -1 4202560 2945973 1251 0 0 500527 513 0 0 25 0 9 0 721220830 8217571328 1967789 33554432000 4194304 4417452 140735759297552 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=16784/tid=16792] ppid=16782 vsize=8024972 CPUtime=5008.79 cores=0-7
/proc/16784/task/16792/stat : 16792 (plingeling) R 16782 16784 16572 0 -1 4202560 2879478 1251 0 0 500306 573 0 0 25 0 9 0 721220830 8217571328 1967789 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=16784/tid=16793] ppid=16782 vsize=8024972 CPUtime=5010.24 cores=0-7
/proc/16784/task/16793/stat : 16793 (plingeling) R 16782 16784 16572 0 -1 4202560 3251466 1251 0 0 500396 628 0 0 25 0 9 0 721220830 8217571328 1967789 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=16784/tid=16794] ppid=16782 vsize=8024972 CPUtime=5010.46 cores=0-7
/proc/16784/task/16794/stat : 16794 (plingeling) R 16782 16784 16572 0 -1 4202560 939656 1251 0 0 500836 210 0 0 25 0 9 0 721220830 8217571328 1967789 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=16784/tid=16795] ppid=16782 vsize=8024972 CPUtime=5010.44 cores=0-7
/proc/16784/task/16795/stat : 16795 (plingeling) R 16782 16784 16572 0 -1 4202560 4020290 1251 0 0 500330 714 0 0 25 0 9 0 721220830 8217571328 1967789 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=16784/tid=16796] ppid=16782 vsize=8024972 CPUtime=5009.77 cores=0-7
/proc/16784/task/16796/stat : 16796 (plingeling) R 16782 16784 16572 0 -1 4202560 4531285 1251 0 0 500165 812 0 0 25 0 9 0 721220830 8217571328 1967789 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=16784/tid=16797] ppid=16782 vsize=8024972 CPUtime=5010.44 cores=0-7
/proc/16784/task/16797/stat : 16797 (plingeling) R 16782 16784 16572 0 -1 4202560 3741152 1251 0 0 500303 741 0 0 25 0 9 0 721220830 8217571328 1967789 33554432000 4194304 4417452 140735759297552 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=8024972 CPUtime=4928.53 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4202560 2830585 1251 0 0 492326 527 0 0 25 0 9 0 721220830 8217571328 1967789 33554432000 4194304 4417452 140735759297552 18446744073709551615 4321721 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 8024972

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5012.2 s]
/proc/loadavg: 8.03 8.06 8.02 9/491 16944
/proc/meminfo: memFree=12023884/32951124 swapFree=63649292/67111528
[pid=16784] ppid=16782 vsize=0 CPUtime=40000.9 cores=0-7
/proc/16784/stat : 16784 (plingeling) Z 16782 16784 16572 0 -1 4203548 25206650 1251 0 0 3995336 4758 0 0 18 0 2 0 721220682 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/16784/statm: 0 0 0 0 0 0 0
[pid=16784/tid=16798] ppid=16782 vsize=0 CPUtime=4928.8 cores=0-7
/proc/16784/task/16798/stat : 16798 (plingeling) R 16782 16784 16572 0 -1 4203588 2830585 1251 0 0 492326 554 0 0 25 0 2 0 721220830 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5012.22
CPU time (s): 40001
CPU user time (s): 39953.4
CPU system time (s): 47.6038
CPU usage (%): 798.069
Max. virtual memory (cumulated for all children) (KiB): 8342788

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39953.4
system time used= 47.6038
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25207901
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 420
involuntary context switches= 193756

runsolver used 23.3465 second user time and 58.5651 second system time

The end

Launcher Data 

Begin job on node130 at 2011-05-22 22:30:22
IDJOB=3394444
IDBENCH=83166
IDSOLVER=1851
FILE ID=node130/3394444-1306096221
RUNJOBID= node130-1306091208-16586
PBS_JOBID= 13387938
Free space on /tmp= 73092 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x40.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394444-1306096221/watcher-3394444-1306096221 -o /tmp/evaluation-result-3394444-1306096221/solver-3394444-1306096221 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394444-1306096221.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 65a5698edfd6f3a12089595d81c196e3
RANDOM SEED=1157597435

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19908916 kB
Buffers:        344432 kB
Cached:        7596532 kB
SwapCached:      10260 kB
Active:        6960008 kB
Inactive:      5761408 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19908916 kB
SwapTotal:    67111528 kB
SwapFree:     63649292 kB
Dirty:           15912 kB
Writeback:           0 kB
AnonPages:     4778396 kB
Mapped:          30276 kB
Slab:           195224 kB
PageTables:      54404 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 145071196 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73092 MiB
End job on node130 at 2011-05-22 23:53:56