Trace number 3394452

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40001.2 5012.27

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-7x39.cnf
MD5SUMf717554c4e7f802b3078c48464dbcd9d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1092
Number of clauses64155
Sum of the clauses size253344
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21638
Number of clauses of size 30
Number of clauses of size 462517
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394452-1306096617/watcher-3394452-1306096617 -o /tmp/evaluation-result-3394452-1306096617/solver-3394452-1306096617 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394452-1306096617.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.94 1.96 1.85 2/543 22488
/proc/meminfo: memFree=16256228/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=13228 CPUtime=0.01 cores=0-7
/proc/22488/stat : 22488 (plingeling) R 22486 22488 22382 0 -1 4202496 1400 1256 0 0 1 0 0 0 25 0 1 0 721262063 13545472 1330 33554432000 4194304 4417452 140734194737248 18446744073709551615 253640859392 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/22488/statm: 3307 1330 148 55 0 1193 0

[startup+0.0426101 s]
/proc/loadavg: 0.94 1.96 1.85 2/543 22488
/proc/meminfo: memFree=16256228/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=21480 CPUtime=0.03 cores=0-7
/proc/22488/stat : 22488 (plingeling) R 22486 22488 22382 0 -1 4202496 3706 1256 0 0 3 0 0 0 25 0 1 0 721262063 21995520 3388 33554432000 4194304 4417452 140734194737248 18446744073709551615 253640553453 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/22488/statm: 5498 3412 148 55 0 3384 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 21480

[startup+0.100596 s]
/proc/loadavg: 0.94 1.96 1.85 2/543 22488
/proc/meminfo: memFree=16256228/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=32744 CPUtime=0.08 cores=0-7
/proc/22488/stat : 22488 (plingeling) R 22486 22488 22382 0 -1 4202496 6290 1256 0 0 8 0 0 0 25 0 1 0 721262063 33529856 5972 33554432000 4194304 4417452 140734194737248 18446744073709551615 253640553550 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/22488/statm: 8186 5980 148 55 0 6072 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 32744

[startup+0.300526 s]
/proc/loadavg: 0.94 1.96 1.85 2/543 22488
/proc/meminfo: memFree=16256228/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=127712 CPUtime=1.23 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 11766 1256 0 0 122 1 0 0 25 0 9 0 721262063 130777088 9509 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 31928 9509 178 55 0 29814 0
Current children cumulated CPU time (s) 1.23
Current children cumulated vsize (KiB) 127712

[startup+0.700453 s]
/proc/loadavg: 0.94 1.96 1.85 2/543 22488
/proc/meminfo: memFree=16256228/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=145856 CPUtime=4.43 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 17621 1256 0 0 441 2 0 0 25 0 9 0 721262063 149356544 14015 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 36464 14015 180 55 0 34350 0
Current children cumulated CPU time (s) 4.43
Current children cumulated vsize (KiB) 145856

[startup+1.5003 s]
/proc/loadavg: 0.94 1.96 1.85 9/552 22502
/proc/meminfo: memFree=16182748/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=169740 CPUtime=10.81 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 26223 1256 0 0 1077 4 0 0 25 0 9 0 721262063 173813760 19986 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 42435 19986 180 55 0 40321 0
[pid=22488/tid=22495] ppid=22486 vsize=169740 CPUtime=1.33 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 1532 1256 0 0 133 0 0 0 19 0 9 0 721262079 173813760 19986 33554432000 4194304 4417452 140734194737248 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=169740 CPUtime=1.33 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 1437 1256 0 0 133 0 0 0 25 0 9 0 721262079 173813760 19986 33554432000 4194304 4417452 140734194737248 18446744073709551615 4258377 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=169740 CPUtime=1.33 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 1760 1256 0 0 133 0 0 0 25 0 9 0 721262079 173813760 19986 33554432000 4194304 4417452 140734194737248 18446744073709551615 4269682 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=169740 CPUtime=1.34 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 5459 1256 0 0 133 1 0 0 25 0 9 0 721262079 173813760 19986 33554432000 4194304 4417452 140734194737248 18446744073709551615 4357734 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=169740 CPUtime=1.33 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 1547 1256 0 0 133 0 0 0 19 0 9 0 721262079 173813760 19986 33554432000 4194304 4417452 140734194737248 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=169740 CPUtime=1.31 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 1536 1256 0 0 131 0 0 0 25 0 9 0 721262079 173813760 19986 33554432000 4194304 4417452 140734194737248 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=169740 CPUtime=1.33 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 2313 1256 0 0 133 0 0 0 25 0 9 0 721262079 173813760 19986 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=169740 CPUtime=1.31 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 1537 1256 0 0 131 0 0 0 25 0 9 0 721262079 173813760 19986 33554432000 4194304 4417452 140734194737248 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 10.81
Current children cumulated vsize (KiB) 169740

[startup+3.10102 s]
/proc/loadavg: 0.94 1.96 1.85 9/552 22502
/proc/meminfo: memFree=16167868/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=261224 CPUtime=23.6 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 59521 1256 0 0 2348 12 0 0 25 0 9 0 721262063 267493376 26552 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 65306 26552 180 55 0 63192 0
[pid=22488/tid=22495] ppid=22486 vsize=261224 CPUtime=2.93 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 3675 1256 0 0 293 0 0 0 25 0 9 0 721262079 267493376 26552 33554432000 4194304 4417452 140734194737248 18446744073709551615 4254441 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=261224 CPUtime=2.92 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 1772 1256 0 0 292 0 0 0 25 0 9 0 721262079 267493376 26552 33554432000 4194304 4417452 140734194737248 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=261224 CPUtime=2.93 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 7608 1256 0 0 292 1 0 0 25 0 9 0 721262079 267493376 26552 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=261224 CPUtime=2.93 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 10788 1256 0 0 291 2 0 0 25 0 9 0 721262079 267493376 26552 33554432000 4194304 4417452 140734194737248 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=261224 CPUtime=2.92 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 8423 1256 0 0 291 1 0 0 24 0 9 0 721262079 267493376 26552 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=261224 CPUtime=2.89 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 6767 1256 0 0 288 1 0 0 25 0 9 0 721262079 267493376 26552 33554432000 4194304 4417452 140734194737248 18446744073709551615 4232626 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=261224 CPUtime=2.92 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 5234 1256 0 0 292 0 0 0 25 0 9 0 721262079 267493376 26552 33554432000 4194304 4417452 140734194737248 18446744073709551615 4337141 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=261224 CPUtime=2.91 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 6152 1256 0 0 290 1 0 0 25 0 9 0 721262079 267493376 26552 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 23.6
Current children cumulated vsize (KiB) 261224

[startup+6.30043 s]
/proc/loadavg: 1.59 2.07 1.89 9/552 22502
/proc/meminfo: memFree=16106612/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=335608 CPUtime=49.13 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 118890 1256 0 0 4888 25 0 0 25 0 9 0 721262063 343662592 45116 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 83902 45116 180 55 0 81788 0
[pid=22488/tid=22495] ppid=22486 vsize=335608 CPUtime=6.13 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 8955 1256 0 0 612 1 0 0 25 0 9 0 721262079 343662592 45116 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364711 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=335608 CPUtime=6.13 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 3873 1256 0 0 612 1 0 0 25 0 9 0 721262079 343662592 45116 33554432000 4194304 4417452 140734194737248 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=335608 CPUtime=6.13 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 15053 1256 0 0 610 3 0 0 25 0 9 0 721262079 343662592 45116 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=335608 CPUtime=6.13 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 20816 1256 0 0 608 5 0 0 25 0 9 0 721262079 343662592 45116 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=335608 CPUtime=6.13 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 20368 1256 0 0 609 4 0 0 25 0 9 0 721262079 343662592 45116 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364807 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=335608 CPUtime=6.02 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 14909 1256 0 0 600 2 0 0 25 0 9 0 721262079 343662592 45116 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=335608 CPUtime=6.12 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 12650 1256 0 0 611 1 0 0 25 0 9 0 721262079 343662592 45116 33554432000 4194304 4417452 140734194737248 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=335608 CPUtime=6.1 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 13164 1256 0 0 608 2 0 0 25 0 9 0 721262079 343662592 45116 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364621 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 49.13
Current children cumulated vsize (KiB) 335608

[startup+12.7013 s]
/proc/loadavg: 2.10 2.17 1.92 9/552 22502
/proc/meminfo: memFree=15938924/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=415152 CPUtime=100.2 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 233406 1256 0 0 9972 48 0 0 25 0 9 0 721262063 425115648 65201 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 103788 65201 180 55 0 101674 0
[pid=22488/tid=22495] ppid=22486 vsize=415152 CPUtime=12.53 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 22376 1256 0 0 1250 3 0 0 25 0 9 0 721262079 425115648 65201 33554432000 4194304 4417452 140734194737248 18446744073709551615 4357222 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=415152 CPUtime=12.53 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 10516 1256 0 0 1251 2 0 0 25 0 9 0 721262079 425115648 65201 33554432000 4194304 4417452 140734194737248 18446744073709551615 4234629 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=415152 CPUtime=12.53 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 27849 1256 0 0 1247 6 0 0 25 0 9 0 721262079 425115648 65201 33554432000 4194304 4417452 140734194737248 18446744073709551615 4249130 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=415152 CPUtime=12.52 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 33446 1256 0 0 1245 7 0 0 25 0 9 0 721262079 425115648 65201 33554432000 4194304 4417452 140734194737248 18446744073709551615 4250927 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=415152 CPUtime=12.52 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 40637 1256 0 0 1244 8 0 0 25 0 9 0 721262079 425115648 65201 33554432000 4194304 4417452 140734194737248 18446744073709551615 18446744073699065904 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=415152 CPUtime=12.31 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 32447 1256 0 0 1224 7 0 0 25 0 9 0 721262079 425115648 65201 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=415152 CPUtime=12.52 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 28857 1256 0 0 1248 4 0 0 25 0 9 0 721262079 425115648 65201 33554432000 4194304 4417452 140734194737248 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=415152 CPUtime=12.51 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 28176 1256 0 0 1245 6 0 0 25 0 9 0 721262079 425115648 65201 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364632 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 100.2
Current children cumulated vsize (KiB) 415152

[startup+25.5009 s]
/proc/loadavg: 3.41 2.46 2.02 9/552 22503
/proc/meminfo: memFree=15775544/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=636272 CPUtime=202.34 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 403841 1256 0 0 20156 78 0 0 25 0 9 0 721262063 651542528 120978 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 159068 120978 180 55 0 156954 0
[pid=22488/tid=22495] ppid=22486 vsize=636272 CPUtime=25.32 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 32182 1256 0 0 2528 4 0 0 25 0 9 0 721262079 651542528 120978 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=636272 CPUtime=25.32 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 20625 1256 0 0 2529 3 0 0 25 0 9 0 721262079 651542528 120978 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=636272 CPUtime=25.32 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 52650 1256 0 0 2523 9 0 0 25 0 9 0 721262079 651542528 120978 33554432000 4194304 4417452 140734194737248 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=636272 CPUtime=25.33 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 57761 1256 0 0 2520 13 0 0 25 0 9 0 721262079 651542528 120978 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=636272 CPUtime=25.33 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 66649 1256 0 0 2522 11 0 0 25 0 9 0 721262079 651542528 120978 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=636272 CPUtime=24.87 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 66156 1256 0 0 2472 15 0 0 25 0 9 0 721262079 651542528 120978 33554432000 4194304 4417452 140734194737248 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=636272 CPUtime=25.33 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 43764 1256 0 0 2526 7 0 0 25 0 9 0 721262079 651542528 120978 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=636272 CPUtime=25.31 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 54952 1256 0 0 2519 12 0 0 25 0 9 0 721262079 651542528 120978 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 202.34
Current children cumulated vsize (KiB) 636272

[startup+51.1013 s]
/proc/loadavg: 4.97 2.90 2.17 9/552 22503
/proc/meminfo: memFree=15636004/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=779836 CPUtime=406.67 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 618314 1256 0 0 40550 117 0 0 25 0 9 0 721262063 798552064 157881 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 194959 157881 180 55 0 192845 0
[pid=22488/tid=22495] ppid=22486 vsize=779836 CPUtime=50.92 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 34298 1256 0 0 5088 4 0 0 25 0 9 0 721262079 798552064 157881 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364716 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=779836 CPUtime=50.91 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 44415 1256 0 0 5083 8 0 0 25 0 9 0 721262079 798552064 157881 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=779836 CPUtime=50.93 cores=0-7

################
# More data... #
################


[startup+4722.32 s]
/proc/loadavg: 8.03 8.05 8.00 9/552 22640
/proc/meminfo: memFree=9682548/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=6718148 CPUtime=37688.8 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 17984170 1256 0 0 3765294 3585 0 0 25 0 9 0 721262063 6879383552 1640737 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 1679537 1640737 180 55 0 1677423 0
[pid=22488/tid=22495] ppid=22486 vsize=6718148 CPUtime=4722.22 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 2303147 1256 0 0 471773 449 0 0 25 0 9 0 721262079 6879383552 1640737 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=6718148 CPUtime=4720.87 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 2155895 1256 0 0 471692 395 0 0 25 0 9 0 721262079 6879383552 1640737 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=6718148 CPUtime=4722.21 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 2403341 1256 0 0 471773 448 0 0 25 0 9 0 721262079 6879383552 1640737 33554432000 4194304 4417452 140734194737248 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=6718148 CPUtime=4722.16 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 1233719 1256 0 0 471918 298 0 0 25 0 9 0 721262079 6879383552 1640737 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=6718148 CPUtime=4722.27 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 2903249 1256 0 0 471637 590 0 0 25 0 9 0 721262079 6879383552 1640737 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=6718148 CPUtime=4634.41 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 2728211 1256 0 0 462886 555 0 0 25 0 9 0 721262079 6879383552 1640737 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=6718148 CPUtime=4722.24 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 1583765 1256 0 0 471886 338 0 0 25 0 9 0 721262079 6879383552 1640737 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=6718148 CPUtime=4722.17 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 2663741 1256 0 0 471710 507 0 0 25 0 9 0 721262079 6879383552 1640737 33554432000 4194304 4417452 140734194737248 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37688.8
Current children cumulated vsize (KiB) 6718148

[startup+4782.3 s]
/proc/loadavg: 8.08 8.06 8.00 9/552 22641
/proc/meminfo: memFree=9803680/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=6597336 CPUtime=38167.5 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 18055134 1256 0 0 3813154 3595 0 0 25 0 9 0 721262063 6755672064 1610534 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 1649334 1610534 180 55 0 1647220 0
[pid=22488/tid=22495] ppid=22486 vsize=6597336 CPUtime=4782.2 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 2328230 1256 0 0 477767 453 0 0 25 0 9 0 721262079 6755672064 1610534 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=6597336 CPUtime=4780.84 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 2169239 1256 0 0 477687 397 0 0 25 0 9 0 721262079 6755672064 1610534 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=6597336 CPUtime=4782.19 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 2403341 1256 0 0 477771 448 0 0 25 0 9 0 721262079 6755672064 1610534 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=6597336 CPUtime=4782.14 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 1233719 1256 0 0 477916 298 0 0 25 0 9 0 721262079 6755672064 1610534 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=6597336 CPUtime=4782.25 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 2935786 1256 0 0 477631 594 0 0 25 0 9 0 721262079 6755672064 1610534 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=6597336 CPUtime=4693.25 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 2728211 1256 0 0 468770 555 0 0 25 0 9 0 721262079 6755672064 1610534 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=6597336 CPUtime=4782.23 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 1583765 1256 0 0 477884 339 0 0 25 0 9 0 721262079 6755672064 1610534 33554432000 4194304 4417452 140734194737248 18446744073709551615 4365088 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=6597336 CPUtime=4782.15 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 2663741 1256 0 0 477708 507 0 0 25 0 9 0 721262079 6755672064 1610534 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38167.5
Current children cumulated vsize (KiB) 6597336

[startup+4842.3 s]
/proc/loadavg: 8.09 8.06 8.00 9/552 22643
/proc/meminfo: memFree=9431424/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=6969812 CPUtime=38646.3 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 18182159 1256 0 0 3861017 3615 0 0 25 0 9 0 721262063 7137087488 1703653 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 1742453 1703653 180 55 0 1740339 0
[pid=22488/tid=22495] ppid=22486 vsize=6969812 CPUtime=4842.2 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 2387268 1256 0 0 483757 463 0 0 25 0 9 0 721262079 7137087488 1703653 33554432000 4194304 4417452 140734194737248 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=6969812 CPUtime=4840.81 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 2202008 1256 0 0 483681 400 0 0 25 0 9 0 721262079 7137087488 1703653 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=6969812 CPUtime=4842.2 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 2424043 1256 0 0 483769 451 0 0 25 0 9 0 721262079 7137087488 1703653 33554432000 4194304 4417452 140734194737248 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=6969812 CPUtime=4842.14 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 1236201 1256 0 0 483915 299 0 0 25 0 9 0 721262079 7137087488 1703653 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=6969812 CPUtime=4842.25 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 2935786 1256 0 0 483631 594 0 0 25 0 9 0 721262079 7137087488 1703653 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=6969812 CPUtime=4752.1 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 2728211 1256 0 0 474655 555 0 0 25 0 9 0 721262079 7137087488 1703653 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=6969812 CPUtime=4842.24 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 1583765 1256 0 0 483885 339 0 0 25 0 9 0 721262079 7137087488 1703653 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=6969812 CPUtime=4842.15 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 2675775 1256 0 0 483705 510 0 0 25 0 9 0 721262079 7137087488 1703653 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38646.3
Current children cumulated vsize (KiB) 6969812

[startup+4902.3 s]
/proc/loadavg: 8.09 8.06 8.00 9/552 22645
/proc/meminfo: memFree=9955080/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=6447688 CPUtime=39125.2 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 18424465 1256 0 0 3908862 3659 0 0 25 0 9 0 721262063 6602432512 1573122 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 1611922 1573122 180 55 0 1609808 0
[pid=22488/tid=22495] ppid=22486 vsize=6447688 CPUtime=4902.2 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 2390738 1256 0 0 489757 463 0 0 25 0 9 0 721262079 6602432512 1573122 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=6447688 CPUtime=4900.8 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 2202008 1256 0 0 489680 400 0 0 25 0 9 0 721262079 6602432512 1573122 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=6447688 CPUtime=4902.2 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 2427458 1256 0 0 489766 454 0 0 25 0 9 0 721262079 6602432512 1573122 33554432000 4194304 4417452 140734194737248 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=6447688 CPUtime=4902.14 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 1261361 1256 0 0 489912 302 0 0 25 0 9 0 721262079 6602432512 1573122 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=6447688 CPUtime=4902.26 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 2998403 1256 0 0 489621 605 0 0 25 0 9 0 721262079 6602432512 1573122 33554432000 4194304 4417452 140734194737248 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=6447688 CPUtime=4810.99 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 2826035 1256 0 0 480527 572 0 0 25 0 9 0 721262079 6602432512 1573122 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=6447688 CPUtime=4902.24 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 1583765 1256 0 0 489885 339 0 0 25 0 9 0 721262079 6602432512 1573122 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=6447688 CPUtime=4902.16 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 2725595 1256 0 0 489696 520 0 0 25 0 9 0 721262079 6602432512 1573122 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39125.2
Current children cumulated vsize (KiB) 6447688

[startup+4962.3 s]
/proc/loadavg: 8.08 8.06 8.00 9/552 22646
/proc/meminfo: memFree=9632668/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=6769772 CPUtime=39604 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 18598923 1256 0 0 3956693 3710 0 0 25 0 9 0 721262063 6932246528 1653643 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 1692443 1653643 180 55 0 1690329 0
[pid=22488/tid=22495] ppid=22486 vsize=6769772 CPUtime=4961.14 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 2440596 1256 0 0 495639 475 0 0 25 0 9 0 721262079 6932246528 1653643 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=6769772 CPUtime=4960.79 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 2263036 1256 0 0 495660 419 0 0 25 0 9 0 721262079 6932246528 1653643 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=6769772 CPUtime=4962.16 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 2490298 1256 0 0 495742 474 0 0 25 0 9 0 721262079 6932246528 1653643 33554432000 4194304 4417452 140734194737248 18446744073709551615 4250599 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=6769772 CPUtime=4962.14 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 1261361 1256 0 0 495912 302 0 0 25 0 9 0 721262079 6932246528 1653643 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364772 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=6769772 CPUtime=4962.26 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 2998403 1256 0 0 495621 605 0 0 25 0 9 0 721262079 6932246528 1653643 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=6769772 CPUtime=4870.93 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 2826035 1256 0 0 486521 572 0 0 25 0 9 0 721262079 6932246528 1653643 33554432000 4194304 4417452 140734194737248 18446744073709551615 4251063 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=6769772 CPUtime=4962.24 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 1583765 1256 0 0 495885 339 0 0 25 0 9 0 721262079 6932246528 1653643 33554432000 4194304 4417452 140734194737248 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=6769772 CPUtime=4962.16 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 2726327 1256 0 0 495696 520 0 0 25 0 9 0 721262079 6932246528 1653643 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39604
Current children cumulated vsize (KiB) 6769772



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5012 s]
/proc/loadavg: 8.09 8.07 8.00 9/552 22648
/proc/meminfo: memFree=9429044/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=6972860 CPUtime=40000.9 cores=0-7
/proc/22488/stat : 22488 (plingeling) S 22486 22488 22382 0 -1 4202496 18737640 1256 0 0 3996353 3734 0 0 25 0 9 0 721262063 7140208640 1704415 33554432000 4194304 4417452 140734194737248 18446744073709551615 253652662245 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 1743215 1704415 180 55 0 1741101 0
[pid=22488/tid=22495] ppid=22486 vsize=6972860 CPUtime=5009.93 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4202560 2440596 1256 0 0 500518 475 0 0 25 0 9 0 721262079 7140208640 1704415 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=22488/tid=22496] ppid=22486 vsize=6972860 CPUtime=5010.49 cores=0-7
/proc/22488/task/22496/stat : 22496 (plingeling) R 22486 22488 22382 0 -1 4202560 2263036 1256 0 0 500630 419 0 0 25 0 9 0 721262079 7140208640 1704415 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=22488/tid=22497] ppid=22486 vsize=6972860 CPUtime=5011.88 cores=0-7
/proc/22488/task/22497/stat : 22497 (plingeling) R 22486 22488 22382 0 -1 4202560 2555954 1256 0 0 500704 484 0 0 25 0 9 0 721262079 7140208640 1704415 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=22488/tid=22498] ppid=22486 vsize=6972860 CPUtime=5011.86 cores=0-7
/proc/22488/task/22498/stat : 22498 (plingeling) R 22486 22488 22382 0 -1 4202560 1261361 1256 0 0 500884 302 0 0 25 0 9 0 721262079 7140208640 1704415 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=22488/tid=22499] ppid=22486 vsize=6972860 CPUtime=5011.98 cores=0-7
/proc/22488/task/22499/stat : 22499 (plingeling) R 22486 22488 22382 0 -1 4202560 2998403 1256 0 0 500593 605 0 0 25 0 9 0 721262079 7140208640 1704415 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=22488/tid=22500] ppid=22486 vsize=6972860 CPUtime=4920.65 cores=0-7
/proc/22488/task/22500/stat : 22500 (plingeling) R 22486 22488 22382 0 -1 4202560 2847416 1256 0 0 491490 575 0 0 25 0 9 0 721262079 7140208640 1704415 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=22488/tid=22501] ppid=22486 vsize=6972860 CPUtime=5011.96 cores=0-7
/proc/22488/task/22501/stat : 22501 (plingeling) R 22486 22488 22382 0 -1 4202560 1583765 1256 0 0 500857 339 0 0 25 0 9 0 721262079 7140208640 1704415 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=22488/tid=22502] ppid=22486 vsize=6972860 CPUtime=5011.88 cores=0-7
/proc/22488/task/22502/stat : 22502 (plingeling) R 22486 22488 22382 0 -1 4202560 2778007 1256 0 0 500657 531 0 0 25 0 9 0 721262079 7140208640 1704415 33554432000 4194304 4417452 140734194737248 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 6972860

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5012.2 s]
/proc/loadavg: 8.09 8.07 8.00 9/552 22648
/proc/meminfo: memFree=9429044/32951124 swapFree=54323904/67111528
[pid=22488] ppid=22486 vsize=0 CPUtime=40001.1 cores=0-7
/proc/22488/stat : 22488 (plingeling) Z 22486 22488 22382 0 -1 4203548 18737640 1256 0 0 3996357 3751 0 0 18 0 2 0 721262063 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 4 0 0 0
/proc/22488/statm: 0 0 0 0 0 0 0
[pid=22488/tid=22495] ppid=22486 vsize=0 CPUtime=5010.11 cores=0-7
/proc/22488/task/22495/stat : 22495 (plingeling) R 22486 22488 22382 0 -1 4203588 2440596 1256 0 0 500519 492 0 0 25 0 2 0 721262079 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40001.1
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5012.27
CPU time (s): 40001.2
CPU user time (s): 39963.6
CPU system time (s): 37.5893
CPU usage (%): 798.064
Max. virtual memory (cumulated for all children) (KiB): 8081368

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39963.6
system time used= 37.5893
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18738896
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 430
involuntary context switches= 143087

runsolver used 25.1182 second user time and 67.3698 second system time

The end

Launcher Data 

Begin job on node106 at 2011-05-22 22:36:57
IDJOB=3394452
IDBENCH=83170
IDSOLVER=1851
FILE ID=node106/3394452-1306096617
RUNJOBID= node106-1306096616-22396
PBS_JOBID= 13387974
Free space on /tmp= 73260 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-7x39.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394452-1306096617/watcher-3394452-1306096617 -o /tmp/evaluation-result-3394452-1306096617/solver-3394452-1306096617 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394452-1306096617.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f717554c4e7f802b3078c48464dbcd9d
RANDOM SEED=341679253

node106.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16256508 kB
Buffers:        342432 kB
Cached:       10390436 kB
SwapCached:      24016 kB
Active:        6103188 kB
Inactive:     10279428 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16256508 kB
SwapTotal:    67111528 kB
SwapFree:     54323904 kB
Dirty:            1584 kB
Writeback:           0 kB
AnonPages:     5634308 kB
Mapped:          25628 kB
Slab:           158376 kB
PageTables:      78184 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 167521740 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73260 MiB
End job on node106 at 2011-05-23 00:00:31