Trace number 3310101

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.4 5011.34

General information on the benchmark

NameSAT-Race-2010-CNF/hardware-verification/
velev/2dlx_ca_bp_f_liveness.cnf
MD5SUM99cd8de7f06ce8c087a5c7fb299dfb62
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables202253
Number of clauses4313014
Sum of the clauses size12562188
Maximum clause length651
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 23935640
Number of clauses of size 3199653
Number of clauses of size 410363
Number of clauses of size 55846
Number of clauses of size over 5161511

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310101-1304019248/watcher-3310101-1304019248 -o /tmp/evaluation-result-3310101-1304019248/solver-3310101-1304019248 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3310101-1304019248.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.01 3.44 2.50 1/170 30799
/proc/meminfo: memFree=11738984/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=11508 CPUtime=0 cores=0-7
/proc/30799/stat : 30799 (plingeling) R 30797 30799 30420 0 -1 4202496 938 1254 0 0 0 0 0 0 21 0 1 0 513525346 11784192 866 33554432000 4194304 4417332 140735037166176 18446744073709551615 230808859604 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30799/statm: 2877 866 146 55 0 763 0

[startup+0.0246199 s]
/proc/loadavg: 7.01 3.44 2.50 1/170 30799
/proc/meminfo: memFree=11738984/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=14968 CPUtime=0.01 cores=0-7
/proc/30799/stat : 30799 (plingeling) R 30797 30799 30420 0 -1 4202496 1837 1254 0 0 1 0 0 0 21 0 1 0 513525346 15327232 1765 33554432000 4194304 4417332 140735037166176 18446744073709551615 4231391 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30799/statm: 3742 1765 148 55 0 1628 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 14968

[startup+0.100608 s]
/proc/loadavg: 7.01 3.44 2.50 1/170 30799
/proc/meminfo: memFree=11738984/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=26708 CPUtime=0.09 cores=0-7
/proc/30799/stat : 30799 (plingeling) R 30797 30799 30420 0 -1 4202496 4772 1254 0 0 9 0 0 0 21 0 1 0 513525346 27348992 4700 33554432000 4194304 4417332 140735037166176 18446744073709551615 4231291 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30799/statm: 6677 4700 148 55 0 4563 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26708

[startup+0.300539 s]
/proc/loadavg: 7.01 3.44 2.50 1/170 30799
/proc/meminfo: memFree=11738984/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=45680 CPUtime=0.29 cores=0-7
/proc/30799/stat : 30799 (plingeling) R 30797 30799 30420 0 -1 4202496 9515 1254 0 0 28 1 0 0 22 0 1 0 513525346 46776320 9443 33554432000 4194304 4417332 140735037166176 18446744073709551615 4322134 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30799/statm: 11420 9443 148 55 0 9306 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 45680

[startup+0.700466 s]
/proc/loadavg: 7.01 3.44 2.50 1/170 30799
/proc/meminfo: memFree=11738984/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=119312 CPUtime=0.69 cores=0-7
/proc/30799/stat : 30799 (plingeling) R 30797 30799 30420 0 -1 4202496 27892 1254 0 0 65 4 0 0 23 0 1 0 513525346 122175488 27821 33554432000 4194304 4417332 140735037166176 18446744073709551615 230808859629 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30799/statm: 29828 27851 148 55 0 27714 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 119312

[startup+1.50033 s]
/proc/loadavg: 7.01 3.44 2.50 2/171 30805
/proc/meminfo: memFree=11615412/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=213388 CPUtime=1.49 cores=0-7
/proc/30799/stat : 30799 (plingeling) R 30797 30799 30420 0 -1 4202496 51450 1254 0 0 142 7 0 0 25 0 1 0 513525346 218509312 51370 33554432000 4194304 4417332 140735037166176 18446744073709551615 4231541 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30799/statm: 53347 51370 148 55 0 51233 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 213388

[startup+3.10102 s]
/proc/loadavg: 7.01 3.44 2.50 2/171 30805
/proc/meminfo: memFree=11615412/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=414616 CPUtime=3.09 cores=0-7
/proc/30799/stat : 30799 (plingeling) R 30797 30799 30420 0 -1 4202496 101757 1254 0 0 295 14 0 0 25 0 1 0 513525346 424566784 101677 33554432000 4194304 4417332 140735037166176 18446744073709551615 230809165568 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30799/statm: 103654 101677 148 55 0 101540 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 414616

[startup+6.30045 s]
/proc/loadavg: 6.52 3.40 2.49 2/171 30805
/proc/meminfo: memFree=11192940/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=816792 CPUtime=6.29 cores=0-7
/proc/30799/stat : 30799 (plingeling) R 30797 30799 30420 0 -1 4202496 202498 1254 0 0 601 28 0 0 25 0 1 0 513525346 836395008 202221 33554432000 4194304 4417332 140735037166176 18446744073709551615 4321563 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/30799/statm: 204198 202221 148 55 0 202084 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 816792

[startup+12.7012 s]
/proc/loadavg: 6.64 3.47 2.52 9/179 30814
/proc/meminfo: memFree=10861444/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=987936 CPUtime=40.26 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 290062 1254 0 0 3982 44 0 0 19 0 9 0 513525346 1011646464 219194 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 246984 219194 177 55 0 244870 0
[pid=30799/tid=30807] ppid=30797 vsize=987936 CPUtime=3.93 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 8350 1254 0 0 393 0 0 0 25 0 9 0 513526221 1011646464 219194 33554432000 4194304 4417332 140735037166176 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=987936 CPUtime=3.91 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4202560 5586 1254 0 0 391 0 0 0 25 0 9 0 513526221 1011646464 219194 33554432000 4194304 4417332 140735037166176 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30799/tid=30809] ppid=30797 vsize=987936 CPUtime=3.94 cores=0-7
/proc/30799/task/30809/stat : 30809 (plingeling) R 30797 30799 30420 0 -1 4202560 5590 1254 0 0 393 1 0 0 25 0 9 0 513526221 1011646464 219194 33554432000 4194304 4417332 140735037166176 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30799/tid=30810] ppid=30797 vsize=987936 CPUtime=3.93 cores=0-7
/proc/30799/task/30810/stat : 30810 (plingeling) R 30797 30799 30420 0 -1 4202560 4641 1254 0 0 393 0 0 0 25 0 9 0 513526221 1011646464 219194 33554432000 4194304 4417332 140735037166176 18446744073709551615 4232577 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30799/tid=30811] ppid=30797 vsize=987936 CPUtime=3.94 cores=0-7
/proc/30799/task/30811/stat : 30811 (plingeling) R 30797 30799 30420 0 -1 4202560 8417 1254 0 0 393 1 0 0 25 0 9 0 513526221 1011646464 219194 33554432000 4194304 4417332 140735037166176 18446744073709551615 4306602 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=30799/tid=30812] ppid=30797 vsize=987936 CPUtime=3.93 cores=0-7
/proc/30799/task/30812/stat : 30812 (plingeling) R 30797 30799 30420 0 -1 4202560 8297 1254 0 0 392 1 0 0 25 0 9 0 513526222 1011646464 219194 33554432000 4194304 4417332 140735037166176 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30799/tid=30813] ppid=30797 vsize=987936 CPUtime=3.93 cores=0-7
/proc/30799/task/30813/stat : 30813 (plingeling) R 30797 30799 30420 0 -1 4202560 8379 1254 0 0 392 1 0 0 25 0 9 0 513526222 1011646464 219194 33554432000 4194304 4417332 140735037166176 18446744073709551615 4278200 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30799/tid=30814] ppid=30797 vsize=987936 CPUtime=3.93 cores=0-7
/proc/30799/task/30814/stat : 30814 (plingeling) R 30797 30799 30420 0 -1 4202560 5519 1254 0 0 392 1 0 0 25 0 9 0 513526222 1011646464 219194 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236866 0 0 4096 17442 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40.26
Current children cumulated vsize (KiB) 987936

[startup+25.5009 s]
/proc/loadavg: 6.94 3.70 2.60 9/179 30814
/proc/meminfo: memFree=10280660/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=1569060 CPUtime=142.37 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 699551 1254 0 0 14103 134 0 0 19 0 9 0 513525346 1606717440 364759 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 392265 364759 181 55 0 390151 0
[pid=30799/tid=30807] ppid=30797 vsize=1569060 CPUtime=16.73 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 64364 1254 0 0 1665 8 0 0 25 0 9 0 513526221 1606717440 364759 33554432000 4194304 4417332 140735037166176 18446744073709551615 4239393 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=1569060 CPUtime=16.63 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4202560 60949 1254 0 0 1646 17 0 0 25 0 9 0 513526221 1606717440 364759 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30799/tid=30809] ppid=30797 vsize=1569060 CPUtime=16.73 cores=0-7
/proc/30799/task/30809/stat : 30809 (plingeling) R 30797 30799 30420 0 -1 4202560 62075 1254 0 0 1660 13 0 0 25 0 9 0 513526221 1606717440 364759 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236755 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30799/tid=30810] ppid=30797 vsize=1569060 CPUtime=16.73 cores=0-7
/proc/30799/task/30810/stat : 30810 (plingeling) R 30797 30799 30420 0 -1 4202560 4641 1254 0 0 1673 0 0 0 25 0 9 0 513526221 1606717440 364759 33554432000 4194304 4417332 140735037166176 18446744073709551615 4264909 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30799/tid=30811] ppid=30797 vsize=1569060 CPUtime=16.63 cores=0-7
/proc/30799/task/30811/stat : 30811 (plingeling) R 30797 30799 30420 0 -1 4202560 73066 1254 0 0 1649 14 0 0 25 0 9 0 513526221 1606717440 364759 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30799/tid=30812] ppid=30797 vsize=1569060 CPUtime=16.68 cores=0-7
/proc/30799/task/30812/stat : 30812 (plingeling) R 30797 30799 30420 0 -1 4202560 69100 1254 0 0 1652 16 0 0 25 0 9 0 513526222 1606717440 364759 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30799/tid=30813] ppid=30797 vsize=1569060 CPUtime=16.72 cores=0-7
/proc/30799/task/30813/stat : 30813 (plingeling) R 30797 30799 30420 0 -1 4202560 69000 1254 0 0 1661 11 0 0 25 0 9 0 513526222 1606717440 364759 33554432000 4194304 4417332 140735037166176 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30799/tid=30814] ppid=30797 vsize=1569060 CPUtime=16.71 cores=0-7
/proc/30799/task/30814/stat : 30814 (plingeling) R 30797 30799 30420 0 -1 4202560 61073 1254 0 0 1655 16 0 0 25 0 9 0 513526222 1606717440 364759 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 142.37
Current children cumulated vsize (KiB) 1569060

[startup+51.1012 s]
/proc/loadavg: 7.36 4.06 2.75 9/179 30815
/proc/meminfo: memFree=10268232/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=1583844 CPUtime=347.01 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 703264 1254 0 0 34567 134 0 0 19 0 9 0 513525346 1621856256 368461 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 395961 368461 181 55 0 393847 0
[pid=30799/tid=30807] ppid=30797 vsize=1583844 CPUtime=42.31 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 64871 1254 0 0 4223 8 0 0 25 0 9 0 513526221 1621856256 368461 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=1583844 CPUtime=42.09 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4202560 60949 1254 0 0 4192 17 0 0 25 0 9 0 513526221 1621856256 368461 33554432000 4194304 4417332 140735037166176 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30799/tid=30809] ppid=30797 vsize=1583844 CPUtime=42.33 cores=0-7
/proc/30799/task/30809/stat : 30809 (plingeling) R 30797 30799 30420 0 -1 4202560 62075 1254 0 0 4220 13 0 0 25 0 9 0 513526221 1621856256 368461 33554432000 4194304 4417332 140735037166176 18446744073709551615 4265399 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30799/tid=30810] ppid=30797 vsize=1583844 CPUtime=42.34 cores=0-7
/proc/30799/task/30810/stat : 30810 (plingeling) R 30797 30799 30420 0 -1 4202560 7066 1254 0 0 4233 1 0 0 25 0 9 0 513526221 1621856256 368461 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30799/tid=30811] ppid=30797 vsize=1583844 CPUtime=42.22 cores=0-7
/proc/30799/task/30811/stat : 30811 (plingeling) R 30797 30799 30420 0 -1 4202560 73066 1254 0 0 4208 14 0 0 25 0 9 0 513526221 1621856256 368461 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30799/tid=30812] ppid=30797 vsize=1583844 CPUtime=42.28 cores=0-7
/proc/30799/task/30812/stat : 30812 (plingeling) R 30797 30799 30420 0 -1 4202560 69100 1254 0 0 4212 16 0 0 25 0 9 0 513526222 1621856256 368461 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30799/tid=30813] ppid=30797 vsize=1583844 CPUtime=42.32 cores=0-7
/proc/30799/task/30813/stat : 30813 (plingeling) R 30797 30799 30420 0 -1 4202560 69781 1254 0 0 4221 11 0 0 25 0 9 0 513526222 1621856256 368461 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30799/tid=30814] ppid=30797 vsize=1583844 CPUtime=42.31 cores=0-7
/proc/30799/task/30814/stat : 30814 (plingeling) R 30797 30799 30420 0 -1 4202560 61073 1254 0 0 4215 16 0 0 25 0 9 0 513526222 1621856256 368461 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 347.01
Current children cumulated vsize (KiB) 1583844

[startup+102.307 s]
/proc/loadavg: 7.78 4.68 3.03 9/179 30816
/proc/meminfo: memFree=10237308/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=1631652 CPUtime=756.36 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 959393 1254 0 0 75453 183 0 0 19 0 9 0 513525346 1670811648 375743 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 407913 375743 181 55 0 405799 0
[pid=30799/tid=30807] ppid=30797 vsize=1631652 CPUtime=93.52 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 99130 1254 0 0 9338 14 0 0 25 0 9 0 513526221 1670811648 375743 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=1631652 CPUtime=93.01 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4202560 96167 1254 0 0 9277 24 0 0 25 0 9 0 513526221 1670811648 375743 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236634 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30799/tid=30809] ppid=30797 vsize=1631652 CPUtime=93.53 cores=0-7
/proc/30799/task/30809/stat : 30809 (plingeling) R 30797 30799 30420 0 -1 4202560 102709 1254 0 0 9332 21 0 0 25 0 9 0 513526221 1670811648 375743 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30799/tid=30810] ppid=30797 vsize=1631652 CPUtime=93.54 cores=0-7
/proc/30799/task/30810/stat : 30810 (plingeling) R 30797 30799 30420 0 -1 4202560 7066 1254 0 0 9353 1 0 0 25 0 9 0 513526221 1670811648 375743 33554432000 4194304 4417332 140735037166176 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30799/tid=30811] ppid=30797 vsize=1631652 CPUtime=93.43 cores=0-7
/proc/30799/task/30811/stat : 30811 (plingeling) R 30797 30799 30420 0 -1 4202560 114974 1254 0 0 9322 21 0 0 25 0 9 0 513526221 1670811648 375743 33554432000 4194304 4417332 140735037166176 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30799/tid=30812] ppid=30797 vsize=1631652 CPUtime=93.49 cores=0-7
/proc/30799/task/30812/stat : 30812 (plingeling) R 30797 30799 30420 0 -1 4202560 102755 1254 0 0 9325 24 0 0 25 0 9 0 513526222 1670811648 375743 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236961 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30799/tid=30813] ppid=30797 vsize=1631652 CPUtime=93.52 cores=0-7
/proc/30799/task/30813/stat : 30813 (plingeling) R 30797 30799 30420 0 -1 4202560 107287 1254 0 0 9333 19 0 0 25 0 9 0 513526222 1670811648 375743 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236593 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30799/tid=30814] ppid=30797 vsize=1631652 CPUtime=93.51 cores=0-7
/proc/30799/task/30814/stat : 30814 (plingeling) R 30797 30799 30420 0 -1 4202560 94022 1254 0 0 9329 22 0 0 25 0 9 0 513526222 1670811648 375743 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 756.36
Current children cumulated vsize (KiB) 1631652

[startup+162.301 s]
/proc/loadavg: 7.97 5.29 3.34 9/179 30818
/proc/meminfo: memFree=10233852/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=1633592 CPUtime=1235.98 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 1185137 1254 0 0 123361 237 0 0 19 0 9 0 513525346 1672798208 376228 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 408398 376228 181 55 0 406284 0
[pid=30799/tid=30807] ppid=30797 vsize=1633592 CPUtime=153.52 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 102137 1254 0 0 15337 15 0 0 25 0 9 0 513526221 1672798208 376228 33554432000 4194304 4417332 140735037166176 18446744073709551615 4265462 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=1633592 CPUtime=152.68 cores=0-7

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.00 8.02 7.95 9/179 30951
/proc/meminfo: memFree=9168676/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=2703784 CPUtime=37690.6 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 9574699 1254 0 0 3767401 1657 0 0 19 0 9 0 513525346 2768674816 643788 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 675946 643788 181 55 0 673832 0
[pid=30799/tid=30807] ppid=30797 vsize=2703784 CPUtime=4713.6 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 1269490 1254 0 0 471138 222 0 0 25 0 9 0 513526221 2768674816 643788 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=2703784 CPUtime=4687.78 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4202560 1125741 1254 0 0 468568 210 0 0 25 0 9 0 513526221 2768674816 643788 33554432000 4194304 4417332 140735037166176 18446744073709551615 4321669 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30799/tid=30809] ppid=30797 vsize=2703784 CPUtime=4713.66 cores=0-7
/proc/30799/task/30809/stat : 30809 (plingeling) R 30797 30799 30420 0 -1 4202560 1177137 1254 0 0 471161 205 0 0 25 0 9 0 513526221 2768674816 643788 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30799/tid=30810] ppid=30797 vsize=2703784 CPUtime=4713.64 cores=0-7
/proc/30799/task/30810/stat : 30810 (plingeling) R 30797 30799 30420 0 -1 4202560 1941674 1254 0 0 471024 340 0 0 25 0 9 0 513526221 2768674816 643788 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30799/tid=30811] ppid=30797 vsize=2703784 CPUtime=4713.38 cores=0-7
/proc/30799/task/30811/stat : 30811 (plingeling) R 30797 30799 30420 0 -1 4202560 824789 1254 0 0 471203 135 0 0 25 0 9 0 513526221 2768674816 643788 33554432000 4194304 4417332 140735037166176 18446744073709551615 4357851 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30799/tid=30812] ppid=30797 vsize=2703784 CPUtime=4713.6 cores=0-7
/proc/30799/task/30812/stat : 30812 (plingeling) R 30797 30799 30420 0 -1 4202560 1089145 1254 0 0 471166 194 0 0 25 0 9 0 513526222 2768674816 643788 33554432000 4194304 4417332 140735037166176 18446744073709551615 4265465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30799/tid=30813] ppid=30797 vsize=2703784 CPUtime=4712.96 cores=0-7
/proc/30799/task/30813/stat : 30813 (plingeling) R 30797 30799 30420 0 -1 4202560 951005 1254 0 0 471142 154 0 0 25 0 9 0 513526222 2768674816 643788 33554432000 4194304 4417332 140735037166176 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30799/tid=30814] ppid=30797 vsize=2703784 CPUtime=4713.16 cores=0-7
/proc/30799/task/30814/stat : 30814 (plingeling) R 30797 30799 30420 0 -1 4202560 960435 1254 0 0 471156 160 0 0 25 0 9 0 513526222 2768674816 643788 33554432000 4194304 4417332 140735037166176 18446744073709551615 4353502 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37690.6
Current children cumulated vsize (KiB) 2703784

[startup+4782.3 s]
/proc/loadavg: 8.04 8.03 7.96 9/179 30953
/proc/meminfo: memFree=9024228/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=2844472 CPUtime=38170.2 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 9652638 1254 0 0 3815351 1671 0 0 19 0 9 0 513525346 2912739328 678960 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 711118 678960 181 55 0 709004 0
[pid=30799/tid=30807] ppid=30797 vsize=2844472 CPUtime=4773.59 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 1280774 1254 0 0 477135 224 0 0 25 0 9 0 513526221 2912739328 678960 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=2844472 CPUtime=4747.44 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4202560 1135604 1254 0 0 474532 212 0 0 25 0 9 0 513526221 2912739328 678960 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30799/tid=30809] ppid=30797 vsize=2844472 CPUtime=4773.66 cores=0-7
/proc/30799/task/30809/stat : 30809 (plingeling) R 30797 30799 30420 0 -1 4202560 1180026 1254 0 0 477160 206 0 0 25 0 9 0 513526221 2912739328 678960 33554432000 4194304 4417332 140735037166176 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30799/tid=30810] ppid=30797 vsize=2844472 CPUtime=4773.63 cores=0-7
/proc/30799/task/30810/stat : 30810 (plingeling) R 30797 30799 30420 0 -1 4202560 1969290 1254 0 0 477020 343 0 0 25 0 9 0 513526221 2912739328 678960 33554432000 4194304 4417332 140735037166176 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30799/tid=30811] ppid=30797 vsize=2844472 CPUtime=4773.39 cores=0-7
/proc/30799/task/30811/stat : 30811 (plingeling) R 30797 30799 30420 0 -1 4202560 827324 1254 0 0 477203 136 0 0 25 0 9 0 513526221 2912739328 678960 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30799/tid=30812] ppid=30797 vsize=2844472 CPUtime=4773.59 cores=0-7
/proc/30799/task/30812/stat : 30812 (plingeling) R 30797 30799 30420 0 -1 4202560 1095375 1254 0 0 477164 195 0 0 25 0 9 0 513526222 2912739328 678960 33554432000 4194304 4417332 140735037166176 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30799/tid=30813] ppid=30797 vsize=2844472 CPUtime=4772.95 cores=0-7
/proc/30799/task/30813/stat : 30813 (plingeling) R 30797 30799 30420 0 -1 4202560 966443 1254 0 0 477138 157 0 0 25 0 9 0 513526222 2912739328 678960 33554432000 4194304 4417332 140735037166176 18446744073709551615 4353502 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30799/tid=30814] ppid=30797 vsize=2844472 CPUtime=4773.14 cores=0-7
/proc/30799/task/30814/stat : 30814 (plingeling) R 30797 30799 30420 0 -1 4202560 962519 1254 0 0 477154 160 0 0 25 0 9 0 513526222 2912739328 678960 33554432000 4194304 4417332 140735037166176 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38170.2
Current children cumulated vsize (KiB) 2844472

[startup+4842.3 s]
/proc/loadavg: 8.05 8.03 7.96 9/179 30954
/proc/meminfo: memFree=9202036/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=2668972 CPUtime=38649.9 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 9746255 1254 0 0 3863303 1686 0 0 19 0 9 0 513525346 2733027328 635085 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 667243 635085 181 55 0 665129 0
[pid=30799/tid=30807] ppid=30797 vsize=2668972 CPUtime=4833.6 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 1288594 1254 0 0 483135 225 0 0 25 0 9 0 513526221 2733027328 635085 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=2668972 CPUtime=4807.12 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4202560 1141873 1254 0 0 480498 214 0 0 25 0 9 0 513526221 2733027328 635085 33554432000 4194304 4417332 140735037166176 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30799/tid=30809] ppid=30797 vsize=2668972 CPUtime=4833.65 cores=0-7
/proc/30799/task/30809/stat : 30809 (plingeling) R 30797 30799 30420 0 -1 4202560 1185395 1254 0 0 483159 206 0 0 25 0 9 0 513526221 2733027328 635085 33554432000 4194304 4417332 140735037166176 18446744073709551615 4265443 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30799/tid=30810] ppid=30797 vsize=2668972 CPUtime=4833.63 cores=0-7
/proc/30799/task/30810/stat : 30810 (plingeling) R 30797 30799 30420 0 -1 4202560 1988508 1254 0 0 483017 346 0 0 25 0 9 0 513526221 2733027328 635085 33554432000 4194304 4417332 140735037166176 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30799/tid=30811] ppid=30797 vsize=2668972 CPUtime=4833.38 cores=0-7
/proc/30799/task/30811/stat : 30811 (plingeling) R 30797 30799 30420 0 -1 4202560 865293 1254 0 0 483197 141 0 0 25 0 9 0 513526221 2733027328 635085 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364385 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30799/tid=30812] ppid=30797 vsize=2668972 CPUtime=4833.59 cores=0-7
/proc/30799/task/30812/stat : 30812 (plingeling) R 30797 30799 30420 0 -1 4202560 1105816 1254 0 0 483162 197 0 0 25 0 9 0 513526222 2733027328 635085 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30799/tid=30813] ppid=30797 vsize=2668972 CPUtime=4832.96 cores=0-7
/proc/30799/task/30813/stat : 30813 (plingeling) R 30797 30799 30420 0 -1 4202560 969380 1254 0 0 483138 158 0 0 25 0 9 0 513526222 2733027328 635085 33554432000 4194304 4417332 140735037166176 18446744073709551615 4365886 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30799/tid=30814] ppid=30797 vsize=2668972 CPUtime=4833.14 cores=0-7
/proc/30799/task/30814/stat : 30814 (plingeling) R 30797 30799 30420 0 -1 4202560 966113 1254 0 0 483153 161 0 0 25 0 9 0 513526222 2733027328 635085 33554432000 4194304 4417332 140735037166176 18446744073709551615 4353498 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38649.9
Current children cumulated vsize (KiB) 2668972

[startup+4902.3 s]
/proc/loadavg: 8.05 8.04 7.97 9/179 30956
/proc/meminfo: memFree=9108652/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=2760424 CPUtime=39129.6 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 9882671 1254 0 0 3911251 1707 0 0 19 0 9 0 513525346 2826674176 657948 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 690106 657948 181 55 0 687992 0
[pid=30799/tid=30807] ppid=30797 vsize=2760424 CPUtime=4893.6 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 1294099 1254 0 0 489134 226 0 0 25 0 9 0 513526221 2826674176 657948 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=2760424 CPUtime=4866.79 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4202560 1151827 1254 0 0 486463 216 0 0 25 0 9 0 513526221 2826674176 657948 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30799/tid=30809] ppid=30797 vsize=2760424 CPUtime=4893.65 cores=0-7
/proc/30799/task/30809/stat : 30809 (plingeling) R 30797 30799 30420 0 -1 4202560 1196333 1254 0 0 489156 209 0 0 25 0 9 0 513526221 2826674176 657948 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30799/tid=30810] ppid=30797 vsize=2760424 CPUtime=4893.63 cores=0-7
/proc/30799/task/30810/stat : 30810 (plingeling) R 30797 30799 30420 0 -1 4202560 2000152 1254 0 0 489016 347 0 0 25 0 9 0 513526221 2826674176 657948 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30799/tid=30811] ppid=30797 vsize=2760424 CPUtime=4893.39 cores=0-7
/proc/30799/task/30811/stat : 30811 (plingeling) R 30797 30799 30420 0 -1 4202560 868428 1254 0 0 489197 142 0 0 25 0 9 0 513526221 2826674176 657948 33554432000 4194304 4417332 140735037166176 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30799/tid=30812] ppid=30797 vsize=2760424 CPUtime=4893.6 cores=0-7
/proc/30799/task/30812/stat : 30812 (plingeling) R 30797 30799 30420 0 -1 4202560 1149266 1254 0 0 489157 203 0 0 25 0 9 0 513526222 2826674176 657948 33554432000 4194304 4417332 140735037166176 18446744073709551615 4357164 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30799/tid=30813] ppid=30797 vsize=2760424 CPUtime=4892.96 cores=0-7
/proc/30799/task/30813/stat : 30813 (plingeling) R 30797 30799 30420 0 -1 4202560 978213 1254 0 0 489136 160 0 0 25 0 9 0 513526222 2826674176 657948 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236772 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30799/tid=30814] ppid=30797 vsize=2760424 CPUtime=4893.14 cores=0-7
/proc/30799/task/30814/stat : 30814 (plingeling) R 30797 30799 30420 0 -1 4202560 1009070 1254 0 0 489147 167 0 0 25 0 9 0 513526222 2826674176 657948 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39129.6
Current children cumulated vsize (KiB) 2760424

[startup+4962.3 s]
/proc/loadavg: 8.13 8.06 7.98 9/179 30958
/proc/meminfo: memFree=9120184/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=2748908 CPUtime=39609.3 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 9970942 1254 0 0 3959202 1724 0 0 19 0 9 0 513525346 2814881792 655069 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 687227 655069 181 55 0 685113 0
[pid=30799/tid=30807] ppid=30797 vsize=2748908 CPUtime=4953.61 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 1303700 1254 0 0 495133 228 0 0 25 0 9 0 513526221 2814881792 655069 33554432000 4194304 4417332 140735037166176 18446744073709551615 4232479 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=2748908 CPUtime=4926.47 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4202560 1163144 1254 0 0 492427 220 0 0 25 0 9 0 513526221 2814881792 655069 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30799/tid=30809] ppid=30797 vsize=2748908 CPUtime=4953.66 cores=0-7
/proc/30799/task/30809/stat : 30809 (plingeling) R 30797 30799 30420 0 -1 4202560 1200994 1254 0 0 495156 210 0 0 25 0 9 0 513526221 2814881792 655069 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30799/tid=30810] ppid=30797 vsize=2748908 CPUtime=4953.64 cores=0-7
/proc/30799/task/30810/stat : 30810 (plingeling) R 30797 30799 30420 0 -1 4202560 2027218 1254 0 0 495012 352 0 0 25 0 9 0 513526221 2814881792 655069 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30799/tid=30811] ppid=30797 vsize=2748908 CPUtime=4953.39 cores=0-7
/proc/30799/task/30811/stat : 30811 (plingeling) R 30797 30799 30420 0 -1 4202560 882123 1254 0 0 495194 145 0 0 25 0 9 0 513526221 2814881792 655069 33554432000 4194304 4417332 140735037166176 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30799/tid=30812] ppid=30797 vsize=2748908 CPUtime=4953.6 cores=0-7
/proc/30799/task/30812/stat : 30812 (plingeling) R 30797 30799 30420 0 -1 4202560 1149266 1254 0 0 495157 203 0 0 25 0 9 0 513526222 2814881792 655069 33554432000 4194304 4417332 140735037166176 18446744073709551615 4251008 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30799/tid=30813] ppid=30797 vsize=2748908 CPUtime=4952.97 cores=0-7
/proc/30799/task/30813/stat : 30813 (plingeling) R 30797 30799 30420 0 -1 4202560 998648 1254 0 0 495134 163 0 0 25 0 9 0 513526222 2814881792 655069 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30799/tid=30814] ppid=30797 vsize=2748908 CPUtime=4953.13 cores=0-7
/proc/30799/task/30814/stat : 30814 (plingeling) R 30797 30799 30420 0 -1 4202560 1010566 1254 0 0 495146 167 0 0 25 0 9 0 513526222 2814881792 655069 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364544 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39609.3
Current children cumulated vsize (KiB) 2748908



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.2 s]
/proc/loadavg: 8.05 8.05 7.98 9/179 30959
/proc/meminfo: memFree=8743628/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=3124772 CPUtime=40000.2 cores=0-7
/proc/30799/stat : 30799 (plingeling) S 30797 30799 30420 0 -1 4202496 10127449 1254 0 0 3998272 1752 0 0 19 0 9 0 513525346 3199766528 749034 33554432000 4194304 4417332 140735037166176 18446744073709551615 230820968421 0 0 4096 17442 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 781193 749034 181 55 0 779079 0
[pid=30799/tid=30807] ppid=30797 vsize=3124772 CPUtime=5002.51 cores=0-7
/proc/30799/task/30807/stat : 30807 (plingeling) R 30797 30799 30420 0 -1 4202560 1369616 1254 0 0 500013 238 0 0 25 0 9 0 513526221 3199766528 749034 33554432000 4194304 4417332 140735037166176 18446744073709551615 4262236 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=3124772 CPUtime=4975.1 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4202560 1166921 1254 0 0 497290 220 0 0 25 0 9 0 513526221 3199766528 749034 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=30799/tid=30809] ppid=30797 vsize=3124772 CPUtime=5002.57 cores=0-7
/proc/30799/task/30809/stat : 30809 (plingeling) R 30797 30799 30420 0 -1 4202560 1213043 1254 0 0 500044 213 0 0 25 0 9 0 513526221 3199766528 749034 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=30799/tid=30810] ppid=30797 vsize=3124772 CPUtime=5002.54 cores=0-7
/proc/30799/task/30810/stat : 30810 (plingeling) R 30797 30799 30420 0 -1 4202560 2054554 1254 0 0 499896 358 0 0 25 0 9 0 513526221 3199766528 749034 33554432000 4194304 4417332 140735037166176 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=30799/tid=30811] ppid=30797 vsize=3124772 CPUtime=5002.3 cores=0-7
/proc/30799/task/30811/stat : 30811 (plingeling) R 30797 30799 30420 0 -1 4202560 909298 1254 0 0 500081 149 0 0 25 0 9 0 513526221 3199766528 749034 33554432000 4194304 4417332 140735037166176 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=30799/tid=30812] ppid=30797 vsize=3124772 CPUtime=5002.5 cores=0-7
/proc/30799/task/30812/stat : 30812 (plingeling) R 30797 30799 30420 0 -1 4202560 1164246 1254 0 0 500045 205 0 0 25 0 9 0 513526222 3199766528 749034 33554432000 4194304 4417332 140735037166176 18446744073709551615 4357164 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=30799/tid=30813] ppid=30797 vsize=3124772 CPUtime=5001.87 cores=0-7
/proc/30799/task/30813/stat : 30813 (plingeling) R 30797 30799 30420 0 -1 4202560 998648 1254 0 0 500024 163 0 0 25 0 9 0 513526222 3199766528 749034 33554432000 4194304 4417332 140735037166176 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=30799/tid=30814] ppid=30797 vsize=3124772 CPUtime=5002.03 cores=0-7
/proc/30799/task/30814/stat : 30814 (plingeling) R 30797 30799 30420 0 -1 4202560 1015840 1254 0 0 500034 169 0 0 25 0 9 0 513526222 3199766528 749034 33554432000 4194304 4417332 140735037166176 18446744073709551615 4364808 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 3124772

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.31 s]
/proc/loadavg: 8.05 8.05 7.98 9/179 30959
/proc/meminfo: memFree=8743628/32951124 swapFree=67111528/67111528
[pid=30799] ppid=30797 vsize=0 CPUtime=40000.4 cores=0-7
/proc/30799/stat : 30799 (plingeling) Z 30797 30799 30420 0 -1 4203548 10127449 1254 0 0 3998276 1762 0 0 18 0 2 0 513525346 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/30799/statm: 0 0 0 0 0 0 0
[pid=30799/tid=30808] ppid=30797 vsize=0 CPUtime=4975.21 cores=0-7
/proc/30799/task/30808/stat : 30808 (plingeling) R 30797 30799 30420 0 -1 4203588 1166921 1254 0 0 497291 230 0 0 25 0 2 0 513526221 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.34
CPU time (s): 40000.4
CPU user time (s): 39982.8
CPU system time (s): 17.6533
CPU usage (%): 798.198
Max. virtual memory (cumulated for all children) (KiB): 3175276

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39982.8
system time used= 17.6533
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10128703
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 499
involuntary context switches= 193304

runsolver used 7.78682 second user time and 19.53 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-28 21:34:09
IDJOB=3310101
IDBENCH=88165
IDSOLVER=1695
FILE ID=node104/3310101-1304019248
RUNJOBID= node104-1304019072-30434
PBS_JOBID= 13170302
Free space on /tmp= 71460 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT-Race-2010-CNF/hardware-verification/velev/2dlx_ca_bp_f_liveness.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310101-1304019248/watcher-3310101-1304019248 -o /tmp/evaluation-result-3310101-1304019248/solver-3310101-1304019248 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3310101-1304019248.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 99cd8de7f06ce8c087a5c7fb299dfb62
RANDOM SEED=440890850

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      11739140 kB
Buffers:       2307940 kB
Cached:       18244452 kB
SwapCached:          0 kB
Active:       11450508 kB
Inactive:      9166408 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      11739140 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           92832 kB
Writeback:           0 kB
AnonPages:       64252 kB
Mapped:          14484 kB
Slab:           528428 kB
PageTables:       4356 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   186268 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71460 MiB
End job on node104 at 2011-04-28 22:57:42