Trace number 3309369

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 40000.6 5005.08

General information on the benchmark

NameAPPLICATIONS/
bitverif/maxxor/maxxor128.cnf
MD5SUM065c126f0d55807310a398728b44423f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark37756.2
Satisfiable
(Un)Satisfiability was proved
Number of variables200440
Number of clauses599015
Sum of the clauses size1397699
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2399342
Number of clauses of size 3199671
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309369-1304002424/watcher-3309369-1304002424 -o /tmp/evaluation-result-3309369-1304002424/solver-3309369-1304002424 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309369-1304002424.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.13 8.07 8.01 1/170 25240
/proc/meminfo: memFree=13472320/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=11480 CPUtime=0 cores=0-7
/proc/25240/stat : 25240 (plingeling) R 25238 25240 24839 0 -1 4202496 951 1252 0 0 0 0 0 0 22 0 1 0 511843157 11755520 880 33554432000 4194304 4417332 140735339802464 18446744073709551615 222921470957 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/25240/statm: 2870 880 146 55 0 756 0

[startup+0.0169711 s]
/proc/loadavg: 8.13 8.07 8.01 1/170 25240
/proc/meminfo: memFree=13472320/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=13868 CPUtime=0.01 cores=0-7
/proc/25240/stat : 25240 (plingeling) R 25238 25240 24839 0 -1 4202496 1561 1252 0 0 1 0 0 0 22 0 1 0 511843157 14200832 1490 33554432000 4194304 4417332 140735339802464 18446744073709551615 4259035 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/25240/statm: 3467 1490 147 55 0 1353 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 13868

[startup+0.100966 s]
/proc/loadavg: 8.13 8.07 8.01 1/170 25240
/proc/meminfo: memFree=13472320/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=29200 CPUtime=0.09 cores=0-7
/proc/25240/stat : 25240 (plingeling) R 25238 25240 24839 0 -1 4202496 5395 1252 0 0 9 0 0 0 22 0 1 0 511843157 29900800 5324 33554432000 4194304 4417332 140735339802464 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/25240/statm: 7300 5324 148 55 0 5186 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29200

[startup+0.300938 s]
/proc/loadavg: 8.13 8.07 8.01 1/170 25240
/proc/meminfo: memFree=13472320/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=81992 CPUtime=0.29 cores=0-7
/proc/25240/stat : 25240 (plingeling) R 25238 25240 24839 0 -1 4202496 18593 1252 0 0 28 1 0 0 23 0 1 0 511843157 83959808 18522 33554432000 4194304 4417332 140735339802464 18446744073709551615 4274405 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/25240/statm: 20498 18522 148 55 0 18384 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 81992

[startup+0.700847 s]
/proc/loadavg: 8.13 8.07 8.01 1/170 25240
/proc/meminfo: memFree=13472320/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=152616 CPUtime=0.69 cores=0-7
/proc/25240/stat : 25240 (plingeling) R 25238 25240 24839 0 -1 4202496 36261 1252 0 0 66 3 0 0 25 0 1 0 511843157 156278784 36178 33554432000 4194304 4417332 140735339802464 18446744073709551615 4231477 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/25240/statm: 38154 36178 148 55 0 36040 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 152616

[startup+1.50064 s]
/proc/loadavg: 7.56 7.96 7.97 2/171 25246
/proc/meminfo: memFree=13253504/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=413396 CPUtime=1.76 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 71506 1252 0 0 169 7 0 0 25 0 9 0 511843157 423317504 64528 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 103349 64528 157 55 0 101235 0
Current children cumulated CPU time (s) 1.76
Current children cumulated vsize (KiB) 413396

[startup+3.10134 s]
/proc/loadavg: 7.56 7.96 7.97 9/179 25254
/proc/meminfo: memFree=13109116/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=511968 CPUtime=14.54 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 149004 1252 0 0 1435 19 0 0 25 0 9 0 511843157 524255232 76468 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 127992 76468 173 55 0 125878 0
[pid=25240/tid=25247] ppid=25238 vsize=511968 CPUtime=1.63 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 11186 1252 0 0 162 1 0 0 20 0 9 0 511843302 524255232 76468 33554432000 4194304 4417332 140735339802464 18446744073709551615 4277545 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=511968 CPUtime=1.63 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 11018 1252 0 0 162 1 0 0 20 0 9 0 511843302 524255232 76468 33554432000 4194304 4417332 140735339802464 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=511968 CPUtime=1.64 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 9412 1252 0 0 163 1 0 0 25 0 9 0 511843302 524255232 76468 33554432000 4194304 4417332 140735339802464 18446744073709551615 4275892 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=511968 CPUtime=1.6 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 4553 1252 0 0 160 0 0 0 25 0 9 0 511843302 524255232 76468 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=511968 CPUtime=1.64 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 9445 1252 0 0 163 1 0 0 20 0 9 0 511843302 524255232 76468 33554432000 4194304 4417332 140735339802464 18446744073709551615 4275748 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=511968 CPUtime=1.64 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 9773 1252 0 0 163 1 0 0 20 0 9 0 511843302 524255232 76468 33554432000 4194304 4417332 140735339802464 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=511968 CPUtime=1.64 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 9836 1252 0 0 162 2 0 0 25 0 9 0 511843302 524255232 76468 33554432000 4194304 4417332 140735339802464 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=511968 CPUtime=1.6 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 12493 1252 0 0 159 1 0 0 25 0 9 0 511843302 524255232 76468 33554432000 4194304 4417332 140735339802464 18446744073709551615 4236598 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 14.54
Current children cumulated vsize (KiB) 511968

[startup+6.30075 s]
/proc/loadavg: 7.59 7.96 7.97 9/179 25254
/proc/meminfo: memFree=13063736/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=519768 CPUtime=40.12 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 222077 1252 0 0 3983 29 0 0 25 0 9 0 511843157 532242432 90217 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 129942 90217 178 55 0 127828 0
[pid=25240/tid=25247] ppid=25238 vsize=519768 CPUtime=4.83 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 28983 1252 0 0 480 3 0 0 25 0 9 0 511843302 532242432 90217 33554432000 4194304 4417332 140735339802464 18446744073709551615 4330853 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=519768 CPUtime=4.83 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 31379 1252 0 0 478 5 0 0 25 0 9 0 511843302 532242432 90217 33554432000 4194304 4417332 140735339802464 18446744073709551615 4254187 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=519768 CPUtime=4.84 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 18183 1252 0 0 482 2 0 0 25 0 9 0 511843302 532242432 90217 33554432000 4194304 4417332 140735339802464 18446744073709551615 4284484 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=519768 CPUtime=4.78 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 4555 1252 0 0 478 0 0 0 25 0 9 0 511843302 532242432 90217 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=519768 CPUtime=4.84 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 14129 1252 0 0 482 2 0 0 25 0 9 0 511843302 532242432 90217 33554432000 4194304 4417332 140735339802464 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=519768 CPUtime=4.84 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 17886 1252 0 0 482 2 0 0 25 0 9 0 511843302 532242432 90217 33554432000 4194304 4417332 140735339802464 18446744073709551615 4330435 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=519768 CPUtime=4.83 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 20844 1252 0 0 480 3 0 0 25 0 9 0 511843302 532242432 90217 33554432000 4194304 4417332 140735339802464 18446744073709551615 4286859 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=519768 CPUtime=4.81 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 14830 1252 0 0 479 2 0 0 25 0 9 0 511843302 532242432 90217 33554432000 4194304 4417332 140735339802464 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40.12
Current children cumulated vsize (KiB) 519768

[startup+12.7006 s]
/proc/loadavg: 7.63 7.96 7.97 9/179 25254
/proc/meminfo: memFree=12979172/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=627748 CPUtime=91.28 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 256360 1252 0 0 9092 36 0 0 25 0 9 0 511843157 642813952 123240 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 156937 123240 180 55 0 154823 0
[pid=25240/tid=25247] ppid=25238 vsize=627748 CPUtime=11.23 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 35133 1252 0 0 1119 4 0 0 25 0 9 0 511843302 642813952 123240 33554432000 4194304 4417332 140735339802464 18446744073709551615 4252374 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=627748 CPUtime=11.23 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 38555 1252 0 0 1117 6 0 0 25 0 9 0 511843302 642813952 123240 33554432000 4194304 4417332 140735339802464 18446744073709551615 4272992 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=627748 CPUtime=11.24 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 19665 1252 0 0 1122 2 0 0 25 0 9 0 511843302 642813952 123240 33554432000 4194304 4417332 140735339802464 18446744073709551615 4236672 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=627748 CPUtime=11.15 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 4555 1252 0 0 1115 0 0 0 25 0 9 0 511843302 642813952 123240 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=627748 CPUtime=11.23 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 21304 1252 0 0 1120 3 0 0 25 0 9 0 511843302 642813952 123240 33554432000 4194304 4417332 140735339802464 18446744073709551615 4252083 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=627748 CPUtime=11.23 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 24036 1252 0 0 1120 3 0 0 25 0 9 0 511843302 642813952 123240 33554432000 4194304 4417332 140735339802464 18446744073709551615 4252495 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=627748 CPUtime=11.23 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 20844 1252 0 0 1120 3 0 0 25 0 9 0 511843302 642813952 123240 33554432000 4194304 4417332 140735339802464 18446744073709551615 4365883 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=627748 CPUtime=11.2 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 20980 1252 0 0 1118 2 0 0 25 0 9 0 511843302 642813952 123240 33554432000 4194304 4417332 140735339802464 18446744073709551615 4252408 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 91.28
Current children cumulated vsize (KiB) 627748

[startup+25.5012 s]
/proc/loadavg: 7.68 7.96 7.97 9/179 25255
/proc/meminfo: memFree=12980492/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=627164 CPUtime=193.62 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 256909 1252 0 0 19326 36 0 0 25 0 9 0 511843157 642215936 123094 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 156791 123094 180 55 0 154677 0
[pid=25240/tid=25247] ppid=25238 vsize=627164 CPUtime=24.04 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 35133 1252 0 0 2400 4 0 0 25 0 9 0 511843302 642215936 123094 33554432000 4194304 4417332 140735339802464 18446744073709551615 4264814 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=627164 CPUtime=24.03 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 38555 1252 0 0 2397 6 0 0 25 0 9 0 511843302 642215936 123094 33554432000 4194304 4417332 140735339802464 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=627164 CPUtime=24.04 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 19665 1252 0 0 2402 2 0 0 25 0 9 0 511843302 642215936 123094 33554432000 4194304 4417332 140735339802464 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=627164 CPUtime=23.88 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 4555 1252 0 0 2388 0 0 0 25 0 9 0 511843302 642215936 123094 33554432000 4194304 4417332 140735339802464 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=627164 CPUtime=24.03 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 21304 1252 0 0 2400 3 0 0 25 0 9 0 511843302 642215936 123094 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=627164 CPUtime=24.03 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 24036 1252 0 0 2400 3 0 0 25 0 9 0 511843302 642215936 123094 33554432000 4194304 4417332 140735339802464 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=627164 CPUtime=24.04 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 21393 1252 0 0 2401 3 0 0 25 0 9 0 511843302 642215936 123094 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364531 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=627164 CPUtime=24 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 20980 1252 0 0 2398 2 0 0 25 0 9 0 511843302 642215936 123094 33554432000 4194304 4417332 140735339802464 18446744073709551615 4250977 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 193.62
Current children cumulated vsize (KiB) 627164

[startup+51.1006 s]
/proc/loadavg: 7.81 7.96 7.97 9/179 25255
/proc/meminfo: memFree=12970132/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=637556 CPUtime=398.29 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 262590 1252 0 0 39792 37 0 0 25 0 9 0 511843157 652857344 125693 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 159389 125693 181 55 0 157275 0
[pid=25240/tid=25247] ppid=25238 vsize=637556 CPUtime=49.64 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 35185 1252 0 0 4960 4 0 0 25 0 9 0 511843302 652857344 125693 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364487 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=637556 CPUtime=49.63 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 38611 1252 0 0 4957 6 0 0 25 0 9 0 511843302 652857344 125693 33554432000 4194304 4417332 140735339802464 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=637556 CPUtime=49.64 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 20407 1252 0 0 4962 2 0 0 25 0 9 0 511843302 652857344 125693 33554432000 4194304 4417332 140735339802464 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=637556 CPUtime=49.35 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 4555 1252 0 0 4935 0 0 0 25 0 9 0 511843302 652857344 125693 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=637556 CPUtime=49.64 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 23898 1252 0 0 4960 4 0 0 25 0 9 0 511843302 652857344 125693 33554432000 4194304 4417332 140735339802464 18446744073709551615 4365900 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=637556 CPUtime=49.63 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 24092 1252 0 0 4960 3 0 0 25 0 9 0 511843302 652857344 125693 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=637556 CPUtime=49.63 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 21530 1252 0 0 4960 3 0 0 25 0 9 0 511843302 652857344 125693 33554432000 4194304 4417332 140735339802464 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=637556 CPUtime=49.61 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 23024 1252 0 0 4958 3 0 0 25 0 9 0 511843302 652857344 125693 33554432000 4194304 4417332 140735339802464 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 398.29
Current children cumulated vsize (KiB) 637556

[startup+102.306 s]
/proc/loadavg: 7.91 7.97 7.97 9/179 25257

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.00 8.02 8.00 9/179 25404
/proc/meminfo: memFree=9994308/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=3624988 CPUtime=37741.1 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 5215248 1252 0 0 3773093 1016 0 0 25 0 9 0 511843157 3711987712 868000 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 906247 868000 181 55 0 904133 0
[pid=25240/tid=25247] ppid=25238 vsize=3624988 CPUtime=4720.92 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 243790 1252 0 0 472059 33 0 0 25 0 9 0 511843302 3711987712 868000 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=3624988 CPUtime=4720.46 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 228463 1252 0 0 472006 40 0 0 25 0 9 0 511843302 3711987712 868000 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=3624988 CPUtime=4720.95 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 518704 1252 0 0 472007 88 0 0 25 0 9 0 511843302 3711987712 868000 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=3624988 CPUtime=4719.58 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 2264289 1252 0 0 471476 482 0 0 25 0 9 0 511843302 3711987712 868000 33554432000 4194304 4417332 140735339802464 18446744073709551615 4320821 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=3624988 CPUtime=4694.82 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 115107 1252 0 0 469463 19 0 0 25 0 9 0 511843302 3711987712 868000 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=3624988 CPUtime=4720.97 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 1136277 1252 0 0 471868 229 0 0 25 0 9 0 511843302 3711987712 868000 33554432000 4194304 4417332 140735339802464 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=3624988 CPUtime=4720.94 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 175090 1252 0 0 472056 38 0 0 25 0 9 0 511843302 3711987712 868000 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=3624988 CPUtime=4720.94 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 462240 1252 0 0 472017 77 0 0 25 0 9 0 511843302 3711987712 868000 33554432000 4194304 4417332 140735339802464 18446744073709551615 4255595 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37741.1
Current children cumulated vsize (KiB) 3624988

[startup+4782.3 s]
/proc/loadavg: 8.00 8.02 8.00 9/179 25406
/proc/meminfo: memFree=9554208/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=4064444 CPUtime=38220.7 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 5335625 1252 0 0 3821034 1037 0 0 25 0 9 0 511843157 4161990656 977833 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 1016111 977833 181 55 0 1013997 0
[pid=25240/tid=25247] ppid=25238 vsize=4064444 CPUtime=4780.91 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 250847 1252 0 0 478058 33 0 0 25 0 9 0 511843302 4161990656 977833 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=4064444 CPUtime=4780.45 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 238945 1252 0 0 478003 42 0 0 25 0 9 0 511843302 4161990656 977833 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=4064444 CPUtime=4780.95 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 556009 1252 0 0 478003 92 0 0 25 0 9 0 511843302 4161990656 977833 33554432000 4194304 4417332 140735339802464 18446744073709551615 4352535 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=4064444 CPUtime=4779.57 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 2292937 1252 0 0 477466 491 0 0 25 0 9 0 511843302 4161990656 977833 33554432000 4194304 4417332 140735339802464 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=4064444 CPUtime=4754.49 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 115107 1252 0 0 475430 19 0 0 25 0 9 0 511843302 4161990656 977833 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=4064444 CPUtime=4780.97 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 1136277 1252 0 0 477868 229 0 0 25 0 9 0 511843302 4161990656 977833 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=4064444 CPUtime=4780.93 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 175090 1252 0 0 478055 38 0 0 25 0 9 0 511843302 4161990656 977833 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=4064444 CPUtime=4780.92 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 499125 1252 0 0 478010 82 0 0 25 0 9 0 511843302 4161990656 977833 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38220.7
Current children cumulated vsize (KiB) 4064444

[startup+4842.3 s]
/proc/loadavg: 8.00 8.01 8.00 9/179 25407
/proc/meminfo: memFree=10346064/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=3274520 CPUtime=38700.4 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 5387998 1252 0 0 3868990 1049 0 0 25 0 9 0 511843157 3353108480 780352 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 818630 780352 181 55 0 816516 0
[pid=25240/tid=25247] ppid=25238 vsize=3274520 CPUtime=4840.91 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 250847 1252 0 0 484058 33 0 0 25 0 9 0 511843302 3353108480 780352 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=3274520 CPUtime=4840.45 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 238945 1252 0 0 484003 42 0 0 25 0 9 0 511843302 3353108480 780352 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=3274520 CPUtime=4840.95 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 579272 1252 0 0 484000 95 0 0 25 0 9 0 511843302 3353108480 780352 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=3274520 CPUtime=4839.58 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 2309322 1252 0 0 483465 493 0 0 25 0 9 0 511843302 3353108480 780352 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364568 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=3274520 CPUtime=4814.16 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 115107 1252 0 0 481397 19 0 0 25 0 9 0 511843302 3353108480 780352 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=3274520 CPUtime=4840.97 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 1140810 1252 0 0 483863 234 0 0 25 0 9 0 511843302 3353108480 780352 33554432000 4194304 4417332 140735339802464 18446744073709551615 4353957 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=3274520 CPUtime=4840.93 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 183282 1252 0 0 484053 40 0 0 25 0 9 0 511843302 3353108480 780352 33554432000 4194304 4417332 140735339802464 18446744073709551615 4346401 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=3274520 CPUtime=4840.92 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 499125 1252 0 0 484010 82 0 0 25 0 9 0 511843302 3353108480 780352 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38700.4
Current children cumulated vsize (KiB) 3274520

[startup+4902.3 s]
/proc/loadavg: 8.06 8.02 8.00 9/179 25409
/proc/meminfo: memFree=10298560/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=3321856 CPUtime=39180.1 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 5416233 1252 0 0 3916951 1057 0 0 25 0 9 0 511843157 3401580544 792202 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 830464 792202 181 55 0 828350 0
[pid=25240/tid=25247] ppid=25238 vsize=3321856 CPUtime=4900.91 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 250847 1252 0 0 490058 33 0 0 25 0 9 0 511843302 3401580544 792202 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=3321856 CPUtime=4900.46 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 238945 1252 0 0 490003 43 0 0 25 0 9 0 511843302 3401580544 792202 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=3321856 CPUtime=4900.96 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 601220 1252 0 0 489994 102 0 0 25 0 9 0 511843302 3401580544 792202 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=3321856 CPUtime=4899.58 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 2309322 1252 0 0 489465 493 0 0 25 0 9 0 511843302 3401580544 792202 33554432000 4194304 4417332 140735339802464 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=3321856 CPUtime=4873.84 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 115123 1252 0 0 487365 19 0 0 25 0 9 0 511843302 3401580544 792202 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=3321856 CPUtime=4900.97 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 1147081 1252 0 0 489862 235 0 0 25 0 9 0 511843302 3401580544 792202 33554432000 4194304 4417332 140735339802464 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=3321856 CPUtime=4900.93 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 183282 1252 0 0 490053 40 0 0 25 0 9 0 511843302 3401580544 792202 33554432000 4194304 4417332 140735339802464 18446744073709551615 4365846 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=3321856 CPUtime=4900.93 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 499125 1252 0 0 490011 82 0 0 25 0 9 0 511843302 3401580544 792202 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39180.1
Current children cumulated vsize (KiB) 3321856

[startup+4962.3 s]
/proc/loadavg: 8.02 8.02 8.00 9/179 25410
/proc/meminfo: memFree=9859092/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=3760332 CPUtime=39659.8 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 5567294 1252 0 0 3964888 1087 0 0 25 0 9 0 511843157 3850579968 901836 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 940083 901836 181 55 0 937969 0
[pid=25240/tid=25247] ppid=25238 vsize=3760332 CPUtime=4960.91 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 250885 1252 0 0 496058 33 0 0 25 0 9 0 511843302 3850579968 901836 33554432000 4194304 4417332 140735339802464 18446744073709551615 4365018 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=3760332 CPUtime=4960.45 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 238953 1252 0 0 496002 43 0 0 25 0 9 0 511843302 3850579968 901836 33554432000 4194304 4417332 140735339802464 18446744073709551615 4235632 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=3760332 CPUtime=4960.96 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 699537 1252 0 0 495974 122 0 0 25 0 9 0 511843302 3850579968 901836 33554432000 4194304 4417332 140735339802464 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=3760332 CPUtime=4959.57 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 2331742 1252 0 0 495459 498 0 0 25 0 9 0 511843302 3850579968 901836 33554432000 4194304 4417332 140735339802464 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=3760332 CPUtime=4933.51 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 115123 1252 0 0 493332 19 0 0 25 0 9 0 511843302 3850579968 901836 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=3760332 CPUtime=4960.98 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 1177352 1252 0 0 495858 240 0 0 25 0 9 0 511843302 3850579968 901836 33554432000 4194304 4417332 140735339802464 18446744073709551615 4237290 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=3760332 CPUtime=4960.93 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 183289 1252 0 0 496053 40 0 0 25 0 9 0 511843302 3850579968 901836 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=3760332 CPUtime=4960.93 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 499125 1252 0 0 496011 82 0 0 25 0 9 0 511843302 3850579968 901836 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39659.8
Current children cumulated vsize (KiB) 3760332



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5004.9 s]
/proc/loadavg: 8.01 8.01 8.00 9/179 25411
/proc/meminfo: memFree=9601920/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=4017124 CPUtime=40000.4 cores=0-7
/proc/25240/stat : 25240 (plingeling) S 25238 25240 24839 0 -1 4202496 5631585 1252 0 0 3998939 1101 0 0 25 0 9 0 511843157 4113534976 966034 33554432000 4194304 4417332 140735339802464 18446744073709551615 222933579749 0 0 4096 17442 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 1004281 966034 181 55 0 1002167 0
[pid=25240/tid=25247] ppid=25238 vsize=4017124 CPUtime=5003.53 cores=0-7
/proc/25240/task/25247/stat : 25247 (plingeling) R 25238 25240 24839 0 -1 4202560 250885 1252 0 0 500320 33 0 0 25 0 9 0 511843302 4113534976 966034 33554432000 4194304 4417332 140735339802464 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=25240/tid=25248] ppid=25238 vsize=4017124 CPUtime=5003.06 cores=0-7
/proc/25240/task/25248/stat : 25248 (plingeling) R 25238 25240 24839 0 -1 4202560 238993 1252 0 0 500263 43 0 0 25 0 9 0 511843302 4113534976 966034 33554432000 4194304 4417332 140735339802464 18446744073709551615 4346278 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=25240/tid=25249] ppid=25238 vsize=4017124 CPUtime=5003.57 cores=0-7
/proc/25240/task/25249/stat : 25249 (plingeling) R 25238 25240 24839 0 -1 4202560 699537 1252 0 0 500235 122 0 0 25 0 9 0 511843302 4113534976 966034 33554432000 4194304 4417332 140735339802464 18446744073709551615 4365859 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=25240/tid=25250] ppid=25238 vsize=4017124 CPUtime=5002.19 cores=0-7
/proc/25240/task/25250/stat : 25250 (plingeling) R 25238 25240 24839 0 -1 4202560 2359934 1252 0 0 499713 506 0 0 25 0 9 0 511843302 4113534976 966034 33554432000 4194304 4417332 140735339802464 18446744073709551615 4358652 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=4017124 CPUtime=4975.87 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4202560 115162 1252 0 0 497568 19 0 0 25 0 9 0 511843302 4113534976 966034 33554432000 4194304 4417332 140735339802464 18446744073709551615 18446744073699065863 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=25240/tid=25252] ppid=25238 vsize=4017124 CPUtime=5003.59 cores=0-7
/proc/25240/task/25252/stat : 25252 (plingeling) R 25238 25240 24839 0 -1 4202560 1177352 1252 0 0 500119 240 0 0 25 0 9 0 511843302 4113534976 966034 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=25240/tid=25253] ppid=25238 vsize=4017124 CPUtime=5003.55 cores=0-7
/proc/25240/task/25253/stat : 25253 (plingeling) R 25238 25240 24839 0 -1 4202560 183329 1252 0 0 500315 40 0 0 25 0 9 0 511843302 4113534976 966034 33554432000 4194304 4417332 140735339802464 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=25240/tid=25254] ppid=25238 vsize=4017124 CPUtime=5003.54 cores=0-7
/proc/25240/task/25254/stat : 25254 (plingeling) R 25238 25240 24839 0 -1 4202560 535105 1252 0 0 500266 88 0 0 25 0 9 0 511843302 4113534976 966034 33554432000 4194304 4417332 140735339802464 18446744073709551615 4354236 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 4017124

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5005.02 s]
/proc/loadavg: 8.01 8.01 8.00 9/179 25411
/proc/meminfo: memFree=9601920/32951124 swapFree=67111528/67111528
[pid=25240] ppid=25238 vsize=0 CPUtime=40000.5 cores=0-7
/proc/25240/stat : 25240 (plingeling) Z 25238 25240 24839 0 -1 4203548 5631585 1252 0 0 3998943 1111 0 0 18 0 2 0 511843157 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/25240/statm: 0 0 0 0 0 0 0
[pid=25240/tid=25251] ppid=25238 vsize=0 CPUtime=4975.98 cores=0-7
/proc/25240/task/25251/stat : 25251 (plingeling) R 25238 25240 24839 0 -1 4203588 115162 1252 0 0 497569 29 0 0 25 0 2 0 511843302 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5005.08
CPU time (s): 40000.6
CPU user time (s): 39989.4
CPU system time (s): 11.1783
CPU usage (%): 799.2
Max. virtual memory (cumulated for all children) (KiB): 4309828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39989.4
system time used= 11.1783
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5632837
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 744
involuntary context switches= 193401

runsolver used 7.8838 second user time and 19.3811 second system time

The end

Launcher Data 

Begin job on node109 at 2011-04-28 16:53:44
IDJOB=3309369
IDBENCH=70815
IDSOLVER=1695
FILE ID=node109/3309369-1304002424
RUNJOBID= node109-1303992412-24853
PBS_JOBID= 13168776
Free space on /tmp= 72376 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT09/APPLICATIONS/bitverif/maxxor/maxxor128.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309369-1304002424/watcher-3309369-1304002424 -o /tmp/evaluation-result-3309369-1304002424/solver-3309369-1304002424 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309369-1304002424.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 065c126f0d55807310a398728b44423f
RANDOM SEED=379904969

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13472716 kB
Buffers:       2132016 kB
Cached:       16704212 kB
SwapCached:          0 kB
Active:        9819704 kB
Inactive:      9081004 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13472716 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           10904 kB
Writeback:           0 kB
AnonPages:       64316 kB
Mapped:          14712 kB
Slab:           513204 kB
PageTables:       4668 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188108 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72372 MiB
End job on node109 at 2011-04-28 18:17:11