Trace number 3394040

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40000.5 5010.98

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v2400c266431g3.cnf
MD5SUM231f625a25c77518fbce98fe99f807b5
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394040-1306079806/watcher-3394040-1306079806 -o /tmp/evaluation-result-3394040-1306079806/solver-3394040-1306079806 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394040-1306079806.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.21 8.11 8.02 1/491 10160
/proc/meminfo: memFree=14108248/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=9740 CPUtime=0 cores=0-7
/proc/10160/stat : 10160 (plingeling) R 10158 10160 9946 0 -1 4202496 495 1257 0 0 0 0 0 0 18 0 1 0 798211247 9973760 426 33554432000 4194304 4417452 140733419781584 18446744073709551615 251367240655 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/10160/statm: 2435 426 147 55 0 321 0

[startup+0.103128 s]
/proc/loadavg: 8.21 8.11 8.02 1/491 10160
/proc/meminfo: memFree=14108248/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=27796 CPUtime=0.09 cores=0-7
/proc/10160/stat : 10160 (plingeling) R 10158 10160 9946 0 -1 4202496 5026 1257 0 0 9 0 0 0 18 0 1 0 798211247 28463104 4957 33554432000 4194304 4417452 140733419781584 18446744073709551615 4262065 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/10160/statm: 6949 4957 148 55 0 4835 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 27796

[startup+0.201112 s]
/proc/loadavg: 8.21 8.11 8.02 1/491 10160
/proc/meminfo: memFree=14108248/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=44180 CPUtime=0.19 cores=0-7
/proc/10160/stat : 10160 (plingeling) R 10158 10160 9946 0 -1 4202496 9122 1257 0 0 18 1 0 0 19 0 1 0 798211247 45240320 9053 33554432000 4194304 4417452 140733419781584 18446744073709551615 251367165519 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/10160/statm: 11045 9053 148 55 0 8931 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 44180

[startup+0.301097 s]
/proc/loadavg: 8.21 8.11 8.02 1/491 10160
/proc/meminfo: memFree=14108248/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=64660 CPUtime=0.28 cores=0-7
/proc/10160/stat : 10160 (plingeling) R 10158 10160 9946 0 -1 4202496 13799 1257 0 0 27 1 0 0 19 0 1 0 798211247 66211840 13731 33554432000 4194304 4417452 140733419781584 18446744073709551615 251367240797 0 0 4096 17442 0 0 0 17 0 0 0 0
/proc/10160/statm: 16165 13762 148 55 0 14051 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 64660

[startup+0.787403 s]
/proc/loadavg: 8.21 8.11 8.02 1/491 10160
/proc/meminfo: memFree=14108248/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=232456 CPUtime=3.55 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 35896 1257 0 0 349 6 0 0 18 0 9 0 798211247 238034944 19347 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 58114 19347 179 55 0 56000 0
Current children cumulated CPU time (s) 3.55
Current children cumulated vsize (KiB) 232456

[startup+1.50079 s]
/proc/loadavg: 8.21 8.11 8.02 9/500 10174
/proc/meminfo: memFree=14005140/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=255808 CPUtime=9.24 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 45645 1257 0 0 917 7 0 0 18 0 9 0 798211247 261947392 25186 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 63952 25186 180 55 0 61838 0
[pid=10160/tid=10167] ppid=10158 vsize=255808 CPUtime=1.1 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 3478 1257 0 0 110 0 0 0 19 0 9 0 798211285 261947392 25186 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=255808 CPUtime=1.1 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 3392 1257 0 0 110 0 0 0 19 0 9 0 798211285 261947392 25186 33554432000 4194304 4417452 140733419781584 18446744073709551615 4239601 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=255808 CPUtime=1.1 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 3353 1257 0 0 110 0 0 0 19 0 9 0 798211285 261947392 25186 33554432000 4194304 4417452 140733419781584 18446744073709551615 4236280 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=255808 CPUtime=1.11 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 6486 1257 0 0 110 1 0 0 24 0 9 0 798211285 261947392 25186 33554432000 4194304 4417452 140733419781584 18446744073709551615 4236569 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=255808 CPUtime=1.1 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 2368 1257 0 0 110 0 0 0 25 0 9 0 798211285 261947392 25186 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=255808 CPUtime=1.1 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 3232 1257 0 0 110 0 0 0 25 0 9 0 798211285 261947392 25186 33554432000 4194304 4417452 140733419781584 18446744073709551615 4250381 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=255808 CPUtime=1.1 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 3821 1257 0 0 110 0 0 0 25 0 9 0 798211286 261947392 25186 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=255808 CPUtime=1.08 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 2185 1257 0 0 108 0 0 0 19 0 9 0 798211286 261947392 25186 33554432000 4194304 4417452 140733419781584 18446744073709551615 4335984 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 9.24
Current children cumulated vsize (KiB) 255808

[startup+3.1005 s]
/proc/loadavg: 8.21 8.11 8.02 9/500 10174
/proc/meminfo: memFree=14000924/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=280748 CPUtime=22.02 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 53684 1257 0 0 2194 8 0 0 18 0 9 0 798211247 287485952 31421 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 70187 31421 180 55 0 68073 0
[pid=10160/tid=10167] ppid=10158 vsize=280748 CPUtime=2.7 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 3478 1257 0 0 270 0 0 0 23 0 9 0 798211285 287485952 31421 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=280748 CPUtime=2.7 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 4630 1257 0 0 270 0 0 0 22 0 9 0 798211285 287485952 31421 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=280748 CPUtime=2.7 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 3353 1257 0 0 270 0 0 0 22 0 9 0 798211285 287485952 31421 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=280748 CPUtime=2.7 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 9573 1257 0 0 269 1 0 0 25 0 9 0 798211285 287485952 31421 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=280748 CPUtime=2.7 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 3606 1257 0 0 270 0 0 0 25 0 9 0 798211285 287485952 31421 33554432000 4194304 4417452 140733419781584 18446744073709551615 4235968 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=280748 CPUtime=2.7 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 4470 1257 0 0 270 0 0 0 25 0 9 0 798211285 287485952 31421 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249601 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=280748 CPUtime=2.7 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 3821 1257 0 0 270 0 0 0 25 0 9 0 798211286 287485952 31421 33554432000 4194304 4417452 140733419781584 18446744073709551615 4343707 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=280748 CPUtime=2.66 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 3423 1257 0 0 266 0 0 0 22 0 9 0 798211286 287485952 31421 33554432000 4194304 4417452 140733419781584 18446744073709551615 4248936 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 22.02
Current children cumulated vsize (KiB) 280748

[startup+6.30091 s]
/proc/loadavg: 8.19 8.11 8.02 9/500 10174
/proc/meminfo: memFree=13971156/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=295628 CPUtime=47.57 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 64577 1257 0 0 4748 9 0 0 18 0 9 0 798211247 302723072 35153 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 73907 35153 180 55 0 71793 0
[pid=10160/tid=10167] ppid=10158 vsize=295628 CPUtime=5.9 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 3478 1257 0 0 590 0 0 0 25 0 9 0 798211285 302723072 35153 33554432000 4194304 4417452 140733419781584 18446744073709551615 4258389 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=295628 CPUtime=5.9 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 4630 1257 0 0 590 0 0 0 25 0 9 0 798211285 302723072 35153 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=295628 CPUtime=5.9 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 4390 1257 0 0 590 0 0 0 25 0 9 0 798211285 302723072 35153 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=295628 CPUtime=5.91 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 18433 1257 0 0 589 2 0 0 25 0 9 0 798211285 302723072 35153 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364548 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=295628 CPUtime=5.9 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 3606 1257 0 0 590 0 0 0 25 0 9 0 798211285 302723072 35153 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=295628 CPUtime=5.9 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 4470 1257 0 0 590 0 0 0 25 0 9 0 798211285 302723072 35153 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249584 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=295628 CPUtime=5.9 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 4817 1257 0 0 590 0 0 0 25 0 9 0 798211286 302723072 35153 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=295628 CPUtime=5.81 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 3423 1257 0 0 581 0 0 0 25 0 9 0 798211286 302723072 35153 33554432000 4194304 4417452 140733419781584 18446744073709551615 4233447 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 47.57
Current children cumulated vsize (KiB) 295628

[startup+12.7007 s]
/proc/loadavg: 8.18 8.10 8.02 9/500 10174
/proc/meminfo: memFree=13937564/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=331168 CPUtime=98.66 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 86475 1257 0 0 9854 12 0 0 18 0 9 0 798211247 339116032 44038 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 82792 44038 180 55 0 80678 0
[pid=10160/tid=10167] ppid=10158 vsize=331168 CPUtime=12.3 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 5954 1257 0 0 1230 0 0 0 25 0 9 0 798211285 339116032 44038 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=331168 CPUtime=12.3 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 5868 1257 0 0 1230 0 0 0 25 0 9 0 798211285 339116032 44038 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=331168 CPUtime=12.3 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 4390 1257 0 0 1230 0 0 0 25 0 9 0 798211285 339116032 44038 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=331168 CPUtime=12.3 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 32903 1257 0 0 1226 4 0 0 25 0 9 0 798211285 339116032 44038 33554432000 4194304 4417452 140733419781584 18446744073709551615 4250755 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=331168 CPUtime=12.3 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 4844 1257 0 0 1230 0 0 0 25 0 9 0 798211285 339116032 44038 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=331168 CPUtime=12.3 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 5708 1257 0 0 1229 1 0 0 25 0 9 0 798211285 339116032 44038 33554432000 4194304 4417452 140733419781584 18446744073709551615 4336723 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=331168 CPUtime=12.3 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 4817 1257 0 0 1230 0 0 0 25 0 9 0 798211286 339116032 44038 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=331168 CPUtime=12.1 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 4661 1257 0 0 1209 1 0 0 25 0 9 0 798211286 339116032 44038 33554432000 4194304 4417452 140733419781584 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 98.66
Current children cumulated vsize (KiB) 331168

[startup+25.5014 s]
/proc/loadavg: 8.14 8.10 8.02 9/500 10174
/proc/meminfo: memFree=13860772/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=398380 CPUtime=200.83 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 122839 1257 0 0 20066 17 0 0 18 0 9 0 798211247 407941120 61640 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 99595 61640 180 55 0 97481 0
[pid=10160/tid=10167] ppid=10158 vsize=398380 CPUtime=25.1 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 5954 1257 0 0 2510 0 0 0 25 0 9 0 798211285 407941120 61640 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=398380 CPUtime=25.1 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 6381 1257 0 0 2510 0 0 0 25 0 9 0 798211285 407941120 61640 33554432000 4194304 4417452 140733419781584 18446744073709551615 4236845 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=398380 CPUtime=25.1 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 4390 1257 0 0 2510 0 0 0 25 0 9 0 798211285 407941120 61640 33554432000 4194304 4417452 140733419781584 18446744073709551615 4270130 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=398380 CPUtime=25.1 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 64073 1257 0 0 2502 8 0 0 25 0 9 0 798211285 407941120 61640 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=398380 CPUtime=25.09 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 7989 1257 0 0 2508 1 0 0 25 0 9 0 798211285 407941120 61640 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=398380 CPUtime=25.1 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 6732 1257 0 0 2509 1 0 0 25 0 9 0 798211285 407941120 61640 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=398380 CPUtime=25.1 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 4817 1257 0 0 2510 0 0 0 25 0 9 0 798211286 407941120 61640 33554432000 4194304 4417452 140733419781584 18446744073709551615 4236255 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=398380 CPUtime=24.68 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 5173 1257 0 0 2467 1 0 0 25 0 9 0 798211286 407941120 61640 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 200.83
Current children cumulated vsize (KiB) 398380

[startup+51.1007 s]
/proc/loadavg: 8.09 8.09 8.02 9/500 10175
/proc/meminfo: memFree=13691500/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=568928 CPUtime=405.2 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 199254 1257 0 0 40488 32 0 0 18 0 9 0 798211247 582582272 103465 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 142232 103465 180 55 0 140118 0
[pid=10160/tid=10167] ppid=10158 vsize=568928 CPUtime=50.7 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 6939 1257 0 0 5070 0 0 0 25 0 9 0 798211285 582582272 103465 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364675 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=568928 CPUtime=50.7 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 7561 1257 0 0 5069 1 0 0 25 0 9 0 798211285 582582272 103465 33554432000 4194304 4417452 140733419781584 18446744073709551615 4365195 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=568928 CPUtime=50.7 cores=0-7

################
# More data... #
################


[startup+4722.3 s]
/proc/loadavg: 8.02 8.04 8.00 9/500 10320
/proc/meminfo: memFree=9883804/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=4319584 CPUtime=37696.9 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 6776992 1257 0 0 3768508 1186 0 0 18 0 9 0 798211247 4423254016 1054257 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 1079896 1054257 180 55 0 1077782 0
[pid=10160/tid=10167] ppid=10158 vsize=4319584 CPUtime=4661.87 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 543236 1257 0 0 466104 83 0 0 25 0 9 0 798211285 4423254016 1054257 33554432000 4194304 4417452 140733419781584 18446744073709551615 4366316 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=4319584 CPUtime=4722.01 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 857999 1257 0 0 472055 146 0 0 25 0 9 0 798211285 4423254016 1054257 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=4319584 CPUtime=4722.02 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 1018159 1257 0 0 472062 140 0 0 25 0 9 0 798211285 4423254016 1054257 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=4319584 CPUtime=4720.79 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 1987321 1257 0 0 471645 434 0 0 25 0 9 0 798211285 4423254016 1054257 33554432000 4194304 4417452 140733419781584 18446744073709551615 4353694 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=4319584 CPUtime=4721.21 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 590543 1257 0 0 472022 99 0 0 25 0 9 0 798211285 4423254016 1054257 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=4319584 CPUtime=4707.06 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 544995 1257 0 0 470614 92 0 0 25 0 9 0 798211285 4423254016 1054257 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=4319584 CPUtime=4722 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 177975 1257 0 0 472178 22 0 0 25 0 9 0 798211286 4423254016 1054257 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=4319584 CPUtime=4719.58 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 1039434 1257 0 0 471794 164 0 0 25 0 9 0 798211286 4423254016 1054257 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37696.9
Current children cumulated vsize (KiB) 4319584

[startup+4782.3 s]
/proc/loadavg: 8.07 8.05 8.00 9/500 10322
/proc/meminfo: memFree=9702872/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=4500096 CPUtime=38175.9 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 6850769 1257 0 0 3816389 1201 0 0 18 0 9 0 798211247 4608098304 1099385 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 1125024 1099385 180 55 0 1122910 0
[pid=10160/tid=10167] ppid=10158 vsize=4500096 CPUtime=4720.88 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 550727 1257 0 0 472004 84 0 0 25 0 9 0 798211285 4608098304 1099385 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=4500096 CPUtime=4782 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 857999 1257 0 0 478054 146 0 0 25 0 9 0 798211285 4608098304 1099385 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=4500096 CPUtime=4782.01 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 1027151 1257 0 0 478058 143 0 0 25 0 9 0 798211285 4608098304 1099385 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=4500096 CPUtime=4780.76 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 2008817 1257 0 0 477640 436 0 0 25 0 9 0 798211285 4608098304 1099385 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=4500096 CPUtime=4781.19 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 599149 1257 0 0 478018 101 0 0 25 0 9 0 798211285 4608098304 1099385 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=4500096 CPUtime=4767.04 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 569443 1257 0 0 476607 97 0 0 25 0 9 0 798211285 4608098304 1099385 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=4500096 CPUtime=4781.99 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 177975 1257 0 0 478177 22 0 0 25 0 9 0 798211286 4608098304 1099385 33554432000 4194304 4417452 140733419781584 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=4500096 CPUtime=4779.57 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 1042178 1257 0 0 477792 165 0 0 25 0 9 0 798211286 4608098304 1099385 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38175.9
Current children cumulated vsize (KiB) 4500096

[startup+4842.32 s]
/proc/loadavg: 8.08 8.05 8.00 9/500 10324
/proc/meminfo: memFree=9546608/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=4656024 CPUtime=38655 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 6914704 1257 0 0 3864288 1216 0 0 18 0 9 0 798211247 4767768576 1138367 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 1164006 1138367 180 55 0 1161892 0
[pid=10160/tid=10167] ppid=10158 vsize=4656024 CPUtime=4779.9 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 572370 1257 0 0 477902 88 0 0 25 0 9 0 798211285 4767768576 1138367 33554432000 4194304 4417452 140733419781584 18446744073709551615 4344138 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=4656024 CPUtime=4842.02 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 866191 1257 0 0 484053 149 0 0 25 0 9 0 798211285 4767768576 1138367 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=4656024 CPUtime=4842.03 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 1040527 1257 0 0 484056 147 0 0 25 0 9 0 798211285 4767768576 1138367 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=4656024 CPUtime=4840.76 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 2008817 1257 0 0 483640 436 0 0 25 0 9 0 798211285 4767768576 1138367 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364903 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=4656024 CPUtime=4841.21 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 599149 1257 0 0 484020 101 0 0 25 0 9 0 798211285 4767768576 1138367 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=4656024 CPUtime=4827.06 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 577635 1257 0 0 482606 100 0 0 25 0 9 0 798211285 4767768576 1138367 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=4656024 CPUtime=4842.01 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 177975 1257 0 0 484179 22 0 0 25 0 9 0 798211286 4767768576 1138367 33554432000 4194304 4417452 140733419781584 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=4656024 CPUtime=4839.59 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 1054710 1257 0 0 483793 166 0 0 25 0 9 0 798211286 4767768576 1138367 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364616 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38655
Current children cumulated vsize (KiB) 4656024

[startup+4902.3 s]
/proc/loadavg: 8.08 8.05 8.00 9/500 10325
/proc/meminfo: memFree=10250544/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=4004400 CPUtime=39133.9 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 7007605 1257 0 0 3912159 1233 0 0 18 0 9 0 798211247 4100505600 962563 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 1001100 962563 180 55 0 998986 0
[pid=10160/tid=10167] ppid=10158 vsize=4004400 CPUtime=4838.91 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 582051 1257 0 0 483801 90 0 0 25 0 9 0 798211285 4100505600 962563 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=4004400 CPUtime=4902 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 880154 1257 0 0 490048 152 0 0 25 0 9 0 798211285 4100505600 962563 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=4004400 CPUtime=4902.01 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 1067731 1257 0 0 490050 151 0 0 25 0 9 0 798211285 4100505600 962563 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=4004400 CPUtime=4900.73 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 2019921 1257 0 0 489636 437 0 0 25 0 9 0 798211285 4100505600 962563 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=4004400 CPUtime=4901.2 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 605421 1257 0 0 490018 102 0 0 25 0 9 0 798211285 4100505600 962563 33554432000 4194304 4417452 140733419781584 18446744073709551615 4302950 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=4004400 CPUtime=4887.05 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 598248 1257 0 0 488600 105 0 0 25 0 9 0 798211285 4100505600 962563 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=4004400 CPUtime=4901.99 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 177975 1257 0 0 490177 22 0 0 25 0 9 0 798211286 4100505600 962563 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=4004400 CPUtime=4899.57 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 1058774 1257 0 0 489790 167 0 0 25 0 9 0 798211286 4100505600 962563 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39133.9
Current children cumulated vsize (KiB) 4004400

[startup+4962.3 s]
/proc/loadavg: 8.08 8.06 8.00 9/500 10327
/proc/meminfo: memFree=9831904/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=4397728 CPUtime=39612.9 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 7171148 1257 0 0 3960037 1257 0 0 18 0 9 0 798211247 4503273472 1067332 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 1099432 1067332 180 55 0 1097318 0
[pid=10160/tid=10167] ppid=10158 vsize=4397728 CPUtime=4897.92 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 590160 1257 0 0 489701 91 0 0 25 0 9 0 798211285 4503273472 1067332 33554432000 4194304 4417452 140733419781584 18446744073709551615 4263216 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=4397728 CPUtime=4962 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 892283 1257 0 0 496047 153 0 0 25 0 9 0 798211285 4503273472 1067332 33554432000 4194304 4417452 140733419781584 18446744073709551615 4358116 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=4397728 CPUtime=4962.01 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 1081761 1257 0 0 496048 153 0 0 25 0 9 0 798211285 4503273472 1067332 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=4397728 CPUtime=4960.73 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 2043009 1257 0 0 495629 444 0 0 25 0 9 0 798211285 4503273472 1067332 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=4397728 CPUtime=4961.2 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 648554 1257 0 0 496011 109 0 0 25 0 9 0 798211285 4503273472 1067332 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=4397728 CPUtime=4947.05 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 628274 1257 0 0 494597 108 0 0 25 0 9 0 798211285 4503273472 1067332 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=4397728 CPUtime=4962 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 211003 1257 0 0 496174 26 0 0 25 0 9 0 798211286 4503273472 1067332 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=4397728 CPUtime=4959.57 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 1058774 1257 0 0 495790 167 0 0 25 0 9 0 798211286 4503273472 1067332 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39612.9
Current children cumulated vsize (KiB) 4397728



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.8 s]
/proc/loadavg: 8.08 8.06 8.00 9/500 10328
/proc/meminfo: memFree=9590712/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=4600036 CPUtime=40000.2 cores=0-7
/proc/10160/stat : 10160 (plingeling) S 10158 10160 9946 0 -1 4202496 7247738 1257 0 0 3998752 1265 0 0 18 0 9 0 798211247 4710436864 1127537 33554432000 4194304 4417452 140733419781584 18446744073709551615 251379349477 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 1150009 1127537 180 55 0 1147895 0
[pid=10160/tid=10167] ppid=10158 vsize=4600036 CPUtime=4945.64 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4202560 596196 1257 0 0 494472 92 0 0 25 0 9 0 798211285 4710436864 1127537 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=10160/tid=10168] ppid=10158 vsize=4600036 CPUtime=5010.52 cores=0-7
/proc/10160/task/10168/stat : 10168 (plingeling) R 10158 10160 9946 0 -1 4202560 934271 1257 0 0 500894 158 0 0 25 0 9 0 798211285 4710436864 1127537 33554432000 4194304 4417452 140733419781584 18446744073709551615 4250651 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=10160/tid=10169] ppid=10158 vsize=4600036 CPUtime=5010.54 cores=0-7
/proc/10160/task/10169/stat : 10169 (plingeling) R 10158 10160 9946 0 -1 4202560 1091390 1257 0 0 500900 154 0 0 25 0 9 0 798211285 4710436864 1127537 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=10160/tid=10170] ppid=10158 vsize=4600036 CPUtime=5009.22 cores=0-7
/proc/10160/task/10170/stat : 10170 (plingeling) R 10158 10160 9946 0 -1 4202560 2043009 1257 0 0 500478 444 0 0 25 0 9 0 798211285 4710436864 1127537 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=10160/tid=10171] ppid=10158 vsize=4600036 CPUtime=5009.72 cores=0-7
/proc/10160/task/10171/stat : 10171 (plingeling) R 10158 10160 9946 0 -1 4202560 648554 1257 0 0 500863 109 0 0 25 0 9 0 798211285 4710436864 1127537 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=10160/tid=10172] ppid=10158 vsize=4600036 CPUtime=4995.56 cores=0-7
/proc/10160/task/10172/stat : 10172 (plingeling) R 10158 10160 9946 0 -1 4202560 628274 1257 0 0 499448 108 0 0 25 0 9 0 798211285 4710436864 1127537 33554432000 4194304 4417452 140733419781584 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=10160/tid=10173] ppid=10158 vsize=4600036 CPUtime=5010.51 cores=0-7
/proc/10160/task/10173/stat : 10173 (plingeling) R 10158 10160 9946 0 -1 4202560 220027 1257 0 0 501024 27 0 0 25 0 9 0 798211286 4710436864 1127537 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=10160/tid=10174] ppid=10158 vsize=4600036 CPUtime=5008.09 cores=0-7
/proc/10160/task/10174/stat : 10174 (plingeling) R 10158 10160 9946 0 -1 4202560 1068687 1257 0 0 500641 168 0 0 25 0 9 0 798211286 4710436864 1127537 33554432000 4194304 4417452 140733419781584 18446744073709551615 4364885 0 0 4096 17442 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 4600036

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.92 s]
/proc/loadavg: 8.08 8.06 8.00 9/500 10328
/proc/meminfo: memFree=9590712/32950928 swapFree=38710952/67111528
[pid=10160] ppid=10158 vsize=0 CPUtime=40000.4 cores=0-7
/proc/10160/stat : 10160 (plingeling) Z 10158 10160 9946 0 -1 4203548 7247738 1257 0 0 3998764 1275 0 0 18 0 2 0 798211247 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/10160/statm: 0 0 0 0 0 0 0
[pid=10160/tid=10167] ppid=10158 vsize=0 CPUtime=4945.74 cores=0-7
/proc/10160/task/10167/stat : 10167 (plingeling) R 10158 10160 9946 0 -1 4203588 596196 1257 0 0 494472 102 0 0 25 0 2 0 798211285 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.98
CPU time (s): 40000.5
CPU user time (s): 39987.6
CPU system time (s): 12.8131
CPU usage (%): 798.256
Max. virtual memory (cumulated for all children) (KiB): 6014944

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39987.6
system time used= 12.8131
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7248995
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 890
involuntary context switches= 193506

runsolver used 22.9055 second user time and 59.201 second system time

The end

Launcher Data 

Begin job on node113 at 2011-05-22 17:56:46
IDJOB=3394040
IDBENCH=71269
IDSOLVER=1851
FILE ID=node113/3394040-1306079806
RUNJOBID= node113-1306078221-9960
PBS_JOBID= 13387911
Free space on /tmp= 73312 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v2400c266431g3.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394040-1306079806/watcher-3394040-1306079806 -o /tmp/evaluation-result-3394040-1306079806/solver-3394040-1306079806 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394040-1306079806.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 231f625a25c77518fbce98fe99f807b5
RANDOM SEED=1606968202

node113.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      14108404 kB
Buffers:        332400 kB
Cached:        8773684 kB
SwapCached:      93732 kB
Active:        8058584 kB
Inactive:     10444632 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      14108404 kB
SwapTotal:    67111528 kB
SwapFree:     38710952 kB
Dirty:            3544 kB
Writeback:           0 kB
AnonPages:     9315740 kB
Mapped:          24624 kB
Slab:           152084 kB
PageTables:     116368 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 154761672 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73312 MiB
End job on node113 at 2011-05-22 19:20:19