Trace number 3394108

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 40001.1 5011.6

General information on the benchmark

NameCRAFTED/rbsat/crafted/forced/
rbsat-v760c43649gyes5.cnf
MD5SUMe7d4dc25f0d8e558fb091b1e566deab7
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.57976
Satisfiable
(Un)Satisfiability was proved
Number of variables760
Number of clauses43649
Sum of the clauses size87978
Maximum clause length19
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 243609
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3394108-1306090226/watcher-3394108-1306090226 -o /tmp/evaluation-result-3394108-1306090226/solver-3394108-1306090226 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3394108-1306090226.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.93 2.00 1.99 2/520 5257
/proc/meminfo: memFree=8026196/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=9672 CPUtime=0 cores=0-7
/proc/5257/stat : 5257 (plingeling) R 5255 5257 5231 0 -1 4202496 479 1262 0 0 0 0 0 0 25 0 1 0 799253256 9904128 408 33554432000 4194304 4417452 140733471159792 18446744073709551615 4235981 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5257/statm: 2418 408 147 55 0 304 0

[startup+0.0276651 s]
/proc/loadavg: 1.93 2.00 1.99 2/520 5257
/proc/meminfo: memFree=8026196/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=14104 CPUtime=0.02 cores=0-7
/proc/5257/stat : 5257 (plingeling) R 5255 5257 5231 0 -1 4202496 1596 1262 0 0 2 0 0 0 25 0 1 0 799253256 14442496 1525 33554432000 4194304 4417452 140733471159792 18446744073709551615 4259629 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/5257/statm: 3526 1525 148 55 0 1412 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 14104

[startup+0.100642 s]
/proc/loadavg: 1.93 2.00 1.99 2/520 5257
/proc/meminfo: memFree=8026196/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=167464 CPUtime=0.34 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 3516 1262 0 0 34 0 0 0 18 0 9 0 799253256 171483136 3073 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 41866 3073 177 55 0 39752 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 167464

[startup+0.300576 s]
/proc/loadavg: 1.93 2.00 1.99 2/520 5257
/proc/meminfo: memFree=8026196/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=173056 CPUtime=1.84 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 6263 1262 0 0 184 0 0 0 18 0 9 0 799253256 177209344 4464 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 43264 4464 180 55 0 41150 0
Current children cumulated CPU time (s) 1.84
Current children cumulated vsize (KiB) 173056

[startup+0.700505 s]
/proc/loadavg: 1.93 2.00 1.99 2/520 5257
/proc/meminfo: memFree=8026196/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=181572 CPUtime=5.04 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 9591 1262 0 0 503 1 0 0 18 0 9 0 799253256 185929728 6593 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 45393 6593 180 55 0 43279 0
Current children cumulated CPU time (s) 5.04
Current children cumulated vsize (KiB) 181572

[startup+1.50037 s]
/proc/loadavg: 2.49 2.12 2.03 9/529 5271
/proc/meminfo: memFree=7999456/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=185888 CPUtime=11.42 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 14031 1262 0 0 1140 2 0 0 18 0 9 0 799253256 190349312 7702 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 46472 7702 180 55 0 44358 0
[pid=5257/tid=5264] ppid=5255 vsize=185888 CPUtime=1.44 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 647 1262 0 0 144 0 0 0 19 0 9 0 799253261 190349312 7702 33554432000 4194304 4417452 140733471159792 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=185888 CPUtime=1.31 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 483 1262 0 0 131 0 0 0 25 0 9 0 799253261 190349312 7702 33554432000 4194304 4417452 140733471159792 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=185888 CPUtime=1.43 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 1370 1262 0 0 143 0 0 0 20 0 9 0 799253261 190349312 7702 33554432000 4194304 4417452 140733471159792 18446744073709551615 4365004 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=185888 CPUtime=1.43 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 5585 1262 0 0 142 1 0 0 20 0 9 0 799253261 190349312 7702 33554432000 4194304 4417452 140733471159792 18446744073709551615 4357227 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=185888 CPUtime=1.41 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 330 1262 0 0 141 0 0 0 23 0 9 0 799253261 190349312 7702 33554432000 4194304 4417452 140733471159792 18446744073709551615 4239395 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=185888 CPUtime=1.44 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 681 1262 0 0 144 0 0 0 20 0 9 0 799253261 190349312 7702 33554432000 4194304 4417452 140733471159792 18446744073709551615 4250017 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=185888 CPUtime=1.43 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 1602 1262 0 0 143 0 0 0 23 0 9 0 799253261 190349312 7702 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=185888 CPUtime=1.43 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 696 1262 0 0 143 0 0 0 19 0 9 0 799253261 190349312 7702 33554432000 4194304 4417452 140733471159792 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.42
Current children cumulated vsize (KiB) 185888

[startup+3.10108 s]
/proc/loadavg: 2.49 2.12 2.03 9/529 5271
/proc/meminfo: memFree=7990040/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=193116 CPUtime=24.21 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 21240 1262 0 0 2417 4 0 0 18 0 9 0 799253256 197750784 9479 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 48279 9479 180 55 0 46165 0
[pid=5257/tid=5264] ppid=5255 vsize=193116 CPUtime=3.04 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 847 1262 0 0 304 0 0 0 24 0 9 0 799253261 197750784 9479 33554432000 4194304 4417452 140733471159792 18446744073709551615 4249222 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=193116 CPUtime=2.89 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 683 1262 0 0 289 0 0 0 25 0 9 0 799253261 197750784 9479 33554432000 4194304 4417452 140733471159792 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=193116 CPUtime=3.03 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 2531 1262 0 0 303 0 0 0 25 0 9 0 799253261 197750784 9479 33554432000 4194304 4417452 140733471159792 18446744073709551615 4242036 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=193116 CPUtime=3.04 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 9766 1262 0 0 302 2 0 0 25 0 9 0 799253261 197750784 9479 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=193116 CPUtime=3.01 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 731 1262 0 0 301 0 0 0 25 0 9 0 799253261 197750784 9479 33554432000 4194304 4417452 140733471159792 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=193116 CPUtime=3.04 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 881 1262 0 0 304 0 0 0 25 0 9 0 799253261 197750784 9479 33554432000 4194304 4417452 140733471159792 18446744073709551615 4337181 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=193116 CPUtime=3.03 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 2268 1262 0 0 303 0 0 0 25 0 9 0 799253261 197750784 9479 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=193116 CPUtime=3.03 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 896 1262 0 0 303 0 0 0 25 0 9 0 799253261 197750784 9479 33554432000 4194304 4417452 140733471159792 18446744073709551615 4249583 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.21
Current children cumulated vsize (KiB) 193116

[startup+6.30053 s]
/proc/loadavg: 2.49 2.12 2.03 9/529 5271
/proc/meminfo: memFree=7966612/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=210272 CPUtime=49.75 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 44647 1262 0 0 4966 9 0 0 18 0 9 0 799253256 215318528 13768 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 52568 13768 180 55 0 50454 0
[pid=5257/tid=5264] ppid=5255 vsize=210272 CPUtime=6.23 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 1562 1262 0 0 623 0 0 0 25 0 9 0 799253261 215318528 13768 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=210272 CPUtime=6.03 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 2259 1262 0 0 603 0 0 0 25 0 9 0 799253261 215318528 13768 33554432000 4194304 4417452 140733471159792 18446744073709551615 4357714 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=210272 CPUtime=6.23 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 6254 1262 0 0 622 1 0 0 25 0 9 0 799253261 215318528 13768 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=210272 CPUtime=6.23 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 18490 1262 0 0 619 4 0 0 25 0 9 0 799253261 215318528 13768 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=210272 CPUtime=6.21 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 1672 1262 0 0 621 0 0 0 25 0 9 0 799253261 215318528 13768 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=210272 CPUtime=6.23 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 2850 1262 0 0 623 0 0 0 25 0 9 0 799253261 215318528 13768 33554432000 4194304 4417452 140733471159792 18446744073709551615 4236982 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=210272 CPUtime=6.22 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 5803 1262 0 0 622 0 0 0 25 0 9 0 799253261 215318528 13768 33554432000 4194304 4417452 140733471159792 18446744073709551615 4366117 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=210272 CPUtime=6.23 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 3120 1262 0 0 623 0 0 0 25 0 9 0 799253261 215318528 13768 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.75
Current children cumulated vsize (KiB) 210272

[startup+12.7004 s]
/proc/loadavg: 3.34 2.31 2.10 9/529 5272
/proc/meminfo: memFree=7945736/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=237704 CPUtime=100.82 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 95196 1262 0 0 10064 18 0 0 18 0 9 0 799253256 243408896 20626 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 59426 20626 180 55 0 57312 0
[pid=5257/tid=5264] ppid=5255 vsize=237704 CPUtime=12.64 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 7705 1262 0 0 1263 1 0 0 25 0 9 0 799253261 243408896 20626 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=237704 CPUtime=12.31 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 7709 1262 0 0 1230 1 0 0 25 0 9 0 799253261 243408896 20626 33554432000 4194304 4417452 140733471159792 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=237704 CPUtime=12.63 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 10501 1262 0 0 1261 2 0 0 25 0 9 0 799253261 243408896 20626 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=237704 CPUtime=12.64 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 32126 1262 0 0 1257 7 0 0 25 0 9 0 799253261 243408896 20626 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=237704 CPUtime=12.61 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 5463 1262 0 0 1261 0 0 0 25 0 9 0 799253261 243408896 20626 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364805 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=237704 CPUtime=12.63 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 9491 1262 0 0 1262 1 0 0 25 0 9 0 799253261 243408896 20626 33554432000 4194304 4417452 140733471159792 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=237704 CPUtime=12.62 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 9906 1262 0 0 1261 1 0 0 25 0 9 0 799253261 243408896 20626 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=237704 CPUtime=12.63 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 9658 1262 0 0 1262 1 0 0 25 0 9 0 799253261 243408896 20626 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364645 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.82
Current children cumulated vsize (KiB) 237704

[startup+25.5012 s]
/proc/loadavg: 4.06 2.50 2.16 9/529 5272
/proc/meminfo: memFree=7881256/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=302216 CPUtime=203.01 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 187807 1262 0 0 20265 36 0 0 18 0 9 0 799253256 309469184 36754 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 75554 36754 180 55 0 73440 0
[pid=5257/tid=5264] ppid=5255 vsize=302216 CPUtime=25.43 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 16738 1262 0 0 2541 2 0 0 25 0 9 0 799253261 309469184 36754 33554432000 4194304 4417452 140733471159792 18446744073709551615 4353568 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=302216 CPUtime=24.88 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 16166 1262 0 0 2485 3 0 0 25 0 9 0 799253261 309469184 36754 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=302216 CPUtime=25.43 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 23191 1262 0 0 2539 4 0 0 25 0 9 0 799253261 309469184 36754 33554432000 4194304 4417452 140733471159792 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=302216 CPUtime=25.44 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 53119 1262 0 0 2534 10 0 0 25 0 9 0 799253261 309469184 36754 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=302216 CPUtime=25.41 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 12923 1262 0 0 2539 2 0 0 25 0 9 0 799253261 309469184 36754 33554432000 4194304 4417452 140733471159792 18446744073709551615 4357207 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=302216 CPUtime=25.43 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 19799 1262 0 0 2540 3 0 0 25 0 9 0 799253261 309469184 36754 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=302216 CPUtime=25.43 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 21293 1262 0 0 2539 4 0 0 25 0 9 0 799253261 309469184 36754 33554432000 4194304 4417452 140733471159792 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=302216 CPUtime=25.43 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 21941 1262 0 0 2539 4 0 0 25 0 9 0 799253261 309469184 36754 33554432000 4194304 4417452 140733471159792 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.01
Current children cumulated vsize (KiB) 302216

[startup+51.1007 s]
/proc/loadavg: 5.61 3.02 2.34 9/529 5273
/proc/meminfo: memFree=7807492/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=374448 CPUtime=407.35 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 335887 1262 0 0 40672 63 0 0 18 0 9 0 799253256 383434752 54212 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 93612 54212 180 55 0 91498 0
[pid=5257/tid=5264] ppid=5255 vsize=374448 CPUtime=51.04 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 37464 1262 0 0 5098 6 0 0 25 0 9 0 799253261 383434752 54212 33554432000 4194304 4417452 140733471159792 18446744073709551615 4354506 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=374448 CPUtime=50.04 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 27042 1262 0 0 4999 5 0 0 25 0 9 0 799253261 383434752 54212 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=374448 CPUtime=51.02 cores=0-7

################
# More data... #
################


[startup+4722.32 s]
/proc/loadavg: 8.07 8.06 8.00 9/529 5418
/proc/meminfo: memFree=3715340/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=4457764 CPUtime=37693.3 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 6582349 1262 0 0 3767974 1356 0 0 18 0 9 0 799253256 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 1114441 1075672 180 55 0 1112327 0
[pid=5257/tid=5264] ppid=5255 vsize=4457764 CPUtime=4722.22 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 874390 1262 0 0 472065 157 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=4457764 CPUtime=4638.52 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 817778 1262 0 0 463696 156 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=4457764 CPUtime=4722.22 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 784153 1262 0 0 472053 169 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=4457764 CPUtime=4722.36 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 917622 1262 0 0 472034 202 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=4457764 CPUtime=4721.01 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 736555 1262 0 0 471938 163 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364829 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=4457764 CPUtime=4722.29 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 800556 1262 0 0 472068 161 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=4457764 CPUtime=4722.2 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 754813 1262 0 0 472049 171 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=4457764 CPUtime=4722.36 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 893845 1262 0 0 472063 173 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37693.3
Current children cumulated vsize (KiB) 4457764

[startup+4782.3 s]
/proc/loadavg: 8.08 8.06 8.00 9/529 5420
/proc/meminfo: memFree=3715220/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=4457764 CPUtime=38172.1 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 6582349 1262 0 0 3815850 1356 0 0 18 0 9 0 799253256 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 1114441 1075672 180 55 0 1112327 0
[pid=5257/tid=5264] ppid=5255 vsize=4457764 CPUtime=4782.21 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 874390 1262 0 0 478064 157 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=4457764 CPUtime=4697.42 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 817778 1262 0 0 469586 156 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=4457764 CPUtime=4782.2 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 784153 1262 0 0 478051 169 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=4457764 CPUtime=4782.35 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 917622 1262 0 0 478033 202 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=4457764 CPUtime=4780.98 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 736555 1262 0 0 477935 163 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364768 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=4457764 CPUtime=4782.27 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 800556 1262 0 0 478066 161 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364972 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=4457764 CPUtime=4782.18 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 754813 1262 0 0 478047 171 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=4457764 CPUtime=4782.34 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 893845 1262 0 0 478061 173 0 0 25 0 9 0 799253261 4564750336 1075672 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38172.1
Current children cumulated vsize (KiB) 4457764

[startup+4842.3 s]
/proc/loadavg: 8.08 8.06 8.00 9/529 5422
/proc/meminfo: memFree=3904576/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=4269104 CPUtime=38651 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 6682530 1262 0 0 3863725 1371 0 0 18 0 9 0 799253256 4371562496 1028507 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 1067276 1028507 180 55 0 1065162 0
[pid=5257/tid=5264] ppid=5255 vsize=4269104 CPUtime=4842.21 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 879376 1262 0 0 484063 158 0 0 25 0 9 0 799253261 4371562496 1028507 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=4269104 CPUtime=4756.32 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 817778 1262 0 0 475476 156 0 0 25 0 9 0 799253261 4371562496 1028507 33554432000 4194304 4417452 140733471159792 18446744073709551615 4366063 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=4269104 CPUtime=4842.21 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 819510 1262 0 0 484047 174 0 0 25 0 9 0 799253261 4371562496 1028507 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=4269104 CPUtime=4842.34 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 934007 1262 0 0 484029 205 0 0 25 0 9 0 799253261 4371562496 1028507 33554432000 4194304 4417452 140733471159792 18446744073709551615 4366400 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=4269104 CPUtime=4840.97 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 736555 1262 0 0 483934 163 0 0 25 0 9 0 799253261 4371562496 1028507 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=4269104 CPUtime=4842.27 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 844009 1262 0 0 484059 168 0 0 25 0 9 0 799253261 4371562496 1028507 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=4269104 CPUtime=4842.18 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 754813 1262 0 0 484047 171 0 0 25 0 9 0 799253261 4371562496 1028507 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=4269104 CPUtime=4842.34 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 893845 1262 0 0 484061 173 0 0 25 0 9 0 799253261 4371562496 1028507 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38651
Current children cumulated vsize (KiB) 4269104

[startup+4902.3 s]
/proc/loadavg: 8.08 8.06 8.00 9/529 5423
/proc/meminfo: memFree=3800176/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=4373296 CPUtime=39129.9 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 6708578 1262 0 0 3911611 1377 0 0 18 0 9 0 799253256 4478255104 1054555 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 1093324 1054555 180 55 0 1091210 0
[pid=5257/tid=5264] ppid=5255 vsize=4373296 CPUtime=4902.21 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 879376 1262 0 0 490063 158 0 0 25 0 9 0 799253261 4478255104 1054555 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=4373296 CPUtime=4815.24 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 817778 1262 0 0 481368 156 0 0 25 0 9 0 799253261 4478255104 1054555 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=4373296 CPUtime=4902.21 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 819510 1262 0 0 490047 174 0 0 25 0 9 0 799253261 4478255104 1054555 33554432000 4194304 4417452 140733471159792 18446744073709551615 4343771 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=4373296 CPUtime=4902.34 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 960055 1262 0 0 490025 209 0 0 25 0 9 0 799253261 4478255104 1054555 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=4373296 CPUtime=4900.94 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 736555 1262 0 0 489931 163 0 0 25 0 9 0 799253261 4478255104 1054555 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=4373296 CPUtime=4902.27 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 844009 1262 0 0 490059 168 0 0 25 0 9 0 799253261 4478255104 1054555 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=4373296 CPUtime=4902.19 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 754813 1262 0 0 490047 172 0 0 25 0 9 0 799253261 4478255104 1054555 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=4373296 CPUtime=4902.34 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 893845 1262 0 0 490061 173 0 0 25 0 9 0 799253261 4478255104 1054555 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39129.9
Current children cumulated vsize (KiB) 4373296

[startup+4962.3 s]
/proc/loadavg: 8.07 8.06 8.00 9/529 5425
/proc/meminfo: memFree=3711532/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=4461904 CPUtime=39608.8 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 6769663 1262 0 0 3959494 1383 0 0 18 0 9 0 799253256 4568989696 1076675 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 1115476 1076675 180 55 0 1113362 0
[pid=5257/tid=5264] ppid=5255 vsize=4461904 CPUtime=4962.21 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 879376 1262 0 0 496063 158 0 0 25 0 9 0 799253261 4568989696 1076675 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=4461904 CPUtime=4874.15 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 817778 1262 0 0 487259 156 0 0 25 0 9 0 799253261 4568989696 1076675 33554432000 4194304 4417452 140733471159792 18446744073709551615 4344176 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=4461904 CPUtime=4962.21 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 819510 1262 0 0 496047 174 0 0 25 0 9 0 799253261 4568989696 1076675 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=4461904 CPUtime=4962.34 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 960055 1262 0 0 496025 209 0 0 25 0 9 0 799253261 4568989696 1076675 33554432000 4194304 4417452 140733471159792 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=4461904 CPUtime=4960.93 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 736555 1262 0 0 495930 163 0 0 25 0 9 0 799253261 4568989696 1076675 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=4461904 CPUtime=4962.27 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 844009 1262 0 0 496059 168 0 0 25 0 9 0 799253261 4568989696 1076675 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=4461904 CPUtime=4962.19 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 754813 1262 0 0 496047 172 0 0 25 0 9 0 799253261 4568989696 1076675 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=4461904 CPUtime=4962.35 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 954930 1262 0 0 496055 180 0 0 25 0 9 0 799253261 4568989696 1076675 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39608.8
Current children cumulated vsize (KiB) 4461904



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.4 s]
/proc/loadavg: 8.08 8.06 8.00 9/529 5426
/proc/meminfo: memFree=3666404/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=4507288 CPUtime=40000.8 cores=0-7
/proc/5257/stat : 5257 (plingeling) S 5255 5257 5231 0 -1 4202496 6781009 1262 0 0 3998691 1384 0 0 18 0 9 0 799253256 4615462912 1088021 33554432000 4194304 4417452 140733471159792 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 1126822 1088021 180 55 0 1124708 0
[pid=5257/tid=5264] ppid=5255 vsize=4507288 CPUtime=5011.34 cores=0-7
/proc/5257/task/5264/stat : 5264 (plingeling) R 5255 5257 5231 0 -1 4202560 890722 1262 0 0 500975 159 0 0 25 0 9 0 799253261 4615462912 1088021 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=4507288 CPUtime=4922.37 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4202560 817778 1262 0 0 492081 156 0 0 25 0 9 0 799253261 4615462912 1088021 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=5257/tid=5266] ppid=5255 vsize=4507288 CPUtime=5011.33 cores=0-7
/proc/5257/task/5266/stat : 5266 (plingeling) R 5255 5257 5231 0 -1 4202560 819510 1262 0 0 500959 174 0 0 25 0 9 0 799253261 4615462912 1088021 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=5257/tid=5267] ppid=5255 vsize=4507288 CPUtime=5011.46 cores=0-7
/proc/5257/task/5267/stat : 5267 (plingeling) R 5255 5257 5231 0 -1 4202560 960055 1262 0 0 500937 209 0 0 25 0 9 0 799253261 4615462912 1088021 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=5257/tid=5268] ppid=5255 vsize=4507288 CPUtime=5010.04 cores=0-7
/proc/5257/task/5268/stat : 5268 (plingeling) R 5255 5257 5231 0 -1 4202560 736555 1262 0 0 500841 163 0 0 25 0 9 0 799253261 4615462912 1088021 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=5257/tid=5269] ppid=5255 vsize=4507288 CPUtime=5011.39 cores=0-7
/proc/5257/task/5269/stat : 5269 (plingeling) R 5255 5257 5231 0 -1 4202560 844009 1262 0 0 500971 168 0 0 25 0 9 0 799253261 4615462912 1088021 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=5257/tid=5270] ppid=5255 vsize=4507288 CPUtime=5011.31 cores=0-7
/proc/5257/task/5270/stat : 5270 (plingeling) R 5255 5257 5231 0 -1 4202560 754813 1262 0 0 500959 172 0 0 25 0 9 0 799253261 4615462912 1088021 33554432000 4194304 4417452 140733471159792 18446744073709551615 4354497 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=5257/tid=5271] ppid=5255 vsize=4507288 CPUtime=5011.47 cores=0-7
/proc/5257/task/5271/stat : 5271 (plingeling) R 5255 5257 5231 0 -1 4202560 954930 1262 0 0 500967 180 0 0 25 0 9 0 799253261 4615462912 1088021 33554432000 4194304 4417452 140733471159792 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 4507288

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.53 s]
/proc/loadavg: 8.08 8.06 8.00 2/523 5427
/proc/meminfo: memFree=6406604/32951124 swapFree=65586216/67111528
[pid=5257] ppid=5255 vsize=0 CPUtime=40001 cores=0-7
/proc/5257/stat : 5257 (plingeling) Z 5255 5257 5231 0 -1 4203548 6781009 1262 0 0 3998703 1395 0 0 18 0 2 0 799253256 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 4 0 0 0
/proc/5257/statm: 0 0 0 0 0 0 0
[pid=5257/tid=5265] ppid=5255 vsize=0 CPUtime=4922.5 cores=0-7
/proc/5257/task/5265/stat : 5265 (plingeling) R 5255 5257 5231 0 -1 4203588 817778 1262 0 0 492082 168 0 0 25 0 2 0 799253261 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.6
CPU time (s): 40001.1
CPU user time (s): 39987
CPU system time (s): 14.0179
CPU usage (%): 798.17
Max. virtual memory (cumulated for all children) (KiB): 5241632

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39987
system time used= 14.0179
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6782271
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 373
involuntary context switches= 193079

runsolver used 24.7232 second user time and 63.5753 second system time

The end

Launcher Data 

Begin job on node119 at 2011-05-22 20:50:26
IDJOB=3394108
IDBENCH=71526
IDSOLVER=1851
FILE ID=node119/3394108-1306090226
RUNJOBID= node119-1306090226-5245
PBS_JOBID= 13387929
Free space on /tmp= 73132 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/forced/rbsat-v760c43649gyes5.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3394108-1306090226/watcher-3394108-1306090226 -o /tmp/evaluation-result-3394108-1306090226/solver-3394108-1306090226 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3394108-1306090226.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e7d4dc25f0d8e558fb091b1e566deab7
RANDOM SEED=2035533788

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:       8026228 kB
Buffers:        346608 kB
Cached:        8030364 kB
SwapCached:       4756 kB
Active:       19725536 kB
Inactive:      4833228 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:       8026228 kB
SwapTotal:    67111528 kB
SwapFree:     65586216 kB
Dirty:            1056 kB
Writeback:           0 kB
AnonPages:    16179956 kB
Mapped:          40944 kB
Slab:           216032 kB
PageTables:      79460 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 163849552 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73132 MiB
End job on node119 at 2011-05-22 22:13:59