Trace number 3371154

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.41 1204

General information on the benchmark

NameCRAFTED/rbsat/crafted/
forced/rbsat-v2640c305320gyes10.cnf
MD5SUM98bac4f2d533fe7abb12552567f9e1aa
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2640
Number of clauses305320
Sum of the clauses size613120
Maximum clause length33
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2305240
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 580

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371154-1305420580/watcher-3371154-1305420580 -o /tmp/evaluation-result-3371154-1305420580/solver-3371154-1305420580 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371154-1305420580.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.48 7.92 7.65 6/387 13346
/proc/meminfo: memFree=14831824/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=9600 CPUtime=0 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) R 13344 13346 12655 0 -1 4202496 473 1252 0 0 0 0 0 0 25 0 1 0 732288681 9830400 403 33554432000 4194304 4417452 140734405119936 18446744073709551615 216735178496 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/13346/statm: 2400 403 147 55 0 286 0

[startup+0.0748781 s]
/proc/loadavg: 7.48 7.92 7.65 6/387 13346
/proc/meminfo: memFree=14831824/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=18344 CPUtime=0.06 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) R 13344 13346 12655 0 -1 4202496 2680 1252 0 0 6 0 0 0 25 0 1 0 732288681 18784256 2610 33554432000 4194304 4417452 140734405119936 18446744073709551615 216734797389 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/13346/statm: 4586 2610 148 55 0 2472 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 18344

[startup+0.100865 s]
/proc/loadavg: 7.48 7.92 7.65 6/387 13346
/proc/meminfo: memFree=14831824/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=26536 CPUtime=0.09 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) R 13344 13346 12655 0 -1 4202496 4728 1252 0 0 9 0 0 0 25 0 1 0 732288681 27172864 4658 33554432000 4194304 4417452 140734405119936 18446744073709551615 4231477 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/13346/statm: 6634 4658 148 55 0 4520 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26536

[startup+0.30079 s]
/proc/loadavg: 7.48 7.92 7.65 6/387 13346
/proc/meminfo: memFree=14831824/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=86884 CPUtime=0.56 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 9617 1252 0 0 55 1 0 0 25 0 5 0 732288681 88969216 9500 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 21721 9500 171 55 0 19607 0
Current children cumulated CPU time (s) 0.56
Current children cumulated vsize (KiB) 86884

[startup+0.700719 s]
/proc/loadavg: 7.48 7.92 7.65 6/387 13346
/proc/meminfo: memFree=14831824/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=93236 CPUtime=2.16 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 19353 1252 0 0 214 2 0 0 25 0 5 0 732288681 95473664 11096 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 23309 11096 179 55 0 21195 0
Current children cumulated CPU time (s) 2.16
Current children cumulated vsize (KiB) 93236

[startup+1.50058 s]
/proc/loadavg: 7.48 7.92 7.65 9/392 13356
/proc/meminfo: memFree=14747100/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=111764 CPUtime=5.34 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 28392 1252 0 0 531 3 0 0 25 0 5 0 732288681 114446336 15729 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 27941 15729 180 55 0 25827 0
[pid=13346/tid=13353] ppid=13344 vsize=111764 CPUtime=1.29 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 3279 1252 0 0 129 0 0 0 25 0 5 0 732288701 114446336 15729 33554432000 4194304 4417452 140734405119936 18446744073709551615 4249545 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=111764 CPUtime=1.27 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 3175 1252 0 0 127 0 0 0 25 0 5 0 732288702 114446336 15729 33554432000 4194304 4417452 140734405119936 18446744073709551615 4248913 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=111764 CPUtime=1.29 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 3683 1252 0 0 129 0 0 0 25 0 5 0 732288702 114446336 15729 33554432000 4194304 4417452 140734405119936 18446744073709551615 4235421 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=111764 CPUtime=1.27 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 9419 1252 0 0 126 1 0 0 25 0 5 0 732288702 114446336 15729 33554432000 4194304 4417452 140734405119936 18446744073709551615 4232698 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.34
Current children cumulated vsize (KiB) 111764

[startup+3.1003 s]
/proc/loadavg: 7.48 7.92 7.65 9/392 13356
/proc/meminfo: memFree=14746488/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=119648 CPUtime=11.73 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 40625 1252 0 0 1168 5 0 0 25 0 5 0 732288681 122519552 17700 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 29912 17700 180 55 0 27798 0
[pid=13346/tid=13353] ppid=13344 vsize=119648 CPUtime=2.89 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 4640 1252 0 0 289 0 0 0 25 0 5 0 732288701 122519552 17700 33554432000 4194304 4417452 140734405119936 18446744073709551615 4250017 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=119648 CPUtime=2.87 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 3175 1252 0 0 287 0 0 0 25 0 5 0 732288702 122519552 17700 33554432000 4194304 4417452 140734405119936 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=119648 CPUtime=2.89 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 3683 1252 0 0 289 0 0 0 25 0 5 0 732288702 122519552 17700 33554432000 4194304 4417452 140734405119936 18446744073709551615 4249943 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=119648 CPUtime=2.85 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 20291 1252 0 0 283 2 0 0 25 0 5 0 732288702 122519552 17700 33554432000 4194304 4417452 140734405119936 18446744073709551615 4366105 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.73
Current children cumulated vsize (KiB) 119648

[startup+6.30074 s]
/proc/loadavg: 7.52 7.92 7.65 9/392 13356
/proc/meminfo: memFree=14696860/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=132472 CPUtime=24.48 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 56320 1252 0 0 2441 7 0 0 25 0 5 0 732288681 135651328 20395 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 33118 20395 180 55 0 31004 0
[pid=13346/tid=13353] ppid=13344 vsize=132472 CPUtime=6.09 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 4640 1252 0 0 609 0 0 0 25 0 5 0 732288701 135651328 20395 33554432000 4194304 4417452 140734405119936 18446744073709551615 4249110 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=132472 CPUtime=6.07 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 3175 1252 0 0 607 0 0 0 25 0 5 0 732288702 135651328 20395 33554432000 4194304 4417452 140734405119936 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=132472 CPUtime=6.09 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 3905 1252 0 0 609 0 0 0 25 0 5 0 732288702 135651328 20395 33554432000 4194304 4417452 140734405119936 18446744073709551615 4365075 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=132472 CPUtime=6.02 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 35764 1252 0 0 597 5 0 0 25 0 5 0 732288702 135651328 20395 33554432000 4194304 4417452 140734405119936 18446744073709551615 4251034 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.48
Current children cumulated vsize (KiB) 132472

[startup+12.7006 s]
/proc/loadavg: 7.56 7.93 7.65 9/392 13357
/proc/meminfo: memFree=14683312/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=165424 CPUtime=50 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 85028 1252 0 0 4989 11 0 0 25 0 5 0 732288681 169394176 28761 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 41356 28761 180 55 0 39242 0
[pid=13346/tid=13353] ppid=13344 vsize=165424 CPUtime=12.49 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 4640 1252 0 0 1249 0 0 0 25 0 5 0 732288701 169394176 28761 33554432000 4194304 4417452 140734405119936 18446744073709551615 4258460 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=165424 CPUtime=12.47 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 3175 1252 0 0 1247 0 0 0 25 0 5 0 732288702 169394176 28761 33554432000 4194304 4417452 140734405119936 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=165424 CPUtime=12.49 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 3905 1252 0 0 1249 0 0 0 25 0 5 0 732288702 169394176 28761 33554432000 4194304 4417452 140734405119936 18446744073709551615 4259609 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=165424 CPUtime=12.34 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 64472 1252 0 0 1225 9 0 0 25 0 5 0 732288702 169394176 28761 33554432000 4194304 4417452 140734405119936 18446744073709551615 4354501 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50
Current children cumulated vsize (KiB) 165424

[startup+25.5004 s]
/proc/loadavg: 7.73 7.94 7.66 9/392 13357
/proc/meminfo: memFree=14529924/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=235344 CPUtime=101.04 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 142902 1252 0 0 10084 20 0 0 25 0 5 0 732288681 240992256 46624 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 58836 46624 180 55 0 56722 0
[pid=13346/tid=13353] ppid=13344 vsize=235344 CPUtime=25.28 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 7024 1252 0 0 2528 0 0 0 25 0 5 0 732288701 240992256 46624 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=235344 CPUtime=25.26 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 5896 1252 0 0 2526 0 0 0 18 0 5 0 732288702 240992256 46624 33554432000 4194304 4417452 140734405119936 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=235344 CPUtime=25.28 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 4749 1252 0 0 2528 0 0 0 25 0 5 0 732288702 240992256 46624 33554432000 4194304 4417452 140734405119936 18446744073709551615 4249501 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=235344 CPUtime=24.98 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 116397 1252 0 0 2481 17 0 0 25 0 5 0 732288702 240992256 46624 33554432000 4194304 4417452 140734405119936 18446744073709551615 4250502 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.04
Current children cumulated vsize (KiB) 235344

[startup+51.1009 s]
/proc/loadavg: 7.82 7.95 7.67 9/392 13358
/proc/meminfo: memFree=14241704/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=366624 CPUtime=203.14 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 214748 1252 0 0 20284 30 0 0 25 0 5 0 732288681 375422976 79216 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 91656 79216 180 55 0 89542 0
[pid=13346/tid=13353] ppid=13344 vsize=366624 CPUtime=50.89 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 8107 1252 0 0 5088 1 0 0 25 0 5 0 732288701 375422976 79216 33554432000 4194304 4417452 140734405119936 18446744073709551615 4250532 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=366624 CPUtime=50.87 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 6312 1252 0 0 5086 1 0 0 25 0 5 0 732288702 375422976 79216 33554432000 4194304 4417452 140734405119936 18446744073709551615 4357536 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=366624 CPUtime=50.88 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 8200 1252 0 0 5088 0 0 0 25 0 5 0 732288702 375422976 79216 33554432000 4194304 4417452 140734405119936 18446744073709551615 4249171 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=366624 CPUtime=50.27 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 183293 1252 0 0 5001 26 0 0 25 0 5 0 732288702 375422976 79216 33554432000 4194304 4417452 140734405119936 18446744073709551615 4250929 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.14
Current children cumulated vsize (KiB) 366624

[startup+102.314 s]
/proc/loadavg: 8.02 7.98 7.69 9/392 13359
/proc/meminfo: memFree=14295140/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=330376 CPUtime=407.37 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 320222 1252 0 0 40692 45 0 0 25 0 5 0 732288681 338305024 70382 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 82594 70382 180 55 0 80480 0
[pid=13346/tid=13353] ppid=13344 vsize=330376 CPUtime=102.1 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 10640 1252 0 0 10209 1 0 0 25 0 5 0 732288701 338305024 70382 33554432000 4194304 4417452 140734405119936 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=330376 CPUtime=102.08 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 7488 1252 0 0 10207 1 0 0 25 0 5 0 732288702 338305024 70382 33554432000 4194304 4417452 140734405119936 18446744073709551615 4277780 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=330376 CPUtime=102.09 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 10937 1252 0 0 10209 0 0 0 25 0 5 0 732288702 338305024 70382 33554432000 4194304 4417452 140734405119936 18446744073709551615 4249143 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=330376 CPUtime=100.86 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 282321 1252 0 0 10046 40 0 0 25 0 5 0 732288702 338305024 70382 33554432000 4194304 4417452 140734405119936 18446744073709551615 4250532 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 407.37
Current children cumulated vsize (KiB) 330376

[startup+162.301 s]
/proc/loadavg: 8.04 8.00 7.72 9/392 13361
/proc/meminfo: memFree=13464448/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=799768 CPUtime=646.6 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 430700 1252 0 0 64595 65 0 0 25 0 5 0 732288681 818962432 171394 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 199942 171394 180 55 0 197828 0
[pid=13346/tid=13353] ppid=13344 vsize=799768 CPUtime=162.08 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 16445 1252 0 0 16207 1 0 0 25 0 5 0 732288701 818962432 171394 33554432000 4194304 4417452 140734405119936 18446744073709551615 4366065 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=799768 CPUtime=162.07 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 16088 1252 0 0 16205 2 0 0 25 0 5 0 732288702 818962432 171394 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=799768 CPUtime=162.08 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 14529 1252 0 0 16207 1 0 0 25 0 5 0 732288702 818962432 171394 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364741 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=799768 CPUtime=160.14 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 374802 1252 0 0 15956 58 0 0 25 0 5 0 732288702 818962432 171394 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 646.6
Current children cumulated vsize (KiB) 799768


################
# More data... #
################

[pid=13346/tid=13354] ppid=13344 vsize=1935612 CPUtime=762.09 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 70707 1252 0 0 76201 8 0 0 25 0 5 0 732288702 1982066688 455340 33554432000 4194304 4417452 140734405119936 18446744073709551615 4356971 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=1935612 CPUtime=762.09 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 36514 1252 0 0 76205 4 0 0 25 0 5 0 732288702 1982066688 455340 33554432000 4194304 4417452 140734405119936 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=1935612 CPUtime=752.8 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 913405 1252 0 0 75146 134 0 0 25 0 5 0 732288702 1982066688 455340 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3039.32
Current children cumulated vsize (KiB) 1935612

[startup+822.3 s]
/proc/loadavg: 8.14 8.11 7.91 9/392 13387
/proc/meminfo: memFree=11921108/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=1935612 CPUtime=3278.54 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 1076692 1252 0 0 327700 154 0 0 25 0 5 0 732288681 1982066688 455340 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 483903 455340 180 55 0 481789 0
[pid=13346/tid=13353] ppid=13344 vsize=1935612 CPUtime=822.1 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 47230 1252 0 0 82204 6 0 0 25 0 5 0 732288701 1982066688 455340 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=1935612 CPUtime=822.07 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 70707 1252 0 0 82199 8 0 0 25 0 5 0 732288702 1982066688 455340 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=1935612 CPUtime=822.07 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 36514 1252 0 0 82203 4 0 0 25 0 5 0 732288702 1982066688 455340 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=1935612 CPUtime=812.07 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 913405 1252 0 0 81073 134 0 0 25 0 5 0 732288702 1982066688 455340 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3278.54
Current children cumulated vsize (KiB) 1935612

[startup+882.301 s]
/proc/loadavg: 8.09 8.10 7.91 9/392 13389
/proc/meminfo: memFree=12388704/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=1320784 CPUtime=3517.79 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 1179999 1252 0 0 351611 168 0 0 25 0 5 0 732288681 1352482816 301633 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 330196 301633 180 55 0 328082 0
[pid=13346/tid=13353] ppid=13344 vsize=1320784 CPUtime=882.1 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 47230 1252 0 0 88204 6 0 0 25 0 5 0 732288701 1352482816 301633 33554432000 4194304 4417452 140734405119936 18446744073709551615 4353632 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=1320784 CPUtime=882.07 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 70707 1252 0 0 88199 8 0 0 25 0 5 0 732288702 1352482816 301633 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=1320784 CPUtime=882.07 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 36514 1252 0 0 88203 4 0 0 25 0 5 0 732288702 1352482816 301633 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=1320784 CPUtime=871.31 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 1016712 1252 0 0 86984 147 0 0 25 0 5 0 732288702 1352482816 301633 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3517.79
Current children cumulated vsize (KiB) 1320784

[startup+942.3 s]
/proc/loadavg: 8.09 8.10 7.92 9/392 13390
/proc/meminfo: memFree=12114284/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=1452120 CPUtime=3757.07 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 1212833 1252 0 0 375535 172 0 0 25 0 5 0 732288681 1486970880 334467 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 363030 334467 180 55 0 360916 0
[pid=13346/tid=13353] ppid=13344 vsize=1452120 CPUtime=942.1 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 47230 1252 0 0 94204 6 0 0 25 0 5 0 732288701 1486970880 334467 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=1452120 CPUtime=942.07 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 70707 1252 0 0 94199 8 0 0 25 0 5 0 732288702 1486970880 334467 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=1452120 CPUtime=942.07 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 36514 1252 0 0 94203 4 0 0 25 0 5 0 732288702 1486970880 334467 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=1452120 CPUtime=930.59 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 1049546 1252 0 0 92908 151 0 0 25 0 5 0 732288702 1486970880 334467 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3757.07
Current children cumulated vsize (KiB) 1452120

[startup+1002.3 s]
/proc/loadavg: 8.08 8.09 7.93 9/392 13392
/proc/meminfo: memFree=12084644/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=1452120 CPUtime=3996.33 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 1212833 1252 0 0 399460 173 0 0 25 0 5 0 732288681 1486970880 334467 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 363030 334467 180 55 0 360916 0
[pid=13346/tid=13353] ppid=13344 vsize=1452120 CPUtime=1002.1 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 47230 1252 0 0 100204 6 0 0 25 0 5 0 732288701 1486970880 334467 33554432000 4194304 4417452 140734405119936 18446744073709551615 4237189 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=1452120 CPUtime=1002.08 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 70707 1252 0 0 100200 8 0 0 25 0 5 0 732288702 1486970880 334467 33554432000 4194304 4417452 140734405119936 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=1452120 CPUtime=1002.07 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 36514 1252 0 0 100203 4 0 0 25 0 5 0 732288702 1486970880 334467 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=1452120 CPUtime=989.85 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 1049546 1252 0 0 98833 152 0 0 25 0 5 0 732288702 1486970880 334467 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3996.33
Current children cumulated vsize (KiB) 1452120

[startup+1062.3 s]
/proc/loadavg: 8.08 8.09 7.93 9/392 13394
/proc/meminfo: memFree=11991260/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=1523888 CPUtime=4235.6 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 1230775 1252 0 0 423385 175 0 0 25 0 5 0 732288681 1560461312 352409 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 380972 352409 180 55 0 378858 0
[pid=13346/tid=13353] ppid=13344 vsize=1523888 CPUtime=1062.1 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 48776 1252 0 0 106204 6 0 0 25 0 5 0 732288701 1560461312 352409 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364877 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=1523888 CPUtime=1062.08 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 70707 1252 0 0 106200 8 0 0 25 0 5 0 732288702 1560461312 352409 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364684 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=1523888 CPUtime=1062.07 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 36514 1252 0 0 106203 4 0 0 25 0 5 0 732288702 1560461312 352409 33554432000 4194304 4417452 140734405119936 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=1523888 CPUtime=1049.11 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 1065942 1252 0 0 104758 153 0 0 25 0 5 0 732288702 1560461312 352409 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4235.6
Current children cumulated vsize (KiB) 1523888

[startup+1122.3 s]
/proc/loadavg: 8.10 8.10 7.94 9/392 13395
/proc/meminfo: memFree=11403620/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=1796252 CPUtime=4474.86 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 1298866 1252 0 0 447300 186 0 0 25 0 5 0 732288681 1839362048 420500 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 449063 420500 180 55 0 446949 0
[pid=13346/tid=13353] ppid=13344 vsize=1796252 CPUtime=1122.1 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 48776 1252 0 0 112204 6 0 0 25 0 5 0 732288701 1839362048 420500 33554432000 4194304 4417452 140734405119936 18446744073709551615 4355860 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=1796252 CPUtime=1122.08 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 70707 1252 0 0 112200 8 0 0 25 0 5 0 732288702 1839362048 420500 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=1796252 CPUtime=1122.07 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 36514 1252 0 0 112203 4 0 0 25 0 5 0 732288702 1839362048 420500 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=1796252 CPUtime=1108.37 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 1134033 1252 0 0 110672 165 0 0 25 0 5 0 732288702 1839362048 420500 33554432000 4194304 4417452 140734405119936 18446744073709551615 4365027 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4474.86
Current children cumulated vsize (KiB) 1796252

[startup+1182.3 s]
/proc/loadavg: 8.15 8.11 7.95 9/392 13397
/proc/meminfo: memFree=10994400/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=1849772 CPUtime=4714.12 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 1312246 1252 0 0 471225 187 0 0 25 0 5 0 732288681 1894166528 433880 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 462443 433880 180 55 0 460329 0
[pid=13346/tid=13353] ppid=13344 vsize=1849772 CPUtime=1182.1 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 53964 1252 0 0 118204 6 0 0 25 0 5 0 732288701 1894166528 433880 33554432000 4194304 4417452 140734405119936 18446744073709551615 4365092 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=1849772 CPUtime=1182.08 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 70707 1252 0 0 118200 8 0 0 25 0 5 0 732288702 1894166528 433880 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=1849772 CPUtime=1182.07 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 36514 1252 0 0 118203 4 0 0 25 0 5 0 732288702 1894166528 433880 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=1849772 CPUtime=1167.64 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 1142225 1252 0 0 116598 166 0 0 25 0 5 0 732288702 1894166528 433880 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4714.12
Current children cumulated vsize (KiB) 1849772



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.9 s]
/proc/loadavg: 8.10 8.10 7.95 5/386 13398
/proc/meminfo: memFree=12992576/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=1980936 CPUtime=4800.28 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 1345037 1252 0 0 479834 194 0 0 25 0 5 0 732288681 2028478464 466671 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 495234 466671 180 55 0 493120 0
[pid=13346/tid=13353] ppid=13344 vsize=1980936 CPUtime=1203.71 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 53964 1252 0 0 120365 6 0 0 25 0 5 0 732288701 2028478464 466671 33554432000 4194304 4417452 140734405119936 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=1980936 CPUtime=1203.69 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 70707 1252 0 0 120361 8 0 0 25 0 5 0 732288702 2028478464 466671 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=1980936 CPUtime=1203.68 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 36514 1252 0 0 120364 4 0 0 25 0 5 0 732288702 2028478464 466671 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=1980936 CPUtime=1188.96 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 1175016 1252 0 0 118724 172 0 0 25 0 5 0 732288702 2028478464 466671 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.28
Current children cumulated vsize (KiB) 1980936

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.9 s]
/proc/loadavg: 8.10 8.10 7.95 5/386 13398
/proc/meminfo: memFree=12992576/32951124 swapFree=65586204/67111528
[pid=13346] ppid=13344 vsize=1980936 CPUtime=4800.28 cores=0,2,4,6
/proc/13346/stat : 13346 (plingeling) S 13344 13346 12655 0 -1 4202496 1345037 1252 0 0 479834 194 0 0 25 0 5 0 732288681 2028478464 466671 33554432000 4194304 4417452 140734405119936 18446744073709551615 216746981349 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/13346/statm: 495234 466671 180 55 0 493120 0
[pid=13346/tid=13353] ppid=13344 vsize=1980936 CPUtime=1203.71 cores=0,2,4,6
/proc/13346/task/13353/stat : 13353 (plingeling) R 13344 13346 12655 0 -1 4202560 53964 1252 0 0 120365 6 0 0 25 0 5 0 732288701 2028478464 466671 33554432000 4194304 4417452 140734405119936 18446744073709551615 4366447 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=13346/tid=13354] ppid=13344 vsize=1980936 CPUtime=1203.69 cores=0,2,4,6
/proc/13346/task/13354/stat : 13354 (plingeling) R 13344 13346 12655 0 -1 4202560 70707 1252 0 0 120361 8 0 0 25 0 5 0 732288702 2028478464 466671 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=13346/tid=13355] ppid=13344 vsize=1980936 CPUtime=1203.68 cores=0,2,4,6
/proc/13346/task/13355/stat : 13355 (plingeling) R 13344 13346 12655 0 -1 4202560 36514 1252 0 0 120364 4 0 0 25 0 5 0 732288702 2028478464 466671 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=13346/tid=13356] ppid=13344 vsize=1980936 CPUtime=1188.96 cores=0,2,4,6
/proc/13346/task/13356/stat : 13356 (plingeling) R 13344 13346 12655 0 -1 4202560 1175016 1252 0 0 118724 172 0 0 25 0 5 0 732288702 2028478464 466671 33554432000 4194304 4417452 140734405119936 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.28
Current children cumulated vsize (KiB) 1980936

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204
CPU time (s): 4800.41
CPU user time (s): 4798.38
CPU system time (s): 2.02669
CPU usage (%): 398.705
Max. virtual memory (cumulated for all children) (KiB): 1980936

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.38
system time used= 2.02669
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1346289
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 94
involuntary context switches= 21082

runsolver used 4.35834 second user time and 10.4154 second system time

The end

Launcher Data 

Begin job on node119 at 2011-05-15 02:49:40
IDJOB=3371154
IDBENCH=71605
IDSOLVER=1848
FILE ID=node119/3371154-1305420580
RUNJOBID= node119-1305419374-13208
PBS_JOBID= 13324563
Free space on /tmp= 73188 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/forced/rbsat-v2640c305320gyes10.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371154-1305420580/watcher-3371154-1305420580 -o /tmp/evaluation-result-3371154-1305420580/solver-3371154-1305420580 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371154-1305420580.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 98bac4f2d533fe7abb12552567f9e1aa
RANDOM SEED=1557941512

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      14831980 kB
Buffers:        287876 kB
Cached:        4583008 kB
SwapCached:       4756 kB
Active:       14745028 kB
Inactive:      3042276 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      14831980 kB
SwapTotal:    67111528 kB
SwapFree:     65586204 kB
Dirty:            8172 kB
Writeback:           0 kB
AnonPages:    12914536 kB
Mapped:          30604 kB
Slab:           210444 kB
PageTables:      56204 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 102555944 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73192 MiB
End job on node119 at 2011-05-15 03:09:46