Trace number 3371173

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)? (TO) 4800.34 1202.69

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v2400c266431g3.cnf
MD5SUM231f625a25c77518fbce98fe99f807b5
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3371173-1305417778/watcher-3371173-1305417778 -o /tmp/evaluation-result-3371173-1305417778/solver-3371173-1305417778 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3371173-1305417778.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.67 7.10 7.45 6/254 14245
/proc/meminfo: memFree=21362764/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=9016 CPUtime=0 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) R 14243 14245 13336 0 -1 4202496 322 1256 0 0 0 0 0 0 25 0 1 0 653375708 9232384 252 33554432000 4194304 4417452 140734537001072 18446744073709551615 271550537472 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/14245/statm: 2254 252 147 55 0 140 0

[startup+0.105984 s]
/proc/loadavg: 7.67 7.10 7.45 6/254 14245
/proc/meminfo: memFree=21362764/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=26604 CPUtime=0.09 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) R 14243 14245 13336 0 -1 4202496 4712 1256 0 0 9 0 0 0 25 0 1 0 653375708 27242496 4642 33554432000 4194304 4417452 140734537001072 18446744073709551615 271550537472 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/14245/statm: 6651 4642 148 55 0 4537 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26604

[startup+0.200903 s]
/proc/loadavg: 7.67 7.10 7.45 6/254 14245
/proc/meminfo: memFree=21362764/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=84016 CPUtime=0.24 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 8928 1256 0 0 23 1 0 0 25 0 5 0 653375708 86032384 8798 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 21004 8798 171 55 0 18890 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 84016

[startup+0.300882 s]
/proc/loadavg: 7.67 7.10 7.45 6/254 14245
/proc/meminfo: memFree=21362764/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=85512 CPUtime=0.64 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 9602 1256 0 0 63 1 0 0 25 0 5 0 653375708 87564288 9192 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 21378 9192 175 55 0 19264 0
Current children cumulated CPU time (s) 0.64
Current children cumulated vsize (KiB) 85512

[startup+0.700809 s]
/proc/loadavg: 7.67 7.10 7.45 6/254 14245
/proc/meminfo: memFree=21362764/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=165552 CPUtime=2.23 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 21055 1256 0 0 220 3 0 0 25 0 5 0 653375708 169525248 12824 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 41388 12824 180 55 0 39274 0
Current children cumulated CPU time (s) 2.23
Current children cumulated vsize (KiB) 165552

[startup+1.50066 s]
/proc/loadavg: 7.67 7.10 7.45 9/259 14255
/proc/meminfo: memFree=21308784/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=167108 CPUtime=5.42 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 25568 1256 0 0 539 3 0 0 25 0 5 0 653375708 171118592 13213 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 41777 13213 180 55 0 39663 0
[pid=14245/tid=14252] ppid=14243 vsize=167108 CPUtime=1.31 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 4100 1256 0 0 131 0 0 0 25 0 5 0 653375726 171118592 13213 33554432000 4194304 4417452 140734537001072 18446744073709551615 4239393 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=167108 CPUtime=1.3 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 2868 1256 0 0 130 0 0 0 25 0 5 0 653375726 171118592 13213 33554432000 4194304 4417452 140734537001072 18446744073709551615 4249151 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=167108 CPUtime=1.3 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 2763 1256 0 0 130 0 0 0 25 0 5 0 653375726 171118592 13213 33554432000 4194304 4417452 140734537001072 18446744073709551615 4258188 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=167108 CPUtime=1.3 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 7017 1256 0 0 130 0 0 0 19 0 5 0 653375726 171118592 13213 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364684 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.42
Current children cumulated vsize (KiB) 167108

[startup+3.10038 s]
/proc/loadavg: 7.67 7.10 7.45 9/259 14255
/proc/meminfo: memFree=21301964/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=183488 CPUtime=11.82 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 31467 1256 0 0 1178 4 0 0 25 0 5 0 653375708 187891712 17308 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 45872 17308 180 55 0 43758 0
[pid=14245/tid=14252] ppid=14243 vsize=183488 CPUtime=2.9 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 5338 1256 0 0 290 0 0 0 25 0 5 0 653375726 187891712 17308 33554432000 4194304 4417452 140734537001072 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=183488 CPUtime=2.9 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 4106 1256 0 0 290 0 0 0 25 0 5 0 653375726 187891712 17308 33554432000 4194304 4417452 140734537001072 18446744073709551615 4258678 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=183488 CPUtime=2.89 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 2763 1256 0 0 289 0 0 0 25 0 5 0 653375726 187891712 17308 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=183488 CPUtime=2.91 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 10440 1256 0 0 290 1 0 0 23 0 5 0 653375726 187891712 17308 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.82
Current children cumulated vsize (KiB) 183488

[startup+6.30079 s]
/proc/loadavg: 7.70 7.11 7.46 9/259 14255
/proc/meminfo: memFree=21280584/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=200712 CPUtime=24.59 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 40913 1256 0 0 2454 5 0 0 25 0 5 0 653375708 205529088 21614 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 50178 21614 180 55 0 48064 0
[pid=14245/tid=14252] ppid=14243 vsize=200712 CPUtime=6.11 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 5338 1256 0 0 611 0 0 0 25 0 5 0 653375726 205529088 21614 33554432000 4194304 4417452 140734537001072 18446744073709551615 4249186 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=200712 CPUtime=6.11 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 4106 1256 0 0 611 0 0 0 25 0 5 0 653375726 205529088 21614 33554432000 4194304 4417452 140734537001072 18446744073709551615 4258587 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=200712 CPUtime=6.06 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 3787 1256 0 0 606 0 0 0 25 0 5 0 653375726 205529088 21614 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=200712 CPUtime=6.11 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 18862 1256 0 0 609 2 0 0 25 0 5 0 653375726 205529088 21614 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.59
Current children cumulated vsize (KiB) 200712

[startup+12.7006 s]
/proc/loadavg: 7.72 7.13 7.46 9/259 14255
/proc/meminfo: memFree=21262632/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=215920 CPUtime=50.14 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 57728 1256 0 0 5006 8 0 0 25 0 5 0 653375708 221102080 25416 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 53980 25416 180 55 0 51866 0
[pid=14245/tid=14252] ppid=14243 vsize=215920 CPUtime=12.51 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 6576 1256 0 0 1250 1 0 0 25 0 5 0 653375726 221102080 25416 33554432000 4194304 4417452 140734537001072 18446744073709551615 4249165 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=215920 CPUtime=12.5 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 5344 1256 0 0 1250 0 0 0 25 0 5 0 653375726 221102080 25416 33554432000 4194304 4417452 140734537001072 18446744073709551615 4248991 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=215920 CPUtime=12.41 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 3787 1256 0 0 1241 0 0 0 25 0 5 0 653375726 221102080 25416 33554432000 4194304 4417452 140734537001072 18446744073709551615 4245774 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=215920 CPUtime=12.5 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 33201 1256 0 0 1246 4 0 0 25 0 5 0 653375726 221102080 25416 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.14
Current children cumulated vsize (KiB) 215920

[startup+25.5003 s]
/proc/loadavg: 7.78 7.17 7.47 9/259 14256
/proc/meminfo: memFree=21151288/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=302268 CPUtime=101.24 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 89288 1256 0 0 10112 12 0 0 25 0 5 0 653375708 309522432 47003 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 75567 47003 180 55 0 73453 0
[pid=14245/tid=14252] ppid=14243 vsize=302268 CPUtime=25.31 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 7600 1256 0 0 2530 1 0 0 25 0 5 0 653375726 309522432 47003 33554432000 4194304 4417452 140734537001072 18446744073709551615 4357229 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=302268 CPUtime=25.3 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 5344 1256 0 0 2530 0 0 0 25 0 5 0 653375726 309522432 47003 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=302268 CPUtime=25.12 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 5315 1256 0 0 2512 0 0 0 25 0 5 0 653375726 309522432 47003 33554432000 4194304 4417452 140734537001072 18446744073709551615 4258258 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=302268 CPUtime=25.31 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 62209 1256 0 0 2523 8 0 0 25 0 5 0 653375726 309522432 47003 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.24
Current children cumulated vsize (KiB) 302268

[startup+51.1007 s]
/proc/loadavg: 7.97 7.26 7.49 9/259 14256
/proc/meminfo: memFree=21018280/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=421280 CPUtime=203.46 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 143097 1256 0 0 20325 21 0 0 25 0 5 0 653375708 431390720 76756 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 105320 76756 180 55 0 103206 0
[pid=14245/tid=14252] ppid=14243 vsize=421280 CPUtime=50.91 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 8585 1256 0 0 5090 1 0 0 25 0 5 0 653375726 431390720 76756 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=421280 CPUtime=50.89 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 5672 1256 0 0 5089 0 0 0 25 0 5 0 653375726 431390720 76756 33554432000 4194304 4417452 140734537001072 18446744073709551615 4353557 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=421280 CPUtime=50.53 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 5315 1256 0 0 5053 0 0 0 25 0 5 0 653375726 431390720 76756 33554432000 4194304 4417452 140734537001072 18446744073709551615 4258263 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=421280 CPUtime=50.9 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 114705 1256 0 0 5074 16 0 0 25 0 5 0 653375726 431390720 76756 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 203.46
Current children cumulated vsize (KiB) 421280

[startup+102.3 s]
/proc/loadavg: 8.23 7.44 7.54 10/260 14261
/proc/meminfo: memFree=20859988/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=526356 CPUtime=407.48 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 211629 1256 0 0 40714 34 0 0 25 0 5 0 653375708 538988544 103025 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 131589 103025 180 55 0 129475 0
[pid=14245/tid=14252] ppid=14243 vsize=526356 CPUtime=101.84 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 9500 1256 0 0 10183 1 0 0 25 0 5 0 653375726 538988544 103025 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=526356 CPUtime=101.96 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 6587 1256 0 0 10195 1 0 0 25 0 5 0 653375726 538988544 103025 33554432000 4194304 4417452 140734537001072 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=526356 CPUtime=101.36 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 5315 1256 0 0 10136 0 0 0 25 0 5 0 653375726 538988544 103025 33554432000 4194304 4417452 140734537001072 18446744073709551615 4249209 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=526356 CPUtime=102.12 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 181407 1256 0 0 10183 29 0 0 25 0 5 0 653375726 538988544 103025 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 407.48
Current children cumulated vsize (KiB) 526356

[startup+162.3 s]
/proc/loadavg: 8.20 7.58 7.58 9/259 14262
/proc/meminfo: memFree=20614016/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=679556 CPUtime=646.64 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 315837 1256 0 0 64615 49 0 0 25 0 5 0 653375708 695865344 141325 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 169889 141325 180 55 0 167775 0
[pid=14245/tid=14252] ppid=14243 vsize=679556 CPUtime=161.46 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 13025 1256 0 0 16144 2 0 0 25 0 5 0 653375726 695865344 141325 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364835 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=679556 CPUtime=161.95 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 8166 1256 0 0 16194 1 0 0 25 0 5 0 653375726 695865344 141325 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364881 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=679556 CPUtime=160.92 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 8241 1256 0 0 16091 1 0 0 25 0 5 0 653375726 695865344 141325 33554432000 4194304 4417452 140734537001072 18446744073709551615 4355852 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=679556 CPUtime=162.11 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 277585 1256 0 0 16168 43 0 0 25 0 5 0 653375726 695865344 141325 33554432000 4194304 4417452 140734537001072 18446744073709551615 4353568 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 646.64
Current children cumulated vsize (KiB) 679556


################
# More data... #
################

[pid=14245/tid=14253] ppid=14243 vsize=1771168 CPUtime=761.89 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 34767 1256 0 0 76185 4 0 0 25 0 5 0 653375726 1813676032 414228 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=1771168 CPUtime=756.54 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 46130 1256 0 0 75649 5 0 0 25 0 5 0 653375726 1813676032 414228 33554432000 4194304 4417452 140734537001072 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=1771168 CPUtime=762.13 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 758829 1256 0 0 76097 116 0 0 25 0 5 0 653375726 1813676032 414228 33554432000 4194304 4417452 140734537001072 18446744073709551615 4353543 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3042.25
Current children cumulated vsize (KiB) 1771168

[startup+822.301 s]
/proc/loadavg: 8.15 8.16 7.89 9/259 14280
/proc/meminfo: memFree=19993804/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=1090932 CPUtime=3281.78 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 982073 1256 0 0 328030 148 0 0 25 0 5 0 653375708 1117114368 244169 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 272733 244169 180 55 0 270619 0
[pid=14245/tid=14252] ppid=14243 vsize=1090932 CPUtime=821.48 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 41078 1256 0 0 82142 6 0 0 25 0 5 0 653375726 1117114368 244169 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364812 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=1090932 CPUtime=821.88 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 34767 1256 0 0 82184 4 0 0 25 0 5 0 653375726 1117114368 244169 33554432000 4194304 4417452 140734537001072 18446744073709551615 4366657 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=1090932 CPUtime=816.1 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 46130 1256 0 0 81605 5 0 0 25 0 5 0 653375726 1117114368 244169 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=1090932 CPUtime=822.13 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 851278 1256 0 0 82082 131 0 0 25 0 5 0 653375726 1117114368 244169 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3281.78
Current children cumulated vsize (KiB) 1090932

[startup+882.31 s]
/proc/loadavg: 8.25 8.18 7.91 9/259 14282
/proc/meminfo: memFree=19805300/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=1239804 CPUtime=3521.38 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 1019291 1256 0 0 351986 152 0 0 25 0 5 0 653375708 1269559296 281387 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 309951 281387 180 55 0 307837 0
[pid=14245/tid=14252] ppid=14243 vsize=1239804 CPUtime=881.49 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 41078 1256 0 0 88143 6 0 0 25 0 5 0 653375726 1269559296 281387 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=1239804 CPUtime=881.88 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 34767 1256 0 0 88184 4 0 0 25 0 5 0 653375726 1269559296 281387 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=1239804 CPUtime=875.67 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 46130 1256 0 0 87562 5 0 0 25 0 5 0 653375726 1269559296 281387 33554432000 4194304 4417452 140734537001072 18446744073709551615 4357856 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=1239804 CPUtime=882.14 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 888496 1256 0 0 88079 135 0 0 25 0 5 0 653375726 1269559296 281387 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3521.38
Current children cumulated vsize (KiB) 1239804

[startup+942.301 s]
/proc/loadavg: 8.12 8.16 7.92 9/259 14283
/proc/meminfo: memFree=19643568/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=1395632 CPUtime=3760.91 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 1058248 1256 0 0 375934 157 0 0 25 0 5 0 653375708 1429127168 320344 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 348908 320344 180 55 0 346794 0
[pid=14245/tid=14252] ppid=14243 vsize=1395632 CPUtime=941.48 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 41078 1256 0 0 94142 6 0 0 25 0 5 0 653375726 1429127168 320344 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364798 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=1395632 CPUtime=941.86 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 34767 1256 0 0 94182 4 0 0 25 0 5 0 653375726 1429127168 320344 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=1395632 CPUtime=935.22 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 46130 1256 0 0 93517 5 0 0 25 0 5 0 653375726 1429127168 320344 33554432000 4194304 4417452 140734537001072 18446744073709551615 4250274 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=1395632 CPUtime=942.13 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 927453 1256 0 0 94074 139 0 0 25 0 5 0 653375726 1429127168 320344 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3760.91
Current children cumulated vsize (KiB) 1395632

[startup+1002.3 s]
/proc/loadavg: 7.07 7.92 7.85 5/249 14302
/proc/meminfo: memFree=20357556/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=1481176 CPUtime=4000.47 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 1079634 1256 0 0 399887 160 0 0 25 0 5 0 653375708 1516724224 341730 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 370294 341730 180 55 0 368180 0
[pid=14245/tid=14252] ppid=14243 vsize=1481176 CPUtime=1001.48 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 41078 1256 0 0 100142 6 0 0 25 0 5 0 653375726 1516724224 341730 33554432000 4194304 4417452 140734537001072 18446744073709551615 4366472 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=1481176 CPUtime=1001.85 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 34767 1256 0 0 100181 4 0 0 25 0 5 0 653375726 1516724224 341730 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=1481176 CPUtime=994.79 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 46130 1256 0 0 99473 6 0 0 25 0 5 0 653375726 1516724224 341730 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=1481176 CPUtime=1002.14 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 948839 1256 0 0 100072 142 0 0 25 0 5 0 653375726 1516724224 341730 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4000.47
Current children cumulated vsize (KiB) 1481176

[startup+1062.3 s]
/proc/loadavg: 5.20 7.22 7.61 5/249 14303
/proc/meminfo: memFree=20059428/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=1778924 CPUtime=4240.04 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 1154071 1256 0 0 423834 170 0 0 25 0 5 0 653375708 1821618176 416167 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 444731 416167 180 55 0 442617 0
[pid=14245/tid=14252] ppid=14243 vsize=1778924 CPUtime=1061.48 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 41078 1256 0 0 106142 6 0 0 25 0 5 0 653375726 1821618176 416167 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=1778924 CPUtime=1061.85 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 34767 1256 0 0 106181 4 0 0 25 0 5 0 653375726 1821618176 416167 33554432000 4194304 4417452 140734537001072 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=1778924 CPUtime=1054.36 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 46130 1256 0 0 105430 6 0 0 25 0 5 0 653375726 1821618176 416167 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=1778924 CPUtime=1062.14 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 1023276 1256 0 0 106063 151 0 0 25 0 5 0 653375726 1821618176 416167 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4240.04
Current children cumulated vsize (KiB) 1778924

[startup+1122.3 s]
/proc/loadavg: 4.44 6.63 7.38 5/249 14305
/proc/meminfo: memFree=20059296/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=1778924 CPUtime=4479.59 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 1154071 1256 0 0 447789 170 0 0 25 0 5 0 653375708 1821618176 416167 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 444731 416167 180 55 0 442617 0
[pid=14245/tid=14252] ppid=14243 vsize=1778924 CPUtime=1121.49 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 41078 1256 0 0 112142 7 0 0 25 0 5 0 653375726 1821618176 416167 33554432000 4194304 4417452 140734537001072 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=1778924 CPUtime=1121.84 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 34767 1256 0 0 112180 4 0 0 25 0 5 0 653375726 1821618176 416167 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364693 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=1778924 CPUtime=1113.93 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 46130 1256 0 0 111387 6 0 0 25 0 5 0 653375726 1821618176 416167 33554432000 4194304 4417452 140734537001072 18446744073709551615 4366130 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=1778924 CPUtime=1122.14 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 1023276 1256 0 0 112063 151 0 0 25 0 5 0 653375726 1821618176 416167 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4479.59
Current children cumulated vsize (KiB) 1778924

[startup+1182.3 s]
/proc/loadavg: 4.16 6.15 7.17 5/249 14307
/proc/meminfo: memFree=20041808/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=1796816 CPUtime=4719.15 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 1158544 1256 0 0 471745 170 0 0 25 0 5 0 653375708 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 449204 420640 180 55 0 447090 0
[pid=14245/tid=14252] ppid=14243 vsize=1796816 CPUtime=1181.49 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 41078 1256 0 0 118142 7 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364555 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=1796816 CPUtime=1181.83 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 39240 1256 0 0 118179 4 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=1796816 CPUtime=1173.49 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 46130 1256 0 0 117343 6 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=1796816 CPUtime=1182.14 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 1023276 1256 0 0 118063 151 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4719.15
Current children cumulated vsize (KiB) 1796816



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.6 s]
/proc/loadavg: 4.11 6.01 7.10 5/249 14307
/proc/meminfo: memFree=20041924/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=1796816 CPUtime=4800.22 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 1158544 1256 0 0 479852 170 0 0 25 0 5 0 653375708 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 449204 420640 180 55 0 447090 0
[pid=14245/tid=14252] ppid=14243 vsize=1796816 CPUtime=1201.8 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 41078 1256 0 0 120173 7 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=1796816 CPUtime=1202.14 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 39240 1256 0 0 120210 4 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4366688 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=1796816 CPUtime=1193.64 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 46130 1256 0 0 119358 6 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=1796816 CPUtime=1202.45 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 1023276 1256 0 0 120094 151 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.22
Current children cumulated vsize (KiB) 1796816

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.6 s]
/proc/loadavg: 4.11 6.01 7.10 5/249 14307
/proc/meminfo: memFree=20041924/32951124 swapFree=67056788/67111528
[pid=14245] ppid=14243 vsize=1796816 CPUtime=4800.22 cores=0,2,4,6
/proc/14245/stat : 14245 (plingeling) S 14243 14245 13336 0 -1 4202496 1158544 1256 0 0 479852 170 0 0 25 0 5 0 653375708 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 271562340325 0 0 4096 17442 18446744073709551615 0 0 17 2 0 0 0
/proc/14245/statm: 449204 420640 180 55 0 447090 0
[pid=14245/tid=14252] ppid=14243 vsize=1796816 CPUtime=1201.8 cores=0,2,4,6
/proc/14245/task/14252/stat : 14252 (plingeling) R 14243 14245 13336 0 -1 4202560 41078 1256 0 0 120173 7 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364756 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=14245/tid=14253] ppid=14243 vsize=1796816 CPUtime=1202.14 cores=0,2,4,6
/proc/14245/task/14253/stat : 14253 (plingeling) R 14243 14245 13336 0 -1 4202560 39240 1256 0 0 120210 4 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4366688 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=14245/tid=14254] ppid=14243 vsize=1796816 CPUtime=1193.64 cores=0,2,4,6
/proc/14245/task/14254/stat : 14254 (plingeling) R 14243 14245 13336 0 -1 4202560 46130 1256 0 0 119358 6 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=14245/tid=14255] ppid=14243 vsize=1796816 CPUtime=1202.45 cores=0,2,4,6
/proc/14245/task/14255/stat : 14255 (plingeling) R 14243 14245 13336 0 -1 4202560 1023276 1256 0 0 120094 151 0 0 25 0 5 0 653375726 1839939584 420640 33554432000 4194304 4417452 140734537001072 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.22
Current children cumulated vsize (KiB) 1796816

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.69
CPU time (s): 4800.34
CPU user time (s): 4798.56
CPU system time (s): 1.78573
CPU usage (%): 399.134
Max. virtual memory (cumulated for all children) (KiB): 1814484

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.56
system time used= 1.78573
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1159801
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 150
involuntary context switches= 72906

runsolver used 2.55161 second user time and 6.25605 second system time

The end

Launcher Data 

Begin job on node133 at 2011-05-15 02:02:58
IDJOB=3371173
IDBENCH=71269
IDSOLVER=1848
FILE ID=node133/3371173-1305417778
RUNJOBID= node133-1305417611-14131
PBS_JOBID= 13324520
Free space on /tmp= 73624 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v2400c266431g3.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3371173-1305417778/watcher-3371173-1305417778 -o /tmp/evaluation-result-3371173-1305417778/solver-3371173-1305417778 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3371173-1305417778.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 231f625a25c77518fbce98fe99f807b5
RANDOM SEED=1510837138

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21363036 kB
Buffers:        280164 kB
Cached:        3262824 kB
SwapCached:       8724 kB
Active:        8870656 kB
Inactive:      2436468 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21363036 kB
SwapTotal:    67111528 kB
SwapFree:     67056788 kB
Dirty:            3660 kB
Writeback:           0 kB
AnonPages:     7760796 kB
Mapped:          21352 kB
Slab:           194824 kB
PageTables:      24320 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 19621800 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73652 MiB
End job on node133 at 2011-05-15 02:23:03