Trace number 3381051

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.5 5013.04

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-16-16-unsat.cnf
MD5SUMc07743bac800f91e403382f26717b1d0
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables256
Number of clauses2176
Sum of the clauses size7936
Maximum clause length16
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21920
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5256

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...501568/instance-3381051-1305501568.cnf
0.00/0.00	c Solving...
40000.46/5013.02	
40000.46/5013.02	*** INTERRUPTED! ***
40000.46/5013.02	*** Shutting down threads...
40000.46/5013.03	s UNKNOWN
40000.46/5013.03	
40000.46/5013.03	c INTERRUPTED   : 1
40000.46/5013.03	c Models        : 0+    
40000.46/5013.03	c Time          : 5013.019s (Solving: 5013.02s 1st Model: 0.00s Unsat: 0.00s)
40000.46/5013.03	c CPU Time      : 40000.500s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3381051-1305501568/watcher-3381051-1305501568 -o /tmp/evaluation-result-3381051-1305501568/solver-3381051-1305501568 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3381051-1305501568.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.06 8.05 8.00 1/447 20607
/proc/meminfo: memFree=24977824/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=184908 CPUtime=0.02 cores=0-7
/proc/20607/stat : 20607 (claspmt) S 20605 20607 20239 0 -1 4202496 994 0 0 0 2 0 0 0 25 0 8 0 661759452 189345792 916 33554432000 4194304 4964800 140733525079040 18446744073709551615 216646331289 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/20607/statm: 46227 916 464 189 0 40576 0
[pid=20607/tid=20608] ppid=20605 vsize=184908 CPUtime=0 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 66 0 0 0 0 0 0 0 25 0 8 0 661759453 189345792 919 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634176545 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=184908 CPUtime=0 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 20 0 0 0 0 0 0 0 25 0 8 0 661759453 189345792 919 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620398 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=184908 CPUtime=0 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 55 0 0 0 0 0 0 0 25 0 8 0 661759453 189345792 921 33554432000 4194304 4964800 140733525079040 18446744073709551615 4653307 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=184908 CPUtime=0 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 28 0 0 0 0 0 0 0 25 0 8 0 661759453 189345792 921 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620398 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=184908 CPUtime=0 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 27 0 0 0 0 0 0 0 25 0 8 0 661759453 189345792 921 33554432000 4194304 4964800 140733525079040 18446744073709551615 216646331289 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=184908 CPUtime=0 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) S 20605 20607 20239 0 -1 4202560 24 0 0 0 0 0 0 0 25 0 8 0 661759453 189345792 923 33554432000 4194304 4964800 140733525079040 18446744073709551615 216646331289 0 0 4096 18946 18446604467935917056 0 0 -1 2 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=184908 CPUtime=0 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 111 0 0 0 0 0 0 0 25 0 8 0 661759453 189345792 923 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 2 0 0 0

[startup+0.0929021 s]
/proc/loadavg: 8.06 8.05 8.00 1/447 20607
/proc/meminfo: memFree=24977824/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=316376 CPUtime=0.66 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 1755 0 0 0 66 0 0 0 18 0 8 0 661759452 323969024 1677 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/20607/statm: 79127 1802 464 189 0 73476 0
[pid=20607/tid=20608] ppid=20605 vsize=316508 CPUtime=0.11 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 165 0 0 0 11 0 0 0 18 0 8 0 661759453 324104192 1809 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=316508 CPUtime=0.1 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 150 0 0 0 10 0 0 0 18 0 8 0 661759453 324104192 1937 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=316640 CPUtime=0.15 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 189 0 0 0 15 0 0 0 18 0 8 0 661759453 324239360 2054 33554432000 4194304 4964800 140733525079040 18446744073709551615 4654549 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=316640 CPUtime=0.16 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 213 0 0 0 16 0 0 0 18 0 8 0 661759453 324239360 2097 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=316904 CPUtime=0.2 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) S 20605 20607 20239 0 -1 4202560 214 0 0 0 20 0 0 0 18 0 8 0 661759453 324509696 2381 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620398 0 0 4096 18946 18446604467935917056 0 0 -1 7 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=316904 CPUtime=0.21 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 194 0 0 0 21 0 0 0 18 0 8 0 661759453 324509696 2387 33554432000 4194304 4964800 140733525079040 18446744073709551615 4660209 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=316904 CPUtime=0.25 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 299 0 0 0 25 0 0 0 18 0 8 0 661759453 324509696 2415 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 0.66
Current children cumulated vsize (KiB) 316376

[startup+0.422232 s]
/proc/loadavg: 8.06 8.05 8.00 1/447 20607
/proc/meminfo: memFree=24977824/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=317572 CPUtime=3.3 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 3284 0 0 0 329 1 0 0 18 0 8 0 661759452 325193728 3206 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/20607/statm: 79393 3210 464 189 0 73742 0
[pid=20607/tid=20608] ppid=20605 vsize=317712 CPUtime=0.46 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 328 0 0 0 46 0 0 0 18 0 8 0 661759453 325337088 3392 33554432000 4194304 4964800 140733525079040 18446744073709551615 4684074 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=317712 CPUtime=0.46 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 479 0 0 0 46 0 0 0 18 0 8 0 661759453 325337088 3446 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=317856 CPUtime=0.53 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 301 0 0 0 53 0 0 0 18 0 8 0 661759453 325484544 3521 33554432000 4194304 4964800 140733525079040 18446744073709551615 4684096 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=317856 CPUtime=0.54 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 516 0 0 0 54 0 0 0 18 0 8 0 661759453 325484544 3546 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=317988 CPUtime=0.56 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) S 20605 20607 20239 0 -1 4202560 369 0 0 0 56 0 0 0 18 0 8 0 661759453 325619712 3669 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620398 0 0 4096 18946 18446604467935917056 0 0 -1 7 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=318120 CPUtime=0.58 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 303 0 0 0 58 0 0 0 18 0 8 0 661759453 325754880 3732 33554432000 4194304 4964800 140733525079040 18446744073709551615 4627536 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=318120 CPUtime=0.63 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 419 0 0 0 63 0 0 0 18 0 8 0 661759453 325754880 3853 33554432000 4194304 4964800 140733525079040 18446744073709551615 4367104 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3.3
Current children cumulated vsize (KiB) 317572

[startup+0.945875 s]
/proc/loadavg: 8.06 8.05 8.00 1/447 20607
/proc/meminfo: memFree=24977824/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=318652 CPUtime=7.5 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 4553 0 0 0 748 2 0 0 19 0 8 0 661759452 326299648 4475 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/20607/statm: 79663 4552 464 189 0 74012 0
[pid=20607/tid=20608] ppid=20605 vsize=318652 CPUtime=1.02 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 485 0 0 0 102 0 0 0 19 0 8 0 661759453 326299648 4570 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=318652 CPUtime=1.02 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 744 0 0 0 102 0 0 0 18 0 8 0 661759453 326299648 4583 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=318652 CPUtime=1.09 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 444 0 0 0 109 0 0 0 19 0 8 0 661759453 326299648 4663 33554432000 4194304 4964800 140733525079040 18446744073709551615 4627536 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=318920 CPUtime=1.12 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 738 0 0 0 112 0 0 0 19 0 8 0 661759453 326574080 4882 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=319052 CPUtime=1.13 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) S 20605 20607 20239 0 -1 4202560 521 0 0 0 113 0 0 0 18 0 8 0 661759453 326709248 4940 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620398 0 0 4096 18946 18446604467935917056 0 0 -1 7 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=319052 CPUtime=1.14 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 390 0 0 0 114 0 0 0 18 0 8 0 661759453 326709248 4955 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=319052 CPUtime=1.17 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 498 0 0 0 117 0 0 0 19 0 8 0 661759453 326709248 4955 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7.5
Current children cumulated vsize (KiB) 318652

[startup+1.39507 s]
/proc/loadavg: 8.06 8.05 8.00 1/447 20607
/proc/meminfo: memFree=24977824/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=319184 CPUtime=11.19 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 5310 0 0 0 1116 3 0 0 20 0 8 0 661759452 326844416 5232 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321023 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/20607/statm: 79796 5232 464 189 0 74145 0
[pid=20607/tid=20608] ppid=20605 vsize=319184 CPUtime=1.4 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 636 0 0 0 140 0 0 0 20 0 8 0 661759453 326844416 5232 33554432000 4194304 4964800 140733525079040 18446744073709551615 4332233 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=319184 CPUtime=1.37 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 864 0 0 0 137 0 0 0 19 0 8 0 661759453 326844416 5232 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=319184 CPUtime=1.4 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 517 0 0 0 140 0 0 0 19 0 8 0 661759453 326844416 5232 33554432000 4194304 4964800 140733525079040 18446744073709551615 4325321 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=319184 CPUtime=1.39 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 765 0 0 0 139 0 0 0 20 0 8 0 661759453 326844416 5232 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=319184 CPUtime=1.39 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 532 0 0 0 139 0 0 0 19 0 8 0 661759453 326844416 5232 33554432000 4194304 4964800 140733525079040 18446744073709551615 4359851 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=319184 CPUtime=1.39 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 393 0 0 0 139 0 0 0 19 0 8 0 661759453 326844416 5232 33554432000 4194304 4964800 140733525079040 18446744073709551615 4627536 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=319184 CPUtime=1.4 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 508 0 0 0 140 0 0 0 19 0 8 0 661759453 326844416 5232 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.19
Current children cumulated vsize (KiB) 319184

[startup+1.59036 s]
/proc/loadavg: 8.06 8.05 8.00 1/447 20607
/proc/meminfo: memFree=24977824/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=319184 CPUtime=12.81 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 5506 0 0 0 1277 4 0 0 20 0 8 0 661759452 326844416 5428 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321042 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/20607/statm: 79796 5428 464 189 0 74145 0
[pid=20607/tid=20608] ppid=20605 vsize=319184 CPUtime=1.6 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 654 0 0 0 160 0 0 0 20 0 8 0 661759453 326844416 5428 33554432000 4194304 4964800 140733525079040 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=319184 CPUtime=1.57 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 929 0 0 0 157 0 0 0 19 0 8 0 661759453 326844416 5428 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=319184 CPUtime=1.6 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 526 0 0 0 160 0 0 0 20 0 8 0 661759453 326844416 5428 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=319184 CPUtime=1.59 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 780 0 0 0 159 0 0 0 20 0 8 0 661759453 326844416 5428 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=319184 CPUtime=1.59 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 553 0 0 0 159 0 0 0 19 0 8 0 661759453 326844416 5428 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=319184 CPUtime=1.59 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 419 0 0 0 159 0 0 0 19 0 8 0 661759453 326844416 5428 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670155 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=319184 CPUtime=1.6 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 521 0 0 0 160 0 0 0 20 0 8 0 661759453 326844416 5428 33554432000 4194304 4964800 140733525079040 18446744073709551615 4365917 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.81
Current children cumulated vsize (KiB) 319184

[startup+3.10085 s]
/proc/loadavg: 8.21 8.08 8.01 9/455 20615
/proc/meminfo: memFree=24952040/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=385784 CPUtime=24.72 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 6907 0 0 0 2466 6 0 0 25 0 8 0 661759452 395042816 6829 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/20607/statm: 96446 6829 464 189 0 90795 0
[pid=20607/tid=20608] ppid=20605 vsize=385784 CPUtime=3.09 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 916 0 0 0 309 0 0 0 18 0 8 0 661759453 395042816 6829 33554432000 4194304 4964800 140733525079040 18446744073709551615 4660236 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=385784 CPUtime=3.06 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 1274 0 0 0 306 0 0 0 22 0 8 0 661759453 395042816 6829 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=385784 CPUtime=3.09 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 649 0 0 0 309 0 0 0 25 0 8 0 661759453 395042816 6829 33554432000 4194304 4964800 140733525079040 18446744073709551615 4627309 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=385784 CPUtime=3.09 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 1049 0 0 0 308 1 0 0 25 0 8 0 661759453 395042816 6829 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=385784 CPUtime=3.05 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 700 0 0 0 305 0 0 0 18 0 8 0 661759453 395042816 6829 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320875 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=385784 CPUtime=3.08 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 490 0 0 0 308 0 0 0 23 0 8 0 661759453 395042816 6829 33554432000 4194304 4964800 140733525079040 18446744073709551615 4332656 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=385784 CPUtime=3.1 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 585 0 0 0 310 0 0 0 24 0 8 0 661759453 395042816 6829 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.72
Current children cumulated vsize (KiB) 385784

[startup+6.30029 s]
/proc/loadavg: 8.21 8.08 8.01 9/455 20616
/proc/meminfo: memFree=24948064/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=386564 CPUtime=50.12 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 8678 0 0 0 5003 9 0 0 25 0 8 0 661759452 395841536 8600 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634174204 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/20607/statm: 96641 8600 464 189 0 90990 0
[pid=20607/tid=20608] ppid=20605 vsize=386564 CPUtime=6.26 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 1118 0 0 0 625 1 0 0 18 0 8 0 661759453 395841536 8600 33554432000 4194304 4964800 140733525079040 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=386564 CPUtime=6.24 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 1590 0 0 0 623 1 0 0 18 0 8 0 661759453 395841536 8600 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321025 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=386564 CPUtime=6.27 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 858 0 0 0 627 0 0 0 25 0 8 0 661759453 395841536 8600 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=386564 CPUtime=6.27 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) S 20605 20607 20239 0 -1 4202560 1355 0 0 0 625 2 0 0 20 0 8 0 661759453 395841536 8600 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620398 0 0 4096 18946 18446604467935917056 0 0 -1 4 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=386564 CPUtime=6.2 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 881 0 0 0 619 1 0 0 25 0 8 0 661759453 395841536 8600 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634174402 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=386564 CPUtime=6.26 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 692 0 0 0 626 0 0 0 25 0 8 0 661759453 395841536 8600 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=386564 CPUtime=6.28 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 702 0 0 0 628 0 0 0 25 0 8 0 661759453 395841536 8600 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634213078 0 0 4096 18946 0 0 0 -1 2 0 0 0

################
# More data... #
################


[startup+4662.3 s]
/proc/loadavg: 8.02 8.03 8.01 9/455 20752
/proc/meminfo: memFree=24842136/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=404164 CPUtime=37202 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 42803 0 0 0 3717274 2928 0 0 25 0 8 0 661759452 413863936 34078 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670368 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20607/statm: 101041 34078 464 189 0 95390 0
[pid=20607/tid=20608] ppid=20605 vsize=404164 CPUtime=4642.64 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 5719 0 0 0 463810 454 0 0 19 0 8 0 661759453 413863936 34078 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=404164 CPUtime=4647.14 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 6521 0 0 0 464328 386 0 0 18 0 8 0 661759453 413863936 34078 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=404164 CPUtime=4659.62 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 4095 0 0 0 465679 283 0 0 25 0 8 0 661759453 413863936 34078 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320911 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=404164 CPUtime=4642.55 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 7192 0 0 0 463843 412 0 0 25 0 8 0 661759453 413863936 34078 33554432000 4194304 4964800 140733525079040 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=404164 CPUtime=4651.93 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 7088 0 0 0 464792 401 0 0 25 0 8 0 661759453 413863936 34078 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=404164 CPUtime=4655.8 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 4140 0 0 0 465228 352 0 0 25 0 8 0 661759453 413863936 34078 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=404164 CPUtime=4658.43 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 3168 0 0 0 465539 304 0 0 25 0 8 0 661759453 413863936 34078 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37202
Current children cumulated vsize (KiB) 404164

[startup+4722.3 s]
/proc/loadavg: 8.06 8.04 8.00 9/455 20753
/proc/meminfo: memFree=24842164/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=404164 CPUtime=37680.8 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 42968 0 0 0 3765114 2964 0 0 25 0 8 0 661759452 413863936 34159 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321093 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20607/statm: 101041 34159 464 189 0 95390 0
[pid=20607/tid=20608] ppid=20605 vsize=404164 CPUtime=4702.54 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 5724 0 0 0 469795 459 0 0 22 0 8 0 661759453 413863936 34159 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=404164 CPUtime=4707.08 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 6554 0 0 0 470318 390 0 0 21 0 8 0 661759453 413863936 34159 33554432000 4194304 4964800 140733525079040 18446744073709551615 4627443 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=404164 CPUtime=4719.6 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 4117 0 0 0 471672 288 0 0 25 0 8 0 661759453 413863936 34159 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670427 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=404164 CPUtime=4701.63 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 7205 0 0 0 469746 417 0 0 18 0 8 0 661759453 413863936 34159 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=404164 CPUtime=4711.9 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 7164 0 0 0 470785 405 0 0 20 0 8 0 661759453 413863936 34159 33554432000 4194304 4964800 140733525079040 18446744073709551615 4660177 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=404164 CPUtime=4715.76 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 4154 0 0 0 471219 357 0 0 18 0 8 0 661759453 413863936 34159 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=404164 CPUtime=4718.4 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 3169 0 0 0 471532 308 0 0 25 0 8 0 661759453 413863936 34159 33554432000 4194304 4964800 140733525079040 18446744073709551615 4660231 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37680.8
Current children cumulated vsize (KiB) 404164

[startup+4782.3 s]
/proc/loadavg: 8.12 8.06 8.01 9/455 20755
/proc/meminfo: memFree=24842236/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=404240 CPUtime=38159.6 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 43091 0 0 0 3812956 3002 0 0 25 0 8 0 661759452 413941760 34207 33554432000 4194304 4964800 140733525079040 18446744073709551615 4359904 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20607/statm: 101060 34207 464 189 0 95409 0
[pid=20607/tid=20608] ppid=20605 vsize=404240 CPUtime=4762.46 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 5764 0 0 0 475782 464 0 0 25 0 8 0 661759453 413941760 34207 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=404240 CPUtime=4766.4 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 6557 0 0 0 476245 395 0 0 18 0 8 0 661759453 413941760 34207 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=404240 CPUtime=4779.57 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 4118 0 0 0 477666 291 0 0 25 0 8 0 661759453 413941760 34207 33554432000 4194304 4964800 140733525079040 18446744073709551615 4653507 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=404240 CPUtime=4761.37 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 7262 0 0 0 475715 422 0 0 25 0 8 0 661759453 413941760 34207 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320916 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=404240 CPUtime=4771.86 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 7166 0 0 0 476775 411 0 0 18 0 8 0 661759453 413941760 34207 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=404240 CPUtime=4775.73 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 4167 0 0 0 477209 364 0 0 25 0 8 0 661759453 413941760 34207 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=404240 CPUtime=4778.35 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 3169 0 0 0 477524 311 0 0 25 0 8 0 661759453 413941760 34207 33554432000 4194304 4964800 140733525079040 18446744073709551615 4627338 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38159.6
Current children cumulated vsize (KiB) 404240

[startup+4842.3 s]
/proc/loadavg: 8.09 8.06 8.01 9/455 20757
/proc/meminfo: memFree=24841976/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=404240 CPUtime=38638.3 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 43179 0 0 0 3860790 3042 0 0 25 0 8 0 661759452 413941760 34250 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20607/statm: 101060 34250 464 189 0 95409 0
[pid=20607/tid=20608] ppid=20605 vsize=404240 CPUtime=4822.35 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 5768 0 0 0 481764 471 0 0 21 0 8 0 661759453 413941760 34250 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=404240 CPUtime=4826.35 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 6586 0 0 0 482235 400 0 0 20 0 8 0 661759453 413941760 34250 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670511 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=404240 CPUtime=4839.54 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 4146 0 0 0 483659 295 0 0 25 0 8 0 661759453 413941760 34250 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=404240 CPUtime=4820.43 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 7262 0 0 0 481616 427 0 0 25 0 8 0 661759453 413941760 34250 33554432000 4194304 4964800 140733525079040 18446744073709551615 4332341 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=404240 CPUtime=4831.83 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 7173 0 0 0 482766 417 0 0 25 0 8 0 661759453 413941760 34250 33554432000 4194304 4964800 140733525079040 18446744073709551615 4342174 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=404240 CPUtime=4835.68 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 4168 0 0 0 483200 368 0 0 25 0 8 0 661759453 413941760 34250 33554432000 4194304 4964800 140733525079040 18446744073709551615 4325321 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=404240 CPUtime=4838.33 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 3186 0 0 0 483517 316 0 0 20 0 8 0 661759453 413941760 34250 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38638.3
Current children cumulated vsize (KiB) 404240

[startup+4902.3 s]
/proc/loadavg: 8.08 8.06 8.01 9/455 20758
/proc/meminfo: memFree=24841888/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=404240 CPUtime=39117.1 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 43219 0 0 0 3908624 3081 0 0 18 0 8 0 661759452 413941760 34215 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20607/statm: 101060 34215 464 189 0 95409 0
[pid=20607/tid=20608] ppid=20605 vsize=404240 CPUtime=4882.26 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 5784 0 0 0 487750 476 0 0 20 0 8 0 661759453 413941760 34215 33554432000 4194304 4964800 140733525079040 18446744073709551615 4332418 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=404240 CPUtime=4886.3 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 6586 0 0 0 488224 406 0 0 25 0 8 0 661759453 413941760 34215 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670511 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=404240 CPUtime=4899.52 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 4152 0 0 0 489653 299 0 0 25 0 8 0 661759453 413941760 34215 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670361 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=404240 CPUtime=4880.36 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 7263 0 0 0 487605 431 0 0 25 0 8 0 661759453 413941760 34215 33554432000 4194304 4964800 140733525079040 18446744073709551615 4342144 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=404240 CPUtime=4891.62 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 7174 0 0 0 488740 422 0 0 25 0 8 0 661759453 413941760 34215 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=404240 CPUtime=4895.62 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 4171 0 0 0 489189 373 0 0 25 0 8 0 661759453 413941760 34215 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320953 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=404240 CPUtime=4897.57 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 3198 0 0 0 489438 319 0 0 25 0 8 0 661759453 413941760 34215 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39117
Current children cumulated vsize (KiB) 404240

[startup+4962.3 s]
/proc/loadavg: 8.11 8.08 8.01 9/455 20760
/proc/meminfo: memFree=24841704/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=404296 CPUtime=39595.8 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 43326 0 0 0 3956462 3119 0 0 25 0 8 0 661759452 413999104 34252 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670335 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20607/statm: 101074 34252 464 189 0 95423 0
[pid=20607/tid=20608] ppid=20605 vsize=404296 CPUtime=4942.18 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 5811 0 0 0 493736 482 0 0 20 0 8 0 661759453 413999104 34252 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=404296 CPUtime=4946.24 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 6588 0 0 0 494213 411 0 0 25 0 8 0 661759453 413999104 34252 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=404296 CPUtime=4959.48 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 4160 0 0 0 495645 303 0 0 25 0 8 0 661759453 413999104 34252 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320934 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=404296 CPUtime=4940.32 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 7266 0 0 0 493596 436 0 0 25 0 8 0 661759453 413999104 34252 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=404296 CPUtime=4951.58 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 7175 0 0 0 494729 429 0 0 25 0 8 0 661759453 413999104 34252 33554432000 4194304 4964800 140733525079040 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=404296 CPUtime=4955.58 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 4226 0 0 0 495181 377 0 0 19 0 8 0 661759453 413999104 34252 33554432000 4194304 4964800 140733525079040 18446744073709551615 4321097 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=404296 CPUtime=4956.66 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 3198 0 0 0 495343 323 0 0 25 0 8 0 661759453 413999104 34252 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39595.8
Current children cumulated vsize (KiB) 404296



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5013 s]
/proc/loadavg: 8.05 8.06 8.01 9/455 20761
/proc/meminfo: memFree=24841792/32951124 swapFree=53501244/67111528
[pid=20607] ppid=20605 vsize=404432 CPUtime=40000.5 cores=0-7
/proc/20607/stat : 20607 (claspmt) R 20605 20607 20239 0 -1 4202496 43460 0 0 0 3996893 3153 0 0 20 0 8 0 661759452 414138368 34274 33554432000 4194304 4964800 140733525079040 18446744073709551615 4654511 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/20607/statm: 101108 34274 464 189 0 95457 0
[pid=20607/tid=20608] ppid=20605 vsize=404432 CPUtime=4992.83 cores=0-7
/proc/20607/task/20608/stat : 20608 (claspmt) R 20605 20607 20239 0 -1 4202560 5831 0 0 0 498797 486 0 0 25 0 8 0 661759453 414138368 34274 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=20607/tid=20609] ppid=20605 vsize=404432 CPUtime=4996.9 cores=0-7
/proc/20607/task/20609/stat : 20609 (claspmt) R 20605 20607 20239 0 -1 4202560 6596 0 0 0 499274 416 0 0 18 0 8 0 661759453 414138368 34274 33554432000 4194304 4964800 140733525079040 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20607/tid=20610] ppid=20605 vsize=404432 CPUtime=5010.18 cores=0-7
/proc/20607/task/20610/stat : 20610 (claspmt) R 20605 20607 20239 0 -1 4202560 4160 0 0 0 500712 306 0 0 25 0 8 0 661759453 414138368 34274 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670407 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=20607/tid=20611] ppid=20605 vsize=404432 CPUtime=4991 cores=0-7
/proc/20607/task/20611/stat : 20611 (claspmt) R 20605 20607 20239 0 -1 4202560 7274 0 0 0 498659 441 0 0 25 0 8 0 661759453 414138368 34274 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=20607/tid=20612] ppid=20605 vsize=404432 CPUtime=5002.24 cores=0-7
/proc/20607/task/20612/stat : 20612 (claspmt) R 20605 20607 20239 0 -1 4202560 7181 0 0 0 499791 433 0 0 25 0 8 0 661759453 414138368 34274 33554432000 4194304 4964800 140733525079040 18446744073709551615 216634620447 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=20607/tid=20613] ppid=20605 vsize=404432 CPUtime=5006.25 cores=0-7
/proc/20607/task/20613/stat : 20613 (claspmt) R 20605 20607 20239 0 -1 4202560 4252 0 0 0 500243 382 0 0 25 0 8 0 661759453 414138368 34274 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=20607/tid=20614] ppid=20605 vsize=404432 CPUtime=5006.61 cores=0-7
/proc/20607/task/20614/stat : 20614 (claspmt) R 20605 20607 20239 0 -1 4202560 3200 0 0 0 500334 327 0 0 25 0 8 0 661759453 414138368 34274 33554432000 4194304 4964800 140733525079040 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 404432

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 5013.04
CPU time (s): 40000.5
CPU user time (s): 39969
CPU system time (s): 31.5412
CPU usage (%): 797.93
Max. virtual memory (cumulated for all children) (KiB): 404432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39969
system time used= 31.5412
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 43474
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5332110
involuntary context switches= 190324

runsolver used 22.0596 second user time and 50.8653 second system time

The end

Launcher Data 

Begin job on node103 at 2011-05-16 01:19:28
IDJOB=3381051
IDBENCH=83223
IDSOLVER=1865
FILE ID=node103/3381051-1305501568
RUNJOBID= node103-1305496446-20253
PBS_JOBID= 13325438
Free space on /tmp= 72964 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-16-16-unsat.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3381051-1305501568/watcher-3381051-1305501568 -o /tmp/evaluation-result-3381051-1305501568/solver-3381051-1305501568 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3381051-1305501568.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= c07743bac800f91e403382f26717b1d0
RANDOM SEED=280417760

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24978096 kB
Buffers:        339248 kB
Cached:        4160388 kB
SwapCached:     340184 kB
Active:        2462592 kB
Inactive:      5211864 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24978096 kB
SwapTotal:    67111528 kB
SwapFree:     53501244 kB
Dirty:             868 kB
Writeback:           0 kB
AnonPages:     2845360 kB
Mapped:          21348 kB
Slab:           163396 kB
PageTables:      66632 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 137669448 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72960 MiB
End job on node103 at 2011-05-16 02:43:03