Trace number 3381018

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.6 5010.08

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-6x40.cnf
MD5SUM3a7a68cedc6ab84c0df9c27d166b0b6b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables960
Number of clauses48480
Sum of the clauses size191040
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21440
Number of clauses of size 30
Number of clauses of size 447040
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...500424/instance-3381018-1305500424.cnf
0.79/0.83	c Solving...
40000.28/5009.82	
40000.28/5009.82	*** INTERRUPTED! ***
40000.28/5009.82	*** Shutting down threads...
40000.52/5010.07	s UNKNOWN
40000.52/5010.07	
40000.52/5010.07	c INTERRUPTED   : 1
40000.52/5010.07	c Models        : 0+    
40000.52/5010.07	c Time          : 5009.818s (Solving: 5008.99s 1st Model: 0.00s Unsat: 0.00s)
40000.52/5010.07	c CPU Time      : 40000.340s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3381018-1305500424/watcher-3381018-1305500424 -o /tmp/evaluation-result-3381018-1305500424/solver-3381018-1305500424 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3381018-1305500424.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.98 8.44 8.39 2/383 11800
/proc/meminfo: memFree=20864736/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=22756 CPUtime=0.01 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 1038 0 0 0 1 0 0 0 25 0 1 0 642458518 23302144 872 33554432000 4194304 4964800 140736562421488 18446744073709551615 255106429985 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/11800/statm: 5689 873 386 189 0 563 0

[startup+0.0513221 s]
/proc/loadavg: 7.98 8.44 8.39 2/383 11800
/proc/meminfo: memFree=20864736/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=25316 CPUtime=0.05 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 1768 0 0 0 5 0 0 0 25 0 1 0 642458518 25923584 1513 33554432000 4194304 4964800 140736562421488 18446744073709551615 4607472 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/11800/statm: 6329 1513 399 189 0 1203 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 25316

[startup+0.100313 s]
/proc/loadavg: 7.98 8.44 8.39 2/383 11800
/proc/meminfo: memFree=20864736/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=25316 CPUtime=0.09 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 1768 0 0 0 9 0 0 0 25 0 1 0 642458518 25923584 1513 33554432000 4194304 4964800 140736562421488 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/11800/statm: 6329 1513 399 189 0 1203 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25316

[startup+0.300278 s]
/proc/loadavg: 7.98 8.44 8.39 2/383 11800
/proc/meminfo: memFree=20864736/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=27032 CPUtime=0.29 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 2206 0 0 0 29 0 0 0 25 0 1 0 642458518 27680768 1951 33554432000 4194304 4964800 140736562421488 18446744073709551615 4600730 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/11800/statm: 6758 1951 400 189 0 1632 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 27032

[startup+0.700206 s]
/proc/loadavg: 7.98 8.44 8.39 2/383 11800
/proc/meminfo: memFree=20864736/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=28880 CPUtime=0.69 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 2669 0 0 0 69 0 0 0 25 0 1 0 642458518 29573120 2414 33554432000 4194304 4964800 140736562421488 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/11800/statm: 7220 2414 400 189 0 2094 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 28880

[startup+1.50103 s]
/proc/loadavg: 7.98 8.44 8.39 9/391 11808
/proc/meminfo: memFree=20823760/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=464208 CPUtime=5.8 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 18531 0 0 0 570 10 0 0 18 0 8 0 642458518 475348992 18142 33554432000 4194304 4964800 140736562421488 18446744073709551615 4362289 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/11800/statm: 116052 18142 464 189 0 110401 0
[pid=11800/tid=11802] ppid=11798 vsize=464208 CPUtime=0.62 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 1891 0 0 0 61 1 0 0 18 0 8 0 642458601 475348992 18144 33554432000 4194304 4964800 140736562421488 18446744073709551615 4682109 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=464208 CPUtime=0.6 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 2295 0 0 0 59 1 0 0 18 0 8 0 642458601 475348992 18145 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=464208 CPUtime=0.59 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 1961 0 0 0 58 1 0 0 18 0 8 0 642458601 475348992 18145 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=464208 CPUtime=0.63 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 2184 0 0 0 62 1 0 0 18 0 8 0 642458601 475348992 18145 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=464208 CPUtime=0.63 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 1504 0 0 0 63 0 0 0 18 0 8 0 642458601 475348992 18145 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=464208 CPUtime=0.63 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 1754 0 0 0 62 1 0 0 18 0 8 0 642458601 475348992 18145 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=464208 CPUtime=0.63 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 2167 0 0 0 62 1 0 0 18 0 8 0 642458601 475348992 18145 33554432000 4194304 4964800 140736562421488 18446744073709551615 255106429985 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.8
Current children cumulated vsize (KiB) 464208

[startup+3.10075 s]
/proc/loadavg: 7.98 8.44 8.39 9/391 11808
/proc/meminfo: memFree=20785584/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=466988 CPUtime=18.56 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 23702 0 0 0 1843 13 0 0 20 0 8 0 642458518 478195712 23313 33554432000 4194304 4964800 140736562421488 18446744073709551615 4321016 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/11800/statm: 116747 23313 466 189 0 111096 0
[pid=11800/tid=11802] ppid=11798 vsize=466988 CPUtime=2.21 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 2369 0 0 0 220 1 0 0 21 0 8 0 642458601 478195712 23313 33554432000 4194304 4964800 140736562421488 18446744073709551615 4647544 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=466988 CPUtime=2.18 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 2970 0 0 0 217 1 0 0 21 0 8 0 642458601 478195712 23313 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=466988 CPUtime=2.19 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 2582 0 0 0 218 1 0 0 21 0 8 0 642458601 478195712 23313 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=466988 CPUtime=2.22 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 2825 0 0 0 221 1 0 0 20 0 8 0 642458601 478195712 23313 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=466988 CPUtime=2.23 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 2199 0 0 0 222 1 0 0 21 0 8 0 642458601 478195712 23313 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=466988 CPUtime=2.22 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 2524 0 0 0 221 1 0 0 21 0 8 0 642458601 478195712 23313 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=466988 CPUtime=2.23 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 2924 0 0 0 221 2 0 0 21 0 8 0 642458601 478195712 23314 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 18.56
Current children cumulated vsize (KiB) 466988

[startup+6.30119 s]
/proc/loadavg: 7.98 8.43 8.39 10/391 11808
/proc/meminfo: memFree=20746400/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=473384 CPUtime=44.09 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 34341 0 0 0 4390 19 0 0 25 0 8 0 642458518 484745216 33952 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/11800/statm: 118346 33952 466 189 0 112695 0
[pid=11800/tid=11802] ppid=11798 vsize=473384 CPUtime=5.41 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 3438 0 0 0 539 2 0 0 19 0 8 0 642458601 484745216 33952 33554432000 4194304 4964800 140736562421488 18446744073709551615 4632224 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=473384 CPUtime=5.33 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 4495 0 0 0 531 2 0 0 25 0 8 0 642458601 484745216 33952 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=473384 CPUtime=5.38 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 4082 0 0 0 537 1 0 0 25 0 8 0 642458601 484745216 33952 33554432000 4194304 4964800 140736562421488 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=473384 CPUtime=5.42 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 3910 0 0 0 541 1 0 0 25 0 8 0 642458601 484745216 33952 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=473384 CPUtime=5.42 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 3435 0 0 0 541 1 0 0 25 0 8 0 642458601 484745216 33952 33554432000 4194304 4964800 140736562421488 18446744073709551615 4627179 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=473384 CPUtime=5.42 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 4053 0 0 0 540 2 0 0 25 0 8 0 642458601 484745216 33952 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=473384 CPUtime=5.43 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 4595 0 0 0 540 3 0 0 25 0 8 0 642458601 484745216 33952 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 44.09
Current children cumulated vsize (KiB) 473384

[startup+12.7011 s]
/proc/loadavg: 7.98 8.42 8.39 9/391 11808
/proc/meminfo: memFree=20677560/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=484604 CPUtime=95.19 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 49511 0 0 0 9491 28 0 0 20 0 8 0 642458518 496234496 48941 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/11800/statm: 121151 48941 466 189 0 115500 0
[pid=11800/tid=11802] ppid=11798 vsize=484604 CPUtime=11.8 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 5228 0 0 0 1177 3 0 0 25 0 8 0 642458601 496234496 48941 33554432000 4194304 4964800 140736562421488 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=484604 CPUtime=11.65 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 7412 0 0 0 1161 4 0 0 25 0 8 0 642458601 496234496 48941 33554432000 4194304 4964800 140736562421488 18446744073709551615 4687029 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=484604 CPUtime=11.78 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 5687 0 0 0 1176 2 0 0 25 0 8 0 642458601 496234496 48941 33554432000 4194304 4964800 140736562421488 18446744073709551615 4654535 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=484604 CPUtime=11.82 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 5427 0 0 0 1180 2 0 0 25 0 8 0 642458601 496234496 48941 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=484604 CPUtime=11.81 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 5446 0 0 0 1179 2 0 0 25 0 8 0 642458601 496234496 48941 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=484604 CPUtime=11.82 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 5899 0 0 0 1180 2 0 0 25 0 8 0 642458601 496234496 48941 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=484604 CPUtime=11.82 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 6775 0 0 0 1178 4 0 0 25 0 8 0 642458601 496234496 48941 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 95.19
Current children cumulated vsize (KiB) 484604

[startup+25.5008 s]
/proc/loadavg: 7.98 8.40 8.38 9/391 11808
/proc/meminfo: memFree=20612828/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=491840 CPUtime=197.38 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 66011 0 0 0 19698 40 0 0 25 0 8 0 642458518 503644160 65165 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320955 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/11800/statm: 122960 65165 466 189 0 117309 0
[pid=11800/tid=11802] ppid=11798 vsize=491840 CPUtime=24.57 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 7196 0 0 0 2452 5 0 0 25 0 8 0 642458601 503644160 65165 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=491840 CPUtime=24.29 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 9324 0 0 0 2423 6 0 0 25 0 8 0 642458601 503644160 65165 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=491840 CPUtime=24.58 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 7464 0 0 0 2454 4 0 0 25 0 8 0 642458601 503644160 65165 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=491840 CPUtime=24.62 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 7605 0 0 0 2459 3 0 0 25 0 8 0 642458601 503644160 65165 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=491840 CPUtime=24.62 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 8779 0 0 0 2457 5 0 0 25 0 8 0 642458601 503644160 65165 33554432000 4194304 4964800 140736562421488 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=491840 CPUtime=24.61 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 7693 0 0 0 2458 3 0 0 25 0 8 0 642458601 503644160 65165 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=491840 CPUtime=24.63 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 9057 0 0 0 2457 6 0 0 25 0 8 0 642458601 503644160 65165 33554432000 4194304 4964800 140736562421488 18446744073709551615 255106873887 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 197.38
Current children cumulated vsize (KiB) 491840

[startup+51.1013 s]
/proc/loadavg: 7.99 8.37 8.37 9/391 11818
/proc/meminfo: memFree=20538260/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=504936 CPUtime=401.77 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 84105 0 0 0 40122 55 0 0 25 0 8 0 642458518 517054464 83233 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/11800/statm: 126234 83233 466 189 0 120583 0
[pid=11800/tid=11802] ppid=11798 vsize=504936 CPUtime=50.17 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 9216 0 0 0 5010 7 0 0 25 0 8 0 642458601 517054464 83233 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=504936 CPUtime=49.55 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 12341 0 0 0 4947 8 0 0 25 0 8 0 642458601 517054464 83233 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=504936 CPUtime=50.17 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 8984 0 0 0 5012 5 0 0 25 0 8 0 642458601 517054464 83233 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320939 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=504936 CPUtime=50.19 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 9060 0 0 0 5015 4 0 0 25 0 8 0 642458601 517054464 83233 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=504936 CPUtime=50.21 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 11076 0 0 0 5014 7 0 0 25 0 8 0 642458601 517054464 83233 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=504936 CPUtime=50.21 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 9185 0 0 0 5016 5 0 0 25 0 8 0 642458601 517054464 83233 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=504936 CPUtime=50.21 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 13062 0 0 0 5013 8 0 0 25 0 8 0 642458601 517054464 83233 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 401.77

################
# More data... #
################

[pid=11800/tid=11803] ppid=11798 vsize=1865052 CPUtime=4652.56 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 69743 0 0 0 465153 103 0 0 25 0 8 0 642458601 1909813248 365776 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=1865052 CPUtime=4657.05 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 36398 0 0 0 465633 72 0 0 25 0 8 0 642458601 1909813248 365776 33554432000 4194304 4964800 140736562421488 18446744073709551615 4659391 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=1865052 CPUtime=4651.05 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 46307 0 0 0 465040 65 0 0 25 0 8 0 642458601 1909813248 365776 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=1865052 CPUtime=4660.79 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 48988 0 0 0 466015 64 0 0 25 0 8 0 642458601 1909813248 365776 33554432000 4194304 4964800 140736562421488 18446744073709551615 4321097 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=1865052 CPUtime=4660.38 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 33373 0 0 0 465972 66 0 0 20 0 8 0 642458601 1909813248 365776 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=1865052 CPUtime=4652.54 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 50739 0 0 0 465165 89 0 0 25 0 8 0 642458601 1909813248 365776 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37225
Current children cumulated vsize (KiB) 1865052

[startup+4722.32 s]
/proc/loadavg: 8.01 8.05 8.00 9/391 11955
/proc/meminfo: memFree=19399644/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=1865720 CPUtime=37704.3 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 389944 0 0 0 3769782 650 0 0 25 0 8 0 642458518 1910497280 367034 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/11800/statm: 466430 367034 466 189 0 460779 0
[pid=11800/tid=11802] ppid=11798 vsize=1865720 CPUtime=4711.01 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 56193 0 0 0 471009 92 0 0 25 0 8 0 642458601 1910497280 367034 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=1865720 CPUtime=4712.57 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 70201 0 0 0 471154 103 0 0 25 0 8 0 642458601 1910497280 367034 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=1865720 CPUtime=4717.04 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 36714 0 0 0 471632 72 0 0 25 0 8 0 642458601 1910497280 367034 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=1865720 CPUtime=4711.05 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 46733 0 0 0 471040 65 0 0 25 0 8 0 642458601 1910497280 367034 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=1865720 CPUtime=4720.79 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 49012 0 0 0 472015 64 0 0 25 0 8 0 642458601 1910497280 367034 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=1865720 CPUtime=4720.4 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 33383 0 0 0 471973 67 0 0 25 0 8 0 642458601 1910497280 367034 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=1865720 CPUtime=4712.55 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 50739 0 0 0 471166 89 0 0 25 0 8 0 642458601 1910497280 367034 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37704.3
Current children cumulated vsize (KiB) 1865720

[startup+4782.3 s]
/proc/loadavg: 8.00 8.04 8.00 9/391 11956
/proc/meminfo: memFree=19388976/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=1870328 CPUtime=38183.4 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 392822 0 0 0 3817678 658 0 0 25 0 8 0 642458518 1915215872 369678 33554432000 4194304 4964800 140736562421488 18446744073709551615 4321016 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/11800/statm: 467582 369678 466 189 0 461931 0
[pid=11800/tid=11802] ppid=11798 vsize=1870328 CPUtime=4770.21 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 56513 0 0 0 476929 92 0 0 25 0 8 0 642458601 1915215872 369678 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=1870328 CPUtime=4772.56 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 71126 0 0 0 477151 105 0 0 25 0 8 0 642458601 1915215872 369678 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=1870328 CPUtime=4777.02 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 37016 0 0 0 477629 73 0 0 25 0 8 0 642458601 1915215872 369678 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=1870328 CPUtime=4771.04 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 47027 0 0 0 477037 67 0 0 25 0 8 0 642458601 1915215872 369678 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=1870328 CPUtime=4780.76 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 49013 0 0 0 478012 64 0 0 25 0 8 0 642458601 1915215872 369678 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=1870328 CPUtime=4780.38 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 33640 0 0 0 477970 68 0 0 25 0 8 0 642458601 1915215872 369678 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=1870328 CPUtime=4772.53 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 51233 0 0 0 477162 91 0 0 25 0 8 0 642458601 1915215872 369678 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38183.4
Current children cumulated vsize (KiB) 1870328

[startup+4842.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/391 11958
/proc/meminfo: memFree=19381152/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=1870328 CPUtime=38662.5 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 395030 0 0 0 3865586 664 0 0 25 0 8 0 642458518 1915215872 371646 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/11800/statm: 467582 371646 466 189 0 461931 0
[pid=11800/tid=11802] ppid=11798 vsize=1870328 CPUtime=4829.43 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 56792 0 0 0 482850 93 0 0 25 0 8 0 642458601 1915215872 371646 33554432000 4194304 4964800 140736562421488 18446744073709551615 4627438 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=1870328 CPUtime=4832.55 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 71749 0 0 0 483149 106 0 0 25 0 8 0 642458601 1915215872 371646 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=1870328 CPUtime=4837 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 37021 0 0 0 483626 74 0 0 25 0 8 0 642458601 1915215872 371646 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=1870328 CPUtime=4831.03 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 47758 0 0 0 483035 68 0 0 25 0 8 0 642458601 1915215872 371646 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=1870328 CPUtime=4840.76 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 49397 0 0 0 484010 66 0 0 25 0 8 0 642458601 1915215872 371646 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=1870328 CPUtime=4840.37 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 33671 0 0 0 483969 68 0 0 25 0 8 0 642458601 1915215872 371646 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=1870328 CPUtime=4832.53 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 51298 0 0 0 483160 93 0 0 25 0 8 0 642458601 1915215872 371646 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38662.5
Current children cumulated vsize (KiB) 1870328

[startup+4902.3 s]
/proc/loadavg: 8.06 8.05 8.00 9/391 11959
/proc/meminfo: memFree=19378044/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=1870328 CPUtime=39141.7 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 395999 0 0 0 3913498 668 0 0 25 0 8 0 642458518 1915215872 372482 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/11800/statm: 467582 372482 466 189 0 461931 0
[pid=11800/tid=11802] ppid=11798 vsize=1870328 CPUtime=4888.67 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 56915 0 0 0 488773 94 0 0 25 0 8 0 642458601 1915215872 372482 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=1870328 CPUtime=4892.54 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 71942 0 0 0 489148 106 0 0 25 0 8 0 642458601 1915215872 372482 33554432000 4194304 4964800 140736562421488 18446744073709551615 4650926 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=1870328 CPUtime=4896.97 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 37025 0 0 0 489623 74 0 0 25 0 8 0 642458601 1915215872 372482 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=1870328 CPUtime=4891.02 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 48318 0 0 0 489034 68 0 0 25 0 8 0 642458601 1915215872 372482 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=1870328 CPUtime=4900.74 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 49438 0 0 0 490008 66 0 0 25 0 8 0 642458601 1915215872 372482 33554432000 4194304 4964800 140736562421488 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=1870328 CPUtime=4900.37 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 33719 0 0 0 489968 69 0 0 25 0 8 0 642458601 1915215872 372482 33554432000 4194304 4964800 140736562421488 18446744073709551615 4363327 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=1870328 CPUtime=4892.52 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 51298 0 0 0 489159 93 0 0 25 0 8 0 642458601 1915215872 372482 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39141.7
Current children cumulated vsize (KiB) 1870328

[startup+4962.3 s]
/proc/loadavg: 8.06 8.05 8.00 9/391 11961
/proc/meminfo: memFree=19374220/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=1870328 CPUtime=39620.8 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 396936 0 0 0 3961410 673 0 0 25 0 8 0 642458518 1915215872 373364 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670335 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/11800/statm: 467582 373364 466 189 0 461931 0
[pid=11800/tid=11802] ppid=11798 vsize=1870328 CPUtime=4948.64 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 56978 0 0 0 494770 94 0 0 25 0 8 0 642458601 1915215872 373364 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=1870328 CPUtime=4951.78 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 72382 0 0 0 495070 108 0 0 25 0 8 0 642458601 1915215872 373364 33554432000 4194304 4964800 140736562421488 18446744073709551615 4325293 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=1870328 CPUtime=4956.95 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 37043 0 0 0 495621 74 0 0 25 0 8 0 642458601 1915215872 373364 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=1870328 CPUtime=4951.02 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 48704 0 0 0 495033 69 0 0 25 0 8 0 642458601 1915215872 373364 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=1870328 CPUtime=4960.73 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 49446 0 0 0 496007 66 0 0 25 0 8 0 642458601 1915215872 373364 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=1870328 CPUtime=4960.36 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 33732 0 0 0 495967 69 0 0 25 0 8 0 642458601 1915215872 373364 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=1870328 CPUtime=4952.51 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 51300 0 0 0 495158 93 0 0 25 0 8 0 642458601 1915215872 373364 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39620.8
Current children cumulated vsize (KiB) 1870328



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.8 s]
/proc/loadavg: 8.08 8.06 8.00 9/391 11962
/proc/meminfo: memFree=19371740/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=1870896 CPUtime=40000.3 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 397672 0 0 0 3999351 677 0 0 25 0 8 0 642458518 1915797504 373986 33554432000 4194304 4964800 140736562421488 18446744073709551615 4320970 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/11800/statm: 467724 373986 466 189 0 462073 0
[pid=11800/tid=11802] ppid=11798 vsize=1870896 CPUtime=4996.15 cores=0-7
/proc/11800/task/11802/stat : 11802 (claspmt) R 11798 11800 11774 0 -1 4202560 57121 0 0 0 499520 95 0 0 25 0 8 0 642458601 1915797504 373986 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=11800/tid=11803] ppid=11798 vsize=1870896 CPUtime=4998.67 cores=0-7
/proc/11800/task/11803/stat : 11803 (claspmt) R 11798 11800 11774 0 -1 4202560 72542 0 0 0 499759 108 0 0 25 0 8 0 642458601 1915797504 373986 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=11800/tid=11804] ppid=11798 vsize=1870896 CPUtime=5004.46 cores=0-7
/proc/11800/task/11804/stat : 11804 (claspmt) R 11798 11800 11774 0 -1 4202560 37103 0 0 0 500371 75 0 0 25 0 8 0 642458601 1915797504 373986 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=11800/tid=11805] ppid=11798 vsize=1870896 CPUtime=4998.53 cores=0-7
/proc/11800/task/11805/stat : 11805 (claspmt) R 11798 11800 11774 0 -1 4202560 48858 0 0 0 499783 70 0 0 25 0 8 0 642458601 1915797504 373986 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=11800/tid=11806] ppid=11798 vsize=1870896 CPUtime=5008.24 cores=0-7
/proc/11800/task/11806/stat : 11806 (claspmt) R 11798 11800 11774 0 -1 4202560 49451 0 0 0 500758 66 0 0 25 0 8 0 642458601 1915797504 373986 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=11800/tid=11807] ppid=11798 vsize=1870896 CPUtime=5007.88 cores=0-7
/proc/11800/task/11807/stat : 11807 (claspmt) R 11798 11800 11774 0 -1 4202560 33849 0 0 0 500718 70 0 0 25 0 8 0 642458601 1915797504 373986 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=11800/tid=11808] ppid=11798 vsize=1870896 CPUtime=5000.01 cores=0-7
/proc/11800/task/11808/stat : 11808 (claspmt) R 11798 11800 11774 0 -1 4202560 51337 0 0 0 499908 93 0 0 25 0 8 0 642458601 1915797504 373986 33554432000 4194304 4964800 140736562421488 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 1870896

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010 s]
/proc/loadavg: 8.08 8.06 8.00 9/391 11962
/proc/meminfo: memFree=19371740/32951124 swapFree=67111348/67111528
[pid=11800] ppid=11798 vsize=1864400 CPUtime=40000.5 cores=0-7
/proc/11800/stat : 11800 (claspmt) R 11798 11800 11774 0 -1 4202496 397682 0 0 0 3999375 677 0 0 25 0 1 0 642458518 1909145600 370576 33554432000 4194304 4964800 140736562421488 18446744073709551615 255106424987 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/11800/statm: 466100 370576 476 189 0 460449 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 1864400

Child status: 0
Real time (s): 5010.08
CPU time (s): 40000.6
CPU user time (s): 39993.8
CPU system time (s): 6.84796
CPU usage (%): 798.402
Max. virtual memory (cumulated for all children) (KiB): 1870896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39993.8
system time used= 6.84796
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 397683
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 514954
involuntary context switches= 189305

runsolver used 17.2974 second user time and 46.4799 second system time

The end

Launcher Data 

Begin job on node144 at 2011-05-16 01:00:24
IDJOB=3381018
IDBENCH=83178
IDSOLVER=1865
FILE ID=node144/3381018-1305500424
RUNJOBID= node144-1305500424-11788
PBS_JOBID= 13325458
Free space on /tmp= 73224 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-6x40.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3381018-1305500424/watcher-3381018-1305500424 -o /tmp/evaluation-result-3381018-1305500424/solver-3381018-1305500424 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3381018-1305500424.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3a7a68cedc6ab84c0df9c27d166b0b6b
RANDOM SEED=802172851

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20865016 kB
Buffers:        323872 kB
Cached:        3962320 kB
SwapCached:          0 kB
Active:        8814688 kB
Inactive:      2910168 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20865016 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            2052 kB
Writeback:           0 kB
AnonPages:     7439380 kB
Mapped:          32680 kB
Slab:           249956 kB
PageTables:      40956 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 108098284 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73224 MiB
End job on node144 at 2011-05-16 02:23:56