Trace number 3380596

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.3 5005.85

General information on the benchmark

NameAPPLICATIONS/bitverif/countbitsarray/
countbitsarray04_32.cnf
MD5SUM2fe3650d4a602f63086e937176360ebb
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables8750
Number of clauses25865
Sum of the clauses size60349
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 217242
Number of clauses of size 38621
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...482709/instance-3380596-1305482709.cnf
0.00/0.05	c Solving...
40000.13/5005.72	
40000.13/5005.72	*** INTERRUPTED! ***
40000.13/5005.72	*** Shutting down threads...
40000.27/5005.84	s UNKNOWN
40000.27/5005.84	
40000.27/5005.84	c INTERRUPTED   : 1
40000.27/5005.84	c Models        : 0+    
40000.27/5005.84	c Time          : 5005.720s (Solving: 5005.67s 1st Model: 0.00s Unsat: 0.00s)
40000.27/5005.84	c CPU Time      : 40000.190s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380596-1305482709/watcher-3380596-1305482709 -o /tmp/evaluation-result-3380596-1305482709/solver-3380596-1305482709 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380596-1305482709.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.61 7.77 5.64 2/238 23386
/proc/meminfo: memFree=22797952/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=22968 CPUtime=0 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 1077 0 0 0 0 0 0 0 24 0 1 0 659871615 23519232 939 33554432000 4194304 4964800 140735851297440 18446744073709551615 4309940 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/23386/statm: 5742 940 386 189 0 616 0

[startup+0.175564 s]
/proc/loadavg: 7.61 7.77 5.64 2/238 23386
/proc/meminfo: memFree=22797952/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=390184 CPUtime=0.76 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 5267 0 0 0 75 1 0 0 25 0 8 0 659871615 399548416 4394 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668805 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 97546 4394 462 189 0 91895 0
Current children cumulated CPU time (s) 0.76
Current children cumulated vsize (KiB) 390184

[startup+0.336626 s]
/proc/loadavg: 7.61 7.77 5.64 2/238 23386
/proc/meminfo: memFree=22797952/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=390340 CPUtime=3.01 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 6527 0 0 0 299 2 0 0 25 0 8 0 659871615 399708160 5654 33554432000 4194304 4964800 140735851297440 18446744073709551615 4669136 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 97585 5654 464 189 0 91934 0
Current children cumulated CPU time (s) 3.01
Current children cumulated vsize (KiB) 390340

[startup+0.534211 s]
/proc/loadavg: 7.61 7.77 5.64 2/238 23386
/proc/meminfo: memFree=22797952/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=390868 CPUtime=4.04 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 7353 0 0 0 401 3 0 0 25 0 8 0 659871615 400248832 6480 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 97717 6480 464 189 0 92066 0
Current children cumulated CPU time (s) 4.04
Current children cumulated vsize (KiB) 390868

[startup+0.991547 s]
/proc/loadavg: 7.61 7.77 5.64 2/238 23386
/proc/meminfo: memFree=22797952/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=391616 CPUtime=7.44 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 8279 0 0 0 740 4 0 0 25 0 8 0 659871615 401014784 7406 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 97904 7406 464 189 0 92253 0
Current children cumulated CPU time (s) 7.44
Current children cumulated vsize (KiB) 391616

[startup+1.50034 s]
/proc/loadavg: 7.61 7.77 5.64 2/238 23386
/proc/meminfo: memFree=22797952/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=392012 CPUtime=11.32 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 9158 0 0 0 1128 4 0 0 25 0 8 0 659871615 401420288 8285 33554432000 4194304 4964800 140735851297440 18446744073709551615 4372431 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 98003 8285 464 189 0 92352 0
Current children cumulated CPU time (s) 11.32
Current children cumulated vsize (KiB) 392012

[startup+3.10105 s]
/proc/loadavg: 7.61 7.77 5.64 9/246 23394
/proc/meminfo: memFree=22756772/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=393332 CPUtime=24.1 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 12247 0 0 0 2404 6 0 0 25 0 8 0 659871615 402771968 11374 33554432000 4194304 4964800 140735851297440 18446744073709551615 4332080 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 98333 11374 466 189 0 92682 0
[pid=23386/tid=23388] ppid=23384 vsize=393332 CPUtime=3.01 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 749 0 0 0 301 0 0 0 24 0 8 0 659871621 402771968 11374 33554432000 4194304 4964800 140735851297440 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=393332 CPUtime=3.01 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 1567 0 0 0 301 0 0 0 23 0 8 0 659871621 402771968 11374 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=393332 CPUtime=3.01 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 1179 0 0 0 301 0 0 0 25 0 8 0 659871621 402771968 11374 33554432000 4194304 4964800 140735851297440 18446744073709551615 4321076 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=393332 CPUtime=2.96 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 1089 0 0 0 296 0 0 0 24 0 8 0 659871621 402771968 11374 33554432000 4194304 4964800 140735851297440 18446744073709551615 4320947 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=393332 CPUtime=3.02 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 1348 0 0 0 302 0 0 0 18 0 8 0 659871621 402771968 11374 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=393332 CPUtime=3.02 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 1309 0 0 0 301 1 0 0 23 0 8 0 659871621 402771968 11374 33554432000 4194304 4964800 140735851297440 18446744073709551615 4660096 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=393332 CPUtime=2.91 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 2384 0 0 0 291 0 0 0 22 0 8 0 659871621 402771968 11374 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.1
Current children cumulated vsize (KiB) 393332

[startup+6.30047 s]
/proc/loadavg: 7.64 7.78 5.65 9/246 23394
/proc/meminfo: memFree=22733968/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=399216 CPUtime=49.66 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 18211 0 0 0 4956 10 0 0 25 0 8 0 659871615 408797184 17217 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670313 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 99804 17217 466 189 0 94153 0
[pid=23386/tid=23388] ppid=23384 vsize=399216 CPUtime=6.21 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 1127 0 0 0 620 1 0 0 25 0 8 0 659871621 408797184 17217 33554432000 4194304 4964800 140735851297440 18446744073709551615 4669542 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=399216 CPUtime=6.21 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 2471 0 0 0 620 1 0 0 25 0 8 0 659871621 408797184 17217 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=399216 CPUtime=6.22 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 1555 0 0 0 621 1 0 0 25 0 8 0 659871621 408797184 17217 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=399216 CPUtime=6.14 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 1664 0 0 0 614 0 0 0 25 0 8 0 659871621 408797184 17217 33554432000 4194304 4964800 140735851297440 18446744073709551615 4650911 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=399216 CPUtime=6.23 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 2659 0 0 0 622 1 0 0 25 0 8 0 659871621 408797184 17217 33554432000 4194304 4964800 140735851297440 18446744073709551615 4684757 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=399216 CPUtime=6.22 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 1628 0 0 0 621 1 0 0 25 0 8 0 659871621 408797184 17217 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=399216 CPUtime=6.12 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 4107 0 0 0 609 3 0 0 25 0 8 0 659871621 408797184 17217 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668789 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 49.66
Current children cumulated vsize (KiB) 399216

[startup+12.7013 s]
/proc/loadavg: 7.67 7.78 5.66 9/246 23394
/proc/meminfo: memFree=22714368/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=401504 CPUtime=100.86 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 22789 0 0 0 10073 13 0 0 25 0 8 0 659871615 411140096 21795 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 100376 21795 466 189 0 94725 0
[pid=23386/tid=23388] ppid=23384 vsize=401504 CPUtime=12.62 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 1484 0 0 0 1261 1 0 0 25 0 8 0 659871621 411140096 21795 33554432000 4194304 4964800 140735851297440 18446744073709551615 4342180 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=401504 CPUtime=12.62 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 2844 0 0 0 1261 1 0 0 25 0 8 0 659871621 411140096 21795 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=401504 CPUtime=12.62 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 1883 0 0 0 1261 1 0 0 25 0 8 0 659871621 411140096 21795 33554432000 4194304 4964800 140735851297440 18446744073709551615 4689036 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=401504 CPUtime=12.5 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 2216 0 0 0 1249 1 0 0 25 0 8 0 659871621 411140096 21795 33554432000 4194304 4964800 140735851297440 18446744073709551615 4669877 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=401504 CPUtime=12.63 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 3291 0 0 0 1262 1 0 0 25 0 8 0 659871621 411140096 21795 33554432000 4194304 4964800 140735851297440 18446744073709551615 4669396 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=401504 CPUtime=12.62 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 1939 0 0 0 1261 1 0 0 25 0 8 0 659871621 411140096 21795 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670361 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=401504 CPUtime=12.53 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 5846 0 0 0 1249 4 0 0 25 0 8 0 659871621 411140096 21795 33554432000 4194304 4964800 140735851297440 18446744073709551615 4628024 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 100.86
Current children cumulated vsize (KiB) 401504

[startup+25.5009 s]
/proc/loadavg: 7.74 7.79 5.70 9/246 23395
/proc/meminfo: memFree=22676136/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=408240 CPUtime=203.08 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 33454 0 0 0 20286 22 0 0 25 0 8 0 659871615 418037760 32460 33554432000 4194304 4964800 140735851297440 18446744073709551615 4342228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 102060 32460 466 189 0 96409 0
[pid=23386/tid=23388] ppid=23384 vsize=408240 CPUtime=25.4 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 1974 0 0 0 2538 2 0 0 25 0 8 0 659871621 418037760 32460 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668544 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=408240 CPUtime=25.41 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 3759 0 0 0 2539 2 0 0 25 0 8 0 659871621 418037760 32460 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670259 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=408240 CPUtime=25.4 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 2639 0 0 0 2539 1 0 0 25 0 8 0 659871621 418037760 32460 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668756 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=408240 CPUtime=25.2 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 3237 0 0 0 2519 1 0 0 25 0 8 0 659871621 418037760 32460 33554432000 4194304 4964800 140735851297440 18446744073709551615 4362425 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=408240 CPUtime=25.42 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 4587 0 0 0 2540 2 0 0 25 0 8 0 659871621 418037760 32460 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=408240 CPUtime=25.41 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 2718 0 0 0 2539 2 0 0 25 0 8 0 659871621 418037760 32460 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=408240 CPUtime=25.31 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 10367 0 0 0 2524 7 0 0 25 0 8 0 659871621 418037760 32460 33554432000 4194304 4964800 140735851297440 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.08
Current children cumulated vsize (KiB) 408240

[startup+51.1013 s]
/proc/loadavg: 7.90 7.82 5.76 9/246 23395
/proc/meminfo: memFree=22650088/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=413500 CPUtime=407.66 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 39254 0 0 0 40737 29 0 0 25 0 8 0 659871615 423424000 38260 33554432000 4194304 4964800 140735851297440 18446744073709551615 4669509 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 103375 38260 466 189 0 97724 0
[pid=23386/tid=23388] ppid=23384 vsize=413500 CPUtime=50.99 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 2416 0 0 0 5097 2 0 0 25 0 8 0 659871621 423424000 38260 33554432000 4194304 4964800 140735851297440 18446744073709551615 4332158 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=413500 CPUtime=51 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 4292 0 0 0 5098 2 0 0 25 0 8 0 659871621 423424000 38260 33554432000 4194304 4964800 140735851297440 18446744073709551615 4669437 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=413500 CPUtime=50.99 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 3193 0 0 0 5097 2 0 0 25 0 8 0 659871621 423424000 38260 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=413500 CPUtime=50.62 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 4294 0 0 0 5059 3 0 0 25 0 8 0 659871621 423424000 38260 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=413500 CPUtime=51.01 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 5296 0 0 0 5098 3 0 0 25 0 8 0 659871621 423424000 38260 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668544 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=413500 CPUtime=51 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 2922 0 0 0 5098 2 0 0 25 0 8 0 659871621 423424000 38260 33554432000 4194304 4964800 140735851297440 18446744073709551615 4669552 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=413500 CPUtime=50.91 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 12316 0 0 0 5082 9 0 0 25 0 8 0 659871621 423424000 38260 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 407.66
Current children cumulated vsize (KiB) 413500

[startup+102.301 s]
/proc/loadavg: 7.99 7.86 5.88 9/246 23397
/proc/meminfo: memFree=22589184/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=423728 CPUtime=816.78 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 54604 0 0 0 81634 44 0 0 25 0 8 0 659871615 433897472 53523 33554432000 4194304 4964800 140735851297440 18446744073709551615 4332146 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 105932 53523 466 189 0 100281 0
[pid=23386/tid=23388] ppid=23384 vsize=423728 CPUtime=102.17 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 3477 0 0 0 10214 3 0 0 25 0 8 0 659871621 433897472 53523 33554432000 4194304 4964800 140735851297440 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=423728 CPUtime=102.19 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 6374 0 0 0 10216 3 0 0 25 0 8 0 659871621 433897472 53523 33554432000 4194304 4964800 140735851297440 18446744073709551615 4653201 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=423728 CPUtime=102.17 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 4618 0 0 0 10213 4 0 0 25 0 8 0 659871621 433897472 53523 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=23386/tid=23389] ppid=23384 vsize=838052 CPUtime=4651.61 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 22489 0 0 0 465092 69 0 0 25 0 8 0 659871621 858165248 175848 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=838052 CPUtime=4660.68 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 13978 0 0 0 466021 47 0 0 25 0 8 0 659871621 858165248 175848 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=838052 CPUtime=4650.78 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 23085 0 0 0 465002 76 0 0 25 0 8 0 659871621 858165248 175848 33554432000 4194304 4964800 140735851297440 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=838052 CPUtime=4661.49 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 21126 0 0 0 466092 57 0 0 25 0 8 0 659871621 858165248 175848 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=838052 CPUtime=4661.26 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 15407 0 0 0 466069 57 0 0 25 0 8 0 659871621 858165248 175848 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=838052 CPUtime=4658.21 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 50606 0 0 0 465712 109 0 0 25 0 8 0 659871621 858165248 175848 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37255.7
Current children cumulated vsize (KiB) 838052

[startup+4722.3 s]
/proc/loadavg: 8.00 8.01 8.00 9/246 23532
/proc/meminfo: memFree=22092172/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=838420 CPUtime=37735.2 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 184565 0 0 0 3772996 527 0 0 25 0 8 0 659871615 858542080 177027 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 209605 177027 466 189 0 203954 0
[pid=23386/tid=23388] ppid=23384 vsize=838420 CPUtime=4710.21 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 22295 0 0 0 470963 58 0 0 25 0 8 0 659871621 858542080 177027 33554432000 4194304 4964800 140735851297440 18446744073709551615 4644906 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=838420 CPUtime=4711.16 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 22691 0 0 0 471047 69 0 0 25 0 8 0 659871621 858542080 177027 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=838420 CPUtime=4720.66 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 14047 0 0 0 472019 47 0 0 25 0 8 0 659871621 858542080 177027 33554432000 4194304 4964800 140735851297440 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=838420 CPUtime=4710.78 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 23785 0 0 0 471000 78 0 0 25 0 8 0 659871621 858542080 177027 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670313 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=838420 CPUtime=4721.49 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 21199 0 0 0 472091 58 0 0 25 0 8 0 659871621 858542080 177027 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=838420 CPUtime=4721.25 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 15446 0 0 0 472067 58 0 0 25 0 8 0 659871621 858542080 177027 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=838420 CPUtime=4718.21 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 50611 0 0 0 471711 110 0 0 25 0 8 0 659871621 858542080 177027 33554432000 4194304 4964800 140735851297440 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37735.2
Current children cumulated vsize (KiB) 838420

[startup+4782.3 s]
/proc/loadavg: 8.05 8.02 8.00 9/246 23534
/proc/meminfo: memFree=22086184/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=839272 CPUtime=38214.8 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 186231 0 0 0 3820943 532 0 0 25 0 8 0 659871615 859414528 178585 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 209818 178585 466 189 0 204167 0
[pid=23386/tid=23388] ppid=23384 vsize=839272 CPUtime=4770.21 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 22564 0 0 0 476963 58 0 0 25 0 8 0 659871621 859414528 178585 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=839272 CPUtime=4770.73 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 23304 0 0 0 477002 71 0 0 25 0 8 0 659871621 859414528 178585 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=839272 CPUtime=4780.64 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 14187 0 0 0 478016 48 0 0 25 0 8 0 659871621 859414528 178585 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=839272 CPUtime=4770.77 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 23991 0 0 0 476999 78 0 0 25 0 8 0 659871621 859414528 178585 33554432000 4194304 4964800 140735851297440 18446744073709551615 4362425 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=839272 CPUtime=4781.49 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 21494 0 0 0 478090 59 0 0 25 0 8 0 659871621 859414528 178585 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=839272 CPUtime=4781.24 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 15451 0 0 0 478066 58 0 0 25 0 8 0 659871621 859414528 178585 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=839272 CPUtime=4778.2 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 50706 0 0 0 477710 110 0 0 25 0 8 0 659871621 859414528 178585 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668725 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38214.8
Current children cumulated vsize (KiB) 839272

[startup+4842.3 s]
/proc/loadavg: 8.07 8.03 8.00 9/246 23535
/proc/meminfo: memFree=22083556/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=839460 CPUtime=38694.2 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 186768 0 0 0 3868883 536 0 0 25 0 8 0 659871615 859607040 179122 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 209865 179122 466 189 0 204214 0
[pid=23386/tid=23388] ppid=23384 vsize=839460 CPUtime=4830.19 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 22626 0 0 0 482961 58 0 0 25 0 8 0 659871621 859607040 179122 33554432000 4194304 4964800 140735851297440 18446744073709551615 4653186 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=839460 CPUtime=4830.28 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 23304 0 0 0 482957 71 0 0 25 0 8 0 659871621 859607040 179122 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=839460 CPUtime=4840.62 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 14187 0 0 0 484014 48 0 0 25 0 8 0 659871621 859607040 179122 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=839460 CPUtime=4830.76 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 24009 0 0 0 482997 79 0 0 25 0 8 0 659871621 859607040 179122 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=839460 CPUtime=4841.47 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 21755 0 0 0 484088 59 0 0 25 0 8 0 659871621 859607040 179122 33554432000 4194304 4964800 140735851297440 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=839460 CPUtime=4841.22 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 15552 0 0 0 484063 59 0 0 25 0 8 0 659871621 859607040 179122 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=839460 CPUtime=4838.19 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 50757 0 0 0 483708 111 0 0 25 0 8 0 659871621 859607040 179122 33554432000 4194304 4964800 140735851297440 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38694.2
Current children cumulated vsize (KiB) 839460

[startup+4902.31 s]
/proc/loadavg: 8.07 8.04 8.00 9/246 23537
/proc/meminfo: memFree=22082164/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=840312 CPUtime=39173.7 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 187197 0 0 0 3916834 540 0 0 25 0 8 0 659871615 860479488 179551 33554432000 4194304 4964800 140735851297440 18446744073709551615 4684018 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 210078 179551 466 189 0 204427 0
[pid=23386/tid=23388] ppid=23384 vsize=840312 CPUtime=4890.19 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 22826 0 0 0 488960 59 0 0 25 0 8 0 659871621 860479488 179551 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670427 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=840312 CPUtime=4889.84 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 23364 0 0 0 488912 72 0 0 25 0 8 0 659871621 860479488 179551 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=840312 CPUtime=4900.61 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 14189 0 0 0 490013 48 0 0 25 0 8 0 659871621 860479488 179551 33554432000 4194304 4964800 140735851297440 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=840312 CPUtime=4890.76 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 24014 0 0 0 488997 79 0 0 25 0 8 0 659871621 860479488 179551 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=840312 CPUtime=4901.47 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 21808 0 0 0 490087 60 0 0 25 0 8 0 659871621 860479488 179551 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=840312 CPUtime=4901.21 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 15553 0 0 0 490062 59 0 0 25 0 8 0 659871621 860479488 179551 33554432000 4194304 4964800 140735851297440 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=840312 CPUtime=4898.19 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 50762 0 0 0 489707 112 0 0 25 0 8 0 659871621 860479488 179551 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39173.7
Current children cumulated vsize (KiB) 840312

[startup+4962.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/246 23538
/proc/meminfo: memFree=22081152/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=840312 CPUtime=39653.2 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 187422 0 0 0 3964774 544 0 0 25 0 8 0 659871615 860479488 179731 33554432000 4194304 4964800 140735851297440 18446744073709551615 4320944 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 210078 179731 466 189 0 204427 0
[pid=23386/tid=23388] ppid=23384 vsize=840312 CPUtime=4950.16 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 22957 0 0 0 494957 59 0 0 25 0 8 0 659871621 860479488 179731 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=840312 CPUtime=4949.4 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 23364 0 0 0 494868 72 0 0 25 0 8 0 659871621 860479488 179731 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=840312 CPUtime=4960.58 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 14198 0 0 0 496010 48 0 0 25 0 8 0 659871621 860479488 179731 33554432000 4194304 4964800 140735851297440 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=840312 CPUtime=4950.74 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 24061 0 0 0 494995 79 0 0 25 0 8 0 659871621 860479488 179731 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=840312 CPUtime=4961.45 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 21808 0 0 0 496085 60 0 0 21 0 8 0 659871621 860479488 179731 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=840312 CPUtime=4961.2 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 15553 0 0 0 496060 60 0 0 25 0 8 0 659871621 860479488 179731 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670313 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=840312 CPUtime=4958.18 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 50770 0 0 0 495705 113 0 0 25 0 8 0 659871621 860479488 179731 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39653.2
Current children cumulated vsize (KiB) 840312



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5005.71 s]
/proc/loadavg: 8.01 8.02 8.00 9/246 23540
/proc/meminfo: memFree=22079772/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=840976 CPUtime=40000.1 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 187784 0 0 0 3999466 547 0 0 25 0 8 0 659871615 861159424 180063 33554432000 4194304 4964800 140735851297440 18446744073709551615 4362234 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/23386/statm: 210244 180063 466 189 0 204593 0
[pid=23386/tid=23388] ppid=23384 vsize=840976 CPUtime=4993.57 cores=0-7
/proc/23386/task/23388/stat : 23388 (claspmt) R 23384 23386 23240 0 -1 4202560 23200 0 0 0 499298 59 0 0 25 0 8 0 659871621 861159424 180063 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=23386/tid=23389] ppid=23384 vsize=840976 CPUtime=4992.49 cores=0-7
/proc/23386/task/23389/stat : 23389 (claspmt) R 23384 23386 23240 0 -1 4202560 23364 0 0 0 499176 73 0 0 25 0 8 0 659871621 861159424 180063 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=23386/tid=23390] ppid=23384 vsize=840976 CPUtime=5003.99 cores=0-7
/proc/23386/task/23390/stat : 23390 (claspmt) R 23384 23386 23240 0 -1 4202560 14198 0 0 0 500350 49 0 0 25 0 8 0 659871621 861159424 180063 33554432000 4194304 4964800 140735851297440 18446744073709551615 4644886 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=23386/tid=23391] ppid=23384 vsize=840976 CPUtime=4994.15 cores=0-7
/proc/23386/task/23391/stat : 23391 (claspmt) R 23384 23386 23240 0 -1 4202560 24061 0 0 0 499336 79 0 0 25 0 8 0 659871621 861159424 180063 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=23386/tid=23392] ppid=23384 vsize=840976 CPUtime=5004.87 cores=0-7
/proc/23386/task/23392/stat : 23392 (claspmt) R 23384 23386 23240 0 -1 4202560 21831 0 0 0 500426 61 0 0 25 0 8 0 659871621 861159424 180063 33554432000 4194304 4964800 140735851297440 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=23386/tid=23393] ppid=23384 vsize=840976 CPUtime=5004.61 cores=0-7
/proc/23386/task/23393/stat : 23393 (claspmt) R 23384 23386 23240 0 -1 4202560 15560 0 0 0 500401 60 0 0 25 0 8 0 659871621 861159424 180063 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=23386/tid=23394] ppid=23384 vsize=840976 CPUtime=5001.6 cores=0-7
/proc/23386/task/23394/stat : 23394 (claspmt) R 23384 23386 23240 0 -1 4202560 50813 0 0 0 500047 113 0 0 25 0 8 0 659871621 861159424 180063 33554432000 4194304 4964800 140735851297440 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.1
Current children cumulated vsize (KiB) 840976

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5005.81 s]
/proc/loadavg: 8.01 8.02 8.00 9/246 23540
/proc/meminfo: memFree=22079772/32951124 swapFree=61559568/67111528
[pid=23386] ppid=23384 vsize=761904 CPUtime=40000.3 cores=0-7
/proc/23386/stat : 23386 (claspmt) R 23384 23386 23240 0 -1 4202496 187794 0 0 0 3999480 547 0 0 25 0 1 0 659871615 780189696 144374 33554432000 4194304 4964800 140735851297440 18446744073709551615 222921820295 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/23386/statm: 190476 144107 476 189 0 184825 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 761904

Child status: 0
Real time (s): 5005.85
CPU time (s): 40000.3
CPU user time (s): 39994.8
CPU system time (s): 5.51416
CPU usage (%): 799.071
Max. virtual memory (cumulated for all children) (KiB): 840976

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39994.8
system time used= 5.51416
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 187795
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 556808
involuntary context switches= 191734

runsolver used 10.3744 second user time and 26.047 second system time

The end

Launcher Data 

Begin job on node109 at 2011-05-15 20:05:09
IDJOB=3380596
IDBENCH=70810
IDSOLVER=1865
FILE ID=node109/3380596-1305482709
RUNJOBID= node109-1305481206-23254
PBS_JOBID= 13325371
Free space on /tmp= 73268 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/APPLICATIONS/bitverif/countbitsarray/countbitsarray04_32.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380596-1305482709/watcher-3380596-1305482709 -o /tmp/evaluation-result-3380596-1305482709/solver-3380596-1305482709 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380596-1305482709.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 2fe3650d4a602f63086e937176360ebb
RANDOM SEED=1300135384

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22798108 kB
Buffers:        280008 kB
Cached:        2604300 kB
SwapCached:      28404 kB
Active:        1373312 kB
Inactive:      8549204 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22798108 kB
SwapTotal:    67111528 kB
SwapFree:     61559568 kB
Dirty:            1228 kB
Writeback:           0 kB
AnonPages:     7017240 kB
Mapped:          18580 kB
Slab:           132156 kB
PageTables:      33604 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 19091260 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73268 MiB
End job on node109 at 2011-05-15 21:28:36