Trace number 3380963

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.8 5010.05

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom14.cnf
MD5SUM7af4cc1b94644f101ccf5f2373fdbfea
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark762.1
Satisfiable
(Un)Satisfiability was proved
Number of variables22886
Number of clauses76038
Sum of the clauses size193162
Maximum clause length786
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 240006
Number of clauses of size 335619
Number of clauses of size 4104
Number of clauses of size 512
Number of clauses of size over 5296

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...497262/instance-3380963-1305497262.cnf
0.09/0.18	c Solving...
40000.49/5009.82	
40000.49/5009.82	*** INTERRUPTED! ***
40000.49/5009.82	*** Shutting down threads...
40000.72/5010.04	s UNKNOWN
40000.72/5010.04	
40000.72/5010.04	c INTERRUPTED   : 1
40000.72/5010.04	c Models        : 0+    
40000.72/5010.04	c Time          : 5009.820s (Solving: 5009.64s 1st Model: 0.00s Unsat: 0.00s)
40000.72/5010.04	c CPU Time      : 40000.530s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380963-1305497262/watcher-3380963-1305497262 -o /tmp/evaluation-result-3380963-1305497262/solver-3380963-1305497262 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380963-1305497262.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.87 7.78 7.92 2/425 24872
/proc/meminfo: memFree=17178440/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=27032 CPUtime=0.01 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 2271 0 0 0 1 0 0 0 23 0 1 0 739956854 27680768 1933 33554432000 4194304 4964800 140734886348512 18446744073709551615 224284586693 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/24872/statm: 6758 1934 389 189 0 1632 0

[startup+0.041489 s]
/proc/loadavg: 6.87 7.78 7.92 2/425 24872
/proc/meminfo: memFree=17178440/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=31720 CPUtime=0.03 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 3864 0 0 0 3 0 0 0 23 0 1 0 739956854 32481280 3101 33554432000 4194304 4964800 140734886348512 18446744073709551615 4618467 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/24872/statm: 7930 3102 399 189 0 2804 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 31720

[startup+0.100478 s]
/proc/loadavg: 6.87 7.78 7.92 2/425 24872
/proc/meminfo: memFree=17178440/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=34244 CPUtime=0.09 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 4469 0 0 0 9 0 0 0 23 0 1 0 739956854 35065856 3706 33554432000 4194304 4964800 140734886348512 18446744073709551615 4600431 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/24872/statm: 8561 3706 404 189 0 3435 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 34244

[startup+0.312502 s]
/proc/loadavg: 6.87 7.78 7.92 2/425 24872
/proc/meminfo: memFree=17178440/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=405500 CPUtime=4.49 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 13724 0 0 0 445 4 0 0 20 0 8 0 739956854 415232000 11335 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669973 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 101375 11335 464 189 0 95724 0
Current children cumulated CPU time (s) 4.49
Current children cumulated vsize (KiB) 405500

[startup+0.937202 s]
/proc/loadavg: 6.87 7.78 7.92 2/425 24872
/proc/meminfo: memFree=17178440/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=407684 CPUtime=11.02 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 16229 0 0 0 1097 5 0 0 21 0 8 0 739956854 417468416 13840 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 101921 13841 464 189 0 96270 0
Current children cumulated CPU time (s) 11.02
Current children cumulated vsize (KiB) 407684

[startup+1.71217 s]
/proc/loadavg: 6.87 7.78 7.92 2/425 24872
/proc/meminfo: memFree=17178440/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=407948 CPUtime=11.82 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 16709 0 0 0 1177 5 0 0 22 0 8 0 739956854 417738752 14320 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669022 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 101987 14321 464 189 0 96336 0
Current children cumulated CPU time (s) 11.82
Current children cumulated vsize (KiB) 407948

[startup+3.10094 s]
/proc/loadavg: 6.87 7.78 7.92 9/433 24880
/proc/meminfo: memFree=17121584/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=410376 CPUtime=22.91 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 19386 0 0 0 2285 6 0 0 25 0 8 0 739956854 420225024 16997 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669022 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 102594 16997 464 189 0 96943 0
[pid=24872/tid=24874] ppid=24870 vsize=410376 CPUtime=2.83 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 1481 0 0 0 283 0 0 0 21 0 8 0 739956873 420225024 16997 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=410376 CPUtime=2.83 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 2604 0 0 0 283 0 0 0 22 0 8 0 739956873 420225024 16997 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=410376 CPUtime=2.82 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 1797 0 0 0 282 0 0 0 22 0 8 0 739956873 420225024 16997 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=410376 CPUtime=2.82 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 1761 0 0 0 282 0 0 0 22 0 8 0 739956873 420225024 16997 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=410376 CPUtime=2.89 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 1547 0 0 0 289 0 0 0 24 0 8 0 739956873 420225024 16997 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=410376 CPUtime=2.81 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 1872 0 0 0 281 0 0 0 22 0 8 0 739956873 420225024 16997 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668777 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=410376 CPUtime=2.82 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 2482 0 0 0 281 1 0 0 22 0 8 0 739956873 420225024 16997 33554432000 4194304 4964800 140734886348512 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 22.91
Current children cumulated vsize (KiB) 410376

[startup+6.30041 s]
/proc/loadavg: 6.96 7.78 7.92 9/433 24880
/proc/meminfo: memFree=17104752/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=411384 CPUtime=48.46 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 22204 0 0 0 4838 8 0 0 25 0 8 0 739956854 421257216 19815 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 102846 19815 466 189 0 97195 0
[pid=24872/tid=24874] ppid=24870 vsize=411384 CPUtime=6.03 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 1636 0 0 0 603 0 0 0 25 0 8 0 739956873 421257216 19815 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668900 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=411384 CPUtime=6.03 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 3356 0 0 0 602 1 0 0 25 0 8 0 739956873 421257216 19815 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668794 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=411384 CPUtime=6.02 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 1975 0 0 0 602 0 0 0 25 0 8 0 739956873 421257216 19815 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=411384 CPUtime=6.03 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 2001 0 0 0 602 1 0 0 25 0 8 0 739956873 421257216 19815 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669276 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=411384 CPUtime=6.09 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 1985 0 0 0 608 1 0 0 25 0 8 0 739956873 421257216 19815 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=411384 CPUtime=5.96 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 2054 0 0 0 596 0 0 0 25 0 8 0 739956873 421257216 19815 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670670 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=411384 CPUtime=6.01 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 3077 0 0 0 600 1 0 0 25 0 8 0 739956873 421257216 19815 33554432000 4194304 4964800 140734886348512 18446744073709551615 4342157 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 48.46
Current children cumulated vsize (KiB) 411384

[startup+12.7003 s]
/proc/loadavg: 7.04 7.79 7.92 9/433 24880
/proc/meminfo: memFree=17083068/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=413900 CPUtime=99.56 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 27104 0 0 0 9944 12 0 0 25 0 8 0 739956854 423833600 24715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 103475 24715 466 189 0 97824 0
[pid=24872/tid=24874] ppid=24870 vsize=413900 CPUtime=12.42 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 1854 0 0 0 1242 0 0 0 25 0 8 0 739956873 423833600 24715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=413900 CPUtime=12.43 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 4617 0 0 0 1242 1 0 0 25 0 8 0 739956873 423833600 24715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=413900 CPUtime=12.42 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 2394 0 0 0 1241 1 0 0 25 0 8 0 739956873 423833600 24715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=413900 CPUtime=12.42 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 2668 0 0 0 1241 1 0 0 25 0 8 0 739956873 423833600 24715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=413900 CPUtime=12.49 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 2595 0 0 0 1248 1 0 0 25 0 8 0 739956873 423833600 24715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=413900 CPUtime=12.27 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 2463 0 0 0 1227 0 0 0 25 0 8 0 739956873 423833600 24715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=413900 CPUtime=12.41 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 4071 0 0 0 1239 2 0 0 25 0 8 0 739956873 423833600 24715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 99.56
Current children cumulated vsize (KiB) 413900

[startup+25.5012 s]
/proc/loadavg: 7.25 7.80 7.92 9/433 24880
/proc/meminfo: memFree=17045124/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=420228 CPUtime=201.78 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 36399 0 0 0 20159 19 0 0 25 0 8 0 739956854 430313472 34010 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670511 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 105057 34010 466 189 0 99406 0
[pid=24872/tid=24874] ppid=24870 vsize=420228 CPUtime=25.22 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 2681 0 0 0 2521 1 0 0 25 0 8 0 739956873 430313472 34010 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669272 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=420228 CPUtime=25.23 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 6158 0 0 0 2521 2 0 0 25 0 8 0 739956873 430313472 34010 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=420228 CPUtime=25.22 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 3301 0 0 0 2520 2 0 0 25 0 8 0 739956873 430313472 34010 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=420228 CPUtime=25.23 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 4155 0 0 0 2521 2 0 0 25 0 8 0 739956873 430313472 34010 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=420228 CPUtime=25.29 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 3835 0 0 0 2526 3 0 0 25 0 8 0 739956873 430313472 34010 33554432000 4194304 4964800 140734886348512 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=420228 CPUtime=24.9 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 3221 0 0 0 2489 1 0 0 25 0 8 0 739956873 430313472 34010 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669164 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=420228 CPUtime=25.21 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 5632 0 0 0 2518 3 0 0 25 0 8 0 739956873 430313472 34010 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 201.78
Current children cumulated vsize (KiB) 420228

[startup+51.1009 s]
/proc/loadavg: 7.51 7.81 7.92 9/433 24882
/proc/meminfo: memFree=16994996/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=429172 CPUtime=406.2 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 49037 0 0 0 40593 27 0 0 25 0 8 0 739956854 439472128 46648 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669280 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 107293 46648 466 189 0 101642 0
[pid=24872/tid=24874] ppid=24870 vsize=429172 CPUtime=50.81 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 3782 0 0 0 5080 1 0 0 25 0 8 0 739956873 439472128 46648 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=429172 CPUtime=50.83 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 7912 0 0 0 5079 4 0 0 25 0 8 0 739956873 439472128 46648 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=429172 CPUtime=50.82 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 5009 0 0 0 5079 3 0 0 25 0 8 0 739956873 439472128 46648 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669294 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=429172 CPUtime=50.82 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 5566 0 0 0 5079 3 0 0 25 0 8 0 739956873 439472128 46648 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668748 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=429172 CPUtime=50.89 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 5531 0 0 0 5085 4 0 0 25 0 8 0 739956873 439472128 46648 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670313 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=429172 CPUtime=50.15 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 3998 0 0 0 5014 1 0 0 25 0 8 0 739956873 439472128 46648 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=429172 CPUtime=50.82 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 9027 0 0 0 5076 6 0 0 25 0 8 0 739956873 439472128 46648 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 406.2
Current children cumulated vsize (KiB) 429172

[startup+102.3 s]
/proc/loadavg: 7.78 7.84 7.92 9/433 24884
/proc/meminfo: memFree=16944864/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=443560 CPUtime=815.16 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 61502 0 0 0 81475 41 0 0 25 0 8 0 739956854 454205440 59043 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670538 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 110890 59043 466 189 0 105239 0
[pid=24872/tid=24874] ppid=24870 vsize=443560 CPUtime=102.03 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 4996 0 0 0 10200 3 0 0 25 0 8 0 739956873 454205440 59043 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=443560 CPUtime=102.04 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 10612 0 0 0 10197 7 0 0 25 0 8 0 739956873 454205440 59043 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669500 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=443560 CPUtime=102.03 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 5933 0 0 0 10199 4 0 0 25 0 8 0 739956873 454205440 59043 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0

################
# More data... #
################

[pid=24872/tid=24875] ppid=24870 vsize=926924 CPUtime=4646.59 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 33133 0 0 0 464617 42 0 0 25 0 8 0 739956873 949170176 187048 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=926924 CPUtime=4660.62 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 17826 0 0 0 466039 23 0 0 25 0 8 0 739956873 949170176 187048 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=926924 CPUtime=4661.06 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 24994 0 0 0 466077 29 0 0 25 0 8 0 739956873 949170176 187048 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=926924 CPUtime=4661.87 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 22005 0 0 0 466161 26 0 0 25 0 8 0 739956873 949170176 187048 33554432000 4194304 4964800 140734886348512 18446744073709551615 4321116 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=926924 CPUtime=4638.22 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 16164 0 0 0 463797 25 0 0 25 0 8 0 739956873 949170176 187048 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670678 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=926924 CPUtime=4657.72 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 40906 0 0 0 465707 65 0 0 25 0 8 0 739956873 949170176 187048 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37225.6
Current children cumulated vsize (KiB) 926924

[startup+4722.3 s]
/proc/loadavg: 8.00 8.03 8.00 9/433 25018
/proc/meminfo: memFree=16429324/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=926924 CPUtime=37704.8 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 197042 0 0 0 3770208 271 0 0 25 0 8 0 739956854 949170176 187302 33554432000 4194304 4964800 140734886348512 18446744073709551615 4627248 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 231731 187302 466 189 0 226080 0
[pid=24872/tid=24874] ppid=24870 vsize=926924 CPUtime=4696.93 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 23360 0 0 0 469664 29 0 0 25 0 8 0 739956873 949170176 187302 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=926924 CPUtime=4706.6 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 33181 0 0 0 470617 43 0 0 25 0 8 0 739956873 949170176 187302 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670282 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=926924 CPUtime=4720.62 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 17826 0 0 0 472038 24 0 0 25 0 8 0 739956873 949170176 187302 33554432000 4194304 4964800 140734886348512 18446744073709551615 224284623520 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=926924 CPUtime=4721.07 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 25052 0 0 0 472078 29 0 0 25 0 8 0 739956873 949170176 187302 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670349 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=926924 CPUtime=4721.88 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 22007 0 0 0 472162 26 0 0 25 0 8 0 739956873 949170176 187302 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669532 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=926924 CPUtime=4698.24 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 16264 0 0 0 469798 26 0 0 25 0 8 0 739956873 949170176 187302 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=926924 CPUtime=4717.73 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 40906 0 0 0 471707 66 0 0 25 0 8 0 739956873 949170176 187302 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 37704.8
Current children cumulated vsize (KiB) 926924

[startup+4782.3 s]
/proc/loadavg: 8.00 8.02 8.00 9/433 25020
/proc/meminfo: memFree=16428048/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=926924 CPUtime=38183.8 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 197566 0 0 0 3818105 272 0 0 25 0 8 0 739956854 949170176 187715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668984 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 231731 187715 466 189 0 226080 0
[pid=24872/tid=24874] ppid=24870 vsize=926924 CPUtime=4756.04 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 23588 0 0 0 475575 29 0 0 25 0 8 0 739956873 949170176 187715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=926924 CPUtime=4766.59 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 33280 0 0 0 476616 43 0 0 25 0 8 0 739956873 949170176 187715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=926924 CPUtime=4780.59 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 17826 0 0 0 478035 24 0 0 25 0 8 0 739956873 949170176 187715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=926924 CPUtime=4781.05 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 25184 0 0 0 478075 30 0 0 25 0 8 0 739956873 949170176 187715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=926924 CPUtime=4781.87 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 22007 0 0 0 478161 26 0 0 25 0 8 0 739956873 949170176 187715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=926924 CPUtime=4758.22 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 16317 0 0 0 475796 26 0 0 25 0 8 0 739956873 949170176 187715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=926924 CPUtime=4777.72 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 40918 0 0 0 477706 66 0 0 25 0 8 0 739956873 949170176 187715 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38183.8
Current children cumulated vsize (KiB) 926924

[startup+4842.32 s]
/proc/loadavg: 8.05 8.03 8.00 9/433 25022
/proc/meminfo: memFree=16425900/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=927700 CPUtime=38663 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 198187 0 0 0 3866026 275 0 0 25 0 8 0 739956854 949964800 188242 33554432000 4194304 4964800 140734886348512 18446744073709551615 4659391 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 231925 188242 466 189 0 226274 0
[pid=24872/tid=24874] ppid=24870 vsize=927700 CPUtime=4815.19 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 23789 0 0 0 481489 30 0 0 25 0 8 0 739956873 949964800 188242 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=927700 CPUtime=4826.61 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 33588 0 0 0 482617 44 0 0 25 0 8 0 739956873 949964800 188242 33554432000 4194304 4964800 140734886348512 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=927700 CPUtime=4840.59 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 17878 0 0 0 484035 24 0 0 25 0 8 0 739956873 949964800 188242 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=927700 CPUtime=4841.07 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 25188 0 0 0 484077 30 0 0 25 0 8 0 739956873 949964800 188242 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=927700 CPUtime=4841.88 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 22033 0 0 0 484162 26 0 0 25 0 8 0 739956873 949964800 188242 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=927700 CPUtime=4818.24 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 16327 0 0 0 481798 26 0 0 25 0 8 0 739956873 949964800 188242 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668896 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=927700 CPUtime=4837.73 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 40922 0 0 0 483707 66 0 0 25 0 8 0 739956873 949964800 188242 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38663
Current children cumulated vsize (KiB) 927700

[startup+4902.3 s]
/proc/loadavg: 8.06 8.04 8.00 9/433 25022
/proc/meminfo: memFree=16424380/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=927892 CPUtime=39142 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 198527 0 0 0 3913924 276 0 0 25 0 8 0 739956854 950161408 188527 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670343 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 231973 188527 466 189 0 226322 0
[pid=24872/tid=24874] ppid=24870 vsize=927892 CPUtime=4875.16 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 24039 0 0 0 487486 30 0 0 25 0 8 0 739956873 950161408 188527 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=927892 CPUtime=4886.59 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 33636 0 0 0 488615 44 0 0 25 0 8 0 739956873 950161408 188527 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=927892 CPUtime=4900.55 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 17897 0 0 0 490031 24 0 0 25 0 8 0 739956873 950161408 188527 33554432000 4194304 4964800 140734886348512 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=927892 CPUtime=4901.05 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 25188 0 0 0 490075 30 0 0 25 0 8 0 739956873 950161408 188527 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=927892 CPUtime=4901.86 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 22040 0 0 0 490160 26 0 0 25 0 8 0 739956873 950161408 188527 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=927892 CPUtime=4877.39 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 16327 0 0 0 487713 26 0 0 25 0 8 0 739956873 950161408 188527 33554432000 4194304 4964800 140734886348512 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=927892 CPUtime=4897.72 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 40938 0 0 0 489705 67 0 0 25 0 8 0 739956873 950161408 188527 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39142
Current children cumulated vsize (KiB) 927892

[startup+4962.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/433 25024
/proc/meminfo: memFree=16421376/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=928680 CPUtime=39621.1 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 199433 0 0 0 3961831 278 0 0 25 0 8 0 739956854 950968320 189283 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 232170 189283 466 189 0 226519 0
[pid=24872/tid=24874] ppid=24870 vsize=928680 CPUtime=4935.15 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 24238 0 0 0 493485 30 0 0 25 0 8 0 739956873 950968320 189283 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=928680 CPUtime=4946.58 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 33779 0 0 0 494614 44 0 0 25 0 8 0 739956873 950968320 189283 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=928680 CPUtime=4960.53 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 18088 0 0 0 496029 24 0 0 25 0 8 0 739956873 950968320 189283 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=928680 CPUtime=4961.04 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 25280 0 0 0 496074 30 0 0 25 0 8 0 739956873 950968320 189283 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=928680 CPUtime=4961.86 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 22040 0 0 0 496160 26 0 0 25 0 8 0 739956873 950968320 189283 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=928680 CPUtime=4936.52 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 16449 0 0 0 493626 26 0 0 25 0 8 0 739956873 950968320 189283 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=928680 CPUtime=4957.72 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 41097 0 0 0 495705 67 0 0 25 0 8 0 739956873 950968320 189283 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670225 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39621.1
Current children cumulated vsize (KiB) 928680



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.8 s]
/proc/loadavg: 8.01 8.02 8.00 9/433 25026
/proc/meminfo: memFree=16420348/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=928824 CPUtime=40000.5 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 199789 0 0 0 3999771 278 0 0 25 0 8 0 739956854 951115776 189466 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669471 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/24872/statm: 232206 189466 466 189 0 226555 0
[pid=24872/tid=24874] ppid=24870 vsize=928824 CPUtime=4982.66 cores=0-7
/proc/24872/task/24874/stat : 24874 (claspmt) R 24870 24872 24846 0 -1 4202560 24408 0 0 0 498236 30 0 0 25 0 8 0 739956873 951115776 189466 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=24872/tid=24875] ppid=24870 vsize=928824 CPUtime=4994.1 cores=0-7
/proc/24872/task/24875/stat : 24875 (claspmt) R 24870 24872 24846 0 -1 4202560 33790 0 0 0 499366 44 0 0 25 0 8 0 739956873 951115776 189466 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669973 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24872/tid=24876] ppid=24870 vsize=928824 CPUtime=5008.04 cores=0-7
/proc/24872/task/24876/stat : 24876 (claspmt) R 24870 24872 24846 0 -1 4202560 18088 0 0 0 500779 25 0 0 25 0 8 0 739956873 951115776 189466 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24872/tid=24877] ppid=24870 vsize=928824 CPUtime=5008.55 cores=0-7
/proc/24872/task/24877/stat : 24877 (claspmt) R 24870 24872 24846 0 -1 4202560 25281 0 0 0 500825 30 0 0 25 0 8 0 739956873 951115776 189466 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=24872/tid=24878] ppid=24870 vsize=928824 CPUtime=5009.38 cores=0-7
/proc/24872/task/24878/stat : 24878 (claspmt) R 24870 24872 24846 0 -1 4202560 22059 0 0 0 500912 26 0 0 25 0 8 0 739956873 951115776 189466 33554432000 4194304 4964800 140734886348512 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24872/tid=24879] ppid=24870 vsize=928824 CPUtime=4983.34 cores=0-7
/proc/24872/task/24879/stat : 24879 (claspmt) R 24870 24872 24846 0 -1 4202560 16580 0 0 0 498308 26 0 0 25 0 8 0 739956873 951115776 189466 33554432000 4194304 4964800 140734886348512 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24872/tid=24880] ppid=24870 vsize=928824 CPUtime=5005.23 cores=0-7
/proc/24872/task/24880/stat : 24880 (claspmt) R 24870 24872 24846 0 -1 4202560 41119 0 0 0 500456 67 0 0 25 0 8 0 739956873 951115776 189466 33554432000 4194304 4964800 140734886348512 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 928824

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010 s]
/proc/loadavg: 8.01 8.02 8.00 9/433 25026
/proc/meminfo: memFree=16420348/32951124 swapFree=45193372/67111528
[pid=24872] ppid=24870 vsize=913128 CPUtime=40000.7 cores=0-7
/proc/24872/stat : 24872 (claspmt) R 24870 24872 24846 0 -1 4202496 199802 0 0 0 3999793 279 0 0 25 0 1 0 739956854 935043072 183331 33554432000 4194304 4964800 140734886348512 18446744073709551615 224284581067 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/24872/statm: 228282 183331 476 189 0 222631 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 913128

Child status: 0
Real time (s): 5010.05
CPU time (s): 40000.8
CPU user time (s): 39997.9
CPU system time (s): 2.83057
CPU usage (%): 798.411
Max. virtual memory (cumulated for all children) (KiB): 928824

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39997.9
system time used= 2.83057
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 199803
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 117393
involuntary context switches= 191614

runsolver used 19.641 second user time and 52.1801 second system time

The end

Launcher Data 

Begin job on node118 at 2011-05-16 00:07:42
IDJOB=3380963
IDBENCH=83125
IDSOLVER=1865
FILE ID=node118/3380963-1305497262
RUNJOBID= node118-1305497262-24860
PBS_JOBID= 13325441
Free space on /tmp= 73264 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom14.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380963-1305497262/watcher-3380963-1305497262 -o /tmp/evaluation-result-3380963-1305497262/solver-3380963-1305497262 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380963-1305497262.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7af4cc1b94644f101ccf5f2373fdbfea
RANDOM SEED=1470024128

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17178960 kB
Buffers:        311892 kB
Cached:        4718684 kB
SwapCached:      22076 kB
Active:       12810388 kB
Inactive:      2636448 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17178960 kB
SwapTotal:    67111528 kB
SwapFree:     45193372 kB
Dirty:            2428 kB
Writeback:           0 kB
AnonPages:    10407944 kB
Mapped:          21760 kB
Slab:           158668 kB
PageTables:      98460 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 125837104 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73264 MiB
End job on node118 at 2011-05-16 01:31:14