Trace number 3380620

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40001.8 5010.81

General information on the benchmark

NameCRAFTED/edgematching/
compact/em_12_2_4_cmp.cnf
MD5SUM7ea97a36d5ab6c8a5aa99830d5253591
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark61.2837
Satisfiable
(Un)Satisfiability was proved
Number of variables12584
Number of clauses155712
Sum of the clauses size523920
Maximum clause length100
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 217404
Number of clauses of size 3103200
Number of clauses of size 417828
Number of clauses of size 517000
Number of clauses of size over 5280

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...485804/instance-3380620-1305485804.cnf
0.19/0.20	c Solving...
40000.82/5009.92	
40000.82/5009.92	*** INTERRUPTED! ***
40000.82/5009.92	*** Shutting down threads...
40001.73/5010.75	s UNKNOWN
40001.73/5010.75	
40001.73/5010.75	c INTERRUPTED   : 1
40001.73/5010.75	c Models        : 0+    
40001.73/5010.75	c Time          : 5009.920s (Solving: 5009.72s 1st Model: 0.00s Unsat: 0.00s)
40001.73/5010.75	c CPU Time      : 40000.950s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380620-1305485804/watcher-3380620-1305485804 -o /tmp/evaluation-result-3380620-1305485804/solver-3380620-1305485804 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380620-1305485804.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.00 8.02 7.94 2/410 2320
/proc/meminfo: memFree=21739936/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=22452 CPUtime=0 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 576 0 0 0 0 0 0 0 24 0 1 0 660178186 22990848 508 33554432000 4194304 4964800 140733599580944 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/2320/statm: 5613 515 376 189 0 487 0

[startup+0.0586271 s]
/proc/loadavg: 8.00 8.02 7.94 2/410 2320
/proc/meminfo: memFree=21739936/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=33212 CPUtime=0.05 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 4446 0 0 0 5 0 0 0 24 0 1 0 660178186 34009088 3413 33554432000 4194304 4964800 140733599580944 18446744073709551615 4625088 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/2320/statm: 8303 3414 397 189 0 3177 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 33212

[startup+0.1006 s]
/proc/loadavg: 8.00 8.02 7.94 2/410 2320
/proc/meminfo: memFree=21739936/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=37652 CPUtime=0.09 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 5490 0 0 0 9 0 0 0 24 0 1 0 660178186 38555648 4457 33554432000 4194304 4964800 140733599580944 18446744073709551615 4607585 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/2320/statm: 9413 4457 399 189 0 4287 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 37652

[startup+0.30267 s]
/proc/loadavg: 8.00 8.02 7.94 2/410 2320
/proc/meminfo: memFree=21739936/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=463996 CPUtime=0.57 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 12442 0 0 0 54 3 0 0 18 0 8 0 660178186 475131904 10698 33554432000 4194304 4964800 140733599580944 18446744073709551615 212687336481 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/2320/statm: 116131 11570 464 189 0 110480 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 463996

[startup+1.49131 s]
/proc/loadavg: 8.00 8.02 7.94 2/410 2320
/proc/meminfo: memFree=21739936/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=473948 CPUtime=10 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 29916 0 0 0 987 13 0 0 20 0 8 0 660178186 485322752 28172 33554432000 4194304 4964800 140733599580944 18446744073709551615 212687336481 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/2320/statm: 118487 28174 464 189 0 112836 0
Current children cumulated CPU time (s) 10
Current children cumulated vsize (KiB) 473948

[startup+1.59129 s]
/proc/loadavg: 8.00 8.02 7.94 2/410 2320
/proc/meminfo: memFree=21739936/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=474740 CPUtime=10.79 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 30958 0 0 0 1066 13 0 0 20 0 8 0 660178186 486133760 29214 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670499 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/2320/statm: 118685 29214 464 189 0 113034 0
Current children cumulated CPU time (s) 10.79
Current children cumulated vsize (KiB) 474740

[startup+3.10102 s]
/proc/loadavg: 8.00 8.02 7.94 9/418 2328
/proc/meminfo: memFree=21557984/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=484720 CPUtime=22.85 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 47648 0 0 0 2264 21 0 0 18 0 8 0 660178186 496353280 45904 33554432000 4194304 4964800 140733599580944 18446744073709551615 4660157 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/2320/statm: 121180 45905 464 189 0 115529 0
[pid=2320/tid=2322] ppid=2318 vsize=484864 CPUtime=2.83 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 6230 0 0 0 281 2 0 0 20 0 8 0 660178206 496500736 46063 33554432000 4194304 4964800 140733599580944 18446744073709551615 4660195 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=484864 CPUtime=2.81 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 1530 0 0 0 281 0 0 0 23 0 8 0 660178206 496500736 46063 33554432000 4194304 4964800 140733599580944 18446744073709551615 4669276 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=484864 CPUtime=2.83 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 5654 0 0 0 280 3 0 0 20 0 8 0 660178206 496500736 46063 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=484864 CPUtime=2.84 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 7388 0 0 0 281 3 0 0 23 0 8 0 660178206 496500736 46063 33554432000 4194304 4964800 140733599580944 18446744073709551615 212687336481 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=484864 CPUtime=2.87 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 2942 0 0 0 286 1 0 0 20 0 8 0 660178206 496500736 46063 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=484864 CPUtime=2.82 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 4697 0 0 0 280 2 0 0 20 0 8 0 660178206 496500736 46064 33554432000 4194304 4964800 140733599580944 18446744073709551615 212687336133 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=484864 CPUtime=2.85 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 6460 0 0 0 282 3 0 0 20 0 8 0 660178206 496500736 46064 33554432000 4194304 4964800 140733599580944 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 22.85
Current children cumulated vsize (KiB) 484720

[startup+6.30044 s]
/proc/loadavg: 8.00 8.02 7.94 9/418 2328
/proc/meminfo: memFree=21491192/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=506172 CPUtime=48.35 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 72858 0 0 0 4801 34 0 0 25 0 8 0 660178186 518320128 71114 33554432000 4194304 4964800 140733599580944 18446744073709551615 4668817 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/2320/statm: 126543 71114 466 189 0 120892 0
[pid=2320/tid=2322] ppid=2318 vsize=506172 CPUtime=6.01 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 11363 0 0 0 597 4 0 0 25 0 8 0 660178206 518320128 71114 33554432000 4194304 4964800 140733599580944 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=506172 CPUtime=5.96 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 1671 0 0 0 596 0 0 0 25 0 8 0 660178206 518320128 71114 33554432000 4194304 4964800 140733599580944 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=506172 CPUtime=6.02 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 8668 0 0 0 597 5 0 0 25 0 8 0 660178206 518320128 71117 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=506172 CPUtime=6.02 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 9996 0 0 0 598 4 0 0 19 0 8 0 660178206 518320128 71117 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=506172 CPUtime=6.05 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 8852 0 0 0 602 3 0 0 25 0 8 0 660178206 518320128 71117 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=506172 CPUtime=6 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 7564 0 0 0 597 3 0 0 25 0 8 0 660178206 518320128 71117 33554432000 4194304 4964800 140733599580944 18446744073709551615 212687372043 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=506172 CPUtime=6.03 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 6783 0 0 0 600 3 0 0 25 0 8 0 660178206 518320128 71118 33554432000 4194304 4964800 140733599580944 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 48.35
Current children cumulated vsize (KiB) 506172

[startup+12.7013 s]
/proc/loadavg: 8.00 8.02 7.94 9/418 2328
/proc/meminfo: memFree=21399216/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=515044 CPUtime=99.44 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 87321 0 0 0 9902 42 0 0 25 0 8 0 660178186 527405056 85574 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320955 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/2320/statm: 128761 85574 466 189 0 123110 0
[pid=2320/tid=2322] ppid=2318 vsize=515044 CPUtime=12.41 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 13757 0 0 0 1235 6 0 0 25 0 8 0 660178206 527405056 85574 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=515044 CPUtime=12.27 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 1787 0 0 0 1227 0 0 0 25 0 8 0 660178206 527405056 85574 33554432000 4194304 4964800 140733599580944 18446744073709551615 4379082 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=515044 CPUtime=12.41 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 9817 0 0 0 1236 5 0 0 25 0 8 0 660178206 527405056 85574 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=515044 CPUtime=12.41 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 11884 0 0 0 1236 5 0 0 25 0 8 0 660178206 527405056 85574 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=515044 CPUtime=12.45 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 12264 0 0 0 1239 6 0 0 25 0 8 0 660178206 527405056 85574 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=515044 CPUtime=12.4 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 9051 0 0 0 1236 4 0 0 25 0 8 0 660178206 527405056 85574 33554432000 4194304 4964800 140733599580944 18446744073709551615 4332462 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=515044 CPUtime=12.43 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 7008 0 0 0 1240 3 0 0 25 0 8 0 660178206 527405056 85574 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670496 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 99.44
Current children cumulated vsize (KiB) 515044

[startup+25.5009 s]
/proc/loadavg: 8.08 8.03 7.94 9/418 2328
/proc/meminfo: memFree=21283792/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=599812 CPUtime=201.62 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 116359 0 0 0 20104 58 0 0 25 0 8 0 660178186 614207488 114612 33554432000 4194304 4964800 140733599580944 18446744073709551615 4660449 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/2320/statm: 149953 114612 466 189 0 144302 0
[pid=2320/tid=2322] ppid=2318 vsize=599812 CPUtime=25.2 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 18178 0 0 0 2512 8 0 0 25 0 8 0 660178206 614207488 114612 33554432000 4194304 4964800 140733599580944 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=599812 CPUtime=24.89 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 2345 0 0 0 2489 0 0 0 25 0 8 0 660178206 614207488 114612 33554432000 4194304 4964800 140733599580944 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=599812 CPUtime=25.2 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 13762 0 0 0 2513 7 0 0 25 0 8 0 660178206 614207488 114612 33554432000 4194304 4964800 140733599580944 18446744073709551615 4321038 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=599812 CPUtime=25.21 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 16754 0 0 0 2514 7 0 0 25 0 8 0 660178206 614207488 114612 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=599812 CPUtime=25.24 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 17188 0 0 0 2515 9 0 0 25 0 8 0 660178206 614207488 114612 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=599812 CPUtime=25.18 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 11685 0 0 0 2513 5 0 0 18 0 8 0 660178206 614207488 114612 33554432000 4194304 4964800 140733599580944 18446744073709551615 4339034 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=599812 CPUtime=25.22 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 7429 0 0 0 2519 3 0 0 25 0 8 0 660178206 614207488 114612 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 201.62
Current children cumulated vsize (KiB) 599812

[startup+51.1013 s]
/proc/loadavg: 8.05 8.03 7.94 9/418 2329
/proc/meminfo: memFree=21173324/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=933080 CPUtime=406.03 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 144596 0 0 0 40525 78 0 0 25 0 8 0 660178186 955473920 142848 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/2320/statm: 233270 142848 466 189 0 227619 0
[pid=2320/tid=2322] ppid=2318 vsize=933080 CPUtime=50.79 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 20718 0 0 0 5069 10 0 0 25 0 8 0 660178206 955473920 142848 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=933080 CPUtime=50.15 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 2765 0 0 0 5014 1 0 0 25 0 8 0 660178206 955473920 142848 33554432000 4194304 4964800 140733599580944 18446744073709551615 4362810 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=933080 CPUtime=50.8 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 17919 0 0 0 5070 10 0 0 25 0 8 0 660178206 955473920 142848 33554432000 4194304 4964800 140733599580944 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=933080 CPUtime=50.8 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 21795 0 0 0 5070 10 0 0 25 0 8 0 660178206 955473920 142848 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=933080 CPUtime=50.83 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 20958 0 0 0 5072 11 0 0 25 0 8 0 660178206 955473920 142848 33554432000 4194304 4964800 140733599580944 18446744073709551615 4321379 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=933080 CPUtime=50.78 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 14333 0 0 0 5071 7 0 0 25 0 8 0 660178206 955473920 142848 33554432000 4194304 4964800 140733599580944 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=933080 CPUtime=50.83 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 7729 0 0 0 5079 4 0 0 25 0 8 0 660178206 955473920 142848 33554432000 4194304 4964800 140733599580944 18446744073709551615 4365162 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 406.03
Current children cumulated vsize (KiB) 933080

[startup+102.301 s]
/proc/loadavg: 8.02 8.02 7.94 9/418 2330
/proc/meminfo: memFree=20976284/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=968504 CPUtime=814.81 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 193175 0 0 0 81371 110 0 0 25 0 8 0 660178186 991748096 191309 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670351 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/2320/statm: 242126 191309 466 189 0 236475 0
[pid=2320/tid=2322] ppid=2318 vsize=968504 CPUtime=101.96 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 26906 0 0 0 10181 15 0 0 25 0 8 0 660178206 991748096 191309 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=968504 CPUtime=100.64 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 4438 0 0 0 10062 2 0 0 25 0 8 0 660178206 991748096 191309 33554432000 4194304 4964800 140733599580944 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=968504 CPUtime=101.99 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 23266 0 0 0 10185 14 0 0 25 0 8 0 660178206 991748096 191309 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0

################
# More data... #
################

/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 170549 0 0 0 465286 197 0 0 25 0 8 0 660178206 4372533248 1009791 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=4270052 CPUtime=4661.18 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 77747 0 0 0 466051 67 0 0 25 0 8 0 660178206 4372533248 1009791 33554432000 4194304 4964800 140733599580944 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37225.1
Current children cumulated vsize (KiB) 4270052

[startup+4722.3 s]
/proc/loadavg: 8.05 8.05 8.00 9/418 2478
/proc/meminfo: memFree=17689476/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=4277104 CPUtime=37704.3 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 1020255 0 0 0 3769486 941 0 0 25 0 8 0 660178186 4379754496 1011046 33554432000 4194304 4964800 140733599580944 18446744073709551615 4669463 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/2320/statm: 1069276 1011046 466 189 0 1063625 0
[pid=2320/tid=2322] ppid=2318 vsize=4277104 CPUtime=4689.58 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 86909 0 0 0 468857 101 0 0 25 0 8 0 660178206 4379754496 1011046 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=4277104 CPUtime=4708.32 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 39094 0 0 0 470796 36 0 0 25 0 8 0 660178206 4379754496 1011046 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=4277104 CPUtime=4707.97 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 108931 0 0 0 470687 110 0 0 25 0 8 0 660178206 4379754496 1011046 33554432000 4194304 4964800 140733599580944 18446744073709551615 4332462 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=4277104 CPUtime=4720.19 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 112242 0 0 0 471924 95 0 0 25 0 8 0 660178206 4379754496 1011046 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=4277104 CPUtime=4721.04 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 75104 0 0 0 472039 65 0 0 25 0 8 0 660178206 4379754496 1011046 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=4277104 CPUtime=4714.82 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 170551 0 0 0 471285 197 0 0 25 0 8 0 660178206 4379754496 1011046 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=4277104 CPUtime=4721.18 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 77747 0 0 0 472051 67 0 0 25 0 8 0 660178206 4379754496 1011046 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670371 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37704.3
Current children cumulated vsize (KiB) 4277104

[startup+4782.3 s]
/proc/loadavg: 8.21 8.09 8.01 9/418 2480
/proc/meminfo: memFree=17673096/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=4277104 CPUtime=38183.4 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 1024519 0 0 0 3817394 946 0 0 25 0 8 0 660178186 4379754496 1015310 33554432000 4194304 4964800 140733599580944 18446744073709551615 4362289 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/2320/statm: 1069276 1015310 466 189 0 1063625 0
[pid=2320/tid=2322] ppid=2318 vsize=4277104 CPUtime=4749.59 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 87854 0 0 0 474857 102 0 0 25 0 8 0 660178206 4379754496 1015310 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=4277104 CPUtime=4768.33 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 39094 0 0 0 476797 36 0 0 25 0 8 0 660178206 4379754496 1015310 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=4277104 CPUtime=4767.17 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 109014 0 0 0 476607 110 0 0 25 0 8 0 660178206 4379754496 1015310 33554432000 4194304 4964800 140733599580944 18446744073709551615 4653482 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=4277104 CPUtime=4780.13 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 112695 0 0 0 477917 96 0 0 25 0 8 0 660178206 4379754496 1015310 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=4277104 CPUtime=4781.04 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 75119 0 0 0 478039 65 0 0 25 0 8 0 660178206 4379754496 1015310 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=4277104 CPUtime=4774.82 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 170569 0 0 0 477285 197 0 0 25 0 8 0 660178206 4379754496 1015310 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=4277104 CPUtime=4781.18 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 77873 0 0 0 478051 67 0 0 25 0 8 0 660178206 4379754496 1015310 33554432000 4194304 4964800 140733599580944 18446744073709551615 4658609 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38183.4
Current children cumulated vsize (KiB) 4277104

[startup+4842.3 s]
/proc/loadavg: 8.21 8.10 8.02 9/418 2482
/proc/meminfo: memFree=17668140/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=4282520 CPUtime=38662.4 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 1025802 0 0 0 3865286 950 0 0 25 0 8 0 660178186 4385300480 1016591 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/2320/statm: 1070630 1016591 466 189 0 1064979 0
[pid=2320/tid=2322] ppid=2318 vsize=4282520 CPUtime=4809.38 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 87872 0 0 0 480836 102 0 0 25 0 8 0 660178206 4385300480 1016591 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=4282520 CPUtime=4828.33 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 39095 0 0 0 482797 36 0 0 25 0 8 0 660178206 4385300480 1016591 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=4282520 CPUtime=4826.4 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 110143 0 0 0 482529 111 0 0 25 0 8 0 660178206 4385300480 1016591 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=4282520 CPUtime=4840.13 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 112727 0 0 0 483916 97 0 0 25 0 8 0 660178206 4385300480 1016591 33554432000 4194304 4964800 140733599580944 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=4282520 CPUtime=4840.98 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 75123 0 0 0 484032 66 0 0 25 0 8 0 660178206 4385300480 1016591 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=4282520 CPUtime=4834.82 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 170643 0 0 0 483285 197 0 0 25 0 8 0 660178206 4385300480 1016591 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=4282520 CPUtime=4841.18 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 77873 0 0 0 484051 67 0 0 25 0 8 0 660178206 4385300480 1016591 33554432000 4194304 4964800 140733599580944 18446744073709551615 4669532 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 38662.4
Current children cumulated vsize (KiB) 4282520

[startup+4902.3 s]
/proc/loadavg: 8.08 8.08 8.01 9/418 2483
/proc/meminfo: memFree=17667380/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=4282520 CPUtime=39141.5 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 1025965 0 0 0 3913202 951 0 0 25 0 8 0 660178186 4385300480 1016754 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670437 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/2320/statm: 1070630 1016754 466 189 0 1064979 0
[pid=2320/tid=2322] ppid=2318 vsize=4282520 CPUtime=4868.57 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 87872 0 0 0 486755 102 0 0 25 0 8 0 660178206 4385300480 1016754 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=4282520 CPUtime=4888.33 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 39096 0 0 0 488797 36 0 0 25 0 8 0 660178206 4385300480 1016754 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670546 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=4282520 CPUtime=4886.4 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 110176 0 0 0 488528 112 0 0 25 0 8 0 660178206 4385300480 1016754 33554432000 4194304 4964800 140733599580944 18446744073709551615 4641862 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=4282520 CPUtime=4900.12 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 112727 0 0 0 489915 97 0 0 25 0 8 0 660178206 4385300480 1016754 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=4282520 CPUtime=4900.98 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 75123 0 0 0 490032 66 0 0 25 0 8 0 660178206 4385300480 1016754 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=4282520 CPUtime=4894.82 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 170721 0 0 0 489285 197 0 0 25 0 8 0 660178206 4385300480 1016754 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=4282520 CPUtime=4901.17 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 77873 0 0 0 490050 67 0 0 25 0 8 0 660178206 4385300480 1016754 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39141.5
Current children cumulated vsize (KiB) 4282520

[startup+4962.3 s]
/proc/loadavg: 8.03 8.06 8.00 9/418 2485
/proc/meminfo: memFree=17665264/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=4284568 CPUtime=39620.6 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 1026567 0 0 0 3961112 953 0 0 25 0 8 0 660178186 4387397632 1017356 33554432000 4194304 4964800 140733599580944 18446744073709551615 4668734 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/2320/statm: 1071142 1017356 466 189 0 1065491 0
[pid=2320/tid=2322] ppid=2318 vsize=4284568 CPUtime=4928.16 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 87874 0 0 0 492714 102 0 0 25 0 8 0 660178206 4387397632 1017356 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=4284568 CPUtime=4948.33 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 39097 0 0 0 494797 36 0 0 25 0 8 0 660178206 4387397632 1017356 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=4284568 CPUtime=4946.39 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 110219 0 0 0 494527 112 0 0 25 0 8 0 660178206 4387397632 1017356 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=4284568 CPUtime=4960.1 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 113059 0 0 0 495913 97 0 0 25 0 8 0 660178206 4387397632 1017356 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=4284568 CPUtime=4960.98 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 75128 0 0 0 496032 66 0 0 25 0 8 0 660178206 4387397632 1017356 33554432000 4194304 4964800 140733599580944 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=4284568 CPUtime=4954.38 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 170848 0 0 0 495241 197 0 0 25 0 8 0 660178206 4387397632 1017356 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=4284568 CPUtime=4961.16 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 77873 0 0 0 496049 67 0 0 25 0 8 0 660178206 4387397632 1017356 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 39620.7
Current children cumulated vsize (KiB) 4284568



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.9 s]
/proc/loadavg: 8.01 8.05 8.00 9/418 2486
/proc/meminfo: memFree=17595328/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=4351128 CPUtime=40000.8 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 1043999 0 0 0 3999110 972 0 0 25 0 8 0 660178186 4455555072 1034788 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/2320/statm: 1087782 1034788 466 189 0 1082131 0
[pid=2320/tid=2322] ppid=2318 vsize=4351128 CPUtime=4975.79 cores=0-7
/proc/2320/task/2322/stat : 2322 (claspmt) R 2318 2320 2024 0 -1 4202560 88023 0 0 0 497476 103 0 0 25 0 8 0 660178206 4455555072 1034788 33554432000 4194304 4964800 140733599580944 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=2320/tid=2323] ppid=2318 vsize=4351128 CPUtime=4995.95 cores=0-7
/proc/2320/task/2323/stat : 2323 (claspmt) R 2318 2320 2024 0 -1 4202560 40237 0 0 0 499558 37 0 0 25 0 8 0 660178206 4455555072 1034788 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=2320/tid=2324] ppid=2318 vsize=4351128 CPUtime=4994 cores=0-7
/proc/2320/task/2324/stat : 2324 (claspmt) R 2318 2320 2024 0 -1 4202560 110526 0 0 0 499288 112 0 0 25 0 8 0 660178206 4455555072 1034788 33554432000 4194304 4964800 140733599580944 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=2320/tid=2325] ppid=2318 vsize=4351128 CPUtime=5007.71 cores=0-7
/proc/2320/task/2325/stat : 2325 (claspmt) R 2318 2320 2024 0 -1 4202560 113267 0 0 0 500673 98 0 0 25 0 8 0 660178206 4455555072 1034788 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=2320/tid=2326] ppid=2318 vsize=4351128 CPUtime=5008.61 cores=0-7
/proc/2320/task/2326/stat : 2326 (claspmt) R 2318 2320 2024 0 -1 4202560 75444 0 0 0 500794 67 0 0 25 0 8 0 660178206 4455555072 1034788 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=2320/tid=2327] ppid=2318 vsize=4351128 CPUtime=5001.33 cores=0-7
/proc/2320/task/2327/stat : 2327 (claspmt) R 2318 2320 2024 0 -1 4202560 177324 0 0 0 499927 206 0 0 25 0 8 0 660178206 4455555072 1034788 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=2320/tid=2328] ppid=2318 vsize=4351128 CPUtime=5008.77 cores=0-7
/proc/2320/task/2328/stat : 2328 (claspmt) R 2318 2320 2024 0 -1 4202560 80880 0 0 0 500807 70 0 0 25 0 8 0 660178206 4455555072 1034788 33554432000 4194304 4964800 140733599580944 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 4351128

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.42 s]
/proc/loadavg: 8.01 8.05 8.00 2/412 2487
/proc/meminfo: memFree=17607280/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=4344080 CPUtime=40001.4 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202496 1044009 0 0 0 3999172 972 0 0 25 0 1 0 660178186 4448337920 1031455 33554432000 4194304 4964800 140733599580944 18446744073709551615 212687332330 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/2320/statm: 1086020 1031455 476 189 0 1080369 0
Current children cumulated CPU time (s) 40001.4
Current children cumulated vsize (KiB) 4344080

[startup+5010.8 s]
/proc/loadavg: 8.01 8.05 8.00 2/412 2487
/proc/meminfo: memFree=17607280/32951124 swapFree=67111348/67111528
[pid=2320] ppid=2318 vsize=0 CPUtime=40001.8 cores=0-7
/proc/2320/stat : 2320 (claspmt) R 2318 2320 2024 0 -1 4202500 1044010 0 0 0 3999192 991 0 0 25 0 1 0 660178186 0 0 33554432000 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/2320/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 40001.8
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 5010.81
CPU time (s): 40001.8
CPU user time (s): 39991.9
CPU system time (s): 9.92149
CPU usage (%): 798.311
Max. virtual memory (cumulated for all children) (KiB): 4351128

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39991.9
system time used= 9.92149
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1044010
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 212270
involuntary context switches= 190158

runsolver used 18.6722 second user time and 49.6684 second system time

The end

Launcher Data 

Begin job on node139 at 2011-05-15 20:56:45
IDJOB=3380620
IDBENCH=70908
IDSOLVER=1865
FILE ID=node139/3380620-1305485804
RUNJOBID= node139-1305481201-2038
PBS_JOBID= 13325341
Free space on /tmp= 73380 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/CRAFTED/edgematching/compact/em_12_2_4_cmp.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380620-1305485804/watcher-3380620-1305485804 -o /tmp/evaluation-result-3380620-1305485804/solver-3380620-1305485804 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380620-1305485804.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 7ea97a36d5ab6c8a5aa99830d5253591
RANDOM SEED=1985380740

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21740340 kB
Buffers:        330892 kB
Cached:        3046764 kB
SwapCached:          0 kB
Active:        8831248 kB
Inactive:      2063920 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21740340 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:            4300 kB
Writeback:           8 kB
AnonPages:     7517808 kB
Mapped:          32808 kB
Slab:           204220 kB
PageTables:      44448 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 97034284 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73380 MiB
End job on node139 at 2011-05-15 22:20:16