Trace number 3381071

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.6 5006.51

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-3-6_2071.cnf
MD5SUM337bdbc5d8bf0013ca73aeffa06cffe8
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark17.0104
Satisfiable
(Un)Satisfiability was proved
Number of variables2070
Number of clauses158884
Sum of the clauses size478584
Maximum clause length6
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3158240
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5644

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...502912/instance-3381071-1305502912.cnf
1.19/1.20	c Solving...
40000.12/5006.12	
40000.12/5006.12	*** INTERRUPTED! ***
40000.12/5006.12	*** Shutting down threads...
40000.56/5006.51	s UNKNOWN
40000.56/5006.51	
40000.56/5006.51	c INTERRUPTED   : 1
40000.56/5006.51	c Models        : 0+    
40000.56/5006.51	c Time          : 5006.122s (Solving: 5004.92s 1st Model: 0.00s Unsat: 0.00s)
40000.56/5006.51	c CPU Time      : 40000.190s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3381071-1305502912/watcher-3381071-1305502912 -o /tmp/evaluation-result-3381071-1305502912/solver-3381071-1305502912 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3381071-1305502912.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.02 8.34 8.28 3/238 24497
/proc/meminfo: memFree=22782244/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=21880 CPUtime=0 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 778 0 0 0 0 0 0 0 23 0 1 0 661891959 22405120 692 33554432000 4194304 4964800 140736805225456 18446744073709551615 222921437893 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/24497/statm: 5470 693 386 189 0 344 0

[startup+0.039923 s]
/proc/loadavg: 8.02 8.34 8.28 3/238 24497
/proc/meminfo: memFree=22782244/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=29444 CPUtime=0.03 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 3274 0 0 0 3 0 0 0 23 0 1 0 661891959 30150656 2444 33554432000 4194304 4964800 140736805225456 18446744073709551615 222921437893 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/24497/statm: 7361 2446 386 189 0 2235 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 29444

[startup+0.100893 s]
/proc/loadavg: 8.02 8.34 8.28 3/238 24497
/proc/meminfo: memFree=22782244/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=31700 CPUtime=0.09 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 3903 0 0 0 9 0 0 0 23 0 1 0 661891959 32460800 3054 33554432000 4194304 4964800 140736805225456 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/24497/statm: 7925 3054 402 189 0 2799 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31700

[startup+0.300858 s]
/proc/loadavg: 8.02 8.34 8.28 3/238 24497
/proc/meminfo: memFree=22782244/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=31700 CPUtime=0.29 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 3904 0 0 0 29 0 0 0 25 0 1 0 661891959 32460800 3055 33554432000 4194304 4964800 140736805225456 18446744073709551615 4613785 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/24497/statm: 7925 3055 403 189 0 2799 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 31700

[startup+0.700783 s]
/proc/loadavg: 8.02 8.34 8.28 3/238 24497
/proc/meminfo: memFree=22782244/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=33680 CPUtime=0.69 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 4411 0 0 0 69 0 0 0 25 0 1 0 661891959 34488320 3562 33554432000 4194304 4964800 140736805225456 18446744073709551615 4600730 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/24497/statm: 8420 3562 403 189 0 3294 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 33680

[startup+1.5006 s]
/proc/loadavg: 8.02 8.34 8.28 2/239 24498
/proc/meminfo: memFree=22768408/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=333512 CPUtime=3.19 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 11808 0 0 0 315 4 0 0 18 0 8 0 661891959 341516288 10569 33554432000 4194304 4964800 140736805225456 18446744073709551615 4683730 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 83378 10569 464 189 0 77727 0
Current children cumulated CPU time (s) 3.19
Current children cumulated vsize (KiB) 333512

[startup+3.10131 s]
/proc/loadavg: 8.02 8.34 8.28 9/246 24505
/proc/meminfo: memFree=22731584/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=336508 CPUtime=15.99 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 17474 0 0 0 1591 8 0 0 20 0 8 0 661891959 344584192 16235 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670264 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 84127 16235 464 189 0 78476 0
[pid=24497/tid=24499] ppid=24495 vsize=336508 CPUtime=1.84 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 1377 0 0 0 184 0 0 0 20 0 8 0 661892079 344584192 16235 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670338 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=336508 CPUtime=1.84 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 1715 0 0 0 184 0 0 0 20 0 8 0 661892079 344584192 16236 33554432000 4194304 4964800 140736805225456 18446744073709551615 222921438241 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=336508 CPUtime=1.83 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 1546 0 0 0 183 0 0 0 20 0 8 0 661892079 344584192 16236 33554432000 4194304 4964800 140736805225456 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=336508 CPUtime=1.83 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 1449 0 0 0 182 1 0 0 20 0 8 0 661892079 344584192 16236 33554432000 4194304 4964800 140736805225456 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=336508 CPUtime=1.86 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 1420 0 0 0 186 0 0 0 20 0 8 0 661892079 344584192 16236 33554432000 4194304 4964800 140736805225456 18446744073709551615 4668698 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=336508 CPUtime=1.81 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 1680 0 0 0 180 1 0 0 20 0 8 0 661892079 344584192 16236 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=336508 CPUtime=1.85 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 1832 0 0 0 184 1 0 0 20 0 8 0 661892079 344584192 16236 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 15.99
Current children cumulated vsize (KiB) 336508

[startup+6.30073 s]
/proc/loadavg: 8.02 8.33 8.27 9/246 24505
/proc/meminfo: memFree=22699220/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=341256 CPUtime=41.55 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 22814 0 0 0 4143 12 0 0 25 0 8 0 661891959 349446144 21575 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670264 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 85314 21575 466 189 0 79663 0
[pid=24497/tid=24499] ppid=24495 vsize=341256 CPUtime=5.05 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 1953 0 0 0 504 1 0 0 25 0 8 0 661892079 349446144 21575 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=341256 CPUtime=5.05 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 2547 0 0 0 504 1 0 0 25 0 8 0 661892079 349446144 21575 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=341256 CPUtime=5.02 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 2102 0 0 0 502 0 0 0 25 0 8 0 661892079 349446144 21575 33554432000 4194304 4964800 140736805225456 18446744073709551615 4361273 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=341256 CPUtime=5.03 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 2136 0 0 0 502 1 0 0 25 0 8 0 661892079 349446144 21575 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=341256 CPUtime=5.06 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 2184 0 0 0 505 1 0 0 25 0 8 0 661892079 349446144 21575 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=341256 CPUtime=4.98 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 2230 0 0 0 497 1 0 0 25 0 8 0 661892079 349446144 21575 33554432000 4194304 4964800 140736805225456 18446744073709551615 4627299 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=341256 CPUtime=5.05 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 2617 0 0 0 503 2 0 0 25 0 8 0 661892079 349446144 21575 33554432000 4194304 4964800 140736805225456 18446744073709551615 4627290 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 41.55
Current children cumulated vsize (KiB) 341256

[startup+12.7006 s]
/proc/loadavg: 8.02 8.33 8.27 9/246 24505
/proc/meminfo: memFree=22674188/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=346336 CPUtime=92.69 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 29336 0 0 0 9253 16 0 0 25 0 8 0 661891959 354648064 28097 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 86584 28097 466 189 0 80933 0
[pid=24497/tid=24499] ppid=24495 vsize=346336 CPUtime=11.45 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 2638 0 0 0 1144 1 0 0 25 0 8 0 661892079 354648064 28097 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=346336 CPUtime=11.45 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 3309 0 0 0 1143 2 0 0 25 0 8 0 661892079 354648064 28097 33554432000 4194304 4964800 140736805225456 18446744073709551615 4668709 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=346336 CPUtime=11.43 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 2674 0 0 0 1142 1 0 0 25 0 8 0 661892079 354648064 28097 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=346336 CPUtime=11.43 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 3167 0 0 0 1141 2 0 0 25 0 8 0 661892079 354648064 28097 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=346336 CPUtime=11.46 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 3067 0 0 0 1144 2 0 0 25 0 8 0 661892079 354648064 28097 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=346336 CPUtime=11.33 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 2927 0 0 0 1132 1 0 0 25 0 8 0 661892079 354648064 28097 33554432000 4194304 4964800 140736805225456 18446744073709551615 222921444283 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=346336 CPUtime=11.45 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 3782 0 0 0 1143 2 0 0 25 0 8 0 661892079 354648064 28097 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 92.69
Current children cumulated vsize (KiB) 346336

[startup+25.5012 s]
/proc/loadavg: 8.01 8.31 8.27 9/246 24506
/proc/meminfo: memFree=22648728/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=349692 CPUtime=195 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 35628 0 0 0 19480 20 0 0 25 0 8 0 661891959 358084608 34389 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 87423 34389 466 189 0 81772 0
[pid=24497/tid=24499] ppid=24495 vsize=349692 CPUtime=24.24 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 3279 0 0 0 2423 1 0 0 25 0 8 0 661892079 358084608 34389 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=349692 CPUtime=24.25 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 4358 0 0 0 2423 2 0 0 25 0 8 0 661892079 358084608 34389 33554432000 4194304 4964800 140736805225456 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=349692 CPUtime=24.22 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 3540 0 0 0 2421 1 0 0 25 0 8 0 661892079 358084608 34389 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670434 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=349692 CPUtime=24.23 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 3934 0 0 0 2421 2 0 0 25 0 8 0 661892079 358084608 34389 33554432000 4194304 4964800 140736805225456 18446744073709551615 4362339 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=349692 CPUtime=24.26 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 3997 0 0 0 2424 2 0 0 25 0 8 0 661892079 358084608 34389 33554432000 4194304 4964800 140736805225456 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=349692 CPUtime=24.04 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 3653 0 0 0 2402 2 0 0 25 0 8 0 661892079 358084608 34389 33554432000 4194304 4964800 140736805225456 18446744073709551615 4631161 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=349692 CPUtime=24.25 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 4597 0 0 0 2422 3 0 0 25 0 8 0 661892079 358084608 34389 33554432000 4194304 4964800 140736805225456 18446744073709551615 4669199 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 195
Current children cumulated vsize (KiB) 349692

[startup+51.1005 s]
/proc/loadavg: 8.01 8.28 8.26 9/246 24506
/proc/meminfo: memFree=22597564/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=359592 CPUtime=399.58 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 48324 0 0 0 39930 28 0 0 25 0 8 0 661891959 368222208 47055 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670534 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 89898 47055 466 189 0 84247 0
[pid=24497/tid=24499] ppid=24495 vsize=359592 CPUtime=49.83 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 4913 0 0 0 4980 3 0 0 25 0 8 0 661892079 368222208 47055 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=359592 CPUtime=49.84 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 6692 0 0 0 4981 3 0 0 25 0 8 0 661892079 368222208 47055 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=359592 CPUtime=49.82 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 4829 0 0 0 4980 2 0 0 25 0 8 0 661892079 368222208 47055 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=359592 CPUtime=49.83 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 5131 0 0 0 4980 3 0 0 25 0 8 0 661892079 368222208 47055 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=359592 CPUtime=49.86 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 5472 0 0 0 4983 3 0 0 25 0 8 0 661892079 368222208 47055 33554432000 4194304 4964800 140736805225456 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=359592 CPUtime=49.45 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 5016 0 0 0 4942 3 0 0 25 0 8 0 661892079 368222208 47055 33554432000 4194304 4964800 140736805225456 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=359592 CPUtime=49.84 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 6625 0 0 0 4980 4 0 0 25 0 8 0 661892079 368222208 47055 33554432000 4194304 4964800 140736805225456 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 399.58
Current children cumulated vsize (KiB) 359592

[startup+102.309 s]
/proc/loadavg: 8.06 8.25 8.25 9/246 24508
/proc/meminfo: memFree=22528572/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=379432 CPUtime=808.81 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 65584 0 0 0 80840 41 0 0 25 0 8 0 661891959 388538368 64190 33554432000 4194304 4964800 140736805225456 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 94858 64190 466 189 0 89207 0
[pid=24497/tid=24499] ppid=24495 vsize=379432 CPUtime=101.02 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 7314 0 0 0 10097 5 0 0 25 0 8 0 661892079 388538368 64190 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=379432 CPUtime=101.05 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 9791 0 0 0 10101 4 0 0 25 0 8 0 661892079 388538368 64190 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=379432 CPUtime=101.03 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 6934 0 0 0 10100 3 0 0 25 0 8 0 661892079 388538368 64190 33554432000 4194304 4964800 140736805225456 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=24497] ppid=24495 vsize=1262776 CPUtime=37732.7 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 259780 0 0 0 3773017 253 0 0 25 0 8 0 661891959 1293082624 244205 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 315694 244205 466 189 0 310043 0
[pid=24497/tid=24499] ppid=24495 vsize=1262776 CPUtime=4720.46 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 36393 0 0 0 472020 26 0 0 25 0 8 0 661892079 1293082624 244205 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670351 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=1262776 CPUtime=4720.08 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 44613 0 0 0 471978 30 0 0 25 0 8 0 661892079 1293082624 244205 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=1262776 CPUtime=4720.93 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 25637 0 0 0 472068 25 0 0 25 0 8 0 661892079 1293082624 244205 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=1262776 CPUtime=4721 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 33244 0 0 0 472074 26 0 0 25 0 8 0 661892079 1293082624 244205 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=1262776 CPUtime=4721.05 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 33318 0 0 0 472082 23 0 0 25 0 8 0 661892079 1293082624 244205 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=1262776 CPUtime=4686.94 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 26203 0 0 0 468663 31 0 0 25 0 8 0 661892079 1293082624 244205 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=1262776 CPUtime=4720.35 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 36368 0 0 0 471986 49 0 0 25 0 8 0 661892079 1293082624 244205 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37732.7
Current children cumulated vsize (KiB) 1262776

[startup+4782.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/246 24653
/proc/meminfo: memFree=21800052/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=1329848 CPUtime=38212.1 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 261053 0 0 0 3820959 255 0 0 25 0 8 0 661891959 1361764352 245462 33554432000 4194304 4964800 140736805225456 18446744073709551615 4668588 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 332462 245462 466 189 0 326811 0
[pid=24497/tid=24499] ppid=24495 vsize=1329848 CPUtime=4780.45 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 36739 0 0 0 478019 26 0 0 25 0 8 0 661892079 1361764352 245462 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=1329848 CPUtime=4780.06 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 44674 0 0 0 477976 30 0 0 25 0 8 0 661892079 1361764352 245462 33554432000 4194304 4964800 140736805225456 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=1329848 CPUtime=4780.91 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 25792 0 0 0 478065 26 0 0 25 0 8 0 661892079 1361764352 245462 33554432000 4194304 4964800 140736805225456 18446744073709551615 4627536 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=1329848 CPUtime=4780.99 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 33628 0 0 0 478073 26 0 0 25 0 8 0 661892079 1361764352 245462 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=1329848 CPUtime=4781.04 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 33407 0 0 0 478081 23 0 0 25 0 8 0 661892079 1361764352 245462 33554432000 4194304 4964800 140736805225456 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=1329848 CPUtime=4746.49 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 26269 0 0 0 474618 31 0 0 25 0 8 0 661892079 1361764352 245462 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=1329848 CPUtime=4780.33 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 36539 0 0 0 477984 49 0 0 25 0 8 0 661892079 1361764352 245462 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38212.1
Current children cumulated vsize (KiB) 1329848

[startup+4842.3 s]
/proc/loadavg: 8.05 8.04 8.00 9/246 24655
/proc/meminfo: memFree=21798676/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=1329848 CPUtime=38691.7 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 261567 0 0 0 3868913 256 0 0 25 0 8 0 661891959 1361764352 245976 33554432000 4194304 4964800 140736805225456 18446744073709551615 4659391 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 332462 245976 466 189 0 326811 0
[pid=24497/tid=24499] ppid=24495 vsize=1329848 CPUtime=4840.45 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 36838 0 0 0 484019 26 0 0 25 0 8 0 661892079 1361764352 245976 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=1329848 CPUtime=4840.06 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 44674 0 0 0 483976 30 0 0 25 0 8 0 661892079 1361764352 245976 33554432000 4194304 4964800 140736805225456 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=1329848 CPUtime=4840.9 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 25991 0 0 0 484064 26 0 0 25 0 8 0 661892079 1361764352 245976 33554432000 4194304 4964800 140736805225456 18446744073709551615 4312169 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=1329848 CPUtime=4840.99 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 33646 0 0 0 484073 26 0 0 25 0 8 0 661892079 1361764352 245976 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=1329848 CPUtime=4841.04 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 33530 0 0 0 484081 23 0 0 25 0 8 0 661892079 1361764352 245976 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=1329848 CPUtime=4806.05 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 26272 0 0 0 480574 31 0 0 25 0 8 0 661892079 1361764352 245976 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=1329848 CPUtime=4840.32 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 36597 0 0 0 483983 49 0 0 25 0 8 0 661892079 1361764352 245976 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38691.7
Current children cumulated vsize (KiB) 1329848

[startup+4902.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/246 24657
/proc/meminfo: memFree=21793072/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=1329848 CPUtime=39171.2 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 263065 0 0 0 3916867 257 0 0 25 0 8 0 661891959 1361764352 247373 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670273 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 332462 247373 466 189 0 326811 0
[pid=24497/tid=24499] ppid=24495 vsize=1329848 CPUtime=4900.44 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 37130 0 0 0 490018 26 0 0 25 0 8 0 661892079 1361764352 247373 33554432000 4194304 4964800 140736805225456 18446744073709551615 4644886 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=1329848 CPUtime=4900.06 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 44951 0 0 0 489976 30 0 0 25 0 8 0 661892079 1361764352 247373 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=1329848 CPUtime=4900.9 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 26017 0 0 0 490064 26 0 0 25 0 8 0 661892079 1361764352 247373 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=1329848 CPUtime=4900.99 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 33979 0 0 0 490073 26 0 0 25 0 8 0 661892079 1361764352 247373 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=1329848 CPUtime=4901.04 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 33815 0 0 0 490080 24 0 0 25 0 8 0 661892079 1361764352 247373 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=1329848 CPUtime=4865.62 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 26275 0 0 0 486531 31 0 0 25 0 8 0 661892079 1361764352 247373 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=1329848 CPUtime=4900.31 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 36826 0 0 0 489982 49 0 0 25 0 8 0 661892079 1361764352 247373 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39171.2
Current children cumulated vsize (KiB) 1329848

[startup+4962.3 s]
/proc/loadavg: 8.21 8.08 8.02 9/246 24661
/proc/meminfo: memFree=21788596/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=1330520 CPUtime=39649.9 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 264093 0 0 0 3964734 260 0 0 25 0 8 0 661891959 1362452480 248113 33554432000 4194304 4964800 140736805225456 18446744073709551615 222921474674 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 332630 248113 466 189 0 326979 0
[pid=24497/tid=24499] ppid=24495 vsize=1330520 CPUtime=4960.44 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 37130 0 0 0 496018 26 0 0 25 0 8 0 661892079 1362452480 248113 33554432000 4194304 4964800 140736805225456 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=1330520 CPUtime=4959.23 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 44951 0 0 0 495892 31 0 0 25 0 8 0 661892079 1362452480 248113 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=1330520 CPUtime=4960.89 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 26117 0 0 0 496063 26 0 0 25 0 8 0 661892079 1362452480 248113 33554432000 4194304 4964800 140736805225456 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=1330520 CPUtime=4961 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 34594 0 0 0 496073 27 0 0 25 0 8 0 661892079 1362452480 248113 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=1330520 CPUtime=4961.03 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 33819 0 0 0 496079 24 0 0 25 0 8 0 661892079 1362452480 248113 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=1330520 CPUtime=4925.18 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 26494 0 0 0 492486 32 0 0 25 0 8 0 661892079 1362452480 248113 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=1330520 CPUtime=4960.29 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 36916 0 0 0 495980 49 0 0 25 0 8 0 661892079 1362452480 248113 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39649.9
Current children cumulated vsize (KiB) 1330520



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5006.11 s]
/proc/loadavg: 8.10 8.07 8.01 9/246 24662
/proc/meminfo: memFree=21786228/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=1330804 CPUtime=40000.1 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 264880 0 0 0 3999751 261 0 0 25 0 8 0 661891959 1362743296 248755 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/24497/statm: 332701 248755 466 189 0 327050 0
[pid=24497/tid=24499] ppid=24495 vsize=1330804 CPUtime=5004.26 cores=0-7
/proc/24497/task/24499/stat : 24499 (claspmt) R 24495 24497 24436 0 -1 4202560 37611 0 0 0 500399 27 0 0 25 0 8 0 661892079 1362743296 248755 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=24497/tid=24500] ppid=24495 vsize=1330804 CPUtime=5003.05 cores=0-7
/proc/24497/task/24500/stat : 24500 (claspmt) R 24495 24497 24436 0 -1 4202560 44952 0 0 0 500274 31 0 0 25 0 8 0 661892079 1362743296 248755 33554432000 4194304 4964800 140736805225456 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=24497/tid=24501] ppid=24495 vsize=1330804 CPUtime=5004.72 cores=0-7
/proc/24497/task/24501/stat : 24501 (claspmt) R 24495 24497 24436 0 -1 4202560 26225 0 0 0 500445 27 0 0 25 0 8 0 661892079 1362743296 248755 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=24497/tid=24502] ppid=24495 vsize=1330804 CPUtime=5004.81 cores=0-7
/proc/24497/task/24502/stat : 24502 (claspmt) R 24495 24497 24436 0 -1 4202560 34618 0 0 0 500454 27 0 0 25 0 8 0 661892079 1362743296 248755 33554432000 4194304 4964800 140736805225456 18446744073709551615 4683996 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=24497/tid=24503] ppid=24495 vsize=1330804 CPUtime=5004.85 cores=0-7
/proc/24497/task/24503/stat : 24503 (claspmt) R 24495 24497 24436 0 -1 4202560 33885 0 0 0 500461 24 0 0 25 0 8 0 661892079 1362743296 248755 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=24497/tid=24504] ppid=24495 vsize=1330804 CPUtime=4968.67 cores=0-7
/proc/24497/task/24504/stat : 24504 (claspmt) R 24495 24497 24436 0 -1 4202560 26494 0 0 0 496835 32 0 0 25 0 8 0 661892079 1362743296 248755 33554432000 4194304 4964800 140736805225456 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=24497/tid=24505] ppid=24495 vsize=1330804 CPUtime=5004.11 cores=0-7
/proc/24497/task/24505/stat : 24505 (claspmt) R 24495 24497 24436 0 -1 4202560 37023 0 0 0 500361 50 0 0 25 0 8 0 661892079 1362743296 248755 33554432000 4194304 4964800 140736805225456 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.1
Current children cumulated vsize (KiB) 1330804

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5006.21 s]
/proc/loadavg: 8.10 8.07 8.01 9/246 24662
/proc/meminfo: memFree=21786228/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=1330544 CPUtime=40000.3 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 264890 0 0 0 3999767 261 0 0 25 0 1 0 661891959 1362477056 248700 33554432000 4194304 4964800 140736805225456 18446744073709551615 222921432417 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/24497/statm: 332636 248700 476 189 0 326985 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 1330544

[startup+5006.4 s]
/proc/loadavg: 8.10 8.07 8.01 9/246 24662
/proc/meminfo: memFree=21786228/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=1323248 CPUtime=40000.5 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 264890 0 0 0 3999785 261 0 0 25 0 1 0 661891959 1355005952 246306 33554432000 4194304 4964800 140736805225456 18446744073709551615 222921433649 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/24497/statm: 330812 246306 476 189 0 325161 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 1323248

[startup+5006.5 s]
/proc/loadavg: 8.10 8.07 8.01 9/246 24662
/proc/meminfo: memFree=21786228/32951124 swapFree=61559568/67111528
[pid=24497] ppid=24495 vsize=396184 CPUtime=40000.6 cores=0-7
/proc/24497/stat : 24497 (claspmt) R 24495 24497 24436 0 -1 4202496 264890 0 0 0 3999791 265 0 0 25 0 1 0 661891959 405692416 53159 33554432000 4194304 4964800 140736805225456 18446744073709551615 222921820519 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/24497/statm: 99046 53071 476 189 0 93395 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 396184

Child status: 0
Real time (s): 5006.51
CPU time (s): 40000.6
CPU user time (s): 39997.9
CPU system time (s): 2.66359
CPU usage (%): 798.971
Max. virtual memory (cumulated for all children) (KiB): 1330804

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39997.9
system time used= 2.66359
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 264891
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 83812
involuntary context switches= 189308

runsolver used 9.28959 second user time and 27.1439 second system time

The end

Launcher Data 

Begin job on node109 at 2011-05-16 01:41:52
IDJOB=3381071
IDBENCH=83253
IDSOLVER=1865
FILE ID=node109/3381071-1305502912
RUNJOBID= node109-1305502884-24450
PBS_JOBID= 13325467
Free space on /tmp= 73264 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-3-6_2071.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3381071-1305502912/watcher-3381071-1305502912 -o /tmp/evaluation-result-3381071-1305502912/solver-3381071-1305502912 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3381071-1305502912.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 337bdbc5d8bf0013ca73aeffa06cffe8
RANDOM SEED=382217634

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22782648 kB
Buffers:        284820 kB
Cached:        2615960 kB
SwapCached:      28404 kB
Active:        1383108 kB
Inactive:      8555872 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22782648 kB
SwapTotal:    67111528 kB
SwapFree:     61559568 kB
Dirty:            3416 kB
Writeback:           0 kB
AnonPages:     7015912 kB
Mapped:          18576 kB
Slab:           132668 kB
PageTables:      32756 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 19085872 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73264 MiB
End job on node109 at 2011-05-16 03:05:20