Trace number 3373566

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.27 1203.03

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom25.cnf
MD5SUMc40bd543dad558d19995fef4fd742233
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables67777
Number of clauses227761
Sum of the clauses size582177
Maximum clause length2084
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2115213
Number of clauses of size 3111398
Number of clauses of size 4324
Number of clauses of size 523
Number of clauses of size over 5802

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...422073/instance-3373566-1305422073.cnf
0.69/0.70	c Solving...
4800.02/1202.81	
4800.02/1202.81	*** INTERRUPTED! ***
4800.02/1202.81	*** Shutting down threads...
4800.24/1203.02	s UNKNOWN
4800.24/1203.02	
4800.24/1203.02	c INTERRUPTED   : 1
4800.24/1203.02	c Models        : 0+    
4800.24/1203.02	c Time          : 1202.813s (Solving: 1202.11s 1st Model: 0.00s Unsat: 0.00s)
4800.24/1203.02	c CPU Time      : 4800.050s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373566-1305422073/watcher-3373566-1305422073 -o /tmp/evaluation-result-3373566-1305422073/solver-3373566-1305422073 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373566-1305422073.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.83 8.06 8.01 6/241 10227
/proc/meminfo: memFree=24233132/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=29544 CPUtime=0 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 1436 0 0 0 0 0 0 0 25 0 1 0 653808056 30253056 1366 33554432000 4194304 4964800 140734763155776 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10227/statm: 7386 1374 375 189 0 2260 0

[startup+0.0121251 s]
/proc/loadavg: 7.83 8.06 8.01 6/241 10227
/proc/meminfo: memFree=24233132/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=33524 CPUtime=0 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 3720 0 0 0 0 0 0 0 25 0 1 0 653808056 34328576 3308 33554432000 4194304 4964800 140734763155776 18446744073709551615 4679094 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10227/statm: 8381 3315 377 189 0 3255 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 33524

[startup+0.101111 s]
/proc/loadavg: 7.83 8.06 8.01 6/241 10227
/proc/meminfo: memFree=24233132/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=50636 CPUtime=0.09 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 10049 0 0 0 9 0 0 0 25 0 1 0 653808056 51851264 7639 33554432000 4194304 4964800 140734763155776 18446744073709551615 222921437893 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10227/statm: 12659 7639 398 189 0 7533 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 50636

[startup+0.301074 s]
/proc/loadavg: 7.83 8.06 8.01 6/241 10227
/proc/meminfo: memFree=24233132/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=60420 CPUtime=0.29 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 12351 0 0 0 29 0 0 0 25 0 1 0 653808056 61870080 9941 33554432000 4194304 4964800 140734763155776 18446744073709551615 4600360 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10227/statm: 15105 9942 403 189 0 9979 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 60420

[startup+0.701 s]
/proc/loadavg: 7.83 8.06 8.01 6/241 10227
/proc/meminfo: memFree=24233132/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=66864 CPUtime=0.69 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 13959 0 0 0 68 1 0 0 25 0 1 0 653808056 68468736 11549 33554432000 4194304 4964800 140734763155776 18446744073709551615 4324281 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10227/statm: 16716 11549 405 189 0 11590 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 66864

[startup+1.50079 s]
/proc/loadavg: 7.83 8.06 8.01 9/245 10231
/proc/meminfo: memFree=24163612/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=221080 CPUtime=3.82 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 22960 0 0 0 379 3 0 0 25 0 4 0 653808056 226385920 17869 33554432000 4194304 4964800 140734763155776 18446744073709551615 4370264 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 55270 17869 458 189 0 49619 0
[pid=10227/tid=10229] ppid=10225 vsize=221080 CPUtime=0.78 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 2002 0 0 0 78 0 0 0 18 0 4 0 653808127 226385920 17869 33554432000 4194304 4964800 140734763155776 18446744073709551615 4370266 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=221080 CPUtime=0.78 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 3304 0 0 0 77 1 0 0 18 0 4 0 653808127 226385920 17869 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=221080 CPUtime=0.76 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 3442 0 0 0 76 0 0 0 18 0 4 0 653808127 226385920 17869 33554432000 4194304 4964800 140734763155776 18446744073709551615 4321038 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.82
Current children cumulated vsize (KiB) 221080

[startup+3.1005 s]
/proc/loadavg: 7.84 8.06 8.00 9/245 10231
/proc/meminfo: memFree=24151340/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=222532 CPUtime=10.21 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 24796 0 0 0 1017 4 0 0 25 0 4 0 653808056 227872768 19705 33554432000 4194304 4964800 140734763155776 18446744073709551615 4669445 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 55633 19705 458 189 0 49982 0
[pid=10227/tid=10229] ppid=10225 vsize=222532 CPUtime=2.38 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 2304 0 0 0 238 0 0 0 21 0 4 0 653808127 227872768 19705 33554432000 4194304 4964800 140734763155776 18446744073709551615 4312169 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=222532 CPUtime=2.38 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 3981 0 0 0 237 1 0 0 22 0 4 0 653808127 227872768 19705 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=222532 CPUtime=2.35 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 3900 0 0 0 235 0 0 0 22 0 4 0 653808127 227872768 19705 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 10.21
Current children cumulated vsize (KiB) 222532

[startup+6.30091 s]
/proc/loadavg: 7.84 8.06 8.00 9/245 10231
/proc/meminfo: memFree=24129188/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=229600 CPUtime=22.98 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 29753 0 0 0 2291 7 0 0 25 0 4 0 653808056 235110400 24662 33554432000 4194304 4964800 140734763155776 18446744073709551615 4660444 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 57400 24662 458 189 0 51749 0
[pid=10227/tid=10229] ppid=10225 vsize=229600 CPUtime=5.57 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 2979 0 0 0 557 0 0 0 25 0 4 0 653808127 235110400 24662 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=229600 CPUtime=5.57 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 6262 0 0 0 555 2 0 0 25 0 4 0 653808127 235110400 24662 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670546 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=229600 CPUtime=5.53 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 4997 0 0 0 552 1 0 0 25 0 4 0 653808127 235110400 24662 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 22.98
Current children cumulated vsize (KiB) 229600

[startup+12.7007 s]
/proc/loadavg: 7.86 8.06 8.00 9/245 10231
/proc/meminfo: memFree=24084124/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=235172 CPUtime=48.52 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 34725 0 0 0 4843 9 0 0 25 0 4 0 653808056 240816128 29634 33554432000 4194304 4964800 140734763155776 18446744073709551615 4632237 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 58793 29634 460 189 0 53142 0
[pid=10227/tid=10229] ppid=10225 vsize=235172 CPUtime=11.97 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 3738 0 0 0 1196 1 0 0 25 0 4 0 653808127 240816128 29634 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668805 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=235172 CPUtime=11.98 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 8705 0 0 0 1195 3 0 0 25 0 4 0 653808127 240816128 29634 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=235172 CPUtime=11.89 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 5664 0 0 0 1187 2 0 0 25 0 4 0 653808127 240816128 29634 33554432000 4194304 4964800 140734763155776 18446744073709551615 4684107 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 48.52
Current children cumulated vsize (KiB) 235172

[startup+25.5004 s]
/proc/loadavg: 7.88 8.05 8.00 9/245 10232
/proc/meminfo: memFree=24021868/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=252976 CPUtime=99.63 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 46677 0 0 0 9948 15 0 0 25 0 4 0 653808056 259047424 41586 33554432000 4194304 4964800 140734763155776 18446744073709551615 4332221 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 63244 41586 460 189 0 57593 0
[pid=10227/tid=10229] ppid=10225 vsize=252976 CPUtime=24.77 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 5654 0 0 0 2475 2 0 0 25 0 4 0 653808127 259047424 41586 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668748 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=252976 CPUtime=24.77 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 12951 0 0 0 2473 4 0 0 25 0 4 0 653808127 259047424 41586 33554432000 4194304 4964800 140734763155776 18446744073709551615 4361097 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=252976 CPUtime=24.59 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 8387 0 0 0 2456 3 0 0 25 0 4 0 653808127 259047424 41586 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 99.63
Current children cumulated vsize (KiB) 252976

[startup+51.1007 s]
/proc/loadavg: 8.00 8.06 8.01 9/245 10232
/proc/meminfo: memFree=23950260/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=258240 CPUtime=201.84 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 53388 0 0 0 20163 21 0 0 25 0 4 0 653808056 264437760 48297 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 64560 48297 460 189 0 58909 0
[pid=10227/tid=10229] ppid=10225 vsize=258240 CPUtime=50.37 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 6744 0 0 0 5034 3 0 0 25 0 4 0 653808127 264437760 48297 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668794 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=258240 CPUtime=50.38 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 15172 0 0 0 5031 7 0 0 25 0 4 0 653808127 264437760 48297 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=258240 CPUtime=50.01 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 10014 0 0 0 4996 5 0 0 25 0 4 0 653808127 264437760 48297 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 201.84
Current children cumulated vsize (KiB) 258240

[startup+102.309 s]
/proc/loadavg: 8.22 8.10 8.02 9/245 10234
/proc/meminfo: memFree=23852904/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=415744 CPUtime=406.27 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 71163 0 0 0 40596 31 0 0 25 0 4 0 653808056 425721856 66068 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668552 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 103936 66068 460 189 0 98285 0
[pid=10227/tid=10229] ppid=10225 vsize=415744 CPUtime=101.57 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 9691 0 0 0 10152 5 0 0 25 0 4 0 653808127 425721856 66068 33554432000 4194304 4964800 140734763155776 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=415744 CPUtime=101.58 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 23363 0 0 0 10147 11 0 0 25 0 4 0 653808127 425721856 66068 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=415744 CPUtime=100.83 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 12429 0 0 0 10077 6 0 0 25 0 4 0 653808127 425721856 66068 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 406.27
Current children cumulated vsize (KiB) 415744

[startup+162.3 s]
/proc/loadavg: 8.22 8.11 8.02 9/245 10235
/proc/meminfo: memFree=23719332/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=450080 CPUtime=645.8 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 99565 0 0 0 64528 52 0 0 25 0 4 0 653808056 460881920 94358 33554432000 4194304 4964800 140734763155776 18446744073709551615 4362240 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 112520 94358 460 189 0 106869 0
[pid=10227/tid=10229] ppid=10225 vsize=450080 CPUtime=161.54 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 15299 0 0 0 16145 9 0 0 25 0 4 0 653808127 460881920 94358 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668732 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=450080 CPUtime=161.57 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 34394 0 0 0 16141 16 0 0 25 0 4 0 653808127 460881920 94358 33554432000 4194304 4964800 140734763155776 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=450080 CPUtime=160.39 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 17407 0 0 0 16029 10 0 0 25 0 4 0 653808127 460881920 94358 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 645.8
Current children cumulated vsize (KiB) 450080

[startup+222.3 s]
/proc/loadavg: 8.14 8.10 8.02 9/245 10237
/proc/meminfo: memFree=23605600/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=613252 CPUtime=885.35 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 124156 0 0 0 88466 69 0 0 25 0 4 0 653808056 627970048 118879 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668734 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 153313 118879 460 189 0 147662 0
[pid=10227/tid=10229] ppid=10225 vsize=613252 CPUtime=221.23 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 19949 0 0 0 22111 12 0 0 25 0 4 0 653808127 627970048 118879 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=613252 CPUtime=221.57 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 43047 0 0 0 22136 21 0 0 25 0 4 0 653808127 627970048 118879 33554432000 4194304 4964800 140734763155776 18446744073709551615 4320921 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=613252 CPUtime=220.25 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 23591 0 0 0 22011 14 0 0 25 0 4 0 653808127 627970048 118879 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 885.35
Current children cumulated vsize (KiB) 613252

[startup+282.3 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2562.18
Current children cumulated vsize (KiB) 892032

[startup+702.301 s]
/proc/loadavg: 8.04 8.06 8.01 9/245 10250
/proc/meminfo: memFree=23252648/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=892032 CPUtime=2801.72 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 195556 0 0 0 280030 142 0 0 25 0 4 0 653808056 913440768 190279 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668987 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 223008 190279 460 189 0 217357 0
[pid=10227/tid=10229] ppid=10225 vsize=892032 CPUtime=697.65 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 34996 0 0 0 69736 29 0 0 25 0 4 0 653808127 913440768 190279 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=892032 CPUtime=701.55 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 62023 0 0 0 70118 37 0 0 25 0 4 0 653808127 913440768 190279 33554432000 4194304 4964800 140734763155776 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=892032 CPUtime=700.22 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 40701 0 0 0 69992 30 0 0 25 0 4 0 653808127 913440768 190279 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670349 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2801.72
Current children cumulated vsize (KiB) 892032

[startup+762.309 s]
/proc/loadavg: 8.16 8.09 8.02 9/245 10251
/proc/meminfo: memFree=23200044/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=957568 CPUtime=3041.31 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 208340 0 0 0 303974 157 0 0 25 0 4 0 653808056 980549632 203063 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 239392 203063 460 189 0 233741 0
[pid=10227/tid=10229] ppid=10225 vsize=957568 CPUtime=757.22 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 35744 0 0 0 75692 30 0 0 25 0 4 0 653808127 980549632 203063 33554432000 4194304 4964800 140734763155776 18446744073709551615 4370264 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=957568 CPUtime=761.57 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 65373 0 0 0 76116 41 0 0 25 0 4 0 653808127 980549632 203063 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668924 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=957568 CPUtime=760.24 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 47097 0 0 0 75985 39 0 0 25 0 4 0 653808127 980549632 203063 33554432000 4194304 4964800 140734763155776 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3041.31
Current children cumulated vsize (KiB) 957568

[startup+822.301 s]
/proc/loadavg: 8.17 8.10 8.03 9/245 10253
/proc/meminfo: memFree=23126368/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=992288 CPUtime=3280.82 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 226118 0 0 0 327907 175 0 0 25 0 4 0 653808056 1016102912 220817 33554432000 4194304 4964800 140734763155776 18446744073709551615 4370224 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 248072 220817 460 189 0 242421 0
[pid=10227/tid=10229] ppid=10225 vsize=992288 CPUtime=816.78 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 44184 0 0 0 81637 41 0 0 25 0 4 0 653808127 1016102912 220817 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=992288 CPUtime=821.53 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 68300 0 0 0 82110 43 0 0 25 0 4 0 653808127 1016102912 220817 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=992288 CPUtime=820.22 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 53025 0 0 0 81980 42 0 0 25 0 4 0 653808127 1016102912 220817 33554432000 4194304 4964800 140734763155776 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3280.82
Current children cumulated vsize (KiB) 992288

[startup+882.301 s]
/proc/loadavg: 8.24 8.13 8.04 9/245 10255
/proc/meminfo: memFree=23118656/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=992288 CPUtime=3520.37 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 226184 0 0 0 351861 176 0 0 25 0 4 0 653808056 1016102912 220879 33554432000 4194304 4964800 140734763155776 18446744073709551615 4362287 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 248072 220879 460 189 0 242421 0
[pid=10227/tid=10229] ppid=10225 vsize=992288 CPUtime=876.33 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 44228 0 0 0 87592 41 0 0 25 0 4 0 653808127 1016102912 220879 33554432000 4194304 4964800 140734763155776 18446744073709551615 4370266 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=992288 CPUtime=881.54 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 68301 0 0 0 88111 43 0 0 25 0 4 0 653808127 1016102912 220879 33554432000 4194304 4964800 140734763155776 18446744073709551615 4362944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=992288 CPUtime=880.22 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 53038 0 0 0 87980 42 0 0 25 0 4 0 653808127 1016102912 220879 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3520.37
Current children cumulated vsize (KiB) 992288

[startup+942.301 s]
/proc/loadavg: 8.22 8.13 8.04 9/245 10256
/proc/meminfo: memFree=23071268/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=1057824 CPUtime=3759.94 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 237048 0 0 0 375807 187 0 0 25 0 4 0 653808056 1083211776 231739 33554432000 4194304 4964800 140734763155776 18446744073709551615 4332341 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 264456 231739 460 189 0 258805 0
[pid=10227/tid=10229] ppid=10225 vsize=1057824 CPUtime=935.89 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 44230 0 0 0 93548 41 0 0 25 0 4 0 653808127 1083211776 231739 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=1057824 CPUtime=941.54 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 77186 0 0 0 94101 53 0 0 25 0 4 0 653808127 1083211776 231739 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=1057824 CPUtime=940.22 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 55013 0 0 0 93978 44 0 0 25 0 4 0 653808127 1083211776 231739 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3759.94
Current children cumulated vsize (KiB) 1057824

[startup+1002.3 s]
/proc/loadavg: 8.14 8.12 8.04 9/245 10258
/proc/meminfo: memFree=23036028/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=1057824 CPUtime=3999.5 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 244518 0 0 0 399753 197 0 0 25 0 4 0 653808056 1083211776 239041 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 264456 239041 460 189 0 258805 0
[pid=10227/tid=10229] ppid=10225 vsize=1057824 CPUtime=995.45 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 46945 0 0 0 99499 46 0 0 25 0 4 0 653808127 1083211776 239041 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=1057824 CPUtime=1001.55 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 79559 0 0 0 100099 56 0 0 25 0 4 0 653808127 1083211776 239041 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=1057824 CPUtime=1000.21 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 56361 0 0 0 99976 45 0 0 25 0 4 0 653808127 1083211776 239041 33554432000 4194304 4964800 140734763155776 18446744073709551615 4660250 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3999.5
Current children cumulated vsize (KiB) 1057824

[startup+1062.3 s]
/proc/loadavg: 8.10 8.11 8.04 9/245 10259
/proc/meminfo: memFree=22982556/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=1123360 CPUtime=4239.07 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 255633 0 0 0 423695 212 0 0 25 0 4 0 653808056 1150320640 250156 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 280840 250156 460 189 0 275189 0
[pid=10227/tid=10229] ppid=10225 vsize=1123360 CPUtime=1055.01 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 47939 0 0 0 105455 46 0 0 25 0 4 0 653808127 1150320640 250156 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=1123360 CPUtime=1061.55 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 79595 0 0 0 106099 56 0 0 25 0 4 0 653808127 1150320640 250156 33554432000 4194304 4964800 140734763155776 18446744073709551615 4653186 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=1123360 CPUtime=1060.22 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 66409 0 0 0 105962 60 0 0 25 0 4 0 653808127 1150320640 250156 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4239.07
Current children cumulated vsize (KiB) 1123360

[startup+1122.3 s]
/proc/loadavg: 8.08 8.10 8.04 9/245 10261
/proc/meminfo: memFree=22972360/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=1123360 CPUtime=4478.59 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 257438 0 0 0 447644 215 0 0 25 0 4 0 653808056 1150320640 251961 33554432000 4194304 4964800 140734763155776 18446744073709551615 4465565 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 280840 251961 460 189 0 275189 0
[pid=10227/tid=10229] ppid=10225 vsize=1123360 CPUtime=1114.55 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 48004 0 0 0 111408 47 0 0 25 0 4 0 653808127 1150320640 251961 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668552 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=1123360 CPUtime=1121.54 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 79601 0 0 0 112098 56 0 0 25 0 4 0 653808127 1150320640 251961 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=1123360 CPUtime=1120.22 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 66461 0 0 0 111962 60 0 0 25 0 4 0 653808127 1150320640 251961 33554432000 4194304 4964800 140734763155776 18446744073709551615 4332188 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4478.59
Current children cumulated vsize (KiB) 1123360

[startup+1182.3 s]
/proc/loadavg: 8.03 8.08 8.03 9/245 10263
/proc/meminfo: memFree=22968740/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=1123360 CPUtime=4718.16 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 257453 0 0 0 471601 215 0 0 25 0 4 0 653808056 1150320640 251976 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670264 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 280840 251976 460 189 0 275189 0
[pid=10227/tid=10229] ppid=10225 vsize=1123360 CPUtime=1174.12 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 48009 0 0 0 117365 47 0 0 25 0 4 0 653808127 1150320640 251976 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=1123360 CPUtime=1181.54 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 79604 0 0 0 118098 56 0 0 25 0 4 0 653808127 1150320640 251976 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=1123360 CPUtime=1180.22 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 66468 0 0 0 117962 60 0 0 25 0 4 0 653808127 1150320640 251976 33554432000 4194304 4964800 140734763155776 18446744073709551615 4653550 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4718.16
Current children cumulated vsize (KiB) 1123360



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.8 s]
/proc/loadavg: 7.70 8.01 8.01 5/237 10281
/proc/meminfo: memFree=23259704/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=1123360 CPUtime=4800.02 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 259635 0 0 0 479785 217 0 0 25 0 4 0 653808056 1150320640 254158 33554432000 4194304 4964800 140734763155776 18446744073709551615 4668564 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/10227/statm: 280840 254158 460 189 0 275189 0
[pid=10227/tid=10229] ppid=10225 vsize=1123360 CPUtime=1194.47 cores=0,2,4,6
/proc/10227/task/10229/stat : 10229 (claspmt) R 10225 10227 9986 0 -1 4202560 48009 0 0 0 119400 47 0 0 25 0 4 0 653808127 1150320640 254159 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10227/tid=10230] ppid=10225 vsize=1123360 CPUtime=1202.05 cores=0,2,4,6
/proc/10227/task/10230/stat : 10230 (claspmt) R 10225 10227 9986 0 -1 4202560 80923 0 0 0 120148 57 0 0 25 0 4 0 653808127 1150320640 254159 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10227/tid=10231] ppid=10225 vsize=1123360 CPUtime=1200.72 cores=0,2,4,6
/proc/10227/task/10231/stat : 10231 (claspmt) R 10225 10227 9986 0 -1 4202560 66470 0 0 0 120012 60 0 0 25 0 4 0 653808127 1150320640 254159 33554432000 4194304 4964800 140734763155776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.02
Current children cumulated vsize (KiB) 1123360

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203 s]
/proc/loadavg: 7.70 8.01 8.01 5/237 10281
/proc/meminfo: memFree=23259704/32951124 swapFree=61559568/67111528
[pid=10227] ppid=10225 vsize=819720 CPUtime=4800.24 cores=0,2,4,6
/proc/10227/stat : 10227 (claspmt) R 10225 10227 9986 0 -1 4202496 259648 0 0 0 479805 219 0 0 25 0 1 0 653808056 839393280 150162 33554432000 4194304 4964800 140734763155776 18446744073709551615 222921802858 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/10227/statm: 204930 150162 471 189 0 199279 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 819720

Child status: 0
Real time (s): 1203.03
CPU time (s): 4800.27
CPU user time (s): 4798.05
CPU system time (s): 2.21966
CPU usage (%): 399.015
Max. virtual memory (cumulated for all children) (KiB): 1123360

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.05
system time used= 2.21966
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 259649
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11528
involuntary context switches= 23547

runsolver used 2.45463 second user time and 6.30404 second system time

The end

Launcher Data 

Begin job on node109 at 2011-05-15 03:14:33
IDJOB=3373566
IDBENCH=83109
IDSOLVER=1853
FILE ID=node109/3373566-1305422073
RUNJOBID= node109-1305419659-10004
PBS_JOBID= 13324580
Free space on /tmp= 73220 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom25.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373566-1305422073/watcher-3373566-1305422073 -o /tmp/evaluation-result-3373566-1305422073/solver-3373566-1305422073 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373566-1305422073.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c40bd543dad558d19995fef4fd742233
RANDOM SEED=65544037

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24233412 kB
Buffers:        240328 kB
Cached:        2286720 kB
SwapCached:      28404 kB
Active:         153704 kB
Inactive:      8349068 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24233412 kB
SwapTotal:    67111528 kB
SwapFree:     61559568 kB
Dirty:            7480 kB
Writeback:           0 kB
AnonPages:     5954056 kB
Mapped:          18428 kB
Slab:           122284 kB
PageTables:      30968 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 17924608 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73224 MiB
End job on node109 at 2011-05-15 03:34:38