Trace number 3299396

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.46 1202.14

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-4-5_4232.cnf
MD5SUM86d9f733c618d2ca060f457ab8a19463
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4230
Number of clauses100443
Sum of the clauses size411786
Maximum clause length5
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 490429
Number of clauses of size 510014
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...092690/instance-3299396-1304092690.cnf
0.19/0.22	c Solving...
4800.30/1202.01	
4800.30/1202.01	*** INTERRUPTED! ***
4800.30/1202.01	*** Shutting down threads...
4800.43/1202.13	s UNKNOWN
4800.43/1202.13	
4800.43/1202.13	c INTERRUPTED   : 1
4800.43/1202.13	c Models        : 0+    
4800.43/1202.13	c Time          : 1202.010s (Solving: 1201.78s 1st Model: 0.00s Unsat: 0.00s)
4800.43/1202.13	c CPU Time      : 4800.320s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299396-1304092690/watcher-3299396-1304092690 -o /tmp/evaluation-result-3299396-1304092690/solver-3299396-1304092690 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299396-1304092690.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.72 7.95 7.97 5/180 30327
/proc/meminfo: memFree=30864360/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=22152 CPUtime=0 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 856 0 0 0 0 0 0 0 25 0 1 0 520866941 22683648 753 33554432000 4194304 4964704 140737133966688 18446744073709551615 228244348672 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/30327/statm: 5538 754 385 189 0 412 0

[startup+0.088716 s]
/proc/loadavg: 7.72 7.95 7.97 5/180 30327
/proc/meminfo: memFree=30864360/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=31184 CPUtime=0.08 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 3522 0 0 0 8 0 0 0 25 0 1 0 520866941 31932416 2906 33554432000 4194304 4964704 140737133966688 18446744073709551615 4607549 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/30327/statm: 7796 2906 401 189 0 2670 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 31184

[startup+0.100711 s]
/proc/loadavg: 7.72 7.95 7.97 5/180 30327
/proc/meminfo: memFree=30864360/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=31184 CPUtime=0.09 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 3522 0 0 0 9 0 0 0 25 0 1 0 520866941 31932416 2906 33554432000 4194304 4964704 140737133966688 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/30327/statm: 7796 2906 401 189 0 2670 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31184

[startup+0.300613 s]
/proc/loadavg: 7.72 7.95 7.97 5/180 30327
/proc/meminfo: memFree=30864360/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=246860 CPUtime=0.45 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 8824 0 0 0 42 3 0 0 25 0 4 0 520866941 252784640 7969 33554432000 4194304 4964704 140737133966688 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 61715 7969 458 189 0 56064 0
Current children cumulated CPU time (s) 0.45
Current children cumulated vsize (KiB) 246860

[startup+0.700544 s]
/proc/loadavg: 7.72 7.95 7.97 5/180 30327
/proc/meminfo: memFree=30864360/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=249536 CPUtime=2.05 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 11796 0 0 0 201 4 0 0 25 0 4 0 520866941 255524864 10941 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 62384 10942 458 189 0 56733 0
Current children cumulated CPU time (s) 2.05
Current children cumulated vsize (KiB) 249536

[startup+1.50041 s]
/proc/loadavg: 7.72 7.95 7.97 9/184 30331
/proc/meminfo: memFree=30816456/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=252308 CPUtime=5.24 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 14639 0 0 0 519 5 0 0 25 0 4 0 520866941 258363392 13784 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670255 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 63077 13784 458 189 0 57426 0
[pid=30327/tid=30329] ppid=30325 vsize=252308 CPUtime=1.24 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 2721 0 0 0 123 1 0 0 19 0 4 0 520866964 258363392 13784 33554432000 4194304 4964704 140737133966688 18446744073709551615 4653475 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=252308 CPUtime=1.26 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 3367 0 0 0 124 2 0 0 19 0 4 0 520866964 258363392 13784 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=252308 CPUtime=1.24 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 2671 0 0 0 124 0 0 0 19 0 4 0 520866964 258363392 13784 33554432000 4194304 4964704 140737133966688 18446744073709551615 4660038 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5.24
Current children cumulated vsize (KiB) 252308

[startup+3.10113 s]
/proc/loadavg: 7.72 7.95 7.97 9/184 30331
/proc/meminfo: memFree=30797236/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=256440 CPUtime=11.64 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 18787 0 0 0 1157 7 0 0 25 0 4 0 520866941 262594560 17932 33554432000 4194304 4964704 140737133966688 18446744073709551615 4362584 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 64110 17932 460 189 0 58459 0
[pid=30327/tid=30329] ppid=30325 vsize=256440 CPUtime=2.84 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 3632 0 0 0 283 1 0 0 23 0 4 0 520866964 262594560 17932 33554432000 4194304 4964704 140737133966688 18446744073709551615 4364583 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=256440 CPUtime=2.85 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 4661 0 0 0 283 2 0 0 23 0 4 0 520866964 262594560 17932 33554432000 4194304 4964704 140737133966688 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=256440 CPUtime=2.85 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 3580 0 0 0 284 1 0 0 23 0 4 0 520866964 262594560 17932 33554432000 4194304 4964704 140737133966688 18446744073709551615 4658370 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.64
Current children cumulated vsize (KiB) 256440

[startup+6.30056 s]
/proc/loadavg: 7.75 7.95 7.97 9/184 30332
/proc/meminfo: memFree=30768432/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=260420 CPUtime=24.42 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 23184 0 0 0 2433 9 0 0 25 0 4 0 520866941 266670080 22329 33554432000 4194304 4964704 140737133966688 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 65105 22329 460 189 0 59454 0
[pid=30327/tid=30329] ppid=30325 vsize=260420 CPUtime=6.02 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 4458 0 0 0 600 2 0 0 25 0 4 0 520866964 266670080 22329 33554432000 4194304 4964704 140737133966688 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=260420 CPUtime=6.06 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 5895 0 0 0 603 3 0 0 25 0 4 0 520866964 266670080 22329 33554432000 4194304 4964704 140737133966688 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=260420 CPUtime=6.04 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 4214 0 0 0 603 1 0 0 25 0 4 0 520866964 266670080 22329 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.42
Current children cumulated vsize (KiB) 260420

[startup+12.7004 s]
/proc/loadavg: 7.77 7.95 7.97 9/184 30332
/proc/meminfo: memFree=30730884/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=264540 CPUtime=49.97 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 30204 0 0 0 4984 13 0 0 25 0 4 0 520866941 270888960 29349 33554432000 4194304 4964704 140737133966688 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 66135 29349 460 189 0 60484 0
[pid=30327/tid=30329] ppid=30325 vsize=264540 CPUtime=12.38 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 5492 0 0 0 1235 3 0 0 25 0 4 0 520866964 270888960 29349 33554432000 4194304 4964704 140737133966688 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=264540 CPUtime=12.46 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 7927 0 0 0 1242 4 0 0 25 0 4 0 520866964 270888960 29349 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670286 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=264540 CPUtime=12.45 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 6320 0 0 0 1242 3 0 0 25 0 4 0 520866964 270888960 29349 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 49.97
Current children cumulated vsize (KiB) 264540

[startup+25.5002 s]
/proc/loadavg: 7.82 7.96 7.97 9/184 30332
/proc/meminfo: memFree=30692296/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=276532 CPUtime=101.09 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 37070 0 0 0 10091 18 0 0 25 0 4 0 520866941 283168768 36215 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 69133 36215 460 189 0 63482 0
[pid=30327/tid=30329] ppid=30325 vsize=276532 CPUtime=25.09 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 7809 0 0 0 2505 4 0 0 25 0 4 0 520866964 283168768 36215 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=276532 CPUtime=25.25 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 8621 0 0 0 2521 4 0 0 25 0 4 0 520866964 283168768 36215 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=276532 CPUtime=25.25 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 8682 0 0 0 2521 4 0 0 25 0 4 0 520866964 283168768 36215 33554432000 4194304 4964704 140737133966688 18446744073709551615 4653394 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 101.09
Current children cumulated vsize (KiB) 276532

[startup+51.1007 s]
/proc/loadavg: 7.95 7.97 7.97 9/184 30333
/proc/meminfo: memFree=30619192/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=292496 CPUtime=203.34 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 49200 0 0 0 20310 24 0 0 25 0 4 0 520866941 299515904 48318 33554432000 4194304 4964704 140737133966688 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 73124 48318 460 189 0 67473 0
[pid=30327/tid=30329] ppid=30325 vsize=292496 CPUtime=50.56 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 10098 0 0 0 5050 6 0 0 25 0 4 0 520866964 299515904 48318 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=292496 CPUtime=50.86 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 12892 0 0 0 5079 7 0 0 25 0 4 0 520866964 299515904 48318 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=292496 CPUtime=50.84 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 10442 0 0 0 5079 5 0 0 25 0 4 0 520866964 299515904 48318 33554432000 4194304 4964704 140737133966688 18446744073709551615 4332418 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.34
Current children cumulated vsize (KiB) 292496

[startup+102.307 s]
/proc/loadavg: 7.97 7.97 7.97 9/184 30334
/proc/meminfo: memFree=30512652/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=374364 CPUtime=407.88 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 67140 0 0 0 40750 38 0 0 25 0 4 0 520866941 383348736 65852 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670416 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 93591 65852 460 189 0 87940 0
[pid=30327/tid=30329] ppid=30325 vsize=374364 CPUtime=101.46 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 12136 0 0 0 10139 7 0 0 25 0 4 0 520866964 383348736 65852 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=374364 CPUtime=102.06 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 16338 0 0 0 10198 8 0 0 25 0 4 0 520866964 383348736 65852 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=374364 CPUtime=102.05 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 15998 0 0 0 10196 9 0 0 25 0 4 0 520866964 383348736 65852 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.88
Current children cumulated vsize (KiB) 374364

[startup+162.3 s]
/proc/loadavg: 8.16 8.02 7.99 9/184 30336
/proc/meminfo: memFree=30365308/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=524704 CPUtime=647.5 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 99233 0 0 0 64686 64 0 0 25 0 4 0 520866941 537296896 97266 33554432000 4194304 4964704 140737133966688 18446744073709551615 4342957 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 131176 97266 460 189 0 125525 0
[pid=30327/tid=30329] ppid=30325 vsize=524704 CPUtime=161.11 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 18325 0 0 0 16098 13 0 0 25 0 4 0 520866964 537296896 97266 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=524704 CPUtime=162.06 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 26720 0 0 0 16189 17 0 0 25 0 4 0 520866964 537296896 97266 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=524704 CPUtime=162.04 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 22755 0 0 0 16191 13 0 0 25 0 4 0 520866964 537296896 97266 33554432000 4194304 4964704 140737133966688 18446744073709551615 4320911 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 647.5
Current children cumulated vsize (KiB) 524704

[startup+222.301 s]
/proc/loadavg: 8.19 8.05 8.00 9/184 30346
/proc/meminfo: memFree=30316024/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=525212 CPUtime=887.15 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 105169 0 0 0 88644 71 0 0 25 0 4 0 520866941 537817088 103202 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 131303 103202 460 189 0 125652 0
[pid=30327/tid=30329] ppid=30325 vsize=525212 CPUtime=220.77 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 19399 0 0 0 22062 15 0 0 25 0 4 0 520866964 537817088 103202 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=525212 CPUtime=222.06 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 26747 0 0 0 22189 17 0 0 25 0 4 0 520866964 537817088 103202 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=525212 CPUtime=222.04 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 26030 0 0 0 22187 17 0 0 25 0 4 0 520866964 537817088 103202 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 887.15
Current children cumulated vsize (KiB) 525212

[startup+282.3 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2564.72
Current children cumulated vsize (KiB) 720824

[startup+702.301 s]
/proc/loadavg: 8.08 8.13 8.05 9/184 30362
/proc/meminfo: memFree=29991776/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=789236 CPUtime=2804.37 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 161227 0 0 0 280314 123 0 0 25 0 4 0 520866941 808177664 158508 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 197309 158508 460 189 0 191658 0
[pid=30327/tid=30329] ppid=30325 vsize=789236 CPUtime=698.01 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 29740 0 0 0 69774 27 0 0 25 0 4 0 520866964 808177664 158508 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=789236 CPUtime=702.05 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 38855 0 0 0 70183 22 0 0 25 0 4 0 520866964 808177664 158508 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=789236 CPUtime=702.02 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 44054 0 0 0 70165 37 0 0 25 0 4 0 520866964 808177664 158508 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2804.37
Current children cumulated vsize (KiB) 789236

[startup+762.306 s]
/proc/loadavg: 8.15 8.13 8.06 9/184 30364
/proc/meminfo: memFree=29971032/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=792180 CPUtime=3044.04 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 163552 0 0 0 304279 125 0 0 25 0 4 0 520866941 811192320 160766 33554432000 4194304 4964704 140737133966688 18446744073709551615 4654527 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 198045 160766 460 189 0 192394 0
[pid=30327/tid=30329] ppid=30325 vsize=792180 CPUtime=757.72 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 30438 0 0 0 75745 27 0 0 25 0 4 0 520866964 811192320 160766 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=792180 CPUtime=762.06 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 40127 0 0 0 76183 23 0 0 25 0 4 0 520866964 811192320 160766 33554432000 4194304 4964704 140737133966688 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=792180 CPUtime=761.95 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 44364 0 0 0 76158 37 0 0 25 0 4 0 520866964 811192320 160766 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3044.04
Current children cumulated vsize (KiB) 792180

[startup+822.301 s]
/proc/loadavg: 8.16 8.14 8.06 9/184 30365
/proc/meminfo: memFree=29942108/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=816348 CPUtime=3283.67 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 170049 0 0 0 328239 128 0 0 25 0 4 0 520866941 835940352 167069 33554432000 4194304 4964704 140737133966688 18446744073709551615 4321038 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 204087 167069 460 189 0 198436 0
[pid=30327/tid=30329] ppid=30325 vsize=816348 CPUtime=817.7 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 31620 0 0 0 81742 28 0 0 25 0 4 0 520866964 835940352 167069 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=816348 CPUtime=822.05 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 40198 0 0 0 82182 23 0 0 25 0 4 0 520866964 835940352 167069 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670291 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=816348 CPUtime=821.61 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 44432 0 0 0 82124 37 0 0 25 0 4 0 520866964 835940352 167069 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3283.67
Current children cumulated vsize (KiB) 816348

[startup+882.3 s]
/proc/loadavg: 8.16 8.14 8.07 9/184 30367
/proc/meminfo: memFree=29922480/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=828776 CPUtime=3523.31 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 173835 0 0 0 352202 129 0 0 25 0 4 0 520866941 848666624 170639 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 207194 170639 460 189 0 201543 0
[pid=30327/tid=30329] ppid=30325 vsize=828776 CPUtime=877.68 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 32218 0 0 0 87740 28 0 0 25 0 4 0 520866964 848666624 170639 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=828776 CPUtime=882.05 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 43212 0 0 0 88181 24 0 0 25 0 4 0 520866964 848666624 170639 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=828776 CPUtime=881.28 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 44552 0 0 0 88091 37 0 0 25 0 4 0 520866964 848666624 170639 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3523.31
Current children cumulated vsize (KiB) 828776

[startup+942.301 s]
/proc/loadavg: 8.12 8.13 8.07 9/184 30369
/proc/meminfo: memFree=29898376/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=828776 CPUtime=3762.96 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 179250 0 0 0 376160 136 0 0 25 0 4 0 520866941 848666624 175832 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 207194 175832 460 189 0 201543 0
[pid=30327/tid=30329] ppid=30325 vsize=828776 CPUtime=937.67 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 33183 0 0 0 93738 29 0 0 25 0 4 0 520866964 848666624 175832 33554432000 4194304 4964704 140737133966688 18446744073709551615 4658280 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=828776 CPUtime=942.05 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 43218 0 0 0 94181 24 0 0 25 0 4 0 520866964 848666624 175832 33554432000 4194304 4964704 140737133966688 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=828776 CPUtime=940.96 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 45823 0 0 0 94057 39 0 0 25 0 4 0 520866964 848666624 175832 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670427 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3762.96
Current children cumulated vsize (KiB) 828776

[startup+1002.3 s]
/proc/loadavg: 8.10 8.12 8.07 9/184 30370
/proc/meminfo: memFree=29895608/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=828776 CPUtime=4002.62 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 179272 0 0 0 400125 137 0 0 25 0 4 0 520866941 848666624 175816 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670230 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 207194 175816 460 189 0 201543 0
[pid=30327/tid=30329] ppid=30325 vsize=828776 CPUtime=997.66 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 33183 0 0 0 99737 29 0 0 25 0 4 0 520866964 848666624 175816 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=828776 CPUtime=1002.04 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 43225 0 0 0 100180 24 0 0 25 0 4 0 520866964 848666624 175816 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=828776 CPUtime=1000.63 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 45837 0 0 0 100024 39 0 0 25 0 4 0 520866964 848666624 175816 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4002.62
Current children cumulated vsize (KiB) 828776

[startup+1062.3 s]
/proc/loadavg: 8.04 8.09 8.06 9/184 30372
/proc/meminfo: memFree=29878824/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=828776 CPUtime=4242.28 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 179376 0 0 0 424090 138 0 0 25 0 4 0 520866941 848666624 175920 33554432000 4194304 4964704 140737133966688 18446744073709551615 4332000 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 207194 175920 460 189 0 201543 0
[pid=30327/tid=30329] ppid=30325 vsize=828776 CPUtime=1057.65 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 33184 0 0 0 105736 29 0 0 25 0 4 0 520866964 848666624 175920 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=828776 CPUtime=1062.03 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 43252 0 0 0 106179 24 0 0 25 0 4 0 520866964 848666624 175920 33554432000 4194304 4964704 140737133966688 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=828776 CPUtime=1060.3 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 45912 0 0 0 105991 39 0 0 25 0 4 0 520866964 848666624 175920 33554432000 4194304 4964704 140737133966688 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4242.28
Current children cumulated vsize (KiB) 828776

[startup+1122.3 s]
/proc/loadavg: 8.07 8.09 8.06 9/184 30373
/proc/meminfo: memFree=29873332/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=828776 CPUtime=4481.93 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 180647 0 0 0 448053 140 0 0 25 0 4 0 520866941 848666624 176930 33554432000 4194304 4964704 140737133966688 18446744073709551615 4653154 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 207194 176930 460 189 0 201543 0
[pid=30327/tid=30329] ppid=30325 vsize=828776 CPUtime=1117.65 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 33412 0 0 0 111735 30 0 0 25 0 4 0 520866964 848666624 176930 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=828776 CPUtime=1122.02 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 43253 0 0 0 112178 24 0 0 25 0 4 0 520866964 848666624 176930 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=828776 CPUtime=1119.97 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 45913 0 0 0 111958 39 0 0 25 0 4 0 520866964 848666624 176930 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4481.93
Current children cumulated vsize (KiB) 828776

[startup+1182.3 s]
/proc/loadavg: 7.47 7.95 8.02 5/176 30393
/proc/meminfo: memFree=30242716/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=828776 CPUtime=4721.59 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 182798 0 0 0 472011 148 0 0 25 0 4 0 520866941 848666624 178886 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 207194 178886 460 189 0 201543 0
[pid=30327/tid=30329] ppid=30325 vsize=828776 CPUtime=1177.64 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 33639 0 0 0 117734 30 0 0 25 0 4 0 520866964 848666624 178886 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=828776 CPUtime=1182.02 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 43480 0 0 0 118177 25 0 0 25 0 4 0 520866964 848666624 178886 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=828776 CPUtime=1179.64 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 47607 0 0 0 117918 46 0 0 25 0 4 0 520866964 848666624 178886 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4721.59
Current children cumulated vsize (KiB) 828776



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202 s]
/proc/loadavg: 6.48 7.70 7.93 5/175 30393
/proc/meminfo: memFree=30240404/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=828776 CPUtime=4800.3 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 183272 0 0 0 479880 150 0 0 25 0 4 0 520866941 848666624 179360 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/30327/statm: 207194 179360 460 189 0 201543 0
[pid=30327/tid=30329] ppid=30325 vsize=828776 CPUtime=1197.34 cores=0,2,4,6
/proc/30327/task/30329/stat : 30329 (claspmt) R 30325 30327 29618 0 -1 4202560 33670 0 0 0 119704 30 0 0 25 0 4 0 520866964 848666624 179360 33554432000 4194304 4964704 140737133966688 18446744073709551615 4370224 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=30327/tid=30330] ppid=30325 vsize=828776 CPUtime=1201.73 cores=0,2,4,6
/proc/30327/task/30330/stat : 30330 (claspmt) R 30325 30327 29618 0 -1 4202560 43480 0 0 0 120148 25 0 0 25 0 4 0 520866964 848666624 179360 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=30327/tid=30331] ppid=30325 vsize=828776 CPUtime=1199.24 cores=0,2,4,6
/proc/30327/task/30331/stat : 30331 (claspmt) R 30325 30327 29618 0 -1 4202560 48050 0 0 0 119875 49 0 0 25 0 4 0 520866964 848666624 179360 33554432000 4194304 4964704 140737133966688 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 828776

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.11 s]
/proc/loadavg: 6.48 7.70 7.93 5/175 30393
/proc/meminfo: memFree=30240404/32951124 swapFree=67111364/67111528
[pid=30327] ppid=30325 vsize=646276 CPUtime=4800.43 cores=0,2,4,6
/proc/30327/stat : 30327 (claspmt) R 30325 30327 29618 0 -1 4202496 183283 0 0 0 479891 152 0 0 25 0 1 0 520866941 661786624 123853 33554432000 4194304 4964704 140737133966688 18446744073709551615 228244392295 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/30327/statm: 161569 123853 471 189 0 155918 0
Current children cumulated CPU time (s) 4800.43
Current children cumulated vsize (KiB) 646276

Child status: 0
Real time (s): 1202.14
CPU time (s): 4800.46
CPU user time (s): 4798.91
CPU system time (s): 1.54776
CPU usage (%): 399.327
Max. virtual memory (cumulated for all children) (KiB): 828776

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.91
system time used= 1.54776
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 183284
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 18325
involuntary context switches= 24248

runsolver used 1.85172 second user time and 4.71128 second system time

The end

Launcher Data 

Begin job on node136 at 2011-04-29 17:58:10
IDJOB=3299396
IDBENCH=83254
IDSOLVER=1683
FILE ID=node136/3299396-1304092690
RUNJOBID= node136-1304092658-30274
PBS_JOBID= 13170547
Free space on /tmp= 72332 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-4-5_4232.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299396-1304092690/watcher-3299396-1304092690 -o /tmp/evaluation-result-3299396-1304092690/solver-3299396-1304092690 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299396-1304092690.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 86d9f733c618d2ca060f457ab8a19463
RANDOM SEED=131923442

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30864516 kB
Buffers:        576692 kB
Cached:         931416 kB
SwapCached:          0 kB
Active:         217296 kB
Inactive:      1445900 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30864516 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            3404 kB
Writeback:           0 kB
AnonPages:      155084 kB
Mapped:          15700 kB
Slab:           359820 kB
PageTables:       5116 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   313552 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72332 MiB
End job on node136 at 2011-04-29 18:18:14