Trace number 3373266

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.63 1205.25

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2640c305320gyes3.cnf
MD5SUMd6877629cc818d7e31dc245fb95f0588
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2640
Number of clauses305320
Sum of the clauses size613120
Maximum clause length33
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2305240
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 580

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...419654/instance-3373266-1305419654.cnf
1.69/1.70	c Solving...
4800.34/1205.01	
4800.34/1205.01	*** INTERRUPTED! ***
4800.34/1205.01	*** Shutting down threads...
4800.57/1205.25	s UNKNOWN
4800.57/1205.25	
4800.57/1205.25	c INTERRUPTED   : 1
4800.57/1205.25	c Models        : 0+    
4800.57/1205.25	c Time          : 1205.018s (Solving: 1203.32s 1st Model: 0.00s Unsat: 0.00s)
4800.57/1205.25	c CPU Time      : 4800.390s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373266-1305419654/watcher-3373266-1305419654 -o /tmp/evaluation-result-3373266-1305419654/solver-3373266-1305419654 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373266-1305419654.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.41 7.94 7.97 2/351 14621
/proc/meminfo: memFree=21283148/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=21868 CPUtime=0 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 764 0 0 0 0 0 0 0 24 0 1 0 653563113 22392832 675 33554432000 4194304 4964800 140734482243776 18446744073709551615 218905391813 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/14621/statm: 5467 676 385 189 0 341 0

[startup+0.036788 s]
/proc/loadavg: 7.41 7.94 7.97 2/351 14621
/proc/meminfo: memFree=21283148/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=27980 CPUtime=0.02 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 2938 0 0 0 2 0 0 0 24 0 1 0 653563113 28651520 2105 33554432000 4194304 4964800 140734482243776 18446744073709551615 218905391813 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/14621/statm: 6995 2108 385 189 0 1869 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 27980

[startup+0.100776 s]
/proc/loadavg: 7.41 7.94 7.97 2/351 14621
/proc/meminfo: memFree=21283148/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=39564 CPUtime=0.09 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 6377 0 0 0 8 1 0 0 24 0 1 0 653563113 40513536 5114 33554432000 4194304 4964800 140734482243776 18446744073709551615 218905391813 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/14621/statm: 9891 5115 396 189 0 4765 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 39564

[startup+0.300741 s]
/proc/loadavg: 7.41 7.94 7.97 2/351 14621
/proc/meminfo: memFree=21283148/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=39828 CPUtime=0.29 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 6427 0 0 0 28 1 0 0 25 0 1 0 653563113 40783872 5164 33554432000 4194304 4964800 140734482243776 18446744073709551615 4607513 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/14621/statm: 9957 5164 398 189 0 4831 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 39828

[startup+0.700673 s]
/proc/loadavg: 7.41 7.94 7.97 2/351 14621
/proc/meminfo: memFree=21283148/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=39828 CPUtime=0.69 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 6427 0 0 0 68 1 0 0 25 0 1 0 653563113 40783872 5164 33554432000 4194304 4964800 140734482243776 18446744073709551615 4607570 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/14621/statm: 9957 5164 398 189 0 4831 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 39828

[startup+1.50052 s]
/proc/loadavg: 7.41 7.94 7.97 3/355 14628
/proc/meminfo: memFree=21240220/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=43128 CPUtime=1.49 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 7255 0 0 0 148 1 0 0 25 0 1 0 653563113 44163072 5992 33554432000 4194304 4964800 140734482243776 18446744073709551615 4600392 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/14621/statm: 10782 5992 399 189 0 5656 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 43128

[startup+3.1012 s]
/proc/loadavg: 7.41 7.94 7.97 9/361 14634
/proc/meminfo: memFree=21216984/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=253860 CPUtime=7.23 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 13195 0 0 0 718 5 0 0 19 0 4 0 653563113 259952640 11311 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 63465 11311 458 189 0 57814 0
[pid=14621/tid=14629] ppid=14619 vsize=253860 CPUtime=1.38 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 1379 0 0 0 137 1 0 0 19 0 4 0 653563284 259952640 11311 33554432000 4194304 4964800 140734482243776 18446744073709551615 4669136 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=253860 CPUtime=1.38 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 1837 0 0 0 137 1 0 0 19 0 4 0 653563284 259952640 11311 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=253860 CPUtime=1.37 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 1164 0 0 0 137 0 0 0 19 0 4 0 653563284 259952640 11311 33554432000 4194304 4964800 140734482243776 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 7.23
Current children cumulated vsize (KiB) 253860

[startup+6.30062 s]
/proc/loadavg: 7.46 7.94 7.97 9/361 14634
/proc/meminfo: memFree=21154148/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=255312 CPUtime=19.99 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 20084 0 0 0 1990 9 0 0 25 0 4 0 653563113 261439488 18200 33554432000 4194304 4964800 140734482243776 18446744073709551615 4362262 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 63828 18200 460 189 0 58177 0
[pid=14621/tid=14629] ppid=14619 vsize=255312 CPUtime=4.58 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 3484 0 0 0 456 2 0 0 25 0 4 0 653563284 261439488 18200 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670538 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=255312 CPUtime=4.58 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 3872 0 0 0 456 2 0 0 25 0 4 0 653563284 261439488 18200 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670520 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=255312 CPUtime=4.53 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 2053 0 0 0 452 1 0 0 25 0 4 0 653563284 261439488 18200 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 19.99
Current children cumulated vsize (KiB) 255312

[startup+12.7005 s]
/proc/loadavg: 7.50 7.94 7.97 9/361 14634
/proc/meminfo: memFree=21055176/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=266496 CPUtime=45.52 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 32024 0 0 0 4538 14 0 0 25 0 4 0 653563113 272891904 30140 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670357 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 66624 30140 460 189 0 60973 0
[pid=14621/tid=14629] ppid=14619 vsize=266496 CPUtime=10.98 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 6882 0 0 0 1095 3 0 0 25 0 4 0 653563284 272891904 30140 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=266496 CPUtime=10.98 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 7234 0 0 0 1095 3 0 0 25 0 4 0 653563284 272891904 30140 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=266496 CPUtime=10.85 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 4996 0 0 0 1083 2 0 0 25 0 4 0 653563284 272891904 30140 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 45.52
Current children cumulated vsize (KiB) 266496

[startup+25.5011 s]
/proc/loadavg: 7.61 7.95 7.97 9/361 14634
/proc/meminfo: memFree=20928304/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=281424 CPUtime=96.56 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 45842 0 0 0 9634 22 0 0 25 0 4 0 653563113 288178176 43958 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 70356 43958 460 189 0 64705 0
[pid=14621/tid=14629] ppid=14619 vsize=281424 CPUtime=23.78 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 11691 0 0 0 2372 6 0 0 25 0 4 0 653563284 288178176 43958 33554432000 4194304 4964800 140734482243776 18446744073709551615 4658177 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=281424 CPUtime=23.78 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 9717 0 0 0 2373 5 0 0 25 0 4 0 653563284 288178176 43958 33554432000 4194304 4964800 140734482243776 18446744073709551615 4627269 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=281424 CPUtime=23.5 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 6262 0 0 0 2347 3 0 0 25 0 4 0 653563284 288178176 43958 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 96.56
Current children cumulated vsize (KiB) 281424

[startup+51.1005 s]
/proc/loadavg: 7.74 7.95 7.97 9/361 14635
/proc/meminfo: memFree=20826108/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=353320 CPUtime=198.64 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 60151 0 0 0 19831 33 0 0 25 0 4 0 653563113 361799680 58255 33554432000 4194304 4964800 140734482243776 18446744073709551615 4668568 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 88330 58255 460 189 0 82679 0
[pid=14621/tid=14629] ppid=14619 vsize=353320 CPUtime=49.38 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 16026 0 0 0 4929 9 0 0 25 0 4 0 653563284 361799680 58255 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=353320 CPUtime=49.13 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 14370 0 0 0 4905 8 0 0 25 0 4 0 653563284 361799680 58255 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=353320 CPUtime=49.04 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 10805 0 0 0 4896 8 0 0 25 0 4 0 653563284 361799680 58255 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320924 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 198.64
Current children cumulated vsize (KiB) 353320

[startup+102.313 s]
/proc/loadavg: 7.93 7.97 7.98 9/361 14636
/proc/meminfo: memFree=20714244/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=494084 CPUtime=402.88 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 72740 0 0 0 40243 45 0 0 25 0 4 0 653563113 505942016 70768 33554432000 4194304 4964800 140734482243776 18446744073709551615 4653179 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 123521 70768 460 189 0 117870 0
[pid=14621/tid=14629] ppid=14619 vsize=494084 CPUtime=100.59 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 20087 0 0 0 10047 12 0 0 25 0 4 0 653563284 505942016 70768 33554432000 4194304 4964800 140734482243776 18446744073709551615 4342193 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=494084 CPUtime=99.72 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 16359 0 0 0 9962 10 0 0 25 0 4 0 653563284 505942016 70768 33554432000 4194304 4964800 140734482243776 18446744073709551615 4321054 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=494084 CPUtime=100.25 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 14742 0 0 0 10014 11 0 0 25 0 4 0 653563284 505942016 70768 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 402.88
Current children cumulated vsize (KiB) 494084

[startup+162.3 s]
/proc/loadavg: 8.01 7.99 7.98 9/361 14638
/proc/meminfo: memFree=20491396/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=543960 CPUtime=642.12 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 102807 0 0 0 64140 72 0 0 25 0 4 0 653563113 557015040 100790 33554432000 4194304 4964800 140734482243776 18446744073709551615 4626930 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 135990 100790 460 189 0 130339 0
[pid=14621/tid=14629] ppid=14619 vsize=543960 CPUtime=160.57 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 33529 0 0 0 16034 23 0 0 25 0 4 0 653563284 557015040 100790 33554432000 4194304 4964800 140734482243776 18446744073709551615 4627281 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=543960 CPUtime=159 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 23668 0 0 0 15885 15 0 0 25 0 4 0 653563284 557015040 100790 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=543960 CPUtime=160.23 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 18668 0 0 0 16008 15 0 0 25 0 4 0 653563284 557015040 100790 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 642.12
Current children cumulated vsize (KiB) 543960

[startup+222.301 s]
/proc/loadavg: 8.11 8.02 7.99 9/361 14640
/proc/meminfo: memFree=20389184/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=614168 CPUtime=881.39 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 113991 0 0 0 88052 87 0 0 25 0 4 0 653563113 628908032 111974 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670264 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 153542 111974 460 189 0 147891 0
[pid=14621/tid=14629] ppid=14619 vsize=614168 CPUtime=220.56 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 41141 0 0 0 22023 33 0 0 25 0 4 0 653563284 628908032 111974 33554432000 4194304 4964800 140734482243776 18446744073709551615 4668900 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=614168 CPUtime=218.29 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 24267 0 0 0 21813 16 0 0 25 0 4 0 653563284 628908032 111974 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=614168 CPUtime=220.22 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 20494 0 0 0 22005 17 0 0 25 0 4 0 653563284 628908032 111974 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 881.39
Current children cumulated vsize (KiB) 614168

[startup+282.301 s]
/proc/loadavg: 8.22 8.06 8.01 9/361 14641
/proc/meminfo: memFree=20361648/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=614680 CPUtime=1120.66 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 116314 0 0 0 111976 90 0 0 25 0 4 0 653563113 629432320 114297 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320955 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 153670 114297 460 189 0 148019 0
[pid=14621/tid=14629] ppid=14619 vsize=614680 CPUtime=280.57 cores=1,3,5,7

################
# More data... #
################

Current children cumulated CPU time (s) 2556.35
Current children cumulated vsize (KiB) 995008

[startup+702.301 s]
/proc/loadavg: 8.05 8.06 8.00 9/361 14652
/proc/meminfo: memFree=19626832/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1012216 CPUtime=2795.61 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 220963 0 0 0 279338 223 0 0 25 0 4 0 653563113 1036509184 216068 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670351 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 253054 216068 460 189 0 247403 0
[pid=14621/tid=14629] ppid=14619 vsize=1012216 CPUtime=700.54 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 80711 0 0 0 69963 91 0 0 25 0 4 0 653563284 1036509184 216068 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=1012216 CPUtime=692.63 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 52181 0 0 0 69213 50 0 0 25 0 4 0 653563284 1036509184 216068 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=1012216 CPUtime=700.13 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 32123 0 0 0 69980 33 0 0 25 0 4 0 653563284 1036509184 216068 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2795.61
Current children cumulated vsize (KiB) 1012216

[startup+762.314 s]
/proc/loadavg: 8.10 8.07 8.01 9/361 14654
/proc/meminfo: memFree=19562952/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1012612 CPUtime=3034.94 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 226594 0 0 0 303263 231 0 0 25 0 4 0 653563113 1036914688 221699 33554432000 4194304 4964800 140734482243776 18446744073709551615 4362289 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 253153 221699 460 189 0 247502 0
[pid=14621/tid=14629] ppid=14619 vsize=1012612 CPUtime=760.55 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 85855 0 0 0 75957 98 0 0 25 0 4 0 653563284 1036914688 221699 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=1012612 CPUtime=751.93 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 52567 0 0 0 75143 50 0 0 25 0 4 0 653563284 1036914688 221699 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=1012612 CPUtime=760.13 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 32125 0 0 0 75980 33 0 0 25 0 4 0 653563284 1036914688 221699 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3034.94
Current children cumulated vsize (KiB) 1012612

[startup+822.301 s]
/proc/loadavg: 8.08 8.07 8.01 9/361 14656
/proc/meminfo: memFree=19520400/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1012612 CPUtime=3274.16 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 227551 0 0 0 327184 232 0 0 25 0 4 0 653563113 1036914688 222430 33554432000 4194304 4964800 140734482243776 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 253153 222430 460 189 0 247502 0
[pid=14621/tid=14629] ppid=14619 vsize=1012612 CPUtime=820.54 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 86217 0 0 0 81955 99 0 0 25 0 4 0 653563284 1036914688 222430 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=1012612 CPUtime=811.2 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 53161 0 0 0 81070 50 0 0 25 0 4 0 653563284 1036914688 222430 33554432000 4194304 4964800 140734482243776 18446744073709551615 4654511 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=1012612 CPUtime=820.1 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 32126 0 0 0 81977 33 0 0 25 0 4 0 653563284 1036914688 222430 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3274.16
Current children cumulated vsize (KiB) 1012612

[startup+882.301 s]
/proc/loadavg: 8.10 8.09 8.01 9/361 14657
/proc/meminfo: memFree=19477228/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1080576 CPUtime=3513.43 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 238009 0 0 0 351094 249 0 0 25 0 4 0 653563113 1106509824 232888 33554432000 4194304 4964800 140734482243776 18446744073709551615 4659391 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 270144 232888 460 189 0 264493 0
[pid=14621/tid=14629] ppid=14619 vsize=1080576 CPUtime=880.54 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 86224 0 0 0 87955 99 0 0 25 0 4 0 653563284 1106509824 232888 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=1080576 CPUtime=870.5 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 63173 0 0 0 86982 68 0 0 25 0 4 0 653563284 1106509824 232888 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=1080576 CPUtime=880.08 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 32553 0 0 0 87975 33 0 0 25 0 4 0 653563284 1106509824 232888 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3513.43
Current children cumulated vsize (KiB) 1080576

[startup+942.301 s]
/proc/loadavg: 8.19 8.11 8.02 9/361 14659
/proc/meminfo: memFree=19422896/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1146112 CPUtime=3752.73 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 249604 0 0 0 375003 270 0 0 25 0 4 0 653563113 1173618688 244483 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 286528 244483 460 189 0 280877 0
[pid=14621/tid=14629] ppid=14619 vsize=1146112 CPUtime=940.54 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 86233 0 0 0 93955 99 0 0 25 0 4 0 653563284 1173618688 244483 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=1146112 CPUtime=929.79 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 70281 0 0 0 92898 81 0 0 25 0 4 0 653563284 1173618688 244483 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=1146112 CPUtime=940.07 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 32554 0 0 0 93974 33 0 0 25 0 4 0 653563284 1173618688 244483 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3752.73
Current children cumulated vsize (KiB) 1146112

[startup+1002.3 s]
/proc/loadavg: 8.18 8.12 8.03 9/361 14660
/proc/meminfo: memFree=19382688/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1170396 CPUtime=3991.95 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 259086 0 0 0 398914 281 0 0 25 0 4 0 653563113 1198485504 253965 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320970 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 292599 253965 460 189 0 286948 0
[pid=14621/tid=14629] ppid=14619 vsize=1170396 CPUtime=1000.49 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 86303 0 0 0 99950 99 0 0 25 0 4 0 653563284 1198485504 253965 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=1170396 CPUtime=989.08 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 76010 0 0 0 98819 89 0 0 25 0 4 0 653563284 1198485504 253965 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=1170396 CPUtime=1000.05 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 32558 0 0 0 99972 33 0 0 25 0 4 0 653563284 1198485504 253965 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3991.95
Current children cumulated vsize (KiB) 1170396

[startup+1062.3 s]
/proc/loadavg: 8.10 8.11 8.03 9/361 14662
/proc/meminfo: memFree=19309260/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1174328 CPUtime=4231.24 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 271539 0 0 0 422822 302 0 0 25 0 4 0 653563113 1202511872 266418 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320970 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 293582 266418 460 189 0 287931 0
[pid=14621/tid=14629] ppid=14619 vsize=1174328 CPUtime=1060.49 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 87309 0 0 0 105949 100 0 0 25 0 4 0 653563284 1202511872 266418 33554432000 4194304 4964800 140734482243776 18446744073709551615 4660155 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=1174328 CPUtime=1048.39 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 87455 0 0 0 104729 110 0 0 25 0 4 0 653563284 1202511872 266418 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=1174328 CPUtime=1060.05 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 32558 0 0 0 105972 33 0 0 25 0 4 0 653563284 1202511872 266418 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4231.24
Current children cumulated vsize (KiB) 1174328

[startup+1122.3 s]
/proc/loadavg: 8.11 8.10 8.03 9/361 14664
/proc/meminfo: memFree=19136144/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1250964 CPUtime=4470.51 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 289404 0 0 0 446722 329 0 0 25 0 4 0 653563113 1280987136 284283 33554432000 4194304 4964800 140734482243776 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 312741 284283 460 189 0 307090 0
[pid=14621/tid=14629] ppid=14619 vsize=1250964 CPUtime=1119.76 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 102353 0 0 0 111853 123 0 0 25 0 4 0 653563284 1280987136 284283 33554432000 4194304 4964800 140734482243776 18446744073709551615 4627365 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=1250964 CPUtime=1108.39 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 89437 0 0 0 110726 113 0 0 25 0 4 0 653563284 1280987136 284283 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=1250964 CPUtime=1120.04 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 33329 0 0 0 111970 34 0 0 25 0 4 0 653563284 1280987136 284283 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4470.51
Current children cumulated vsize (KiB) 1250964

[startup+1182.3 s]
/proc/loadavg: 8.12 8.10 8.03 9/361 14665
/proc/meminfo: memFree=19076600/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1317852 CPUtime=4709.79 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 300153 0 0 0 470632 347 0 0 25 0 4 0 653563113 1349480448 295032 33554432000 4194304 4964800 140734482243776 18446744073709551615 4332378 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 329463 295032 460 189 0 323812 0
[pid=14621/tid=14629] ppid=14619 vsize=1317852 CPUtime=1179.06 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 112768 0 0 0 117765 141 0 0 25 0 4 0 653563284 1349480448 295032 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=1317852 CPUtime=1168.39 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 89439 0 0 0 116726 113 0 0 25 0 4 0 653563284 1349480448 295032 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=1317852 CPUtime=1180.02 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 33652 0 0 0 117968 34 0 0 25 0 4 0 653563284 1349480448 295032 33554432000 4194304 4964800 140734482243776 18446744073709551615 4332327 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4709.79
Current children cumulated vsize (KiB) 1317852



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205 s]
/proc/loadavg: 8.08 8.09 8.02 6/359 14667
/proc/meminfo: memFree=19062104/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1318336 CPUtime=4800.34 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 306442 0 0 0 479676 358 0 0 25 0 4 0 653563113 1349976064 301321 33554432000 4194304 4964800 140734482243776 18446744073709551615 4320970 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/14621/statm: 329584 301321 460 189 0 323933 0
[pid=14621/tid=14629] ppid=14619 vsize=1318336 CPUtime=1201.49 cores=1,3,5,7
/proc/14621/task/14629/stat : 14629 (claspmt) R 14619 14621 14138 0 -1 4202560 118919 0 0 0 119997 152 0 0 25 0 4 0 653563284 1349976064 301321 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14621/tid=14630] ppid=14619 vsize=1318336 CPUtime=1191.1 cores=1,3,5,7
/proc/14621/task/14630/stat : 14630 (claspmt) R 14619 14621 14138 0 -1 4202560 89575 0 0 0 118997 113 0 0 25 0 4 0 653563284 1349976064 301321 33554432000 4194304 4964800 140734482243776 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14621/tid=14631] ppid=14619 vsize=1318336 CPUtime=1202.73 cores=1,3,5,7
/proc/14621/task/14631/stat : 14631 (claspmt) R 14619 14621 14138 0 -1 4202560 33654 0 0 0 120239 34 0 0 25 0 4 0 653563284 1349976064 301321 33554432000 4194304 4964800 140734482243776 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 1318336

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205.2 s]
/proc/loadavg: 8.08 8.09 8.02 6/359 14667
/proc/meminfo: memFree=19062104/32951124 swapFree=65581052/67111528
[pid=14621] ppid=14619 vsize=1309800 CPUtime=4800.57 cores=1,3,5,7
/proc/14621/stat : 14621 (claspmt) R 14619 14621 14138 0 -1 4202496 306454 0 0 0 479699 358 0 0 25 0 1 0 653563113 1341235200 299352 33554432000 4194304 4964800 140734482243776 18446744073709551615 218905386337 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/14621/statm: 327450 299352 470 189 0 321799 0
Current children cumulated CPU time (s) 4800.57
Current children cumulated vsize (KiB) 1309800

Child status: 0
Real time (s): 1205.25
CPU time (s): 4800.63
CPU user time (s): 4797
CPU system time (s): 3.62845
CPU usage (%): 398.309
Max. virtual memory (cumulated for all children) (KiB): 1318336

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797
system time used= 3.62845
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 306456
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7413
involuntary context switches= 34670

runsolver used 3.72843 second user time and 10.5304 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-15 02:34:14
IDJOB=3373266
IDBENCH=71423
IDSOLVER=1853
FILE ID=node137/3373266-1305419654
RUNJOBID= node137-1305418448-14514
PBS_JOBID= 13324553
Free space on /tmp= 73672 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2640c305320gyes3.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373266-1305419654/watcher-3373266-1305419654 -o /tmp/evaluation-result-3373266-1305419654/solver-3373266-1305419654 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373266-1305419654.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d6877629cc818d7e31dc245fb95f0588
RANDOM SEED=1545993568

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21283800 kB
Buffers:        288596 kB
Cached:        3713028 kB
SwapCached:      36328 kB
Active:        1624380 kB
Inactive:      9819392 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21283800 kB
SwapTotal:    67111528 kB
SwapFree:     65581052 kB
Dirty:            4688 kB
Writeback:           0 kB
AnonPages:     7415852 kB
Mapped:          18936 kB
Slab:           120404 kB
PageTables:      37944 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 75897900 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73672 MiB
End job on node137 at 2011-05-15 02:54:21