Trace number 3373245

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.48 1203.88

General information on the benchmark

NameCRAFTED/edgematching/
compact/em_11_3_4_cmp.cnf
MD5SUM3b5e80540ef2fcb09cfe50ac7e3686c1
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark135.155
Satisfiable
(Un)Satisfiability was proved
Number of variables8713
Number of clauses99699
Sum of the clauses size335345
Maximum clause length81
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 210866
Number of clauses of size 367270
Number of clauses of size 410556
Number of clauses of size 510773
Number of clauses of size over 5234

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...418661/instance-3373245-1305418661.cnf
0.09/0.13	c Solving...
4800.27/1203.71	
4800.27/1203.71	*** INTERRUPTED! ***
4800.27/1203.71	*** Shutting down threads...
4800.41/1203.87	s UNKNOWN
4800.41/1203.87	
4800.41/1203.87	c INTERRUPTED   : 1
4800.41/1203.87	c Models        : 0+    
4800.41/1203.87	c Time          : 1203.714s (Solving: 1203.59s 1st Model: 0.00s Unsat: 0.00s)
4800.41/1203.87	c CPU Time      : 4800.310s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373245-1305418661/watcher-3373245-1305418661 -o /tmp/evaluation-result-3373245-1305418661/solver-3373245-1305418661 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373245-1305418661.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.61 5.66 7.07 2/336 14321
/proc/meminfo: memFree=18154944/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=20872 CPUtime=0 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 484 0 1 0 0 0 0 0 21 0 1 0 653464044 21372928 415 33554432000 4194304 4964800 140733772344304 18446744073709551615 228244046368 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/14321/statm: 5218 415 353 189 0 92 0

[startup+0.025164 s]
/proc/loadavg: 3.61 5.66 7.07 2/336 14321
/proc/meminfo: memFree=18154944/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=25676 CPUtime=0.02 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 1939 0 1 0 2 0 0 0 21 0 1 0 653464044 26292224 1631 33554432000 4194304 4964800 140733772344304 18446744073709551615 228244009669 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/14321/statm: 6419 1632 385 189 0 1293 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 25676

[startup+0.100165 s]
/proc/loadavg: 3.61 5.66 7.07 2/336 14321
/proc/meminfo: memFree=18154944/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=32004 CPUtime=0.09 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 3783 0 1 0 9 0 0 0 21 0 1 0 653464044 32772096 3089 33554432000 4194304 4964800 140733772344304 18446744073709551615 4607761 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/14321/statm: 8001 3089 398 189 0 2875 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 32004

[startup+0.307054 s]
/proc/loadavg: 3.61 5.66 7.07 2/336 14321
/proc/meminfo: memFree=18154944/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=245244 CPUtime=0.85 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 7678 0 2 0 84 1 0 0 22 0 4 0 653464044 251129856 6722 33554432000 4194304 4964800 140733772344304 18446744073709551615 228244010017 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 62317 10945 458 189 0 56666 0
Current children cumulated CPU time (s) 0.85
Current children cumulated vsize (KiB) 245244

[startup+1.25792 s]
/proc/loadavg: 3.61 5.66 7.07 2/336 14321
/proc/meminfo: memFree=18154944/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=250720 CPUtime=4.15 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 13536 0 2 0 413 2 0 0 25 0 4 0 653464044 256737280 12580 33554432000 4194304 4964800 140733772344304 18446744073709551615 4669033 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 62680 12580 458 189 0 57029 0
Current children cumulated CPU time (s) 4.15
Current children cumulated vsize (KiB) 250720

[startup+1.50087 s]
/proc/loadavg: 3.61 5.66 7.07 2/336 14321
/proc/meminfo: memFree=18154944/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=253368 CPUtime=5.13 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 15457 0 2 0 510 3 0 0 25 0 4 0 653464044 259448832 14501 33554432000 4194304 4964800 140733772344304 18446744073709551615 4332491 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 63342 14501 458 189 0 57691 0
Current children cumulated CPU time (s) 5.13
Current children cumulated vsize (KiB) 253368

[startup+3.1006 s]
/proc/loadavg: 3.61 5.66 7.07 9/346 14334
/proc/meminfo: memFree=18001828/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=257404 CPUtime=11.5 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 20468 0 2 0 1145 5 0 0 25 0 4 0 653464044 263581696 19512 33554432000 4194304 4964800 140733772344304 18446744073709551615 4342939 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 64351 19512 460 189 0 58700 0
[pid=14321/tid=14329] ppid=14319 vsize=257404 CPUtime=2.84 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 4794 0 0 0 283 1 0 0 24 0 4 0 653464069 263581696 19512 33554432000 4194304 4964800 140733772344304 18446744073709551615 4684125 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=257404 CPUtime=2.84 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 2903 0 0 0 284 0 0 0 24 0 4 0 653464069 263581696 19512 33554432000 4194304 4964800 140733772344304 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=257404 CPUtime=2.81 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 4750 0 0 0 280 1 0 0 24 0 4 0 653464069 263581696 19512 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.5
Current children cumulated vsize (KiB) 257404

[startup+6.31304 s]
/proc/loadavg: 3.96 5.70 7.08 9/346 14335
/proc/meminfo: memFree=17929308/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=261824 CPUtime=24.31 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 26311 0 2 0 2424 7 0 0 25 0 4 0 653464044 268107776 25355 33554432000 4194304 4964800 140733772344304 18446744073709551615 4660542 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 65456 25355 460 189 0 59805 0
[pid=14321/tid=14329] ppid=14319 vsize=261824 CPUtime=6.05 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 5830 0 0 0 604 1 0 0 25 0 4 0 653464069 268107776 25355 33554432000 4194304 4964800 140733772344304 18446744073709551615 4332537 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=261824 CPUtime=6.05 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 3046 0 0 0 605 0 0 0 25 0 4 0 653464069 268107776 25355 33554432000 4194304 4964800 140733772344304 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=261824 CPUtime=5.99 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 6939 0 0 0 597 2 0 0 25 0 4 0 653464069 268107776 25355 33554432000 4194304 4964800 140733772344304 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.31
Current children cumulated vsize (KiB) 261824

[startup+12.7009 s]
/proc/loadavg: 4.36 5.75 7.09 9/346 14335
/proc/meminfo: memFree=17875136/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=268700 CPUtime=49.8 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 33888 0 2 0 4970 10 0 0 25 0 4 0 653464044 275148800 32904 33554432000 4194304 4964800 140733772344304 18446744073709551615 4321420 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 67175 32904 460 189 0 61524 0
[pid=14321/tid=14329] ppid=14319 vsize=268700 CPUtime=12.44 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 8643 0 0 0 1242 2 0 0 25 0 4 0 653464069 275148800 32904 33554432000 4194304 4964800 140733772344304 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=268700 CPUtime=12.45 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 3447 0 0 0 1244 1 0 0 25 0 4 0 653464069 275148800 32904 33554432000 4194304 4964800 140733772344304 18446744073709551615 4379092 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=268700 CPUtime=12.32 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 7863 0 0 0 1230 2 0 0 25 0 4 0 653464069 275148800 32904 33554432000 4194304 4964800 140733772344304 18446744073709551615 4332488 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.8
Current children cumulated vsize (KiB) 268700

[startup+25.5007 s]
/proc/loadavg: 4.92 5.83 7.10 9/346 14335
/proc/meminfo: memFree=17761684/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=281920 CPUtime=100.85 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 45080 0 2 0 10070 15 0 0 25 0 4 0 653464044 288686080 44096 33554432000 4194304 4964800 140733772344304 18446744073709551615 228244009669 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 70480 44096 460 189 0 64829 0
[pid=14321/tid=14329] ppid=14319 vsize=281920 CPUtime=25.23 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 12550 0 0 0 2520 3 0 0 25 0 4 0 653464069 288686080 44096 33554432000 4194304 4964800 140733772344304 18446744073709551615 4342896 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=281920 CPUtime=25.25 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 3720 0 0 0 2524 1 0 0 25 0 4 0 653464069 288686080 44096 33554432000 4194304 4964800 140733772344304 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=281920 CPUtime=24.98 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 12225 0 0 0 2493 5 0 0 25 0 4 0 653464069 288686080 44096 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.85
Current children cumulated vsize (KiB) 281920

[startup+51.1002 s]
/proc/loadavg: 6.13 6.03 7.12 9/346 14336
/proc/meminfo: memFree=17590296/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=311064 CPUtime=202.96 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 66005 0 2 0 20269 27 0 0 25 0 4 0 653464044 318529536 64947 33554432000 4194304 4964800 140733772344304 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 77766 64947 460 189 0 72115 0
[pid=14321/tid=14329] ppid=14319 vsize=311064 CPUtime=50.83 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 18150 0 0 0 5076 7 0 0 25 0 4 0 653464069 318529536 64947 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=311064 CPUtime=50.85 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 4879 0 0 0 5083 2 0 0 25 0 4 0 653464069 318529536 64947 33554432000 4194304 4964800 140733772344304 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=311064 CPUtime=50.29 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 18866 0 0 0 5022 7 0 0 25 0 4 0 653464069 318529536 64947 33554432000 4194304 4964800 140733772344304 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 202.96
Current children cumulated vsize (KiB) 311064

[startup+102.3 s]
/proc/loadavg: 7.25 6.35 7.17 9/346 14337
/proc/meminfo: memFree=17335592/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=531544 CPUtime=407.15 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 96770 0 2 0 40667 48 0 0 25 0 4 0 653464044 544301056 95680 33554432000 4194304 4964800 140733772344304 18446744073709551615 4659262 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 132886 95680 460 189 0 127235 0
[pid=14321/tid=14329] ppid=14319 vsize=531544 CPUtime=102.01 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 22432 0 0 0 10192 9 0 0 25 0 4 0 653464069 544301056 95680 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=531544 CPUtime=102.05 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 6613 0 0 0 10202 3 0 0 25 0 4 0 653464069 544301056 95680 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=531544 CPUtime=100.92 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 32145 0 0 0 10075 17 0 0 25 0 4 0 653464069 544301056 95680 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.15
Current children cumulated vsize (KiB) 531544

[startup+162.301 s]
/proc/loadavg: 7.72 6.65 7.22 9/346 14339
/proc/meminfo: memFree=17070956/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=562260 CPUtime=646.48 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 125510 0 2 0 64580 68 0 0 25 0 4 0 653464044 575754240 124303 33554432000 4194304 4964800 140733772344304 18446744073709551615 4325338 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 140565 124303 460 189 0 134914 0
[pid=14321/tid=14329] ppid=14319 vsize=562260 CPUtime=162 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 26282 0 0 0 16188 12 0 0 25 0 4 0 653464069 575754240 124303 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=562260 CPUtime=161.66 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 8111 0 0 0 16162 4 0 0 25 0 4 0 653464069 575754240 124303 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=562260 CPUtime=160.66 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 37185 0 0 0 16043 23 0 0 25 0 4 0 653464069 575754240 124303 33554432000 4194304 4964800 140733772344304 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 646.48
Current children cumulated vsize (KiB) 562260

[startup+222.3 s]
/proc/loadavg: 7.94 6.91 7.27 9/346 14340
/proc/meminfo: memFree=16886184/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=699552 CPUtime=885.79 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 146160 0 2 0 88491 88 0 0 25 0 4 0 653464044 716341248 144436 33554432000 4194304 4964800 140733772344304 18446744073709551615 4653304 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 174888 144436 460 189 0 169237 0
[pid=14321/tid=14329] ppid=14319 vsize=699552 CPUtime=221.36 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 34166 0 0 0 22115 21 0 0 25 0 4 0 653464069 716341248 144436 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=699552 CPUtime=221.64 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 10733 0 0 0 22158 6 0 0 25 0 4 0 653464069 716341248 144436 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=699552 CPUtime=220.66 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 40490 0 0 0 22039 27 0 0 25 0 4 0 653464069 716341248 144436 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 885.79
Current children cumulated vsize (KiB) 699552

[startup+282.301 s]
/proc/loadavg: 7.98 7.10 7.31 9/346 14342
/proc/meminfo: memFree=16643868/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=784288 CPUtime=1125.13 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 171270 0 2 0 112406 107 0 0 25 0 4 0 653464044 803110912 169465 33554432000 4194304 4964800 140733772344304 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 196072 169465 460 189 0 190421 0
[pid=14321/tid=14329] ppid=14319 vsize=784288 CPUtime=280.7 cores=1,3,5,7

################
# More data... #
################

Current children cumulated CPU time (s) 2561.03
Current children cumulated vsize (KiB) 1109916

[startup+702.301 s]
/proc/loadavg: 8.12 7.86 7.59 9/346 14353
/proc/meminfo: memFree=15918752/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1114432 CPUtime=2800.32 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 244919 0 2 0 279844 188 0 0 25 0 4 0 653464044 1141178368 242072 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 278608 242072 460 189 0 272957 0
[pid=14321/tid=14329] ppid=14319 vsize=1114432 CPUtime=696.02 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 50360 0 0 0 69563 39 0 0 25 0 4 0 653464069 1141178368 242072 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=1114432 CPUtime=701.63 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 16424 0 0 0 70154 9 0 0 25 0 4 0 653464069 1141178368 242072 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=1114432 CPUtime=700.64 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 101304 0 0 0 69970 94 0 0 25 0 4 0 653464069 1141178368 242072 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2800.32
Current children cumulated vsize (KiB) 1114432

[startup+762.301 s]
/proc/loadavg: 8.11 7.90 7.62 9/346 14355
/proc/meminfo: memFree=15881168/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1114432 CPUtime=3039.64 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 245334 0 2 0 303776 188 0 0 25 0 4 0 653464044 1141178368 242487 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 278608 242487 460 189 0 272957 0
[pid=14321/tid=14329] ppid=14319 vsize=1114432 CPUtime=755.36 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 50368 0 0 0 75497 39 0 0 25 0 4 0 653464069 1141178368 242487 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=1114432 CPUtime=761.63 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 16424 0 0 0 76154 9 0 0 25 0 4 0 653464069 1141178368 242487 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=1114432 CPUtime=760.62 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 101593 0 0 0 75968 94 0 0 25 0 4 0 653464069 1141178368 242487 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3039.64
Current children cumulated vsize (KiB) 1114432

[startup+822.301 s]
/proc/loadavg: 8.15 7.94 7.65 9/346 14356
/proc/meminfo: memFree=15779352/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1136792 CPUtime=3278.97 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 251206 0 2 0 327705 192 0 0 25 0 4 0 653464044 1164075008 248359 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 284198 248359 460 189 0 278547 0
[pid=14321/tid=14329] ppid=14319 vsize=1136792 CPUtime=814.69 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 50747 0 0 0 81430 39 0 0 25 0 4 0 653464069 1164075008 248359 33554432000 4194304 4964800 140733772344304 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=1136792 CPUtime=821.63 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 16424 0 0 0 82154 9 0 0 25 0 4 0 653464069 1164075008 248359 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=1136792 CPUtime=820.62 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 107028 0 0 0 81965 97 0 0 25 0 4 0 653464069 1164075008 248359 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3278.97
Current children cumulated vsize (KiB) 1136792

[startup+882.301 s]
/proc/loadavg: 8.09 7.96 7.67 9/346 14358
/proc/meminfo: memFree=15678528/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1158900 CPUtime=3518.29 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 256885 0 2 0 351633 196 0 0 25 0 4 0 653464044 1186713600 254038 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670534 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 289725 254038 460 189 0 284074 0
[pid=14321/tid=14329] ppid=14319 vsize=1158900 CPUtime=874.04 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 55693 0 0 0 87361 43 0 0 25 0 4 0 653464069 1186713600 254038 33554432000 4194304 4964800 140733772344304 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=1158900 CPUtime=881.63 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 16425 0 0 0 88154 9 0 0 25 0 4 0 653464069 1186713600 254038 33554432000 4194304 4964800 140733772344304 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=1158900 CPUtime=880.62 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 107493 0 0 0 87964 98 0 0 25 0 4 0 653464069 1186713600 254038 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3518.29
Current children cumulated vsize (KiB) 1158900

[startup+942.301 s]
/proc/loadavg: 8.07 7.98 7.70 9/346 14360
/proc/meminfo: memFree=15580928/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1304700 CPUtime=3757.62 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 280506 0 2 0 375536 226 0 0 25 0 4 0 653464044 1336012800 277492 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670330 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 326175 277492 460 189 0 320524 0
[pid=14321/tid=14329] ppid=14319 vsize=1304700 CPUtime=933.35 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 57333 0 0 0 93290 45 0 0 24 0 4 0 653464069 1336012800 277492 33554432000 4194304 4964800 140733772344304 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=1304700 CPUtime=941.65 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 18239 0 0 0 94153 12 0 0 25 0 4 0 653464069 1336012800 277492 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=1304700 CPUtime=940.63 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 120752 0 0 0 93947 116 0 0 25 0 4 0 653464069 1336012800 277492 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3757.62
Current children cumulated vsize (KiB) 1304700

[startup+1002.3 s]
/proc/loadavg: 8.06 8.00 7.72 9/346 14361
/proc/meminfo: memFree=15558984/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1304700 CPUtime=3996.92 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 284145 0 2 0 399459 233 0 0 25 0 4 0 653464044 1336012800 281128 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670373 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 326175 281128 460 189 0 320524 0
[pid=14321/tid=14329] ppid=14319 vsize=1304700 CPUtime=992.69 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 58920 0 0 0 99221 48 0 0 25 0 4 0 653464069 1336012800 281128 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=1304700 CPUtime=1001.63 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 18243 0 0 0 100151 12 0 0 25 0 4 0 653464069 1336012800 281128 33554432000 4194304 4964800 140733772344304 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=1304700 CPUtime=1000.62 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 122796 0 0 0 99943 119 0 0 25 0 4 0 653464069 1336012800 281128 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3996.92
Current children cumulated vsize (KiB) 1304700

[startup+1062.31 s]
/proc/loadavg: 8.13 8.03 7.74 9/346 14363
/proc/meminfo: memFree=15557344/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1304700 CPUtime=4236.29 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 284187 0 2 0 423396 233 0 0 25 0 4 0 653464044 1336012800 281170 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 326175 281170 460 189 0 320524 0
[pid=14321/tid=14329] ppid=14319 vsize=1304700 CPUtime=1052.05 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 58940 0 0 0 105156 49 0 0 25 0 4 0 653464069 1336012800 281170 33554432000 4194304 4964800 140733772344304 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=1304700 CPUtime=1061.64 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 18243 0 0 0 106152 12 0 0 25 0 4 0 653464069 1336012800 281170 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=1304700 CPUtime=1060.62 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 122809 0 0 0 105943 119 0 0 25 0 4 0 653464069 1336012800 281170 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4236.29
Current children cumulated vsize (KiB) 1304700

[startup+1122.3 s]
/proc/loadavg: 8.19 8.05 7.77 9/346 14364
/proc/meminfo: memFree=15537744/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1304700 CPUtime=4475.58 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 284231 0 2 0 447325 233 0 0 19 0 4 0 653464044 1336012800 281200 33554432000 4194304 4964800 140733772344304 18446744073709551615 4660114 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 326175 281200 460 189 0 320524 0
[pid=14321/tid=14329] ppid=14319 vsize=1304700 CPUtime=1111.4 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 58960 0 0 0 111091 49 0 0 25 0 4 0 653464069 1336012800 281200 33554432000 4194304 4964800 140733772344304 18446744073709551615 4684579 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=1304700 CPUtime=1121.63 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 18243 0 0 0 112151 12 0 0 25 0 4 0 653464069 1336012800 281200 33554432000 4194304 4964800 140733772344304 18446744073709551615 4362938 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=1304700 CPUtime=1120.61 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 122822 0 0 0 111942 119 0 0 25 0 4 0 653464069 1336012800 281200 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4475.58
Current children cumulated vsize (KiB) 1304700

[startup+1182.3 s]
/proc/loadavg: 8.18 8.07 7.79 9/346 14366
/proc/meminfo: memFree=15504124/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1304700 CPUtime=4714.88 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 292392 0 2 0 471239 249 0 0 25 0 4 0 653464044 1336012800 289361 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670340 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 326175 289361 460 189 0 320524 0
[pid=14321/tid=14329] ppid=14319 vsize=1304700 CPUtime=1170.71 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 58962 0 0 0 117021 50 0 0 25 0 4 0 653464069 1336012800 289361 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=1304700 CPUtime=1181.63 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 18245 0 0 0 118151 12 0 0 25 0 4 0 653464069 1336012800 289361 33554432000 4194304 4964800 140733772344304 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=1304700 CPUtime=1180.61 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 130974 0 0 0 117927 134 0 0 25 0 4 0 653464069 1336012800 289361 33554432000 4194304 4964800 140733772344304 18446744073709551615 4343240 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4714.88
Current children cumulated vsize (KiB) 1304700



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.7 s]
/proc/loadavg: 8.21 8.08 7.80 6/344 14368
/proc/meminfo: memFree=15491984/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1304700 CPUtime=4800.27 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 296277 0 2 0 479773 254 0 0 25 0 4 0 653464044 1336012800 293246 33554432000 4194304 4964800 140733772344304 18446744073709551615 4669410 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 11
/proc/14321/statm: 326175 293246 460 189 0 320524 0
[pid=14321/tid=14329] ppid=14319 vsize=1304700 CPUtime=1191.88 cores=1,3,5,7
/proc/14321/task/14329/stat : 14329 (claspmt) R 14319 14321 13934 0 -1 4202560 58963 0 0 0 119138 50 0 0 25 0 4 0 653464069 1336012800 293246 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=14321/tid=14331] ppid=14319 vsize=1304700 CPUtime=1203.04 cores=1,3,5,7
/proc/14321/task/14331/stat : 14331 (claspmt) R 14319 14321 13934 0 -1 4202560 18246 0 0 0 120292 12 0 0 25 0 4 0 653464069 1336012800 293246 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=14321/tid=14333] ppid=14319 vsize=1304700 CPUtime=1202.02 cores=1,3,5,7
/proc/14321/task/14333/stat : 14333 (claspmt) R 14319 14321 13934 0 -1 4202560 134857 0 0 0 120063 139 0 0 25 0 4 0 653464069 1336012800 293246 33554432000 4194304 4964800 140733772344304 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 1304700

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.82 s]
/proc/loadavg: 8.21 8.08 7.80 6/344 14368
/proc/meminfo: memFree=15491984/32951124 swapFree=67082152/67111528
[pid=14321] ppid=14319 vsize=1301176 CPUtime=4800.41 cores=1,3,5,7
/proc/14321/stat : 14321 (claspmt) R 14319 14321 13934 0 -1 4202496 296287 0 2 0 479787 254 0 0 25 0 1 0 653464044 1332404224 282984 33554432000 4194304 4964800 140733772344304 18446744073709551615 228244005866 0 0 4096 18946 0 0 0 17 3 0 0 11
/proc/14321/statm: 325294 282984 470 189 0 319643 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 1301176

Child status: 0
Real time (s): 1203.88
CPU time (s): 4800.48
CPU user time (s): 4797.89
CPU system time (s): 2.5996
CPU usage (%): 398.751
Max. virtual memory (cumulated for all children) (KiB): 1304700

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4797.89
system time used= 2.5996
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 296289
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17937
involuntary context switches= 34308

runsolver used 3.43748 second user time and 9.70153 second system time

The end

Launcher Data 

Begin job on node136 at 2011-05-15 02:17:41
IDJOB=3373245
IDBENCH=70910
IDSOLVER=1853
FILE ID=node136/3373245-1305418661
RUNJOBID= node136-1305418661-14308
PBS_JOBID= 13324558
Free space on /tmp= 72992 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/CRAFTED/edgematching/compact/em_11_3_4_cmp.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373245-1305418661/watcher-3373245-1305418661 -o /tmp/evaluation-result-3373245-1305418661/solver-3373245-1305418661 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373245-1305418661.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3b5e80540ef2fcb09cfe50ac7e3686c1
RANDOM SEED=374916525

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18155216 kB
Buffers:        299008 kB
Cached:        5038984 kB
SwapCached:       2740 kB
Active:       10558772 kB
Inactive:      3896588 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18155216 kB
SwapTotal:    67111528 kB
SwapFree:     67082152 kB
Dirty:            5488 kB
Writeback:           0 kB
AnonPages:     9116320 kB
Mapped:          27200 kB
Slab:           236668 kB
PageTables:      39344 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 69863400 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72992 MiB
End job on node136 at 2011-05-15 02:37:47