Trace number 3373121

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.54 1203.82

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v1150c84314g1.cnf
MD5SUMeded74bffb721f48c45af6ff95302642
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark39.8949
Satisfiable
(Un)Satisfiability was proved
Number of variables1150
Number of clauses84314
Sum of the clauses size169678
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 284264
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 550

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...419181/instance-3373121-1305419181.cnf
0.19/0.25	c Solving...
4800.41/1203.71	
4800.41/1203.71	*** INTERRUPTED! ***
4800.41/1203.71	*** Shutting down threads...
4800.41/1203.81	s UNKNOWN
4800.41/1203.81	
4800.41/1203.81	c INTERRUPTED   : 1
4800.41/1203.81	c Models        : 0+    
4800.41/1203.81	c Time          : 1203.716s (Solving: 1203.46s 1st Model: 0.00s Unsat: 0.00s)
4800.41/1203.81	c CPU Time      : 4800.430s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373121-1305419181/watcher-3373121-1305419181 -o /tmp/evaluation-result-3373121-1305419181/solver-3373121-1305419181 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373121-1305419181.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.37 7.60 7.86 7/353 22822
/proc/meminfo: memFree=23996276/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=22592 CPUtime=0 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 1034 0 0 0 0 0 0 0 25 0 1 0 653514783 23134208 866 33554432000 4194304 4964800 140735352708112 18446744073709551615 254500352709 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/22822/statm: 5648 868 385 189 0 522 0

[startup+0.0167401 s]
/proc/loadavg: 6.37 7.60 7.86 7/353 22822
/proc/meminfo: memFree=23996276/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=23784 CPUtime=0.01 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 1476 0 0 0 1 0 0 0 25 0 1 0 653514783 24354816 1106 33554432000 4194304 4964800 140735352708112 18446744073709551615 254500352709 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/22822/statm: 5946 1108 385 189 0 820 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 23784

[startup+0.100718 s]
/proc/loadavg: 6.37 7.60 7.86 7/353 22822
/proc/meminfo: memFree=23996276/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=26348 CPUtime=0.09 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 2167 0 0 0 9 0 0 0 25 0 1 0 653514783 26980352 1787 33554432000 4194304 4964800 140735352708112 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/22822/statm: 6587 1787 398 189 0 1461 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26348

[startup+0.300606 s]
/proc/loadavg: 6.37 7.60 7.86 7/353 22822
/proc/meminfo: memFree=23996276/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=173412 CPUtime=0.4 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 2988 0 0 0 40 0 0 0 18 0 4 0 653514783 177573888 2433 33554432000 4194304 4964800 140735352708112 18446744073709551615 254500735159 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 43353 2434 457 189 0 37702 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 173412

[startup+0.700527 s]
/proc/loadavg: 6.37 7.60 7.86 7/353 22822
/proc/meminfo: memFree=23996276/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=173968 CPUtime=2 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 4428 0 0 0 199 1 0 0 18 0 4 0 653514783 178143232 3873 33554432000 4194304 4964800 140735352708112 18446744073709551615 4669136 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 43492 3873 458 189 0 37841 0
Current children cumulated CPU time (s) 2
Current children cumulated vsize (KiB) 173968

[startup+1.50037 s]
/proc/loadavg: 6.37 7.60 7.86 9/357 22826
/proc/meminfo: memFree=23973808/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=176740 CPUtime=5.18 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 6529 0 0 0 517 1 0 0 19 0 4 0 653514783 180981760 5974 33554432000 4194304 4964800 140735352708112 18446744073709551615 254500350708 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 44185 5974 458 189 0 38534 0
[pid=22822/tid=22824] ppid=22820 vsize=176740 CPUtime=1.22 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 1036 0 0 0 122 0 0 0 19 0 4 0 653514809 180981760 5974 33554432000 4194304 4964800 140735352708112 18446744073709551615 4660126 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=176740 CPUtime=1.23 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 981 0 0 0 123 0 0 0 25 0 4 0 653514809 180981760 5974 33554432000 4194304 4964800 140735352708112 18446744073709551615 4653172 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=176740 CPUtime=1.22 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 1061 0 0 0 122 0 0 0 25 0 4 0 653514809 180981760 5974 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.18
Current children cumulated vsize (KiB) 176740

[startup+3.10105 s]
/proc/loadavg: 6.50 7.61 7.86 9/357 22826
/proc/meminfo: memFree=23959784/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=179240 CPUtime=11.57 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 8079 0 0 0 1155 2 0 0 23 0 4 0 653514783 183541760 7524 33554432000 4194304 4964800 140735352708112 18446744073709551615 4332103 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 44810 7524 460 189 0 39159 0
[pid=22822/tid=22824] ppid=22820 vsize=179240 CPUtime=2.8 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 1421 0 0 0 280 0 0 0 24 0 4 0 653514809 183541760 7524 33554432000 4194304 4964800 140735352708112 18446744073709551615 4627509 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=179240 CPUtime=2.83 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 1417 0 0 0 283 0 0 0 25 0 4 0 653514809 183541760 7524 33554432000 4194304 4964800 140735352708112 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=179240 CPUtime=2.82 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 1433 0 0 0 282 0 0 0 25 0 4 0 653514809 183541760 7524 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.57
Current children cumulated vsize (KiB) 179240

[startup+6.30042 s]
/proc/loadavg: 6.50 7.61 7.86 9/357 22826
/proc/meminfo: memFree=23939700/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=183116 CPUtime=24.34 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 11175 0 0 0 2430 4 0 0 25 0 4 0 653514783 187510784 10620 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320928 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 45779 10620 460 189 0 40128 0
[pid=22822/tid=22824] ppid=22820 vsize=183116 CPUtime=5.97 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 2275 0 0 0 597 0 0 0 25 0 4 0 653514809 187510784 10620 33554432000 4194304 4964800 140735352708112 18446744073709551615 4362231 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=183116 CPUtime=6.03 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 2314 0 0 0 603 0 0 0 25 0 4 0 653514809 187510784 10620 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=183116 CPUtime=6.03 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 2055 0 0 0 602 1 0 0 25 0 4 0 653514809 187510784 10620 33554432000 4194304 4964800 140735352708112 18446744073709551615 4627301 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.34
Current children cumulated vsize (KiB) 183116

[startup+12.7011 s]
/proc/loadavg: 6.62 7.61 7.86 9/357 22827
/proc/meminfo: memFree=23925712/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=185892 CPUtime=49.86 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 13168 0 0 0 4981 5 0 0 25 0 4 0 653514783 190353408 12613 33554432000 4194304 4964800 140735352708112 18446744073709551615 4321020 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 46473 12613 460 189 0 40822 0
[pid=22822/tid=22824] ppid=22820 vsize=185892 CPUtime=12.3 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 2814 0 0 0 1229 1 0 0 25 0 4 0 653514809 190353408 12613 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=185892 CPUtime=12.42 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 2977 0 0 0 1242 0 0 0 25 0 4 0 653514809 190353408 12613 33554432000 4194304 4964800 140735352708112 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=185892 CPUtime=12.42 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 2457 0 0 0 1241 1 0 0 25 0 4 0 653514809 190353408 12613 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.86
Current children cumulated vsize (KiB) 185892

[startup+25.5006 s]
/proc/loadavg: 6.93 7.63 7.86 9/357 22827
/proc/meminfo: memFree=23858864/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=190884 CPUtime=100.92 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 17069 0 0 0 10084 8 0 0 25 0 4 0 653514783 195465216 16514 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 47721 16514 460 189 0 42070 0
[pid=22822/tid=22824] ppid=22820 vsize=190884 CPUtime=24.95 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 4074 0 0 0 2493 2 0 0 25 0 4 0 653514809 195465216 16514 33554432000 4194304 4964800 140735352708112 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=190884 CPUtime=25.23 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 4111 0 0 0 2522 1 0 0 25 0 4 0 653514809 195465216 16514 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=190884 CPUtime=25.23 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 3145 0 0 0 2521 2 0 0 25 0 4 0 653514809 195465216 16514 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.92
Current children cumulated vsize (KiB) 190884

[startup+51.1005 s]
/proc/loadavg: 7.35 7.68 7.87 9/357 22828
/proc/meminfo: memFree=23784948/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=204764 CPUtime=203.03 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 26481 0 0 0 20288 15 0 0 25 0 4 0 653514783 209678336 25636 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 51191 25636 460 189 0 45540 0
[pid=22822/tid=22824] ppid=22820 vsize=204764 CPUtime=50.26 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 6171 0 0 0 5023 3 0 0 25 0 4 0 653514809 209678336 25636 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=204764 CPUtime=50.83 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 7153 0 0 0 5080 3 0 0 25 0 4 0 653514809 209678336 25636 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=204764 CPUtime=50.83 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 5339 0 0 0 5079 4 0 0 25 0 4 0 653514809 209678336 25636 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.03
Current children cumulated vsize (KiB) 204764

[startup+102.313 s]
/proc/loadavg: 7.80 7.74 7.88 9/357 22829
/proc/meminfo: memFree=23717600/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=215672 CPUtime=407.29 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 32350 0 0 0 40709 20 0 0 25 0 4 0 653514783 220848128 31473 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320897 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 53918 31473 460 189 0 48267 0
[pid=22822/tid=22824] ppid=22820 vsize=215672 CPUtime=100.89 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 7700 0 0 0 10085 4 0 0 25 0 4 0 653514809 220848128 31473 33554432000 4194304 4964800 140735352708112 18446744073709551615 4627365 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=215672 CPUtime=102.04 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 8781 0 0 0 10200 4 0 0 25 0 4 0 653514809 220848128 31473 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670496 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=215672 CPUtime=102.03 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 6413 0 0 0 10198 5 0 0 25 0 4 0 653514809 220848128 31473 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320993 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 407.29
Current children cumulated vsize (KiB) 215672

[startup+162.3 s]
/proc/loadavg: 7.97 7.80 7.89 9/357 22831
/proc/meminfo: memFree=23601396/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=235616 CPUtime=646.57 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 44942 0 0 0 64626 31 0 0 25 0 4 0 653514783 241270784 43581 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 58904 43581 460 189 0 53253 0
[pid=22822/tid=22824] ppid=22820 vsize=235616 CPUtime=160.21 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 10060 0 0 0 16014 7 0 0 25 0 4 0 653514809 241270784 43581 33554432000 4194304 4964800 140735352708112 18446744073709551615 4683980 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=235616 CPUtime=162.03 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 12556 0 0 0 16198 5 0 0 25 0 4 0 653514809 241270784 43581 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=235616 CPUtime=162.02 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 9647 0 0 0 16194 8 0 0 25 0 4 0 653514809 241270784 43581 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 646.57
Current children cumulated vsize (KiB) 235616

[startup+222.3 s]
/proc/loadavg: 8.08 7.86 7.91 9/357 22832
/proc/meminfo: memFree=23540864/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=237084 CPUtime=885.89 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 48157 0 0 0 88554 35 0 0 25 0 4 0 653514783 242774016 46665 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 59271 46665 460 189 0 53620 0
[pid=22822/tid=22824] ppid=22820 vsize=237084 CPUtime=219.51 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 11120 0 0 0 21944 7 0 0 25 0 4 0 653514809 242774016 46665 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=237084 CPUtime=222.03 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 13775 0 0 0 22197 6 0 0 25 0 4 0 653514809 242774016 46665 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=237084 CPUtime=222.02 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 10399 0 0 0 22193 9 0 0 25 0 4 0 653514809 242774016 46665 33554432000 4194304 4964800 140735352708112 18446744073709551615 4627248 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 885.89
Current children cumulated vsize (KiB) 237084

[startup+282.301 s]

################
# More data... #
################

[pid=22822] ppid=22820 vsize=395724 CPUtime=2800.49 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 71378 0 0 0 279992 57 0 0 25 0 4 0 653514783 405221376 68766 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 98931 68766 460 189 0 93280 0
[pid=22822/tid=22824] ppid=22820 vsize=395724 CPUtime=694.1 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 16181 0 0 0 69397 13 0 0 25 0 4 0 653514809 405221376 68766 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=395724 CPUtime=702.04 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 23847 0 0 0 70194 10 0 0 25 0 4 0 653514809 405221376 68766 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=395724 CPUtime=702.03 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 13945 0 0 0 70188 15 0 0 25 0 4 0 653514809 405221376 68766 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2800.49
Current children cumulated vsize (KiB) 395724

[startup+762.313 s]
/proc/loadavg: 8.08 8.05 7.98 9/357 22847
/proc/meminfo: memFree=23154400/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=397644 CPUtime=3039.85 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 72666 0 0 0 303927 58 0 0 25 0 4 0 653514783 407187456 69860 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670313 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 99411 69860 460 189 0 93760 0
[pid=22822/tid=22824] ppid=22820 vsize=397644 CPUtime=753.42 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 17050 0 0 0 75329 13 0 0 25 0 4 0 653514809 407187456 69860 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=397644 CPUtime=762.05 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 24125 0 0 0 76194 11 0 0 25 0 4 0 653514809 407187456 69860 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=397644 CPUtime=762.04 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 13999 0 0 0 76189 15 0 0 25 0 4 0 653514809 407187456 69860 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3039.85
Current children cumulated vsize (KiB) 397644

[startup+822.3 s]
/proc/loadavg: 8.15 8.07 7.99 9/357 22848
/proc/meminfo: memFree=23130700/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=399544 CPUtime=3279.13 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 73877 0 0 0 327854 59 0 0 25 0 4 0 653514783 409133056 70992 33554432000 4194304 4964800 140735352708112 18446744073709551615 4632320 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 99886 70992 460 189 0 94235 0
[pid=22822/tid=22824] ppid=22820 vsize=399544 CPUtime=812.73 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 17867 0 0 0 81259 14 0 0 19 0 4 0 653514809 409133056 70992 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=399544 CPUtime=822.04 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 24402 0 0 0 82193 11 0 0 25 0 4 0 653514809 409133056 70992 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=399544 CPUtime=822.03 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 14100 0 0 0 82188 15 0 0 25 0 4 0 653514809 409133056 70992 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3279.13
Current children cumulated vsize (KiB) 399544

[startup+882.3 s]
/proc/loadavg: 8.24 8.11 8.01 9/357 22850
/proc/meminfo: memFree=23111952/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=399544 CPUtime=3518.47 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 75393 0 0 0 351785 62 0 0 25 0 4 0 653514783 409133056 72508 33554432000 4194304 4964800 140735352708112 18446744073709551615 4324819 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 99886 72508 460 189 0 94235 0
[pid=22822/tid=22824] ppid=22820 vsize=399544 CPUtime=872.06 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 18014 0 0 0 87192 14 0 0 25 0 4 0 653514809 409133056 72508 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=399544 CPUtime=882.04 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 24972 0 0 0 88193 11 0 0 25 0 4 0 653514809 409133056 72508 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320953 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=399544 CPUtime=882.03 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 14164 0 0 0 88188 15 0 0 25 0 4 0 653514809 409133056 72508 33554432000 4194304 4964800 140735352708112 18446744073709551615 4628024 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3518.47
Current children cumulated vsize (KiB) 399544

[startup+942.301 s]
/proc/loadavg: 8.09 8.09 8.00 9/357 22851
/proc/meminfo: memFree=23108576/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=401884 CPUtime=3757.77 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 76394 0 0 0 375714 63 0 0 25 0 4 0 653514783 411529216 73272 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 100471 73272 460 189 0 94820 0
[pid=22822/tid=22824] ppid=22820 vsize=401884 CPUtime=931.37 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 18267 0 0 0 93122 15 0 0 25 0 4 0 653514809 411529216 73272 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=401884 CPUtime=942.04 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 25638 0 0 0 94193 11 0 0 25 0 4 0 653514809 411529216 73272 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=401884 CPUtime=942.02 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 14185 0 0 0 94187 15 0 0 25 0 4 0 653514809 411529216 73272 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3757.77
Current children cumulated vsize (KiB) 401884

[startup+1002.3 s]
/proc/loadavg: 8.07 8.09 8.00 9/357 22853
/proc/meminfo: memFree=23086984/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=408620 CPUtime=3997.08 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 80379 0 0 0 399642 66 0 0 25 0 4 0 653514783 418426880 77101 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320955 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 102155 77101 460 189 0 96504 0
[pid=22822/tid=22824] ppid=22820 vsize=408620 CPUtime=990.67 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 20003 0 0 0 99051 16 0 0 25 0 4 0 653514809 418426880 77101 33554432000 4194304 4964800 140735352708112 18446744073709551615 4627252 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=408620 CPUtime=1002.04 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 26255 0 0 0 100193 11 0 0 25 0 4 0 653514809 418426880 77101 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320924 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=408620 CPUtime=1002.02 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 14730 0 0 0 100187 15 0 0 25 0 4 0 653514809 418426880 77101 33554432000 4194304 4964800 140735352708112 18446744073709551615 4669136 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3997.08
Current children cumulated vsize (KiB) 408620

[startup+1062.3 s]
/proc/loadavg: 8.13 8.10 8.01 9/357 22855
/proc/meminfo: memFree=23077896/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=412664 CPUtime=4236.41 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 82231 0 0 0 423572 69 0 0 25 0 4 0 653514783 422567936 78798 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 103166 78798 460 189 0 97515 0
[pid=22822/tid=22824] ppid=22820 vsize=412664 CPUtime=1050 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 20483 0 0 0 104984 16 0 0 25 0 4 0 653514809 422567936 78798 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=412664 CPUtime=1062.04 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 26621 0 0 0 106192 12 0 0 25 0 4 0 653514809 422567936 78798 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=412664 CPUtime=1062.02 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 14957 0 0 0 106187 15 0 0 25 0 4 0 653514809 422567936 78798 33554432000 4194304 4964800 140735352708112 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4236.41
Current children cumulated vsize (KiB) 412664

[startup+1122.3 s]
/proc/loadavg: 8.09 8.09 8.01 9/357 22856
/proc/meminfo: memFree=23055056/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=415000 CPUtime=4475.7 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 83809 0 0 0 447500 70 0 0 25 0 4 0 653514783 424960000 80193 33554432000 4194304 4964800 140735352708112 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 103750 80193 460 189 0 98099 0
[pid=22822/tid=22824] ppid=22820 vsize=415000 CPUtime=1109.29 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 20680 0 0 0 110913 16 0 0 25 0 4 0 653514809 424960000 80193 33554432000 4194304 4964800 140735352708112 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=415000 CPUtime=1122.04 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 27339 0 0 0 112192 12 0 0 25 0 4 0 653514809 424960000 80193 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=415000 CPUtime=1122.02 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 14996 0 0 0 112187 15 0 0 25 0 4 0 653514809 424960000 80193 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4475.7
Current children cumulated vsize (KiB) 415000

[startup+1182.3 s]
/proc/loadavg: 8.07 8.09 8.01 9/357 22858
/proc/meminfo: memFree=23048712/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=415132 CPUtime=4715.02 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 84185 0 0 0 471431 71 0 0 25 0 4 0 653514783 425095168 80414 33554432000 4194304 4964800 140735352708112 18446744073709551615 4627204 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 103783 80414 460 189 0 98132 0
[pid=22822/tid=22824] ppid=22820 vsize=415132 CPUtime=1168.61 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 20864 0 0 0 116844 17 0 0 25 0 4 0 653514809 425095168 80414 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=415132 CPUtime=1182.05 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 27506 0 0 0 118192 13 0 0 25 0 4 0 653514809 425095168 80414 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=415132 CPUtime=1182.02 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 15021 0 0 0 118187 15 0 0 25 0 4 0 653514809 425095168 80414 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4715.02
Current children cumulated vsize (KiB) 415132



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.7 s]
/proc/loadavg: 7.72 8.01 7.98 6/354 23048
/proc/meminfo: memFree=23595632/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=415848 CPUtime=4800.41 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 84474 0 0 0 479970 71 0 0 25 0 4 0 653514783 425828352 80703 33554432000 4194304 4964800 140735352708112 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 103962 80703 460 189 0 98311 0
[pid=22822/tid=22824] ppid=22820 vsize=415848 CPUtime=1189.76 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 21004 0 0 0 118959 17 0 0 25 0 4 0 653514809 425828352 80703 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=415848 CPUtime=1203.46 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 27623 0 0 0 120333 13 0 0 25 0 4 0 653514809 425828352 80703 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=415848 CPUtime=1203.44 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 15052 0 0 0 120328 16 0 0 25 0 4 0 653514809 425828352 80703 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 415848

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.7 s]
/proc/loadavg: 7.72 8.01 7.98 6/354 23048
/proc/meminfo: memFree=23595632/32950928 swapFree=45937192/67111528
[pid=22822] ppid=22820 vsize=415848 CPUtime=4800.41 cores=1,3,5,7
/proc/22822/stat : 22822 (claspmt) R 22820 22822 22319 0 -1 4202496 84474 0 0 0 479970 71 0 0 25 0 4 0 653514783 425828352 80703 33554432000 4194304 4964800 140735352708112 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/22822/statm: 103962 80703 460 189 0 98311 0
[pid=22822/tid=22824] ppid=22820 vsize=415848 CPUtime=1189.76 cores=1,3,5,7
/proc/22822/task/22824/stat : 22824 (claspmt) R 22820 22822 22319 0 -1 4202560 21004 0 0 0 118959 17 0 0 25 0 4 0 653514809 425828352 80703 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=22822/tid=22825] ppid=22820 vsize=415848 CPUtime=1203.46 cores=1,3,5,7
/proc/22822/task/22825/stat : 22825 (claspmt) R 22820 22822 22319 0 -1 4202560 27623 0 0 0 120333 13 0 0 25 0 4 0 653514809 425828352 80703 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=22822/tid=22826] ppid=22820 vsize=415848 CPUtime=1203.44 cores=1,3,5,7
/proc/22822/task/22826/stat : 22826 (claspmt) R 22820 22822 22319 0 -1 4202560 15052 0 0 0 120328 16 0 0 25 0 4 0 653514809 425828352 80703 33554432000 4194304 4964800 140735352708112 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.41
Current children cumulated vsize (KiB) 415848

Child status: 0
Real time (s): 1203.82
CPU time (s): 4800.54
CPU user time (s): 4799.81
CPU system time (s): 0.735888
CPU usage (%): 398.777
Max. virtual memory (cumulated for all children) (KiB): 415848

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.81
system time used= 0.735888
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 84486
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6975
involuntary context switches= 21181

runsolver used 3.68044 second user time and 9.91549 second system time

The end

Launcher Data 

Begin job on node149 at 2011-05-15 02:26:21
IDJOB=3373121
IDBENCH=71273
IDSOLVER=1853
FILE ID=node149/3373121-1305419181
RUNJOBID= node149-1305419164-22770
PBS_JOBID= 13324565
Free space on /tmp= 73568 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v1150c84314g1.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373121-1305419181/watcher-3373121-1305419181 -o /tmp/evaluation-result-3373121-1305419181/solver-3373121-1305419181 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373121-1305419181.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= eded74bffb721f48c45af6ff95302642
RANDOM SEED=1029993424

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23996680 kB
Buffers:        313060 kB
Cached:        3879852 kB
SwapCached:      19984 kB
Active:        6453444 kB
Inactive:      2206980 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23996680 kB
SwapTotal:    67111528 kB
SwapFree:     45937192 kB
Dirty:            6224 kB
Writeback:           0 kB
AnonPages:     4459672 kB
Mapped:          14796 kB
Slab:           157648 kB
PageTables:      72260 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 80350600 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73548 MiB
End job on node149 at 2011-05-15 02:46:27