Trace number 3299647

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.27 1202.01

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v1150c84314g7.cnf
MD5SUMf39e50b5cd7b50d1971722973512a1b8
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark6.09707
Satisfiable
(Un)Satisfiability was proved
Number of variables1150
Number of clauses84314
Sum of the clauses size169678
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 284264
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 550

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...051189/instance-3299647-1304051189.cnf
0.19/0.26	c Solving...
4800.15/1201.91	
4800.15/1201.91	*** INTERRUPTED! ***
4800.15/1201.91	*** Shutting down threads...
4800.15/1202.00	s UNKNOWN
4800.15/1202.00	
4800.15/1202.00	c INTERRUPTED   : 1
4800.15/1202.00	c Models        : 0+    
4800.15/1202.00	c Time          : 1201.916s (Solving: 1201.66s 1st Model: 0.00s Unsat: 0.00s)
4800.15/1202.00	c CPU Time      : 4800.170s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299647-1304051189/watcher-3299647-1304051189 -o /tmp/evaluation-result-3299647-1304051189/solver-3299647-1304051189 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299647-1304051189.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.74 2.39 2.78 3/174 20240
/proc/meminfo: memFree=25414040/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=21476 CPUtime=0 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 684 0 0 0 0 0 0 0 21 0 1 0 516721649 21991424 605 33554432000 4194304 4964704 140734617524272 18446744073709551615 218370618053 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/20240/statm: 5369 606 385 189 0 243 0

[startup+0.087055 s]
/proc/loadavg: 1.74 2.39 2.78 3/174 20240
/proc/meminfo: memFree=25414040/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=26220 CPUtime=0.08 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 2166 0 0 0 8 0 0 0 21 0 1 0 516721649 26849280 1785 33554432000 4194304 4964704 140734617524272 18446744073709551615 4607536 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/20240/statm: 6555 1785 398 189 0 1429 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 26220

[startup+0.101052 s]
/proc/loadavg: 1.74 2.39 2.78 3/174 20240
/proc/meminfo: memFree=25414040/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=26220 CPUtime=0.09 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 2166 0 0 0 9 0 0 0 21 0 1 0 516721649 26849280 1785 33554432000 4194304 4964704 140734617524272 18446744073709551615 4607536 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/20240/statm: 6555 1785 398 189 0 1429 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26220

[startup+0.308877 s]
/proc/loadavg: 1.74 2.39 2.78 3/174 20240
/proc/meminfo: memFree=25414040/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=174256 CPUtime=1.94 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) D 20238 20240 18073 0 -1 4202496 4493 0 0 0 193 1 0 0 18 0 4 0 516721649 178438144 3943 33554432000 4194304 4964704 140734617524272 18446744073709551615 218370618053 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/20240/statm: 43729 4361 458 189 0 38078 0
Current children cumulated CPU time (s) 1.94
Current children cumulated vsize (KiB) 174256

[startup+1.16982 s]
/proc/loadavg: 1.74 2.39 2.78 3/174 20240
/proc/meminfo: memFree=25414040/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=175916 CPUtime=3.85 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 5623 0 0 0 383 2 0 0 19 0 4 0 516721649 180137984 5073 33554432000 4194304 4964704 140734617524272 18446744073709551615 218371062254 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/20240/statm: 43979 5073 458 189 0 38328 0
Current children cumulated CPU time (s) 3.85
Current children cumulated vsize (KiB) 175916

[startup+1.50077 s]
/proc/loadavg: 1.74 2.39 2.78 3/174 20240
/proc/meminfo: memFree=25414040/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=177640 CPUtime=5.18 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 6858 0 0 0 514 4 0 0 19 0 4 0 516721649 181903360 6308 33554432000 4194304 4964704 140734617524272 18446744073709551615 4627252 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/20240/statm: 44410 6308 458 189 0 38759 0
Current children cumulated CPU time (s) 5.18
Current children cumulated vsize (KiB) 177640

[startup+3.10049 s]
/proc/loadavg: 1.74 2.39 2.78 9/184 20253
/proc/meminfo: memFree=25344288/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=179032 CPUtime=11.56 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 8448 0 0 0 1152 4 0 0 23 0 4 0 516721649 183328768 7898 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/20240/statm: 44758 7898 460 189 0 39107 0
[pid=20240/tid=20248] ppid=20238 vsize=179032 CPUtime=2.82 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 1302 0 0 0 281 1 0 0 25 0 4 0 516721675 183328768 7898 33554432000 4194304 4964704 140734617524272 18446744073709551615 4627299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=179032 CPUtime=2.82 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 1767 0 0 0 282 0 0 0 24 0 4 0 516721675 183328768 7898 33554432000 4194304 4964704 140734617524272 18446744073709551615 4321069 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=179032 CPUtime=2.82 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 1500 0 0 0 281 1 0 0 25 0 4 0 516721675 183328768 7898 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.56
Current children cumulated vsize (KiB) 179032

[startup+6.30092 s]
/proc/loadavg: 2.24 2.48 2.80 9/184 20253
/proc/meminfo: memFree=25304052/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=183500 CPUtime=24.35 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 11720 0 0 0 2429 6 0 0 25 0 4 0 516721649 187904000 11170 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670454 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/20240/statm: 45875 11170 460 189 0 40224 0
[pid=20240/tid=20248] ppid=20238 vsize=183500 CPUtime=6.02 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 2263 0 0 0 601 1 0 0 25 0 4 0 516721675 187904000 11170 33554432000 4194304 4964704 140734617524272 18446744073709551615 4668942 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=183500 CPUtime=6.03 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 2715 0 0 0 602 1 0 0 25 0 4 0 516721675 187904000 11170 33554432000 4194304 4964704 140734617524272 18446744073709551615 4644874 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=183500 CPUtime=6.02 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 2070 0 0 0 601 1 0 0 25 0 4 0 516721675 187904000 11170 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670462 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.35
Current children cumulated vsize (KiB) 183500

[startup+12.7008 s]
/proc/loadavg: 2.70 2.57 2.83 9/184 20254
/proc/meminfo: memFree=25249492/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=188132 CPUtime=49.93 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 13962 0 0 0 4986 7 0 0 25 0 4 0 516721649 192647168 13412 33554432000 4194304 4964704 140734617524272 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/20240/statm: 47033 13412 460 189 0 41382 0
[pid=20240/tid=20248] ppid=20238 vsize=188132 CPUtime=12.43 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 2924 0 0 0 1241 2 0 0 25 0 4 0 516721675 192647168 13412 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=188132 CPUtime=12.43 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 3415 0 0 0 1242 1 0 0 25 0 4 0 516721675 192647168 13412 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=188132 CPUtime=12.43 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 2399 0 0 0 1242 1 0 0 25 0 4 0 516721675 192647168 13412 33554432000 4194304 4964704 140734617524272 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 49.93
Current children cumulated vsize (KiB) 188132

[startup+25.5005 s]
/proc/loadavg: 3.87 2.84 2.91 9/184 20254
/proc/meminfo: memFree=25177824/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=191888 CPUtime=101.04 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 17639 0 0 0 10095 9 0 0 25 0 4 0 516721649 196493312 17089 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670260 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/20240/statm: 47972 17089 460 189 0 42321 0
[pid=20240/tid=20248] ppid=20238 vsize=191888 CPUtime=25.21 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 4039 0 0 0 2519 2 0 0 25 0 4 0 516721675 196493312 17089 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=191888 CPUtime=25.22 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 4229 0 0 0 2521 1 0 0 25 0 4 0 516721675 196493312 17089 33554432000 4194304 4964704 140734617524272 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=191888 CPUtime=25.21 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 3247 0 0 0 2520 1 0 0 25 0 4 0 516721675 196493312 17089 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.04
Current children cumulated vsize (KiB) 191888

[startup+51.101 s]
/proc/loadavg: 5.40 3.28 3.06 9/184 20254
/proc/meminfo: memFree=25097036/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=201556 CPUtime=203.29 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 27546 0 0 0 20313 16 0 0 25 0 4 0 516721649 206393344 26725 33554432000 4194304 4964704 140734617524272 18446744073709551615 4668953 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/20240/statm: 50389 26725 460 189 0 44738 0
[pid=20240/tid=20248] ppid=20238 vsize=201556 CPUtime=50.81 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 6516 0 0 0 5076 5 0 0 25 0 4 0 516721675 206393344 26725 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=201556 CPUtime=50.82 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 6817 0 0 0 5080 2 0 0 25 0 4 0 516721675 206393344 26725 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=201556 CPUtime=50.82 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 5307 0 0 0 5079 3 0 0 25 0 4 0 516721675 206393344 26725 33554432000 4194304 4964704 140734617524272 18446744073709551615 4654431 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.29
Current children cumulated vsize (KiB) 201556

[startup+102.301 s]
/proc/loadavg: 6.87 4.01 3.32 9/184 20256
/proc/meminfo: memFree=25011464/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=212680 CPUtime=407.8 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 35352 0 0 0 40757 23 0 0 25 0 4 0 516721649 217784320 34451 33554432000 4194304 4964704 140734617524272 18446744073709551615 4627269 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/20240/statm: 53170 34451 460 189 0 47519 0
[pid=20240/tid=20248] ppid=20238 vsize=212680 CPUtime=102 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 8087 0 0 0 10194 6 0 0 25 0 4 0 516721675 217784320 34451 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=212680 CPUtime=102.01 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 8177 0 0 0 10198 3 0 0 25 0 4 0 516721675 217784320 34451 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=212680 CPUtime=102.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 7474 0 0 0 10197 4 0 0 25 0 4 0 516721675 217784320 34451 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 407.8
Current children cumulated vsize (KiB) 212680

[startup+162.301 s]
/proc/loadavg: 7.64 4.75 3.61 9/184 20258
/proc/meminfo: memFree=24848252/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=228240 CPUtime=647.48 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 45321 0 0 0 64717 31 0 0 25 0 4 0 516721649 233717760 43993 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320928 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 57060 43993 460 189 0 51409 0
[pid=20240/tid=20248] ppid=20238 vsize=228240 CPUtime=161.76 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 11115 0 0 0 16167 9 0 0 25 0 4 0 516721675 233717760 43993 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=228240 CPUtime=162.03 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 10471 0 0 0 16199 4 0 0 25 0 4 0 516721675 233717760 43993 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=228240 CPUtime=162.02 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 9132 0 0 0 16196 6 0 0 25 0 4 0 516721675 233717760 43993 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 647.48
Current children cumulated vsize (KiB) 228240

[startup+222.301 s]
/proc/loadavg: 7.92 5.35 3.89 9/184 20259
/proc/meminfo: memFree=24742696/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=366532 CPUtime=887.12 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 51902 0 0 0 88674 38 0 0 25 0 4 0 516721649 375328768 50568 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670277 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 91633 50568 460 189 0 85982 0
[pid=20240/tid=20248] ppid=20238 vsize=366532 CPUtime=221.43 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 12650 0 0 0 22132 11 0 0 25 0 4 0 516721675 375328768 50568 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=366532 CPUtime=222.02 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 12028 0 0 0 22197 5 0 0 25 0 4 0 516721675 375328768 50568 33554432000 4194304 4964704 140734617524272 18446744073709551615 4660345 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=366532 CPUtime=222.02 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 10656 0 0 0 22194 8 0 0 25 0 4 0 516721675 375328768 50568 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320953 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 887.12
Current children cumulated vsize (KiB) 366532

[startup+282.307 s]
/proc/loadavg: 7.97 5.83 4.14 9/184 20261
/proc/meminfo: memFree=24707072/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=368852 CPUtime=1126.8 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 53321 0 0 0 112641 39 0 0 25 0 4 0 516721649 377704448 51775 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 92213 51775 460 189 0 86562 0
[pid=20240/tid=20248] ppid=20238 vsize=368852 CPUtime=281.09 cores=1,3,5,7

################
# More data... #
################

[pid=20240] ppid=20238 vsize=400260 CPUtime=2564.79 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 73133 0 0 0 256421 58 0 0 25 0 4 0 516721649 409866240 70680 33554432000 4194304 4964704 140734617524272 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 100065 70680 460 189 0 94414 0
[pid=20240/tid=20248] ppid=20238 vsize=400260 CPUtime=639.09 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 17417 0 0 0 63895 14 0 0 25 0 4 0 516721675 409866240 70680 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=400260 CPUtime=642.02 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 18938 0 0 0 64194 8 0 0 25 0 4 0 516721675 409866240 70680 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=400260 CPUtime=642.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 14963 0 0 0 64187 14 0 0 25 0 4 0 516721675 409866240 70680 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670271 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2564.79
Current children cumulated vsize (KiB) 400260

[startup+702.3 s]
/proc/loadavg: 8.06 7.54 5.57 9/184 20272
/proc/meminfo: memFree=24282592/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=403424 CPUtime=2804.46 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 74657 0 0 0 280387 59 0 0 25 0 4 0 516721649 413106176 72204 33554432000 4194304 4964704 140734617524272 18446744073709551615 4342223 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 100856 72204 460 189 0 95205 0
[pid=20240/tid=20248] ppid=20238 vsize=403424 CPUtime=698.77 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 17793 0 0 0 69862 15 0 0 25 0 4 0 516721675 413106176 72204 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=403424 CPUtime=702.01 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 19402 0 0 0 70193 8 0 0 25 0 4 0 516721675 413106176 72204 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=403424 CPUtime=702.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 15097 0 0 0 70187 14 0 0 25 0 4 0 516721675 413106176 72204 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2804.46
Current children cumulated vsize (KiB) 403424

[startup+762.301 s]
/proc/loadavg: 8.13 7.65 5.73 9/184 20274
/proc/meminfo: memFree=24277596/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=404744 CPUtime=3044.13 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 75486 0 0 0 304353 60 0 0 25 0 4 0 516721649 414457856 73033 33554432000 4194304 4964704 140734617524272 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 101186 73033 460 189 0 95535 0
[pid=20240/tid=20248] ppid=20238 vsize=404744 CPUtime=758.44 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 17894 0 0 0 75829 15 0 0 25 0 4 0 516721675 414457856 73033 33554432000 4194304 4964704 140734617524272 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=404744 CPUtime=762.01 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 20052 0 0 0 76193 8 0 0 25 0 4 0 516721675 414457856 73033 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=404744 CPUtime=762.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 15156 0 0 0 76187 14 0 0 25 0 4 0 516721675 414457856 73033 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3044.13
Current children cumulated vsize (KiB) 404744

[startup+822.301 s]
/proc/loadavg: 8.12 7.73 5.87 9/184 20275
/proc/meminfo: memFree=24263928/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=406572 CPUtime=3283.81 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 76558 0 0 0 328320 61 0 0 25 0 4 0 516721649 416329728 73858 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670357 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 101643 73858 460 189 0 95992 0
[pid=20240/tid=20248] ppid=20238 vsize=406572 CPUtime=818.11 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 18413 0 0 0 81796 15 0 0 25 0 4 0 516721675 416329728 73858 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=406572 CPUtime=822.02 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 20535 0 0 0 82194 8 0 0 25 0 4 0 516721675 416329728 73858 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=406572 CPUtime=822.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 15214 0 0 0 82187 14 0 0 25 0 4 0 516721675 416329728 73858 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3283.81
Current children cumulated vsize (KiB) 406572

[startup+882.3 s]
/proc/loadavg: 8.18 7.81 6.02 9/184 20277
/proc/meminfo: memFree=24232276/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=476712 CPUtime=3523.45 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 82726 0 0 0 352275 70 0 0 25 0 4 0 516721649 488153088 80026 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320984 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 119178 80026 460 189 0 113527 0
[pid=20240/tid=20248] ppid=20238 vsize=476712 CPUtime=877.77 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 18827 0 0 0 87761 16 0 0 25 0 4 0 516721675 488153088 80026 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=476712 CPUtime=882.02 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 21162 0 0 0 88193 9 0 0 25 0 4 0 516721675 488153088 80026 33554432000 4194304 4964704 140734617524272 18446744073709551615 4654508 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=476712 CPUtime=882.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 18774 0 0 0 88180 21 0 0 25 0 4 0 516721675 488153088 80026 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3523.45
Current children cumulated vsize (KiB) 476712

[startup+942.307 s]
/proc/loadavg: 8.20 7.87 6.15 9/184 20278
/proc/meminfo: memFree=24204464/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=476712 CPUtime=3763.14 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 86066 0 0 0 376240 74 0 0 25 0 4 0 516721649 488153088 83210 33554432000 4194304 4964704 140734617524272 18446744073709551615 4684027 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 119178 83210 460 189 0 113527 0
[pid=20240/tid=20248] ppid=20238 vsize=476712 CPUtime=937.44 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 19167 0 0 0 93728 16 0 0 25 0 4 0 516721675 488153088 83210 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=476712 CPUtime=942.02 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 22995 0 0 0 94191 11 0 0 25 0 4 0 516721675 488153088 83210 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=476712 CPUtime=942.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 19938 0 0 0 94178 23 0 0 25 0 4 0 516721675 488153088 83210 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3763.14
Current children cumulated vsize (KiB) 476712

[startup+1002.3 s]
/proc/loadavg: 8.19 7.92 6.27 9/184 20280
/proc/meminfo: memFree=24166364/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=476712 CPUtime=4002.81 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 93940 0 0 0 400194 87 0 0 25 0 4 0 516721649 488153088 90929 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670230 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 119178 90929 460 189 0 113527 0
[pid=20240/tid=20248] ppid=20238 vsize=476712 CPUtime=997.12 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 20860 0 0 0 99693 19 0 0 25 0 4 0 516721675 488153088 90929 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=476712 CPUtime=1002.02 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 26171 0 0 0 100186 16 0 0 25 0 4 0 516721675 488153088 90929 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=476712 CPUtime=1002.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 21953 0 0 0 100175 26 0 0 25 0 4 0 516721675 488153088 90929 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320924 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4002.81
Current children cumulated vsize (KiB) 476712

[startup+1062.3 s]
/proc/loadavg: 8.24 7.98 6.39 9/184 20282
/proc/meminfo: memFree=24117728/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=476864 CPUtime=4242.47 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 99935 0 0 0 424152 95 0 0 25 0 4 0 516721649 488308736 96769 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670250 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 119216 96769 460 189 0 113565 0
[pid=20240/tid=20248] ppid=20238 vsize=476864 CPUtime=1056.78 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 21134 0 0 0 105659 19 0 0 25 0 4 0 516721675 488308736 96769 33554432000 4194304 4964704 140734617524272 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=476864 CPUtime=1062.01 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 27519 0 0 0 106185 16 0 0 25 0 4 0 516721675 488308736 96769 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320947 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=476864 CPUtime=1062.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 22591 0 0 0 106175 26 0 0 25 0 4 0 516721675 488308736 96769 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4242.47
Current children cumulated vsize (KiB) 476864

[startup+1122.3 s]
/proc/loadavg: 8.20 8.01 6.50 9/184 20283
/proc/meminfo: memFree=24058180/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=477272 CPUtime=4482.14 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 100529 0 0 0 448119 95 0 0 25 0 4 0 516721649 488726528 97192 33554432000 4194304 4964704 140734617524272 18446744073709551615 4668931 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 119318 97192 460 189 0 113667 0
[pid=20240/tid=20248] ppid=20238 vsize=477272 CPUtime=1116.46 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 21412 0 0 0 111627 19 0 0 25 0 4 0 516721675 488726528 97192 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=477272 CPUtime=1122.01 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 27830 0 0 0 112185 16 0 0 25 0 4 0 516721675 488726528 97192 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=477272 CPUtime=1122.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 22595 0 0 0 112175 26 0 0 25 0 4 0 516721675 488726528 97192 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4482.14
Current children cumulated vsize (KiB) 477272

[startup+1182.3 s]
/proc/loadavg: 8.12 8.02 6.60 9/184 20285
/proc/meminfo: memFree=23996020/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=477888 CPUtime=4721.81 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 102018 0 0 0 472085 96 0 0 25 0 4 0 516721649 489357312 98681 33554432000 4194304 4964704 140734617524272 18446744073709551615 4659143 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 119472 98681 460 189 0 113821 0
[pid=20240/tid=20248] ppid=20238 vsize=477888 CPUtime=1176.12 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 21500 0 0 0 117593 19 0 0 25 0 4 0 516721675 489357312 98681 33554432000 4194304 4964704 140734617524272 18446744073709551615 4660077 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=477888 CPUtime=1182.01 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 28563 0 0 0 118185 16 0 0 25 0 4 0 516721675 489357312 98681 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=477888 CPUtime=1182.01 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 23248 0 0 0 118174 27 0 0 25 0 4 0 516721675 489357312 98681 33554432000 4194304 4964704 140734617524272 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4721.81
Current children cumulated vsize (KiB) 477888



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.91 s]
/proc/loadavg: 8.08 8.02 6.63 9/184 20285
/proc/meminfo: memFree=23982492/32951124 swapFree=67051468/67111528
[pid=20240] ppid=20238 vsize=477888 CPUtime=4800.15 cores=1,3,5,7
/proc/20240/stat : 20240 (claspmt) R 20238 20240 18073 0 -1 4202496 102697 0 0 0 479918 97 0 0 25 0 4 0 516721649 489357312 99360 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/20240/statm: 119472 99360 460 189 0 113821 0
[pid=20240/tid=20248] ppid=20238 vsize=477888 CPUtime=1195.62 cores=1,3,5,7
/proc/20240/task/20248/stat : 20248 (claspmt) R 20238 20240 18073 0 -1 4202560 22152 0 0 0 119542 20 0 0 25 0 4 0 516721675 489357312 99360 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=20240/tid=20249] ppid=20238 vsize=477888 CPUtime=1201.62 cores=1,3,5,7
/proc/20240/task/20249/stat : 20249 (claspmt) R 20238 20240 18073 0 -1 4202560 28565 0 0 0 120146 16 0 0 25 0 4 0 516721675 489357312 99360 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=20240/tid=20250] ppid=20238 vsize=477888 CPUtime=1201.62 cores=1,3,5,7
/proc/20240/task/20250/stat : 20250 (claspmt) R 20238 20240 18073 0 -1 4202560 23248 0 0 0 120135 27 0 0 25 0 4 0 516721675 489357312 99360 33554432000 4194304 4964704 140734617524272 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.15
Current children cumulated vsize (KiB) 477888

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1202.01
CPU time (s): 4800.27
CPU user time (s): 4799.27
CPU system time (s): 0.996848
CPU usage (%): 399.355
Max. virtual memory (cumulated for all children) (KiB): 477888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.27
system time used= 0.996848
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 102711
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7741
involuntary context switches= 31709

runsolver used 1.80572 second user time and 4.75928 second system time

The end

Launcher Data 

Begin job on node101 at 2011-04-29 06:26:29
IDJOB=3299647
IDBENCH=71337
IDSOLVER=1683
FILE ID=node101/3299647-1304051189
RUNJOBID= node101-1304051189-20227
PBS_JOBID= 13170371
Free space on /tmp= 72024 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v1150c84314g7.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299647-1304051189/watcher-3299647-1304051189 -o /tmp/evaluation-result-3299647-1304051189/solver-3299647-1304051189 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299647-1304051189.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f39e50b5cd7b50d1971722973512a1b8
RANDOM SEED=973356662

node101.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.841
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25414568 kB
Buffers:       2012728 kB
Cached:        5043964 kB
SwapCached:      30452 kB
Active:        2902736 kB
Inactive:      4190712 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25414568 kB
SwapTotal:    67111528 kB
SwapFree:     67051468 kB
Dirty:            1624 kB
Writeback:           0 kB
AnonPages:       28092 kB
Mapped:           8600 kB
Slab:           379008 kB
PageTables:       4376 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188432 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72016 MiB
End job on node101 at 2011-04-29 06:46:33