Trace number 3373130

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.3 1203.82

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_26_60_1-dir.shuffled-as.sat03-167.cnf
MD5SUMb970e9358cd0cd1a9cfd3d4afb2e830d
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables780
Number of clauses65612
Sum of the clauses size131952
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 265586
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 526

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...429092/instance-3373130-1305429092.cnf
0.29/0.33	c Solving...
4800.15/1203.71	
4800.15/1203.71	*** INTERRUPTED! ***
4800.15/1203.71	*** Shutting down threads...
4800.15/1203.81	s UNKNOWN
4800.15/1203.81	
4800.15/1203.81	c INTERRUPTED   : 1
4800.15/1203.81	c Models        : 0+    
4800.15/1203.81	c Time          : 1203.730s (Solving: 1203.40s 1st Model: 0.00s Unsat: 0.00s)
4800.15/1203.81	c CPU Time      : 4800.200s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373130-1305429092/watcher-3373130-1305429092 -o /tmp/evaluation-result-3373130-1305429092/solver-3373130-1305429092 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373130-1305429092.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 1.06 2.41 2/336 9648
/proc/meminfo: memFree=17504336/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=21640 CPUtime=0 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 698 0 0 0 0 0 0 0 21 0 1 0 654510113 22159360 623 33554432000 4194304 4964800 140736536053728 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/9648/statm: 5410 623 385 189 0 284 0

[startup+0.0643561 s]
/proc/loadavg: 0.92 1.06 2.41 2/336 9648
/proc/meminfo: memFree=17504336/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=25528 CPUtime=0.05 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 1899 0 0 0 5 0 0 0 21 0 1 0 654510113 26140672 1525 33554432000 4194304 4964800 140736536053728 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/9648/statm: 6382 1525 398 189 0 1256 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 25528

[startup+0.100353 s]
/proc/loadavg: 0.92 1.06 2.41 2/336 9648
/proc/meminfo: memFree=17504336/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=25528 CPUtime=0.09 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 1899 0 0 0 9 0 0 0 21 0 1 0 654510113 26140672 1525 33554432000 4194304 4964800 140736536053728 18446744073709551615 4607513 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/9648/statm: 6382 1525 398 189 0 1256 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25528

[startup+0.300322 s]
/proc/loadavg: 0.92 1.06 2.41 2/336 9648
/proc/meminfo: memFree=17504336/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=25924 CPUtime=0.29 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 2019 0 0 0 29 0 0 0 22 0 1 0 654510113 26546176 1645 33554432000 4194304 4964800 140736536053728 18446744073709551615 4600434 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/9648/statm: 6481 1645 399 189 0 1355 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 25924

[startup+0.700154 s]
/proc/loadavg: 0.92 1.06 2.41 2/336 9648
/proc/meminfo: memFree=17504336/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=172880 CPUtime=1.57 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 4354 0 0 0 154 3 0 0 18 0 4 0 654510113 177029120 3844 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320849 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/9648/statm: 43220 3844 458 189 0 37569 0
Current children cumulated CPU time (s) 1.57
Current children cumulated vsize (KiB) 172880

[startup+1.50101 s]
/proc/loadavg: 0.92 1.06 2.41 11/343 9655
/proc/meminfo: memFree=17466232/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=176948 CPUtime=4.76 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 7210 0 0 0 472 4 0 0 19 0 4 0 654510113 181194752 6701 33554432000 4194304 4964800 140736536053728 18446744073709551615 4627248 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/9648/statm: 44237 6701 458 189 0 38586 0
[pid=9648/tid=9653] ppid=9646 vsize=176948 CPUtime=1.01 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 1095 0 0 0 101 0 0 0 25 0 4 0 654510146 181194752 6701 33554432000 4194304 4964800 140736536053728 18446744073709551615 4684805 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=176948 CPUtime=1.11 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 897 0 0 0 111 0 0 0 19 0 4 0 654510146 181194752 6701 33554432000 4194304 4964800 140736536053728 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=176948 CPUtime=1.15 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 1605 0 0 0 115 0 0 0 25 0 4 0 654510146 181194752 6701 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.76
Current children cumulated vsize (KiB) 176948

[startup+3.10073 s]
/proc/loadavg: 0.92 1.06 2.41 10/343 9655
/proc/meminfo: memFree=17442424/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=180748 CPUtime=11.14 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 9361 0 0 0 1110 4 0 0 22 0 4 0 654510113 185085952 8851 33554432000 4194304 4964800 140736536053728 18446744073709551615 4362240 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/9648/statm: 45187 8851 460 189 0 39536 0
[pid=9648/tid=9653] ppid=9646 vsize=180748 CPUtime=2.6 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 1714 0 0 0 260 0 0 0 25 0 4 0 654510146 185085952 8851 33554432000 4194304 4964800 140736536053728 18446744073709551615 4627338 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=180748 CPUtime=2.71 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 1584 0 0 0 271 0 0 0 23 0 4 0 654510146 185085952 8851 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=180748 CPUtime=2.75 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 2000 0 0 0 275 0 0 0 25 0 4 0 654510146 185085952 8851 33554432000 4194304 4964800 140736536053728 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 11.14
Current children cumulated vsize (KiB) 180748

[startup+6.30117 s]
/proc/loadavg: 1.49 1.18 2.44 10/343 9655
/proc/meminfo: memFree=17415088/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=183668 CPUtime=23.91 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 12716 0 0 0 2385 6 0 0 25 0 4 0 654510113 188076032 12206 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/9648/statm: 45917 12206 460 189 0 40266 0
[pid=9648/tid=9653] ppid=9646 vsize=183668 CPUtime=5.8 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 2437 0 0 0 580 0 0 0 25 0 4 0 654510146 188076032 12206 33554432000 4194304 4964800 140736536053728 18446744073709551615 4627213 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=183668 CPUtime=5.91 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 2521 0 0 0 591 0 0 0 25 0 4 0 654510146 188076032 12206 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=183668 CPUtime=5.95 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 2769 0 0 0 594 1 0 0 25 0 4 0 654510146 188076032 12206 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 23.91
Current children cumulated vsize (KiB) 183668

[startup+12.701 s]
/proc/loadavg: 2.01 1.29 2.47 9/343 9655
/proc/meminfo: memFree=17381024/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=189536 CPUtime=49.43 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 16575 0 0 0 4935 8 0 0 25 0 4 0 654510113 194084864 16065 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320849 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 47384 16065 460 189 0 41733 0
[pid=9648/tid=9653] ppid=9646 vsize=189536 CPUtime=12.17 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 3495 0 0 0 1216 1 0 0 25 0 4 0 654510146 194084864 16065 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=189536 CPUtime=12.31 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 3543 0 0 0 1230 1 0 0 25 0 4 0 654510146 194084864 16065 33554432000 4194304 4964800 140736536053728 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=189536 CPUtime=12.36 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 3527 0 0 0 1234 2 0 0 25 0 4 0 654510146 194084864 16065 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 49.43
Current children cumulated vsize (KiB) 189536

[startup+25.5008 s]
/proc/loadavg: 3.33 1.62 2.56 10/343 9655
/proc/meminfo: memFree=17319660/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=205068 CPUtime=100.47 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 26878 0 0 0 10034 13 0 0 25 0 4 0 654510113 209989632 26368 33554432000 4194304 4964800 140736536053728 18446744073709551615 4653547 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 51267 26368 460 189 0 45616 0
[pid=9648/tid=9653] ppid=9646 vsize=205068 CPUtime=24.82 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 5541 0 0 0 2480 2 0 0 25 0 4 0 654510146 209989632 26368 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=205068 CPUtime=25.1 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 6027 0 0 0 2509 1 0 0 25 0 4 0 654510146 209989632 26368 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=205068 CPUtime=25.15 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 5617 0 0 0 2512 3 0 0 21 0 4 0 654510146 209989632 26368 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 100.47
Current children cumulated vsize (KiB) 205068

[startup+51.1002 s]
/proc/loadavg: 4.99 2.15 2.71 10/343 9656
/proc/meminfo: memFree=17258092/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=208192 CPUtime=202.58 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 31763 0 0 0 20242 16 0 0 25 0 4 0 654510113 213188608 31204 33554432000 4194304 4964800 140736536053728 18446744073709551615 4668552 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 52048 31204 460 189 0 46397 0
[pid=9648/tid=9653] ppid=9646 vsize=208192 CPUtime=50.13 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 6660 0 0 0 5010 3 0 0 18 0 4 0 654510146 213188608 31204 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=208192 CPUtime=50.7 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 8010 0 0 0 5068 2 0 0 25 0 4 0 654510146 213188608 31204 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=208192 CPUtime=50.74 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 6461 0 0 0 5071 3 0 0 25 0 4 0 654510146 213188608 31204 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 202.58
Current children cumulated vsize (KiB) 208192

[startup+102.312 s]
/proc/loadavg: 6.84 3.08 3.00 10/343 9657
/proc/meminfo: memFree=17161108/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=222608 CPUtime=406.84 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 43160 0 0 0 40661 23 0 0 25 0 4 0 654510113 227950592 42601 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 55652 42601 460 189 0 50001 0
[pid=9648/tid=9653] ppid=9646 vsize=222608 CPUtime=100.77 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 8808 0 0 0 10072 5 0 0 25 0 4 0 654510146 227950592 42601 33554432000 4194304 4964800 140736536053728 18446744073709551615 4659398 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=222608 CPUtime=101.9 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 11996 0 0 0 10187 3 0 0 25 0 4 0 654510146 227950592 42601 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=222608 CPUtime=101.96 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 9512 0 0 0 10190 6 0 0 25 0 4 0 654510146 227950592 42601 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 406.84
Current children cumulated vsize (KiB) 222608

[startup+162.301 s]
/proc/loadavg: 7.57 3.97 3.31 10/343 9659
/proc/meminfo: memFree=17060404/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=377180 CPUtime=646.12 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 57034 0 0 0 64581 31 0 0 25 0 4 0 654510113 386232320 56090 33554432000 4194304 4964800 140736536053728 18446744073709551615 4653368 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 94295 56090 460 189 0 88644 0
[pid=9648/tid=9653] ppid=9646 vsize=377180 CPUtime=160.1 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 10829 0 0 0 16004 6 0 0 25 0 4 0 654510146 386232320 56090 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=377180 CPUtime=161.88 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 15882 0 0 0 16184 4 0 0 25 0 4 0 654510146 386232320 56090 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=377180 CPUtime=161.95 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 13183 0 0 0 16186 9 0 0 25 0 4 0 654510146 386232320 56090 33554432000 4194304 4964800 140736536053728 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 646.12
Current children cumulated vsize (KiB) 377180

[startup+222.301 s]
/proc/loadavg: 7.90 4.72 3.60 10/343 9661
/proc/meminfo: memFree=16997528/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=384064 CPUtime=885.45 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 65829 0 0 0 88507 38 0 0 25 0 4 0 654510113 393281536 64543 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 96016 64543 460 189 0 90365 0
[pid=9648/tid=9653] ppid=9646 vsize=384064 CPUtime=219.43 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 11566 0 0 0 21936 7 0 0 25 0 4 0 654510146 393281536 64543 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=384064 CPUtime=221.87 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 18805 0 0 0 22183 4 0 0 25 0 4 0 654510146 393281536 64543 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=384064 CPUtime=221.94 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 16764 0 0 0 22182 12 0 0 25 0 4 0 654510146 393281536 64543 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 885.45
Current children cumulated vsize (KiB) 384064

[startup+282.3 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2560.8
Current children cumulated vsize (KiB) 535656

[startup+702.301 s]
/proc/loadavg: 8.12 7.42 5.40 10/343 9673
/proc/meminfo: memFree=16774100/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=538360 CPUtime=2800.11 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 109629 0 0 0 279935 76 0 0 25 0 4 0 654510113 551280640 106794 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 134590 106794 460 189 0 128939 0
[pid=9648/tid=9653] ppid=9646 vsize=538360 CPUtime=694.17 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 27730 0 0 0 69395 22 0 0 25 0 4 0 654510146 551280640 106794 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=538360 CPUtime=701.78 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 28106 0 0 0 70170 8 0 0 25 0 4 0 654510146 551280640 106794 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=538360 CPUtime=701.95 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 26819 0 0 0 70172 23 0 0 25 0 4 0 654510146 551280640 106794 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2800.11
Current children cumulated vsize (KiB) 538360

[startup+762.312 s]
/proc/loadavg: 8.08 7.54 5.57 10/343 9675
/proc/meminfo: memFree=16758716/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=543648 CPUtime=3039.49 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 112373 0 0 0 303871 78 0 0 25 0 4 0 654510113 556695552 109416 33554432000 4194304 4964800 140736536053728 18446744073709551615 4669022 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 135912 109416 460 189 0 130261 0
[pid=9648/tid=9653] ppid=9646 vsize=543648 CPUtime=753.52 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 27893 0 0 0 75329 23 0 0 25 0 4 0 654510146 556695552 109416 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=543648 CPUtime=761.79 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 30203 0 0 0 76170 9 0 0 25 0 4 0 654510146 556695552 109416 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=543648 CPUtime=761.97 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 27302 0 0 0 76173 24 0 0 25 0 4 0 654510146 556695552 109416 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320939 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3039.49
Current children cumulated vsize (KiB) 543648

[startup+822.301 s]
/proc/loadavg: 8.06 7.63 5.72 10/343 9677
/proc/meminfo: memFree=16743208/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=545568 CPUtime=3278.78 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 115690 0 0 0 327799 79 0 0 25 0 4 0 654510113 558661632 112536 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670340 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 136392 112536 460 189 0 130741 0
[pid=9648/tid=9653] ppid=9646 vsize=545568 CPUtime=812.85 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 28605 0 0 0 81262 23 0 0 25 0 4 0 654510146 558661632 112536 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=545568 CPUtime=821.77 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 32625 0 0 0 82167 10 0 0 25 0 4 0 654510146 558661632 112536 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=545568 CPUtime=821.96 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 27329 0 0 0 82172 24 0 0 25 0 4 0 654510146 558661632 112536 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3278.78
Current children cumulated vsize (KiB) 545568

[startup+882.3 s]
/proc/loadavg: 8.02 7.70 5.86 10/343 9678
/proc/meminfo: memFree=16737616/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=546848 CPUtime=3518.09 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 116564 0 0 0 351729 80 0 0 25 0 4 0 654510113 559972352 113410 33554432000 4194304 4964800 140736536053728 18446744073709551615 4669350 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 136712 113410 460 189 0 131061 0
[pid=9648/tid=9653] ppid=9646 vsize=546848 CPUtime=872.19 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 28796 0 0 0 87196 23 0 0 25 0 4 0 654510146 559972352 113410 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=546848 CPUtime=881.75 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 33299 0 0 0 88165 10 0 0 25 0 4 0 654510146 559972352 113410 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=546848 CPUtime=881.95 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 27338 0 0 0 88171 24 0 0 25 0 4 0 654510146 559972352 113410 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3518.09
Current children cumulated vsize (KiB) 546848

[startup+942.301 s]
/proc/loadavg: 8.00 7.75 5.99 10/343 9680
/proc/meminfo: memFree=16735988/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=546848 CPUtime=3757.43 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 116624 0 0 0 375663 80 0 0 25 0 4 0 654510113 559972352 113470 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 136712 113470 460 189 0 131061 0
[pid=9648/tid=9653] ppid=9646 vsize=546848 CPUtime=931.53 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 28826 0 0 0 93130 23 0 0 25 0 4 0 654510146 559972352 113470 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=546848 CPUtime=941.75 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 33328 0 0 0 94165 10 0 0 25 0 4 0 654510146 559972352 113470 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670349 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=546848 CPUtime=941.95 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 27339 0 0 0 94171 24 0 0 25 0 4 0 654510146 559972352 113470 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3757.43
Current children cumulated vsize (KiB) 546848

[startup+1002.3 s]
/proc/loadavg: 8.00 7.79 6.11 10/343 9681
/proc/meminfo: memFree=16731884/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=547468 CPUtime=3996.78 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 117054 0 0 0 399597 81 0 0 25 0 4 0 654510113 560607232 113900 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670313 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 136867 113900 460 189 0 131216 0
[pid=9648/tid=9653] ppid=9646 vsize=547468 CPUtime=990.87 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 28985 0 0 0 99064 23 0 0 25 0 4 0 654510146 560607232 113900 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=547468 CPUtime=1001.74 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 33599 0 0 0 100164 10 0 0 25 0 4 0 654510146 560607232 113900 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=547468 CPUtime=1001.96 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 27339 0 0 0 100171 25 0 0 25 0 4 0 654510146 560607232 113900 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3996.78
Current children cumulated vsize (KiB) 547468

[startup+1062.3 s]
/proc/loadavg: 8.07 7.84 6.23 10/343 9683
/proc/meminfo: memFree=16728772/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=547468 CPUtime=4236.11 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 117402 0 0 0 423530 81 0 0 25 0 4 0 654510113 560607232 114125 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 136867 114125 460 189 0 131216 0
[pid=9648/tid=9653] ppid=9646 vsize=547468 CPUtime=1050.22 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 29217 0 0 0 104999 23 0 0 25 0 4 0 654510146 560607232 114125 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=547468 CPUtime=1061.72 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 33710 0 0 0 106162 10 0 0 25 0 4 0 654510146 560607232 114125 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=547468 CPUtime=1061.96 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 27343 0 0 0 106171 25 0 0 25 0 4 0 654510146 560607232 114125 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4236.11
Current children cumulated vsize (KiB) 547468

[startup+1122.3 s]
/proc/loadavg: 8.08 7.89 6.35 10/343 9685
/proc/meminfo: memFree=16725660/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=547468 CPUtime=4475.44 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 117572 0 0 0 447463 81 0 0 25 0 4 0 654510113 560607232 114295 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670264 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 136867 114295 460 189 0 131216 0
[pid=9648/tid=9653] ppid=9646 vsize=547468 CPUtime=1109.56 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 29328 0 0 0 110933 23 0 0 25 0 4 0 654510146 560607232 114295 33554432000 4194304 4964800 140736536053728 18446744073709551615 4627290 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=547468 CPUtime=1121.72 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 33759 0 0 0 112162 10 0 0 25 0 4 0 654510146 560607232 114295 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=547468 CPUtime=1121.96 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 27349 0 0 0 112171 25 0 0 25 0 4 0 654510146 560607232 114295 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4475.44
Current children cumulated vsize (KiB) 547468

[startup+1182.3 s]
/proc/loadavg: 8.09 7.92 6.45 10/343 9686
/proc/meminfo: memFree=16718208/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=548448 CPUtime=4714.79 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 118025 0 0 0 471398 81 0 0 25 0 4 0 654510113 561610752 114748 33554432000 4194304 4964800 140736536053728 18446744073709551615 4627252 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 137112 114748 460 189 0 131461 0
[pid=9648/tid=9653] ppid=9646 vsize=548448 CPUtime=1168.92 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 29577 0 0 0 116868 24 0 0 25 0 4 0 654510146 561610752 114748 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=548448 CPUtime=1181.71 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 33958 0 0 0 118161 10 0 0 25 0 4 0 654510146 561610752 114748 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=548448 CPUtime=1181.96 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 27354 0 0 0 118171 25 0 0 25 0 4 0 654510146 561610752 114748 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4714.79
Current children cumulated vsize (KiB) 548448



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.7 s]
/proc/loadavg: 8.14 7.94 6.49 9/343 9687
/proc/meminfo: memFree=16706672/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=556508 CPUtime=4800.15 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 120232 0 0 0 479933 82 0 0 25 0 4 0 654510113 569864192 116955 33554432000 4194304 4964800 140736536053728 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/9648/statm: 139127 116955 460 189 0 133476 0
[pid=9648/tid=9653] ppid=9646 vsize=556508 CPUtime=1190.08 cores=0,2,4,6
/proc/9648/task/9653/stat : 9653 (claspmt) R 9646 9648 563 0 -1 4202560 29902 0 0 0 118984 24 0 0 25 0 4 0 654510146 569864192 116959 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=9648/tid=9654] ppid=9646 vsize=556508 CPUtime=1203.11 cores=0,2,4,6
/proc/9648/task/9654/stat : 9654 (claspmt) R 9646 9648 563 0 -1 4202560 34139 0 0 0 120301 10 0 0 25 0 4 0 654510146 569864192 116959 33554432000 4194304 4964800 140736536053728 18446744073709551615 4321121 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=9648/tid=9655] ppid=9646 vsize=556508 CPUtime=1203.37 cores=0,2,4,6
/proc/9648/task/9655/stat : 9655 (claspmt) R 9646 9648 563 0 -1 4202560 27366 0 0 0 120312 25 0 0 25 0 4 0 654510146 569864192 116959 33554432000 4194304 4964800 140736536053728 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.15
Current children cumulated vsize (KiB) 556508

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.82 s]
/proc/loadavg: 8.14 7.94 6.49 9/343 9687
/proc/meminfo: memFree=16706672/32951124 swapFree=67056804/67111528
[pid=9648] ppid=9646 vsize=237580 CPUtime=4800.3 cores=0,2,4,6
/proc/9648/stat : 9648 (claspmt) R 9646 9648 563 0 -1 4202496 120251 0 0 0 479945 85 0 0 25 0 1 0 654510113 243281920 1827 33554432000 4194304 4964800 140736536053728 18446744073709551615 47324426994736 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/9648/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 237580

Child status: 0
Real time (s): 1203.82
CPU time (s): 4800.3
CPU user time (s): 4799.45
CPU system time (s): 0.85087
CPU usage (%): 398.756
Max. virtual memory (cumulated for all children) (KiB): 556508

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.45
system time used= 0.85087
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 120251
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10546
involuntary context switches= 24499

runsolver used 3.86641 second user time and 9.27559 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-15 05:11:32
IDJOB=3373130
IDBENCH=83934
IDSOLVER=1853
FILE ID=node108/3373130-1305429092
RUNJOBID= node108-1305429092-9628
PBS_JOBID= 13324595
Free space on /tmp= 73576 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_26_60_1-dir.shuffled-as.sat03-167.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373130-1305429092/watcher-3373130-1305429092 -o /tmp/evaluation-result-3373130-1305429092/solver-3373130-1305429092 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373130-1305429092.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b970e9358cd0cd1a9cfd3d4afb2e830d
RANDOM SEED=928965098

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17504872 kB
Buffers:        290056 kB
Cached:        4739756 kB
SwapCached:       8700 kB
Active:       11066624 kB
Inactive:      4069784 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17504872 kB
SwapTotal:    67111528 kB
SwapFree:     67056804 kB
Dirty:            2728 kB
Writeback:           0 kB
AnonPages:    10102656 kB
Mapped:          27144 kB
Slab:           208048 kB
PageTables:      38792 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 52276096 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73572 MiB
End job on node108 at 2011-05-15 05:31:37