Trace number 3373034

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.36 1203.89

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-6x40.cnf
MD5SUM3a7a68cedc6ab84c0df9c27d166b0b6b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables960
Number of clauses48480
Sum of the clauses size191040
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21440
Number of clauses of size 30
Number of clauses of size 447040
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...424551/instance-3373034-1305424551.cnf
0.79/0.82	c Solving...
4800.25/1203.81	
4800.25/1203.81	*** INTERRUPTED! ***
4800.25/1203.81	*** Shutting down threads...
4800.25/1203.88	s UNKNOWN
4800.25/1203.88	
4800.25/1203.88	c INTERRUPTED   : 1
4800.25/1203.88	c Models        : 0+    
4800.25/1203.88	c Time          : 1203.814s (Solving: 1202.99s 1st Model: 0.00s Unsat: 0.00s)
4800.25/1203.88	c CPU Time      : 4800.280s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373034-1305424551/watcher-3373034-1305424551 -o /tmp/evaluation-result-3373034-1305424551/solver-3373034-1305424551 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373034-1305424551.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.43 7.98 7.96 4/294 4581
/proc/meminfo: memFree=12976616/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=21636 CPUtime=0 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 700 0 0 0 0 0 0 0 23 0 1 0 654054763 22155264 624 33554432000 4194304 4964800 140734708317584 18446744073709551615 208079893189 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4581/statm: 5409 626 385 189 0 283 0

[startup+0.104842 s]
/proc/loadavg: 7.43 7.98 7.96 4/294 4581
/proc/meminfo: memFree=12976616/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=25312 CPUtime=0.1 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 1766 0 0 0 10 0 0 0 23 0 1 0 654054763 25919488 1511 33554432000 4194304 4964800 140734708317584 18446744073709551615 4607673 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4581/statm: 6328 1511 398 189 0 1202 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 25312

[startup+0.200823 s]
/proc/loadavg: 7.43 7.98 7.96 4/294 4581
/proc/meminfo: memFree=12976616/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=25972 CPUtime=0.19 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 1949 0 0 0 19 0 0 0 23 0 1 0 654054763 26595328 1694 33554432000 4194304 4964800 140734708317584 18446744073709551615 4600730 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4581/statm: 6493 1694 399 189 0 1367 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 25972

[startup+0.300804 s]
/proc/loadavg: 7.43 7.98 7.96 4/294 4581
/proc/meminfo: memFree=12976616/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=27028 CPUtime=0.29 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 2204 0 0 0 29 0 0 0 24 0 1 0 654054763 27676672 1949 33554432000 4194304 4964800 140734708317584 18446744073709551615 4619902 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4581/statm: 6757 1949 399 189 0 1631 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 27028

[startup+0.70073 s]
/proc/loadavg: 7.43 7.98 7.96 4/294 4581
/proc/meminfo: memFree=12976616/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=28876 CPUtime=0.69 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 2667 0 0 0 69 0 0 0 25 0 1 0 654054763 29569024 2412 33554432000 4194304 4964800 140734708317584 18446744073709551615 4607616 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/4581/statm: 7219 2412 399 189 0 2093 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 28876

[startup+1.50058 s]
/proc/loadavg: 7.43 7.98 7.96 6/299 4616
/proc/meminfo: memFree=12912992/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=245796 CPUtime=3.47 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 11813 0 0 0 344 3 0 0 25 0 4 0 654054763 251695104 11446 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670330 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 61449 11446 458 189 0 55798 0
[pid=4581/tid=4614] ppid=4576 vsize=245796 CPUtime=0.66 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 1867 0 0 0 66 0 0 0 25 0 4 0 654054846 251695104 11446 33554432000 4194304 4964800 140734708317584 18446744073709551615 4338784 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=245796 CPUtime=0.65 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 3332 0 0 0 64 1 0 0 25 0 4 0 654054846 251695104 11446 33554432000 4194304 4964800 140734708317584 18446744073709551615 208079929986 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=245796 CPUtime=0.66 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 2689 0 0 0 65 1 0 0 25 0 4 0 654054846 251695104 11446 33554432000 4194304 4964800 140734708317584 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3.47
Current children cumulated vsize (KiB) 245796

[startup+3.10028 s]
/proc/loadavg: 7.43 7.98 7.96 6/299 4616
/proc/meminfo: memFree=12890788/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=248996 CPUtime=9.86 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 15206 0 0 0 982 4 0 0 25 0 4 0 654054763 254971904 14839 33554432000 4194304 4964800 140734708317584 18446744073709551615 4332025 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 62249 14839 460 189 0 56598 0
[pid=4581/tid=4614] ppid=4576 vsize=248996 CPUtime=2.26 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 2527 0 0 0 226 0 0 0 25 0 4 0 654054846 254971904 14839 33554432000 4194304 4964800 140734708317584 18446744073709551615 4332255 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=248996 CPUtime=2.23 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 4418 0 0 0 222 1 0 0 25 0 4 0 654054846 254971904 14839 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=248996 CPUtime=2.25 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 3529 0 0 0 224 1 0 0 25 0 4 0 654054846 254971904 14839 33554432000 4194304 4964800 140734708317584 18446744073709551615 4324961 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 9.86
Current children cumulated vsize (KiB) 248996

[startup+6.30067 s]
/proc/loadavg: 7.24 7.93 7.94 6/299 4616
/proc/meminfo: memFree=12856504/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=251400 CPUtime=22.63 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 20422 0 0 0 2257 6 0 0 25 0 4 0 654054763 257433600 20055 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 62850 20055 460 189 0 57199 0
[pid=4581/tid=4614] ppid=4576 vsize=251400 CPUtime=5.46 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 3450 0 0 0 545 1 0 0 25 0 4 0 654054846 257433600 20055 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=251400 CPUtime=5.41 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 7262 0 0 0 539 2 0 0 25 0 4 0 654054846 257433600 20055 33554432000 4194304 4964800 140734708317584 18446744073709551615 4654600 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=251400 CPUtime=5.46 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 4387 0 0 0 544 2 0 0 25 0 4 0 654054846 257433600 20055 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 22.63
Current children cumulated vsize (KiB) 251400

[startup+12.7004 s]
/proc/loadavg: 7.06 7.88 7.92 6/299 4617
/proc/meminfo: memFree=12793660/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=320872 CPUtime=48.17 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 35967 0 0 0 4802 15 0 0 25 0 4 0 654054763 328572928 35148 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 80218 35148 460 189 0 74567 0
[pid=4581/tid=4614] ppid=4576 vsize=320872 CPUtime=11.86 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 6216 0 0 0 1184 2 0 0 25 0 4 0 654054846 328572928 35148 33554432000 4194304 4964800 140734708317584 18446744073709551615 4321116 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=320872 CPUtime=11.75 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 18514 0 0 0 1166 9 0 0 25 0 4 0 654054846 328572928 35148 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=320872 CPUtime=11.86 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 5350 0 0 0 1183 3 0 0 25 0 4 0 654054846 328572928 35148 33554432000 4194304 4964800 140734708317584 18446744073709551615 4660835 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 48.17
Current children cumulated vsize (KiB) 320872

[startup+25.501 s]
/proc/loadavg: 7.27 7.89 7.92 9/302 4620
/proc/meminfo: memFree=12578996/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=327708 CPUtime=99.25 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 43247 0 0 0 9906 19 0 0 25 0 4 0 654054763 335572992 42412 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670313 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 81927 42412 460 189 0 76276 0
[pid=4581/tid=4614] ppid=4576 vsize=327708 CPUtime=24.66 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 6882 0 0 0 2464 2 0 0 25 0 4 0 654054846 335572992 42412 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=327708 CPUtime=24.43 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 21537 0 0 0 2432 11 0 0 25 0 4 0 654054846 335572992 42412 33554432000 4194304 4964800 140734708317584 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=327708 CPUtime=24.65 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 7289 0 0 0 2462 3 0 0 25 0 4 0 654054846 335572992 42412 33554432000 4194304 4964800 140734708317584 18446744073709551615 4644882 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 99.25
Current children cumulated vsize (KiB) 327708

[startup+51.1011 s]
/proc/loadavg: 7.51 7.89 7.92 9/302 4621
/proc/meminfo: memFree=12410424/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=333156 CPUtime=201.43 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 53027 0 0 0 20117 26 0 0 25 0 4 0 654054763 341151744 52113 33554432000 4194304 4964800 140734708317584 18446744073709551615 4320944 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 83289 52113 460 189 0 77638 0
[pid=4581/tid=4614] ppid=4576 vsize=333156 CPUtime=50.26 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 11633 0 0 0 5021 5 0 0 25 0 4 0 654054846 341151744 52113 33554432000 4194304 4964800 140734708317584 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=333156 CPUtime=49.8 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 24412 0 0 0 4966 14 0 0 25 0 4 0 654054846 341151744 52113 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=333156 CPUtime=50.26 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 8113 0 0 0 5022 4 0 0 25 0 4 0 654054846 341151744 52113 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 201.43
Current children cumulated vsize (KiB) 333156

[startup+102.3 s]
/proc/loadavg: 7.79 7.91 7.92 9/302 4622
/proc/meminfo: memFree=12168100/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=406392 CPUtime=405.79 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 66226 0 0 0 40544 35 0 0 25 0 4 0 654054763 416145408 64871 33554432000 4194304 4964800 140734708317584 18446744073709551615 4364587 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 101598 64871 460 189 0 95947 0
[pid=4581/tid=4614] ppid=4576 vsize=406392 CPUtime=101.47 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 18880 0 0 0 10136 11 0 0 25 0 4 0 654054846 416145408 64871 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=406392 CPUtime=100.54 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 26502 0 0 0 10039 15 0 0 25 0 4 0 654054846 416145408 64871 33554432000 4194304 4964800 140734708317584 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=406392 CPUtime=101.46 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 10524 0 0 0 10141 5 0 0 25 0 4 0 654054846 416145408 64871 33554432000 4194304 4964800 140734708317584 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 405.79
Current children cumulated vsize (KiB) 406392

[startup+162.301 s]
/proc/loadavg: 7.97 7.94 7.93 9/302 4624
/proc/meminfo: memFree=11960768/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=412112 CPUtime=645.22 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 77187 0 0 0 64476 46 0 0 25 0 4 0 654054763 422002688 75685 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 103028 75685 460 189 0 97377 0
[pid=4581/tid=4614] ppid=4576 vsize=412112 CPUtime=161.47 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 21530 0 0 0 16133 14 0 0 25 0 4 0 654054846 422002688 75685 33554432000 4194304 4964800 140734708317584 18446744073709551615 4362450 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=412112 CPUtime=159.99 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 31844 0 0 0 15977 22 0 0 25 0 4 0 654054846 422002688 75685 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=412112 CPUtime=161.46 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 12129 0 0 0 16139 7 0 0 25 0 4 0 654054846 422002688 75685 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 645.22
Current children cumulated vsize (KiB) 412112

[startup+222.312 s]
/proc/loadavg: 8.03 7.96 7.94 9/302 4625
/proc/meminfo: memFree=11917468/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=419104 CPUtime=884.73 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 81725 0 0 0 88423 50 0 0 25 0 4 0 654054763 429162496 79837 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670499 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 104776 79837 460 189 0 99125 0
[pid=4581/tid=4614] ppid=4576 vsize=419104 CPUtime=221.48 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 21539 0 0 0 22134 14 0 0 25 0 4 0 654054846 429162496 79837 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=419104 CPUtime=219.46 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 33552 0 0 0 21922 24 0 0 25 0 4 0 654054846 429162496 79837 33554432000 4194304 4964800 140734708317584 18446744073709551615 4668920 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=419104 CPUtime=221.47 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 13256 0 0 0 22139 8 0 0 25 0 4 0 654054846 429162496 79837 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 884.73
Current children cumulated vsize (KiB) 419104

[startup+282.301 s]

################
# More data... #
################

[pid=4581] ppid=4576 vsize=571568 CPUtime=2799.03 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 115067 0 0 0 279818 85 0 0 25 0 4 0 654054763 585285632 109366 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670310 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 142892 109366 460 189 0 137241 0
[pid=4581/tid=4614] ppid=4576 vsize=571568 CPUtime=701.34 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 32967 0 0 0 70109 25 0 0 25 0 4 0 654054846 585285632 109366 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=571568 CPUtime=694.14 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 44848 0 0 0 69374 40 0 0 25 0 4 0 654054846 585285632 109366 33554432000 4194304 4964800 140734708317584 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=571568 CPUtime=701.41 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 18978 0 0 0 70128 13 0 0 25 0 4 0 654054846 585285632 109366 33554432000 4194304 4964800 140734708317584 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2799.03
Current children cumulated vsize (KiB) 571568

[startup+762.301 s]
/proc/loadavg: 9.07 8.83 8.36 10/308 6440
/proc/meminfo: memFree=11387664/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=576276 CPUtime=3038.49 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 118422 0 0 0 303762 87 0 0 25 0 4 0 654054763 590106624 112574 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670340 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 144069 112574 460 189 0 138418 0
[pid=4581/tid=4614] ppid=4576 vsize=576276 CPUtime=761.36 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 34007 0 0 0 76110 26 0 0 25 0 4 0 654054846 590106624 112574 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=576276 CPUtime=753.57 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 44848 0 0 0 75317 40 0 0 25 0 4 0 654054846 590106624 112574 33554432000 4194304 4964800 140734708317584 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=576276 CPUtime=761.43 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 20173 0 0 0 76129 14 0 0 25 0 4 0 654054846 590106624 112574 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3038.49
Current children cumulated vsize (KiB) 576276

[startup+822.3 s]
/proc/loadavg: 9.14 8.89 8.41 10/307 6599
/proc/meminfo: memFree=11339284/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=580076 CPUtime=3277.91 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 121595 0 0 0 327702 89 0 0 25 0 4 0 654054763 593997824 115660 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 145019 115660 460 189 0 139368 0
[pid=4581/tid=4614] ppid=4576 vsize=580076 CPUtime=821.35 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 34567 0 0 0 82109 26 0 0 25 0 4 0 654054846 593997824 115660 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=580076 CPUtime=813 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 45544 0 0 0 81259 41 0 0 25 0 4 0 654054846 593997824 115660 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=580076 CPUtime=821.42 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 21226 0 0 0 82127 15 0 0 25 0 4 0 654054846 593997824 115660 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3277.91
Current children cumulated vsize (KiB) 580076

[startup+882.312 s]
/proc/loadavg: 9.16 8.94 8.45 10/307 6766
/proc/meminfo: memFree=11291820/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=580524 CPUtime=3517.39 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 123413 0 0 0 351648 91 0 0 25 0 4 0 654054763 594456576 117331 33554432000 4194304 4964800 140734708317584 18446744073709551615 4364587 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 145131 117331 460 189 0 139480 0
[pid=4581/tid=4614] ppid=4576 vsize=580524 CPUtime=881.36 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 34945 0 0 0 88110 26 0 0 25 0 4 0 654054846 594456576 117331 33554432000 4194304 4964800 140734708317584 18446744073709551615 208079899549 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=580524 CPUtime=872.45 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 46161 0 0 0 87203 42 0 0 25 0 4 0 654054846 594456576 117331 33554432000 4194304 4964800 140734708317584 18446744073709551615 4363327 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=580524 CPUtime=881.43 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 21917 0 0 0 88127 16 0 0 25 0 4 0 654054846 594456576 117331 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3517.39
Current children cumulated vsize (KiB) 580524

[startup+942.3 s]
/proc/loadavg: 9.08 8.96 8.49 9/302 6903
/proc/meminfo: memFree=11308292/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=581312 CPUtime=3756.58 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 124729 0 0 0 375566 92 0 0 25 0 4 0 654054763 595263488 118277 33554432000 4194304 4964800 140734708317584 18446744073709551615 208079929986 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 145328 118277 460 189 0 139677 0
[pid=4581/tid=4614] ppid=4576 vsize=581312 CPUtime=941.35 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 35316 0 0 0 94109 26 0 0 25 0 4 0 654054846 595263488 118277 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=581312 CPUtime=931.87 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 46860 0 0 0 93144 43 0 0 25 0 4 0 654054846 595263488 118277 33554432000 4194304 4964800 140734708317584 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=581312 CPUtime=941.41 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 22006 0 0 0 94125 16 0 0 25 0 4 0 654054846 595263488 118277 33554432000 4194304 4964800 140734708317584 18446744073709551615 4654532 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3756.58
Current children cumulated vsize (KiB) 581312

[startup+1002.3 s]
/proc/loadavg: 8.54 8.83 8.47 9/302 6905
/proc/meminfo: memFree=11305892/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=581696 CPUtime=3996.04 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 126313 0 0 0 399511 93 0 0 25 0 4 0 654054763 595656704 119491 33554432000 4194304 4964800 140734708317584 18446744073709551615 4644882 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 145424 119491 460 189 0 139773 0
[pid=4581/tid=4614] ppid=4576 vsize=581696 CPUtime=1001.35 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 35686 0 0 0 100109 26 0 0 25 0 4 0 654054846 595656704 119491 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=581696 CPUtime=991.32 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 47468 0 0 0 99089 43 0 0 25 0 4 0 654054846 595656704 119491 33554432000 4194304 4964800 140734708317584 18446744073709551615 4627365 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=581696 CPUtime=1001.41 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 22507 0 0 0 100125 16 0 0 25 0 4 0 654054846 595656704 119491 33554432000 4194304 4964800 140734708317584 18446744073709551615 4644156 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3996.04
Current children cumulated vsize (KiB) 581696

[startup+1062.3 s]
/proc/loadavg: 8.29 8.70 8.45 9/302 6907
/proc/meminfo: memFree=11290492/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=582520 CPUtime=4235.51 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 126849 0 0 0 423457 94 0 0 25 0 4 0 654054763 596500480 120027 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 145630 120027 460 189 0 139979 0
[pid=4581/tid=4614] ppid=4576 vsize=582520 CPUtime=1061.36 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 35690 0 0 0 106110 26 0 0 25 0 4 0 654054846 596500480 120027 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=582520 CPUtime=1050.78 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 47471 0 0 0 105035 43 0 0 25 0 4 0 654054846 596500480 120027 33554432000 4194304 4964800 140734708317584 18446744073709551615 4320987 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=582520 CPUtime=1061.41 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 22859 0 0 0 106124 17 0 0 25 0 4 0 654054846 596500480 120027 33554432000 4194304 4964800 140734708317584 18446744073709551615 4320987 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4235.51
Current children cumulated vsize (KiB) 582520

[startup+1122.3 s]
/proc/loadavg: 8.10 8.57 8.42 9/302 6908
/proc/meminfo: memFree=11268896/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=582772 CPUtime=4474.96 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 131146 0 0 0 447396 100 0 0 25 0 4 0 654054763 596758528 124324 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 145693 124324 460 189 0 140042 0
[pid=4581/tid=4614] ppid=4576 vsize=582772 CPUtime=1121.36 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 35698 0 0 0 112110 26 0 0 25 0 4 0 654054846 596758528 124324 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=582772 CPUtime=1110.23 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 51252 0 0 0 110974 49 0 0 25 0 4 0 654054846 596758528 124324 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=582772 CPUtime=1121.41 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 23306 0 0 0 112124 17 0 0 25 0 4 0 654054846 596758528 124324 33554432000 4194304 4964800 140734708317584 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4474.96
Current children cumulated vsize (KiB) 582772

[startup+1182.3 s]
/proc/loadavg: 8.04 8.47 8.39 9/302 6910
/proc/meminfo: memFree=11231072/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=584804 CPUtime=4714.43 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 131809 0 0 0 471343 100 0 0 25 0 4 0 654054763 598839296 124949 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670349 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 146201 124949 460 189 0 140550 0
[pid=4581/tid=4614] ppid=4576 vsize=584804 CPUtime=1181.36 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 35703 0 0 0 118110 26 0 0 25 0 4 0 654054846 598839296 124949 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=584804 CPUtime=1169.69 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 51254 0 0 0 116920 49 0 0 25 0 4 0 654054846 598839296 124949 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=584804 CPUtime=1181.42 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 23519 0 0 0 118124 18 0 0 25 0 4 0 654054846 598839296 124949 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4714.43
Current children cumulated vsize (KiB) 584804



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.8 s]
/proc/loadavg: 8.11 8.45 8.38 9/302 6910
/proc/meminfo: memFree=11215428/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=586320 CPUtime=4800.25 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 132322 0 0 0 479925 100 0 0 25 0 4 0 654054763 600391680 125462 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 146580 125462 460 189 0 140929 0
[pid=4581/tid=4614] ppid=4576 vsize=586320 CPUtime=1202.87 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 35703 0 0 0 120261 26 0 0 25 0 4 0 654054846 600391680 125462 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=586320 CPUtime=1190.99 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 51256 0 0 0 119050 49 0 0 25 0 4 0 654054846 600391680 125462 33554432000 4194304 4964800 140734708317584 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=586320 CPUtime=1202.93 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 23688 0 0 0 120275 18 0 0 25 0 4 0 654054846 600391680 125462 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 586320

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.8 s]
/proc/loadavg: 8.11 8.45 8.38 9/302 6910
/proc/meminfo: memFree=11215428/32950928 swapFree=67083212/67111528
[pid=4581] ppid=4576 vsize=586320 CPUtime=4800.25 cores=1,3,5,7
/proc/4581/stat : 4581 (claspmt) R 4576 4581 4446 0 -1 4202496 132322 0 0 0 479925 100 0 0 25 0 4 0 654054763 600391680 125462 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/4581/statm: 146580 125462 460 189 0 140929 0
[pid=4581/tid=4614] ppid=4576 vsize=586320 CPUtime=1202.87 cores=1,3,5,7
/proc/4581/task/4614/stat : 4614 (claspmt) R 4576 4581 4446 0 -1 4202560 35703 0 0 0 120261 26 0 0 25 0 4 0 654054846 600391680 125462 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=4581/tid=4615] ppid=4576 vsize=586320 CPUtime=1190.99 cores=1,3,5,7
/proc/4581/task/4615/stat : 4615 (claspmt) R 4576 4581 4446 0 -1 4202560 51256 0 0 0 119050 49 0 0 25 0 4 0 654054846 600391680 125462 33554432000 4194304 4964800 140734708317584 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=4581/tid=4616] ppid=4576 vsize=586320 CPUtime=1202.93 cores=1,3,5,7
/proc/4581/task/4616/stat : 4616 (claspmt) R 4576 4581 4446 0 -1 4202560 23688 0 0 0 120275 18 0 0 25 0 4 0 654054846 600391680 125462 33554432000 4194304 4964800 140734708317584 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 586320

Child status: 0
Real time (s): 1203.89
CPU time (s): 4800.36
CPU user time (s): 4799.34
CPU system time (s): 1.02984
CPU usage (%): 398.738
Max. virtual memory (cumulated for all children) (KiB): 586320

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.34
system time used= 1.02984
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 132334
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1156
involuntary context switches= 36872

runsolver used 2.90656 second user time and 8.26474 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-15 03:55:51
IDJOB=3373034
IDBENCH=83178
IDSOLVER=1853
FILE ID=node127/3373034-1305424551
RUNJOBID= node127-1305423346-4465
PBS_JOBID= 13324590
Free space on /tmp= 73476 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-6x40.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373034-1305424551/watcher-3373034-1305424551 -o /tmp/evaluation-result-3373034-1305424551/solver-3373034-1305424551 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373034-1305424551.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3a7a68cedc6ab84c0df9c27d166b0b6b
RANDOM SEED=993378903

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12977176 kB
Buffers:        294720 kB
Cached:        3510780 kB
SwapCached:       1620 kB
Active:       16832084 kB
Inactive:      2807016 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12977176 kB
SwapTotal:    67111528 kB
SwapFree:     67083212 kB
Dirty:            3180 kB
Writeback:           0 kB
AnonPages:    15832672 kB
Mapped:          26328 kB
Slab:           226344 kB
PageTables:      46288 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 44319020 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73504 MiB
End job on node127 at 2011-05-15 04:15:57