Trace number 3373534

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.4 1203.13

General information on the benchmark

Nameindustrial/jarvisalo/
eq.atree.braun.12.unsat.cnf
MD5SUM8d6acb9f6b752ad76c024133f5175c69
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1694
Number of clauses5726
Sum of the clauses size14874
Maximum clause length23
Minimum clause length1
Number of clauses of size 13
Number of clauses of size 22490
Number of clauses of size 33143
Number of clauses of size 439
Number of clauses of size 538
Number of clauses of size over 513

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...418181/instance-3373534-1305418181.cnf
0.00/0.01	c Solving...
4800.34/1203.11	
4800.34/1203.11	*** INTERRUPTED! ***
4800.34/1203.11	*** Shutting down threads...
4800.34/1203.12	s UNKNOWN
4800.34/1203.12	
4800.34/1203.12	c INTERRUPTED   : 1
4800.34/1203.12	c Models        : 0+    
4800.34/1203.12	c Time          : 1203.115s (Solving: 1203.11s 1st Model: 0.00s Unsat: 0.00s)
4800.34/1203.12	c CPU Time      : 4800.370s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373534-1305418181/watcher-3373534-1305418181 -o /tmp/evaluation-result-3373534-1305418181/solver-3373534-1305418181 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373534-1305418181.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.86 7.11 7.67 5/319 9316
/proc/meminfo: memFree=27263144/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=21772 CPUtime=0 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 768 0 0 0 0 0 0 0 25 0 1 0 386009334 22294528 670 33554432000 4194304 4964800 140737079450800 18446744073709551615 268660358923 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/9316/statm: 5443 670 398 189 0 317 0

[startup+0.0353459 s]
/proc/loadavg: 4.86 7.11 7.67 5/319 9316
/proc/meminfo: memFree=27263144/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=169076 CPUtime=0.09 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 1226 0 0 0 9 0 0 0 25 0 4 0 386009334 173133824 1097 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 42269 1097 457 189 0 36618 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 169076

[startup+0.135328 s]
/proc/loadavg: 4.86 7.11 7.67 5/319 9316
/proc/meminfo: memFree=27263144/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=169604 CPUtime=0.49 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 1572 0 0 0 49 0 0 0 25 0 4 0 386009334 173674496 1443 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 42401 1443 458 189 0 36750 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 169604

[startup+0.3003 s]
/proc/loadavg: 4.86 7.11 7.67 5/319 9316
/proc/meminfo: memFree=27263144/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=169736 CPUtime=1.14 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 1761 0 0 0 114 0 0 0 18 0 4 0 386009334 173809664 1632 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670323 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 42434 1632 458 189 0 36783 0
Current children cumulated CPU time (s) 1.14
Current children cumulated vsize (KiB) 169736

[startup+0.700229 s]
/proc/loadavg: 4.86 7.11 7.67 5/319 9316
/proc/meminfo: memFree=27263144/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=170000 CPUtime=2.74 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 2033 0 0 0 274 0 0 0 18 0 4 0 386009334 174080000 1904 33554432000 4194304 4964800 140737079450800 18446744073709551615 4668987 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 42500 1904 458 189 0 36849 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 170000

[startup+1.50109 s]
/proc/loadavg: 4.86 7.11 7.67 9/323 9320
/proc/meminfo: memFree=27255680/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=170680 CPUtime=5.93 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 2426 0 0 0 593 0 0 0 19 0 4 0 386009334 174776320 2297 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 42670 2297 458 189 0 37019 0
[pid=9316/tid=9318] ppid=9314 vsize=170680 CPUtime=1.48 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 354 0 0 0 148 0 0 0 25 0 4 0 386009335 174776320 2297 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=170680 CPUtime=1.47 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 480 0 0 0 147 0 0 0 25 0 4 0 386009335 174776320 2297 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=170680 CPUtime=1.48 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 358 0 0 0 148 0 0 0 25 0 4 0 386009335 174776320 2297 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 170680

[startup+3.10081 s]
/proc/loadavg: 5.11 7.13 7.67 9/323 9320
/proc/meminfo: memFree=27251492/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=171864 CPUtime=12.33 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 3454 0 0 0 1232 1 0 0 24 0 4 0 386009334 175988736 3325 33554432000 4194304 4964800 140737079450800 18446744073709551615 4325701 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 42966 3325 458 189 0 37315 0
[pid=9316/tid=9318] ppid=9314 vsize=171864 CPUtime=3.08 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 578 0 0 0 308 0 0 0 25 0 4 0 386009335 175988736 3325 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=171864 CPUtime=3.05 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 936 0 0 0 305 0 0 0 25 0 4 0 386009335 175988736 3325 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=171864 CPUtime=3.08 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 501 0 0 0 308 0 0 0 25 0 4 0 386009335 175988736 3325 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 171864

[startup+6.30025 s]
/proc/loadavg: 5.11 7.13 7.67 9/323 9320
/proc/meminfo: memFree=27246628/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=173744 CPUtime=25.09 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 4202 0 0 0 2508 1 0 0 25 0 4 0 386009334 177913856 4073 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 43436 4073 460 189 0 37785 0
[pid=9316/tid=9318] ppid=9314 vsize=173744 CPUtime=6.28 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 780 0 0 0 628 0 0 0 25 0 4 0 386009335 177913856 4073 33554432000 4194304 4964800 140737079450800 18446744073709551615 4660447 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=173744 CPUtime=6.22 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 1247 0 0 0 622 0 0 0 25 0 4 0 386009335 177913856 4073 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=173744 CPUtime=6.28 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 608 0 0 0 628 0 0 0 25 0 4 0 386009335 177913856 4073 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.09
Current children cumulated vsize (KiB) 173744

[startup+12.7011 s]
/proc/loadavg: 5.56 7.16 7.68 9/323 9320
/proc/meminfo: memFree=27241800/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=174404 CPUtime=50.63 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 4925 0 0 0 5061 2 0 0 25 0 4 0 386009334 178589696 4796 33554432000 4194304 4964800 140737079450800 18446744073709551615 4320953 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 43601 4796 460 189 0 37950 0
[pid=9316/tid=9318] ppid=9314 vsize=174404 CPUtime=12.68 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 954 0 0 0 1268 0 0 0 25 0 4 0 386009335 178589696 4796 33554432000 4194304 4964800 140737079450800 18446744073709551615 4320939 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=174404 CPUtime=12.55 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 1335 0 0 0 1255 0 0 0 25 0 4 0 386009335 178589696 4796 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670351 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=174404 CPUtime=12.68 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 799 0 0 0 1268 0 0 0 25 0 4 0 386009335 178589696 4796 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.63
Current children cumulated vsize (KiB) 174404

[startup+25.5009 s]
/proc/loadavg: 6.00 7.20 7.68 9/323 9321
/proc/meminfo: memFree=27237344/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=175336 CPUtime=101.69 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 5784 0 0 0 10167 2 0 0 25 0 4 0 386009334 179544064 5655 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670321 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 43834 5655 460 189 0 38183 0
[pid=9316/tid=9318] ppid=9314 vsize=175336 CPUtime=25.47 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 1226 0 0 0 2547 0 0 0 25 0 4 0 386009335 179544064 5655 33554432000 4194304 4964800 140737079450800 18446744073709551615 4652073 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=175336 CPUtime=25.22 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 1680 0 0 0 2522 0 0 0 25 0 4 0 386009335 179544064 5655 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=175336 CPUtime=25.47 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 904 0 0 0 2547 0 0 0 25 0 4 0 386009335 179544064 5655 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.69
Current children cumulated vsize (KiB) 175336

[startup+51.1004 s]
/proc/loadavg: 6.76 7.28 7.70 9/323 9321
/proc/meminfo: memFree=27233320/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=176832 CPUtime=203.83 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 6685 0 0 0 20380 3 0 0 25 0 4 0 386009334 181075968 6556 33554432000 4194304 4964800 140737079450800 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 44208 6556 460 189 0 38557 0
[pid=9316/tid=9318] ppid=9314 vsize=176832 CPUtime=51.07 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 1508 0 0 0 5107 0 0 0 25 0 4 0 386009335 181075968 6556 33554432000 4194304 4964800 140737079450800 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=176832 CPUtime=50.57 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 1992 0 0 0 5056 1 0 0 25 0 4 0 386009335 181075968 6556 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670220 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=176832 CPUtime=51.07 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 1039 0 0 0 5107 0 0 0 25 0 4 0 386009335 181075968 6556 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.83
Current children cumulated vsize (KiB) 176832

[startup+102.312 s]
/proc/loadavg: 7.74 7.46 7.73 9/323 9323
/proc/meminfo: memFree=27226968/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=178228 CPUtime=408.16 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 8020 0 0 0 40811 5 0 0 25 0 4 0 386009334 182505472 7891 33554432000 4194304 4964800 140737079450800 18446744073709551615 4660582 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 44557 7891 460 189 0 38906 0
[pid=9316/tid=9318] ppid=9314 vsize=178228 CPUtime=102.28 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 1931 0 0 0 10228 0 0 0 25 0 4 0 386009335 182505472 7891 33554432000 4194304 4964800 140737079450800 18446744073709551615 4362266 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=178228 CPUtime=101.26 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 2572 0 0 0 10125 1 0 0 25 0 4 0 386009335 182505472 7891 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669376 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=178228 CPUtime=102.28 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 1226 0 0 0 10228 0 0 0 25 0 4 0 386009335 182505472 7891 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.16
Current children cumulated vsize (KiB) 178228

[startup+162.301 s]
/proc/loadavg: 7.98 7.57 7.75 9/323 9324
/proc/meminfo: memFree=27220732/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=179752 CPUtime=647.52 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 9131 0 0 0 64746 6 0 0 25 0 4 0 386009334 184066048 9002 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670415 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 44938 9002 460 189 0 39287 0
[pid=9316/tid=9318] ppid=9314 vsize=179752 CPUtime=162.27 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 2400 0 0 0 16226 1 0 0 25 0 4 0 386009335 184066048 9002 33554432000 4194304 4964800 140737079450800 18446744073709551615 4668797 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=179752 CPUtime=160.66 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 2837 0 0 0 16064 2 0 0 25 0 4 0 386009335 184066048 9002 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=179752 CPUtime=162.27 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 1426 0 0 0 16226 1 0 0 25 0 4 0 386009335 184066048 9002 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 647.52
Current children cumulated vsize (KiB) 179752

[startup+222.3 s]
/proc/loadavg: 8.06 7.66 7.77 9/323 9326
/proc/meminfo: memFree=27218092/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=180684 CPUtime=886.91 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 9844 0 0 0 88683 8 0 0 25 0 4 0 386009334 185020416 9715 33554432000 4194304 4964800 140737079450800 18446744073709551615 4660104 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 45171 9715 460 189 0 39520 0
[pid=9316/tid=9318] ppid=9314 vsize=180684 CPUtime=222.26 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 2814 0 0 0 22225 1 0 0 25 0 4 0 386009335 185020416 9715 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=180684 CPUtime=220.06 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 2938 0 0 0 22004 2 0 0 25 0 4 0 386009335 185020416 9715 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=180684 CPUtime=222.27 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 1487 0 0 0 22226 1 0 0 25 0 4 0 386009335 185020416 9715 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669454 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 886.91
Current children cumulated vsize (KiB) 180684

[startup+282.301 s]

################
# More data... #
################

[pid=9316] ppid=9314 vsize=251888 CPUtime=2802.11 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 15132 0 0 0 280193 18 0 0 25 0 4 0 386009334 257933312 14804 33554432000 4194304 4964800 140737079450800 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 62972 14804 460 189 0 57321 0
[pid=9316/tid=9318] ppid=9314 vsize=251888 CPUtime=702.26 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4425 0 0 0 70222 4 0 0 25 0 4 0 386009335 257933312 14804 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=251888 CPUtime=695.27 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 5181 0 0 0 69522 5 0 0 25 0 4 0 386009335 257933312 14804 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669429 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=251888 CPUtime=702.27 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2266 0 0 0 70224 3 0 0 25 0 4 0 386009335 257933312 14804 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669276 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2802.11
Current children cumulated vsize (KiB) 251888

[startup+762.312 s]
/proc/loadavg: 8.07 8.03 7.91 9/323 9340
/proc/meminfo: memFree=27195484/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=251888 CPUtime=3041.55 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 15425 0 0 0 304137 18 0 0 25 0 4 0 386009334 257933312 15096 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670546 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 62972 15096 460 189 0 57321 0
[pid=9316/tid=9318] ppid=9314 vsize=251888 CPUtime=762.28 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4448 0 0 0 76224 4 0 0 25 0 4 0 386009335 257933312 15096 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670392 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=251888 CPUtime=754.68 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 5439 0 0 0 75462 6 0 0 25 0 4 0 386009335 257933312 15096 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669360 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=251888 CPUtime=762.28 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2277 0 0 0 76225 3 0 0 25 0 4 0 386009335 257933312 15096 33554432000 4194304 4964800 140737079450800 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3041.55
Current children cumulated vsize (KiB) 251888

[startup+822.301 s]
/proc/loadavg: 8.12 8.05 7.92 9/323 9342
/proc/meminfo: memFree=27194076/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=252204 CPUtime=3280.91 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 15835 0 0 0 328072 19 0 0 25 0 4 0 386009334 258256896 15425 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669557 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 63051 15425 460 189 0 57400 0
[pid=9316/tid=9318] ppid=9314 vsize=252204 CPUtime=822.23 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4544 0 0 0 82219 4 0 0 25 0 4 0 386009335 258256896 15425 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669535 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=252204 CPUtime=814.11 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 5673 0 0 0 81405 6 0 0 25 0 4 0 386009335 258256896 15425 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=252204 CPUtime=822.27 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2338 0 0 0 82224 3 0 0 25 0 4 0 386009335 258256896 15425 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3280.91
Current children cumulated vsize (KiB) 252204

[startup+882.3 s]
/proc/loadavg: 8.15 8.07 7.93 9/323 9343
/proc/meminfo: memFree=27192528/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=252204 CPUtime=3520.31 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 16250 0 0 0 352010 21 0 0 25 0 4 0 386009334 258256896 15840 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 63051 15840 460 189 0 57400 0
[pid=9316/tid=9318] ppid=9314 vsize=252204 CPUtime=881.62 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4647 0 0 0 88158 4 0 0 25 0 4 0 386009335 258256896 15840 33554432000 4194304 4964800 140737079450800 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=252204 CPUtime=874.11 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 5913 0 0 0 87405 6 0 0 25 0 4 0 386009335 258256896 15840 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669476 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=252204 CPUtime=882.27 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2399 0 0 0 88223 4 0 0 25 0 4 0 386009335 258256896 15840 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3520.31
Current children cumulated vsize (KiB) 252204

[startup+942.301 s]
/proc/loadavg: 8.13 8.07 7.93 9/323 9345
/proc/meminfo: memFree=27191972/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=252580 CPUtime=3759.71 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 16379 0 0 0 375950 21 0 0 25 0 4 0 386009334 258641920 15969 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670534 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 63145 15969 460 189 0 57494 0
[pid=9316/tid=9318] ppid=9314 vsize=252580 CPUtime=941.03 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4710 0 0 0 94098 5 0 0 25 0 4 0 386009335 258641920 15969 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=252580 CPUtime=934.11 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 5929 0 0 0 93405 6 0 0 25 0 4 0 386009335 258641920 15969 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669503 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=252580 CPUtime=942.27 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2403 0 0 0 94223 4 0 0 25 0 4 0 386009335 258641920 15969 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3759.71
Current children cumulated vsize (KiB) 252580

[startup+1002.3 s]
/proc/loadavg: 8.09 8.07 7.94 9/323 9347
/proc/meminfo: memFree=27190416/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=252916 CPUtime=3999.11 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 16886 0 0 0 399889 22 0 0 25 0 4 0 386009334 258985984 16398 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669523 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 63229 16398 460 189 0 57578 0
[pid=9316/tid=9318] ppid=9314 vsize=252916 CPUtime=1000.43 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4779 0 0 0 100038 5 0 0 25 0 4 0 386009335 258985984 16398 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=252916 CPUtime=994.11 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 6180 0 0 0 99405 6 0 0 25 0 4 0 386009335 258985984 16398 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=252916 CPUtime=1002.27 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2471 0 0 0 100223 4 0 0 25 0 4 0 386009335 258985984 16398 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669376 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3999.11
Current children cumulated vsize (KiB) 252916

[startup+1062.3 s]
/proc/loadavg: 8.08 8.07 7.95 9/323 9348
/proc/meminfo: memFree=27188524/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=253552 CPUtime=4238.51 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 17415 0 0 0 423829 22 0 0 25 0 4 0 386009334 259637248 16883 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670273 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 63388 16883 460 189 0 57737 0
[pid=9316/tid=9318] ppid=9314 vsize=253552 CPUtime=1059.83 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4840 0 0 0 105978 5 0 0 25 0 4 0 386009335 259637248 16883 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=253552 CPUtime=1054.11 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 6544 0 0 0 105405 6 0 0 25 0 4 0 386009335 259637248 16883 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=253552 CPUtime=1062.27 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2490 0 0 0 106223 4 0 0 25 0 4 0 386009335 259637248 16883 33554432000 4194304 4964800 140737079450800 18446744073709551615 4321122 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4238.51
Current children cumulated vsize (KiB) 253552

[startup+1122.3 s]
/proc/loadavg: 8.14 8.08 7.96 9/323 9350
/proc/meminfo: memFree=27188104/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=253552 CPUtime=4477.91 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 17491 0 0 0 447769 22 0 0 25 0 4 0 386009334 259637248 16959 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669350 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 63388 16959 460 189 0 57737 0
[pid=9316/tid=9318] ppid=9314 vsize=253552 CPUtime=1119.22 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4840 0 0 0 111917 5 0 0 25 0 4 0 386009335 259637248 16959 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=253552 CPUtime=1114.11 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 6574 0 0 0 111405 6 0 0 25 0 4 0 386009335 259637248 16959 33554432000 4194304 4964800 140737079450800 18446744073709551615 4668662 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=253552 CPUtime=1122.27 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2491 0 0 0 112223 4 0 0 25 0 4 0 386009335 259637248 16959 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670351 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4477.91
Current children cumulated vsize (KiB) 253552

[startup+1182.3 s]
/proc/loadavg: 8.15 8.10 7.97 9/323 9351
/proc/meminfo: memFree=27188056/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=253696 CPUtime=4717.33 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 17528 0 0 0 471711 22 0 0 25 0 4 0 386009334 259784704 16996 33554432000 4194304 4964800 140737079450800 18446744073709551615 4668987 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 63424 16996 460 189 0 57773 0
[pid=9316/tid=9318] ppid=9314 vsize=253696 CPUtime=1178.63 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4840 0 0 0 117858 5 0 0 25 0 4 0 386009335 259784704 16996 33554432000 4194304 4964800 140737079450800 18446744073709551615 4660435 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=253696 CPUtime=1174.11 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 6575 0 0 0 117405 6 0 0 25 0 4 0 386009335 259784704 16996 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=253696 CPUtime=1182.27 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2527 0 0 0 118223 4 0 0 25 0 4 0 386009335 259784704 16996 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4717.33
Current children cumulated vsize (KiB) 253696



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.1 s]
/proc/loadavg: 7.85 8.04 7.95 5/315 9370
/proc/meminfo: memFree=27200572/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=253848 CPUtime=4800.34 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 17587 0 0 0 480012 22 0 0 25 0 4 0 386009334 259940352 17055 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670313 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 63462 17055 460 189 0 57811 0
[pid=9316/tid=9318] ppid=9314 vsize=253848 CPUtime=1199.22 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4841 0 0 0 119917 5 0 0 25 0 4 0 386009335 259940352 17055 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=253848 CPUtime=1194.92 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 6575 0 0 0 119486 6 0 0 25 0 4 0 386009335 259940352 17055 33554432000 4194304 4964800 140737079450800 18446744073709551615 4668748 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=253848 CPUtime=1203.08 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2550 0 0 0 120304 4 0 0 25 0 4 0 386009335 259940352 17055 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 253848

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.1 s]
/proc/loadavg: 7.85 8.04 7.95 5/315 9370
/proc/meminfo: memFree=27200572/32951124 swapFree=46575252/67111528
[pid=9316] ppid=9314 vsize=253848 CPUtime=4800.34 cores=1,3,5,7
/proc/9316/stat : 9316 (claspmt) R 9314 9316 8545 0 -1 4202496 17587 0 0 0 480012 22 0 0 25 0 4 0 386009334 259940352 17055 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670313 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/9316/statm: 63462 17055 460 189 0 57811 0
[pid=9316/tid=9318] ppid=9314 vsize=253848 CPUtime=1199.22 cores=1,3,5,7
/proc/9316/task/9318/stat : 9318 (claspmt) R 9314 9316 8545 0 -1 4202560 4841 0 0 0 119917 5 0 0 25 0 4 0 386009335 259940352 17055 33554432000 4194304 4964800 140737079450800 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=9316/tid=9319] ppid=9314 vsize=253848 CPUtime=1194.92 cores=1,3,5,7
/proc/9316/task/9319/stat : 9319 (claspmt) R 9314 9316 8545 0 -1 4202560 6575 0 0 0 119486 6 0 0 25 0 4 0 386009335 259940352 17055 33554432000 4194304 4964800 140737079450800 18446744073709551615 4668748 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=9316/tid=9320] ppid=9314 vsize=253848 CPUtime=1203.08 cores=1,3,5,7
/proc/9316/task/9320/stat : 9320 (claspmt) R 9314 9316 8545 0 -1 4202560 2550 0 0 0 120304 4 0 0 25 0 4 0 386009335 259940352 17055 33554432000 4194304 4964800 140737079450800 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.34
Current children cumulated vsize (KiB) 253848

Child status: 0
Real time (s): 1203.13
CPU time (s): 4800.4
CPU user time (s): 4800.16
CPU system time (s): 0.233964
CPU usage (%): 398.993
Max. virtual memory (cumulated for all children) (KiB): 253848

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4800.16
system time used= 0.233964
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17599
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17519
involuntary context switches= 35213

runsolver used 3.47747 second user time and 8.5657 second system time

The end

Launcher Data 

Begin job on node107 at 2011-05-15 02:09:41
IDJOB=3373534
IDBENCH=20468
IDSOLVER=1853
FILE ID=node107/3373534-1305418181
RUNJOBID= node107-1305418178-9240
PBS_JOBID= 13324536
Free space on /tmp= 73436 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT07/industrial/jarvisalo/eq.atree.braun.12.unsat.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373534-1305418181/watcher-3373534-1305418181 -o /tmp/evaluation-result-3373534-1305418181/solver-3373534-1305418181 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373534-1305418181.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8d6acb9f6b752ad76c024133f5175c69
RANDOM SEED=1740669338

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27263432 kB
Buffers:        139984 kB
Cached:         979908 kB
SwapCached:       9832 kB
Active:        5261392 kB
Inactive:       147088 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27263432 kB
SwapTotal:    67111528 kB
SwapFree:     46575252 kB
Dirty:            2060 kB
Writeback:           0 kB
AnonPages:     4285572 kB
Mapped:          19844 kB
Slab:           147492 kB
PageTables:      68960 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 64953172 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73436 MiB
End job on node107 at 2011-05-15 02:29:46