Trace number 3372994

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.27 1203.72

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m32-q369.75-n30-p30-s25693430.cnf
MD5SUM08b4f1e095a7a4b98cb40c2c00e78d45
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.477926
Satisfiable
(Un)Satisfiability was proved
Number of variables952
Number of clauses84809
Sum of the clauses size170510
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 284779
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 530

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...432892/instance-3372994-1305432892.cnf
0.19/0.27	c Solving...
4800.12/1203.61	
4800.12/1203.61	*** INTERRUPTED! ***
4800.12/1203.61	*** Shutting down threads...
4800.12/1203.71	s UNKNOWN
4800.12/1203.71	
4800.12/1203.71	c INTERRUPTED   : 1
4800.12/1203.71	c Models        : 0+    
4800.12/1203.71	c Time          : 1203.618s (Solving: 1203.35s 1st Model: 0.00s Unsat: 0.00s)
4800.12/1203.71	c CPU Time      : 4800.170s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372994-1305432892/watcher-3372994-1305432892 -o /tmp/evaluation-result-3372994-1305432892/solver-3372994-1305432892 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3372994-1305432892.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.65 6.96 7.57 2/333 10125
/proc/meminfo: memFree=17498960/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=21676 CPUtime=0 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 711 0 0 0 0 0 0 0 22 0 1 0 654890105 22196224 634 33554432000 4194304 4964800 140734981662960 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10125/statm: 5419 635 385 189 0 293 0

[startup+0.0890911 s]
/proc/loadavg: 4.65 6.96 7.57 2/333 10125
/proc/meminfo: memFree=17498960/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=26200 CPUtime=0.08 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 2141 0 0 0 8 0 0 0 22 0 1 0 654890105 26828800 1764 33554432000 4194304 4964800 140734981662960 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10125/statm: 6550 1764 398 189 0 1424 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 26200

[startup+0.101076 s]
/proc/loadavg: 4.65 6.96 7.57 2/333 10125
/proc/meminfo: memFree=17498960/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=26200 CPUtime=0.09 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 2141 0 0 0 9 0 0 0 22 0 1 0 654890105 26828800 1764 33554432000 4194304 4964800 140734981662960 18446744073709551615 4607536 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10125/statm: 6550 1764 398 189 0 1424 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26200

[startup+0.301008 s]
/proc/loadavg: 4.65 6.96 7.57 2/333 10125
/proc/meminfo: memFree=17498960/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=172812 CPUtime=0.36 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 2772 0 0 0 35 1 0 0 25 0 4 0 654890105 176959488 2221 33554432000 4194304 4964800 140734981662960 18446744073709551615 4627204 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 43203 2221 457 189 0 37552 0
Current children cumulated CPU time (s) 0.36
Current children cumulated vsize (KiB) 172812

[startup+1.22285 s]
/proc/loadavg: 4.65 6.96 7.57 2/333 10125
/proc/meminfo: memFree=17498960/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=243240 CPUtime=4.03 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 9182 0 0 0 389 14 0 0 19 0 4 0 654890105 249077760 8631 33554432000 4194304 4964800 140734981662960 18446744073709551615 4660185 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 60810 8631 458 189 0 55159 0
Current children cumulated CPU time (s) 4.03
Current children cumulated vsize (KiB) 243240

[startup+1.5008 s]
/proc/loadavg: 4.65 6.96 7.57 2/333 10125
/proc/meminfo: memFree=17498960/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=244712 CPUtime=5.14 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 10493 0 0 0 499 15 0 0 19 0 4 0 654890105 250585088 9942 33554432000 4194304 4964800 140734981662960 18446744073709551615 4341888 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 61178 9942 458 189 0 55527 0
Current children cumulated CPU time (s) 5.14
Current children cumulated vsize (KiB) 244712

[startup+3.10051 s]
/proc/loadavg: 4.65 6.96 7.57 6/340 10135
/proc/meminfo: memFree=17406424/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=248540 CPUtime=11.52 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 14891 0 0 0 1129 23 0 0 23 0 4 0 654890105 254504960 14340 33554432000 4194304 4964800 140734981662960 18446744073709551615 4332616 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 62135 14340 460 189 0 56484 0
[pid=10125/tid=10133] ppid=10123 vsize=248540 CPUtime=2.81 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 3148 0 0 0 280 1 0 0 25 0 4 0 654890133 254504960 14340 33554432000 4194304 4964800 140734981662960 18446744073709551615 4324761 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=248540 CPUtime=2.81 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 2867 0 0 0 275 6 0 0 23 0 4 0 654890133 254504960 14340 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=248540 CPUtime=2.81 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 2686 0 0 0 275 6 0 0 22 0 4 0 654890133 254504960 14340 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.52
Current children cumulated vsize (KiB) 248540

[startup+6.30092 s]
/proc/loadavg: 4.67 6.92 7.56 9/343 10138
/proc/meminfo: memFree=17351640/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=253028 CPUtime=24.28 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 20648 0 0 0 2400 28 0 0 25 0 4 0 654890105 259100672 20097 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670321 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 63257 20097 460 189 0 57606 0
[pid=10125/tid=10133] ppid=10123 vsize=253028 CPUtime=6.01 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 4670 0 0 0 600 1 0 0 25 0 4 0 654890133 259100672 20097 33554432000 4194304 4964800 140734981662960 18446744073709551615 4342887 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=253028 CPUtime=6.01 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 3510 0 0 0 594 7 0 0 25 0 4 0 654890133 259100672 20097 33554432000 4194304 4964800 140734981662960 18446744073709551615 4332009 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=253028 CPUtime=6.01 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 4594 0 0 0 592 9 0 0 25 0 4 0 654890133 259100672 20097 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320963 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.28
Current children cumulated vsize (KiB) 253028

[startup+12.7128 s]
/proc/loadavg: 4.94 6.94 7.56 9/343 10138
/proc/meminfo: memFree=17252052/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=261032 CPUtime=49.86 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 26852 0 0 0 4955 31 0 0 25 0 4 0 654890105 267296768 26297 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320944 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 65258 26297 460 189 0 59607 0
[pid=10125/tid=10133] ppid=10123 vsize=261032 CPUtime=12.42 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 6775 0 0 0 1240 2 0 0 25 0 4 0 654890133 267296768 26297 33554432000 4194304 4964800 140734981662960 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=261032 CPUtime=12.41 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 5590 0 0 0 1234 7 0 0 25 0 4 0 654890133 267296768 26297 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=261032 CPUtime=12.43 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 5735 0 0 0 1233 10 0 0 25 0 4 0 654890133 267296768 26297 33554432000 4194304 4964800 140734981662960 18446744073709551615 4363450 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.86
Current children cumulated vsize (KiB) 261032

[startup+25.5005 s]
/proc/loadavg: 5.62 6.99 7.57 9/343 10139
/proc/meminfo: memFree=17126320/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=268376 CPUtime=100.87 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 34680 0 0 0 10051 36 0 0 25 0 4 0 654890105 274817024 34125 33554432000 4194304 4964800 140734981662960 18446744073709551615 4627470 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 67094 34125 460 189 0 61443 0
[pid=10125/tid=10133] ppid=10123 vsize=268376 CPUtime=25.2 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 10615 0 0 0 2516 4 0 0 25 0 4 0 654890133 274817024 34125 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=268376 CPUtime=25.2 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 6311 0 0 0 2513 7 0 0 25 0 4 0 654890133 274817024 34125 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=268376 CPUtime=25.22 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 8102 0 0 0 2510 12 0 0 25 0 4 0 654890133 274817024 34125 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 100.87
Current children cumulated vsize (KiB) 268376

[startup+51.101 s]
/proc/loadavg: 6.51 7.09 7.58 9/343 10139
/proc/meminfo: memFree=16939736/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=285160 CPUtime=203 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 49082 0 0 0 20258 42 0 0 25 0 4 0 654890105 292003840 48520 33554432000 4194304 4964800 140734981662960 18446744073709551615 4342228 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 71290 48520 460 189 0 65639 0
[pid=10125/tid=10133] ppid=10123 vsize=285160 CPUtime=50.81 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 15147 0 0 0 5076 5 0 0 25 0 4 0 654890133 292003840 48532 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=285160 CPUtime=50.82 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 8224 0 0 0 5074 8 0 0 25 0 4 0 654890133 292003840 48532 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=285160 CPUtime=50.82 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 14422 0 0 0 5067 15 0 0 25 0 4 0 654890133 292003840 48532 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203
Current children cumulated vsize (KiB) 285160

[startup+102.301 s]
/proc/loadavg: 7.35 7.23 7.60 9/343 10141
/proc/meminfo: memFree=16803296/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=431316 CPUtime=407.2 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 65667 0 0 0 40666 54 0 0 25 0 4 0 654890105 441667584 65080 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 107829 65080 460 189 0 102178 0
[pid=10125/tid=10133] ppid=10123 vsize=431316 CPUtime=102 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 19130 0 0 0 10192 8 0 0 25 0 4 0 654890133 441667584 65080 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=431316 CPUtime=102.01 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 10984 0 0 0 10192 9 0 0 25 0 4 0 654890133 441667584 65080 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=431316 CPUtime=102 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 19076 0 0 0 10181 19 0 0 25 0 4 0 654890133 441667584 65080 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.2
Current children cumulated vsize (KiB) 431316

[startup+162.312 s]
/proc/loadavg: 7.91 7.41 7.64 9/343 10142
/proc/meminfo: memFree=16582740/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=506744 CPUtime=646.56 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 83258 0 0 0 64590 66 0 0 25 0 4 0 654890105 518905856 82538 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320976 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 126686 82538 460 189 0 121035 0
[pid=10125/tid=10133] ppid=10123 vsize=506744 CPUtime=161.99 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 27204 0 0 0 16185 14 0 0 25 0 4 0 654890133 518905856 82538 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=506744 CPUtime=162.02 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 12954 0 0 0 16192 10 0 0 25 0 4 0 654890133 518905856 82538 33554432000 4194304 4964800 140734981662960 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=506744 CPUtime=162 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 26610 0 0 0 16176 24 0 0 25 0 4 0 654890133 518905856 82538 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 646.56
Current children cumulated vsize (KiB) 506744

[startup+222.301 s]
/proc/loadavg: 8.04 7.54 7.67 9/343 10144
/proc/meminfo: memFree=16466852/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=541048 CPUtime=885.85 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 96729 0 0 0 88508 77 0 0 25 0 4 0 654890105 554033152 95668 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 135262 95668 460 189 0 129611 0
[pid=10125/tid=10133] ppid=10123 vsize=541048 CPUtime=221.97 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 31630 0 0 0 22180 17 0 0 25 0 4 0 654890133 554033152 95668 33554432000 4194304 4964800 140734981662960 18446744073709551615 4653491 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=541048 CPUtime=222.01 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 14033 0 0 0 22190 11 0 0 25 0 4 0 654890133 554033152 95668 33554432000 4194304 4964800 140734981662960 18446744073709551615 4321020 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=541048 CPUtime=221.97 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 34573 0 0 0 22167 30 0 0 25 0 4 0 654890133 554033152 95668 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 885.85
Current children cumulated vsize (KiB) 541048

[startup+282.301 s]
/proc/loadavg: 8.16 7.67 7.70 9/343 10146
/proc/meminfo: memFree=16241700/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=611252 CPUtime=1125.18 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 117251 0 0 0 112425 93 0 0 25 0 4 0 654890105 625922048 116098 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 152813 116098 460 189 0 147162 0
[pid=10125/tid=10133] ppid=10123 vsize=611252 CPUtime=281.97 cores=0,2,4,6

################
# More data... #
################

[pid=10125] ppid=10123 vsize=758540 CPUtime=2561.15 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 150704 0 0 0 255988 127 0 0 25 0 4 0 654890105 776744960 148719 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 189635 148719 460 189 0 183984 0
[pid=10125/tid=10133] ppid=10123 vsize=758540 CPUtime=641.93 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 47967 0 0 0 64161 32 0 0 25 0 4 0 654890133 776744960 148719 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=758540 CPUtime=642.01 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 19548 0 0 0 64188 13 0 0 25 0 4 0 654890133 776744960 148719 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=758540 CPUtime=641.89 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 51360 0 0 0 64138 51 0 0 25 0 4 0 654890133 776744960 148719 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2561.15
Current children cumulated vsize (KiB) 758540

[startup+702.301 s]
/proc/loadavg: 8.17 8.02 7.85 9/343 10157
/proc/meminfo: memFree=15783952/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=758540 CPUtime=2800.51 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 157692 0 0 0 279913 138 0 0 25 0 4 0 654890105 776744960 155707 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 189635 155707 460 189 0 183984 0
[pid=10125/tid=10133] ppid=10123 vsize=758540 CPUtime=701.94 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 47998 0 0 0 70161 33 0 0 25 0 4 0 654890133 776744960 155707 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=758540 CPUtime=702.03 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 19887 0 0 0 70190 13 0 0 25 0 4 0 654890133 776744960 155707 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=758540 CPUtime=701.9 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 57975 0 0 0 70129 61 0 0 25 0 4 0 654890133 776744960 155707 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2800.51
Current children cumulated vsize (KiB) 758540

[startup+762.3 s]
/proc/loadavg: 8.16 8.04 7.86 9/343 10158
/proc/meminfo: memFree=15656768/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=758540 CPUtime=3039.82 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 163175 0 0 0 303838 144 0 0 25 0 4 0 654890105 776744960 161190 33554432000 4194304 4964800 140734981662960 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 189635 161190 460 189 0 183984 0
[pid=10125/tid=10133] ppid=10123 vsize=758540 CPUtime=761.93 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 51269 0 0 0 76155 38 0 0 25 0 4 0 654890133 776744960 161190 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=758540 CPUtime=762.02 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 20486 0 0 0 76188 14 0 0 25 0 4 0 654890133 776744960 161190 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=758540 CPUtime=761.87 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 59111 0 0 0 76125 62 0 0 25 0 4 0 654890133 776744960 161190 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3039.82
Current children cumulated vsize (KiB) 758540

[startup+822.313 s]
/proc/loadavg: 8.15 8.06 7.88 9/343 10160
/proc/meminfo: memFree=15626316/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=763836 CPUtime=3279.2 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 169924 0 0 0 327768 152 0 0 25 0 4 0 654890105 782168064 167533 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670534 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 190959 167533 460 189 0 185308 0
[pid=10125/tid=10133] ppid=10123 vsize=763836 CPUtime=821.93 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 51962 0 0 0 82154 39 0 0 25 0 4 0 654890133 782168064 167533 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=763836 CPUtime=822.03 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 21724 0 0 0 82189 14 0 0 25 0 4 0 654890133 782168064 167533 33554432000 4194304 4964800 140734981662960 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=763836 CPUtime=821.87 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 63307 0 0 0 82120 67 0 0 25 0 4 0 654890133 782168064 167533 33554432000 4194304 4964800 140734981662960 18446744073709551615 4627259 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3279.2
Current children cumulated vsize (KiB) 763836

[startup+882.301 s]
/proc/loadavg: 8.14 8.08 7.89 9/343 10161
/proc/meminfo: memFree=15598832/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=788620 CPUtime=3518.49 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 176487 0 0 0 351694 155 0 0 25 0 4 0 654890105 807546880 174096 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320970 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 197155 174096 460 189 0 191504 0
[pid=10125/tid=10133] ppid=10123 vsize=788620 CPUtime=881.92 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 52160 0 0 0 88153 39 0 0 25 0 4 0 654890133 807546880 174096 33554432000 4194304 4964800 140734981662960 18446744073709551615 270612771873 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=788620 CPUtime=882.02 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 21926 0 0 0 88188 14 0 0 25 0 4 0 654890133 807546880 174096 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=788620 CPUtime=881.86 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 69469 0 0 0 88116 70 0 0 25 0 4 0 654890133 807546880 174096 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3518.49
Current children cumulated vsize (KiB) 788620

[startup+942.3 s]
/proc/loadavg: 8.13 8.09 7.91 9/343 10163
/proc/meminfo: memFree=15565920/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=795876 CPUtime=3757.81 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 182820 0 0 0 375621 160 0 0 25 0 4 0 654890105 814977024 180272 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 198969 180272 460 189 0 193318 0
[pid=10125/tid=10133] ppid=10123 vsize=795876 CPUtime=941.9 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 56804 0 0 0 94147 43 0 0 25 0 4 0 654890133 814977024 180272 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=795876 CPUtime=942.02 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 22623 0 0 0 94188 14 0 0 25 0 4 0 654890133 814977024 180272 33554432000 4194304 4964800 140734981662960 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=795876 CPUtime=941.84 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 70459 0 0 0 94114 70 0 0 25 0 4 0 654890133 814977024 180272 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3757.81
Current children cumulated vsize (KiB) 795876

[startup+1002.3 s]
/proc/loadavg: 8.19 8.13 7.93 9/343 10165
/proc/meminfo: memFree=15523128/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=795876 CPUtime=3997.15 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 184411 0 0 0 399553 162 0 0 25 0 4 0 654890105 814977024 181707 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 198969 181707 460 189 0 193318 0
[pid=10125/tid=10133] ppid=10123 vsize=795876 CPUtime=1001.91 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 58149 0 0 0 100146 45 0 0 25 0 4 0 654890133 814977024 181707 33554432000 4194304 4964800 140734981662960 18446744073709551615 4321054 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=795876 CPUtime=1002.03 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 22860 0 0 0 100188 15 0 0 25 0 4 0 654890133 814977024 181707 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670330 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=795876 CPUtime=1001.83 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 70462 0 0 0 100113 70 0 0 25 0 4 0 654890133 814977024 181707 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3997.15
Current children cumulated vsize (KiB) 795876

[startup+1062.3 s]
/proc/loadavg: 8.24 8.15 7.95 9/343 10166
/proc/meminfo: memFree=15467936/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=861412 CPUtime=4236.49 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 196642 0 0 0 423473 176 0 0 25 0 4 0 654890105 882085888 193783 33554432000 4194304 4964800 140734981662960 18446744073709551615 4342144 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 215353 193783 460 189 0 209702 0
[pid=10125/tid=10133] ppid=10123 vsize=861412 CPUtime=1061.9 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 69749 0 0 0 106132 58 0 0 25 0 4 0 654890133 882085888 193783 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=861412 CPUtime=1062.03 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 23465 0 0 0 106188 15 0 0 25 0 4 0 654890133 882085888 193783 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=861412 CPUtime=1061.82 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 70487 0 0 0 106112 70 0 0 25 0 4 0 654890133 882085888 193783 33554432000 4194304 4964800 140734981662960 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4236.49
Current children cumulated vsize (KiB) 861412

[startup+1122.3 s]
/proc/loadavg: 8.16 8.13 7.95 9/343 10168
/proc/meminfo: memFree=15463336/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=861412 CPUtime=4475.82 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 197406 0 0 0 447406 176 0 0 25 0 4 0 654890105 882085888 194547 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670295 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10125/statm: 215353 194547 460 189 0 209702 0
[pid=10125/tid=10133] ppid=10123 vsize=861412 CPUtime=1121.9 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 69768 0 0 0 112132 58 0 0 25 0 4 0 654890133 882085888 194547 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=861412 CPUtime=1122.03 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 24208 0 0 0 112188 15 0 0 25 0 4 0 654890133 882085888 194547 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=861412 CPUtime=1121.8 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 70487 0 0 0 112110 70 0 0 25 0 4 0 654890133 882085888 194547 33554432000 4194304 4964800 140734981662960 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4475.82
Current children cumulated vsize (KiB) 861412

[startup+1182.3 s]
/proc/loadavg: 8.12 8.12 7.96 9/343 10170
/proc/meminfo: memFree=15461080/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=861412 CPUtime=4715.13 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 197754 0 0 0 471336 177 0 0 25 0 4 0 654890105 882085888 194739 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/10125/statm: 215353 194739 460 189 0 209702 0
[pid=10125/tid=10133] ppid=10123 vsize=861412 CPUtime=1181.88 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 70083 0 0 0 118130 58 0 0 25 0 4 0 654890133 882085888 194739 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=861412 CPUtime=1181.45 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 24227 0 0 0 118130 15 0 0 25 0 4 0 654890133 882085888 194739 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=861412 CPUtime=1181.79 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 70501 0 0 0 118109 70 0 0 25 0 4 0 654890133 882085888 194739 33554432000 4194304 4964800 140734981662960 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4715.13
Current children cumulated vsize (KiB) 861412



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.6 s]
/proc/loadavg: 8.09 8.11 7.96 9/343 10170
/proc/meminfo: memFree=15461080/32951124 swapFree=67056804/67111528
[pid=10125] ppid=10123 vsize=861412 CPUtime=4800.12 cores=0,2,4,6
/proc/10125/stat : 10125 (claspmt) R 10123 10125 563 0 -1 4202496 197773 0 0 0 479835 177 0 0 25 0 4 0 654890105 882085888 194758 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320955 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/10125/statm: 215353 194758 460 189 0 209702 0
[pid=10125/tid=10133] ppid=10123 vsize=861412 CPUtime=1203.2 cores=0,2,4,6
/proc/10125/task/10133/stat : 10133 (claspmt) R 10123 10125 563 0 -1 4202560 70087 0 0 0 120262 58 0 0 25 0 4 0 654890133 882085888 194758 33554432000 4194304 4964800 140734981662960 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10125/tid=10134] ppid=10123 vsize=861412 CPUtime=1202.52 cores=0,2,4,6
/proc/10125/task/10134/stat : 10134 (claspmt) R 10123 10125 563 0 -1 4202560 24228 0 0 0 120237 15 0 0 25 0 4 0 654890133 882085888 194758 33554432000 4194304 4964800 140734981662960 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=10125/tid=10135] ppid=10123 vsize=861412 CPUtime=1203.11 cores=0,2,4,6
/proc/10125/task/10135/stat : 10135 (claspmt) R 10123 10125 563 0 -1 4202560 70515 0 0 0 120241 70 0 0 25 0 4 0 654890133 882085888 194758 33554432000 4194304 4964800 140734981662960 18446744073709551615 4378965 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.12
Current children cumulated vsize (KiB) 861412

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1203.72
CPU time (s): 4800.27
CPU user time (s): 4798.46
CPU system time (s): 1.80672
CPU usage (%): 398.787
Max. virtual memory (cumulated for all children) (KiB): 861412

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.46
system time used= 1.80672
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 197785
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11657
involuntary context switches= 24197

runsolver used 3.77443 second user time and 9.36558 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-15 06:14:52
IDJOB=3372994
IDBENCH=88227
IDSOLVER=1853
FILE ID=node108/3372994-1305432892
RUNJOBID= node108-1305432892-10111
PBS_JOBID= 13324595
Free space on /tmp= 73576 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m32-q369.75-n30-p30-s25693430.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372994-1305432892/watcher-3372994-1305432892 -o /tmp/evaluation-result-3372994-1305432892/solver-3372994-1305432892 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3372994-1305432892.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 08b4f1e095a7a4b98cb40c2c00e78d45
RANDOM SEED=1669690541

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17499488 kB
Buffers:        291140 kB
Cached:        4743384 kB
SwapCached:       8700 kB
Active:       11066996 kB
Inactive:      4074428 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17499488 kB
SwapTotal:    67111528 kB
SwapFree:     67056804 kB
Dirty:            2724 kB
Writeback:           0 kB
AnonPages:    10104188 kB
Mapped:          26364 kB
Slab:           207852 kB
PageTables:      38016 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 52252348 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73568 MiB
End job on node108 at 2011-05-15 06:34:57