Trace number 3373585

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.65 1203.52

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf
MD5SUM3c5c73741ba21d5f39c7f436ba834743
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables95456
Number of clauses483561
Sum of the clauses size1149911
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2477300
Number of clauses of size 31500
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 54550

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...420624/instance-3373585-1305420624.cnf
0.29/0.39	c Solving...
4800.30/1203.21	
4800.30/1203.21	*** INTERRUPTED! ***
4800.30/1203.21	*** Shutting down threads...
4800.63/1203.51	s UNKNOWN
4800.63/1203.51	
4800.63/1203.51	c INTERRUPTED   : 1
4800.63/1203.51	c Models        : 0+    
4800.63/1203.51	c Time          : 1203.213s (Solving: 1202.82s 1st Model: 0.00s Unsat: 0.00s)
4800.63/1203.51	c CPU Time      : 4800.330s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373585-1305420624/watcher-3373585-1305420624 -o /tmp/evaluation-result-3373585-1305420624/solver-3373585-1305420624 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373585-1305420624.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.13 7.84 7.93 6/294 29009
/proc/meminfo: memFree=23403696/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=32964 CPUtime=0 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 2035 0 0 0 0 0 0 0 21 0 1 0 634478362 33755136 1965 33554432000 4194304 4964800 140734244336976 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/29009/statm: 8241 1974 375 189 0 3115 0

[startup+0.10717 s]
/proc/loadavg: 7.13 7.84 7.93 6/294 29009
/proc/meminfo: memFree=23403696/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=47524 CPUtime=0.09 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 8552 0 0 0 9 0 0 0 22 0 1 0 634478362 48664576 6993 33554432000 4194304 4964800 140734244336976 18446744073709551615 220815897285 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/29009/statm: 11881 6994 388 189 0 6755 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 47524

[startup+0.201146 s]
/proc/loadavg: 7.13 7.84 7.93 6/294 29009
/proc/meminfo: memFree=23403696/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=63268 CPUtime=0.19 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 13667 0 0 0 18 1 0 0 22 0 1 0 634478362 64786432 10770 33554432000 4194304 4964800 140734244336976 18446744073709551615 4607641 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/29009/statm: 15817 10770 402 189 0 10691 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 63268

[startup+0.301126 s]
/proc/loadavg: 7.13 7.84 7.93 6/294 29009
/proc/meminfo: memFree=23403696/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=63268 CPUtime=0.29 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 13668 0 0 0 28 1 0 0 22 0 1 0 634478362 64786432 10771 33554432000 4194304 4964800 140734244336976 18446744073709551615 4612197 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/29009/statm: 15817 10771 403 189 0 10691 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 63268

[startup+0.701016 s]
/proc/loadavg: 7.13 7.84 7.93 6/294 29009
/proc/meminfo: memFree=23403696/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=285584 CPUtime=1.56 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 24251 0 0 0 152 4 0 0 24 0 4 0 634478362 292438016 17497 33554432000 4194304 4964800 140734244336976 18446744073709551615 4338788 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 71396 17498 458 189 0 65745 0
Current children cumulated CPU time (s) 1.56
Current children cumulated vsize (KiB) 285584

[startup+1.50087 s]
/proc/loadavg: 7.13 7.84 7.93 10/298 29013
/proc/meminfo: memFree=23304224/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=285584 CPUtime=4.75 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 29046 0 0 0 469 6 0 0 25 0 4 0 634478362 292438016 22292 33554432000 4194304 4964800 140734244336976 18446744073709551615 4370224 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 71396 22292 458 189 0 65745 0
[pid=29009/tid=29011] ppid=29007 vsize=285584 CPUtime=1.09 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 3293 0 0 0 108 1 0 0 19 0 4 0 634478402 292438016 22292 33554432000 4194304 4964800 140734244336976 18446744073709551615 4669038 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=285584 CPUtime=1.09 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 5525 0 0 0 108 1 0 0 25 0 4 0 634478402 292438016 22292 33554432000 4194304 4964800 140734244336976 18446744073709551615 220815897633 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=285584 CPUtime=1.08 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 5532 0 0 0 107 1 0 0 25 0 4 0 634478402 292438016 22292 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670077 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.75
Current children cumulated vsize (KiB) 285584

[startup+3.10057 s]
/proc/loadavg: 7.20 7.85 7.93 9/298 29013
/proc/meminfo: memFree=23258664/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=289832 CPUtime=11.14 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 38850 0 0 0 1104 10 0 0 25 0 4 0 634478362 296787968 32097 33554432000 4194304 4964800 140734244336976 18446744073709551615 220815897633 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 72458 32098 458 189 0 66807 0
[pid=29009/tid=29011] ppid=29007 vsize=289832 CPUtime=2.69 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 4450 0 0 0 268 1 0 0 22 0 4 0 634478402 296787968 32098 33554432000 4194304 4964800 140734244336976 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=289832 CPUtime=2.69 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 8808 0 0 0 266 3 0 0 25 0 4 0 634478402 296787968 32098 33554432000 4194304 4964800 140734244336976 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=289832 CPUtime=2.67 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 8897 0 0 0 265 2 0 0 25 0 4 0 634478402 296787968 32098 33554432000 4194304 4964800 140734244336976 18446744073709551615 4342939 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.14
Current children cumulated vsize (KiB) 289832

[startup+6.30098 s]
/proc/loadavg: 7.20 7.85 7.93 9/298 29013
/proc/meminfo: memFree=23137888/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=299656 CPUtime=23.9 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 57897 0 0 0 2373 17 0 0 25 0 4 0 634478362 306847744 51143 33554432000 4194304 4964800 140734244336976 18446744073709551615 4332465 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 74914 51146 458 189 0 69263 0
[pid=29009/tid=29011] ppid=29007 vsize=299656 CPUtime=5.88 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 7066 0 0 0 587 1 0 0 25 0 4 0 634478402 306847744 51146 33554432000 4194304 4964800 140734244336976 18446744073709551615 4653222 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=299656 CPUtime=5.89 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 13477 0 0 0 584 5 0 0 25 0 4 0 634478402 306847744 51146 33554432000 4194304 4964800 140734244336976 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=299656 CPUtime=5.84 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 14900 0 0 0 580 4 0 0 25 0 4 0 634478402 306847744 51146 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.9
Current children cumulated vsize (KiB) 299656

[startup+12.7008 s]
/proc/loadavg: 7.32 7.85 7.93 9/298 29013
/proc/meminfo: memFree=22954992/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=444836 CPUtime=49.45 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 82134 0 0 0 4917 28 0 0 25 0 4 0 634478362 455512064 75380 33554432000 4194304 4964800 140734244336976 18446744073709551615 4632486 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 111209 75380 460 189 0 105558 0
[pid=29009/tid=29011] ppid=29007 vsize=444836 CPUtime=12.28 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 11773 0 0 0 1225 3 0 0 25 0 4 0 634478402 455512064 75380 33554432000 4194304 4964800 140734244336976 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=444836 CPUtime=12.29 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 17754 0 0 0 1223 6 0 0 25 0 4 0 634478402 455512064 75380 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670371 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=444836 CPUtime=12.18 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 22044 0 0 0 1210 8 0 0 25 0 4 0 634478402 455512064 75380 33554432000 4194304 4964800 140734244336976 18446744073709551615 4653186 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.45
Current children cumulated vsize (KiB) 444836

[startup+25.5004 s]
/proc/loadavg: 7.50 7.87 7.93 9/298 29013
/proc/meminfo: memFree=22583172/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=535564 CPUtime=100.51 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 118304 0 0 0 10009 42 0 0 25 0 4 0 634478362 548417536 111550 33554432000 4194304 4964800 140734244336976 18446744073709551615 4668900 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 133891 111550 460 189 0 128240 0
[pid=29009/tid=29011] ppid=29007 vsize=535564 CPUtime=25.08 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 22567 0 0 0 2499 9 0 0 25 0 4 0 634478402 548417536 111550 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=535564 CPUtime=25.09 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 26316 0 0 0 2501 8 0 0 25 0 4 0 634478402 548417536 111550 33554432000 4194304 4964800 140734244336976 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=535564 CPUtime=24.85 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 25747 0 0 0 2475 10 0 0 25 0 4 0 634478402 548417536 111550 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670140 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.51
Current children cumulated vsize (KiB) 535564

[startup+51.1007 s]
/proc/loadavg: 7.73 7.90 7.94 9/298 29014
/proc/meminfo: memFree=22158192/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=740784 CPUtime=202.69 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 167382 0 0 0 20200 69 0 0 25 0 4 0 634478362 758562816 160628 33554432000 4194304 4964800 140734244336976 18446744073709551615 4653186 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 185196 160629 460 189 0 179545 0
[pid=29009/tid=29011] ppid=29007 vsize=740784 CPUtime=50.68 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 39931 0 0 0 5049 19 0 0 25 0 4 0 634478402 758562816 160629 33554432000 4194304 4964800 140734244336976 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=740784 CPUtime=50.68 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 44389 0 0 0 5051 17 0 0 25 0 4 0 634478402 758562816 160629 33554432000 4194304 4964800 140734244336976 18446744073709551615 4647774 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=740784 CPUtime=50.22 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 31972 0 0 0 5008 14 0 0 25 0 4 0 634478402 758562816 160629 33554432000 4194304 4964800 140734244336976 18446744073709551615 4313616 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 202.69
Current children cumulated vsize (KiB) 740784

[startup+102.301 s]
/proc/loadavg: 7.91 7.91 7.94 9/298 29015
/proc/meminfo: memFree=21882640/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=1088384 CPUtime=407.03 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 231437 0 0 0 40605 98 0 0 25 0 4 0 634478362 1114505216 224683 33554432000 4194304 4964800 140734244336976 18446744073709551615 4632347 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 272096 224683 460 189 0 266445 0
[pid=29009/tid=29011] ppid=29007 vsize=1088384 CPUtime=101.88 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 61441 0 0 0 10160 28 0 0 25 0 4 0 634478402 1114505216 224683 33554432000 4194304 4964800 140734244336976 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=1088384 CPUtime=101.9 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 58573 0 0 0 10167 23 0 0 25 0 4 0 634478402 1114505216 224683 33554432000 4194304 4964800 140734244336976 18446744073709551615 4313835 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=1088384 CPUtime=100.96 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 43338 0 0 0 10075 21 0 0 25 0 4 0 634478402 1114505216 224683 33554432000 4194304 4964800 140734244336976 18446744073709551615 4660447 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.03
Current children cumulated vsize (KiB) 1088384

[startup+162.3 s]
/proc/loadavg: 8.02 7.94 7.94 9/298 29017
/proc/meminfo: memFree=21053924/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=1329300 CPUtime=646.44 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 301615 0 0 0 64517 127 0 0 25 0 4 0 634478362 1361203200 294773 33554432000 4194304 4964800 140734244336976 18446744073709551615 4631252 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 332325 294773 460 189 0 326674 0
[pid=29009/tid=29011] ppid=29007 vsize=1329300 CPUtime=161.86 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 74876 0 0 0 16151 35 0 0 25 0 4 0 634478402 1361203200 294773 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=1329300 CPUtime=161.89 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 70204 0 0 0 16162 27 0 0 25 0 4 0 634478402 1361203200 294773 33554432000 4194304 4964800 140734244336976 18446744073709551615 4313804 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=1329300 CPUtime=160.41 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 69677 0 0 0 16009 32 0 0 25 0 4 0 634478402 1361203200 294773 33554432000 4194304 4964800 140734244336976 18446744073709551615 4669011 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 646.44
Current children cumulated vsize (KiB) 1329300

[startup+222.311 s]
/proc/loadavg: 8.06 7.96 7.95 9/298 29019
/proc/meminfo: memFree=20389496/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=1586732 CPUtime=885.89 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 360843 0 0 0 88431 158 0 0 25 0 4 0 634478362 1624813568 353969 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 396683 353969 460 189 0 391032 0
[pid=29009/tid=29011] ppid=29007 vsize=1586732 CPUtime=221.87 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 86443 0 0 0 22143 44 0 0 25 0 4 0 634478402 1624813568 353969 33554432000 4194304 4964800 140734244336976 18446744073709551615 4684016 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=1586732 CPUtime=221.87 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 102416 0 0 0 22147 40 0 0 25 0 4 0 634478402 1624813568 353969 33554432000 4194304 4964800 140734244336976 18446744073709551615 4660144 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=1586732 CPUtime=219.86 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 81981 0 0 0 21948 38 0 0 25 0 4 0 634478402 1624813568 353969 33554432000 4194304 4964800 140734244336976 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 885.89
Current children cumulated vsize (KiB) 1586732

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2561.93
Current children cumulated vsize (KiB) 2976648

[startup+702.301 s]
/proc/loadavg: 8.00 8.02 7.99 9/298 29041
/proc/meminfo: memFree=16569672/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=3005980 CPUtime=2801.32 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 724240 0 0 0 279740 392 0 0 25 0 4 0 634478362 3078123520 717037 33554432000 4194304 4964800 140734244336976 18446744073709551615 4342939 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 751495 717037 460 189 0 745844 0
[pid=29009/tid=29011] ppid=29007 vsize=3005980 CPUtime=701.55 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 156593 0 0 0 70057 98 0 0 25 0 4 0 634478402 3078123520 717037 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=3005980 CPUtime=701.7 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 202679 0 0 0 70087 83 0 0 25 0 4 0 634478402 3078123520 717037 33554432000 4194304 4964800 140734244336976 18446744073709551615 4660148 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=3005980 CPUtime=695.79 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 225070 0 0 0 69431 148 0 0 25 0 4 0 634478402 3078123520 717037 33554432000 4194304 4964800 140734244336976 18446744073709551615 4669272 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2801.32
Current children cumulated vsize (KiB) 3005980

[startup+762.301 s]
/proc/loadavg: 8.15 8.05 8.00 9/298 29043
/proc/meminfo: memFree=15956076/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=3005980 CPUtime=3040.76 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 724297 0 0 0 303684 392 0 0 25 0 4 0 634478362 3078123520 717062 33554432000 4194304 4964800 140734244336976 18446744073709551615 4660157 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 751495 717062 460 189 0 745844 0
[pid=29009/tid=29011] ppid=29007 vsize=3005980 CPUtime=761.51 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 156646 0 0 0 76053 98 0 0 25 0 4 0 634478402 3078123520 717062 33554432000 4194304 4964800 140734244336976 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=3005980 CPUtime=761.17 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 202680 0 0 0 76034 83 0 0 25 0 4 0 634478402 3078123520 717062 33554432000 4194304 4964800 140734244336976 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=3005980 CPUtime=755.79 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 225073 0 0 0 75431 148 0 0 25 0 4 0 634478402 3078123520 717062 33554432000 4194304 4964800 140734244336976 18446744073709551615 4653186 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3040.76
Current children cumulated vsize (KiB) 3005980

[startup+822.301 s]
/proc/loadavg: 8.20 8.07 8.01 9/298 29045
/proc/meminfo: memFree=15651144/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=3005980 CPUtime=3280.19 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 724342 0 0 0 327627 392 0 0 25 0 4 0 634478362 3078123520 717107 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670361 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 751495 717107 460 189 0 745844 0
[pid=29009/tid=29011] ppid=29007 vsize=3005980 CPUtime=821.5 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 156646 0 0 0 82052 98 0 0 25 0 4 0 634478402 3078123520 717107 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=3005980 CPUtime=820.62 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 202683 0 0 0 81979 83 0 0 25 0 4 0 634478402 3078123520 717107 33554432000 4194304 4964800 140734244336976 18446744073709551615 4313753 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=3005980 CPUtime=815.79 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 225115 0 0 0 81431 148 0 0 25 0 4 0 634478402 3078123520 717107 33554432000 4194304 4964800 140734244336976 18446744073709551615 4660123 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3280.19
Current children cumulated vsize (KiB) 3005980

[startup+882.312 s]
/proc/loadavg: 8.20 8.09 8.01 9/298 29046
/proc/meminfo: memFree=15097704/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=3071516 CPUtime=3519.65 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 738102 0 0 0 351561 404 0 0 25 0 4 0 634478362 3145232384 730867 33554432000 4194304 4964800 140734244336976 18446744073709551615 4653307 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 767879 730867 460 189 0 762228 0
[pid=29009/tid=29011] ppid=29007 vsize=3071516 CPUtime=881.48 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 156648 0 0 0 88049 99 0 0 25 0 4 0 634478402 3145232384 730867 33554432000 4194304 4964800 140734244336976 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=3071516 CPUtime=880.07 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 211154 0 0 0 87918 89 0 0 25 0 4 0 634478402 3145232384 730867 33554432000 4194304 4964800 140734244336976 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=3071516 CPUtime=875.79 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 230402 0 0 0 87427 152 0 0 25 0 4 0 634478402 3145232384 730867 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3519.65
Current children cumulated vsize (KiB) 3071516

[startup+942.3 s]
/proc/loadavg: 8.17 8.08 8.01 9/298 29049
/proc/meminfo: memFree=14621892/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=3137052 CPUtime=3759.07 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 754688 0 0 0 375494 413 0 0 25 0 4 0 634478362 3212341248 747452 33554432000 4194304 4964800 140734244336976 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 784263 747452 460 189 0 778612 0
[pid=29009/tid=29011] ppid=29007 vsize=3137052 CPUtime=941.47 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 156650 0 0 0 94048 99 0 0 25 0 4 0 634478402 3212341248 747452 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=3137052 CPUtime=939.52 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 211160 0 0 0 93863 89 0 0 25 0 4 0 634478402 3212341248 747452 33554432000 4194304 4964800 140734244336976 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=3137052 CPUtime=935.78 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 230403 0 0 0 93426 152 0 0 25 0 4 0 634478402 3212341248 747452 33554432000 4194304 4964800 140734244336976 18446744073709551615 4660835 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3759.07
Current children cumulated vsize (KiB) 3137052

[startup+1002.3 s]
/proc/loadavg: 8.18 8.10 8.02 9/298 29050
/proc/meminfo: memFree=14464260/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=3202588 CPUtime=3998.52 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 786137 0 0 0 399414 438 0 0 25 0 4 0 634478362 3279450112 778888 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 800647 778888 460 189 0 794996 0
[pid=29009/tid=29011] ppid=29007 vsize=3202588 CPUtime=1001.47 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 157384 0 0 0 100047 100 0 0 25 0 4 0 634478402 3279450112 778888 33554432000 4194304 4964800 140734244336976 18446744073709551615 4653316 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=3202588 CPUtime=998.98 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 241872 0 0 0 99785 113 0 0 25 0 4 0 634478402 3279450112 778888 33554432000 4194304 4964800 140734244336976 18446744073709551615 4320984 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=3202588 CPUtime=995.78 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 230406 0 0 0 99426 152 0 0 25 0 4 0 634478402 3279450112 778888 33554432000 4194304 4964800 140734244336976 18446744073709551615 4669131 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3998.52
Current children cumulated vsize (KiB) 3202588

[startup+1062.3 s]
/proc/loadavg: 8.12 8.09 8.01 9/298 29053
/proc/meminfo: memFree=14328076/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=3399196 CPUtime=4237.99 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 820014 0 0 0 423334 465 0 0 25 0 4 0 634478362 3480776704 812765 33554432000 4194304 4964800 140734244336976 18446744073709551615 4654668 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 849799 812765 460 189 0 844148 0
[pid=29009/tid=29011] ppid=29007 vsize=3399196 CPUtime=1061.48 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 160232 0 0 0 106044 104 0 0 25 0 4 0 634478402 3480776704 812765 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=3399196 CPUtime=1058.44 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 261583 0 0 0 105718 126 0 0 25 0 4 0 634478402 3480776704 812765 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=3399196 CPUtime=1055.78 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 231116 0 0 0 105425 153 0 0 25 0 4 0 634478402 3480776704 812765 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4237.99
Current children cumulated vsize (KiB) 3399196

[startup+1122.3 s]
/proc/loadavg: 8.10 8.09 8.01 9/298 29056
/proc/meminfo: memFree=14195748/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=3501840 CPUtime=4477.45 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 853215 0 0 0 447257 488 0 0 25 0 4 0 634478362 3585884160 845966 33554432000 4194304 4964800 140734244336976 18446744073709551615 4683952 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 875460 845966 460 189 0 869809 0
[pid=29009/tid=29011] ppid=29007 vsize=3501840 CPUtime=1121.47 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 165930 0 0 0 112039 108 0 0 25 0 4 0 634478402 3585884160 845966 33554432000 4194304 4964800 140734244336976 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=3501840 CPUtime=1117.89 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 270881 0 0 0 111656 133 0 0 25 0 4 0 634478402 3585884160 845966 33554432000 4194304 4964800 140734244336976 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=3501840 CPUtime=1115.78 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 249287 0 0 0 111413 165 0 0 25 0 4 0 634478402 3585884160 845966 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670542 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4477.45
Current children cumulated vsize (KiB) 3501840

[startup+1182.3 s]
/proc/loadavg: 8.08 8.08 8.01 10/298 29092
/proc/meminfo: memFree=20781628/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=3568724 CPUtime=4716.87 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 870773 0 0 0 471178 509 0 0 25 0 4 0 634478362 3654373376 863524 33554432000 4194304 4964800 140734244336976 18446744073709551615 4652258 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 892181 863524 460 189 0 886530 0
[pid=29009/tid=29011] ppid=29007 vsize=3568724 CPUtime=1181.24 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 166462 0 0 0 118015 109 0 0 25 0 4 0 634478402 3654373376 863524 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=3568724 CPUtime=1177.55 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 275144 0 0 0 117617 138 0 0 25 0 4 0 634478402 3654373376 863524 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=3568724 CPUtime=1175.79 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 261054 0 0 0 117399 180 0 0 25 0 4 0 634478402 3654373376 863524 33554432000 4194304 4964800 140734244336976 18446744073709551615 4332537 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4716.87
Current children cumulated vsize (KiB) 3568724



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.2 s]
/proc/loadavg: 8.06 8.08 8.01 9/298 29093
/proc/meminfo: memFree=20730492/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=3568724 CPUtime=4800.3 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 877625 0 0 0 479512 518 0 0 25 0 4 0 634478362 3654373376 870376 33554432000 4194304 4964800 140734244336976 18446744073709551615 4668987 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29009/statm: 892181 870376 460 189 0 886530 0
[pid=29009/tid=29011] ppid=29007 vsize=3568724 CPUtime=1201.95 cores=1,3,5,7
/proc/29009/task/29011/stat : 29011 (claspmt) R 29007 29009 28842 0 -1 4202560 173261 0 0 0 120077 118 0 0 25 0 4 0 634478402 3654373376 870376 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670313 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29009/tid=29012] ppid=29007 vsize=3568724 CPUtime=1198.46 cores=1,3,5,7
/proc/29009/task/29012/stat : 29012 (claspmt) R 29007 29009 28842 0 -1 4202560 275165 0 0 0 119708 138 0 0 25 0 4 0 634478402 3654373376 870376 33554432000 4194304 4964800 140734244336976 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29009/tid=29013] ppid=29007 vsize=3568724 CPUtime=1196.69 cores=1,3,5,7
/proc/29009/task/29013/stat : 29013 (claspmt) R 29007 29009 28842 0 -1 4202560 261086 0 0 0 119489 180 0 0 25 0 4 0 634478402 3654373376 870376 33554432000 4194304 4964800 140734244336976 18446744073709551615 4343011 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 3568724

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.51 s]
/proc/loadavg: 8.06 8.08 8.01 7/296 29094
/proc/meminfo: memFree=20954040/32951124 swapFree=63485424/67111528
[pid=29009] ppid=29007 vsize=614668 CPUtime=4800.63 cores=1,3,5,7
/proc/29009/stat : 29009 (claspmt) R 29007 29009 28842 0 -1 4202496 877636 0 0 0 479533 530 0 0 25 0 1 0 634478362 629420032 58989 33554432000 4194304 4964800 140734244336976 18446744073709551615 220816262250 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/29009/statm: 153667 58477 471 189 0 148016 0
Current children cumulated CPU time (s) 4800.63
Current children cumulated vsize (KiB) 614668

Child status: 0
Real time (s): 1203.52
CPU time (s): 4800.65
CPU user time (s): 4795.34
CPU system time (s): 5.31119
CPU usage (%): 398.883
Max. virtual memory (cumulated for all children) (KiB): 3568724

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.33
system time used= 5.31119
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 877637
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11137
involuntary context switches= 21158

runsolver used 2.95955 second user time and 8.00178 second system time

The end

Launcher Data 

Begin job on node147 at 2011-05-15 02:50:25
IDJOB=3373585
IDBENCH=82381
IDSOLVER=1853
FILE ID=node147/3373585-1305420624
RUNJOBID= node147-1305419372-28861
PBS_JOBID= 13324574
Free space on /tmp= 73088 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.025-NOTKNOWN.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373585-1305420624/watcher-3373585-1305420624 -o /tmp/evaluation-result-3373585-1305420624/solver-3373585-1305420624 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373585-1305420624.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3c5c73741ba21d5f39c7f436ba834743
RANDOM SEED=367563557

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23403852 kB
Buffers:        293580 kB
Cached:        5034004 kB
SwapCached:      13132 kB
Active:        2607532 kB
Inactive:      6703532 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23403852 kB
SwapTotal:    67111528 kB
SwapFree:     63485424 kB
Dirty:           17100 kB
Writeback:           0 kB
AnonPages:     3978088 kB
Mapped:          15732 kB
Slab:           141044 kB
PageTables:      30080 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 45812188 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73092 MiB
End job on node147 at 2011-05-15 03:10:30