Trace number 3373588

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4801.18 1205.6

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
MD5SUM0385ba51f44fb47d0b0726e26312816f
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables171676
Number of clauses858766
Sum of the clauses size2046721
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2847665
Number of clauses of size 32700
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 58190

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...420516/instance-3373588-1305420516.cnf
0.99/1.03	c Solving...
4800.35/1204.81	
4800.35/1204.81	*** INTERRUPTED! ***
4800.35/1204.81	*** Shutting down threads...
4800.97/1205.44	s UNKNOWN
4800.97/1205.44	
4800.97/1205.44	c INTERRUPTED   : 1
4800.97/1205.44	c Models        : 0+    
4800.97/1205.44	c Time          : 1204.816s (Solving: 1203.79s 1st Model: 0.00s Unsat: 0.00s)
4800.97/1205.44	c CPU Time      : 4800.390s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373588-1305420516/watcher-3373588-1305420516 -o /tmp/evaluation-result-3373588-1305420516/solver-3373588-1305420516 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373588-1305420516.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.44 7.95 7.99 2/308 15168
/proc/meminfo: memFree=12228468/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=42672 CPUtime=0 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 1246 0 0 0 0 0 0 0 25 0 1 0 653650429 43696128 1177 33554432000 4194304 4964800 140734373052624 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/15168/statm: 10668 1185 375 189 0 5542 0

[startup+0.109297 s]
/proc/loadavg: 7.44 7.95 7.99 2/308 15168
/proc/meminfo: memFree=12228468/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=61596 CPUtime=0.1 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 12554 0 0 0 8 2 0 0 25 0 1 0 653650429 63074304 10400 33554432000 4194304 4964800 140734373052624 18446744073709551615 235594527429 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/15168/statm: 15399 10401 388 189 0 10273 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 61596

[startup+0.200282 s]
/proc/loadavg: 7.44 7.95 7.99 2/308 15168
/proc/meminfo: memFree=12228468/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=75476 CPUtime=0.19 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 17587 0 0 0 16 3 0 0 25 0 1 0 653650429 77287424 13507 33554432000 4194304 4964800 140734373052624 18446744073709551615 235594866432 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/15168/statm: 18869 13508 388 189 0 13743 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 75476

[startup+0.300203 s]
/proc/loadavg: 7.44 7.95 7.99 2/308 15168
/proc/meminfo: memFree=12228468/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=95984 CPUtime=0.29 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 24699 0 0 0 25 4 0 0 25 0 1 0 653650429 98287616 18901 33554432000 4194304 4964800 140734373052624 18446744073709551615 4618467 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/15168/statm: 23996 18901 398 189 0 18870 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 95984

[startup+0.70119 s]
/proc/loadavg: 7.44 7.95 7.99 2/308 15168
/proc/meminfo: memFree=12228468/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=109180 CPUtime=0.69 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 27746 0 0 0 65 4 0 0 25 0 1 0 653650429 111800320 21948 33554432000 4194304 4964800 140734373052624 18446744073709551615 235594527429 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/15168/statm: 27295 21948 403 189 0 22169 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 109180

[startup+1.50099 s]
/proc/loadavg: 7.44 7.95 7.99 6/312 15172
/proc/meminfo: memFree=11950232/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=338456 CPUtime=2.79 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 45794 0 0 0 263 16 0 0 18 0 4 0 653650429 346578944 32970 33554432000 4194304 4964800 140734373052624 18446744073709551615 4370264 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 84614 32970 458 189 0 78963 0
[pid=15168/tid=15170] ppid=15166 vsize=338456 CPUtime=0.41 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 4473 0 0 0 38 3 0 0 18 0 4 0 653650532 346578944 32970 33554432000 4194304 4964800 140734373052624 18446744073709551615 4632378 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=338456 CPUtime=0.45 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 5595 0 0 0 44 1 0 0 25 0 4 0 653650532 346578944 32970 33554432000 4194304 4964800 140734373052624 18446744073709551615 4362944 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=338456 CPUtime=0.45 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 6707 0 0 0 41 4 0 0 18 0 4 0 653650532 346578944 32970 33554432000 4194304 4964800 140734373052624 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2.79
Current children cumulated vsize (KiB) 338456

[startup+3.10066 s]
/proc/loadavg: 7.44 7.95 7.99 6/312 15172
/proc/meminfo: memFree=11913900/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=349596 CPUtime=9.17 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 58995 0 0 0 889 28 0 0 20 0 4 0 653650429 357986304 46171 33554432000 4194304 4964800 140734373052624 18446744073709551615 4660195 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 87399 46171 458 189 0 81748 0
[pid=15168/tid=15170] ppid=15166 vsize=349596 CPUtime=2 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 7231 0 0 0 194 6 0 0 19 0 4 0 653650532 357986304 46171 33554432000 4194304 4964800 140734373052624 18446744073709551615 4653334 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=349596 CPUtime=2.05 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 8383 0 0 0 204 1 0 0 25 0 4 0 653650532 357986304 46171 33554432000 4194304 4964800 140734373052624 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=349596 CPUtime=2.06 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 11185 0 0 0 197 9 0 0 20 0 4 0 653650532 357986304 46171 33554432000 4194304 4964800 140734373052624 18446744073709551615 4660495 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 9.17
Current children cumulated vsize (KiB) 349596

[startup+6.3011 s]
/proc/loadavg: 7.49 7.95 7.99 9/315 15175
/proc/meminfo: memFree=11673156/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=461644 CPUtime=21.94 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 89425 0 0 0 2158 36 0 0 25 0 4 0 653650429 472723456 76601 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670155 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 115411 76601 458 189 0 109760 0
[pid=15168/tid=15170] ppid=15166 vsize=461644 CPUtime=5.17 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 9567 0 0 0 510 7 0 0 25 0 4 0 653650532 472723456 76602 33554432000 4194304 4964800 140734373052624 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=461644 CPUtime=5.25 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 19996 0 0 0 522 3 0 0 25 0 4 0 653650532 472723456 76603 33554432000 4194304 4964800 140734373052624 18446744073709551615 235594527429 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=461644 CPUtime=5.25 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 21942 0 0 0 513 12 0 0 18 0 4 0 653650532 472723456 76603 33554432000 4194304 4964800 140734373052624 18446744073709551615 235594527777 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 21.94
Current children cumulated vsize (KiB) 461644

[startup+12.701 s]
/proc/loadavg: 7.29 7.90 7.97 6/309 15197
/proc/meminfo: memFree=11742024/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=608604 CPUtime=47.47 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 131251 0 0 0 4678 69 0 0 25 0 4 0 653650429 623210496 118427 33554432000 4194304 4964800 140734373052624 18446744073709551615 4627259 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 152151 118427 458 189 0 146500 0
[pid=15168/tid=15170] ppid=15166 vsize=608604 CPUtime=11.5 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 12084 0 0 0 1141 9 0 0 25 0 4 0 653650532 623210496 118427 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670229 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=608604 CPUtime=11.65 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 40380 0 0 0 1158 7 0 0 25 0 4 0 653650532 623210496 118427 33554432000 4194304 4964800 140734373052624 18446744073709551615 4669008 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=608604 CPUtime=11.65 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 38906 0 0 0 1127 38 0 0 23 0 4 0 653650532 623210496 118427 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 47.47
Current children cumulated vsize (KiB) 608604

[startup+25.5007 s]
/proc/loadavg: 7.24 7.86 7.96 10/315 15206
/proc/meminfo: memFree=10815644/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=843260 CPUtime=98.53 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 200363 0 0 0 9755 98 0 0 25 0 4 0 653650429 863498240 187539 33554432000 4194304 4964800 140734373052624 18446744073709551615 4313753 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 210815 187539 460 189 0 205164 0
[pid=15168/tid=15170] ppid=15166 vsize=843260 CPUtime=24.17 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 23678 0 0 0 2404 13 0 0 25 0 4 0 653650532 863498240 187539 33554432000 4194304 4964800 140734373052624 18446744073709551615 4313736 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=843260 CPUtime=24.46 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 65040 0 0 0 2432 14 0 0 25 0 4 0 653650532 863498240 187539 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=843260 CPUtime=24.45 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 56838 0 0 0 2399 46 0 0 25 0 4 0 653650532 863498240 187539 33554432000 4194304 4964800 140734373052624 18446744073709551615 4627252 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 98.53
Current children cumulated vsize (KiB) 843260

[startup+51.1012 s]
/proc/loadavg: 7.62 7.90 7.97 10/315 15207
/proc/meminfo: memFree=10188816/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=1493224 CPUtime=200.67 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 349346 0 0 0 19924 143 0 0 25 0 4 0 653650429 1529061376 336522 33554432000 4194304 4964800 140734373052624 18446744073709551615 4684040 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 373306 336522 460 189 0 367655 0
[pid=15168/tid=15170] ppid=15166 vsize=1493224 CPUtime=49.51 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 52838 0 0 0 4927 24 0 0 25 0 4 0 653650532 1529061376 336524 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=1493224 CPUtime=50.05 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 120756 0 0 0 4980 25 0 0 25 0 4 0 653650532 1529061376 336524 33554432000 4194304 4964800 140734373052624 18446744073709551615 235594563339 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=1493224 CPUtime=50.04 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 100200 0 0 0 4944 60 0 0 25 0 4 0 653650532 1529061376 336524 33554432000 4194304 4964800 140734373052624 18446744073709551615 4320309 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 200.67
Current children cumulated vsize (KiB) 1493224

[startup+102.301 s]
/proc/loadavg: 7.21 7.74 7.91 9/315 15238
/proc/meminfo: memFree=9048480/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=2311972 CPUtime=404.93 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 550667 0 0 0 40253 240 0 0 25 0 4 0 653650429 2367459328 537843 33554432000 4194304 4964800 140734373052624 18446744073709551615 4658556 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 577993 537843 460 189 0 572342 0
[pid=15168/tid=15170] ppid=15166 vsize=2311972 CPUtime=100.19 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 89635 0 0 0 9980 39 0 0 25 0 4 0 653650532 2367459328 537843 33554432000 4194304 4964800 140734373052624 18446744073709551615 4664239 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=2311972 CPUtime=101.26 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 171096 0 0 0 10090 36 0 0 25 0 4 0 653650532 2367459328 537843 33554432000 4194304 4964800 140734373052624 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=2311972 CPUtime=101.25 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 165224 0 0 0 10029 96 0 0 25 0 4 0 653650532 2367459328 537843 33554432000 4194304 4964800 140734373052624 18446744073709551615 4632486 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 404.93
Current children cumulated vsize (KiB) 2311972

[startup+162.301 s]
/proc/loadavg: 7.86 7.82 7.92 9/315 15240
/proc/meminfo: memFree=7893288/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=2943792 CPUtime=644.27 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 720085 0 0 0 64138 289 0 0 25 0 4 0 653650429 3014443008 707260 33554432000 4194304 4964800 140734373052624 18446744073709551615 235594527429 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 735948 707260 460 189 0 730297 0
[pid=15168/tid=15170] ppid=15166 vsize=2943792 CPUtime=159.57 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 116294 0 0 0 15910 47 0 0 25 0 4 0 653650532 3014443008 707260 33554432000 4194304 4964800 140734373052624 18446744073709551615 4653186 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=2943792 CPUtime=161.23 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 205735 0 0 0 16077 46 0 0 25 0 4 0 653650532 3014443008 707260 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=2943792 CPUtime=161.22 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 213246 0 0 0 16014 108 0 0 25 0 4 0 653650532 3014443008 707260 33554432000 4194304 4964800 140734373052624 18446744073709551615 4320296 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 644.27
Current children cumulated vsize (KiB) 2943792

[startup+222.312 s]
/proc/loadavg: 7.95 7.85 7.92 9/315 15241
/proc/meminfo: memFree=6785064/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=3614512 CPUtime=883.69 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 876891 0 0 0 88021 348 0 0 25 0 4 0 653650429 3701260288 864017 33554432000 4194304 4964800 140734373052624 18446744073709551615 4653307 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 903628 864017 460 189 0 897977 0
[pid=15168/tid=15170] ppid=15166 vsize=3614512 CPUtime=218.97 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 129453 0 0 0 21844 53 0 0 25 0 4 0 653650532 3701260288 864017 33554432000 4194304 4964800 140734373052624 18446744073709551615 4654648 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=3614512 CPUtime=221.25 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 261595 0 0 0 22062 63 0 0 25 0 4 0 653650532 3701260288 864017 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670496 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=3614512 CPUtime=221.23 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 260628 0 0 0 21993 130 0 0 25 0 4 0 653650532 3701260288 864017 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 883.69
Current children cumulated vsize (KiB) 3614512

[startup+282.301 s]

################
# More data... #
################

[pid=15168/tid=15170] ppid=15166 vsize=6510864 CPUtime=693.99 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 294915 0 0 0 69274 125 0 0 25 0 4 0 653650532 6667124736 1604387 33554432000 4194304 4964800 140734373052624 18446744073709551615 4653186 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=6510864 CPUtime=701.25 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 432863 0 0 0 70016 109 0 0 25 0 4 0 653650532 6667124736 1604387 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=6510864 CPUtime=701.16 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 463676 0 0 0 69894 222 0 0 25 0 4 0 653650532 6667124736 1604387 33554432000 4194304 4964800 140734373052624 18446744073709551615 235594525592 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2798.54
Current children cumulated vsize (KiB) 6510864

[startup+762.301 s]
/proc/loadavg: 8.07 8.06 8.00 9/315 15265
/proc/meminfo: memFree=929160/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=7029008 CPUtime=3037.94 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 1728756 0 0 0 303114 680 0 0 25 0 4 0 653650429 7197704192 1715575 33554432000 4194304 4964800 140734373052624 18446744073709551615 4653186 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 1757252 1715575 460 189 0 1751601 0
[pid=15168/tid=15170] ppid=15166 vsize=7029008 CPUtime=753.4 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 316592 0 0 0 75207 133 0 0 25 0 4 0 653650532 7197704192 1715575 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=7029008 CPUtime=761.25 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 458992 0 0 0 76011 114 0 0 25 0 4 0 653650532 7197704192 1715575 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=7029008 CPUtime=761.18 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 471029 0 0 0 75891 227 0 0 25 0 4 0 653650532 7197704192 1715575 33554432000 4194304 4964800 140734373052624 18446744073709551615 4644142 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3037.94
Current children cumulated vsize (KiB) 7029008

[startup+822.301 s]
/proc/loadavg: 8.02 8.05 8.00 9/315 15266
/proc/meminfo: memFree=270640/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=7333136 CPUtime=3277.26 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 1823945 0 0 0 327005 721 0 0 25 0 4 0 653650429 7509131264 1810659 33554432000 4194304 4964800 140734373052624 18446744073709551615 4339045 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 1833284 1810659 460 189 0 1827633 0
[pid=15168/tid=15170] ppid=15166 vsize=7333136 CPUtime=812.75 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 338473 0 0 0 81132 143 0 0 25 0 4 0 653650532 7509131264 1810659 33554432000 4194304 4964800 140734373052624 18446744073709551615 4342939 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=7333136 CPUtime=821.24 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 486415 0 0 0 81999 125 0 0 25 0 4 0 653650532 7509131264 1810659 33554432000 4194304 4964800 140734373052624 18446744073709551615 4362847 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=7333136 CPUtime=821.16 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 510407 0 0 0 81874 242 0 0 25 0 4 0 653650532 7509131264 1810659 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3277.26
Current children cumulated vsize (KiB) 7333136

[startup+882.312 s]
/proc/loadavg: 8.12 8.07 8.00 9/315 15268
/proc/meminfo: memFree=95132/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=7697680 CPUtime=3516.54 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 1900738 0 0 0 350907 747 0 0 25 0 4 0 653650429 7882424320 1887104 33554432000 4194304 4964800 140734373052624 18446744073709551615 4370264 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 1924420 1887104 460 189 0 1918769 0
[pid=15168/tid=15170] ppid=15166 vsize=7697680 CPUtime=872.13 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 368652 0 0 0 87063 150 0 0 25 0 4 0 653650532 7882424320 1887104 33554432000 4194304 4964800 140734373052624 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=7697680 CPUtime=881.15 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 486726 0 0 0 87989 126 0 0 25 0 4 0 653650532 7882424320 1887104 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=7697680 CPUtime=881.15 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 549111 0 0 0 87858 257 0 0 25 0 4 0 653650532 7882424320 1887104 33554432000 4194304 4964800 140734373052624 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3516.54
Current children cumulated vsize (KiB) 7697680

[startup+942.301 s]
/proc/loadavg: 8.19 8.08 8.01 11/316 15272
/proc/meminfo: memFree=93936/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=7886108 CPUtime=3755.44 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 1961467 0 0 0 374779 765 0 0 25 0 4 0 653650429 8075374592 1947833 33554432000 4194304 4964800 140734373052624 18446744073709551615 4320309 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 1971527 1947834 460 189 0 1965876 0
[pid=15168/tid=15170] ppid=15166 vsize=7886108 CPUtime=932.05 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 369160 0 0 0 93055 150 0 0 25 0 4 0 653650532 8075374592 1947834 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=7886108 CPUtime=940.18 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 515025 0 0 0 93883 135 0 0 25 0 4 0 653650532 8075374592 1947834 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=7886108 CPUtime=941.14 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 557778 0 0 0 93854 260 0 0 25 0 4 0 653650532 8075374592 1947834 33554432000 4194304 4964800 140734373052624 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3755.44
Current children cumulated vsize (KiB) 7886108

[startup+1002.3 s]
/proc/loadavg: 8.34 8.16 8.04 9/315 15274
/proc/meminfo: memFree=94020/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=8276252 CPUtime=3993.75 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 2057492 0 0 0 398573 802 0 0 25 0 4 0 653650429 8474882048 2043636 33554432000 4194304 4964800 140734373052624 18446744073709551615 4668984 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15168/statm: 2069063 2043636 460 189 0 2063412 0
[pid=15168/tid=15170] ppid=15166 vsize=8276252 CPUtime=991.34 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 406049 0 0 0 98972 162 0 0 25 0 4 0 653650532 8474882048 2043636 33554432000 4194304 4964800 140734373052624 18446744073709551615 4342199 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=8276252 CPUtime=1000.17 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 515085 0 0 0 99882 135 0 0 25 0 4 0 653650532 8474882048 2043636 33554432000 4194304 4964800 140734373052624 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=8276252 CPUtime=1001.13 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 594236 0 0 0 99836 277 0 0 25 0 4 0 653650532 8474882048 2043636 33554432000 4194304 4964800 140734373052624 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3993.75
Current children cumulated vsize (KiB) 8276252

[startup+1062.3 s]
/proc/loadavg: 8.31 8.17 8.05 9/315 15276
/proc/meminfo: memFree=92252/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=8775452 CPUtime=4232.66 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 2183758 0 0 0 422408 858 0 0 25 0 4 0 653650429 8986062848 2169902 33554432000 4194304 4964800 140734373052624 18446744073709551615 4627204 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 2193863 2169902 460 189 0 2188212 0
[pid=15168/tid=15170] ppid=15166 vsize=8775452 CPUtime=1050.45 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 448739 0 0 0 104870 175 0 0 25 0 4 0 653650532 8986062848 2169902 33554432000 4194304 4964800 140734373052624 18446744073709551615 4341904 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=8775452 CPUtime=1060.17 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 515200 0 0 0 105882 135 0 0 25 0 4 0 653650532 8986062848 2169902 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=8775452 CPUtime=1061.13 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 638204 0 0 0 105809 304 0 0 25 0 4 0 653650532 8986062848 2169902 33554432000 4194304 4964800 140734373052624 18446744073709551615 4342186 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4232.66
Current children cumulated vsize (KiB) 8775452

[startup+1122.3 s]
/proc/loadavg: 8.17 8.15 8.05 9/315 15277
/proc/meminfo: memFree=97444/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=8845084 CPUtime=4471.73 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 2193864 0 0 0 446308 865 0 0 25 0 4 0 653650429 9057366016 2179723 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15168/statm: 2211271 2179723 460 189 0 2205620 0
[pid=15168/tid=15170] ppid=15166 vsize=8845084 CPUtime=1109.54 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 448740 0 0 0 110779 175 0 0 25 0 4 0 653650532 9057366016 2179723 33554432000 4194304 4964800 140734373052624 18446744073709551615 4668920 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=8845084 CPUtime=1120.17 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 515254 0 0 0 111882 135 0 0 25 0 4 0 653650532 9057366016 2179723 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=8845084 CPUtime=1121.11 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 639342 0 0 0 111807 304 0 0 25 0 4 0 653650532 9057366016 2179723 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4471.73
Current children cumulated vsize (KiB) 8845084

[startup+1182.3 s]
/proc/loadavg: 8.18 8.15 8.05 9/315 15279
/proc/meminfo: memFree=92056/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=8873756 CPUtime=4710.83 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 2201075 0 0 0 470217 866 0 0 25 0 4 0 653650429 9086726144 2186934 33554432000 4194304 4964800 140734373052624 18446744073709551615 4332491 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15168/statm: 2218439 2186934 460 189 0 2212788 0
[pid=15168/tid=15170] ppid=15166 vsize=8873756 CPUtime=1169.18 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 448776 0 0 0 116743 175 0 0 25 0 4 0 653650532 9086726144 2186934 33554432000 4194304 4964800 140734373052624 18446744073709551615 4313764 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=8873756 CPUtime=1180.17 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 515310 0 0 0 117882 135 0 0 25 0 4 0 653650532 9086726144 2186934 33554432000 4194304 4964800 140734373052624 18446744073709551615 4313794 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=8873756 CPUtime=1180.65 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 646453 0 0 0 117759 306 0 0 25 0 4 0 653650532 9086726144 2186934 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4710.83
Current children cumulated vsize (KiB) 8873756



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.8 s]
/proc/loadavg: 8.12 8.14 8.05 9/315 15279
/proc/meminfo: memFree=97284/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=8900380 CPUtime=4800.35 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 2210151 0 0 0 479164 871 0 0 25 0 4 0 653650429 9113989120 2195860 33554432000 4194304 4964800 140734373052624 18446744073709551615 4670137 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15168/statm: 2225095 2195860 460 189 0 2219444 0
[pid=15168/tid=15170] ppid=15166 vsize=8900380 CPUtime=1191.66 cores=0,2,4,6
/proc/15168/task/15170/stat : 15170 (claspmt) R 15166 15168 15036 0 -1 4202560 451294 0 0 0 118988 178 0 0 25 0 4 0 653650532 9113989120 2195860 33554432000 4194304 4964800 140734373052624 18446744073709551615 4631154 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15168/tid=15171] ppid=15166 vsize=8900380 CPUtime=1202.68 cores=0,2,4,6
/proc/15168/task/15171/stat : 15171 (claspmt) R 15166 15168 15036 0 -1 4202560 515324 0 0 0 120133 135 0 0 25 0 4 0 653650532 9113989120 2195860 33554432000 4194304 4964800 140734373052624 18446744073709551615 4669011 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15168/tid=15172] ppid=15166 vsize=8900380 CPUtime=1203.16 cores=0,2,4,6
/proc/15168/task/15172/stat : 15172 (claspmt) R 15166 15168 15036 0 -1 4202560 652997 0 0 0 120009 307 0 0 25 0 4 0 653650532 9113989120 2195860 33554432000 4194304 4964800 140734373052624 18446744073709551615 4363459 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 8900380

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205.1 s]
/proc/loadavg: 8.12 8.14 8.05 9/315 15279
/proc/meminfo: memFree=97284/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=8870704 CPUtime=4800.67 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202496 2210161 0 0 0 479196 871 0 0 25 0 1 0 653650429 9083600896 2188451 33554432000 4194304 4964800 140734373052624 18446744073709551615 235594515585 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/15168/statm: 2217676 2188451 470 189 0 2212025 0
Current children cumulated CPU time (s) 4800.67
Current children cumulated vsize (KiB) 8870704

[startup+1205.5 s]
/proc/loadavg: 8.12 8.14 8.05 9/315 15279
/proc/meminfo: memFree=97284/32950928 swapFree=67111348/67111528
[pid=15168] ppid=15166 vsize=0 CPUtime=4801.07 cores=0,2,4,6
/proc/15168/stat : 15168 (claspmt) R 15166 15168 15036 0 -1 4202500 2210163 0 0 0 479210 897 0 0 25 0 1 0 653650429 0 0 33554432000 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15168/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 4801.07
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 1205.6
CPU time (s): 4801.18
CPU user time (s): 4792.1
CPU system time (s): 9.07662
CPU usage (%): 398.24
Max. virtual memory (cumulated for all children) (KiB): 8900380

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4792.1
system time used= 9.07662
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2210163
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12061
involuntary context switches= 21496

runsolver used 3.2805 second user time and 8.80266 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-15 02:48:37
IDJOB=3373588
IDBENCH=82369
IDSOLVER=1853
FILE ID=node120/3373588-1305420516
RUNJOBID= node120-1305419310-15054
PBS_JOBID= 13324572
Free space on /tmp= 73464 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_1.045-NOTKNOWN.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373588-1305420516/watcher-3373588-1305420516 -o /tmp/evaluation-result-3373588-1305420516/solver-3373588-1305420516 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373588-1305420516.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0385ba51f44fb47d0b0726e26312816f
RANDOM SEED=1693147444

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12231476 kB
Buffers:        262776 kB
Cached:        3645692 kB
SwapCached:          0 kB
Active:       17427832 kB
Inactive:      3003412 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12231476 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           47768 kB
Writeback:           0 kB
AnonPages:    16522412 kB
Mapped:          24792 kB
Slab:           176148 kB
PageTables:      47872 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 51612304 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73360 MiB
End job on node120 at 2011-05-15 03:08:44