Trace number 3299966

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.77 1203.21

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf
MD5SUMc4319228342e10028de028a9b67c3404
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables133566
Number of clauses676901
Sum of the clauses size1609791
Maximum clause length63
Minimum clause length1
Number of clauses of size 1211
Number of clauses of size 2668220
Number of clauses of size 32100
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 56370

Solver Data 

0.00/0.01	c clasp version 2.0.0-RC2
0.00/0.01	c Reading from ...059701/instance-3299966-1304059701.cnf
0.68/0.71	c Solving...
4800.13/1202.61	
4800.13/1202.61	*** INTERRUPTED! ***
4800.13/1202.61	*** Shutting down threads...
4800.65/1203.14	s UNKNOWN
4800.65/1203.14	
4800.65/1203.14	c INTERRUPTED   : 1
4800.65/1203.14	c Models        : 0+    
4800.65/1203.14	c Time          : 1202.607s (Solving: 1201.90s 1st Model: 0.00s Unsat: 0.00s)
4800.65/1203.14	c CPU Time      : 4800.160s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299966-1304059701/watcher-3299966-1304059701 -o /tmp/evaluation-result-3299966-1304059701/solver-3299966-1304059701 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299966-1304059701.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.89 6.14 6.80 2/174 15606
/proc/meminfo: memFree=17924052/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=3200 CPUtime=0 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) D 15604 15606 12737 0 -1 4194304 77 0 0 0 0 0 0 0 21 0 1 0 517572760 3276800 32 33554432000 4194304 4964704 140735668982336 18446744073709551615 216629595670 0 0 4096 0 18446744071562234166 0 0 17 1 0 0 0
/proc/15606/statm: 800 32 25 189 0 24 0

[startup+0.0531771 s]
/proc/loadavg: 3.89 6.14 6.80 2/174 15606
/proc/meminfo: memFree=17924052/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=48184 CPUtime=0.03 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 8307 0 1 0 3 0 0 0 21 0 1 0 517572760 49340416 7158 33554432000 4194304 4964704 140735668982336 18446744073709551615 216634176197 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/15606/statm: 12046 7160 388 189 0 6920 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 48184

[startup+0.101166 s]
/proc/loadavg: 3.89 6.14 6.80 2/174 15606
/proc/meminfo: memFree=17924052/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=52748 CPUtime=0.08 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 9884 0 1 0 8 0 0 0 21 0 1 0 517572760 54013952 8298 33554432000 4194304 4964704 140735668982336 18446744073709551615 216634515200 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/15606/statm: 13187 8299 388 189 0 8061 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 52748

[startup+0.300133 s]
/proc/loadavg: 3.89 6.14 6.80 2/174 15606
/proc/meminfo: memFree=17924052/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=84120 CPUtime=0.28 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 20209 0 1 0 27 1 0 0 22 0 1 0 517572760 86138880 16001 33554432000 4194304 4964704 140735668982336 18446744073709551615 4607486 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/15606/statm: 21030 16001 402 189 0 15904 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 84120

[startup+0.701063 s]
/proc/loadavg: 3.89 6.14 6.80 2/174 15606
/proc/meminfo: memFree=17924052/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=85444 CPUtime=0.68 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 20571 0 1 0 67 1 0 0 23 0 1 0 517572760 87494656 16363 33554432000 4194304 4964704 140735668982336 18446744073709551615 4626353 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/15606/statm: 21361 16363 405 189 0 16235 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 85444

[startup+1.50089 s]
/proc/loadavg: 3.89 6.14 6.80 6/178 15610
/proc/meminfo: memFree=17788240/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=314388 CPUtime=3.78 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 36961 0 2 0 373 5 0 0 25 0 4 0 517572760 321933312 27262 33554432000 4194304 4964704 140735668982336 18446744073709551615 4370473 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 78597 27262 458 189 0 72946 0
[pid=15606/tid=15608] ppid=15604 vsize=314388 CPUtime=0.75 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 4550 0 0 0 75 0 0 0 18 0 4 0 517572831 321933312 27262 33554432000 4194304 4964704 140735668982336 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=314388 CPUtime=0.77 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 5031 0 0 0 77 0 0 0 25 0 4 0 517572831 321933312 27262 33554432000 4194304 4964704 140735668982336 18446744073709551615 4627170 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=314388 CPUtime=0.77 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 5589 0 0 0 76 1 0 0 19 0 4 0 517572831 321933312 27262 33554432000 4194304 4964704 140735668982336 18446744073709551615 4653233 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.78
Current children cumulated vsize (KiB) 314388

[startup+3.10061 s]
/proc/loadavg: 3.89 6.14 6.80 6/178 15610
/proc/meminfo: memFree=17716188/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=320820 CPUtime=10.17 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 46992 0 2 0 1008 9 0 0 25 0 4 0 517572760 328519680 37293 33554432000 4194304 4964704 140735668982336 18446744073709551615 216634176545 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 80205 37293 458 189 0 74554 0
[pid=15606/tid=15608] ppid=15604 vsize=320820 CPUtime=2.35 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 7062 0 0 0 234 1 0 0 18 0 4 0 517572831 328519680 37293 33554432000 4194304 4964704 140735668982336 18446744073709551615 4362225 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=320820 CPUtime=2.37 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 6710 0 0 0 237 0 0 0 25 0 4 0 517572831 328519680 37293 33554432000 4194304 4964704 140735668982336 18446744073709551615 4669200 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=320820 CPUtime=2.36 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 8788 0 0 0 234 2 0 0 18 0 4 0 517572831 328519680 37293 33554432000 4194304 4964704 140735668982336 18446744073709551615 4632519 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 10.17
Current children cumulated vsize (KiB) 320820

[startup+6.30104 s]
/proc/loadavg: 3.98 6.12 6.79 6/178 15610
/proc/meminfo: memFree=17498512/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=348276 CPUtime=22.95 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 69836 0 2 0 2279 16 0 0 25 0 4 0 517572760 356634624 60137 33554432000 4194304 4964704 140735668982336 18446744073709551615 216634176545 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 87069 60137 458 189 0 81418 0
[pid=15606/tid=15608] ppid=15604 vsize=348276 CPUtime=5.56 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 12498 0 0 0 553 3 0 0 25 0 4 0 517572831 356634624 60137 33554432000 4194304 4964704 140735668982336 18446744073709551615 4332462 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=348276 CPUtime=5.57 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 13340 0 0 0 555 2 0 0 25 0 4 0 517572831 356634624 60137 33554432000 4194304 4964704 140735668982336 18446744073709551615 4313804 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=348276 CPUtime=5.54 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 14046 0 0 0 549 5 0 0 25 0 4 0 517572831 356634624 60137 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 22.95
Current children cumulated vsize (KiB) 348276

[startup+12.7009 s]
/proc/loadavg: 4.14 6.12 6.78 9/184 15619
/proc/meminfo: memFree=16862168/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=518836 CPUtime=48.5 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 104546 0 2 0 4811 39 0 0 25 0 4 0 517572760 531288064 94847 33554432000 4194304 4964704 140735668982336 18446744073709551615 4325409 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 129709 94847 458 189 0 124058 0
[pid=15606/tid=15608] ppid=15604 vsize=518836 CPUtime=11.96 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 19506 0 0 0 1190 6 0 0 25 0 4 0 517572831 531288064 94847 33554432000 4194304 4964704 140735668982336 18446744073709551615 4370264 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=518836 CPUtime=11.97 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 20808 0 0 0 1188 9 0 0 25 0 4 0 517572831 531288064 94847 33554432000 4194304 4964704 140735668982336 18446744073709551615 4363547 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=518836 CPUtime=11.91 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 24505 0 0 0 1179 12 0 0 25 0 4 0 517572831 531288064 94847 33554432000 4194304 4964704 140735668982336 18446744073709551615 4363332 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 48.5
Current children cumulated vsize (KiB) 518836

[startup+25.5007 s]
/proc/loadavg: 5.00 6.21 6.80 9/184 15620
/proc/meminfo: memFree=16606856/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=768756 CPUtime=99.62 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 164699 0 2 0 9902 60 0 0 25 0 4 0 517572760 787206144 155000 33554432000 4194304 4964704 140735668982336 18446744073709551615 4370264 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 192189 155000 460 189 0 186538 0
[pid=15606/tid=15608] ppid=15604 vsize=768756 CPUtime=24.75 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 33853 0 0 0 2464 11 0 0 25 0 4 0 517572831 787206144 155000 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320883 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=768756 CPUtime=24.77 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 37799 0 0 0 2463 14 0 0 25 0 4 0 517572831 787206144 155000 33554432000 4194304 4964704 140735668982336 18446744073709551615 4668928 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=768756 CPUtime=24.63 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 39840 0 0 0 2447 16 0 0 25 0 4 0 517572831 787206144 155000 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 99.62
Current children cumulated vsize (KiB) 768756

[startup+51.1012 s]
/proc/loadavg: 5.42 6.22 6.79 6/178 15641
/proc/meminfo: memFree=16874440/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=1182904 CPUtime=201.81 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 270935 0 2 0 20054 127 0 0 24 0 4 0 517572760 1211293696 261236 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 295726 261236 460 189 0 290075 0
[pid=15606/tid=15608] ppid=15604 vsize=1182904 CPUtime=50.32 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 65099 0 0 0 5000 32 0 0 25 0 4 0 517572831 1211293696 261236 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=1182904 CPUtime=50.35 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 56657 0 0 0 5011 24 0 0 25 0 4 0 517572831 1211293696 261236 33554432000 4194304 4964704 140735668982336 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=1182904 CPUtime=50.09 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 70509 0 0 0 4972 37 0 0 25 0 4 0 517572831 1211293696 261236 33554432000 4194304 4964704 140735668982336 18446744073709551615 4342144 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 201.81
Current children cumulated vsize (KiB) 1182904

[startup+102.307 s]
/proc/loadavg: 6.92 6.50 6.85 9/184 15652
/proc/meminfo: memFree=15029628/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=1705892 CPUtime=406.28 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 394969 0 2 0 40448 180 0 0 25 0 4 0 517572760 1746833408 385269 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670054 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 426473 385269 460 189 0 420822 0
[pid=15606/tid=15608] ppid=15604 vsize=1705892 CPUtime=101.52 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 91600 0 0 0 10108 44 0 0 25 0 4 0 517572831 1746833408 385269 33554432000 4194304 4964704 140735668982336 18446744073709551615 4342174 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=1705892 CPUtime=101.52 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 87505 0 0 0 10116 36 0 0 25 0 4 0 517572831 1746833408 385269 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=1705892 CPUtime=101 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 102183 0 0 0 10046 54 0 0 25 0 4 0 517572831 1746833408 385269 33554432000 4194304 4964704 140735668982336 18446744073709551615 4632289 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 406.28
Current children cumulated vsize (KiB) 1705892

[startup+162.301 s]
/proc/loadavg: 7.67 6.78 6.93 9/184 15653
/proc/meminfo: memFree=14246512/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=2111724 CPUtime=645.92 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 499729 0 2 0 64366 226 0 0 25 0 4 0 517572760 2162405376 490018 33554432000 4194304 4964704 140735668982336 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 527931 490019 460 189 0 522280 0
[pid=15606/tid=15608] ppid=15604 vsize=2111724 CPUtime=161.5 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 117370 0 0 0 16094 56 0 0 25 0 4 0 517572831 2162405376 490019 33554432000 4194304 4964704 140735668982336 18446744073709551615 216634176545 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=2111724 CPUtime=161.51 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 113448 0 0 0 16106 45 0 0 25 0 4 0 517572831 2162405376 490019 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=2111724 CPUtime=160.67 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 131167 0 0 0 15998 69 0 0 25 0 4 0 517572831 2162405376 490019 33554432000 4194304 4964704 140735668982336 18446744073709551615 4654517 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 645.92
Current children cumulated vsize (KiB) 2111724

[startup+222.301 s]
/proc/loadavg: 7.94 7.02 7.00 10/184 15655
/proc/meminfo: memFree=13434024/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=2563464 CPUtime=885.54 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 618050 0 2 0 88277 277 0 0 25 0 4 0 517572760 2624987136 608318 33554432000 4194304 4964704 140735668982336 18446744073709551615 4653316 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 640866 608318 460 189 0 635215 0
[pid=15606/tid=15608] ppid=15604 vsize=2563464 CPUtime=221.46 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 154874 0 0 0 22075 71 0 0 25 0 4 0 517572831 2624987136 608318 33554432000 4194304 4964704 140735668982336 18446744073709551615 4683929 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=2563464 CPUtime=221.51 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 146021 0 0 0 22092 59 0 0 25 0 4 0 517572831 2624987136 608318 33554432000 4194304 4964704 140735668982336 18446744073709551615 4313764 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=2563464 CPUtime=220.33 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 157726 0 0 0 21951 82 0 0 25 0 4 0 517572831 2624987136 608318 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670462 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 885.54
Current children cumulated vsize (KiB) 2563464

[startup+282.3 s]

################
# More data... #
################

[pid=15606/tid=15608] ppid=15604 vsize=5161004 CPUtime=701.29 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 331473 0 0 0 69966 163 0 0 25 0 4 0 517572831 5284868096 1258748 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=5161004 CPUtime=701.5 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 286702 0 0 0 70044 106 0 0 25 0 4 0 517572831 5284868096 1258748 33554432000 4194304 4964704 140735668982336 18446744073709551615 4313799 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=5161004 CPUtime=697.68 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 361920 0 0 0 69557 211 0 0 25 0 4 0 517572831 5284868096 1258748 33554432000 4194304 4964704 140735668982336 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2802.69
Current children cumulated vsize (KiB) 5161004

[startup+762.307 s]
/proc/loadavg: 8.13 7.94 7.47 9/184 15678
/proc/meminfo: memFree=8878884/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=5253164 CPUtime=3042.31 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 1277654 0 2 0 303623 608 0 0 25 0 4 0 517572760 5379239936 1267640 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 1313291 1267640 460 189 0 1307640 0
[pid=15606/tid=15608] ppid=15604 vsize=5253164 CPUtime=761.23 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 331514 0 0 0 75960 163 0 0 25 0 4 0 517572831 5379239936 1267640 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=5253164 CPUtime=761.51 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 286740 0 0 0 76044 107 0 0 25 0 4 0 517572831 5379239936 1267640 33554432000 4194304 4964704 140735668982336 18446744073709551615 4313794 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=5253164 CPUtime=757.35 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 364202 0 0 0 75522 213 0 0 25 0 4 0 517572831 5379239936 1267640 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3042.31
Current children cumulated vsize (KiB) 5253164

[startup+822.3 s]
/proc/loadavg: 8.16 7.99 7.52 9/184 15680
/proc/meminfo: memFree=8375000/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=5506092 CPUtime=3281.96 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 1356710 0 2 0 327530 666 0 0 25 0 4 0 517572760 5638238208 1346696 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 1376523 1346696 460 189 0 1370872 0
[pid=15606/tid=15608] ppid=15604 vsize=5506092 CPUtime=821.23 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 380252 0 0 0 81916 207 0 0 25 0 4 0 517572831 5638238208 1346696 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=5506092 CPUtime=821.51 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 286800 0 0 0 82044 107 0 0 25 0 4 0 517572831 5638238208 1346696 33554432000 4194304 4964704 140735668982336 18446744073709551615 4313736 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=5506092 CPUtime=817.01 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 378206 0 0 0 81480 221 0 0 25 0 4 0 517572831 5638238208 1346696 33554432000 4194304 4964704 140735668982336 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3281.96
Current children cumulated vsize (KiB) 5506092

[startup+882.301 s]
/proc/loadavg: 8.17 8.03 7.56 9/184 15681
/proc/meminfo: memFree=8007304/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=5637164 CPUtime=3521.57 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 1382961 0 2 0 351477 680 0 0 25 0 4 0 517572760 5772455936 1372828 33554432000 4194304 4964704 140735668982336 18446744073709551615 4660085 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 1409291 1372828 460 189 0 1403640 0
[pid=15606/tid=15608] ppid=15604 vsize=5637164 CPUtime=881.21 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 385299 0 0 0 87909 212 0 0 25 0 4 0 517572831 5772455936 1372828 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=5637164 CPUtime=881.5 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 286863 0 0 0 88043 107 0 0 25 0 4 0 517572831 5772455936 1372828 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=5637164 CPUtime=876.66 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 378225 0 0 0 87444 222 0 0 25 0 4 0 517572831 5772455936 1372828 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3521.57
Current children cumulated vsize (KiB) 5637164

[startup+942.3 s]
/proc/loadavg: 8.34 8.10 7.61 9/184 15686
/proc/meminfo: memFree=7505292/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=5836332 CPUtime=3760.41 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 1437888 0 2 0 375332 709 0 0 25 0 4 0 517572760 5976403968 1427755 33554432000 4194304 4964704 140735668982336 18446744073709551615 4342920 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 1459083 1427755 460 189 0 1453432 0
[pid=15606/tid=15608] ppid=15604 vsize=5836332 CPUtime=941.21 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 385740 0 0 0 93909 212 0 0 25 0 4 0 517572831 5976403968 1427755 33554432000 4194304 4964704 140735668982336 18446744073709551615 4632355 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=5836332 CPUtime=941.14 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 341348 0 0 0 93978 136 0 0 25 0 4 0 517572831 5976403968 1427755 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=5836332 CPUtime=935.87 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 378226 0 0 0 93365 222 0 0 25 0 4 0 517572831 5976403968 1427755 33554432000 4194304 4964704 140735668982336 18446744073709551615 4332375 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3760.41
Current children cumulated vsize (KiB) 5836332

[startup+1002.3 s]
/proc/loadavg: 8.24 8.11 7.64 9/184 15688
/proc/meminfo: memFree=6892428/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=6250028 CPUtime=4000.08 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 1541976 0 2 0 399240 768 0 0 25 0 4 0 517572760 6400028672 1531841 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 1562507 1531841 460 189 0 1556856 0
[pid=15606/tid=15608] ppid=15604 vsize=6250028 CPUtime=1001.2 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 417660 0 0 0 99888 232 0 0 25 0 4 0 517572831 6400028672 1531841 33554432000 4194304 4964704 140735668982336 18446744073709551615 4632401 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=6250028 CPUtime=1000.8 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 352669 0 0 0 99939 141 0 0 25 0 4 0 517572831 6400028672 1531841 33554432000 4194304 4964704 140735668982336 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=6250028 CPUtime=995.86 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 417423 0 0 0 99334 252 0 0 25 0 4 0 517572831 6400028672 1531841 33554432000 4194304 4964704 140735668982336 18446744073709551615 4632401 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4000.08
Current children cumulated vsize (KiB) 6250028

[startup+1062.3 s]
/proc/loadavg: 8.19 8.12 7.67 9/184 15689
/proc/meminfo: memFree=6467192/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=6577708 CPUtime=4239.76 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 1612352 0 2 0 423153 823 0 0 25 0 4 0 517572760 6735572992 1602217 33554432000 4194304 4964704 140735668982336 18446744073709551615 4684027 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 1644427 1602218 460 189 0 1638776 0
[pid=15606/tid=15608] ppid=15604 vsize=6577708 CPUtime=1061.21 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 417661 0 0 0 105889 232 0 0 25 0 4 0 517572831 6735572992 1602218 33554432000 4194304 4964704 140735668982336 18446744073709551615 4321368 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=6577708 CPUtime=1060.48 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 352731 0 0 0 105907 141 0 0 25 0 4 0 517572831 6735572992 1602218 33554432000 4194304 4964704 140735668982336 18446744073709551615 4668820 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=6577708 CPUtime=1055.87 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 487727 0 0 0 105280 307 0 0 25 0 4 0 517572831 6735572992 1602218 33554432000 4194304 4964704 140735668982336 18446744073709551615 216634176545 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4239.76
Current children cumulated vsize (KiB) 6577708

[startup+1122.3 s]
/proc/loadavg: 8.24 8.14 7.71 9/184 15691
/proc/meminfo: memFree=5891660/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=6970924 CPUtime=4479.36 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 1716136 0 2 0 447045 891 0 0 25 0 4 0 517572760 7138226176 1705810 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 1742731 1705810 460 189 0 1737080 0
[pid=15606/tid=15608] ppid=15604 vsize=6970924 CPUtime=1121.15 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 435699 0 0 0 111872 243 0 0 25 0 4 0 517572831 7138226176 1705810 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=6970924 CPUtime=1120.15 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 383697 0 0 0 111859 156 0 0 25 0 4 0 517572831 7138226176 1705810 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=6970924 CPUtime=1115.86 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 542268 0 0 0 111237 349 0 0 25 0 4 0 517572831 7138226176 1705810 33554432000 4194304 4964704 140735668982336 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4479.36
Current children cumulated vsize (KiB) 6970924

[startup+1182.3 s]
/proc/loadavg: 8.22 8.14 7.73 9/184 15692
/proc/meminfo: memFree=5330760/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=7364140 CPUtime=4719.04 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 1815565 0 2 0 470955 949 0 0 25 0 4 0 517572760 7540879360 1805119 33554432000 4194304 4964704 140735668982336 18446744073709551615 4683951 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 1841035 1805119 460 189 0 1835384 0
[pid=15606/tid=15608] ppid=15604 vsize=7364140 CPUtime=1181.14 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 461931 0 0 0 117856 258 0 0 25 0 4 0 517572831 7540879360 1805119 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=7364140 CPUtime=1179.84 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 384526 0 0 0 117827 157 0 0 25 0 4 0 517572831 7540879360 1805119 33554432000 4194304 4964704 140735668982336 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=7364140 CPUtime=1175.86 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 558505 0 0 0 117225 361 0 0 25 0 4 0 517572831 7540879360 1805119 33554432000 4194304 4964704 140735668982336 18446744073709551615 4325305 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4719.04
Current children cumulated vsize (KiB) 7364140



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.6 s]
/proc/loadavg: 8.16 8.13 7.74 9/184 15693
/proc/meminfo: memFree=5233284/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=7429676 CPUtime=4800.13 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 1832817 0 2 0 479056 957 0 0 25 0 4 0 517572760 7607988224 1822258 33554432000 4194304 4964704 140735668982336 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 1857419 1822258 460 189 0 1851768 0
[pid=15606/tid=15608] ppid=15604 vsize=7429676 CPUtime=1201.45 cores=1,3,5,7
/proc/15606/task/15608/stat : 15608 (claspmt) R 15604 15606 12737 0 -1 4202560 461931 0 0 0 119887 258 0 0 25 0 4 0 517572831 7607988224 1822258 33554432000 4194304 4964704 140735668982336 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15606/tid=15609] ppid=15604 vsize=7429676 CPUtime=1200.02 cores=1,3,5,7
/proc/15606/task/15609/stat : 15609 (claspmt) R 15604 15606 12737 0 -1 4202560 384550 0 0 0 119845 157 0 0 25 0 4 0 517572831 7607988224 1822258 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15606/tid=15610] ppid=15604 vsize=7429676 CPUtime=1196.16 cores=1,3,5,7
/proc/15606/task/15610/stat : 15610 (claspmt) R 15604 15606 12737 0 -1 4202560 558511 0 0 0 119255 361 0 0 25 0 4 0 517572831 7607988224 1822258 33554432000 4194304 4964704 140735668982336 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.13
Current children cumulated vsize (KiB) 7429676

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203 s]
/proc/loadavg: 8.16 8.13 7.74 9/184 15693
/proc/meminfo: memFree=5233284/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=5225896 CPUtime=4800.55 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202496 1832828 0 2 0 479090 965 0 0 25 0 1 0 517572760 5351317504 1264867 33554432000 4194304 4964704 140735668982336 18446744073709551615 216634558599 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/15606/statm: 1306474 1264867 471 189 0 1300823 0
Current children cumulated CPU time (s) 4800.55
Current children cumulated vsize (KiB) 5225896

[startup+1203.2 s]
/proc/loadavg: 8.16 8.13 7.74 9/184 15693
/proc/meminfo: memFree=5233284/32951124 swapFree=67111528/67111528
[pid=15606] ppid=15604 vsize=0 CPUtime=4800.75 cores=1,3,5,7
/proc/15606/stat : 15606 (claspmt) R 15604 15606 12737 0 -1 4202500 1832829 0 2 0 479090 985 0 0 25 0 1 0 517572760 0 0 33554432000 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/15606/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 4800.75
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 1203.21
CPU time (s): 4800.77
CPU user time (s): 4790.91
CPU system time (s): 9.8625
CPU usage (%): 398.997
Max. virtual memory (cumulated for all children) (KiB): 7429676

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4790.91
system time used= 9.8625
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1832829
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13850
involuntary context switches= 33279

runsolver used 1.71574 second user time and 4.83626 second system time

The end

Launcher Data 

Begin job on node103 at 2011-04-29 08:48:21
IDJOB=3299966
IDBENCH=82372
IDSOLVER=1683
FILE ID=node103/3299966-1304059701
RUNJOBID= node103-1304059701-15593
PBS_JOBID= 13170359
Free space on /tmp= 71496 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/application/rintanen/SATPlanning/openstacks-sequencedstrips-nonadl-nonnegated-os-sequencedstrips-p30_3.035-NOTKNOWN.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299966-1304059701/watcher-3299966-1304059701 -o /tmp/evaluation-result-3299966-1304059701/solver-3299966-1304059701 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299966-1304059701.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c4319228342e10028de028a9b67c3404
RANDOM SEED=1037679329

node103.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.858
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17924200 kB
Buffers:       2145660 kB
Cached:       12231512 kB
SwapCached:          0 kB
Active:        5552944 kB
Inactive:      8891320 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17924200 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           25628 kB
Writeback:           8 kB
AnonPages:       66800 kB
Mapped:          14392 kB
Slab:           518712 kB
PageTables:       4580 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   189372 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71376 MiB
End job on node103 at 2011-04-29 09:08:26