Trace number 3373132

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.22 1203.13

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_60_29_30_6-dir.shuffled-as.sat03-130.cnf
MD5SUMe826117d87949a5b285e72732bfa395b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables870
Number of clauses69964
Sum of the clauses size140740
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 269935
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 529

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...429477/instance-3373132-1305429477.cnf
0.29/0.30	c Solving...
4800.06/1203.01	
4800.06/1203.01	*** INTERRUPTED! ***
4800.06/1203.01	*** Shutting down threads...
4800.20/1203.12	s UNKNOWN
4800.20/1203.12	
4800.20/1203.12	c INTERRUPTED   : 1
4800.20/1203.12	c Models        : 0+    
4800.20/1203.12	c Time          : 1203.032s (Solving: 1202.73s 1st Model: 0.00s Unsat: 0.00s)
4800.20/1203.12	c CPU Time      : 4800.120s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373132-1305429477/watcher-3373132-1305429477 -o /tmp/evaluation-result-3373132-1305429477/solver-3373132-1305429477 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373132-1305429477.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.70 1.94 1.98 3/273 7399
/proc/meminfo: memFree=25134692/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=21660 CPUtime=0 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 723 0 0 0 0 0 0 0 20 0 1 0 733178261 22179840 647 33554432000 4194304 4964800 140733323085824 18446744073709551615 260020056773 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/7399/statm: 5415 648 385 189 0 289 0

[startup+0.0444341 s]
/proc/loadavg: 1.70 1.94 1.98 3/273 7399
/proc/meminfo: memFree=25134692/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=25692 CPUtime=0.03 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 1954 0 0 0 3 0 0 0 20 0 1 0 733178261 26308608 1579 33554432000 4194304 4964800 140733323085824 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/7399/statm: 6423 1579 398 189 0 1297 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 25692

[startup+0.100414 s]
/proc/loadavg: 1.70 1.94 1.98 3/273 7399
/proc/meminfo: memFree=25134692/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=25692 CPUtime=0.09 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 1954 0 0 0 9 0 0 0 20 0 1 0 733178261 26308608 1579 33554432000 4194304 4964800 140733323085824 18446744073709551615 4607694 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/7399/statm: 6423 1579 398 189 0 1297 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25692

[startup+0.300354 s]
/proc/loadavg: 1.70 1.94 1.98 3/273 7399
/proc/meminfo: memFree=25134692/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=26088 CPUtime=0.29 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 2089 0 0 0 29 0 0 0 21 0 1 0 733178261 26714112 1714 33554432000 4194304 4964800 140733323085824 18446744073709551615 4324306 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/7399/statm: 6522 1714 401 189 0 1396 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 26088

[startup+0.700213 s]
/proc/loadavg: 1.70 1.94 1.98 3/273 7399
/proc/meminfo: memFree=25134692/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=174652 CPUtime=1.79 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 5278 0 0 0 177 2 0 0 18 0 4 0 733178261 178843648 4765 33554432000 4194304 4964800 140733323085824 18446744073709551615 4654473 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 43663 4766 458 189 0 38012 0
Current children cumulated CPU time (s) 1.79
Current children cumulated vsize (KiB) 174652

[startup+1.50107 s]
/proc/loadavg: 1.70 1.94 1.98 10/281 7407
/proc/meminfo: memFree=25088932/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=177964 CPUtime=4.97 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 7995 0 0 0 495 2 0 0 19 0 4 0 733178261 182235136 7482 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670335 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 44491 7482 458 189 0 38840 0
[pid=7399/tid=7405] ppid=7397 vsize=177964 CPUtime=1.18 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 1451 0 0 0 118 0 0 0 18 0 4 0 733178291 182235136 7482 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=177964 CPUtime=1.17 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 1366 0 0 0 117 0 0 0 25 0 4 0 733178291 182235136 7482 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=177964 CPUtime=1.13 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 1314 0 0 0 113 0 0 0 25 0 4 0 733178291 182235136 7482 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.97
Current children cumulated vsize (KiB) 177964

[startup+3.10077 s]
/proc/loadavg: 1.70 1.94 1.98 10/281 7407
/proc/meminfo: memFree=25066240/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=180636 CPUtime=11.37 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 10375 0 0 0 1134 3 0 0 23 0 4 0 733178261 184971264 9862 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670335 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 45159 9863 460 189 0 39508 0
[pid=7399/tid=7405] ppid=7397 vsize=180636 CPUtime=2.78 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 1812 0 0 0 278 0 0 0 21 0 4 0 733178291 184971264 9863 33554432000 4194304 4964800 140733323085824 18446744073709551615 4660835 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=180636 CPUtime=2.77 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 2041 0 0 0 277 0 0 0 25 0 4 0 733178291 184971264 9863 33554432000 4194304 4964800 140733323085824 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=180636 CPUtime=2.72 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 1990 0 0 0 272 0 0 0 25 0 4 0 733178291 184971264 9863 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 11.37
Current children cumulated vsize (KiB) 180636

[startup+6.30019 s]
/proc/loadavg: 2.20 2.04 2.01 10/281 7407
/proc/meminfo: memFree=25038844/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=185840 CPUtime=24.13 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 13763 0 0 0 2409 4 0 0 25 0 4 0 733178261 190300160 13250 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 46460 13250 460 189 0 40809 0
[pid=7399/tid=7405] ppid=7397 vsize=185840 CPUtime=5.98 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 2477 0 0 0 598 0 0 0 25 0 4 0 733178291 190300160 13250 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=185840 CPUtime=5.97 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 3106 0 0 0 597 0 0 0 25 0 4 0 733178291 190300160 13250 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=185840 CPUtime=5.92 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 2747 0 0 0 592 0 0 0 25 0 4 0 733178291 190300160 13250 33554432000 4194304 4964800 140733323085824 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.13
Current children cumulated vsize (KiB) 185840

[startup+12.701 s]
/proc/loadavg: 2.83 2.17 2.05 10/281 7408
/proc/meminfo: memFree=25002520/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=192572 CPUtime=49.68 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 18026 0 0 0 4962 6 0 0 25 0 4 0 733178261 197193728 17513 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320970 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 48143 17513 460 189 0 42492 0
[pid=7399/tid=7405] ppid=7397 vsize=192572 CPUtime=12.38 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 3347 0 0 0 1237 1 0 0 25 0 4 0 733178291 197193728 17513 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=192572 CPUtime=12.37 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 4458 0 0 0 1236 1 0 0 25 0 4 0 733178291 197193728 17513 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=192572 CPUtime=12.33 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 3787 0 0 0 1232 1 0 0 25 0 4 0 733178291 197193728 17513 33554432000 4194304 4964800 140733323085824 18446744073709551615 4660185 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 49.68
Current children cumulated vsize (KiB) 192572

[startup+25.5007 s]
/proc/loadavg: 3.97 2.46 2.15 10/281 7408
/proc/meminfo: memFree=24956020/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=197676 CPUtime=100.75 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 22040 0 0 0 10067 8 0 0 25 0 4 0 733178261 202420224 21527 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670328 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 49419 21527 460 189 0 43768 0
[pid=7399/tid=7405] ppid=7397 vsize=197676 CPUtime=25.17 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 4048 0 0 0 2516 1 0 0 25 0 4 0 733178291 202420224 21527 33554432000 4194304 4964800 140733323085824 18446744073709551615 4342174 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=197676 CPUtime=25.16 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 5757 0 0 0 2515 1 0 0 25 0 4 0 733178291 202420224 21527 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=197676 CPUtime=25.12 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 4704 0 0 0 2511 1 0 0 25 0 4 0 733178291 202420224 21527 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 100.75
Current children cumulated vsize (KiB) 197676

[startup+51.101 s]
/proc/loadavg: 5.42 2.92 2.31 10/281 7409
/proc/meminfo: memFree=24899652/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=209388 CPUtime=202.91 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 29746 0 0 0 20279 12 0 0 25 0 4 0 733178261 214413312 29223 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 52347 29223 460 189 0 46696 0
[pid=7399/tid=7405] ppid=7397 vsize=209388 CPUtime=50.77 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 6434 0 0 0 5075 2 0 0 25 0 4 0 733178291 214413312 29223 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=209388 CPUtime=50.77 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 7645 0 0 0 5075 2 0 0 25 0 4 0 733178291 214413312 29223 33554432000 4194304 4964800 140733323085824 18446744073709551615 4321097 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=209388 CPUtime=50.72 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 6631 0 0 0 5070 2 0 0 25 0 4 0 733178291 214413312 29223 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 202.91
Current children cumulated vsize (KiB) 209388

[startup+102.311 s]
/proc/loadavg: 6.97 3.73 2.61 10/281 7410
/proc/meminfo: memFree=24800312/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=232104 CPUtime=407.27 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 45461 0 0 0 40704 23 0 0 25 0 4 0 733178261 237674496 44912 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 58026 44912 460 189 0 52375 0
[pid=7399/tid=7405] ppid=7397 vsize=232104 CPUtime=101.97 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 11178 0 0 0 10191 6 0 0 25 0 4 0 733178291 237674496 44912 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=232104 CPUtime=101.97 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 11717 0 0 0 10194 3 0 0 25 0 4 0 733178291 237674496 44912 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=232104 CPUtime=101.93 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 9877 0 0 0 10188 5 0 0 25 0 4 0 733178291 237674496 44912 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.27
Current children cumulated vsize (KiB) 232104

[startup+162.301 s]
/proc/loadavg: 7.70 4.53 2.96 10/281 7412
/proc/meminfo: memFree=24733556/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=311696 CPUtime=646.67 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 54946 0 0 0 64639 28 0 0 25 0 4 0 733178261 319176704 54392 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320928 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 77924 54392 460 189 0 72273 0
[pid=7399/tid=7405] ppid=7397 vsize=311696 CPUtime=161.96 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 12413 0 0 0 16189 7 0 0 25 0 4 0 733178291 319176704 54392 33554432000 4194304 4964800 140733323085824 18446744073709551615 4659391 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=311696 CPUtime=161.97 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 15292 0 0 0 16192 5 0 0 25 0 4 0 733178291 319176704 54392 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=311696 CPUtime=161.92 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 12027 0 0 0 16186 6 0 0 25 0 4 0 733178291 319176704 54392 33554432000 4194304 4964800 140733323085824 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 646.67
Current children cumulated vsize (KiB) 311696

[startup+222.301 s]
/proc/loadavg: 7.96 5.19 3.28 10/281 7413
/proc/meminfo: memFree=24613732/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=392984 CPUtime=886.12 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 68751 0 0 0 88571 41 0 0 25 0 4 0 733178261 402415616 67835 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 98246 67835 460 189 0 92595 0
[pid=7399/tid=7405] ppid=7397 vsize=392984 CPUtime=221.95 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 18116 0 0 0 22180 15 0 0 25 0 4 0 733178291 402415616 67835 33554432000 4194304 4964800 140733323085824 18446744073709551615 4321065 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=392984 CPUtime=221.97 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 19096 0 0 0 22191 6 0 0 25 0 4 0 733178291 402415616 67835 33554432000 4194304 4964800 140733323085824 18446744073709551615 4321099 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=392984 CPUtime=221.93 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 14440 0 0 0 22185 8 0 0 25 0 4 0 733178291 402415616 67835 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 886.12
Current children cumulated vsize (KiB) 392984

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2562.29
Current children cumulated vsize (KiB) 531520

[startup+702.301 s]
/proc/loadavg: 8.09 7.49 5.21 10/281 7426
/proc/meminfo: memFree=24296148/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=600320 CPUtime=2801.74 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 114675 0 0 0 280090 84 0 0 25 0 4 0 733178261 614727680 112673 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 150080 112673 460 189 0 144429 0
[pid=7399/tid=7405] ppid=7397 vsize=600320 CPUtime=701.93 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 25944 0 0 0 70172 21 0 0 25 0 4 0 733178291 614727680 112673 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=600320 CPUtime=701.98 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 28159 0 0 0 70190 8 0 0 25 0 4 0 733178291 614727680 112673 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=600320 CPUtime=701.93 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 39997 0 0 0 70156 37 0 0 25 0 4 0 733178291 614727680 112673 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2801.74
Current children cumulated vsize (KiB) 600320

[startup+762.311 s]
/proc/loadavg: 8.14 7.61 5.39 10/281 7428
/proc/meminfo: memFree=24286184/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=667808 CPUtime=3041.22 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 116793 0 0 0 304037 85 0 0 25 0 4 0 733178261 683835392 114385 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320951 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 166952 114385 460 189 0 161301 0
[pid=7399/tid=7405] ppid=7397 vsize=667808 CPUtime=761.94 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 26114 0 0 0 76173 21 0 0 25 0 4 0 733178291 683835392 114385 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=667808 CPUtime=762 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 29809 0 0 0 76191 9 0 0 25 0 4 0 733178291 683835392 114385 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=667808 CPUtime=761.95 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 40290 0 0 0 76157 38 0 0 25 0 4 0 733178291 683835392 114385 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3041.22
Current children cumulated vsize (KiB) 667808

[startup+822.301 s]
/proc/loadavg: 8.14 7.71 5.56 10/281 7429
/proc/meminfo: memFree=24275852/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=667808 CPUtime=3280.64 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 118752 0 0 0 327979 85 0 0 25 0 4 0 733178261 683835392 116344 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320966 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 166952 116344 460 189 0 161301 0
[pid=7399/tid=7405] ppid=7397 vsize=667808 CPUtime=821.93 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 26123 0 0 0 82172 21 0 0 25 0 4 0 733178291 683835392 116344 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670335 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=667808 CPUtime=821.99 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 31753 0 0 0 82190 9 0 0 25 0 4 0 733178291 683835392 116344 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=667808 CPUtime=821.94 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 40295 0 0 0 82156 38 0 0 25 0 4 0 733178291 683835392 116344 33554432000 4194304 4964800 140733323085824 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3280.64
Current children cumulated vsize (KiB) 667808

[startup+882.301 s]
/proc/loadavg: 8.19 7.80 5.73 10/281 7431
/proc/meminfo: memFree=24238472/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=667808 CPUtime=3520.08 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 119970 0 0 0 351921 87 0 0 25 0 4 0 733178261 683835392 117433 33554432000 4194304 4964800 140733323085824 18446744073709551615 4332201 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 166952 117433 460 189 0 161301 0
[pid=7399/tid=7405] ppid=7397 vsize=667808 CPUtime=881.92 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 26127 0 0 0 88170 22 0 0 25 0 4 0 733178291 683835392 117433 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=667808 CPUtime=881.99 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 32955 0 0 0 88189 10 0 0 25 0 4 0 733178291 683835392 117433 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=667808 CPUtime=881.94 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 40305 0 0 0 88156 38 0 0 25 0 4 0 733178291 683835392 117433 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3520.08
Current children cumulated vsize (KiB) 667808

[startup+942.301 s]
/proc/loadavg: 8.07 7.84 5.86 10/281 7433
/proc/meminfo: memFree=24231000/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=673744 CPUtime=3759.52 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 121814 0 0 0 375864 88 0 0 25 0 4 0 733178261 689913856 119277 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670499 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 168436 119277 460 189 0 162785 0
[pid=7399/tid=7405] ppid=7397 vsize=673744 CPUtime=941.91 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 26238 0 0 0 94169 22 0 0 25 0 4 0 733178291 689913856 119277 33554432000 4194304 4964800 140733323085824 18446744073709551615 4627652 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=673744 CPUtime=941.99 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 33329 0 0 0 94189 10 0 0 25 0 4 0 733178291 689913856 119277 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=673744 CPUtime=941.94 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 40658 0 0 0 94156 38 0 0 25 0 4 0 733178291 689913856 119277 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3759.52
Current children cumulated vsize (KiB) 673744

[startup+1002.3 s]
/proc/loadavg: 8.07 7.88 6.00 10/281 7434
/proc/meminfo: memFree=24228332/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=674452 CPUtime=3998.98 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 121996 0 0 0 399809 89 0 0 25 0 4 0 733178261 690638848 119420 33554432000 4194304 4964800 140733323085824 18446744073709551615 4338784 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 168613 119420 460 189 0 162962 0
[pid=7399/tid=7405] ppid=7397 vsize=674452 CPUtime=1001.91 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 26244 0 0 0 100169 22 0 0 25 0 4 0 733178291 690638848 119420 33554432000 4194304 4964800 140733323085824 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=674452 CPUtime=1001.99 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 33478 0 0 0 100189 10 0 0 25 0 4 0 733178291 690638848 119420 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=674452 CPUtime=1001.94 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 40679 0 0 0 100156 38 0 0 25 0 4 0 733178291 690638848 119420 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670534 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3998.98
Current children cumulated vsize (KiB) 674452

[startup+1062.3 s]
/proc/loadavg: 8.06 7.91 6.13 10/281 7436
/proc/meminfo: memFree=24227176/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=675308 CPUtime=4238.43 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 122228 0 0 0 423754 89 0 0 25 0 4 0 733178261 691515392 119652 33554432000 4194304 4964800 140733323085824 18446744073709551615 4669479 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 168827 119652 460 189 0 163176 0
[pid=7399/tid=7405] ppid=7397 vsize=675308 CPUtime=1061.91 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 26244 0 0 0 106169 22 0 0 25 0 4 0 733178291 691515392 119652 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=675308 CPUtime=1061.99 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 33694 0 0 0 106189 10 0 0 25 0 4 0 733178291 691515392 119652 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=675308 CPUtime=1061.94 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 40694 0 0 0 106156 38 0 0 25 0 4 0 733178291 691515392 119652 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4238.43
Current children cumulated vsize (KiB) 675308

[startup+1122.3 s]
/proc/loadavg: 7.95 7.90 6.23 9/281 7497
/proc/meminfo: memFree=24351060/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=677332 CPUtime=4477.92 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 122720 0 0 0 447702 90 0 0 25 0 4 0 733178261 693587968 120144 33554432000 4194304 4964800 140733323085824 18446744073709551615 4668592 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 169333 120144 460 189 0 163682 0
[pid=7399/tid=7405] ppid=7397 vsize=677332 CPUtime=1121.91 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 26717 0 0 0 112169 22 0 0 25 0 4 0 733178291 693587968 120144 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=677332 CPUtime=1121.99 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 33705 0 0 0 112189 10 0 0 25 0 4 0 733178291 693587968 120144 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=677332 CPUtime=1121.94 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 40696 0 0 0 112155 39 0 0 25 0 4 0 733178291 693587968 120144 33554432000 4194304 4964800 140733323085824 18446744073709551615 4669389 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4477.92
Current children cumulated vsize (KiB) 677332

[startup+1182.3 s]
/proc/loadavg: 8.05 7.94 6.35 9/281 7500
/proc/meminfo: memFree=24236480/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=706804 CPUtime=4717.41 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 131050 0 0 0 471648 93 0 0 25 0 4 0 733178261 723767296 128351 33554432000 4194304 4964800 140733323085824 18446744073709551615 4669350 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 176701 128351 460 189 0 171050 0
[pid=7399/tid=7405] ppid=7397 vsize=706804 CPUtime=1181.9 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 29035 0 0 0 118167 23 0 0 25 0 4 0 733178291 723767296 128351 33554432000 4194304 4964800 140733323085824 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=706804 CPUtime=1181.99 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 34602 0 0 0 118189 10 0 0 25 0 4 0 733178291 723767296 128351 33554432000 4194304 4964800 140733323085824 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=706804 CPUtime=1181.95 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 40865 0 0 0 118156 39 0 0 25 0 4 0 733178291 723767296 128351 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4717.41
Current children cumulated vsize (KiB) 706804



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203 s]
/proc/loadavg: 8.17 7.98 6.39 9/281 7500
/proc/meminfo: memFree=24204980/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=706804 CPUtime=4800.06 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 131098 0 0 0 479912 94 0 0 25 0 4 0 733178261 723767296 128399 33554432000 4194304 4964800 140733323085824 18446744073709551615 4312146 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/7399/statm: 176701 128399 460 189 0 171050 0
[pid=7399/tid=7405] ppid=7397 vsize=706804 CPUtime=1202.61 cores=0,2,4,6
/proc/7399/task/7405/stat : 7405 (claspmt) R 7397 7399 510 0 -1 4202560 29037 0 0 0 120238 23 0 0 25 0 4 0 733178291 723767296 128399 33554432000 4194304 4964800 140733323085824 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=7399/tid=7406] ppid=7397 vsize=706804 CPUtime=1202.7 cores=0,2,4,6
/proc/7399/task/7406/stat : 7406 (claspmt) R 7397 7399 510 0 -1 4202560 34631 0 0 0 120260 10 0 0 25 0 4 0 733178291 723767296 128399 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=7399/tid=7407] ppid=7397 vsize=706804 CPUtime=1202.65 cores=0,2,4,6
/proc/7399/task/7407/stat : 7407 (claspmt) R 7397 7399 510 0 -1 4202560 40865 0 0 0 120226 39 0 0 25 0 4 0 733178291 723767296 128399 33554432000 4194304 4964800 140733323085824 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 706804

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.12 s]
/proc/loadavg: 8.17 7.98 6.39 9/281 7500
/proc/meminfo: memFree=24204980/32951124 swapFree=67083432/67111528
[pid=7399] ppid=7397 vsize=360328 CPUtime=4800.2 cores=0,2,4,6
/proc/7399/stat : 7399 (claspmt) R 7397 7399 510 0 -1 4202496 131110 0 0 0 479925 95 0 0 25 0 1 0 733178261 368975872 59673 33554432000 4194304 4964800 140733323085824 18446744073709551615 260020421738 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/7399/statm: 90082 59673 471 189 0 84431 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 360328

Child status: 0
Real time (s): 1203.13
CPU time (s): 4800.22
CPU user time (s): 4799.25
CPU system time (s): 0.964853
CPU usage (%): 398.978
Max. virtual memory (cumulated for all children) (KiB): 706804

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.25
system time used= 0.964853
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 131111
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8228
involuntary context switches= 31172

runsolver used 2.99354 second user time and 7.78881 second system time

The end

Launcher Data 

Begin job on node110 at 2011-05-15 05:17:57
IDJOB=3373132
IDBENCH=83986
IDSOLVER=1853
FILE ID=node110/3373132-1305429477
RUNJOBID= node110-1305429477-7380
PBS_JOBID= 13324577
Free space on /tmp= 73640 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_60_29_30_6-dir.shuffled-as.sat03-130.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373132-1305429477/watcher-3373132-1305429477 -o /tmp/evaluation-result-3373132-1305429477/solver-3373132-1305429477 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373132-1305429477.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e826117d87949a5b285e72732bfa395b
RANDOM SEED=881082288

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25134964 kB
Buffers:        282200 kB
Cached:        4060124 kB
SwapCached:       1440 kB
Active:        4280224 kB
Inactive:      3209144 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25134964 kB
SwapTotal:    67111528 kB
SwapFree:     67083432 kB
Dirty:            2784 kB
Writeback:           0 kB
AnonPages:     3145608 kB
Mapped:          22760 kB
Slab:           244972 kB
PageTables:      20432 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 46124460 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73616 MiB
End job on node110 at 2011-05-15 05:38:02