Trace number 3373017

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.21 1206.73

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-4-5_4232.cnf
MD5SUM86d9f733c618d2ca060f457ab8a19463
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4230
Number of clauses100443
Sum of the clauses size411786
Maximum clause length5
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 490429
Number of clauses of size 510014
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...426436/instance-3373017-1305426436.cnf
0.19/0.24	c Solving...
4800.06/1206.62	
4800.06/1206.62	*** INTERRUPTED! ***
4800.06/1206.62	*** Shutting down threads...
4800.20/1206.73	s UNKNOWN
4800.20/1206.73	
4800.20/1206.73	c INTERRUPTED   : 1
4800.20/1206.73	c Models        : 0+    
4800.20/1206.73	c Time          : 1206.624s (Solving: 1206.38s 1st Model: 0.00s Unsat: 0.00s)
4800.20/1206.73	c CPU Time      : 4800.100s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373017-1305426436/watcher-3373017-1305426436 -o /tmp/evaluation-result-3373017-1305426436/solver-3373017-1305426436 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373017-1305426436.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.16 8.82 8.35 7/291 16532
/proc/meminfo: memFree=18873656/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=22308 CPUtime=0 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 908 0 0 0 0 0 0 0 25 0 1 0 654243236 22843392 806 33554432000 4194304 4964800 140736541076336 18446744073709551615 274664469189 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/16532/statm: 5577 806 385 189 0 451 0

[startup+0.01373 s]
/proc/loadavg: 9.16 8.82 8.35 7/291 16532
/proc/meminfo: memFree=18873656/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=23292 CPUtime=0.01 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 1221 0 0 0 1 0 0 0 25 0 1 0 654243236 23851008 1029 33554432000 4194304 4964800 140736541076336 18446744073709551615 274664808192 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/16532/statm: 5823 1030 385 189 0 697 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 23292

[startup+0.100739 s]
/proc/loadavg: 9.16 8.82 8.35 7/291 16532
/proc/meminfo: memFree=18873656/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=31184 CPUtime=0.09 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 3521 0 0 0 9 0 0 0 25 0 1 0 654243236 31932416 2906 33554432000 4194304 4964800 140736541076336 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/16532/statm: 7796 2906 401 189 0 2670 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31184

[startup+0.300651 s]
/proc/loadavg: 9.16 8.82 8.35 7/291 16532
/proc/meminfo: memFree=18873656/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=246268 CPUtime=0.41 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 8711 0 0 0 39 2 0 0 25 0 4 0 654243236 252178432 7889 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670349 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/16532/statm: 61567 7889 457 189 0 55916 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 246268

[startup+0.700581 s]
/proc/loadavg: 9.16 8.82 8.35 7/291 16532
/proc/meminfo: memFree=18873656/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=248976 CPUtime=2.02 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 11702 0 0 0 198 4 0 0 25 0 4 0 654243236 254951424 10880 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/16532/statm: 62244 10880 458 189 0 56593 0
Current children cumulated CPU time (s) 2.02
Current children cumulated vsize (KiB) 248976

[startup+1.50445 s]
/proc/loadavg: 9.16 8.82 8.35 11/296 16796
/proc/meminfo: memFree=18827716/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=250916 CPUtime=5.21 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 14617 0 0 0 516 5 0 0 18 0 4 0 654243236 256937984 13795 33554432000 4194304 4964800 140736541076336 18446744073709551615 4320939 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/16532/statm: 62729 13795 458 189 0 57078 0
[pid=16532/tid=16780] ppid=16528 vsize=250916 CPUtime=1.25 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 2640 0 0 0 124 1 0 0 19 0 4 0 654243260 256937984 13795 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=250916 CPUtime=1.23 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 3435 0 0 0 122 1 0 0 18 0 4 0 654243260 256937984 13796 33554432000 4194304 4964800 140736541076336 18446744073709551615 4320872 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=250916 CPUtime=1.25 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 2644 0 0 0 124 1 0 0 19 0 4 0 654243260 256937984 13796 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.21
Current children cumulated vsize (KiB) 250916

[startup+3.10117 s]
/proc/loadavg: 9.16 8.82 8.35 10/297 16802
/proc/meminfo: memFree=18811732/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=255108 CPUtime=11.57 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 18413 0 0 0 1150 7 0 0 21 0 4 0 654243236 261230592 17591 33554432000 4194304 4964800 140736541076336 18446744073709551615 4668900 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/16532/statm: 63777 17591 460 189 0 58126 0
[pid=16532/tid=16780] ppid=16528 vsize=255108 CPUtime=2.84 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 3302 0 0 0 283 1 0 0 23 0 4 0 654243260 261230592 17591 33554432000 4194304 4964800 140736541076336 18446744073709551615 4653595 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=255108 CPUtime=2.81 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 4641 0 0 0 279 2 0 0 21 0 4 0 654243260 261230592 17591 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=255108 CPUtime=2.83 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 3361 0 0 0 282 1 0 0 23 0 4 0 654243260 261230592 17591 33554432000 4194304 4964800 140736541076336 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.57
Current children cumulated vsize (KiB) 255108

[startup+6.30061 s]
/proc/loadavg: 9.15 8.82 8.35 11/296 16913
/proc/meminfo: memFree=18787124/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=258600 CPUtime=24.28 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 23509 0 0 0 2419 9 0 0 25 0 4 0 654243236 264806400 22687 33554432000 4194304 4964800 140736541076336 18446744073709551615 4362287 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/16532/statm: 64650 22687 460 189 0 58999 0
[pid=16532/tid=16780] ppid=16528 vsize=258600 CPUtime=6.04 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 4327 0 0 0 602 2 0 0 25 0 4 0 654243260 264806400 22687 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=258600 CPUtime=5.98 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 5563 0 0 0 596 2 0 0 25 0 4 0 654243260 264806400 22687 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=258600 CPUtime=6.02 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 4475 0 0 0 601 1 0 0 25 0 4 0 654243260 264806400 22687 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.28
Current children cumulated vsize (KiB) 258600

[startup+12.7005 s]
/proc/loadavg: 9.14 8.82 8.35 10/296 17108
/proc/meminfo: memFree=18762136/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=266544 CPUtime=49.72 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 29945 0 0 0 4959 13 0 0 25 0 4 0 654243236 272941056 29123 33554432000 4194304 4964800 140736541076336 18446744073709551615 4325321 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/16532/statm: 66636 29123 460 189 0 60985 0
[pid=16532/tid=16780] ppid=16528 vsize=266544 CPUtime=12.42 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 5900 0 0 0 1240 2 0 0 25 0 4 0 654243260 272941056 29123 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=266544 CPUtime=12.3 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 7133 0 0 0 1227 3 0 0 25 0 4 0 654243260 272941056 29123 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=266544 CPUtime=12.43 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 6319 0 0 0 1240 3 0 0 25 0 4 0 654243260 272941056 29123 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.72
Current children cumulated vsize (KiB) 266544

[startup+25.5003 s]
/proc/loadavg: 9.17 8.85 8.37 10/296 17479
/proc/meminfo: memFree=18729140/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=274144 CPUtime=100.58 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 36852 0 0 0 10040 18 0 0 25 0 4 0 654243236 280723456 36002 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/16532/statm: 68536 36002 460 189 0 62885 0
[pid=16532/tid=16780] ppid=16528 vsize=274144 CPUtime=25.21 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 7151 0 0 0 2518 3 0 0 25 0 4 0 654243260 280723456 36002 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=274144 CPUtime=24.88 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 8552 0 0 0 2485 3 0 0 25 0 4 0 654243260 280723456 36002 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=274144 CPUtime=25.22 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 8279 0 0 0 2518 4 0 0 25 0 4 0 654243260 280723456 36002 33554432000 4194304 4964800 140736541076336 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.58
Current children cumulated vsize (KiB) 274144

[startup+51.1009 s]
/proc/loadavg: 9.11 8.86 8.38 10/297 18227
/proc/meminfo: memFree=18680464/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=301020 CPUtime=202.31 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 49520 0 0 0 20205 26 0 0 25 0 4 0 654243236 308244480 48658 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/16532/statm: 75255 48658 460 189 0 69604 0
[pid=16532/tid=16780] ppid=16528 vsize=301020 CPUtime=50.68 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 9547 0 0 0 5063 5 0 0 25 0 4 0 654243260 308244480 48658 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=301020 CPUtime=50.2 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 11614 0 0 0 5016 4 0 0 25 0 4 0 654243260 308244480 48658 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=301020 CPUtime=50.81 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 10491 0 0 0 5075 6 0 0 25 0 4 0 654243260 308244480 48658 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 202.31
Current children cumulated vsize (KiB) 301020

[startup+102.311 s]
/proc/loadavg: 9.15 8.91 8.42 10/295 19756
/proc/meminfo: memFree=18602500/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=328424 CPUtime=405.87 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 69172 0 0 0 40544 43 0 0 25 0 4 0 654243236 336306176 67802 33554432000 4194304 4964800 140736541076336 18446744073709551615 4325338 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/16532/statm: 82106 67802 460 189 0 76455 0
[pid=16532/tid=16780] ppid=16528 vsize=328424 CPUtime=101.29 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 13227 0 0 0 10121 8 0 0 25 0 4 0 654243260 336306176 67802 33554432000 4194304 4964800 140736541076336 18446744073709551615 4659841 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=328424 CPUtime=101.31 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 14842 0 0 0 10125 6 0 0 25 0 4 0 654243260 336306176 67802 33554432000 4194304 4964800 140736541076336 18446744073709551615 4320886 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=328424 CPUtime=101.94 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 15151 0 0 0 10184 10 0 0 25 0 4 0 654243260 336306176 67802 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 405.87
Current children cumulated vsize (KiB) 328424

[startup+162.301 s]
/proc/loadavg: 9.24 8.97 8.47 11/296 21511
/proc/meminfo: memFree=18478484/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=529340 CPUtime=644.18 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 100225 0 0 0 64347 71 0 0 25 0 4 0 654243236 542044160 98176 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670264 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 132335 98176 460 189 0 126684 0
[pid=16532/tid=16780] ppid=16528 vsize=529340 CPUtime=160.79 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 20257 0 0 0 16062 17 0 0 25 0 4 0 654243260 542044160 98176 33554432000 4194304 4964800 140736541076336 18446744073709551615 4332144 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=529340 CPUtime=161.14 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 26795 0 0 0 16099 15 0 0 25 0 4 0 654243260 542044160 98176 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=529340 CPUtime=161.39 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 20426 0 0 0 16124 15 0 0 25 0 4 0 654243260 542044160 98176 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 644.18
Current children cumulated vsize (KiB) 529340

[startup+222.3 s]
/proc/loadavg: 9.14 8.99 8.51 11/296 23357
/proc/meminfo: memFree=18472420/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=529340 CPUtime=882.64 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 102077 0 0 0 88190 74 0 0 25 0 4 0 654243236 542044160 100010 33554432000 4194304 4964800 140736541076336 18446744073709551615 4658560 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 132335 100010 460 189 0 126684 0
[pid=16532/tid=16780] ppid=16528 vsize=529340 CPUtime=220.67 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 21176 0 0 0 22049 18 0 0 25 0 4 0 654243260 542044160 100010 33554432000 4194304 4964800 140736541076336 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=529340 CPUtime=221.03 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 26814 0 0 0 22088 15 0 0 25 0 4 0 654243260 542044160 100010 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=529340 CPUtime=220.74 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 21333 0 0 0 22058 16 0 0 25 0 4 0 654243260 542044160 100010 33554432000 4194304 4964800 140736541076336 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 882.64
Current children cumulated vsize (KiB) 529340

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2552.08
Current children cumulated vsize (KiB) 720892

[startup+702.301 s]
/proc/loadavg: 9.31 9.17 8.78 11/296 7710
/proc/meminfo: memFree=18188160/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=787540 CPUtime=2790.54 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 158028 0 0 0 278917 137 0 0 25 0 4 0 654243236 806440960 155663 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/16532/statm: 196885 155663 460 189 0 191234 0
[pid=16532/tid=16780] ppid=16528 vsize=787540 CPUtime=697.48 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 38488 0 0 0 69708 40 0 0 25 0 4 0 654243260 806440960 155663 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=787540 CPUtime=698.46 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 46555 0 0 0 69814 32 0 0 25 0 4 0 654243260 806440960 155663 33554432000 4194304 4964800 140736541076336 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=787540 CPUtime=695.92 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 35668 0 0 0 69557 35 0 0 25 0 4 0 654243260 806440960 155663 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2790.54
Current children cumulated vsize (KiB) 787540

[startup+762.311 s]
/proc/loadavg: 9.18 9.16 8.79 10/297 9988
/proc/meminfo: memFree=18194884/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=795620 CPUtime=3029.05 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 172905 0 0 0 302750 155 0 0 25 0 4 0 654243236 814714880 170345 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 198905 170345 460 189 0 193254 0
[pid=16532/tid=16780] ppid=16528 vsize=795620 CPUtime=757.34 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 39762 0 0 0 75692 42 0 0 25 0 4 0 654243260 814714880 170345 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=795620 CPUtime=757.92 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 54462 0 0 0 75752 40 0 0 25 0 4 0 654243260 814714880 170345 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=795620 CPUtime=755.27 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 39672 0 0 0 75485 42 0 0 25 0 4 0 654243260 814714880 170345 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3029.05
Current children cumulated vsize (KiB) 795620

[startup+822.3 s]
/proc/loadavg: 9.35 9.20 8.83 11/295 11655
/proc/meminfo: memFree=18134948/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=795620 CPUtime=3267.45 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 175774 0 0 0 326586 159 0 0 25 0 4 0 654243236 814714880 173144 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 198905 173144 460 189 0 193254 0
[pid=16532/tid=16780] ppid=16528 vsize=795620 CPUtime=817.21 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 39764 0 0 0 81679 42 0 0 25 0 4 0 654243260 814714880 173144 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670351 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=795620 CPUtime=817.86 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 54837 0 0 0 81746 40 0 0 25 0 4 0 654243260 814714880 173144 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=795620 CPUtime=814.72 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 39896 0 0 0 81430 42 0 0 25 0 4 0 654243260 814714880 173144 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3267.45
Current children cumulated vsize (KiB) 795620

[startup+882.301 s]
/proc/loadavg: 9.24 9.19 8.85 10/295 12975
/proc/meminfo: memFree=18056896/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=840144 CPUtime=3506.14 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 186855 0 0 0 350449 165 0 0 25 0 4 0 654243236 860307456 184221 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 210036 184221 460 189 0 204385 0
[pid=16532/tid=16780] ppid=16528 vsize=840144 CPUtime=877.13 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 39772 0 0 0 87671 42 0 0 25 0 4 0 654243260 860307456 184221 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=840144 CPUtime=877.76 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 65041 0 0 0 87730 46 0 0 25 0 4 0 654243260 860307456 184221 33554432000 4194304 4964800 140736541076336 18446744073709551615 274664475520 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=840144 CPUtime=874.1 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 40551 0 0 0 87367 43 0 0 25 0 4 0 654243260 860307456 184221 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670371 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3506.14
Current children cumulated vsize (KiB) 840144

[startup+942.301 s]
/proc/loadavg: 8.80 9.09 8.83 9/289 13358
/proc/meminfo: memFree=18046508/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=840144 CPUtime=3745.31 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 186891 0 0 0 374366 165 0 0 25 0 4 0 654243236 860307456 184257 33554432000 4194304 4964800 140736541076336 18446744073709551615 4654052 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 210036 184257 460 189 0 204385 0
[pid=16532/tid=16780] ppid=16528 vsize=840144 CPUtime=937.09 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 39773 0 0 0 93667 42 0 0 25 0 4 0 654243260 860307456 184257 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=840144 CPUtime=937.71 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 65052 0 0 0 93725 46 0 0 25 0 4 0 654243260 860307456 184257 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=840144 CPUtime=933.55 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 40563 0 0 0 93312 43 0 0 25 0 4 0 654243260 860307456 184257 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3745.31
Current children cumulated vsize (KiB) 840144

[startup+1002.3 s]
/proc/loadavg: 8.37 8.91 8.78 9/289 13359
/proc/meminfo: memFree=18032852/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=840144 CPUtime=3984.75 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 187476 0 0 0 398308 167 0 0 25 0 4 0 654243236 860307456 184648 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 210036 184648 460 189 0 204385 0
[pid=16532/tid=16780] ppid=16528 vsize=840144 CPUtime=997.08 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 40001 0 0 0 99666 42 0 0 25 0 4 0 654243260 860307456 184648 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=840144 CPUtime=997.71 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 65069 0 0 0 99725 46 0 0 25 0 4 0 654243260 860307456 184648 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=840144 CPUtime=993 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 40565 0 0 0 99257 43 0 0 25 0 4 0 654243260 860307456 184648 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3984.75
Current children cumulated vsize (KiB) 840144

[startup+1062.3 s]
/proc/loadavg: 8.26 8.77 8.74 9/289 13361
/proc/meminfo: memFree=18025776/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=840144 CPUtime=4224.19 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 187512 0 0 0 422252 167 0 0 25 0 4 0 654243236 860307456 184684 33554432000 4194304 4964800 140736541076336 18446744073709551615 4668900 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 210036 184684 460 189 0 204385 0
[pid=16532/tid=16780] ppid=16528 vsize=840144 CPUtime=1057.08 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 40004 0 0 0 105666 42 0 0 25 0 4 0 654243260 860307456 184684 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=840144 CPUtime=1057.7 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 65096 0 0 0 105724 46 0 0 25 0 4 0 654243260 860307456 184684 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=840144 CPUtime=1052.46 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 40566 0 0 0 105203 43 0 0 25 0 4 0 654243260 860307456 184684 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4224.19
Current children cumulated vsize (KiB) 840144

[startup+1122.3 s]
/proc/loadavg: 8.15 8.64 8.70 9/289 13363
/proc/meminfo: memFree=18025252/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=840144 CPUtime=4463.61 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 187528 0 0 0 446193 168 0 0 25 0 4 0 654243236 860307456 184700 33554432000 4194304 4964800 140736541076336 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 210036 184700 460 189 0 204385 0
[pid=16532/tid=16780] ppid=16528 vsize=840144 CPUtime=1117.07 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 40012 0 0 0 111664 43 0 0 25 0 4 0 654243260 860307456 184700 33554432000 4194304 4964800 140736541076336 18446744073709551615 4370381 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=840144 CPUtime=1117.7 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 65103 0 0 0 111724 46 0 0 25 0 4 0 654243260 860307456 184700 33554432000 4194304 4964800 140736541076336 18446744073709551615 4668588 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=840144 CPUtime=1111.91 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 40566 0 0 0 111148 43 0 0 25 0 4 0 654243260 860307456 184700 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4463.61
Current children cumulated vsize (KiB) 840144

[startup+1182.3 s]
/proc/loadavg: 8.11 8.54 8.66 9/289 13364
/proc/meminfo: memFree=17997216/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=840144 CPUtime=4703.05 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 192908 0 0 0 470129 176 0 0 25 0 4 0 654243236 860307456 190080 33554432000 4194304 4964800 140736541076336 18446744073709551615 4687052 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 210036 190080 460 189 0 204385 0
[pid=16532/tid=16780] ppid=16528 vsize=840144 CPUtime=1177.06 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 43004 0 0 0 117658 48 0 0 25 0 4 0 654243260 860307456 190080 33554432000 4194304 4964800 140736541076336 18446744073709551615 274664913439 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=840144 CPUtime=1177.71 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 65612 0 0 0 117724 47 0 0 25 0 4 0 654243260 860307456 190080 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670496 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=840144 CPUtime=1171.37 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 40608 0 0 0 117094 43 0 0 25 0 4 0 654243260 860307456 190080 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4703.05
Current children cumulated vsize (KiB) 840144



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1206.6 s]
/proc/loadavg: 8.15 8.51 8.64 10/289 13365
/proc/meminfo: memFree=17994612/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=840144 CPUtime=4800.06 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 193022 0 0 0 479830 176 0 0 25 0 4 0 654243236 860307456 190194 33554432000 4194304 4964800 140736541076336 18446744073709551615 4362220 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/16532/statm: 210036 190194 460 189 0 204385 0
[pid=16532/tid=16780] ppid=16528 vsize=840144 CPUtime=1201.37 cores=1,3,5,7
/proc/16532/task/16780/stat : 16780 (claspmt) R 16528 16532 6618 0 -1 4202560 43005 0 0 0 120089 48 0 0 25 0 4 0 654243260 860307456 190194 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=16532/tid=16781] ppid=16528 vsize=840144 CPUtime=1202.02 cores=1,3,5,7
/proc/16532/task/16781/stat : 16781 (claspmt) R 16528 16532 6618 0 -1 4202560 65704 0 0 0 120155 47 0 0 25 0 4 0 654243260 860307456 190194 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=16532/tid=16782] ppid=16528 vsize=840144 CPUtime=1195.45 cores=1,3,5,7
/proc/16532/task/16782/stat : 16782 (claspmt) R 16528 16532 6618 0 -1 4202560 40629 0 0 0 119502 43 0 0 25 0 4 0 654243260 860307456 190194 33554432000 4194304 4964800 140736541076336 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.06
Current children cumulated vsize (KiB) 840144

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1206.73 s]
/proc/loadavg: 8.15 8.51 8.64 10/289 13365
/proc/meminfo: memFree=17994612/32951132 swapFree=67093824/67111528
[pid=16532] ppid=16528 vsize=314940 CPUtime=4800.2 cores=1,3,5,7
/proc/16532/stat : 16532 (claspmt) R 16528 16532 6618 0 -1 4202496 193033 0 0 0 479841 179 0 0 25 0 1 0 654243236 322498560 24559 33554432000 4194304 4964800 140736541076336 18446744073709551615 274664851591 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/16532/statm: 78735 24559 471 189 0 73084 0
Current children cumulated CPU time (s) 4800.2
Current children cumulated vsize (KiB) 314940

Child status: 0
Real time (s): 1206.73
CPU time (s): 4800.21
CPU user time (s): 4798.41
CPU system time (s): 1.79973
CPU usage (%): 397.786
Max. virtual memory (cumulated for all children) (KiB): 840144

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.41
system time used= 1.79973
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 193034
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 19217
involuntary context switches= 57536

runsolver used 3.10053 second user time and 7.8948 second system time

The end

Launcher Data 

Begin job on node131 at 2011-05-15 04:27:16
IDJOB=3373017
IDBENCH=83254
IDSOLVER=1853
FILE ID=node131/3373017-1305426436
RUNJOBID= node131-1305424261-6637
PBS_JOBID= 13324598
Free space on /tmp= 73708 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-4-5_4232.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373017-1305426436/watcher-3373017-1305426436 -o /tmp/evaluation-result-3373017-1305426436/solver-3373017-1305426436 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373017-1305426436.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 86d9f733c618d2ca060f457ab8a19463
RANDOM SEED=2068353024

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      18873596 kB
Buffers:        279216 kB
Cached:        3754444 kB
SwapCached:       1504 kB
Active:       10648908 kB
Inactive:      3166812 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      18873596 kB
SwapTotal:    67111528 kB
SwapFree:     67093824 kB
Dirty:            2748 kB
Writeback:         316 kB
AnonPages:     9781164 kB
Mapped:          27552 kB
Slab:           164664 kB
PageTables:      31740 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 28092856 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73704 MiB
End job on node131 at 2011-05-15 04:47:25