Trace number 3321302

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 40002.1 5043.28

General information on the benchmark

Nameindustrial/anbulagan/
hard-unsat/partial-5-11-u.cnf
MD5SUM8e22d84b1ae625d44fbf300a32374a2d
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables164158
Number of clauses730719
Sum of the clauses size1660140
Maximum clause length10
Minimum clause length1
Number of clauses of size 112474
Number of clauses of size 2600009
Number of clauses of size 387256
Number of clauses of size 43440
Number of clauses of size 513760
Number of clauses of size over 513780

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...335210/instance-3321302-1304335210.cnf
0.99/1.09	c Solving...
40000.58/5041.81	
40000.58/5041.81	*** INTERRUPTED! ***
40000.58/5041.81	*** Shutting down threads...
40002.06/5043.22	s UNKNOWN
40002.06/5043.22	
40002.06/5043.22	c INTERRUPTED   : 1
40002.06/5043.22	c Models        : 0+    
40002.06/5043.22	c Time          : 5041.823s (Solving: 5040.73s 1st Model: 0.00s Unsat: 0.00s)
40002.06/5043.22	c CPU Time      : 40000.680s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321302-1304335210/watcher-3321302-1304335210 -o /tmp/evaluation-result-3321302-1304335210/solver-3321302-1304335210 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321302-1304335210.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.16 8.12 7.59 2/232 796
/proc/meminfo: memFree=28068788/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=20740 CPUtime=0 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4194304 311 0 0 0 0 0 0 0 21 0 1 0 545119250 21237760 246 33554432000 4194304 4964704 140735908295248 18446744073709551615 47706559291968 0 0 4096 0 0 0 0 17 4 0 0 0
/proc/796/statm: 5185 260 215 189 0 59 0

[startup+0.0965361 s]
/proc/loadavg: 8.16 8.12 7.59 2/232 796
/proc/meminfo: memFree=28068788/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=64584 CPUtime=0.08 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 13669 0 0 0 7 1 0 0 21 0 1 0 545119250 66134016 11166 33554432000 4194304 4964704 140735908295248 18446744073709551615 246516495045 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/796/statm: 16146 11167 386 189 0 11020 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 64584

[startup+0.100535 s]
/proc/loadavg: 8.16 8.12 7.59 2/232 796
/proc/meminfo: memFree=28068788/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=65112 CPUtime=0.09 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 13829 0 0 0 8 1 0 0 21 0 1 0 545119250 66674688 11326 33554432000 4194304 4964704 140735908295248 18446744073709551615 246516834048 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/796/statm: 16278 11328 386 189 0 11152 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 65112

[startup+0.300499 s]
/proc/loadavg: 8.16 8.12 7.59 2/232 796
/proc/meminfo: memFree=28068788/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=105944 CPUtime=0.29 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 27713 0 0 0 27 2 0 0 22 0 1 0 545119250 108486656 20678 33554432000 4194304 4964704 140735908295248 18446744073709551615 4615747 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/796/statm: 26486 20678 400 189 0 21360 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 105944

[startup+0.700425 s]
/proc/loadavg: 8.16 8.12 7.59 2/232 796
/proc/meminfo: memFree=28068788/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=110504 CPUtime=0.69 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 28863 0 0 0 67 2 0 0 23 0 1 0 545119250 113156096 21828 33554432000 4194304 4964704 140735908295248 18446744073709551615 4615515 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/796/statm: 27626 21828 404 189 0 22500 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 110504

[startup+1.50028 s]
/proc/loadavg: 7.59 8.00 7.56 2/233 797
/proc/meminfo: memFree=27982360/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=531644 CPUtime=1.84 cores=0-7
/proc/796/stat : 796 (claspmt) S 794 796 574 0 -1 4202496 69899 0 0 0 162 22 0 0 19 0 8 0 545119250 544403456 50837 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/796/statm: 132911 50837 443 189 0 127260 0
Current children cumulated CPU time (s) 1.84
Current children cumulated vsize (KiB) 531644

[startup+3.10099 s]
/proc/loadavg: 7.59 8.00 7.56 2/240 804
/proc/meminfo: memFree=27866860/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=531644 CPUtime=3.44 cores=0-7
/proc/796/stat : 796 (claspmt) S 794 796 574 0 -1 4202496 69922 0 0 0 322 22 0 0 19 0 8 0 545119250 544403456 50860 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/796/statm: 132911 50860 443 189 0 127260 0
[pid=796/tid=798] ppid=794 vsize=531644 CPUtime=0.04 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) S 794 796 574 0 -1 4202560 4401 0 0 0 3 1 0 0 18 0 8 0 545119359 544403456 50860 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 1 0 0 0
[pid=796/tid=799] ppid=794 vsize=531644 CPUtime=0.06 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) S 794 796 574 0 -1 4202560 5902 0 0 0 5 1 0 0 25 0 8 0 545119359 544403456 50860 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=531644 CPUtime=0.05 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) S 794 796 574 0 -1 4202560 6916 0 0 0 2 3 0 0 18 0 8 0 545119359 544403456 50860 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=531644 CPUtime=0.03 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) S 794 796 574 0 -1 4202560 4737 0 0 0 1 2 0 0 18 0 8 0 545119359 544403456 50860 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=531644 CPUtime=1.96 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 5441 0 0 0 194 2 0 0 20 0 8 0 545119359 544403456 50860 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668942 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=531644 CPUtime=0.07 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) S 794 796 574 0 -1 4202560 6381 0 0 0 5 2 0 0 18 0 8 0 545119359 544403456 50860 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 5 0 0 0
[pid=796/tid=804] ppid=794 vsize=531644 CPUtime=0.06 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) S 794 796 574 0 -1 4202560 6716 0 0 0 2 4 0 0 18 0 8 0 545119359 544403456 50860 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.44
Current children cumulated vsize (KiB) 531644

[startup+6.3004 s]
/proc/loadavg: 7.59 8.00 7.56 2/240 804
/proc/meminfo: memFree=27866796/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=531644 CPUtime=6.64 cores=0-7
/proc/796/stat : 796 (claspmt) S 794 796 574 0 -1 4202496 69925 0 0 0 642 22 0 0 19 0 8 0 545119250 544403456 50863 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/796/statm: 132911 50863 443 189 0 127260 0
[pid=796/tid=798] ppid=794 vsize=531644 CPUtime=0.04 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) S 794 796 574 0 -1 4202560 4401 0 0 0 3 1 0 0 18 0 8 0 545119359 544403456 50863 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 1 0 0 0
[pid=796/tid=799] ppid=794 vsize=531644 CPUtime=0.06 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) S 794 796 574 0 -1 4202560 5902 0 0 0 5 1 0 0 25 0 8 0 545119359 544403456 50863 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=531644 CPUtime=0.05 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) S 794 796 574 0 -1 4202560 6916 0 0 0 2 3 0 0 18 0 8 0 545119359 544403456 50863 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=531644 CPUtime=0.03 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) S 794 796 574 0 -1 4202560 4737 0 0 0 1 2 0 0 18 0 8 0 545119359 544403456 50863 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=531644 CPUtime=5.16 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 5444 0 0 0 514 2 0 0 25 0 8 0 545119359 544403456 50863 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=531644 CPUtime=0.07 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) S 794 796 574 0 -1 4202560 6381 0 0 0 5 2 0 0 18 0 8 0 545119359 544403456 50863 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 5 0 0 0
[pid=796/tid=804] ppid=794 vsize=531644 CPUtime=0.06 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) S 794 796 574 0 -1 4202560 6716 0 0 0 2 4 0 0 18 0 8 0 545119359 544403456 50863 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 6.64
Current children cumulated vsize (KiB) 531644

[startup+12.7012 s]
/proc/loadavg: 6.58 7.77 7.48 2/240 804
/proc/meminfo: memFree=27867200/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=531644 CPUtime=13.04 cores=0-7
/proc/796/stat : 796 (claspmt) S 794 796 574 0 -1 4202496 69929 0 0 0 1282 22 0 0 19 0 8 0 545119250 544403456 50867 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/796/statm: 132911 50867 443 189 0 127260 0
[pid=796/tid=798] ppid=794 vsize=531644 CPUtime=0.04 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) S 794 796 574 0 -1 4202560 4401 0 0 0 3 1 0 0 18 0 8 0 545119359 544403456 50867 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 1 0 0 0
[pid=796/tid=799] ppid=794 vsize=531644 CPUtime=0.06 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) S 794 796 574 0 -1 4202560 5902 0 0 0 5 1 0 0 25 0 8 0 545119359 544403456 50867 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=531644 CPUtime=0.05 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) S 794 796 574 0 -1 4202560 6916 0 0 0 2 3 0 0 18 0 8 0 545119359 544403456 50867 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=531644 CPUtime=0.03 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) S 794 796 574 0 -1 4202560 4737 0 0 0 1 2 0 0 18 0 8 0 545119359 544403456 50867 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=531644 CPUtime=11.56 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 5448 0 0 0 1154 2 0 0 25 0 8 0 545119359 544403456 50867 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670080 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=531644 CPUtime=0.07 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) S 794 796 574 0 -1 4202560 6381 0 0 0 5 2 0 0 18 0 8 0 545119359 544403456 50867 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 5 0 0 0
[pid=796/tid=804] ppid=794 vsize=531644 CPUtime=0.06 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) S 794 796 574 0 -1 4202560 6716 0 0 0 2 4 0 0 18 0 8 0 545119359 544403456 50867 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 13.04
Current children cumulated vsize (KiB) 531644

[startup+25.5009 s]
/proc/loadavg: 5.72 7.54 7.41 2/240 804
/proc/meminfo: memFree=27867916/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=531884 CPUtime=25.84 cores=0-7
/proc/796/stat : 796 (claspmt) S 794 796 574 0 -1 4202496 69957 0 0 0 2562 22 0 0 19 0 8 0 545119250 544649216 50895 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/796/statm: 132971 50895 443 189 0 127320 0
[pid=796/tid=798] ppid=794 vsize=531884 CPUtime=0.04 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) S 794 796 574 0 -1 4202560 4401 0 0 0 3 1 0 0 18 0 8 0 545119359 544649216 50895 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 1 0 0 0
[pid=796/tid=799] ppid=794 vsize=531884 CPUtime=0.06 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) S 794 796 574 0 -1 4202560 5902 0 0 0 5 1 0 0 25 0 8 0 545119359 544649216 50895 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=531884 CPUtime=0.05 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) S 794 796 574 0 -1 4202560 6916 0 0 0 2 3 0 0 18 0 8 0 545119359 544649216 50895 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=531884 CPUtime=0.03 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) S 794 796 574 0 -1 4202560 4737 0 0 0 1 2 0 0 18 0 8 0 545119359 544649216 50895 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=531884 CPUtime=24.36 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 5476 0 0 0 2434 2 0 0 25 0 8 0 545119359 544649216 50895 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=531884 CPUtime=0.07 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) S 794 796 574 0 -1 4202560 6381 0 0 0 5 2 0 0 18 0 8 0 545119359 544649216 50895 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 5 0 0 0
[pid=796/tid=804] ppid=794 vsize=531884 CPUtime=0.06 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) S 794 796 574 0 -1 4202560 6716 0 0 0 2 4 0 0 18 0 8 0 545119359 544649216 50895 33554432000 4194304 4964704 140735908295248 18446744073709551615 246528650137 0 0 4096 18946 18446604445634099328 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.84
Current children cumulated vsize (KiB) 531884

[startup+51.1012 s]
/proc/loadavg: 4.67 7.13 7.28 9/240 805
/proc/meminfo: memFree=27829644/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=531884 CPUtime=113.39 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 80960 0 0 0 11304 35 0 0 25 0 8 0 545119250 544649216 61898 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668820 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/796/statm: 132971 61898 464 189 0 127320 0
[pid=796/tid=798] ppid=794 vsize=531884 CPUtime=8.91 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) R 794 796 574 0 -1 4202560 4513 0 0 0 889 2 0 0 25 0 8 0 545119359 544649216 61898 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670281 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=796/tid=799] ppid=794 vsize=531884 CPUtime=8.92 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) R 794 796 574 0 -1 4202560 9338 0 0 0 888 4 0 0 25 0 8 0 545119359 544649216 61898 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=531884 CPUtime=8.92 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) R 794 796 574 0 -1 4202560 8926 0 0 0 886 6 0 0 25 0 8 0 545119359 544649216 61898 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=531884 CPUtime=8.89 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) R 794 796 574 0 -1 4202560 6297 0 0 0 886 3 0 0 25 0 8 0 545119359 544649216 61898 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668907 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=531884 CPUtime=49.96 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 5487 0 0 0 4994 2 0 0 25 0 8 0 545119359 544649216 61898 33554432000 4194304 4964704 140735908295248 18446744073709551615 4677965 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=531884 CPUtime=8.94 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) R 794 796 574 0 -1 4202560 7428 0 0 0 890 4 0 0 25 0 8 0 545119359 544649216 61898 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=796/tid=804] ppid=794 vsize=531884 CPUtime=8.92 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) R 794 796 574 0 -1 4202560 9093 0 0 0 886 6 0 0 25 0 8 0 545119359 544649216 61898 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670114 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 113.39
Current children cumulated vsize (KiB) 531884

[startup+102.309 s]
/proc/loadavg: 7.04 7.37 7.35 9/240 806
/proc/meminfo: memFree=27470652/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=824432 CPUtime=522.67 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 169546 0 0 0 52151 116 0 0 25 0 8 0 545119250 844218368 150480 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668632 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/796/statm: 206108 150480 466 189 0 200457 0
[pid=796/tid=798] ppid=794 vsize=824432 CPUtime=60.12 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) R 794 796 574 0 -1 4202560 10040 0 0 0 6003 9 0 0 25 0 8 0 545119359 844218368 150480 33554432000 4194304 4964704 140735908295248 18446744073709551615 4653475 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=796/tid=799] ppid=794 vsize=824432 CPUtime=60.13 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) R 794 796 574 0 -1 4202560 30005 0 0 0 5991 22 0 0 25 0 8 0 545119359 844218368 150480 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=824432 CPUtime=60.14 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) R 794 796 574 0 -1 4202560 16096 0 0 0 5999 15 0 0 25 0 8 0 545119359 844218368 150480 33554432000 4194304 4964704 140735908295248 18446744073709551615 4683999 0 0 4096 18946 0 0 0 -1 6 0 0 0

################
# More data... #
################

[pid=796] ppid=794 vsize=8095336 CPUtime=37926.5 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 1968456 0 0 0 3790617 2037 0 0 25 0 8 0 545119250 8289624064 1947205 33554432000 4194304 4964704 140735908295248 18446744073709551615 4320947 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/796/statm: 2023834 1947205 466 189 0 2018183 0
[pid=796/tid=798] ppid=794 vsize=8095336 CPUtime=4725.73 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) R 794 796 574 0 -1 4202560 79536 0 0 0 472452 121 0 0 25 0 8 0 545119359 8289624064 1947205 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=796/tid=799] ppid=794 vsize=8095336 CPUtime=4740.26 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) R 794 796 574 0 -1 4202560 205785 0 0 0 473872 154 0 0 25 0 8 0 545119359 8289624064 1947205 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=8095336 CPUtime=4739.4 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) R 794 796 574 0 -1 4202560 115214 0 0 0 473799 141 0 0 25 0 8 0 545119359 8289624064 1947205 33554432000 4194304 4964704 140735908295248 18446744073709551615 246516495393 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=8095336 CPUtime=4739.37 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) R 794 796 574 0 -1 4202560 327036 0 0 0 473593 344 0 0 25 0 8 0 545119359 8289624064 1947205 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=8095336 CPUtime=4781.04 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 193263 0 0 0 477874 230 0 0 25 0 8 0 545119359 8289624064 1947205 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=8095336 CPUtime=4727.91 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) R 794 796 574 0 -1 4202560 98073 0 0 0 472654 137 0 0 25 0 8 0 545119359 8289624064 1947205 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=796/tid=804] ppid=794 vsize=8095336 CPUtime=4739.99 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) R 794 796 574 0 -1 4202560 788393 0 0 0 473307 692 0 0 25 0 8 0 545119359 8289624064 1947205 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37926.5
Current children cumulated vsize (KiB) 8095336

[startup+4842.3 s]
/proc/loadavg: 8.15 8.12 8.09 9/240 965
/proc/meminfo: memFree=20063780/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=8269416 CPUtime=38406.1 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 2019430 0 0 0 3838516 2094 0 0 25 0 8 0 545119250 8467881984 1998179 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/796/statm: 2067354 1998179 466 189 0 2061703 0
[pid=796/tid=798] ppid=794 vsize=8269416 CPUtime=4785.37 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) R 794 796 574 0 -1 4202560 82172 0 0 0 478413 124 0 0 25 0 8 0 545119359 8467881984 1998179 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=796/tid=799] ppid=794 vsize=8269416 CPUtime=4800.26 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) R 794 796 574 0 -1 4202560 210116 0 0 0 479868 158 0 0 25 0 8 0 545119359 8467881984 1998179 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=8269416 CPUtime=4799.4 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) R 794 796 574 0 -1 4202560 117273 0 0 0 479796 144 0 0 25 0 8 0 545119359 8467881984 1998179 33554432000 4194304 4964704 140735908295248 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=8269416 CPUtime=4799.36 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) R 794 796 574 0 -1 4202560 340793 0 0 0 479577 359 0 0 25 0 8 0 545119359 8467881984 1998179 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=8269416 CPUtime=4841.04 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 195133 0 0 0 483872 232 0 0 25 0 8 0 545119359 8467881984 1998179 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=8269416 CPUtime=4787.92 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) R 794 796 574 0 -1 4202560 98386 0 0 0 478654 138 0 0 25 0 8 0 545119359 8467881984 1998179 33554432000 4194304 4964704 140735908295248 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=796/tid=804] ppid=794 vsize=8269416 CPUtime=4799.99 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) R 794 796 574 0 -1 4202560 809309 0 0 0 479287 712 0 0 25 0 8 0 545119359 8467881984 1998179 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38406.1
Current children cumulated vsize (KiB) 8269416

[startup+4902.3 s]
/proc/loadavg: 8.10 8.11 8.09 10/240 966
/proc/meminfo: memFree=19925496/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=8410728 CPUtime=38885.7 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 2053748 0 0 0 3886435 2131 0 0 25 0 8 0 545119250 8612585472 2032497 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/796/statm: 2102682 2032497 466 189 0 2097031 0
[pid=796/tid=798] ppid=794 vsize=8410728 CPUtime=4845.38 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) R 794 796 574 0 -1 4202560 84481 0 0 0 484409 129 0 0 25 0 8 0 545119359 8612585472 2032497 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=796/tid=799] ppid=794 vsize=8410728 CPUtime=4860.26 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) R 794 796 574 0 -1 4202560 210504 0 0 0 485868 158 0 0 25 0 8 0 545119359 8612585472 2032497 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=8410728 CPUtime=4859.41 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) R 794 796 574 0 -1 4202560 117410 0 0 0 485796 145 0 0 25 0 8 0 545119359 8612585472 2032497 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=8410728 CPUtime=4859.35 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) R 794 796 574 0 -1 4202560 347962 0 0 0 485569 366 0 0 25 0 8 0 545119359 8612585472 2032497 33554432000 4194304 4964704 140735908295248 18446744073709551615 4675387 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=8410728 CPUtime=4901.03 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 195162 0 0 0 489871 232 0 0 25 0 8 0 545119359 8612585472 2032497 33554432000 4194304 4964704 140735908295248 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=8410728 CPUtime=4847.92 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) R 794 796 574 0 -1 4202560 100942 0 0 0 484651 141 0 0 25 0 8 0 545119359 8612585472 2032497 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668652 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=796/tid=804] ppid=794 vsize=8410728 CPUtime=4859.99 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) R 794 796 574 0 -1 4202560 830736 0 0 0 485266 733 0 0 25 0 8 0 545119359 8612585472 2032497 33554432000 4194304 4964704 140735908295248 18446744073709551615 4669051 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38885.7
Current children cumulated vsize (KiB) 8410728

[startup+4962.3 s]
/proc/loadavg: 8.07 8.10 8.09 9/240 968
/proc/meminfo: memFree=19865332/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=8419060 CPUtime=39365.2 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 2069036 0 0 0 3934365 2151 0 0 25 0 8 0 545119250 8621117440 2047785 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/796/statm: 2104765 2047785 466 189 0 2099114 0
[pid=796/tid=798] ppid=794 vsize=8419060 CPUtime=4905.32 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) R 794 796 574 0 -1 4202560 84505 0 0 0 490403 129 0 0 25 0 8 0 545119359 8621117440 2047785 33554432000 4194304 4964704 140735908295248 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=796/tid=799] ppid=794 vsize=8419060 CPUtime=4920.27 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) R 794 796 574 0 -1 4202560 211006 0 0 0 491868 159 0 0 25 0 8 0 545119359 8621117440 2047785 33554432000 4194304 4964704 140735908295248 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=8419060 CPUtime=4919.41 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) R 794 796 574 0 -1 4202560 117511 0 0 0 491796 145 0 0 25 0 8 0 545119359 8621117440 2047785 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=8419060 CPUtime=4919.35 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) R 794 796 574 0 -1 4202560 351780 0 0 0 491564 371 0 0 25 0 8 0 545119359 8621117440 2047785 33554432000 4194304 4964704 140735908295248 18446744073709551615 4660364 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=8419060 CPUtime=4961.03 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 196561 0 0 0 495871 232 0 0 25 0 8 0 545119359 8621117440 2047785 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=8419060 CPUtime=4907.91 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) R 794 796 574 0 -1 4202560 103400 0 0 0 490646 145 0 0 25 0 8 0 545119359 8621117440 2047785 33554432000 4194304 4964704 140735908295248 18446744073709551615 4669200 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=796/tid=804] ppid=794 vsize=8419060 CPUtime=4919.98 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) R 794 796 574 0 -1 4202560 836650 0 0 0 491257 741 0 0 25 0 8 0 545119359 8621117440 2047785 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39365.2
Current children cumulated vsize (KiB) 8419060

[startup+5022.3 s]
/proc/loadavg: 8.06 8.10 8.09 9/240 970
/proc/meminfo: memFree=19714036/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=8550132 CPUtime=39844.7 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 2107150 0 0 0 3982288 2185 0 0 25 0 8 0 545119250 8755335168 2085899 33554432000 4194304 4964704 140735908295248 18446744073709551615 4654636 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/796/statm: 2137533 2085899 466 189 0 2131882 0
[pid=796/tid=798] ppid=794 vsize=8550132 CPUtime=4965.32 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) R 794 796 574 0 -1 4202560 85733 0 0 0 496401 131 0 0 25 0 8 0 545119359 8755335168 2085899 33554432000 4194304 4964704 140735908295248 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=796/tid=799] ppid=794 vsize=8550132 CPUtime=4980.27 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) R 794 796 574 0 -1 4202560 211423 0 0 0 497868 159 0 0 25 0 8 0 545119359 8755335168 2085899 33554432000 4194304 4964704 140735908295248 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=8550132 CPUtime=4979.4 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) R 794 796 574 0 -1 4202560 119752 0 0 0 497792 148 0 0 25 0 8 0 545119359 8755335168 2085899 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=8550132 CPUtime=4979.35 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) R 794 796 574 0 -1 4202560 351782 0 0 0 497564 371 0 0 25 0 8 0 545119359 8755335168 2085899 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=8550132 CPUtime=5021.03 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 196582 0 0 0 501871 232 0 0 25 0 8 0 545119359 8755335168 2085899 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=8550132 CPUtime=4967.92 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) R 794 796 574 0 -1 4202560 105283 0 0 0 496643 149 0 0 25 0 8 0 545119359 8755335168 2085899 33554432000 4194304 4964704 140735908295248 18446744073709551615 4669429 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=796/tid=804] ppid=794 vsize=8550132 CPUtime=4979.98 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) R 794 796 574 0 -1 4202560 868972 0 0 0 497233 765 0 0 25 0 8 0 545119359 8755335168 2085899 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39844.7
Current children cumulated vsize (KiB) 8550132



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5041.8 s]
/proc/loadavg: 8.10 8.11 8.09 10/240 970
/proc/meminfo: memFree=19684752/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=8550132 CPUtime=40000.6 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 2113868 0 0 0 3997866 2192 0 0 25 0 8 0 545119250 8755335168 2092617 33554432000 4194304 4964704 140735908295248 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/796/statm: 2137533 2092617 466 189 0 2131882 0
[pid=796/tid=798] ppid=794 vsize=8550132 CPUtime=4984.83 cores=0-7
/proc/796/task/798/stat : 798 (claspmt) R 794 796 574 0 -1 4202560 86536 0 0 0 498350 133 0 0 25 0 8 0 545119359 8755335168 2092617 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=796/tid=799] ppid=794 vsize=8550132 CPUtime=4999.78 cores=0-7
/proc/796/task/799/stat : 799 (claspmt) R 794 796 574 0 -1 4202560 211433 0 0 0 499819 159 0 0 25 0 8 0 545119359 8755335168 2092617 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=796/tid=800] ppid=794 vsize=8550132 CPUtime=4998.91 cores=0-7
/proc/796/task/800/stat : 800 (claspmt) R 794 796 574 0 -1 4202560 119766 0 0 0 499743 148 0 0 25 0 8 0 545119359 8755335168 2092617 33554432000 4194304 4964704 140735908295248 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=796/tid=801] ppid=794 vsize=8550132 CPUtime=4998.83 cores=0-7
/proc/796/task/801/stat : 801 (claspmt) R 794 796 574 0 -1 4202560 351782 0 0 0 499512 371 0 0 25 0 8 0 545119359 8755335168 2092617 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=796/tid=802] ppid=794 vsize=8550132 CPUtime=5040.54 cores=0-7
/proc/796/task/802/stat : 802 (claspmt) R 794 796 574 0 -1 4202560 196591 0 0 0 503822 232 0 0 25 0 8 0 545119359 8755335168 2092617 33554432000 4194304 4964704 140735908295248 18446744073709551615 4653167 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=796/tid=803] ppid=794 vsize=8550132 CPUtime=4987.43 cores=0-7
/proc/796/task/803/stat : 803 (claspmt) R 794 796 574 0 -1 4202560 106830 0 0 0 498591 152 0 0 25 0 8 0 545119359 8755335168 2092617 33554432000 4194304 4964704 140735908295248 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=796/tid=804] ppid=794 vsize=8550132 CPUtime=4999.49 cores=0-7
/proc/796/task/804/stat : 804 (claspmt) R 794 796 574 0 -1 4202560 873307 0 0 0 499181 768 0 0 25 0 8 0 545119359 8755335168 2092617 33554432000 4194304 4964704 140735908295248 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 8550132

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5042.2 s]
/proc/loadavg: 8.10 8.11 8.09 10/240 970
/proc/meminfo: memFree=19684752/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=8529448 CPUtime=40001.1 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 2113881 0 0 0 3997913 2193 0 0 25 0 1 0 545119250 8734154752 2081491 33554432000 4194304 4964704 140735908295248 18446744073709551615 246516491242 0 0 4096 18946 0 0 0 17 7 0 0 0
/proc/796/statm: 2132362 2081491 476 189 0 2126711 0
Current children cumulated CPU time (s) 40001.1
Current children cumulated vsize (KiB) 8529448

[startup+5043 s]
/proc/loadavg: 8.10 8.11 8.09 2/234 971
/proc/meminfo: memFree=19728076/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=6104616 CPUtime=40001.9 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 2113881 0 0 0 3997982 2204 0 0 25 0 1 0 545119250 6251126784 1458660 33554432000 4194304 4964704 140735908295248 18446744073709551615 246516877447 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/796/statm: 1526154 1458147 476 189 0 1520503 0
Current children cumulated CPU time (s) 40001.9
Current children cumulated vsize (KiB) 6104616

[startup+5043.2 s]
/proc/loadavg: 8.10 8.11 8.09 2/234 971
/proc/meminfo: memFree=19728076/32951124 swapFree=67102756/67111528
[pid=796] ppid=794 vsize=2033688 CPUtime=40002.1 cores=0-7
/proc/796/stat : 796 (claspmt) R 794 796 574 0 -1 4202496 2113881 0 0 0 3997982 2224 0 0 25 0 1 0 545119250 2082496512 418529 33554432000 4194304 4964704 140735908295248 18446744073709551615 246516877447 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/796/statm: 508422 418017 476 189 0 502771 0
Current children cumulated CPU time (s) 40002.1
Current children cumulated vsize (KiB) 2033688

Child status: 0
Real time (s): 5043.28
CPU time (s): 40002.1
CPU user time (s): 39979.8
CPU system time (s): 22.3226
CPU usage (%): 793.177
Max. virtual memory (cumulated for all children) (KiB): 8550132

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39979.8
system time used= 22.3226
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2113882
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 45290
involuntary context switches= 390785

runsolver used 9.81151 second user time and 26.8719 second system time

The end

Launcher Data 

Begin job on node134 at 2011-05-02 13:20:11
IDJOB=3321302
IDBENCH=20386
IDSOLVER=1711
FILE ID=node134/3321302-1304335210
RUNJOBID= node134-1304332544-588
PBS_JOBID= 13177706
Free space on /tmp= 73140 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT07/industrial/anbulagan/hard-unsat/partial-5-11-u.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321302-1304335210/watcher-3321302-1304335210 -o /tmp/evaluation-result-3321302-1304335210/solver-3321302-1304335210 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321302-1304335210.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 8e22d84b1ae625d44fbf300a32374a2d
RANDOM SEED=990996735

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28069068 kB
Buffers:       1080492 kB
Cached:        1979532 kB
SwapCached:       4840 kB
Active:        1741820 kB
Inactive:      2724752 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28069068 kB
SwapTotal:    67111528 kB
SwapFree:     67102756 kB
Dirty:           13592 kB
Writeback:           0 kB
AnonPages:     1404840 kB
Mapped:          20988 kB
Slab:           341140 kB
PageTables:      12348 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 27853480 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73140 MiB
End job on node134 at 2011-05-02 14:44:14