Trace number 3322564

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 26307.9 5100.14

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_80_17_90_7-log.shuffled-as.sat03-190.cnf
MD5SUMad30956261e72142648a01bc7c025dba
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables85
Number of clauses29282
Sum of the clauses size292650
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 534
Number of clauses of size over 529248

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...389082/instance-3322564-1304389082.cnf
1.69/1.72	c Solving...
26307.64/5100.05	
26307.64/5100.05	*** INTERRUPTED! ***
26307.64/5100.05	*** Shutting down threads...
26307.90/5100.14	s UNKNOWN
26307.90/5100.14	
26307.90/5100.14	c INTERRUPTED   : 1
26307.90/5100.14	c Models        : 0+    
26307.90/5100.14	c Time          : 5100.053s (Solving: 5098.33s 1st Model: 0.00s Unsat: 0.00s)
26307.90/5100.14	c CPU Time      : 26307.830s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322564-1304389082/watcher-3322564-1304389082 -o /tmp/evaluation-result-3322564-1304389082/solver-3322564-1304389082 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322564-1304389082.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.90 11.12 11.33 5/409 26098
/proc/meminfo: memFree=18818676/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=22156 CPUtime=0.01 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 834 0 0 0 1 0 0 0 25 0 1 0 629138956 22687744 763 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988253381 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/26098/statm: 5539 763 386 189 0 413 0

[startup+0.067509 s]
/proc/loadavg: 9.90 11.12 11.33 5/409 26098
/proc/meminfo: memFree=18818676/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=25060 CPUtime=0.06 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 1626 0 0 0 6 0 0 0 25 0 1 0 629138956 25661440 1465 33554432000 4194304 4964704 140735022482400 18446744073709551615 4608023 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/26098/statm: 6265 1465 399 189 0 1139 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 25060

[startup+0.100503 s]
/proc/loadavg: 9.90 11.12 11.33 5/409 26098
/proc/meminfo: memFree=18818676/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=25060 CPUtime=0.09 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 1626 0 0 0 9 0 0 0 25 0 1 0 629138956 25661440 1465 33554432000 4194304 4964704 140735022482400 18446744073709551615 4608433 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/26098/statm: 6265 1465 399 189 0 1139 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25060

[startup+0.300468 s]
/proc/loadavg: 9.90 11.12 11.33 5/409 26098
/proc/meminfo: memFree=18818676/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=25060 CPUtime=0.29 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 1627 0 0 0 29 0 0 0 25 0 1 0 629138956 25661440 1466 33554432000 4194304 4964704 140735022482400 18446744073709551615 4608013 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/26098/statm: 6265 1466 399 189 0 1139 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 25060

[startup+0.700399 s]
/proc/loadavg: 9.90 11.12 11.33 5/409 26098
/proc/meminfo: memFree=18818676/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=25060 CPUtime=0.69 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 1627 0 0 0 69 0 0 0 25 0 1 0 629138956 25661440 1466 33554432000 4194304 4964704 140735022482400 18446744073709551615 4607761 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/26098/statm: 6265 1466 399 189 0 1139 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 25060

[startup+1.50026 s]
/proc/loadavg: 9.90 11.12 11.33 5/410 26099
/proc/meminfo: memFree=18813708/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=25060 CPUtime=1.49 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 1634 0 0 0 149 0 0 0 25 0 1 0 629138956 25661440 1473 33554432000 4194304 4964704 140735022482400 18446744073709551615 4607513 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/26098/statm: 6265 1473 399 189 0 1139 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 25060

[startup+3.10099 s]
/proc/loadavg: 9.90 11.12 11.33 12/417 26106
/proc/meminfo: memFree=18794060/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=390128 CPUtime=8.42 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 8610 0 0 0 840 2 0 0 25 0 8 0 629138956 399491072 8381 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26098/statm: 97532 8381 464 189 0 91881 0
[pid=26098/tid=26100] ppid=26096 vsize=390128 CPUtime=0.86 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 899 0 0 0 86 0 0 0 25 0 8 0 629139129 399491072 8381 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=390128 CPUtime=1.25 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 1236 0 0 0 125 0 0 0 19 0 8 0 629139129 399491072 8381 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=390128 CPUtime=0.76 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 832 0 0 0 76 0 0 0 25 0 8 0 629139129 399491072 8381 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988697582 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=390128 CPUtime=0.74 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 967 0 0 0 74 0 0 0 25 0 8 0 629139129 399491072 8381 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=390128 CPUtime=0.6 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 613 0 0 0 60 0 0 0 25 0 8 0 629139129 399491072 8381 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988697582 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=390128 CPUtime=0.57 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 782 0 0 0 57 0 0 0 25 0 8 0 629139129 399491072 8381 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=390128 CPUtime=0.59 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 835 0 0 0 59 0 0 0 25 0 8 0 629139129 399491072 8381 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 8.42
Current children cumulated vsize (KiB) 390128

[startup+6.30043 s]
/proc/loadavg: 9.99 11.12 11.33 12/417 26106
/proc/meminfo: memFree=18776092/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=391936 CPUtime=24.37 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 11788 0 0 0 2434 3 0 0 25 0 8 0 629138956 401342464 11559 33554432000 4194304 4964704 140735022482400 18446744073709551615 4626992 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26098/statm: 97984 11559 466 189 0 92333 0
[pid=26098/tid=26100] ppid=26096 vsize=391936 CPUtime=2.23 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 1167 0 0 0 223 0 0 0 25 0 8 0 629139129 401342464 11559 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670332 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=391936 CPUtime=4.44 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 2364 0 0 0 444 0 0 0 25 0 8 0 629139129 401342464 11559 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=391936 CPUtime=2.75 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 1005 0 0 0 275 0 0 0 25 0 8 0 629139129 401342464 11559 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=391936 CPUtime=2.19 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 1313 0 0 0 219 0 0 0 25 0 8 0 629139129 401342464 11559 33554432000 4194304 4964704 140735022482400 18446744073709551615 4319906 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=391936 CPUtime=2.34 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 941 0 0 0 234 0 0 0 25 0 8 0 629139129 401342464 11559 33554432000 4194304 4964704 140735022482400 18446744073709551615 4660755 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=391936 CPUtime=1.77 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 940 0 0 0 177 0 0 0 25 0 8 0 629139129 401342464 11559 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988697582 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=391936 CPUtime=2.38 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 1233 0 0 0 238 0 0 0 25 0 8 0 629139129 401342464 11559 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988697582 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.37
Current children cumulated vsize (KiB) 391936

[startup+12.7003 s]
/proc/loadavg: 10.07 11.12 11.33 12/417 26106
/proc/meminfo: memFree=18760632/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=393832 CPUtime=56.27 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 15293 0 0 0 5622 5 0 0 25 0 8 0 629138956 403283968 14943 33554432000 4194304 4964704 140735022482400 18446744073709551615 4320890 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26098/statm: 98458 14943 466 189 0 92807 0
[pid=26098/tid=26100] ppid=26096 vsize=393832 CPUtime=5.23 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 1481 0 0 0 523 0 0 0 25 0 8 0 629139129 403283968 14943 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=393832 CPUtime=9.55 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 3505 0 0 0 954 1 0 0 24 0 8 0 629139129 403283968 14943 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=393832 CPUtime=6.23 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 1210 0 0 0 623 0 0 0 25 0 8 0 629139129 403283968 14943 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=393832 CPUtime=6.09 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 1763 0 0 0 609 0 0 0 25 0 8 0 629139129 403283968 14943 33554432000 4194304 4964704 140735022482400 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=393832 CPUtime=6.13 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 1424 0 0 0 613 0 0 0 25 0 8 0 629139129 403283968 14943 33554432000 4194304 4964704 140735022482400 18446744073709551615 4627832 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=393832 CPUtime=4.69 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 1187 0 0 0 469 0 0 0 25 0 8 0 629139129 403283968 14943 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=393832 CPUtime=5.69 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 1499 0 0 0 569 0 0 0 25 0 8 0 629139129 403283968 14943 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 56.27
Current children cumulated vsize (KiB) 393832

[startup+25.5011 s]
/proc/loadavg: 10.28 11.11 11.32 12/417 26107
/proc/meminfo: memFree=18745140/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=397096 CPUtime=121.64 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 19374 0 0 0 12156 8 0 0 24 0 8 0 629138956 406626304 19024 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/26098/statm: 99274 19024 466 189 0 93623 0
[pid=26098/tid=26100] ppid=26096 vsize=397096 CPUtime=11.46 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 2048 0 0 0 1146 0 0 0 25 0 8 0 629139129 406626304 19024 33554432000 4194304 4964704 140735022482400 18446744073709551615 4626894 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=397096 CPUtime=19 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 4156 0 0 0 1899 1 0 0 25 0 8 0 629139129 406626304 19024 33554432000 4194304 4964704 140735022482400 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=397096 CPUtime=13.85 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 1626 0 0 0 1385 0 0 0 25 0 8 0 629139129 406626304 19024 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=397096 CPUtime=14.79 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 2447 0 0 0 1479 0 0 0 25 0 8 0 629139129 406626304 19024 33554432000 4194304 4964704 140735022482400 18446744073709551615 4334298 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=397096 CPUtime=17.42 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 1993 0 0 0 1741 1 0 0 25 0 8 0 629139129 406626304 19024 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=397096 CPUtime=12.61 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 1769 0 0 0 1260 1 0 0 25 0 8 0 629139129 406626304 19024 33554432000 4194304 4964704 140735022482400 18446744073709551615 4654508 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=397096 CPUtime=12.67 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 1880 0 0 0 1266 1 0 0 25 0 8 0 629139129 406626304 19024 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 121.64
Current children cumulated vsize (KiB) 397096

[startup+51.1006 s]
/proc/loadavg: 10.52 11.10 11.31 12/417 26107
/proc/meminfo: memFree=18723908/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=400156 CPUtime=250.52 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 25076 0 0 0 25039 13 0 0 25 0 8 0 629138956 409759744 24677 33554432000 4194304 4964704 140735022482400 18446744073709551615 4642509 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26098/statm: 100039 24677 466 189 0 94388 0
[pid=26098/tid=26100] ppid=26096 vsize=400156 CPUtime=24.69 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 2696 0 0 0 2469 0 0 0 25 0 8 0 629139129 409759744 24677 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988697582 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=400156 CPUtime=39.2 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 5046 0 0 0 3918 2 0 0 25 0 8 0 629139129 409759744 24677 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=400156 CPUtime=27.7 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 2131 0 0 0 2769 1 0 0 25 0 8 0 629139129 409759744 24677 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988290170 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=400156 CPUtime=31.7 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 3228 0 0 0 3170 0 0 0 25 0 8 0 629139129 409759744 24677 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=400156 CPUtime=30.65 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 2498 0 0 0 3063 2 0 0 25 0 8 0 629139129 409759744 24677 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=400156 CPUtime=29.78 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 2530 0 0 0 2977 1 0 0 25 0 8 0 629139129 409759744 24677 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=400156 CPUtime=35.19 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 3062 0 0 0 3517 2 0 0 25 0 8 0 629139129 409759744 24677 33554432000 4194304 4964704 140735022482400 18446744073709551615 4321069 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 250.52
Current children cumulated vsize (KiB) 400156

[startup+102.316 s]
/proc/loadavg: 10.84 11.10 11.30 12/417 26109
/proc/meminfo: memFree=18695868/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=409276 CPUtime=506.81 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 31799 0 0 0 50664 17 0 0 25 0 8 0 629138956 419098624 31285 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988697582 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26098/statm: 102319 31285 466 189 0 96668 0
[pid=26098/tid=26100] ppid=26096 vsize=409276 CPUtime=52.98 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 3715 0 0 0 5297 1 0 0 25 0 8 0 629139129 419098624 31285 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=409276 CPUtime=77.7 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 6264 0 0 0 7768 2 0 0 25 0 8 0 629139129 419098624 31285 33554432000 4194304 4964704 140735022482400 18446744073709551615 4320939 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=409276 CPUtime=53.49 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 2545 0 0 0 5348 1 0 0 25 0 8 0 629139129 419098624 31285 33554432000 4194304 4964704 140735022482400 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=26098/tid=26101] ppid=26096 vsize=517004 CPUtime=3160.42 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 17616 0 0 0 316013 29 0 0 25 0 8 0 629139129 529412096 86735 33554432000 4194304 4964704 140735022482400 18446744073709551615 4361344 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=517004 CPUtime=2981.15 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 6398 0 0 0 298090 25 0 0 25 0 8 0 629139129 529412096 86735 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=517004 CPUtime=3322.97 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 13250 0 0 0 332268 29 0 0 25 0 8 0 629139129 529412096 86735 33554432000 4194304 4964704 140735022482400 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=517004 CPUtime=3090.04 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 12024 0 0 0 308973 31 0 0 25 0 8 0 629139129 529412096 86735 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=517004 CPUtime=2905.69 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 7963 0 0 0 290539 30 0 0 25 0 8 0 629139129 529412096 86735 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=517004 CPUtime=3232.09 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 10705 0 0 0 323177 32 0 0 25 0 8 0 629139129 529412096 86735 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24706.7
Current children cumulated vsize (KiB) 517004

[startup+4842.3 s]
/proc/loadavg: 11.08 11.08 11.07 12/417 26247
/proc/meminfo: memFree=18471632/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=517288 CPUtime=25005.8 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 91213 0 0 0 2500344 239 0 0 25 0 8 0 629138956 529702912 86810 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26098/statm: 129322 86810 466 189 0 123671 0
[pid=26098/tid=26100] ppid=26096 vsize=517288 CPUtime=3051.49 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 13867 0 0 0 305122 27 0 0 25 0 8 0 629139129 529702912 86810 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=517288 CPUtime=3192.42 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 17668 0 0 0 319213 29 0 0 25 0 8 0 629139129 529702912 86810 33554432000 4194304 4964704 140735022482400 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=517288 CPUtime=3010.77 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 6398 0 0 0 301052 25 0 0 25 0 8 0 629139129 529702912 86810 33554432000 4194304 4964704 140735022482400 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=517288 CPUtime=3369.96 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 13250 0 0 0 336967 29 0 0 25 0 8 0 629139129 529702912 86810 33554432000 4194304 4964704 140735022482400 18446744073709551615 4332144 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=517288 CPUtime=3120.41 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 12024 0 0 0 312010 31 0 0 25 0 8 0 629139129 529702912 86810 33554432000 4194304 4964704 140735022482400 18446744073709551615 4320872 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=517288 CPUtime=2935.03 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 7963 0 0 0 293473 30 0 0 25 0 8 0 629139129 529702912 86810 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988697582 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=517288 CPUtime=3275.25 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 10711 0 0 0 327492 33 0 0 25 0 8 0 629139129 529702912 86810 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25005.8
Current children cumulated vsize (KiB) 517288

[startup+4902.3 s]
/proc/loadavg: 11.16 11.11 11.08 12/417 26252
/proc/meminfo: memFree=18470688/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=517288 CPUtime=25312.9 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 91360 0 0 0 2531050 241 0 0 25 0 8 0 629138956 529702912 86957 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670248 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26098/statm: 129322 86957 466 189 0 123671 0
[pid=26098/tid=26100] ppid=26096 vsize=517288 CPUtime=3102.05 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 13950 0 0 0 310178 27 0 0 25 0 8 0 629139129 529702912 86957 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=517288 CPUtime=3229.15 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 17668 0 0 0 322886 29 0 0 25 0 8 0 629139129 529702912 86957 33554432000 4194304 4964704 140735022482400 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=517288 CPUtime=3040.03 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 6449 0 0 0 303978 25 0 0 25 0 8 0 629139129 529702912 86957 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=517288 CPUtime=3425.25 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 13258 0 0 0 342496 29 0 0 25 0 8 0 629139129 529702912 86957 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=517288 CPUtime=3151.16 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 12024 0 0 0 315084 32 0 0 25 0 8 0 629139129 529702912 86957 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=517288 CPUtime=2965.55 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 7963 0 0 0 296524 31 0 0 25 0 8 0 629139129 529702912 86957 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670291 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=517288 CPUtime=3307.03 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 10711 0 0 0 330670 33 0 0 25 0 8 0 629139129 529702912 86957 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25312.9
Current children cumulated vsize (KiB) 517288

[startup+4962.3 s]
/proc/loadavg: 11.12 11.10 11.08 12/417 26253
/proc/meminfo: memFree=18470400/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=517288 CPUtime=25620.9 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 91527 0 0 0 2561852 243 0 0 25 0 8 0 629138956 529702912 87124 33554432000 4194304 4964704 140735022482400 18446744073709551615 4659143 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26098/statm: 129322 87124 466 189 0 123671 0
[pid=26098/tid=26100] ppid=26096 vsize=517288 CPUtime=3147.1 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 13965 0 0 0 314682 28 0 0 25 0 8 0 629139129 529702912 87124 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=517288 CPUtime=3285.28 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 17741 0 0 0 328498 30 0 0 25 0 8 0 629139129 529702912 87124 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=517288 CPUtime=3069.63 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 6449 0 0 0 306938 25 0 0 25 0 8 0 629139129 529702912 87124 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=517288 CPUtime=3467.87 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 13262 0 0 0 346757 30 0 0 25 0 8 0 629139129 529702912 87124 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=517288 CPUtime=3182.37 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 12034 0 0 0 318205 32 0 0 25 0 8 0 629139129 529702912 87124 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=517288 CPUtime=2996.84 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 7973 0 0 0 299653 31 0 0 25 0 8 0 629139129 529702912 87124 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=517288 CPUtime=3336.74 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 10711 0 0 0 333641 33 0 0 25 0 8 0 629139129 529702912 87124 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25620.9
Current children cumulated vsize (KiB) 517288

[startup+5022.3 s]
/proc/loadavg: 11.10 11.10 11.07 12/417 26255
/proc/meminfo: memFree=18470116/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=517572 CPUtime=25920.1 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 91679 0 0 0 2591769 245 0 0 25 0 8 0 629138956 529993728 87276 33554432000 4194304 4964704 140735022482400 18446744073709551615 4660139 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26098/statm: 129393 87276 466 189 0 123742 0
[pid=26098/tid=26100] ppid=26096 vsize=517572 CPUtime=3182.94 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 13971 0 0 0 318266 28 0 0 25 0 8 0 629139129 529993728 87276 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988697582 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=517572 CPUtime=3325.1 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 17816 0 0 0 332480 30 0 0 25 0 8 0 629139129 529993728 87276 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=517572 CPUtime=3106.43 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 6502 0 0 0 310617 26 0 0 25 0 8 0 629139129 529993728 87276 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=517572 CPUtime=3500.39 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 13262 0 0 0 350009 30 0 0 25 0 8 0 629139129 529993728 87276 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=517572 CPUtime=3211.88 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 12045 0 0 0 321156 32 0 0 24 0 8 0 629139129 529993728 87276 33554432000 4194304 4964704 140735022482400 18446744073709551615 4644860 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=517572 CPUtime=3038.33 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 7974 0 0 0 303802 31 0 0 25 0 8 0 629139129 529993728 87276 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=517572 CPUtime=3366.13 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 10711 0 0 0 336579 34 0 0 25 0 8 0 629139129 529993728 87276 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988697582 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25920.1
Current children cumulated vsize (KiB) 517572

[startup+5082.3 s]
/proc/loadavg: 11.09 11.09 11.07 12/417 26256
/proc/meminfo: memFree=18469456/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=517572 CPUtime=26219.3 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 91893 0 0 0 2621684 247 0 0 25 0 8 0 629138956 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670454 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26098/statm: 129393 87490 466 189 0 123742 0
[pid=26098/tid=26100] ppid=26096 vsize=517572 CPUtime=3224.27 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 14103 0 0 0 322399 28 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=517572 CPUtime=3354.9 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 17816 0 0 0 335460 30 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4653167 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=517572 CPUtime=3151.02 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 6511 0 0 0 315076 26 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=517572 CPUtime=3545.43 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 13263 0 0 0 354513 30 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=517572 CPUtime=3242.2 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 12054 0 0 0 324188 32 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=517572 CPUtime=3071.02 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 8027 0 0 0 307070 32 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=517572 CPUtime=3402.27 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 10721 0 0 0 340193 34 0 0 21 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 26219.3
Current children cumulated vsize (KiB) 517572



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 11.06 11.08 11.07 12/417 26257
/proc/meminfo: memFree=18469320/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=517572 CPUtime=26307.6 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 91893 0 0 0 2630516 248 0 0 25 0 8 0 629138956 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988697582 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/26098/statm: 129393 87490 466 189 0 123742 0
[pid=26098/tid=26100] ppid=26096 vsize=517572 CPUtime=3236.9 cores=0-7
/proc/26098/task/26100/stat : 26100 (claspmt) R 26096 26098 26072 0 -1 4202560 14103 0 0 0 323662 28 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4312137 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26098/tid=26101] ppid=26096 vsize=517572 CPUtime=3364 cores=0-7
/proc/26098/task/26101/stat : 26101 (claspmt) R 26096 26098 26072 0 -1 4202560 17816 0 0 0 336370 30 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26102] ppid=26096 vsize=517572 CPUtime=3159.43 cores=0-7
/proc/26098/task/26102/stat : 26102 (claspmt) R 26096 26098 26072 0 -1 4202560 6511 0 0 0 315917 26 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=26098/tid=26103] ppid=26096 vsize=517572 CPUtime=3559.3 cores=0-7
/proc/26098/task/26103/stat : 26103 (claspmt) R 26096 26098 26072 0 -1 4202560 13263 0 0 0 355900 30 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4320849 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26098/tid=26104] ppid=26096 vsize=517572 CPUtime=3256.29 cores=0-7
/proc/26098/task/26104/stat : 26104 (claspmt) R 26096 26098 26072 0 -1 4202560 12054 0 0 0 325597 32 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26098/tid=26105] ppid=26096 vsize=517572 CPUtime=3079.63 cores=0-7
/proc/26098/task/26105/stat : 26105 (claspmt) R 26096 26098 26072 0 -1 4202560 8027 0 0 0 307931 32 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26098/tid=26106] ppid=26096 vsize=517572 CPUtime=3411.57 cores=0-7
/proc/26098/task/26106/stat : 26106 (claspmt) R 26096 26098 26072 0 -1 4202560 10721 0 0 0 341123 34 0 0 25 0 8 0 629139129 529993728 87490 33554432000 4194304 4964704 140735022482400 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 26307.6
Current children cumulated vsize (KiB) 517572

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5100.12 s]
/proc/loadavg: 11.06 11.08 11.07 12/417 26257
/proc/meminfo: memFree=18469320/32950940 swapFree=67111364/67111528
[pid=26098] ppid=26096 vsize=448496 CPUtime=26307.9 cores=0-7
/proc/26098/stat : 26098 (claspmt) R 26096 26098 26072 0 -1 4202496 91903 0 0 0 2630542 248 0 0 24 0 1 0 629138956 459259904 85626 33554432000 4194304 4964704 140735022482400 18446744073709551615 215988247905 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/26098/statm: 112124 85626 476 189 0 106473 0
Current children cumulated CPU time (s) 26307.9
Current children cumulated vsize (KiB) 448496

Child status: 0
Real time (s): 5100.14
CPU time (s): 26307.9
CPU user time (s): 26305.4
CPU system time (s): 2.49862
CPU usage (%): 515.827
Max. virtual memory (cumulated for all children) (KiB): 517572

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 26305.4
system time used= 2.49862
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 91904
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 202854
involuntary context switches= 325128

runsolver used 20.1719 second user time and 49.3355 second system time

The end

Launcher Data 

Begin job on node117 at 2011-05-03 04:18:02
IDJOB=3322564
IDBENCH=83924
IDSOLVER=1711
FILE ID=node117/3322564-1304389082
RUNJOBID= node117-1304389082-26086
PBS_JOBID= 13181825
Free space on /tmp= 72628 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_80_17_90_7-log.shuffled-as.sat03-190.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322564-1304389082/watcher-3322564-1304389082 -o /tmp/evaluation-result-3322564-1304389082/solver-3322564-1304389082 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322564-1304389082.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ad30956261e72142648a01bc7c025dba
RANDOM SEED=2035511648

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      18818956 kB
Buffers:       1035796 kB
Cached:        4622164 kB
SwapCached:        160 kB
Active:        8468580 kB
Inactive:      5135364 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      18818956 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            2088 kB
Writeback:           0 kB
AnonPages:     7947004 kB
Mapped:          31864 kB
Slab:           416724 kB
PageTables:      44608 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 101194468 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72628 MiB
End job on node117 at 2011-05-03 05:43:04