Trace number 3321487

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 40000.6 5006.31

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v1150c84314g7.cnf
MD5SUMf39e50b5cd7b50d1971722973512a1b8
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark318.765
Satisfiable
(Un)Satisfiability was proved
Number of variables1150
Number of clauses84314
Sum of the clauses size169678
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 284264
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 550

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...343064/instance-3321487-1304343064.cnf
0.19/0.26	c Solving...
40000.15/5005.92	
40000.15/5005.92	*** INTERRUPTED! ***
40000.15/5005.92	*** Shutting down threads...
40000.56/5006.30	s UNKNOWN
40000.56/5006.30	
40000.56/5006.30	c INTERRUPTED   : 1
40000.56/5006.30	c Models        : 0+    
40000.56/5006.30	c Time          : 5005.923s (Solving: 5005.66s 1st Model: 0.00s Unsat: 0.00s)
40000.56/5006.30	c CPU Time      : 40000.190s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321487-1304343064/watcher-3321487-1304343064 -o /tmp/evaluation-result-3321487-1304343064/solver-3321487-1304343064 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321487-1304343064.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.00 8.13 8.23 2/251 8226
/proc/meminfo: memFree=17676132/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=22092 CPUtime=0 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 842 0 0 0 0 0 0 0 25 0 1 0 545905082 22622208 728 33554432000 4194304 4964704 140733720269440 18446744073709551615 251813900997 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/8226/statm: 5523 730 386 189 0 397 0

[startup+0.0672071 s]
/proc/loadavg: 8.00 8.13 8.23 2/251 8226
/proc/meminfo: memFree=17676132/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=26352 CPUtime=0.06 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 2169 0 0 0 6 0 0 0 25 0 1 0 545905082 26984448 1789 33554432000 4194304 4964704 140733720269440 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/8226/statm: 6588 1789 399 189 0 1462 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 26352

[startup+0.100202 s]
/proc/loadavg: 8.00 8.13 8.23 2/251 8226
/proc/meminfo: memFree=17676132/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=26352 CPUtime=0.09 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 2169 0 0 0 9 0 0 0 25 0 1 0 545905082 26984448 1789 33554432000 4194304 4964704 140733720269440 18446744073709551615 4607604 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/8226/statm: 6588 1789 399 189 0 1462 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26352

[startup+0.300213 s]
/proc/loadavg: 8.00 8.13 8.23 2/251 8226
/proc/meminfo: memFree=17676132/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=255324 CPUtime=0.3 cores=0-7
/proc/8226/stat : 8226 (claspmt) S 8224 8226 7873 0 -1 4202496 3099 0 0 0 30 0 0 0 25 0 8 0 545905082 261451776 2529 33554432000 4194304 4964704 140733720269440 18446744073709551615 251826056089 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/8226/statm: 63831 2529 437 189 0 58180 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 255324

[startup+1.34595 s]
/proc/loadavg: 8.00 8.13 8.23 2/251 8226
/proc/meminfo: memFree=17676132/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=326812 CPUtime=10.01 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 12367 0 0 0 995 6 0 0 25 0 8 0 545905082 334655488 11797 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 81703 11797 464 189 0 76052 0
Current children cumulated CPU time (s) 10.01
Current children cumulated vsize (KiB) 326812

[startup+1.63395 s]
/proc/loadavg: 8.00 8.13 8.23 2/251 8226
/proc/meminfo: memFree=17676132/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=327084 CPUtime=10.81 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 12521 0 0 0 1075 6 0 0 25 0 8 0 545905082 334934016 11951 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670314 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 81771 11951 464 189 0 76120 0
Current children cumulated CPU time (s) 10.81
Current children cumulated vsize (KiB) 327084

[startup+3.1007 s]
/proc/loadavg: 7.44 8.01 8.19 9/259 8234
/proc/meminfo: memFree=17615580/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=329524 CPUtime=22.59 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 16119 0 0 0 2250 9 0 0 25 0 8 0 545905082 337432576 15549 33554432000 4194304 4964704 140733720269440 18446744073709551615 4627204 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 82381 15549 464 189 0 76730 0
[pid=8226/tid=8228] ppid=8224 vsize=329524 CPUtime=2.79 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 1453 0 0 0 278 1 0 0 22 0 8 0 545905108 337432576 15549 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670281 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=329524 CPUtime=2.78 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 1613 0 0 0 278 0 0 0 23 0 8 0 545905108 337432576 15549 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=329524 CPUtime=2.79 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 1568 0 0 0 278 1 0 0 22 0 8 0 545905108 337432576 15549 33554432000 4194304 4964704 140733720269440 18446744073709551615 4627536 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=329524 CPUtime=2.75 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 1749 0 0 0 275 0 0 0 22 0 8 0 545905108 337432576 15549 33554432000 4194304 4964704 140733720269440 18446744073709551615 4627185 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=329524 CPUtime=2.83 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 643 0 0 0 283 0 0 0 23 0 8 0 545905108 337432576 15549 33554432000 4194304 4964704 140733720269440 18446744073709551615 4342177 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=329524 CPUtime=2.78 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 1922 0 0 0 277 1 0 0 22 0 8 0 545905108 337432576 15549 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=329524 CPUtime=2.76 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 3233 0 0 0 274 2 0 0 22 0 8 0 545905108 337432576 15549 33554432000 4194304 4964704 140733720269440 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 22.59
Current children cumulated vsize (KiB) 329524

[startup+6.30117 s]
/proc/loadavg: 7.49 8.01 8.19 9/259 8234
/proc/meminfo: memFree=17596848/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=333484 CPUtime=48.09 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 21172 0 0 0 4797 12 0 0 25 0 8 0 545905082 341487616 20602 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 83371 20602 466 189 0 77720 0
[pid=8226/tid=8228] ppid=8224 vsize=333484 CPUtime=5.97 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 1913 0 0 0 596 1 0 0 25 0 8 0 545905108 341487616 20602 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=333484 CPUtime=5.98 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 2239 0 0 0 597 1 0 0 25 0 8 0 545905108 341487616 20602 33554432000 4194304 4964704 140733720269440 18446744073709551615 4627536 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=333484 CPUtime=5.97 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 1944 0 0 0 596 1 0 0 25 0 8 0 545905108 341487616 20602 33554432000 4194304 4964704 140733720269440 18446744073709551615 4627290 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=333484 CPUtime=5.92 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 2210 0 0 0 592 0 0 0 25 0 8 0 545905108 341487616 20602 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=333484 CPUtime=6.02 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 1318 0 0 0 602 0 0 0 25 0 8 0 545905108 341487616 20602 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=333484 CPUtime=5.97 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 2296 0 0 0 596 1 0 0 25 0 8 0 545905108 341487616 20602 33554432000 4194304 4964704 140733720269440 18446744073709551615 251813907418 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=333484 CPUtime=5.95 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 4860 0 0 0 593 2 0 0 19 0 8 0 545905108 341487616 20602 33554432000 4194304 4964704 140733720269440 18446744073709551615 4668820 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 48.09
Current children cumulated vsize (KiB) 333484

[startup+12.7011 s]
/proc/loadavg: 7.53 8.01 8.19 9/259 8234
/proc/meminfo: memFree=17581496/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=337280 CPUtime=99.24 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 24931 0 0 0 9908 16 0 0 25 0 8 0 545905082 345374720 24361 33554432000 4194304 4964704 140733720269440 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 84320 24361 466 189 0 78669 0
[pid=8226/tid=8228] ppid=8224 vsize=337280 CPUtime=12.38 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 2328 0 0 0 1236 2 0 0 25 0 8 0 545905108 345374720 24361 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=337280 CPUtime=12.37 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 2781 0 0 0 1236 1 0 0 25 0 8 0 545905108 345374720 24361 33554432000 4194304 4964704 140733720269440 18446744073709551615 4363327 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=337280 CPUtime=12.37 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 2257 0 0 0 1236 1 0 0 25 0 8 0 545905108 345374720 24361 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=337280 CPUtime=12.28 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 2614 0 0 0 1227 1 0 0 25 0 8 0 545905108 345374720 24361 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=337280 CPUtime=12.42 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 1666 0 0 0 1241 1 0 0 25 0 8 0 545905108 345374720 24361 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=337280 CPUtime=12.37 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 2654 0 0 0 1236 1 0 0 25 0 8 0 545905108 345374720 24361 33554432000 4194304 4964704 140733720269440 18446744073709551615 4342232 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=337280 CPUtime=12.35 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 5888 0 0 0 1232 3 0 0 25 0 8 0 545905108 345374720 24361 33554432000 4194304 4964704 140733720269440 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 99.24
Current children cumulated vsize (KiB) 337280

[startup+25.5009 s]
/proc/loadavg: 7.60 8.01 8.18 9/259 8235
/proc/meminfo: memFree=17542664/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=346456 CPUtime=201.49 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 34555 0 0 0 20126 23 0 0 25 0 8 0 545905082 354770944 33985 33554432000 4194304 4964704 140733720269440 18446744073709551615 4627263 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 86614 33985 466 189 0 80963 0
[pid=8226/tid=8228] ppid=8224 vsize=346456 CPUtime=25.16 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 3439 0 0 0 2513 3 0 0 25 0 8 0 545905108 354770944 33985 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320984 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=346456 CPUtime=25.17 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 4057 0 0 0 2515 2 0 0 25 0 8 0 545905108 354770944 33985 33554432000 4194304 4964704 140733720269440 18446744073709551615 4660105 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=346456 CPUtime=25.17 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 3116 0 0 0 2515 2 0 0 25 0 8 0 545905108 354770944 33985 33554432000 4194304 4964704 140733720269440 18446744073709551615 4653195 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=346456 CPUtime=24.96 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 3580 0 0 0 2494 2 0 0 25 0 8 0 545905108 354770944 33985 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=346456 CPUtime=25.21 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 2651 0 0 0 2520 1 0 0 25 0 8 0 545905108 354770944 33985 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=346456 CPUtime=25.17 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 3387 0 0 0 2515 2 0 0 25 0 8 0 545905108 354770944 33985 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=346456 CPUtime=25.15 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 8483 0 0 0 2510 5 0 0 25 0 8 0 545905108 354770944 33985 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 201.49
Current children cumulated vsize (KiB) 346456

[startup+51.1006 s]
/proc/loadavg: 7.76 8.01 8.18 9/259 8235
/proc/meminfo: memFree=17493416/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=358388 CPUtime=406.03 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 46882 0 0 0 40570 33 0 0 25 0 8 0 545905082 366989312 46284 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 89597 46284 466 189 0 83946 0
[pid=8226/tid=8228] ppid=8224 vsize=358388 CPUtime=50.74 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 5273 0 0 0 5070 4 0 0 25 0 8 0 545905108 366989312 46284 33554432000 4194304 4964704 140733720269440 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=358388 CPUtime=50.77 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 5237 0 0 0 5075 2 0 0 25 0 8 0 545905108 366989312 46284 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=358388 CPUtime=50.76 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 4092 0 0 0 5073 3 0 0 25 0 8 0 545905108 366989312 46284 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=358388 CPUtime=50.35 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 4761 0 0 0 5032 3 0 0 25 0 8 0 545905108 366989312 46284 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=358388 CPUtime=50.81 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 3773 0 0 0 5079 2 0 0 25 0 8 0 545905108 366989312 46284 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=358388 CPUtime=50.76 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 4212 0 0 0 5073 3 0 0 25 0 8 0 545905108 366989312 46284 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=358388 CPUtime=50.75 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 12596 0 0 0 5066 9 0 0 25 0 8 0 545905108 366989312 46284 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 406.03
Current children cumulated vsize (KiB) 358388

[startup+102.301 s]
/proc/loadavg: 7.95 8.02 8.17 9/259 8237
/proc/meminfo: memFree=17427920/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=373368 CPUtime=815.17 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 63583 0 0 0 81470 47 0 0 25 0 8 0 545905082 382328832 62599 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 93342 62599 466 189 0 87691 0
[pid=8226/tid=8228] ppid=8224 vsize=373368 CPUtime=101.93 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 7256 0 0 0 10187 6 0 0 25 0 8 0 545905108 382328832 62599 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=373368 CPUtime=101.97 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 7375 0 0 0 10193 4 0 0 25 0 8 0 545905108 382328832 62599 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=373368 CPUtime=101.95 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 5705 0 0 0 10192 3 0 0 25 0 8 0 545905108 382328832 62599 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0

################
# More data... #
################

[pid=8226] ppid=8224 vsize=1112556 CPUtime=37733.7 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 246548 0 0 0 3773079 288 0 0 25 0 8 0 545905082 1139257344 234530 33554432000 4194304 4964704 140733720269440 18446744073709551615 4653356 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 278139 234530 466 189 0 272488 0
[pid=8226/tid=8228] ppid=8224 vsize=1112556 CPUtime=4697.73 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 33163 0 0 0 469729 44 0 0 25 0 8 0 545905108 1139257344 234530 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=1112556 CPUtime=4713.77 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 42946 0 0 0 471347 30 0 0 25 0 8 0 545905108 1139257344 234530 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=1112556 CPUtime=4721.26 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 17954 0 0 0 472100 26 0 0 25 0 8 0 545905108 1139257344 234530 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=1112556 CPUtime=4718.42 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 24190 0 0 0 471815 27 0 0 25 0 8 0 545905108 1139257344 234530 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=1112556 CPUtime=4721.49 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 24110 0 0 0 472128 21 0 0 25 0 8 0 545905108 1139257344 234530 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=1112556 CPUtime=4717.13 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 18659 0 0 0 471686 27 0 0 25 0 8 0 545905108 1139257344 234530 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=1112556 CPUtime=4721.83 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 62408 0 0 0 472110 73 0 0 25 0 8 0 545905108 1139257344 234530 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37733.7
Current children cumulated vsize (KiB) 1112556

[startup+4782.3 s]
/proc/loadavg: 8.07 8.05 8.00 9/259 8373
/proc/meminfo: memFree=16733480/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=1113628 CPUtime=38213.1 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 247397 0 0 0 3821026 289 0 0 25 0 8 0 545905082 1140355072 235137 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 278407 235137 466 189 0 272756 0
[pid=8226/tid=8228] ppid=8224 vsize=1113628 CPUtime=4757.72 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 33679 0 0 0 475727 45 0 0 25 0 8 0 545905108 1140355072 235137 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=1113628 CPUtime=4773.77 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 43033 0 0 0 477347 30 0 0 25 0 8 0 545905108 1140355072 235137 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=1113628 CPUtime=4781.25 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 17957 0 0 0 478099 26 0 0 25 0 8 0 545905108 1140355072 235137 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=1113628 CPUtime=4777.93 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 24191 0 0 0 477766 27 0 0 25 0 8 0 545905108 1140355072 235137 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=1113628 CPUtime=4781.49 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 24254 0 0 0 478128 21 0 0 25 0 8 0 545905108 1140355072 235137 33554432000 4194304 4964704 140733720269440 18446744073709551615 4627652 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=1113628 CPUtime=4777.12 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 18724 0 0 0 477685 27 0 0 25 0 8 0 545905108 1140355072 235137 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=1113628 CPUtime=4781.83 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 62441 0 0 0 478110 73 0 0 25 0 8 0 545905108 1140355072 235137 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38213.2
Current children cumulated vsize (KiB) 1113628

[startup+4842.3 s]
/proc/loadavg: 8.02 8.04 8.00 9/259 8375
/proc/meminfo: memFree=16731848/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=1113772 CPUtime=38692.6 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 248037 0 0 0 3868973 290 0 0 25 0 8 0 545905082 1140502528 235762 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670215 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 278443 235762 466 189 0 272792 0
[pid=8226/tid=8228] ppid=8224 vsize=1113772 CPUtime=4817.72 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 33857 0 0 0 481727 45 0 0 25 0 8 0 545905108 1140502528 235762 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=1113772 CPUtime=4833.77 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 43094 0 0 0 483346 31 0 0 25 0 8 0 545905108 1140502528 235762 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=1113772 CPUtime=4841.24 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 17988 0 0 0 484098 26 0 0 25 0 8 0 545905108 1140502528 235762 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=1113772 CPUtime=4837.44 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 24356 0 0 0 483717 27 0 0 25 0 8 0 545905108 1140502528 235762 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670454 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=1113772 CPUtime=4841.49 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 24309 0 0 0 484128 21 0 0 25 0 8 0 545905108 1140502528 235762 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=1113772 CPUtime=4837.12 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 18724 0 0 0 483685 27 0 0 25 0 8 0 545905108 1140502528 235762 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=1113772 CPUtime=4841.82 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 62527 0 0 0 484109 73 0 0 25 0 8 0 545905108 1140502528 235762 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38692.6
Current children cumulated vsize (KiB) 1113772

[startup+4902.3 s]
/proc/loadavg: 8.07 8.05 8.00 9/259 8377
/proc/meminfo: memFree=16728108/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=1114832 CPUtime=39172.1 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 248985 0 0 0 3916920 292 0 0 25 0 8 0 545905082 1141587968 236555 33554432000 4194304 4964704 140733720269440 18446744073709551615 4321076 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 278708 236555 466 189 0 273057 0
[pid=8226/tid=8228] ppid=8224 vsize=1114832 CPUtime=4877.7 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 34087 0 0 0 487725 45 0 0 25 0 8 0 545905108 1141587968 236555 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=1114832 CPUtime=4893.77 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 43426 0 0 0 489346 31 0 0 25 0 8 0 545905108 1141587968 236555 33554432000 4194304 4964704 140733720269440 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=1114832 CPUtime=4901.22 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 18028 0 0 0 490096 26 0 0 25 0 8 0 545905108 1141587968 236555 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=1114832 CPUtime=4896.95 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 24513 0 0 0 489668 27 0 0 25 0 8 0 545905108 1141587968 236555 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=1114832 CPUtime=4901.49 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 24385 0 0 0 490128 21 0 0 25 0 8 0 545905108 1141587968 236555 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=1114832 CPUtime=4897.12 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 18769 0 0 0 489685 27 0 0 25 0 8 0 545905108 1141587968 236555 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=1114832 CPUtime=4901.82 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 62570 0 0 0 490108 74 0 0 25 0 8 0 545905108 1141587968 236555 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39172.1
Current children cumulated vsize (KiB) 1114832

[startup+4962.3 s]
/proc/loadavg: 8.02 8.04 8.00 9/259 8378
/proc/meminfo: memFree=16723504/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=1115148 CPUtime=39651.6 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 250321 0 0 0 3964863 295 0 0 25 0 8 0 545905082 1141911552 237825 33554432000 4194304 4964704 140733720269440 18446744073709551615 4342144 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 278787 237825 466 189 0 273136 0
[pid=8226/tid=8228] ppid=8224 vsize=1115148 CPUtime=4937.7 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 34314 0 0 0 493724 46 0 0 25 0 8 0 545905108 1141911552 237825 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=1115148 CPUtime=4953.77 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 43572 0 0 0 495346 31 0 0 25 0 8 0 545905108 1141911552 237825 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=1115148 CPUtime=4961.21 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 18036 0 0 0 496095 26 0 0 25 0 8 0 545905108 1141911552 237825 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=1115148 CPUtime=4956.46 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 24794 0 0 0 495618 28 0 0 25 0 8 0 545905108 1141911552 237825 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=1115148 CPUtime=4961.49 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 24494 0 0 0 496127 22 0 0 25 0 8 0 545905108 1141911552 237825 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=1115148 CPUtime=4957.12 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 18871 0 0 0 495685 27 0 0 25 0 8 0 545905108 1141911552 237825 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=1115148 CPUtime=4961.82 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 63018 0 0 0 496107 75 0 0 25 0 8 0 545905108 1141911552 237825 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39651.6
Current children cumulated vsize (KiB) 1115148



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5005.9 s]
/proc/loadavg: 8.08 8.04 8.00 10/259 8379
/proc/meminfo: memFree=16722120/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=1115556 CPUtime=40000.1 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 250657 0 0 0 3999719 296 0 0 25 0 8 0 545905082 1142329344 238161 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320909 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/8226/statm: 278889 238161 466 189 0 273238 0
[pid=8226/tid=8228] ppid=8224 vsize=1115556 CPUtime=4981.32 cores=0-7
/proc/8226/task/8228/stat : 8228 (claspmt) R 8224 8226 7873 0 -1 4202560 34314 0 0 0 498086 46 0 0 25 0 8 0 545905108 1142329344 238161 33554432000 4194304 4964704 140733720269440 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=8226/tid=8229] ppid=8224 vsize=1115556 CPUtime=4997.38 cores=0-7
/proc/8226/task/8229/stat : 8229 (claspmt) R 8224 8226 7873 0 -1 4202560 43658 0 0 0 499707 31 0 0 25 0 8 0 545905108 1142329344 238161 33554432000 4194304 4964704 140733720269440 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=8226/tid=8230] ppid=8224 vsize=1115556 CPUtime=5004.81 cores=0-7
/proc/8226/task/8230/stat : 8230 (claspmt) R 8224 8226 7873 0 -1 4202560 18044 0 0 0 500455 26 0 0 25 0 8 0 545905108 1142329344 238161 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=8226/tid=8231] ppid=8224 vsize=1115556 CPUtime=4999.71 cores=0-7
/proc/8226/task/8231/stat : 8231 (claspmt) R 8224 8226 7873 0 -1 4202560 24801 0 0 0 499943 28 0 0 25 0 8 0 545905108 1142329344 238161 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=8226/tid=8232] ppid=8224 vsize=1115556 CPUtime=5005.11 cores=0-7
/proc/8226/task/8232/stat : 8232 (claspmt) R 8224 8226 7873 0 -1 4202560 24580 0 0 0 500489 22 0 0 25 0 8 0 545905108 1142329344 238161 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=8226/tid=8233] ppid=8224 vsize=1115556 CPUtime=5000.73 cores=0-7
/proc/8226/task/8233/stat : 8233 (claspmt) R 8224 8226 7873 0 -1 4202560 18956 0 0 0 500046 27 0 0 25 0 8 0 545905108 1142329344 238161 33554432000 4194304 4964704 140733720269440 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=8226/tid=8234] ppid=8224 vsize=1115556 CPUtime=5005.44 cores=0-7
/proc/8226/task/8234/stat : 8234 (claspmt) R 8224 8226 7873 0 -1 4202560 63045 0 0 0 500469 75 0 0 25 0 8 0 545905108 1142329344 238161 33554432000 4194304 4964704 140733720269440 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 1115556

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5006.02 s]
/proc/loadavg: 8.08 8.04 8.00 10/259 8379
/proc/meminfo: memFree=16722120/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=1115412 CPUtime=40000.3 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 250667 0 0 0 3999733 296 0 0 25 0 1 0 545905082 1142181888 238055 33554432000 4194304 4964704 140733720269440 18446744073709551615 251813895521 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/8226/statm: 278853 238055 476 189 0 273202 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 1115412

[startup+5006.2 s]
/proc/loadavg: 8.08 8.04 8.00 10/259 8379
/proc/meminfo: memFree=16722120/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=1108116 CPUtime=40000.5 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 250667 0 0 0 3999750 296 0 0 25 0 1 0 545905082 1134710784 236328 33554432000 4194304 4964704 140733720269440 18446744073709551615 251813895291 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/8226/statm: 277029 236328 476 189 0 271378 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 1108116

[startup+5006.3 s]
/proc/loadavg: 8.08 8.04 8.00 10/259 8379
/proc/meminfo: memFree=16722120/32950928 swapFree=67111448/67111528
[pid=8226] ppid=8224 vsize=320816 CPUtime=40000.6 cores=0-7
/proc/8226/stat : 8226 (claspmt) R 8224 8226 7873 0 -1 4202496 250667 0 0 0 3999756 300 0 0 25 0 1 0 545905082 328515584 31079 33554432000 4194304 4964704 140733720269440 18446744073709551615 251814283623 0 0 4096 18946 0 0 0 17 0 0 0 0
/proc/8226/statm: 80204 31079 476 189 0 74553 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 320816

Child status: 0
Real time (s): 5006.31
CPU time (s): 40000.6
CPU user time (s): 39997.6
CPU system time (s): 3.01354
CPU usage (%): 799.003
Max. virtual memory (cumulated for all children) (KiB): 1115556

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39997.6
system time used= 3.01354
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 250668
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 110559
involuntary context switches= 189994

runsolver used 11.8072 second user time and 29.1496 second system time

The end

Launcher Data 

Begin job on node126 at 2011-05-02 15:31:04
IDJOB=3321487
IDBENCH=71337
IDSOLVER=1711
FILE ID=node126/3321487-1304343064
RUNJOBID= node126-1304337728-7887
PBS_JOBID= 13178045
Free space on /tmp= 73656 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v1150c84314g7.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321487-1304343064/watcher-3321487-1304343064 -o /tmp/evaluation-result-3321487-1304343064/solver-3321487-1304343064 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321487-1304343064.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= f39e50b5cd7b50d1971722973512a1b8
RANDOM SEED=757560541

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17676536 kB
Buffers:        335396 kB
Cached:        1966280 kB
SwapCached:         76 kB
Active:       13026692 kB
Inactive:      1887712 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17676536 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:            1968 kB
Writeback:           0 kB
AnonPages:    12612952 kB
Mapped:          22484 kB
Slab:           260932 kB
PageTables:      37652 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 35610164 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73652 MiB
End job on node126 at 2011-05-02 16:54:32