Trace number 3321509

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 40001.1 5007.17

General information on the benchmark

NameCRAFTED/rbsat/crafted/forced/
rbsat-v945c61409gyes7.cnf
MD5SUM6200c727c8a5a324974090a1f9a6d7ab
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark21.61
Satisfiable
(Un)Satisfiability was proved
Number of variables945
Number of clauses61409
Sum of the clauses size123673
Maximum clause length21
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 261364
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data 

0.00/0.02	c clasp version 2.0.0-RC2
0.00/0.02	c Reading from ...357184/instance-3321509-1304357184.cnf
0.17/0.20	c Solving...
40000.80/5006.91	
40000.80/5006.91	*** INTERRUPTED! ***
40000.80/5006.91	*** Shutting down threads...
40001.02/5007.16	s UNKNOWN
40001.02/5007.16	
40001.02/5007.16	c INTERRUPTED   : 1
40001.02/5007.16	c Models        : 0+    
40001.02/5007.16	c Time          : 5006.890s (Solving: 5006.71s 1st Model: 0.00s Unsat: 0.00s)
40001.02/5007.16	c CPU Time      : 40000.840s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3321509-1304357184/watcher-3321509-1304357184 -o /tmp/evaluation-result-3321509-1304357184/solver-3321509-1304357184 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321509-1304357184.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.58 6.86 5.92 1/298 15810
/proc/meminfo: memFree=17091852/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=20924 CPUtime=0 cores=0-7
/proc/15810/stat : 15810 (claspmt) D 15808 15810 14423 0 -1 4194304 363 0 0 0 0 0 0 0 21 0 1 0 528134724 21426176 298 33554432000 4194304 4964704 140734405708496 18446744073709551615 212034731655 0 0 4096 0 18446744071562154983 0 0 17 4 0 0 0
/proc/15810/statm: 5231 298 252 189 0 92 0

[startup+0.0505259 s]
/proc/loadavg: 7.58 6.86 5.92 1/298 15810
/proc/meminfo: memFree=17091852/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=24792 CPUtime=0.02 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 1692 0 0 0 2 0 0 0 21 0 1 0 528134724 25387008 1434 33554432000 4194304 4964704 140734405708496 18446744073709551615 4607549 0 0 4096 18946 0 0 0 17 2 0 0 2
/proc/15810/statm: 6198 1434 399 189 0 1072 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 24792

[startup+0.100521 s]
/proc/loadavg: 7.58 6.86 5.92 1/298 15810
/proc/meminfo: memFree=17091852/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=24792 CPUtime=0.07 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 1692 0 0 0 7 0 0 0 21 0 1 0 528134724 25387008 1434 33554432000 4194304 4964704 140734405708496 18446744073709551615 4607575 0 0 4096 18946 0 0 0 17 2 0 0 2
/proc/15810/statm: 6198 1434 399 189 0 1072 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 24792

[startup+0.300474 s]
/proc/loadavg: 7.58 6.86 5.92 1/298 15810
/proc/meminfo: memFree=17091852/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=384944 CPUtime=0.59 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 3643 0 0 0 57 2 0 0 25 0 8 0 528134724 394182656 3250 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670266 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 96236 3250 464 189 0 90585 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 384944

[startup+0.700372 s]
/proc/loadavg: 7.58 6.86 5.92 1/298 15810
/proc/meminfo: memFree=17091852/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=452484 CPUtime=3.76 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 8065 0 0 0 371 5 0 0 25 0 8 0 528134724 463343616 7672 33554432000 4194304 4964704 140734405708496 18446744073709551615 212039698615 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 113121 7674 464 189 0 107470 0
Current children cumulated CPU time (s) 3.76
Current children cumulated vsize (KiB) 452484

[startup+1.50123 s]
/proc/loadavg: 7.58 6.86 5.92 9/306 15818
/proc/meminfo: memFree=17057888/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=453940 CPUtime=10.16 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 11854 0 0 0 1010 6 0 0 25 0 8 0 528134724 464834560 11461 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670462 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 113485 11462 464 189 0 107834 0
[pid=15810/tid=15812] ppid=15808 vsize=453940 CPUtime=1.24 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 1176 0 0 0 124 0 0 0 19 0 8 0 528134745 464834560 11462 33554432000 4194304 4964704 140734405708496 18446744073709551615 4668958 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=453940 CPUtime=1.25 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 1300 0 0 0 124 1 0 0 19 0 8 0 528134745 464834560 11462 33554432000 4194304 4964704 140734405708496 18446744073709551615 4321061 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=453940 CPUtime=1.24 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 1076 0 0 0 124 0 0 0 19 0 8 0 528134745 464834560 11462 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=453940 CPUtime=1.24 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 1276 0 0 0 124 0 0 0 19 0 8 0 528134745 464834560 11462 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320916 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=453940 CPUtime=1.2 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 548 0 0 0 120 0 0 0 19 0 8 0 528134745 464834560 11462 33554432000 4194304 4964704 140734405708496 18446744073709551615 4627168 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=453940 CPUtime=1.24 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 1317 0 0 0 124 0 0 0 19 0 8 0 528134745 464834560 11462 33554432000 4194304 4964704 140734405708496 18446744073709551615 212039316513 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=453940 CPUtime=1.25 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 2116 0 0 0 124 1 0 0 19 0 8 0 528134745 464834560 11463 33554432000 4194304 4964704 140734405708496 18446744073709551615 212039316513 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 10.16
Current children cumulated vsize (KiB) 453940

[startup+3.10095 s]
/proc/loadavg: 7.58 6.86 5.92 9/306 15818
/proc/meminfo: memFree=17042264/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=455208 CPUtime=22.93 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 14140 0 0 0 2286 7 0 0 25 0 8 0 528134724 466132992 13747 33554432000 4194304 4964704 140734405708496 18446744073709551615 4653842 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 113802 13747 466 189 0 108151 0
[pid=15810/tid=15812] ppid=15808 vsize=455208 CPUtime=2.84 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 1375 0 0 0 284 0 0 0 18 0 8 0 528134745 466132992 13747 33554432000 4194304 4964704 140734405708496 18446744073709551615 4631193 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=455208 CPUtime=2.84 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 1527 0 0 0 283 1 0 0 22 0 8 0 528134745 466132992 13747 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670288 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=455208 CPUtime=2.84 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 1228 0 0 0 284 0 0 0 19 0 8 0 528134745 466132992 13747 33554432000 4194304 4964704 140734405708496 18446744073709551615 4627365 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=455208 CPUtime=2.84 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 1575 0 0 0 284 0 0 0 22 0 8 0 528134745 466132992 13747 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=455208 CPUtime=2.79 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 880 0 0 0 279 0 0 0 23 0 8 0 528134745 466132992 13747 33554432000 4194304 4964704 140734405708496 18446744073709551615 4359871 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=455208 CPUtime=2.84 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 1529 0 0 0 284 0 0 0 22 0 8 0 528134745 466132992 13748 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=455208 CPUtime=2.85 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 2700 0 0 0 284 1 0 0 22 0 8 0 528134745 466132992 13748 33554432000 4194304 4964704 140734405708496 18446744073709551615 212039316513 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 22.93
Current children cumulated vsize (KiB) 455208

[startup+6.30038 s]
/proc/loadavg: 7.61 6.88 5.93 9/306 15818
/proc/meminfo: memFree=17029136/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=458244 CPUtime=48.49 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 18164 0 0 0 4840 9 0 0 25 0 8 0 528134724 469241856 17771 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 114561 17771 466 189 0 108910 0
[pid=15810/tid=15812] ppid=15808 vsize=458244 CPUtime=6.03 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 1876 0 0 0 603 0 0 0 25 0 8 0 528134745 469241856 17771 33554432000 4194304 4964704 140734405708496 18446744073709551615 4362080 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=458244 CPUtime=6.04 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 2216 0 0 0 603 1 0 0 25 0 8 0 528134745 469241856 17771 33554432000 4194304 4964704 140734405708496 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=458244 CPUtime=6.04 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 1501 0 0 0 604 0 0 0 25 0 8 0 528134745 469241856 17771 33554432000 4194304 4964704 140734405708496 18446744073709551615 4332000 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=458244 CPUtime=6.04 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 1861 0 0 0 604 0 0 0 25 0 8 0 528134745 469241856 17771 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=458244 CPUtime=5.95 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 1249 0 0 0 595 0 0 0 25 0 8 0 528134745 469241856 17771 33554432000 4194304 4964704 140734405708496 18446744073709551615 4684016 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=458244 CPUtime=6.04 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 1839 0 0 0 604 0 0 0 25 0 8 0 528134745 469241856 17771 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=458244 CPUtime=6.05 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 3989 0 0 0 603 2 0 0 25 0 8 0 528134745 469241856 17771 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 48.49
Current children cumulated vsize (KiB) 458244

[startup+12.7012 s]
/proc/loadavg: 7.64 6.89 5.94 9/306 15818
/proc/meminfo: memFree=16995080/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=463088 CPUtime=99.63 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 26667 0 0 0 9949 14 0 0 25 0 8 0 528134724 474202112 26274 33554432000 4194304 4964704 140734405708496 18446744073709551615 4627299 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 115772 26274 466 189 0 110121 0
[pid=15810/tid=15812] ppid=15808 vsize=463088 CPUtime=12.44 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 2939 0 0 0 1243 1 0 0 25 0 8 0 528134745 474202112 26274 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=463088 CPUtime=12.45 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 3301 0 0 0 1243 2 0 0 25 0 8 0 528134745 474202112 26274 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=463088 CPUtime=12.45 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 1852 0 0 0 1244 1 0 0 25 0 8 0 528134745 474202112 26274 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670416 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=463088 CPUtime=12.44 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 2402 0 0 0 1243 1 0 0 25 0 8 0 528134745 474202112 26274 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=463088 CPUtime=12.3 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 2579 0 0 0 1229 1 0 0 25 0 8 0 528134745 474202112 26274 33554432000 4194304 4964704 140734405708496 18446744073709551615 4332225 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=463088 CPUtime=12.45 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 2358 0 0 0 1244 1 0 0 25 0 8 0 528134745 474202112 26274 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=463088 CPUtime=12.45 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 6304 0 0 0 1242 3 0 0 25 0 8 0 528134745 474202112 26274 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 99.63
Current children cumulated vsize (KiB) 463088

[startup+25.5009 s]
/proc/loadavg: 7.86 6.98 5.99 9/306 15819
/proc/meminfo: memFree=16961592/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=470208 CPUtime=201.89 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 34999 0 0 0 20170 19 0 0 21 0 8 0 528134724 481492992 34425 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 117552 34425 466 189 0 111901 0
[pid=15810/tid=15812] ppid=15808 vsize=470208 CPUtime=25.23 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 3750 0 0 0 2522 1 0 0 25 0 8 0 528134745 481492992 34425 33554432000 4194304 4964704 140734405708496 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=470208 CPUtime=25.24 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 4428 0 0 0 2522 2 0 0 25 0 8 0 528134745 481492992 34425 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=470208 CPUtime=25.24 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 2199 0 0 0 2523 1 0 0 25 0 8 0 528134745 481492992 34425 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=470208 CPUtime=25.24 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 3207 0 0 0 2523 1 0 0 25 0 8 0 528134745 481492992 34425 33554432000 4194304 4964704 140734405708496 18446744073709551615 4660415 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=470208 CPUtime=24.96 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 3282 0 0 0 2495 1 0 0 21 0 8 0 528134745 481492992 34425 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=470208 CPUtime=25.24 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 2986 0 0 0 2523 1 0 0 25 0 8 0 528134745 481492992 34425 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=470208 CPUtime=25.24 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 9833 0 0 0 2519 5 0 0 25 0 8 0 528134745 481492992 34425 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670135 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 201.89
Current children cumulated vsize (KiB) 470208

[startup+51.1014 s]
/proc/loadavg: 7.90 7.06 6.04 9/306 15819
/proc/meminfo: memFree=16905504/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=479204 CPUtime=406.42 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 49285 0 0 0 40614 28 0 0 25 0 8 0 528134724 490704896 48418 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 119801 48418 466 189 0 114150 0
[pid=15810/tid=15812] ppid=15808 vsize=479204 CPUtime=50.83 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 5246 0 0 0 5080 3 0 0 25 0 8 0 528134745 490704896 48418 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=479204 CPUtime=50.83 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 5987 0 0 0 5081 2 0 0 25 0 8 0 528134745 490704896 48418 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=479204 CPUtime=50.83 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 3066 0 0 0 5081 2 0 0 25 0 8 0 528134745 490704896 48418 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=479204 CPUtime=50.84 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 4059 0 0 0 5082 2 0 0 25 0 8 0 528134745 490704896 48418 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=479204 CPUtime=50.32 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 4742 0 0 0 5030 2 0 0 25 0 8 0 528134745 490704896 48418 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=479204 CPUtime=50.84 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 4300 0 0 0 5082 2 0 0 25 0 8 0 528134745 490704896 48418 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=479204 CPUtime=50.85 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 15185 0 0 0 5077 8 0 0 25 0 8 0 528134745 490704896 48418 33554432000 4194304 4964704 140734405708496 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 406.42

################
# More data... #
################

[pid=15810/tid=15813] ppid=15808 vsize=1047144 CPUtime=4661.78 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 31382 0 0 0 466159 19 0 0 25 0 8 0 528134745 1072275456 220548 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=1047144 CPUtime=4660.63 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 17966 0 0 0 466037 26 0 0 25 0 8 0 528134745 1072275456 220548 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=1047144 CPUtime=4661.96 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 18369 0 0 0 466176 20 0 0 25 0 8 0 528134745 1072275456 220548 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=1047144 CPUtime=4645.25 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 18352 0 0 0 464504 21 0 0 25 0 8 0 528134745 1072275456 220548 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=1047144 CPUtime=4654.9 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 18089 0 0 0 465465 25 0 0 25 0 8 0 528134745 1072275456 220548 33554432000 4194304 4964704 140734405708496 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=1047144 CPUtime=4662.05 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 72426 0 0 0 466113 92 0 0 25 0 8 0 528134745 1072275456 220548 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37247.5
Current children cumulated vsize (KiB) 1047144

[startup+4722.3 s]
/proc/loadavg: 8.01 8.03 8.00 9/306 15956
/proc/meminfo: memFree=16206396/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=1047144 CPUtime=37726.9 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 233920 0 0 0 3772415 279 0 0 25 0 8 0 528134724 1072275456 221597 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 261786 221597 466 189 0 256135 0
[pid=15810/tid=15812] ppid=15808 vsize=1047144 CPUtime=4698.22 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 32923 0 0 0 469787 35 0 0 25 0 8 0 528134745 1072275456 221597 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=1047144 CPUtime=4721.8 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 32230 0 0 0 472160 20 0 0 25 0 8 0 528134745 1072275456 221597 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=1047144 CPUtime=4720.62 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 17969 0 0 0 472036 26 0 0 25 0 8 0 528134745 1072275456 221597 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=1047144 CPUtime=4721.97 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 18370 0 0 0 472177 20 0 0 25 0 8 0 528134745 1072275456 221597 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=1047144 CPUtime=4705.27 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 18357 0 0 0 470506 21 0 0 25 0 8 0 528134745 1072275456 221597 33554432000 4194304 4964704 140734405708496 18446744073709551615 4627272 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=1047144 CPUtime=4714.9 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 18103 0 0 0 471465 25 0 0 25 0 8 0 528134745 1072275456 221597 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=1047144 CPUtime=4722.06 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 72573 0 0 0 472114 92 0 0 25 0 8 0 528134745 1072275456 221597 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320984 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37726.9
Current children cumulated vsize (KiB) 1047144

[startup+4782.3 s]
/proc/loadavg: 8.04 8.04 8.00 9/306 15958
/proc/meminfo: memFree=16201872/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=1050428 CPUtime=38206.2 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 235562 0 0 0 3820344 281 0 0 25 0 8 0 528134724 1075638272 222855 33554432000 4194304 4964704 140734405708496 18446744073709551615 4684027 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 262607 222855 466 189 0 256956 0
[pid=15810/tid=15812] ppid=15808 vsize=1050428 CPUtime=4757.61 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 33244 0 0 0 475726 35 0 0 25 0 8 0 528134745 1075638272 222855 33554432000 4194304 4964704 140734405708496 18446744073709551615 4627170 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=1050428 CPUtime=4781.79 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 32422 0 0 0 478159 20 0 0 25 0 8 0 528134745 1075638272 222855 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=1050428 CPUtime=4780.6 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 17969 0 0 0 478034 26 0 0 25 0 8 0 528134745 1075638272 222855 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=1050428 CPUtime=4781.95 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 18500 0 0 0 478175 20 0 0 25 0 8 0 528134745 1075638272 222855 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=1050428 CPUtime=4765.25 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 18511 0 0 0 476504 21 0 0 25 0 8 0 528134745 1075638272 222855 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=1050428 CPUtime=4774.9 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 18463 0 0 0 477464 26 0 0 25 0 8 0 528134745 1075638272 222855 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=1050428 CPUtime=4782.04 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 72818 0 0 0 478112 92 0 0 25 0 8 0 528134745 1075638272 222855 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38206.2
Current children cumulated vsize (KiB) 1050428

[startup+4842.31 s]
/proc/loadavg: 8.16 8.06 8.01 9/306 15959
/proc/meminfo: memFree=16200084/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=1051028 CPUtime=38685.7 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 235961 0 0 0 3868289 282 0 0 25 0 8 0 528134724 1076252672 223254 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 262757 223254 466 189 0 257106 0
[pid=15810/tid=15812] ppid=15808 vsize=1051028 CPUtime=4817.01 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 33258 0 0 0 481666 35 0 0 25 0 8 0 528134745 1076252672 223254 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=1051028 CPUtime=4841.8 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 32440 0 0 0 484160 20 0 0 25 0 8 0 528134745 1076252672 223254 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=1051028 CPUtime=4840.6 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 18035 0 0 0 484033 27 0 0 25 0 8 0 528134745 1076252672 223254 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=1051028 CPUtime=4841.96 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 18537 0 0 0 484176 20 0 0 25 0 8 0 528134745 1076252672 223254 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=1051028 CPUtime=4825.26 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 18676 0 0 0 482504 22 0 0 25 0 8 0 528134745 1076252672 223254 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320976 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=1051028 CPUtime=4834.91 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 18541 0 0 0 483465 26 0 0 25 0 8 0 528134745 1076252672 223254 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=1051028 CPUtime=4842.06 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 72839 0 0 0 484114 92 0 0 25 0 8 0 528134745 1076252672 223254 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38685.7
Current children cumulated vsize (KiB) 1051028

[startup+4902.3 s]
/proc/loadavg: 8.06 8.05 8.00 9/306 15961
/proc/meminfo: memFree=16197796/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=1051876 CPUtime=39165 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 236765 0 0 0 3916218 283 0 0 25 0 8 0 528134724 1077121024 223896 33554432000 4194304 4964704 140734405708496 18446744073709551615 4627263 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 262969 223896 466 189 0 257318 0
[pid=15810/tid=15812] ppid=15808 vsize=1051876 CPUtime=4876.4 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 33649 0 0 0 487605 35 0 0 25 0 8 0 528134745 1077121024 223896 33554432000 4194304 4964704 140734405708496 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=1051876 CPUtime=4901.79 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 32574 0 0 0 490159 20 0 0 25 0 8 0 528134745 1077121024 223896 33554432000 4194304 4964704 140734405708496 18446744073709551615 4627263 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=1051876 CPUtime=4900.58 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 18074 0 0 0 490031 27 0 0 25 0 8 0 528134745 1077121024 223896 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=1051876 CPUtime=4901.95 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 18549 0 0 0 490175 20 0 0 25 0 8 0 528134745 1077121024 223896 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=1051876 CPUtime=4885.26 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 18797 0 0 0 488504 22 0 0 25 0 8 0 528134745 1077121024 223896 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=1051876 CPUtime=4894.9 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 18564 0 0 0 489464 26 0 0 25 0 8 0 528134745 1077121024 223896 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=1051876 CPUtime=4902.04 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 72905 0 0 0 490112 92 0 0 25 0 8 0 528134745 1077121024 223896 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39165
Current children cumulated vsize (KiB) 1051876

[startup+4962.3 s]
/proc/loadavg: 8.08 8.05 8.00 9/306 15962
/proc/meminfo: memFree=16192528/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=1117412 CPUtime=39644.4 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 238172 0 0 0 3964154 286 0 0 25 0 8 0 528134724 1144229888 225251 33554432000 4194304 4964704 140734405708496 18446744073709551615 4627365 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 279353 225251 466 189 0 273702 0
[pid=15810/tid=15812] ppid=15808 vsize=1117412 CPUtime=4935.79 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 33731 0 0 0 493544 35 0 0 25 0 8 0 528134745 1144229888 225251 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=1117412 CPUtime=4961.79 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 32574 0 0 0 496159 20 0 0 25 0 8 0 528134745 1144229888 225251 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=1117412 CPUtime=4960.58 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 18135 0 0 0 496030 28 0 0 25 0 8 0 528134745 1144229888 225251 33554432000 4194304 4964704 140734405708496 18446744073709551615 4342157 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=1117412 CPUtime=4961.96 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 18666 0 0 0 496175 21 0 0 25 0 8 0 528134745 1144229888 225251 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670291 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=1117412 CPUtime=4945.25 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 18876 0 0 0 494503 22 0 0 25 0 8 0 528134745 1144229888 225251 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=1117412 CPUtime=4954.89 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 18658 0 0 0 495463 26 0 0 25 0 8 0 528134745 1144229888 225251 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=1117412 CPUtime=4962.05 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 73800 0 0 0 496111 94 0 0 25 0 8 0 528134745 1144229888 225251 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670291 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39644.4
Current children cumulated vsize (KiB) 1117412



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5006.9 s]
/proc/loadavg: 8.04 8.04 8.00 9/306 15964
/proc/meminfo: memFree=16189836/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=1182948 CPUtime=40000.8 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 238923 0 0 0 3999794 286 0 0 25 0 8 0 528134724 1211338752 225872 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 2
/proc/15810/statm: 295737 225872 466 189 0 290086 0
[pid=15810/tid=15812] ppid=15808 vsize=1182948 CPUtime=4979.94 cores=0-7
/proc/15810/task/15812/stat : 15812 (claspmt) R 15808 15810 14423 0 -1 4202560 33879 0 0 0 497959 35 0 0 25 0 8 0 528134745 1211338752 225872 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=15810/tid=15813] ppid=15808 vsize=1182948 CPUtime=5006.4 cores=0-7
/proc/15810/task/15813/stat : 15813 (claspmt) R 15808 15810 14423 0 -1 4202560 32867 0 0 0 500620 20 0 0 25 0 8 0 528134745 1211338752 225872 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=15810/tid=15814] ppid=15808 vsize=1182948 CPUtime=5005.18 cores=0-7
/proc/15810/task/15814/stat : 15814 (claspmt) R 15808 15810 14423 0 -1 4202560 18214 0 0 0 500490 28 0 0 25 0 8 0 528134745 1211338752 225872 33554432000 4194304 4964704 140734405708496 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15810/tid=15815] ppid=15808 vsize=1182948 CPUtime=5006.56 cores=0-7
/proc/15810/task/15815/stat : 15815 (claspmt) R 15808 15810 14423 0 -1 4202560 18790 0 0 0 500635 21 0 0 25 0 8 0 528134745 1211338752 225872 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15810/tid=15816] ppid=15808 vsize=1182948 CPUtime=4989.86 cores=0-7
/proc/15810/task/15816/stat : 15816 (claspmt) R 15808 15810 14423 0 -1 4202560 18900 0 0 0 498964 22 0 0 25 0 8 0 528134745 1211338752 225872 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=15810/tid=15817] ppid=15808 vsize=1182948 CPUtime=4999.5 cores=0-7
/proc/15810/task/15817/stat : 15817 (claspmt) R 15808 15810 14423 0 -1 4202560 18658 0 0 0 499924 26 0 0 25 0 8 0 528134745 1211338752 225872 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=15810/tid=15818] ppid=15808 vsize=1182948 CPUtime=5006.67 cores=0-7
/proc/15810/task/15818/stat : 15818 (claspmt) R 15808 15810 14423 0 -1 4202560 73883 0 0 0 500573 94 0 0 25 0 8 0 528134745 1211338752 225872 33554432000 4194304 4964704 140734405708496 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 1182948

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5007.1 s]
/proc/loadavg: 8.04 8.04 8.00 9/306 15964
/proc/meminfo: memFree=16189836/32951124 swapFree=66372068/67111528
[pid=15810] ppid=15808 vsize=1178076 CPUtime=40001 cores=0-7
/proc/15810/stat : 15810 (claspmt) R 15808 15810 14423 0 -1 4202496 238933 0 0 0 3999816 286 0 0 25 0 1 0 528134724 1206349824 223448 33554432000 4194304 4964704 140734405708496 18446744073709551615 212039310539 0 0 4096 18946 0 0 0 17 0 0 0 2
/proc/15810/statm: 294519 223448 476 189 0 288868 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 1178076

Child status: 0
Real time (s): 5007.17
CPU time (s): 40001.1
CPU user time (s): 39998.2
CPU system time (s): 2.91656
CPU usage (%): 798.876
Max. virtual memory (cumulated for all children) (KiB): 1182948

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39998.2
system time used= 2.91656
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 238934
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 79651
involuntary context switches= 190499

runsolver used 14.4948 second user time and 35.4396 second system time

The end

Launcher Data 

Begin job on node146 at 2011-05-02 19:26:25
IDJOB=3321509
IDBENCH=71540
IDSOLVER=1711
FILE ID=node146/3321509-1304357184
RUNJOBID= node146-1304337556-14437
PBS_JOBID= 13178039
Free space on /tmp= 73448 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/forced/rbsat-v945c61409gyes7.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321509-1304357184/watcher-3321509-1304357184 -o /tmp/evaluation-result-3321509-1304357184/solver-3321509-1304357184 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3321509-1304357184.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6200c727c8a5a324974090a1f9a6d7ab
RANDOM SEED=2119911149

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17092132 kB
Buffers:         27744 kB
Cached:         505652 kB
SwapCached:      15512 kB
Active:       14144024 kB
Inactive:      1468912 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17092132 kB
SwapTotal:    67111528 kB
SwapFree:     66372068 kB
Dirty:            1636 kB
Writeback:           0 kB
AnonPages:    15070568 kB
Mapped:          22352 kB
Slab:           125712 kB
PageTables:      49892 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 59413568 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73444 MiB
End job on node146 at 2011-05-02 20:49:54