Trace number 3322392

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 35689.5 5100.19

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-6x34.cnf
MD5SUM1633295f58c28a5b4150be8640bdf9df
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables816
Number of clauses35088
Sum of the clauses size137904
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21224
Number of clauses of size 30
Number of clauses of size 433864
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...382594/instance-3322392-1304382594.cnf
0.39/0.45	c Solving...
35689.27/5100.01	
35689.27/5100.01	*** INTERRUPTED! ***
35689.27/5100.01	*** Shutting down threads...
35689.40/5100.18	s UNKNOWN
35689.40/5100.18	
35689.40/5100.18	c INTERRUPTED   : 1
35689.40/5100.18	c Models        : 0+    
35689.40/5100.18	c Time          : 5100.012s (Solving: 5099.56s 1st Model: 0.00s Unsat: 0.00s)
35689.40/5100.18	c CPU Time      : 35689.310s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322392-1304382594/watcher-3322392-1304382594 -o /tmp/evaluation-result-3322392-1304382594/solver-3322392-1304382594 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322392-1304382594.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.07 9.57 9.48 2/244 29861
/proc/meminfo: memFree=22657444/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=22024 CPUtime=0 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 803 0 0 0 0 0 0 0 22 0 1 0 549857283 22552576 726 33554432000 4194304 4964704 140736388292560 18446744073709551615 271550198469 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/29861/statm: 5506 727 386 189 0 380 0

[startup+0.0650841 s]
/proc/loadavg: 9.07 9.57 9.48 2/244 29861
/proc/meminfo: memFree=22657444/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=24136 CPUtime=0.06 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 1432 0 0 0 6 0 0 0 22 0 1 0 549857283 24715264 1258 33554432000 4194304 4964704 140736388292560 18446744073709551615 4607641 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/29861/statm: 6034 1258 399 189 0 908 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 24136

[startup+0.101078 s]
/proc/loadavg: 9.07 9.57 9.48 2/244 29861
/proc/meminfo: memFree=22657444/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=24400 CPUtime=0.09 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 1502 0 0 0 9 0 0 0 22 0 1 0 549857283 24985600 1328 33554432000 4194304 4964704 140736388292560 18446744073709551615 4600360 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/29861/statm: 6100 1328 400 189 0 974 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 24400

[startup+0.30104 s]
/proc/loadavg: 9.07 9.57 9.48 2/244 29861
/proc/meminfo: memFree=22657444/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=26512 CPUtime=0.29 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 2020 0 0 0 29 0 0 0 23 0 1 0 549857283 27148288 1846 33554432000 4194304 4964704 140736388292560 18446744073709551615 4612155 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/29861/statm: 6628 1846 400 189 0 1502 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 26512

[startup+0.700937 s]
/proc/loadavg: 9.07 9.57 9.48 2/244 29861
/proc/meminfo: memFree=22657444/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=456512 CPUtime=1.96 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 10658 0 0 0 190 6 0 0 25 0 8 0 549857283 467468288 10391 33554432000 4194304 4964704 140736388292560 18446744073709551615 4321020 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/29861/statm: 114128 10391 464 189 0 108477 0
Current children cumulated CPU time (s) 1.96
Current children cumulated vsize (KiB) 456512

[startup+1.50079 s]
/proc/loadavg: 9.07 9.57 9.48 10/252 29869
/proc/meminfo: memFree=22600472/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=524064 CPUtime=7.52 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 17089 0 0 0 742 10 0 0 25 0 8 0 549857283 536641536 16822 33554432000 4194304 4964704 140736388292560 18446744073709551615 4632289 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/29861/statm: 131016 16822 464 189 0 125365 0
[pid=29861/tid=29863] ppid=29859 vsize=524064 CPUtime=0.74 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 1984 0 0 0 73 1 0 0 17 0 8 0 549857329 536641536 16822 33554432000 4194304 4964704 140736388292560 18446744073709551615 4371024 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=524064 CPUtime=1 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 2463 0 0 0 99 1 0 0 19 0 8 0 549857329 536641536 16822 33554432000 4194304 4964704 140736388292560 18446744073709551615 4325336 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=524064 CPUtime=0.93 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 1722 0 0 0 92 1 0 0 18 0 8 0 549857329 536641536 16822 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=524064 CPUtime=0.98 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 1926 0 0 0 98 0 0 0 18 0 8 0 549857329 536641536 16822 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=524064 CPUtime=0.47 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 1206 0 0 0 47 0 0 0 18 0 8 0 549857329 536641536 16822 33554432000 4194304 4964704 140736388292560 18446744073709551615 4370381 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=524064 CPUtime=0.99 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 1826 0 0 0 98 1 0 0 19 0 8 0 549857329 536641536 16822 33554432000 4194304 4964704 140736388292560 18446744073709551615 4325321 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=524064 CPUtime=0.89 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 2244 0 0 0 88 1 0 0 18 0 8 0 549857329 536641536 16822 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 7.52
Current children cumulated vsize (KiB) 524064

[startup+3.1005 s]
/proc/loadavg: 9.06 9.56 9.48 10/252 29869
/proc/meminfo: memFree=22583980/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=526996 CPUtime=18.7 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 22341 0 0 0 1857 13 0 0 25 0 8 0 549857283 539643904 22074 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670260 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/29861/statm: 131749 22075 466 189 0 126098 0
[pid=29861/tid=29863] ppid=29859 vsize=526996 CPUtime=2.05 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 2589 0 0 0 204 1 0 0 18 0 8 0 549857329 539643904 22075 33554432000 4194304 4964704 140736388292560 18446744073709551615 4364579 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=526996 CPUtime=2.61 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 4059 0 0 0 258 3 0 0 23 0 8 0 549857329 539643904 22075 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=526996 CPUtime=1.89 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 2149 0 0 0 188 1 0 0 20 0 8 0 549857329 539643904 22075 33554432000 4194304 4964704 140736388292560 18446744073709551615 4642415 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=526996 CPUtime=2.57 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 2781 0 0 0 256 1 0 0 18 0 8 0 549857329 539643904 22076 33554432000 4194304 4964704 140736388292560 18446744073709551615 4658344 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=526996 CPUtime=1.99 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 1745 0 0 0 199 0 0 0 20 0 8 0 549857329 539643904 22076 33554432000 4194304 4964704 140736388292560 18446744073709551615 271550580919 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=526996 CPUtime=2.6 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 2293 0 0 0 258 2 0 0 22 0 8 0 549857329 539643904 22077 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=526996 CPUtime=1.88 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 2615 0 0 0 187 1 0 0 18 0 8 0 549857329 539643904 22077 33554432000 4194304 4964704 140736388292560 18446744073709551615 4660075 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 18.7
Current children cumulated vsize (KiB) 526996

[startup+6.30092 s]
/proc/loadavg: 9.06 9.56 9.48 10/252 29869
/proc/meminfo: memFree=22541324/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=530520 CPUtime=41.07 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 31875 0 0 0 4089 18 0 0 25 0 8 0 549857283 543252480 31487 33554432000 4194304 4964704 140736388292560 18446744073709551615 4342157 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/29861/statm: 132630 31487 466 189 0 126979 0
[pid=29861/tid=29863] ppid=29859 vsize=530520 CPUtime=4.15 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 2936 0 0 0 414 1 0 0 23 0 8 0 549857329 543252480 31487 33554432000 4194304 4964704 140736388292560 18446744073709551615 271550642670 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=530520 CPUtime=5.8 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 6578 0 0 0 577 3 0 0 25 0 8 0 549857329 543252480 31487 33554432000 4194304 4964704 140736388292560 18446744073709551615 4362944 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=530520 CPUtime=3.76 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 2638 0 0 0 375 1 0 0 22 0 8 0 549857329 543252480 31487 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=530520 CPUtime=5.46 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 4904 0 0 0 544 2 0 0 25 0 8 0 549857329 543252480 31487 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=530520 CPUtime=5.19 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 2873 0 0 0 518 1 0 0 18 0 8 0 549857329 543252480 31487 33554432000 4194304 4964704 140736388292560 18446744073709551615 4362425 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=530520 CPUtime=5.8 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 3313 0 0 0 577 3 0 0 25 0 8 0 549857329 543252480 31487 33554432000 4194304 4964704 140736388292560 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=530520 CPUtime=4.61 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 3898 0 0 0 459 2 0 0 19 0 8 0 549857329 543252480 31487 33554432000 4194304 4964704 140736388292560 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 41.07
Current children cumulated vsize (KiB) 530520

[startup+12.7008 s]
/proc/loadavg: 9.05 9.54 9.47 10/252 29870
/proc/meminfo: memFree=22493368/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=542588 CPUtime=85.77 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 43874 0 0 0 8553 24 0 0 25 0 8 0 549857283 555610112 43305 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/29861/statm: 135647 43305 466 189 0 129996 0
[pid=29861/tid=29863] ppid=29859 vsize=542588 CPUtime=9.05 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 3733 0 0 0 903 2 0 0 25 0 8 0 549857329 555610112 43305 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670286 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=542588 CPUtime=12.19 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 9169 0 0 0 1215 4 0 0 25 0 8 0 549857329 555610112 43305 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=542588 CPUtime=8.59 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 3639 0 0 0 858 1 0 0 25 0 8 0 549857329 555610112 43305 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=542588 CPUtime=11.85 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 6120 0 0 0 1183 2 0 0 25 0 8 0 549857329 555610112 43305 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=542588 CPUtime=9.94 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 4089 0 0 0 993 1 0 0 25 0 8 0 549857329 555610112 43305 33554432000 4194304 4964704 140736388292560 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=542588 CPUtime=12.19 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 4478 0 0 0 1215 4 0 0 25 0 8 0 549857329 555610112 43305 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=542588 CPUtime=10.78 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 7105 0 0 0 1074 4 0 0 25 0 8 0 549857329 555610112 43305 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 85.77
Current children cumulated vsize (KiB) 542588

[startup+25.5004 s]
/proc/loadavg: 9.04 9.52 9.46 10/252 29870
/proc/meminfo: memFree=22433788/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=547776 CPUtime=175.18 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 58224 0 0 0 17484 34 0 0 22 0 8 0 549857283 560922624 57632 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/29861/statm: 136944 57632 466 189 0 131293 0
[pid=29861/tid=29863] ppid=29859 vsize=547776 CPUtime=19.23 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 4953 0 0 0 1920 3 0 0 23 0 8 0 549857329 560922624 57632 33554432000 4194304 4964704 140736388292560 18446744073709551615 4371245 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=547776 CPUtime=23.96 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 11613 0 0 0 2390 6 0 0 24 0 8 0 549857329 560922624 57632 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=547776 CPUtime=19.14 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 5595 0 0 0 1911 3 0 0 25 0 8 0 549857329 560922624 57632 33554432000 4194304 4964704 140736388292560 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=547776 CPUtime=22.38 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 8539 0 0 0 2235 3 0 0 25 0 8 0 549857329 560922624 57632 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670260 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=547776 CPUtime=21.59 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 5071 0 0 0 2157 2 0 0 25 0 8 0 549857329 560922624 57632 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=547776 CPUtime=24.97 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 6103 0 0 0 2492 5 0 0 25 0 8 0 549857329 560922624 57632 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=547776 CPUtime=23.49 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 9865 0 0 0 2343 6 0 0 25 0 8 0 549857329 560922624 57632 33554432000 4194304 4964704 140736388292560 18446744073709551615 4660095 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 175.18
Current children cumulated vsize (KiB) 547776

[startup+51.1008 s]
/proc/loadavg: 9.03 9.48 9.45 10/252 29871
/proc/meminfo: memFree=22350684/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=557968 CPUtime=354.13 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 79131 0 0 0 35364 49 0 0 25 0 8 0 549857283 571359232 78455 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670419 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/29861/statm: 139492 78455 466 189 0 133841 0
[pid=29861/tid=29863] ppid=29859 vsize=557968 CPUtime=40.01 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 5766 0 0 0 3998 3 0 0 25 0 8 0 549857329 571359232 78455 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=557968 CPUtime=47.19 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 14314 0 0 0 4712 7 0 0 25 0 8 0 549857329 571359232 78455 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=557968 CPUtime=44.55 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 8804 0 0 0 4450 5 0 0 25 0 8 0 549857329 571359232 78455 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=557968 CPUtime=47.09 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 11993 0 0 0 4704 5 0 0 25 0 8 0 549857329 571359232 78455 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=557968 CPUtime=37.97 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 7835 0 0 0 3793 4 0 0 25 0 8 0 549857329 571359232 78455 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=557968 CPUtime=49.55 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 9243 0 0 0 4948 7 0 0 25 0 8 0 549857329 571359232 78455 33554432000 4194304 4964704 140736388292560 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=557968 CPUtime=44.53 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 12172 0 0 0 4445 8 0 0 25 0 8 0 549857329 571359232 78455 33554432000 4194304 4964704 140736388292560 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 354.13

################
# More data... #
################

[pid=29861/tid=29864] ppid=29859 vsize=1622040 CPUtime=4317.97 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 82941 0 0 0 431695 102 0 0 25 0 8 0 549857329 1660968960 334705 33554432000 4194304 4964704 140736388292560 18446744073709551615 4627365 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=1622040 CPUtime=4125.52 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 41760 0 0 0 412476 76 0 0 25 0 8 0 549857329 1660968960 334705 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=1622040 CPUtime=4250.73 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 31284 0 0 0 425026 47 0 0 25 0 8 0 549857329 1660968960 334705 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=1622040 CPUtime=4309.45 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 27916 0 0 0 430896 49 0 0 25 0 8 0 549857329 1660968960 334705 33554432000 4194304 4964704 140736388292560 18446744073709551615 4684027 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=1622040 CPUtime=4162.83 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 44807 0 0 0 416200 83 0 0 25 0 8 0 549857329 1660968960 334705 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=1622040 CPUtime=4354.39 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 39659 0 0 0 435373 66 0 0 25 0 8 0 549857329 1660968960 334705 33554432000 4194304 4964704 140736388292560 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 33461.8
Current children cumulated vsize (KiB) 1622040

[startup+4842.3 s]
/proc/loadavg: 9.16 9.12 9.09 10/252 30010
/proc/meminfo: memFree=21311212/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=1622040 CPUtime=33887.4 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 349250 0 0 0 3388170 572 0 0 25 0 8 0 549857283 1660968960 335449 33554432000 4194304 4964704 140736388292560 18446744073709551615 4684027 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/29861/statm: 405510 335449 466 189 0 399859 0
[pid=29861/tid=29863] ppid=29859 vsize=1622040 CPUtime=4031.86 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 39626 0 0 0 403116 70 0 0 25 0 8 0 549857329 1660968960 335449 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=1622040 CPUtime=4375.19 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 83390 0 0 0 437416 103 0 0 25 0 8 0 549857329 1660968960 335449 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=1622040 CPUtime=4176.36 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 41829 0 0 0 417559 77 0 0 25 0 8 0 549857329 1660968960 335449 33554432000 4194304 4964704 140736388292560 18446744073709551615 4644840 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=1622040 CPUtime=4300.24 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 31306 0 0 0 429976 48 0 0 25 0 8 0 549857329 1660968960 335449 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=1622040 CPUtime=4360.35 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 28098 0 0 0 435986 49 0 0 25 0 8 0 549857329 1660968960 335449 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=1622040 CPUtime=4222.66 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 44807 0 0 0 422183 83 0 0 25 0 8 0 549857329 1660968960 335449 33554432000 4194304 4964704 140736388292560 18446744073709551615 271550196632 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=1622040 CPUtime=4411.28 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 39699 0 0 0 441062 66 0 0 25 0 8 0 549857329 1660968960 335449 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 33887.4
Current children cumulated vsize (KiB) 1622040

[startup+4902.3 s]
/proc/loadavg: 9.14 9.12 9.09 10/252 30012
/proc/meminfo: memFree=21303368/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=1622040 CPUtime=34306.9 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 351209 0 0 0 3430117 577 0 0 25 0 8 0 549857283 1660968960 337393 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670454 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/29861/statm: 405510 337393 466 189 0 399859 0
[pid=29861/tid=29863] ppid=29859 vsize=1622040 CPUtime=4076.31 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 39764 0 0 0 407560 71 0 0 25 0 8 0 549857329 1660968960 337393 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=1622040 CPUtime=4428.54 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 84701 0 0 0 442749 105 0 0 25 0 8 0 549857329 1660968960 337393 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=1622040 CPUtime=4231.26 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 41875 0 0 0 423049 77 0 0 25 0 8 0 549857329 1660968960 337393 33554432000 4194304 4964704 140736388292560 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=1622040 CPUtime=4355.91 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 31347 0 0 0 435543 48 0 0 25 0 8 0 549857329 1660968960 337393 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=1622040 CPUtime=4414.74 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 28137 0 0 0 441425 49 0 0 25 0 8 0 549857329 1660968960 337393 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=1622040 CPUtime=4274.17 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 45177 0 0 0 427333 84 0 0 25 0 8 0 549857329 1660968960 337393 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=1622040 CPUtime=4458.26 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 39713 0 0 0 445760 66 0 0 25 0 8 0 549857329 1660968960 337393 33554432000 4194304 4964704 140736388292560 18446744073709551615 271550642670 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 34306.9
Current children cumulated vsize (KiB) 1622040

[startup+4962.3 s]
/proc/loadavg: 9.14 9.13 9.09 10/252 30014
/proc/meminfo: memFree=21300616/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=1622040 CPUtime=34726.5 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 352096 0 0 0 3472066 580 0 0 25 0 8 0 549857283 1660968960 338091 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29861/statm: 405510 338091 466 189 0 399859 0
[pid=29861/tid=29863] ppid=29859 vsize=1622040 CPUtime=4136.31 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 39942 0 0 0 413559 72 0 0 25 0 8 0 549857329 1660968960 338091 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=1622040 CPUtime=4465.12 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 84778 0 0 0 446407 105 0 0 25 0 8 0 549857329 1660968960 338091 33554432000 4194304 4964704 140736388292560 18446744073709551615 4644850 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=1622040 CPUtime=4291.26 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 41875 0 0 0 429049 77 0 0 25 0 8 0 549857329 1660968960 338091 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=1622040 CPUtime=4415.9 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 31732 0 0 0 441542 48 0 0 25 0 8 0 549857329 1660968960 338091 33554432000 4194304 4964704 140736388292560 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=1622040 CPUtime=4465.65 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 28376 0 0 0 446515 50 0 0 25 0 8 0 549857329 1660968960 338091 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=1622040 CPUtime=4328.76 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 45177 0 0 0 432792 84 0 0 25 0 8 0 549857329 1660968960 338091 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=1622040 CPUtime=4508.8 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 39713 0 0 0 450813 67 0 0 25 0 8 0 549857329 1660968960 338091 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 34726.5
Current children cumulated vsize (KiB) 1622040

[startup+5022.3 s]
/proc/loadavg: 9.05 9.10 9.09 10/252 30015
/proc/meminfo: memFree=21292884/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=1622040 CPUtime=35146 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 354066 0 0 0 3514010 586 0 0 25 0 8 0 549857283 1660968960 340061 33554432000 4194304 4964704 140736388292560 18446744073709551615 4312169 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29861/statm: 405510 340061 466 189 0 399859 0
[pid=29861/tid=29863] ppid=29859 vsize=1622040 CPUtime=4192.93 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 39943 0 0 0 419221 72 0 0 25 0 8 0 549857329 1660968960 340061 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=1622040 CPUtime=4506.44 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 84901 0 0 0 450538 106 0 0 25 0 8 0 549857329 1660968960 340061 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=1622040 CPUtime=4343.18 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 41880 0 0 0 434241 77 0 0 25 0 8 0 549857329 1660968960 340061 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=1622040 CPUtime=4471.99 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 32966 0 0 0 447149 50 0 0 25 0 8 0 549857329 1660968960 340061 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=1622040 CPUtime=4525.48 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 28376 0 0 0 452498 50 0 0 25 0 8 0 549857329 1660968960 340061 33554432000 4194304 4964704 140736388292560 18446744073709551615 4684027 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=1622040 CPUtime=4379.32 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 45233 0 0 0 437848 84 0 0 25 0 8 0 549857329 1660968960 340061 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=1622040 CPUtime=4561.03 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 40249 0 0 0 456035 68 0 0 25 0 8 0 549857329 1660968960 340061 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670255 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 35146
Current children cumulated vsize (KiB) 1622040

[startup+5082.3 s]
/proc/loadavg: 9.06 9.09 9.08 10/252 30017
/proc/meminfo: memFree=21286524/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=1622040 CPUtime=35565.5 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 355587 0 0 0 3555956 590 0 0 25 0 8 0 549857283 1660968960 341535 33554432000 4194304 4964704 140736388292560 18446744073709551615 4653459 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/29861/statm: 405510 341535 466 189 0 399859 0
[pid=29861/tid=29863] ppid=29859 vsize=1622040 CPUtime=4245.87 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 40175 0 0 0 424514 73 0 0 25 0 8 0 549857329 1660968960 341535 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=1622040 CPUtime=4555.8 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 84953 0 0 0 455474 106 0 0 25 0 8 0 549857329 1660968960 341535 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=1622040 CPUtime=4403.18 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 43108 0 0 0 440239 79 0 0 25 0 8 0 549857329 1660968960 341535 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=1622040 CPUtime=4531.99 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 32975 0 0 0 453149 50 0 0 25 0 8 0 549857329 1660968960 341535 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=1622040 CPUtime=4579.49 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 28376 0 0 0 457899 50 0 0 25 0 8 0 549857329 1660968960 341535 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=1622040 CPUtime=4428.93 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 45233 0 0 0 442808 85 0 0 25 0 8 0 549857329 1660968960 341535 33554432000 4194304 4964704 140736388292560 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=1622040 CPUtime=4610.68 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 40249 0 0 0 460999 69 0 0 25 0 8 0 549857329 1660968960 341535 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 35565.5
Current children cumulated vsize (KiB) 1622040



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5100 s]
/proc/loadavg: 9.05 9.09 9.08 10/252 30017
/proc/meminfo: memFree=21285264/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=1622040 CPUtime=35689.3 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 355925 0 0 0 3568335 592 0 0 25 0 8 0 549857283 1660968960 341873 33554432000 4194304 4964704 140736388292560 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/29861/statm: 405510 341873 466 189 0 399859 0
[pid=29861/tid=29863] ppid=29859 vsize=1622040 CPUtime=4262.13 cores=0-7
/proc/29861/task/29863/stat : 29863 (claspmt) R 29859 29861 29100 0 -1 4202560 40175 0 0 0 426140 73 0 0 25 0 8 0 549857329 1660968960 341873 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29861/tid=29864] ppid=29859 vsize=1622040 CPUtime=4573.21 cores=0-7
/proc/29861/task/29864/stat : 29864 (claspmt) R 29859 29861 29100 0 -1 4202560 84953 0 0 0 457215 106 0 0 25 0 8 0 549857329 1660968960 341873 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29861/tid=29865] ppid=29859 vsize=1622040 CPUtime=4415.62 cores=0-7
/proc/29861/task/29865/stat : 29865 (claspmt) R 29859 29861 29100 0 -1 4202560 43109 0 0 0 441483 79 0 0 25 0 8 0 549857329 1660968960 341873 33554432000 4194304 4964704 140736388292560 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29861/tid=29866] ppid=29859 vsize=1622040 CPUtime=4546.69 cores=0-7
/proc/29861/task/29866/stat : 29866 (claspmt) R 29859 29861 29100 0 -1 4202560 33069 0 0 0 454619 50 0 0 25 0 8 0 549857329 1660968960 341873 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29861/tid=29867] ppid=29859 vsize=1622040 CPUtime=4597.2 cores=0-7
/proc/29861/task/29867/stat : 29867 (claspmt) R 29859 29861 29100 0 -1 4202560 28418 0 0 0 459670 50 0 0 25 0 8 0 549857329 1660968960 341873 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=29861/tid=29868] ppid=29859 vsize=1622040 CPUtime=4443.54 cores=0-7
/proc/29861/task/29868/stat : 29868 (claspmt) R 29859 29861 29100 0 -1 4202560 45233 0 0 0 444269 85 0 0 25 0 8 0 549857329 1660968960 341873 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29861/tid=29869] ppid=29859 vsize=1622040 CPUtime=4623.78 cores=0-7
/proc/29861/task/29869/stat : 29869 (claspmt) R 29859 29861 29100 0 -1 4202560 40249 0 0 0 462309 69 0 0 25 0 8 0 549857329 1660968960 341873 33554432000 4194304 4964704 140736388292560 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 35689.3
Current children cumulated vsize (KiB) 1622040

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5100.11 s]
/proc/loadavg: 9.05 9.09 9.08 10/252 30017
/proc/meminfo: memFree=21285264/32951124 swapFree=67111336/67111528
[pid=29861] ppid=29859 vsize=1617704 CPUtime=35689.4 cores=0-7
/proc/29861/stat : 29861 (claspmt) R 29859 29861 29100 0 -1 4202496 355935 0 0 0 3568348 592 0 0 25 0 1 0 549857283 1656528896 340182 33554432000 4194304 4964704 140736388292560 18446744073709551615 271550194225 0 0 4096 18946 0 0 0 17 7 0 0 0
/proc/29861/statm: 404426 340182 476 189 0 398775 0
Current children cumulated CPU time (s) 35689.4
Current children cumulated vsize (KiB) 1617704

Child status: 0
Real time (s): 5100.19
CPU time (s): 35689.5
CPU user time (s): 35683.5
CPU system time (s): 5.97609
CPU usage (%): 699.768
Max. virtual memory (cumulated for all children) (KiB): 1622040

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 35683.5
system time used= 5.97609
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 355936
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 359082
involuntary context switches= 484582

runsolver used 11.3893 second user time and 27.3488 second system time

The end

Launcher Data 

Begin job on node133 at 2011-05-03 02:29:54
IDJOB=3322392
IDBENCH=83157
IDSOLVER=1711
FILE ID=node133/3322392-1304382594
RUNJOBID= node133-1304371961-29114
PBS_JOBID= 13181778
Free space on /tmp= 73632 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-6x34.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322392-1304382594/watcher-3322392-1304382594 -o /tmp/evaluation-result-3322392-1304382594/solver-3322392-1304382594 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322392-1304382594.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1633295f58c28a5b4150be8640bdf9df
RANDOM SEED=466602633

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22657972 kB
Buffers:        613164 kB
Cached:        1716140 kB
SwapCached:        124 kB
Active:        8049816 kB
Inactive:      1860868 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22657972 kB
SwapTotal:    67111528 kB
SwapFree:     67111336 kB
Dirty:            1744 kB
Writeback:           0 kB
AnonPages:     7580856 kB
Mapped:          22836 kB
Slab:           294028 kB
PageTables:      23452 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 19320372 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73632 MiB
End job on node133 at 2011-05-03 03:54:56