Trace number 3380984

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.8 5020.22

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n160-s73223945-unsat.cnf
MD5SUMebbfc0ffb6aa4fcba0d5ce3964018543
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables161
Number of clauses332
Sum of the clauses size996
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3332
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...499010/instance-3380984-1305499010.cnf
0.00/0.00	c Solving...
40000.68/5020.21	
40000.68/5020.21	*** INTERRUPTED! ***
40000.68/5020.21	*** Shutting down threads...
40000.68/5020.22	s UNKNOWN
40000.68/5020.22	
40000.68/5020.22	c INTERRUPTED   : 1
40000.68/5020.22	c Models        : 0+    
40000.68/5020.22	c Time          : 5020.217s (Solving: 5020.22s 1st Model: 0.00s Unsat: 0.00s)
40000.68/5020.22	c CPU Time      : 40000.740s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380984-1305499010/watcher-3380984-1305499010 -o /tmp/evaluation-result-3380984-1305499010/solver-3380984-1305499010 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380984-1305499010.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.52 8.54 8.27 1/377 25138
/proc/meminfo: memFree=25017728/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=184220 CPUtime=0.02 cores=0-7
/proc/25138/stat : 25138 (claspmt) S 25136 25138 24446 0 -1 4202496 808 0 0 0 2 0 0 0 25 0 8 0 394092275 188641280 733 33554432000 4194304 4964800 140733993151008 18446744073709551615 268672478105 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/25138/statm: 46055 733 463 189 0 40404 0
[pid=25138/tid=25139] ppid=25136 vsize=184352 CPUtime=0 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 42 0 0 0 0 0 0 0 18 0 8 0 394092276 188776448 741 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=184352 CPUtime=0 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 23 0 0 0 0 0 0 0 25 0 8 0 394092276 188776448 742 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=184352 CPUtime=0 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 29 0 0 0 0 0 0 0 25 0 8 0 394092276 188776448 742 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=184352 CPUtime=0 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 4 0 0 0 0 0 0 0 25 0 8 0 394092276 188776448 742 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767015 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=184352 CPUtime=0 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) S 25136 25138 24446 0 -1 4202560 11 0 0 0 0 0 0 0 25 0 8 0 394092276 188776448 742 33554432000 4194304 4964800 140733993151008 18446744073709551615 268672478105 0 0 4096 18946 18446604460726386816 0 0 -1 6 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=184352 CPUtime=0 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) S 25136 25138 24446 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 8 0 394092276 188776448 742 33554432000 4194304 4964800 140733993151008 18446744073709551615 268672478105 0 0 4096 18946 18446604460726386816 0 0 -1 1 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=184352 CPUtime=0 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 83 0 0 0 0 0 0 0 25 0 8 0 394092276 188776448 742 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 6 0 0 0

[startup+0.049239 s]
/proc/loadavg: 8.52 8.54 8.27 1/377 25138
/proc/meminfo: memFree=25017728/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=315424 CPUtime=0.26 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 1027 0 0 0 26 0 0 0 25 0 8 0 394092275 322994176 952 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767214 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/25138/statm: 78856 952 464 189 0 73205 0
[pid=25138/tid=25139] ppid=25136 vsize=315424 CPUtime=0.04 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 71 0 0 0 4 0 0 0 18 0 8 0 394092276 322994176 952 33554432000 4194304 4964800 140733993151008 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=315424 CPUtime=0.04 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 52 0 0 0 4 0 0 0 25 0 8 0 394092276 322994176 952 33554432000 4194304 4964800 140733993151008 18446744073709551615 4362990 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=315424 CPUtime=0.03 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 47 0 0 0 3 0 0 0 25 0 8 0 394092276 322994176 952 33554432000 4194304 4964800 140733993151008 18446744073709551615 4668564 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=315424 CPUtime=0.02 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 27 0 0 0 2 0 0 0 18 0 8 0 394092276 322994176 952 33554432000 4194304 4964800 140733993151008 18446744073709551615 4362492 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=315424 CPUtime=0.03 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 33 0 0 0 3 0 0 0 18 0 8 0 394092276 322994176 952 33554432000 4194304 4964800 140733993151008 18446744073709551615 4371104 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=315424 CPUtime=0.03 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 42 0 0 0 3 0 0 0 17 0 8 0 394092276 322994176 952 33554432000 4194304 4964800 140733993151008 18446744073709551615 4660449 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=315424 CPUtime=0.02 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 105 0 0 0 2 0 0 0 25 0 8 0 394092276 322994176 952 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670190 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 315424

[startup+0.101193 s]
/proc/loadavg: 8.52 8.54 8.27 1/377 25138
/proc/meminfo: memFree=25017728/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=315556 CPUtime=0.66 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 1206 0 0 0 66 0 0 0 25 0 8 0 394092275 323129344 1131 33554432000 4194304 4964800 140733993151008 18446744073709551615 4320919 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/25138/statm: 78889 1131 464 189 0 73238 0
[pid=25138/tid=25139] ppid=25136 vsize=315556 CPUtime=0.09 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 100 0 0 0 9 0 0 0 18 0 8 0 394092276 323129344 1131 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=315556 CPUtime=0.09 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 80 0 0 0 9 0 0 0 25 0 8 0 394092276 323129344 1131 33554432000 4194304 4964800 140733993151008 18446744073709551615 4642389 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=315556 CPUtime=0.08 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 60 0 0 0 8 0 0 0 18 0 8 0 394092276 323129344 1131 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670357 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=315556 CPUtime=0.08 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 49 0 0 0 8 0 0 0 18 0 8 0 394092276 323129344 1132 33554432000 4194304 4964800 140733993151008 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=315556 CPUtime=0.08 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 46 0 0 0 8 0 0 0 18 0 8 0 394092276 323129344 1132 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670025 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=315556 CPUtime=0.08 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 59 0 0 0 8 0 0 0 18 0 8 0 394092276 323129344 1132 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660323361 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=315556 CPUtime=0.07 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 145 0 0 0 7 0 0 0 25 0 8 0 394092276 323129344 1132 33554432000 4194304 4964800 140733993151008 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 0.66
Current children cumulated vsize (KiB) 315556

[startup+0.301158 s]
/proc/loadavg: 8.52 8.54 8.27 1/377 25138
/proc/meminfo: memFree=25017728/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=315820 CPUtime=2.26 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 1608 0 0 0 225 1 0 0 25 0 8 0 394092275 323399680 1533 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/25138/statm: 78955 1533 464 189 0 73304 0
[pid=25138/tid=25139] ppid=25136 vsize=315820 CPUtime=0.29 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 164 0 0 0 29 0 0 0 18 0 8 0 394092276 323399680 1533 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=315820 CPUtime=0.28 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 129 0 0 0 28 0 0 0 25 0 8 0 394092276 323399680 1533 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=315820 CPUtime=0.28 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 86 0 0 0 28 0 0 0 18 0 8 0 394092276 323399680 1533 33554432000 4194304 4964800 140733993151008 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=315820 CPUtime=0.27 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 105 0 0 0 27 0 0 0 18 0 8 0 394092276 323399680 1533 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=315820 CPUtime=0.28 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 74 0 0 0 28 0 0 0 18 0 8 0 394092276 323399680 1533 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=315820 CPUtime=0.28 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 85 0 0 0 28 0 0 0 18 0 8 0 394092276 323399680 1533 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=315820 CPUtime=0.27 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 244 0 0 0 27 0 0 0 25 0 8 0 394092276 323399680 1533 33554432000 4194304 4964800 140733993151008 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.26
Current children cumulated vsize (KiB) 315820

[startup+0.701088 s]
/proc/loadavg: 8.52 8.54 8.27 1/377 25138
/proc/meminfo: memFree=25017728/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=316084 CPUtime=5.45 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 1978 0 0 0 542 3 0 0 25 0 8 0 394092275 323670016 1903 33554432000 4194304 4964800 140733993151008 18446744073709551615 4362225 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/25138/statm: 79021 1903 464 189 0 73370 0
[pid=25138/tid=25139] ppid=25136 vsize=316084 CPUtime=0.69 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 235 0 0 0 69 0 0 0 18 0 8 0 394092276 323670016 1903 33554432000 4194304 4964800 140733993151008 18446744073709551615 4332230 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=316084 CPUtime=0.68 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 181 0 0 0 68 0 0 0 25 0 8 0 394092276 323670016 1903 33554432000 4194304 4964800 140733993151008 18446744073709551615 4668544 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=316084 CPUtime=0.68 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 96 0 0 0 68 0 0 0 18 0 8 0 394092276 323670016 1903 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=316084 CPUtime=0.67 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 157 0 0 0 67 0 0 0 18 0 8 0 394092276 323670016 1903 33554432000 4194304 4964800 140733993151008 18446744073709551615 4332288 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=316084 CPUtime=0.67 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 89 0 0 0 67 0 0 0 18 0 8 0 394092276 323670016 1903 33554432000 4194304 4964800 140733993151008 18446744073709551615 4669276 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=316084 CPUtime=0.67 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 101 0 0 0 67 0 0 0 18 0 8 0 394092276 323670016 1903 33554432000 4194304 4964800 140733993151008 18446744073709551615 4654559 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=316084 CPUtime=0.67 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 331 0 0 0 67 0 0 0 25 0 8 0 394092276 323670016 1903 33554432000 4194304 4964800 140733993151008 18446744073709551615 4325336 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.45
Current children cumulated vsize (KiB) 316084

[startup+1.50095 s]
/proc/loadavg: 8.52 8.54 8.27 9/385 25146
/proc/meminfo: memFree=25011092/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=316484 CPUtime=11.81 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 2395 0 0 0 1175 6 0 0 25 0 8 0 394092275 324079616 2320 33554432000 4194304 4964800 140733993151008 18446744073709551615 4684760 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/25138/statm: 79121 2320 464 189 0 73470 0
[pid=25138/tid=25139] ppid=25136 vsize=316484 CPUtime=1.48 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 322 0 0 0 148 0 0 0 19 0 8 0 394092276 324079616 2320 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=316484 CPUtime=1.48 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 209 0 0 0 147 1 0 0 25 0 8 0 394092276 324079616 2320 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670313 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=316484 CPUtime=1.47 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 116 0 0 0 147 0 0 0 19 0 8 0 394092276 324079616 2320 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=316484 CPUtime=1.47 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 186 0 0 0 146 1 0 0 19 0 8 0 394092276 324079616 2320 33554432000 4194304 4964800 140733993151008 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=316484 CPUtime=1.47 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 108 0 0 0 147 0 0 0 19 0 8 0 394092276 324079616 2320 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=316484 CPUtime=1.47 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 124 0 0 0 147 0 0 0 18 0 8 0 394092276 324079616 2320 33554432000 4194304 4964800 140733993151008 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=316484 CPUtime=1.45 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 442 0 0 0 145 0 0 0 25 0 8 0 394092276 324079616 2320 33554432000 4194304 4964800 140733993151008 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.81
Current children cumulated vsize (KiB) 316484

[startup+3.10067 s]
/proc/loadavg: 8.52 8.54 8.27 9/385 25146
/proc/meminfo: memFree=25009160/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=316752 CPUtime=24.56 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 2782 0 0 0 2444 12 0 0 18 0 8 0 394092275 324354048 2707 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/25138/statm: 79188 2707 464 189 0 73537 0
[pid=25138/tid=25139] ppid=25136 vsize=316752 CPUtime=3.08 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 437 0 0 0 308 0 0 0 22 0 8 0 394092276 324354048 2707 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670538 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=316752 CPUtime=3.07 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 245 0 0 0 305 2 0 0 25 0 8 0 394092276 324354048 2707 33554432000 4194304 4964800 140733993151008 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=316752 CPUtime=3.07 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 130 0 0 0 306 1 0 0 22 0 8 0 394092276 324354048 2707 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660321844 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=316752 CPUtime=3.07 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 220 0 0 0 305 2 0 0 18 0 8 0 394092276 324354048 2707 33554432000 4194304 4964800 140733993151008 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=316752 CPUtime=3.06 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 117 0 0 0 305 1 0 0 18 0 8 0 394092276 324354048 2707 33554432000 4194304 4964800 140733993151008 18446744073709551615 4654559 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=316752 CPUtime=3.06 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 144 0 0 0 305 1 0 0 18 0 8 0 394092276 324354048 2707 33554432000 4194304 4964800 140733993151008 18446744073709551615 4683730 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=316752 CPUtime=3.04 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 550 0 0 0 303 1 0 0 18 0 8 0 394092276 324354048 2707 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.56
Current children cumulated vsize (KiB) 316752

[startup+6.3011 s]
/proc/loadavg: 8.48 8.53 8.27 9/385 25146
/proc/meminfo: memFree=25006680/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=317276 CPUtime=50.03 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 3346 0 0 0 4979 24 0 0 25 0 8 0 394092275 324890624 3271 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/25138/statm: 79319 3271 464 189 0 73668 0
[pid=25138/tid=25139] ppid=25136 vsize=317276 CPUtime=6.28 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 619 0 0 0 626 2 0 0 18 0 8 0 394092276 324890624 3271 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670118 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=317276 CPUtime=6.26 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 296 0 0 0 622 4 0 0 19 0 8 0 394092276 324890624 3271 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=317276 CPUtime=6.25 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 148 0 0 0 623 2 0 0 20 0 8 0 394092276 324890624 3271 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=317276 CPUtime=6.25 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 248 0 0 0 621 4 0 0 19 0 8 0 394092276 324890624 3271 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=317276 CPUtime=6.25 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 151 0 0 0 622 3 0 0 20 0 8 0 394092276 324890624 3271 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=317276 CPUtime=6.25 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 168 0 0 0 623 2 0 0 18 0 8 0 394092276 324890624 3271 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=317276 CPUtime=6.2 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 669 0 0 0 618 2 0 0 20 0 8 0 394092276 324890624 3271 33554432000 4194304 4964800 140733993151008 18446744073709551615 4365155 0 0 4096 18946 0 0 0 -1 7 0 0 0

################
# More data... #
################


[startup+4662.3 s]
/proc/loadavg: 8.01 8.02 8.00 9/385 25283
/proc/meminfo: memFree=24987292/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=450744 CPUtime=37150.3 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 7471 0 0 0 3705440 9594 0 0 22 0 8 0 394092275 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4669574 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/25138/statm: 112686 7396 468 189 0 107035 0
[pid=25138/tid=25139] ppid=25136 vsize=450744 CPUtime=4646.97 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 2106 0 0 0 463563 1134 0 0 25 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4654605 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=450744 CPUtime=4633.84 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 534 0 0 0 462052 1332 0 0 19 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670212 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=450744 CPUtime=4640.03 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 296 0 0 0 462744 1259 0 0 18 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660319210 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=450744 CPUtime=4643.29 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 422 0 0 0 463057 1272 0 0 19 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4660835 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=450744 CPUtime=4644.18 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 351 0 0 0 463188 1230 0 0 19 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=450744 CPUtime=4648.57 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 389 0 0 0 463671 1186 0 0 18 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670538 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=450744 CPUtime=4642.06 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 1588 0 0 0 463048 1158 0 0 20 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4366312 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37150.3
Current children cumulated vsize (KiB) 450744

[startup+4722.31 s]
/proc/loadavg: 8.00 8.01 8.00 9/385 25284
/proc/meminfo: memFree=24987380/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=450744 CPUtime=37628.5 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 7471 0 0 0 3753129 9720 0 0 20 0 8 0 394092275 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/25138/statm: 112686 7396 468 189 0 107035 0
[pid=25138/tid=25139] ppid=25136 vsize=450744 CPUtime=4706.81 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 2106 0 0 0 469532 1149 0 0 25 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4654543 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=450744 CPUtime=4693.72 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 534 0 0 0 468020 1352 0 0 18 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4660444 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=450744 CPUtime=4699.68 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 296 0 0 0 468694 1274 0 0 25 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4668564 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=450744 CPUtime=4703.1 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 422 0 0 0 469019 1291 0 0 18 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4660419 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=450744 CPUtime=4703.98 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 351 0 0 0 469152 1246 0 0 25 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4668732 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=450744 CPUtime=4708.48 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 389 0 0 0 469648 1200 0 0 19 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4321020 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=450744 CPUtime=4701.89 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 1588 0 0 0 469016 1173 0 0 18 0 8 0 394092276 461561856 7396 33554432000 4194304 4964800 140733993151008 18446744073709551615 4320984 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37628.5
Current children cumulated vsize (KiB) 450744

[startup+4782.3 s]
/proc/loadavg: 8.14 8.05 8.01 9/385 25289
/proc/meminfo: memFree=24986184/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=450744 CPUtime=38105.7 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 7478 0 0 0 3800729 9839 0 0 18 0 8 0 394092275 461561856 7403 33554432000 4194304 4964800 140733993151008 18446744073709551615 4642509 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/25138/statm: 112686 7403 468 189 0 107035 0
[pid=25138/tid=25139] ppid=25136 vsize=450744 CPUtime=4766.63 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 2110 0 0 0 475500 1163 0 0 18 0 8 0 394092276 461561856 7403 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=450744 CPUtime=4753.57 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 534 0 0 0 473986 1371 0 0 23 0 8 0 394092276 461561856 7403 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=450744 CPUtime=4759.53 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 296 0 0 0 474666 1287 0 0 18 0 8 0 394092276 461561856 7403 33554432000 4194304 4964800 140733993151008 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=450744 CPUtime=4762.46 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 422 0 0 0 474941 1305 0 0 20 0 8 0 394092276 461561856 7403 33554432000 4194304 4964800 140733993151008 18446744073709551615 4342186 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=450744 CPUtime=4763.56 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 351 0 0 0 475095 1261 0 0 20 0 8 0 394092276 461561856 7403 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=450744 CPUtime=4767.93 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 389 0 0 0 475578 1215 0 0 25 0 8 0 394092276 461561856 7403 33554432000 4194304 4964800 140733993151008 18446744073709551615 4660263 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=450744 CPUtime=4761.57 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 1591 0 0 0 474969 1188 0 0 19 0 8 0 394092276 461561856 7403 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38105.7
Current children cumulated vsize (KiB) 450744

[startup+4842.3 s]
/proc/loadavg: 8.08 8.05 8.01 9/385 25290
/proc/meminfo: memFree=24986500/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=450744 CPUtime=38583.6 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 7489 0 0 0 3848400 9962 0 0 25 0 8 0 394092275 461561856 7414 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/25138/statm: 112686 7414 468 189 0 107035 0
[pid=25138/tid=25139] ppid=25136 vsize=450744 CPUtime=4826.47 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 2113 0 0 0 481468 1179 0 0 21 0 8 0 394092276 461561856 7414 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=450744 CPUtime=4813.44 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 534 0 0 0 479957 1387 0 0 25 0 8 0 394092276 461561856 7414 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=450744 CPUtime=4819.47 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 297 0 0 0 480647 1300 0 0 22 0 8 0 394092276 461561856 7414 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=450744 CPUtime=4822.24 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 424 0 0 0 480904 1320 0 0 20 0 8 0 394092276 461561856 7414 33554432000 4194304 4964800 140733993151008 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=450744 CPUtime=4823.33 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 352 0 0 0 481054 1279 0 0 18 0 8 0 394092276 461561856 7414 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=450744 CPUtime=4827.1 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 392 0 0 0 481478 1232 0 0 18 0 8 0 394092276 461561856 7414 33554432000 4194304 4964800 140733993151008 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=450744 CPUtime=4821.29 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 1591 0 0 0 480927 1202 0 0 18 0 8 0 394092276 461561856 7414 33554432000 4194304 4964800 140733993151008 18446744073709551615 4668766 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38583.6
Current children cumulated vsize (KiB) 450744

[startup+4902.3 s]
/proc/loadavg: 8.03 8.04 8.01 9/385 25292
/proc/meminfo: memFree=24986460/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=450744 CPUtime=39061.5 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 7501 0 0 0 3896065 10087 0 0 19 0 8 0 394092275 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670321 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/25138/statm: 112686 7426 468 189 0 107035 0
[pid=25138/tid=25139] ppid=25136 vsize=450744 CPUtime=4886.3 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 2115 0 0 0 487435 1195 0 0 20 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=450744 CPUtime=4873.09 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 534 0 0 0 485904 1405 0 0 19 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=450744 CPUtime=4879.39 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 297 0 0 0 486627 1312 0 0 19 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4363591 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=450744 CPUtime=4882.01 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 424 0 0 0 486864 1337 0 0 21 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=450744 CPUtime=4883.09 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 353 0 0 0 487013 1296 0 0 18 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670511 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=450744 CPUtime=4886.47 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 396 0 0 0 487399 1248 0 0 25 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4660463 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=450744 CPUtime=4881 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 1594 0 0 0 486884 1216 0 0 19 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4669280 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39061.5
Current children cumulated vsize (KiB) 450744

[startup+4962.3 s]
/proc/loadavg: 8.01 8.03 8.00 9/385 25294
/proc/meminfo: memFree=24986540/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=450744 CPUtime=39539.4 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 7501 0 0 0 3943729 10215 0 0 25 0 8 0 394092275 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4342144 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/25138/statm: 112686 7426 468 189 0 107035 0
[pid=25138/tid=25139] ppid=25136 vsize=450744 CPUtime=4946.14 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 2115 0 0 0 493401 1213 0 0 20 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=450744 CPUtime=4932.23 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 534 0 0 0 491801 1422 0 0 18 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4361252 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=450744 CPUtime=4939.31 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 297 0 0 0 492605 1326 0 0 18 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4669187 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=450744 CPUtime=4941.8 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 424 0 0 0 492825 1355 0 0 18 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4668698 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=450744 CPUtime=4942.86 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 353 0 0 0 492974 1312 0 0 20 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=450744 CPUtime=4946.33 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 396 0 0 0 493370 1263 0 0 23 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 268660767263 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=450744 CPUtime=4940.71 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 1594 0 0 0 492838 1233 0 0 18 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4660114 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39539.4
Current children cumulated vsize (KiB) 450744



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5020.2 s]
/proc/loadavg: 8.00 8.02 8.00 9/385 25295
/proc/meminfo: memFree=24986488/32951124 swapFree=46575260/67111528
[pid=25138] ppid=25136 vsize=450744 CPUtime=40000.7 cores=0-7
/proc/25138/stat : 25138 (claspmt) R 25136 25138 24446 0 -1 4202496 7501 0 0 0 3989737 10331 0 0 22 0 8 0 394092275 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4660157 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/25138/statm: 112686 7426 468 189 0 107035 0
[pid=25138/tid=25139] ppid=25136 vsize=450744 CPUtime=5003.9 cores=0-7
/proc/25138/task/25139/stat : 25139 (claspmt) R 25136 25138 24446 0 -1 4202560 2115 0 0 0 499164 1226 0 0 25 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=25138/tid=25140] ppid=25136 vsize=450744 CPUtime=4989.33 cores=0-7
/proc/25138/task/25140/stat : 25140 (claspmt) R 25136 25138 24446 0 -1 4202560 534 0 0 0 497497 1436 0 0 21 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4465530 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=25138/tid=25141] ppid=25136 vsize=450744 CPUtime=4997.15 cores=0-7
/proc/25138/task/25141/stat : 25141 (claspmt) R 25136 25138 24446 0 -1 4202560 297 0 0 0 498375 1340 0 0 25 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4660832 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=25138/tid=25142] ppid=25136 vsize=450744 CPUtime=4999.47 cores=0-7
/proc/25138/task/25142/stat : 25142 (claspmt) R 25136 25138 24446 0 -1 4202560 424 0 0 0 498575 1372 0 0 18 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=25138/tid=25143] ppid=25136 vsize=450744 CPUtime=5000.54 cores=0-7
/proc/25138/task/25143/stat : 25143 (claspmt) R 25136 25138 24446 0 -1 4202560 353 0 0 0 498727 1327 0 0 18 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4670412 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=25138/tid=25144] ppid=25136 vsize=450744 CPUtime=5004.1 cores=0-7
/proc/25138/task/25144/stat : 25144 (claspmt) R 25136 25138 24446 0 -1 4202560 396 0 0 0 499132 1278 0 0 23 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4361293 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=25138/tid=25145] ppid=25136 vsize=450744 CPUtime=4998.34 cores=0-7
/proc/25138/task/25145/stat : 25145 (claspmt) R 25136 25138 24446 0 -1 4202560 1594 0 0 0 498586 1248 0 0 22 0 8 0 394092276 461561856 7426 33554432000 4194304 4964800 140733993151008 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.7
Current children cumulated vsize (KiB) 450744

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 5020.22
CPU time (s): 40000.8
CPU user time (s): 39897.4
CPU system time (s): 103.315
CPU usage (%): 796.792
Max. virtual memory (cumulated for all children) (KiB): 450744

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39897.4
system time used= 103.315
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7513
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17198202
involuntary context switches= 186024

runsolver used 17.6913 second user time and 41.6687 second system time

The end

Launcher Data 

Begin job on node107 at 2011-05-16 00:36:50
IDJOB=3380984
IDBENCH=83144
IDSOLVER=1865
FILE ID=node107/3380984-1305499010
RUNJOBID= node107-1305491634-24460
PBS_JOBID= 13325417
Free space on /tmp= 73452 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n160-s73223945-unsat.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380984-1305499010/watcher-3380984-1305499010 -o /tmp/evaluation-result-3380984-1305499010/solver-3380984-1305499010 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380984-1305499010.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ebbfc0ffb6aa4fcba0d5ce3964018543
RANDOM SEED=16597774

node107.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5359.47
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.829
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25018000 kB
Buffers:        207868 kB
Cached:        1522136 kB
SwapCached:       9824 kB
Active:        6992668 kB
Inactive:       642612 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25018000 kB
SwapTotal:    67111528 kB
SwapFree:     46575260 kB
Dirty:             776 kB
Writeback:           0 kB
AnonPages:     5903304 kB
Mapped:          26008 kB
Slab:           151524 kB
PageTables:      78800 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 99209620 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73448 MiB
End job on node107 at 2011-05-16 02:00:32