Trace number 3380991

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.3 5020.03

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n200-s00813792-unsat.cnf
MD5SUM92046422d2d9595619b29413c0964c9c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables201
Number of clauses412
Sum of the clauses size1236
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3412
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...499126/instance-3380991-1305499126.cnf
0.00/0.00	c Solving...
40000.22/5020.02	
40000.22/5020.02	*** INTERRUPTED! ***
40000.22/5020.02	*** Shutting down threads...
40000.22/5020.02	s UNKNOWN
40000.22/5020.02	
40000.22/5020.02	c INTERRUPTED   : 1
40000.22/5020.02	c Models        : 0+    
40000.22/5020.02	c Time          : 5020.016s (Solving: 5020.02s 1st Model: 0.00s Unsat: 0.00s)
40000.22/5020.02	c CPU Time      : 40000.270s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380991-1305499126/watcher-3380991-1305499126 -o /tmp/evaluation-result-3380991-1305499126/solver-3380991-1305499126 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380991-1305499126.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.01 8.04 8.00 2/374 31152
/proc/meminfo: memFree=20611788/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=315440 CPUtime=0.02 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 887 0 0 0 2 0 0 0 25 0 8 0 661512247 323010560 811 33554432000 4194304 4964800 140735524602016 18446744073709551615 4379899 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/31152/statm: 78860 811 464 189 0 73209 0
[pid=31152/tid=31153] ppid=31150 vsize=315440 CPUtime=0 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 39 0 0 0 0 0 0 0 18 0 8 0 661512247 323010560 818 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=315440 CPUtime=0 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 29 0 0 0 0 0 0 0 17 0 8 0 661512247 323010560 818 33554432000 4194304 4964800 140735524602016 18446744073709551615 210646807237 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=315440 CPUtime=0 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 26 0 0 0 0 0 0 0 25 0 8 0 661512247 323010560 819 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=315440 CPUtime=0 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 26 0 0 0 0 0 0 0 18 0 8 0 661512247 323010560 819 33554432000 4194304 4964800 140735524602016 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=315440 CPUtime=0 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 26 0 0 0 0 0 0 0 18 0 8 0 661512247 323010560 819 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=315440 CPUtime=0 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 34 0 0 0 0 0 0 0 18 0 8 0 661512247 323010560 819 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=315440 CPUtime=0 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 76 0 0 0 0 0 0 0 18 0 8 0 661512247 323010560 819 33554432000 4194304 4964800 140735524602016 18446744073709551615 210646807237 0 0 4096 18946 0 0 0 -1 4 0 0 0

[startup+0.0874111 s]
/proc/loadavg: 8.01 8.04 8.00 2/374 31152
/proc/meminfo: memFree=20611788/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=315704 CPUtime=0.68 cores=0-7
/proc/31152/stat : 31152 (claspmt) S 31150 31152 30539 0 -1 4202496 1266 0 0 0 67 1 0 0 18 0 8 0 661512247 323280896 1190 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251438 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31152/statm: 78959 1290 464 189 0 73308 0
[pid=31152/tid=31153] ppid=31150 vsize=315968 CPUtime=0.14 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 120 0 0 0 14 0 0 0 18 0 8 0 661512247 323551232 1369 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=315968 CPUtime=0.16 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 100 0 0 0 16 0 0 0 18 0 8 0 661512247 323551232 1401 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=315968 CPUtime=0.2 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 83 0 0 0 20 0 0 0 25 0 8 0 661512247 323551232 1484 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=315968 CPUtime=0.2 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 94 0 0 0 20 0 0 0 18 0 8 0 661512247 323551232 1532 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=316104 CPUtime=0.24 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 76 0 0 0 24 0 0 0 18 0 8 0 661512247 323690496 1582 33554432000 4194304 4964800 140735524602016 18446744073709551615 4668698 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=316104 CPUtime=0.26 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 115 0 0 0 26 0 0 0 18 0 8 0 661512247 323690496 1620 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=316104 CPUtime=0.26 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 228 0 0 0 26 0 0 0 18 0 8 0 661512247 323690496 1621 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 315704

[startup+0.443176 s]
/proc/loadavg: 8.01 8.04 8.00 2/374 31152
/proc/meminfo: memFree=20611788/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=316240 CPUtime=3.63 cores=0-7
/proc/31152/stat : 31152 (claspmt) S 31150 31152 30539 0 -1 4202496 1950 0 0 0 361 2 0 0 18 0 8 0 661512247 323829760 1874 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251438 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31152/statm: 79060 1874 464 189 0 73409 0
[pid=31152/tid=31153] ppid=31150 vsize=316240 CPUtime=0.48 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 198 0 0 0 48 0 0 0 18 0 8 0 661512247 323829760 1898 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321042 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=316240 CPUtime=0.49 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 181 0 0 0 49 0 0 0 18 0 8 0 661512247 323829760 1911 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=316372 CPUtime=0.54 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 111 0 0 0 54 0 0 0 25 0 8 0 661512247 323964928 1930 33554432000 4194304 4964800 140735524602016 18446744073709551615 4362996 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=316372 CPUtime=0.54 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 147 0 0 0 54 0 0 0 18 0 8 0 661512247 323964928 1966 33554432000 4194304 4964800 140735524602016 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=316372 CPUtime=0.61 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 103 0 0 0 61 0 0 0 18 0 8 0 661512247 323964928 2029 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=316372 CPUtime=0.64 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 135 0 0 0 64 0 0 0 18 0 8 0 661512247 323964928 2054 33554432000 4194304 4964800 140735524602016 18446744073709551615 4325293 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=316372 CPUtime=0.67 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 347 0 0 0 67 0 0 0 18 0 8 0 661512247 323964928 2080 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.63
Current children cumulated vsize (KiB) 316240

[startup+0.901915 s]
/proc/loadavg: 8.01 8.04 8.00 2/374 31152
/proc/meminfo: memFree=20611788/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=316636 CPUtime=7.28 cores=0-7
/proc/31152/stat : 31152 (claspmt) S 31150 31152 30539 0 -1 4202496 2318 0 0 0 724 4 0 0 18 0 8 0 661512247 324235264 2242 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251438 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31152/statm: 79159 2258 464 189 0 73508 0
[pid=31152/tid=31153] ppid=31150 vsize=316636 CPUtime=1 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 261 0 0 0 100 0 0 0 19 0 8 0 661512247 324235264 2289 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=316768 CPUtime=1.01 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 238 0 0 0 101 0 0 0 19 0 8 0 661512247 324370432 2300 33554432000 4194304 4964800 140735524602016 18446744073709551615 4642509 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=316768 CPUtime=1.06 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 124 0 0 0 106 0 0 0 25 0 8 0 661512247 324370432 2334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670361 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=316768 CPUtime=1.04 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 191 0 0 0 104 0 0 0 18 0 8 0 661512247 324370432 2334 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=316768 CPUtime=1.1 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 125 0 0 0 110 0 0 0 18 0 8 0 661512247 324370432 2351 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=316768 CPUtime=1.15 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 148 0 0 0 115 0 0 0 18 0 8 0 661512247 324370432 2384 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=316768 CPUtime=1.16 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 434 0 0 0 116 0 0 0 18 0 8 0 661512247 324370432 2386 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 7.28
Current children cumulated vsize (KiB) 316636

[startup+1.53531 s]
/proc/loadavg: 8.01 8.04 8.00 2/374 31152
/proc/meminfo: memFree=20611788/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=316900 CPUtime=12.14 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 2661 0 0 0 1207 7 0 0 19 0 8 0 661512247 324505600 2585 33554432000 4194304 4964800 140735524602016 18446744073709551615 4342174 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31152/statm: 79225 2585 464 189 0 73574 0
[pid=31152/tid=31153] ppid=31150 vsize=316900 CPUtime=1.51 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 337 0 0 0 151 0 0 0 20 0 8 0 661512247 324505600 2585 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=316900 CPUtime=1.5 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 283 0 0 0 149 1 0 0 20 0 8 0 661512247 324505600 2585 33554432000 4194304 4964800 140735524602016 18446744073709551615 4669201 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=316900 CPUtime=1.51 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 131 0 0 0 151 0 0 0 25 0 8 0 661512247 324505600 2585 33554432000 4194304 4964800 140735524602016 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=316900 CPUtime=1.49 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 220 0 0 0 149 0 0 0 19 0 8 0 661512247 324505600 2585 33554432000 4194304 4964800 140735524602016 18446744073709551615 4660495 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=316900 CPUtime=1.51 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 137 0 0 0 151 0 0 0 19 0 8 0 661512247 324505600 2585 33554432000 4194304 4964800 140735524602016 18446744073709551615 4668748 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=316900 CPUtime=1.52 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 156 0 0 0 151 1 0 0 18 0 8 0 661512247 324505600 2585 33554432000 4194304 4964800 140735524602016 18446744073709551615 4654552 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=316900 CPUtime=1.51 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 469 0 0 0 151 0 0 0 18 0 8 0 661512247 324505600 2585 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.14
Current children cumulated vsize (KiB) 316900

[startup+1.61394 s]
/proc/loadavg: 8.01 8.04 8.00 2/374 31152
/proc/meminfo: memFree=20611788/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=316900 CPUtime=12.73 cores=0-7
/proc/31152/stat : 31152 (claspmt) S 31150 31152 30539 0 -1 4202496 2716 0 0 0 1266 7 0 0 19 0 8 0 661512247 324505600 2640 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251438 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31152/statm: 79225 2650 464 189 0 73574 0
[pid=31152/tid=31153] ppid=31150 vsize=316900 CPUtime=1.61 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 351 0 0 0 161 0 0 0 20 0 8 0 661512247 324505600 2650 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=316900 CPUtime=1.6 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 297 0 0 0 159 1 0 0 18 0 8 0 661512247 324505600 2650 33554432000 4194304 4964800 140735524602016 18446744073709551615 4320911 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=316900 CPUtime=1.61 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 133 0 0 0 161 0 0 0 25 0 8 0 661512247 324505600 2650 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670282 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=316900 CPUtime=1.59 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 227 0 0 0 159 0 0 0 19 0 8 0 661512247 324505600 2650 33554432000 4194304 4964800 140735524602016 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=316900 CPUtime=1.61 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 142 0 0 0 161 0 0 0 19 0 8 0 661512247 324505600 2650 33554432000 4194304 4964800 140735524602016 18446744073709551615 4668817 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=316900 CPUtime=1.62 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 157 0 0 0 161 1 0 0 18 0 8 0 661512247 324505600 2650 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=316900 CPUtime=1.61 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 477 0 0 0 161 0 0 0 18 0 8 0 661512247 324505600 2650 33554432000 4194304 4964800 140735524602016 18446744073709551615 4660513 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.73
Current children cumulated vsize (KiB) 316900

[startup+3.10095 s]
/proc/loadavg: 8.09 8.05 8.01 9/382 31160
/proc/meminfo: memFree=20602704/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=317288 CPUtime=24.32 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 3176 0 0 0 2415 17 0 0 18 0 8 0 661512247 324902912 3100 33554432000 4194304 4964800 140735524602016 18446744073709551615 4320942 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31152/statm: 79322 3100 464 189 0 73671 0
[pid=31152/tid=31153] ppid=31150 vsize=317288 CPUtime=3.06 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 473 0 0 0 305 1 0 0 18 0 8 0 661512247 324902912 3100 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=317288 CPUtime=2.88 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 352 0 0 0 285 3 0 0 19 0 8 0 661512247 324902912 3100 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=317288 CPUtime=3.06 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 157 0 0 0 304 2 0 0 19 0 8 0 661512247 324902912 3100 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=317288 CPUtime=3.04 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 279 0 0 0 303 1 0 0 18 0 8 0 661512247 324902912 3100 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=317288 CPUtime=3.05 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 155 0 0 0 304 1 0 0 17 0 8 0 661512247 324902912 3100 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=317288 CPUtime=3.06 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 181 0 0 0 304 2 0 0 18 0 8 0 661512247 324902912 3100 33554432000 4194304 4964800 140735524602016 18446744073709551615 4660463 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=317288 CPUtime=3.05 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 572 0 0 0 304 1 0 0 20 0 8 0 661512247 324902912 3100 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.32
Current children cumulated vsize (KiB) 317288

[startup+6.30042 s]
/proc/loadavg: 8.09 8.05 8.01 9/382 31160
/proc/meminfo: memFree=20599028/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=317808 CPUtime=49.78 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 3909 0 0 0 4951 27 0 0 25 0 8 0 661512247 325435392 3833 33554432000 4194304 4964800 140735524602016 18446744073709551615 4684107 0 0 4096 18946 18446744073709551615 0 0 17 7 0 0 0
/proc/31152/statm: 79452 3833 464 189 0 73801 0
[pid=31152/tid=31153] ppid=31150 vsize=317808 CPUtime=6.25 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 671 0 0 0 623 2 0 0 18 0 8 0 661512247 325435392 3833 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=317808 CPUtime=6.05 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 445 0 0 0 601 4 0 0 18 0 8 0 661512247 325435392 3833 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321059 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=317808 CPUtime=6.24 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 191 0 0 0 621 3 0 0 19 0 8 0 661512247 325435392 3833 33554432000 4194304 4964800 140735524602016 18446744073709551615 4660452 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=317808 CPUtime=6.24 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 328 0 0 0 622 2 0 0 23 0 8 0 661512247 325435392 3833 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=317808 CPUtime=6.24 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 189 0 0 0 621 3 0 0 22 0 8 0 661512247 325435392 3833 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670295 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=317808 CPUtime=6.25 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 227 0 0 0 622 3 0 0 25 0 8 0 661512247 325435392 3833 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=317808 CPUtime=6.23 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 737 0 0 0 621 2 0 0 20 0 8 0 661512247 325435392 3833 33554432000 4194304 4964800 140735524602016 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 4 0 0 0

################
# More data... #
################


[startup+4662.3 s]
/proc/loadavg: 7.95 8.02 7.99 9/382 31296
/proc/meminfo: memFree=20574836/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=452112 CPUtime=37149.4 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 9407 0 0 0 3705759 9184 0 0 18 0 8 0 661512247 462962688 9331 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670323 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/31152/statm: 113028 9331 468 189 0 107377 0
[pid=31152/tid=31153] ppid=31150 vsize=452112 CPUtime=4644.1 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 2515 0 0 0 463282 1128 0 0 20 0 8 0 661512247 462962688 9331 33554432000 4194304 4964800 140735524602016 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=452112 CPUtime=4643.98 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) S 31150 31152 30539 0 -1 4202560 843 0 0 0 463073 1325 0 0 20 0 8 0 661512247 462962688 9331 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251438 0 0 4096 18946 18446604444670192640 0 0 -1 4 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=452112 CPUtime=4641.34 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 429 0 0 0 462999 1135 0 0 23 0 8 0 661512247 462962688 9331 33554432000 4194304 4964800 140735524602016 18446744073709551615 4653477 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=452112 CPUtime=4647.28 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 561 0 0 0 463575 1153 0 0 18 0 8 0 661512247 462962688 9331 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=452112 CPUtime=4641.01 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 469 0 0 0 462902 1199 0 0 20 0 8 0 661512247 462962688 9331 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=452112 CPUtime=4636.03 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 486 0 0 0 462453 1150 0 0 20 0 8 0 661512247 462962688 9331 33554432000 4194304 4964800 140735524602016 18446744073709551615 210647251487 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=452112 CPUtime=4649.08 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 1991 0 0 0 463861 1047 0 0 20 0 8 0 661512247 462962688 9331 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37149.4
Current children cumulated vsize (KiB) 452112

[startup+4722.3 s]
/proc/loadavg: 7.98 8.01 7.99 9/382 31298
/proc/meminfo: memFree=20574824/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=452112 CPUtime=37627.7 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 9410 0 0 0 3753474 9295 0 0 19 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670335 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/31152/statm: 113028 9334 468 189 0 107377 0
[pid=31152/tid=31153] ppid=31150 vsize=452112 CPUtime=4703.52 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 2518 0 0 0 469209 1143 0 0 19 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=452112 CPUtime=4703.77 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 843 0 0 0 469037 1340 0 0 25 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4362996 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=452112 CPUtime=4701.28 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 429 0 0 0 468980 1148 0 0 19 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4659391 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=452112 CPUtime=4707.19 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 561 0 0 0 469553 1166 0 0 22 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4658016 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=452112 CPUtime=4700.64 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 469 0 0 0 468851 1213 0 0 25 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4645016 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=452112 CPUtime=4695.87 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 486 0 0 0 468423 1164 0 0 19 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321029 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=452112 CPUtime=4708.88 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 1991 0 0 0 469827 1061 0 0 25 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37627.7
Current children cumulated vsize (KiB) 452112

[startup+4782.3 s]
/proc/loadavg: 7.99 8.00 7.99 9/382 31299
/proc/meminfo: memFree=20575196/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=452112 CPUtime=38105.8 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 9410 0 0 0 3801175 9401 0 0 25 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/31152/statm: 113028 9334 468 189 0 107377 0
[pid=31152/tid=31153] ppid=31150 vsize=452112 CPUtime=4762.65 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 2518 0 0 0 475107 1158 0 0 19 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=452112 CPUtime=4763.54 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 843 0 0 0 475000 1354 0 0 19 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 210646806439 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=452112 CPUtime=4761.18 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 429 0 0 0 474960 1158 0 0 20 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4654549 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=452112 CPUtime=4767.08 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 561 0 0 0 475530 1178 0 0 19 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4658589 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=452112 CPUtime=4760.45 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 469 0 0 0 474816 1229 0 0 20 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=452112 CPUtime=4755.68 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 486 0 0 0 474390 1178 0 0 18 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4669276 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=452112 CPUtime=4768.72 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 1991 0 0 0 475798 1074 0 0 25 0 8 0 661512247 462962688 9334 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321054 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38105.8
Current children cumulated vsize (KiB) 452112

[startup+4842.31 s]
/proc/loadavg: 8.04 8.02 8.00 9/382 31301
/proc/meminfo: memFree=20575316/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=452112 CPUtime=38584.1 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 9413 0 0 0 3848896 9510 0 0 19 0 8 0 661512247 462962688 9337 33554432000 4194304 4964800 140735524602016 18446744073709551615 4668611 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/31152/statm: 113028 9337 468 189 0 107377 0
[pid=31152/tid=31153] ppid=31150 vsize=452112 CPUtime=4822.32 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 2518 0 0 0 481062 1170 0 0 25 0 8 0 661512247 462962688 9337 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=452112 CPUtime=4822.92 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 843 0 0 0 480923 1369 0 0 18 0 8 0 661512247 462962688 9337 33554432000 4194304 4964800 140735524602016 18446744073709551615 4669216 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=452112 CPUtime=4821.04 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 429 0 0 0 480933 1171 0 0 25 0 8 0 661512247 462962688 9337 33554432000 4194304 4964800 140735524602016 18446744073709551615 4325338 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=452112 CPUtime=4826.98 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 561 0 0 0 481506 1192 0 0 18 0 8 0 661512247 462962688 9337 33554432000 4194304 4964800 140735524602016 18446744073709551615 4660123 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=452112 CPUtime=4820.26 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 469 0 0 0 480780 1246 0 0 18 0 8 0 661512247 462962688 9337 33554432000 4194304 4964800 140735524602016 18446744073709551615 4334309 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=452112 CPUtime=4815.52 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 486 0 0 0 480361 1191 0 0 18 0 8 0 661512247 462962688 9337 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670190 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=452112 CPUtime=4828.63 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 1994 0 0 0 481777 1086 0 0 25 0 8 0 661512247 462962688 9337 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 38584.1
Current children cumulated vsize (KiB) 452112

[startup+4902.3 s]
/proc/loadavg: 8.01 8.01 8.00 9/382 31303
/proc/meminfo: memFree=20575316/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=452112 CPUtime=39062.2 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 9418 0 0 0 3896604 9616 0 0 18 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/31152/statm: 113028 9342 468 189 0 107377 0
[pid=31152/tid=31153] ppid=31150 vsize=452112 CPUtime=4882.24 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 2518 0 0 0 487042 1182 0 0 25 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=452112 CPUtime=4882.1 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 843 0 0 0 486829 1381 0 0 25 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321013 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=452112 CPUtime=4880.83 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 430 0 0 0 486899 1184 0 0 21 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=452112 CPUtime=4886.86 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 561 0 0 0 487480 1206 0 0 25 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=452112 CPUtime=4880.03 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 469 0 0 0 486743 1260 0 0 25 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4660163 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=452112 CPUtime=4875.32 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 486 0 0 0 486327 1205 0 0 18 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=452112 CPUtime=4888.51 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 1994 0 0 0 487751 1100 0 0 18 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4320961 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39062.2
Current children cumulated vsize (KiB) 452112

[startup+4962.3 s]
/proc/loadavg: 8.00 8.00 8.00 9/382 31313
/proc/meminfo: memFree=20573496/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=452112 CPUtime=39540.3 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 9418 0 0 0 3944301 9727 0 0 25 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/31152/statm: 113028 9342 468 189 0 107377 0
[pid=31152/tid=31153] ppid=31150 vsize=452112 CPUtime=4942.14 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 2518 0 0 0 493020 1194 0 0 19 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=452112 CPUtime=4941.26 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 843 0 0 0 492729 1397 0 0 18 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=452112 CPUtime=4940.63 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 430 0 0 0 492865 1198 0 0 21 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321150 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=452112 CPUtime=4946.74 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 561 0 0 0 493453 1221 0 0 18 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4342162 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=452112 CPUtime=4939.77 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 469 0 0 0 492701 1276 0 0 19 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=452112 CPUtime=4935.14 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 486 0 0 0 492296 1218 0 0 20 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4689125 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=452112 CPUtime=4948.4 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 1994 0 0 0 493727 1113 0 0 20 0 8 0 661512247 462962688 9342 33554432000 4194304 4964800 140735524602016 18446744073709551615 4668817 0 0 4096 18946 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 39540.3
Current children cumulated vsize (KiB) 452112



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5020 s]
/proc/loadavg: 8.06 8.01 8.00 9/382 31315
/proc/meminfo: memFree=20573624/32951132 swapFree=64495988/67111528
[pid=31152] ppid=31150 vsize=452112 CPUtime=40000.2 cores=0-7
/proc/31152/stat : 31152 (claspmt) R 31150 31152 30539 0 -1 4202496 9423 0 0 0 3990188 9834 0 0 18 0 8 0 661512247 462962688 9347 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/31152/statm: 113028 9347 468 189 0 107377 0
[pid=31152/tid=31153] ppid=31150 vsize=452112 CPUtime=4999.76 cores=0-7
/proc/31152/task/31153/stat : 31153 (claspmt) R 31150 31152 30539 0 -1 4202560 2519 0 0 0 498771 1205 0 0 18 0 8 0 661512247 462962688 9347 33554432000 4194304 4964800 140735524602016 18446744073709551615 4683700 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=31152/tid=31154] ppid=31150 vsize=452112 CPUtime=4998.69 cores=0-7
/proc/31152/task/31154/stat : 31154 (claspmt) R 31150 31152 30539 0 -1 4202560 843 0 0 0 498457 1412 0 0 19 0 8 0 661512247 462962688 9347 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=31152/tid=31155] ppid=31150 vsize=452112 CPUtime=4998.17 cores=0-7
/proc/31152/task/31155/stat : 31155 (claspmt) R 31150 31152 30539 0 -1 4202560 430 0 0 0 498605 1212 0 0 20 0 8 0 661512247 462962688 9347 33554432000 4194304 4964800 140735524602016 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=31152/tid=31156] ppid=31150 vsize=452112 CPUtime=5004.11 cores=0-7
/proc/31152/task/31156/stat : 31156 (claspmt) R 31150 31152 30539 0 -1 4202560 561 0 0 0 499175 1236 0 0 22 0 8 0 661512247 462962688 9347 33554432000 4194304 4964800 140735524602016 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=31152/tid=31157] ppid=31150 vsize=452112 CPUtime=4997.28 cores=0-7
/proc/31152/task/31157/stat : 31157 (claspmt) R 31150 31152 30539 0 -1 4202560 469 0 0 0 498437 1291 0 0 18 0 8 0 661512247 462962688 9347 33554432000 4194304 4964800 140735524602016 18446744073709551615 4364583 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=31152/tid=31158] ppid=31150 vsize=452112 CPUtime=4992.68 cores=0-7
/proc/31152/task/31158/stat : 31158 (claspmt) R 31150 31152 30539 0 -1 4202560 486 0 0 0 498037 1231 0 0 18 0 8 0 661512247 462962688 9347 33554432000 4194304 4964800 140735524602016 18446744073709551615 4321020 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=31152/tid=31159] ppid=31150 vsize=452112 CPUtime=5005.7 cores=0-7
/proc/31152/task/31159/stat : 31159 (claspmt) R 31150 31152 30539 0 -1 4202560 1998 0 0 0 499445 1125 0 0 21 0 8 0 661512247 462962688 9347 33554432000 4194304 4964800 140735524602016 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 452112

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 5020.03
CPU time (s): 40000.3
CPU user time (s): 39901.9
CPU system time (s): 98.343
CPU usage (%): 796.814
Max. virtual memory (cumulated for all children) (KiB): 452112

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39901.9
system time used= 98.343
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9441
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16674771
involuntary context switches= 135962

runsolver used 17.5623 second user time and 42.6435 second system time

The end

Launcher Data 

Begin job on node129 at 2011-05-16 00:38:46
IDJOB=3380991
IDBENCH=83151
IDSOLVER=1865
FILE ID=node129/3380991-1305499126
RUNJOBID= node129-1305493483-30553
PBS_JOBID= 13325426
Free space on /tmp= 73392 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n200-s00813792-unsat.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380991-1305499126/watcher-3380991-1305499126 -o /tmp/evaluation-result-3380991-1305499126/solver-3380991-1305499126 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380991-1305499126.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 92046422d2d9595619b29413c0964c9c
RANDOM SEED=1228752242

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      20612184 kB
Buffers:        279508 kB
Cached:        6416576 kB
SwapCached:      52664 kB
Active:        3559704 kB
Inactive:      8538116 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      20612184 kB
SwapTotal:    67111528 kB
SwapFree:     64495988 kB
Dirty:             820 kB
Writeback:           0 kB
AnonPages:     5358260 kB
Mapped:          20712 kB
Slab:           133540 kB
PageTables:      40540 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 93359504 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73392 MiB
End job on node129 at 2011-05-16 02:02:28