Trace number 3380971

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40001 5009.11

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom22.cnf
MD5SUM808b4b06b3dea960876e6772f0b9c207
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables53118
Number of clauses178062
Sum of the clauses size454634
Maximum clause length1670
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 290658
Number of clauses of size 386491
Number of clauses of size 4252
Number of clauses of size 520
Number of clauses of size over 5640

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...497864/instance-3380971-1305497864.cnf
0.49/0.50	c Solving...
40000.43/5008.62	
40000.43/5008.62	*** INTERRUPTED! ***
40000.43/5008.62	*** Shutting down threads...
40000.96/5009.10	s UNKNOWN
40000.96/5009.10	
40000.96/5009.10	c INTERRUPTED   : 1
40000.96/5009.10	c Models        : 0+    
40000.96/5009.10	c Time          : 5008.619s (Solving: 5008.11s 1st Model: 0.00s Unsat: 0.00s)
40000.96/5009.10	c CPU Time      : 40000.490s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380971-1305497864/watcher-3380971-1305497864 -o /tmp/evaluation-result-3380971-1305497864/solver-3380971-1305497864 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380971-1305497864.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.06 1.03 1.00 2/365 18370
/proc/meminfo: memFree=21959936/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=31424 CPUtime=0 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 3525 0 0 0 0 0 0 0 21 0 1 0 642201984 32178176 3040 33554432000 4194304 4964800 140735355616160 18446744073709551615 264726101771 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/18370/statm: 7856 3041 389 189 0 2730 0

[startup+0.0690279 s]
/proc/loadavg: 1.06 1.03 1.00 2/365 18370
/proc/meminfo: memFree=21959936/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=42672 CPUtime=0.05 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 7463 0 0 0 5 0 0 0 21 0 1 0 642201984 43696128 5716 33554432000 4194304 4964800 140735355616160 18446744073709551615 264726066209 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/18370/statm: 10668 5742 399 189 0 5542 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 42672

[startup+0.101023 s]
/proc/loadavg: 1.06 1.03 1.00 2/365 18370
/proc/meminfo: memFree=21959936/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=47660 CPUtime=0.09 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 8660 0 0 0 9 0 0 0 21 0 1 0 642201984 48803840 6913 33554432000 4194304 4964800 140735355616160 18446744073709551615 264726101523 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/18370/statm: 11915 6915 399 189 0 6789 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 47660

[startup+0.300988 s]
/proc/loadavg: 1.06 1.03 1.00 2/365 18370
/proc/meminfo: memFree=21959936/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=52808 CPUtime=0.29 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 9994 0 0 0 28 1 0 0 22 0 1 0 642201984 54075392 8247 33554432000 4194304 4964800 140735355616160 18446744073709551615 4612533 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/18370/statm: 13202 8247 404 189 0 8076 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 52808

[startup+0.700872 s]
/proc/loadavg: 1.06 1.03 1.00 2/365 18370
/proc/meminfo: memFree=21959936/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=501624 CPUtime=0.75 cores=0-7
/proc/18370/stat : 18370 (claspmt) S 18368 18370 17872 0 -1 4202496 25912 0 0 0 68 7 0 0 18 0 8 0 642201984 513662976 20409 33554432000 4194304 4964800 140735355616160 18446744073709551615 264738220953 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/18370/statm: 125406 20409 443 189 0 119755 0
Current children cumulated CPU time (s) 0.75
Current children cumulated vsize (KiB) 501624

[startup+1.50072 s]
/proc/loadavg: 1.05 1.02 1.00 10/373 18378
/proc/meminfo: memFree=21877356/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=502152 CPUtime=7.06 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 28238 0 0 0 697 9 0 0 17 0 8 0 642201984 514203648 22735 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670155 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/18370/statm: 125538 22735 464 189 0 119887 0
[pid=18370/tid=18372] ppid=18368 vsize=502152 CPUtime=0.8 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 1997 0 0 0 80 0 0 0 17 0 8 0 642202035 514203648 22735 33554432000 4194304 4964800 140735355616160 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=502152 CPUtime=0.8 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 3016 0 0 0 79 1 0 0 17 0 8 0 642202035 514203648 22735 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668709 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=502152 CPUtime=0.79 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 2840 0 0 0 78 1 0 0 17 0 8 0 642202035 514203648 22735 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=502152 CPUtime=0.8 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 2042 0 0 0 79 1 0 0 17 0 8 0 642202035 514203648 22736 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670190 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=502152 CPUtime=0.93 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 2149 0 0 0 93 0 0 0 19 0 8 0 642202035 514203648 22736 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668763 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=502152 CPUtime=0.8 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 2702 0 0 0 79 1 0 0 17 0 8 0 642202035 514203648 22736 33554432000 4194304 4964800 140735355616160 18446744073709551615 4653692 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=502152 CPUtime=0.8 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 2349 0 0 0 79 1 0 0 17 0 8 0 642202035 514203648 22737 33554432000 4194304 4964800 140735355616160 18446744073709551615 264726066209 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 7.06
Current children cumulated vsize (KiB) 502152

[startup+3.10042 s]
/proc/loadavg: 1.05 1.02 1.00 10/373 18378
/proc/meminfo: memFree=21863344/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=504448 CPUtime=19.84 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 32575 0 0 0 1972 12 0 0 20 0 8 0 642201984 516554752 27072 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668734 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/18370/statm: 126112 27072 464 189 0 120461 0
[pid=18370/tid=18372] ppid=18368 vsize=504448 CPUtime=2.39 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 2336 0 0 0 239 0 0 0 19 0 8 0 642202035 516554752 27072 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=504448 CPUtime=2.39 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 3916 0 0 0 238 1 0 0 19 0 8 0 642202035 516554752 27072 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=504448 CPUtime=2.38 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 3401 0 0 0 237 1 0 0 19 0 8 0 642202035 516554752 27072 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=504448 CPUtime=2.4 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 2695 0 0 0 239 1 0 0 19 0 8 0 642202035 516554752 27072 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668715 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=504448 CPUtime=2.52 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 2158 0 0 0 252 0 0 0 22 0 8 0 642202035 516554752 27072 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=504448 CPUtime=2.39 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 3305 0 0 0 238 1 0 0 19 0 8 0 642202035 516554752 27072 33554432000 4194304 4964800 140735355616160 18446744073709551615 4653348 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=504448 CPUtime=2.4 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 3167 0 0 0 239 1 0 0 19 0 8 0 642202035 516554752 27072 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 19.84
Current children cumulated vsize (KiB) 504448

[startup+6.30082 s]
/proc/loadavg: 1.05 1.02 1.00 9/373 18378
/proc/meminfo: memFree=21829008/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=509916 CPUtime=45.4 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 41259 0 0 0 4522 18 0 0 25 0 8 0 642201984 522153984 35756 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/18370/statm: 127479 35756 464 189 0 121828 0
[pid=18370/tid=18372] ppid=18368 vsize=509916 CPUtime=5.6 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 2822 0 0 0 559 1 0 0 25 0 8 0 642202035 522153984 35756 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=509916 CPUtime=5.6 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 5340 0 0 0 558 2 0 0 25 0 8 0 642202035 522153984 35756 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=509916 CPUtime=5.58 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 4598 0 0 0 556 2 0 0 25 0 8 0 642202035 522153984 35756 33554432000 4194304 4964800 140735355616160 18446744073709551615 4683744 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=509916 CPUtime=5.6 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 3934 0 0 0 558 2 0 0 25 0 8 0 642202035 522153984 35756 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=509916 CPUtime=5.68 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 3191 0 0 0 567 1 0 0 25 0 8 0 642202035 522153984 35756 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=509916 CPUtime=5.6 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 4198 0 0 0 558 2 0 0 25 0 8 0 642202035 522153984 35756 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=509916 CPUtime=5.6 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 4902 0 0 0 557 3 0 0 25 0 8 0 642202035 522153984 35756 33554432000 4194304 4964800 140735355616160 18446744073709551615 4669936 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 45.4
Current children cumulated vsize (KiB) 509916

[startup+12.7006 s]
/proc/loadavg: 2.12 1.25 1.08 9/373 18378
/proc/meminfo: memFree=21795792/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=513888 CPUtime=96.51 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 48093 0 0 0 9628 23 0 0 25 0 8 0 642201984 526221312 42590 33554432000 4194304 4964800 140735355616160 18446744073709551615 4653186 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/18370/statm: 128472 42590 466 189 0 122821 0
[pid=18370/tid=18372] ppid=18368 vsize=513888 CPUtime=11.99 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 3234 0 0 0 1198 1 0 0 25 0 8 0 642202035 526221312 42590 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=513888 CPUtime=11.99 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 7084 0 0 0 1196 3 0 0 25 0 8 0 642202035 526221312 42590 33554432000 4194304 4964800 140735355616160 18446744073709551615 264726066209 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=513888 CPUtime=11.99 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 5235 0 0 0 1196 3 0 0 25 0 8 0 642202035 526221312 42590 33554432000 4194304 4964800 140735355616160 18446744073709551615 4320879 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=513888 CPUtime=12 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 4706 0 0 0 1198 2 0 0 25 0 8 0 642202035 526221312 42590 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=513888 CPUtime=12 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 4108 0 0 0 1198 2 0 0 25 0 8 0 642202035 526221312 42590 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=513888 CPUtime=11.99 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 4761 0 0 0 1197 2 0 0 25 0 8 0 642202035 526221312 42590 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668552 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=513888 CPUtime=11.99 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 6148 0 0 0 1196 3 0 0 25 0 8 0 642202035 526221312 42590 33554432000 4194304 4964800 140735355616160 18446744073709551615 4660449 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 96.51
Current children cumulated vsize (KiB) 513888

[startup+25.5012 s]
/proc/loadavg: 3.02 1.48 1.15 9/373 18379
/proc/meminfo: memFree=21745676/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=518844 CPUtime=198.75 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 60468 0 0 0 19842 33 0 0 25 0 8 0 642201984 531296256 54965 33554432000 4194304 4964800 140735355616160 18446744073709551615 4669164 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/18370/statm: 129711 54965 466 189 0 124060 0
[pid=18370/tid=18372] ppid=18368 vsize=518844 CPUtime=24.79 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 4162 0 0 0 2477 2 0 0 25 0 8 0 642202035 531296256 54965 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=518844 CPUtime=24.79 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 8861 0 0 0 2475 4 0 0 25 0 8 0 642202035 531296256 54965 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=518844 CPUtime=24.78 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 6199 0 0 0 2474 4 0 0 25 0 8 0 642202035 531296256 54965 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668814 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=518844 CPUtime=24.79 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 6468 0 0 0 2476 3 0 0 25 0 8 0 642202035 531296256 54965 33554432000 4194304 4964800 140735355616160 18446744073709551615 4684732 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=518844 CPUtime=24.65 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 6528 0 0 0 2461 4 0 0 25 0 8 0 642202035 531296256 54965 33554432000 4194304 4964800 140735355616160 18446744073709551615 4660495 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=518844 CPUtime=24.8 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 5938 0 0 0 2477 3 0 0 25 0 8 0 642202035 531296256 54965 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668797 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=518844 CPUtime=24.79 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 8633 0 0 0 2473 6 0 0 25 0 8 0 642202035 531296256 54965 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 198.75
Current children cumulated vsize (KiB) 518844

[startup+51.1004 s]
/proc/loadavg: 4.98 2.10 1.37 9/373 18379
/proc/meminfo: memFree=21646500/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=532308 CPUtime=403.24 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 85117 0 0 0 40269 55 0 0 25 0 8 0 642201984 545083392 79614 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/18370/statm: 133077 79614 466 189 0 127426 0
[pid=18370/tid=18372] ppid=18368 vsize=532308 CPUtime=50.39 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 6126 0 0 0 5035 4 0 0 25 0 8 0 642202035 545083392 79614 33554432000 4194304 4964800 140735355616160 18446744073709551615 4684107 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=532308 CPUtime=50.39 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 14860 0 0 0 5030 9 0 0 25 0 8 0 642202035 545083392 79614 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=532308 CPUtime=50.38 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 8971 0 0 0 5032 6 0 0 25 0 8 0 642202035 545083392 79614 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670220 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=532308 CPUtime=50.39 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 9017 0 0 0 5034 5 0 0 25 0 8 0 642202035 545083392 79614 33554432000 4194304 4964800 140735355616160 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=532308 CPUtime=49.94 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 8768 0 0 0 4988 6 0 0 25 0 8 0 642202035 545083392 79614 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670670 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=532308 CPUtime=50.39 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 8178 0 0 0 5034 5 0 0 25 0 8 0 642202035 545083392 79614 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670194 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=532308 CPUtime=50.39 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 13905 0 0 0 5029 10 0 0 25 0 8 0 642202035 545083392 79614 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 403.24

################
# More data... #
################

/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 36779 0 0 0 466032 49 0 0 25 0 8 0 642202035 2054037504 447215 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670313 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=2005896 CPUtime=4660.2 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 148205 0 0 0 465846 174 0 0 25 0 8 0 642202035 2054037504 447215 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37234.2
Current children cumulated vsize (KiB) 2005896

[startup+4722.31 s]
/proc/loadavg: 8.11 8.07 8.00 9/373 18519
/proc/meminfo: memFree=20168484/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=2005896 CPUtime=37713.6 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 455558 0 0 0 3770783 573 0 0 25 0 8 0 642201984 2054037504 447215 33554432000 4194304 4964800 140735355616160 18446744073709551615 4669350 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/18370/statm: 501474 447215 466 189 0 495823 0
[pid=18370/tid=18372] ppid=18368 vsize=2005896 CPUtime=4697.9 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 32464 0 0 0 469741 49 0 0 25 0 8 0 642202035 2054037504 447215 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=2005896 CPUtime=4721.49 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 76166 0 0 0 472068 81 0 0 25 0 8 0 642202035 2054037504 447215 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668777 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=2005896 CPUtime=4717.3 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 34172 0 0 0 471680 50 0 0 25 0 8 0 642202035 2054037504 447215 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=2005896 CPUtime=4720.85 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 43968 0 0 0 472030 55 0 0 25 0 8 0 642202035 2054037504 447215 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=2005896 CPUtime=4717.87 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 44717 0 0 0 471723 64 0 0 25 0 8 0 642202035 2054037504 447215 33554432000 4194304 4964800 140735355616160 18446744073709551615 4321082 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=2005896 CPUtime=4720.83 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 36779 0 0 0 472034 49 0 0 25 0 8 0 642202035 2054037504 447215 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=2005896 CPUtime=4720.2 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 148205 0 0 0 471845 175 0 0 25 0 8 0 642202035 2054037504 447215 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37713.6
Current children cumulated vsize (KiB) 2005896

[startup+4782.3 s]
/proc/loadavg: 8.11 8.07 8.00 9/373 18520
/proc/meminfo: memFree=20168316/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=2005896 CPUtime=38192.7 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 455568 0 0 0 3818699 573 0 0 25 0 8 0 642201984 2054037504 447225 33554432000 4194304 4964800 140735355616160 18446744073709551615 4684107 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/18370/statm: 501474 447225 466 189 0 495823 0
[pid=18370/tid=18372] ppid=18368 vsize=2005896 CPUtime=4757.18 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 32464 0 0 0 475669 49 0 0 25 0 8 0 642202035 2054037504 447225 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=2005896 CPUtime=4781.48 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 76166 0 0 0 478067 81 0 0 25 0 8 0 642202035 2054037504 447225 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=2005896 CPUtime=4777.29 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 34172 0 0 0 477679 50 0 0 25 0 8 0 642202035 2054037504 447225 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670321 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=2005896 CPUtime=4780.82 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 43970 0 0 0 478027 55 0 0 25 0 8 0 642202035 2054037504 447225 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=2005896 CPUtime=4777.86 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 44725 0 0 0 477722 64 0 0 25 0 8 0 642202035 2054037504 447225 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=2005896 CPUtime=4780.81 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 36779 0 0 0 478032 49 0 0 25 0 8 0 642202035 2054037504 447225 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=2005896 CPUtime=4780.17 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 148205 0 0 0 477842 175 0 0 25 0 8 0 642202035 2054037504 447225 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38192.7
Current children cumulated vsize (KiB) 2005896

[startup+4842.3 s]
/proc/loadavg: 8.04 8.05 8.00 9/373 18522
/proc/meminfo: memFree=20168276/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=2005896 CPUtime=38672 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 455572 0 0 0 3866627 573 0 0 25 0 8 0 642201984 2054037504 447229 33554432000 4194304 4964800 140735355616160 18446744073709551615 4362287 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/18370/statm: 501474 447229 466 189 0 495823 0
[pid=18370/tid=18372] ppid=18368 vsize=2005896 CPUtime=4816.47 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 32464 0 0 0 481598 49 0 0 25 0 8 0 642202035 2054037504 447229 33554432000 4194304 4964800 140735355616160 18446744073709551615 4684009 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=2005896 CPUtime=4841.49 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 76166 0 0 0 484068 81 0 0 25 0 8 0 642202035 2054037504 447229 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=2005896 CPUtime=4837.29 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 34176 0 0 0 483679 50 0 0 25 0 8 0 642202035 2054037504 447229 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=2005896 CPUtime=4840.82 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 43970 0 0 0 484027 55 0 0 25 0 8 0 642202035 2054037504 447229 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670313 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=2005896 CPUtime=4837.86 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 44725 0 0 0 483722 64 0 0 25 0 8 0 642202035 2054037504 447229 33554432000 4194304 4964800 140735355616160 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=2005896 CPUtime=4840.81 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 36779 0 0 0 484032 49 0 0 25 0 8 0 642202035 2054037504 447229 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=2005896 CPUtime=4840.17 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 148205 0 0 0 483842 175 0 0 25 0 8 0 642202035 2054037504 447229 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38672
Current children cumulated vsize (KiB) 2005896

[startup+4902.3 s]
/proc/loadavg: 8.07 8.06 8.00 9/373 18524
/proc/meminfo: memFree=20168112/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=2005896 CPUtime=39151.3 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 455598 0 0 0 3914552 575 0 0 25 0 8 0 642201984 2054037504 447255 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/18370/statm: 501474 447255 466 189 0 495823 0
[pid=18370/tid=18372] ppid=18368 vsize=2005896 CPUtime=4875.74 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 32464 0 0 0 487525 49 0 0 25 0 8 0 642202035 2054037504 447255 33554432000 4194304 4964800 140735355616160 18446744073709551615 4653265 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=2005896 CPUtime=4901.48 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 76166 0 0 0 490067 81 0 0 25 0 8 0 642202035 2054037504 447255 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=2005896 CPUtime=4897.29 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 34198 0 0 0 489679 50 0 0 25 0 8 0 642202035 2054037504 447255 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=2005896 CPUtime=4900.81 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 43970 0 0 0 490026 55 0 0 25 0 8 0 642202035 2054037504 447255 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=2005896 CPUtime=4897.86 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 44729 0 0 0 489722 64 0 0 25 0 8 0 642202035 2054037504 447255 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=2005896 CPUtime=4900.8 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 36779 0 0 0 490031 49 0 0 25 0 8 0 642202035 2054037504 447255 33554432000 4194304 4964800 140735355616160 18446744073709551615 4684107 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=2005896 CPUtime=4900.16 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 148205 0 0 0 489841 175 0 0 25 0 8 0 642202035 2054037504 447255 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39151.3
Current children cumulated vsize (KiB) 2005896

[startup+4962.3 s]
/proc/loadavg: 8.02 8.05 8.00 9/373 18525
/proc/meminfo: memFree=20168064/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=2005896 CPUtime=39630.5 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 455607 0 0 0 3962475 576 0 0 25 0 8 0 642201984 2054037504 447264 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/18370/statm: 501474 447264 466 189 0 495823 0
[pid=18370/tid=18372] ppid=18368 vsize=2005896 CPUtime=4935.02 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 32464 0 0 0 493453 49 0 0 25 0 8 0 642202035 2054037504 447264 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=2005896 CPUtime=4961.48 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 76166 0 0 0 496067 81 0 0 25 0 8 0 642202035 2054037504 447264 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=2005896 CPUtime=4957.28 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 34199 0 0 0 495678 50 0 0 25 0 8 0 642202035 2054037504 447264 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=2005896 CPUtime=4960.82 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 43975 0 0 0 496027 55 0 0 25 0 8 0 642202035 2054037504 447264 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=2005896 CPUtime=4957.84 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 44732 0 0 0 495720 64 0 0 25 0 8 0 642202035 2054037504 447264 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=2005896 CPUtime=4960.8 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 36779 0 0 0 496031 49 0 0 25 0 8 0 642202035 2054037504 447264 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=2005896 CPUtime=4960.13 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 148205 0 0 0 495838 175 0 0 25 0 8 0 642202035 2054037504 447264 33554432000 4194304 4964800 140735355616160 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39630.5
Current children cumulated vsize (KiB) 2005896



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5008.6 s]
/proc/loadavg: 8.07 8.05 8.00 9/373 18526
/proc/meminfo: memFree=20167896/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=2005896 CPUtime=40000.4 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 455663 0 0 0 3999466 577 0 0 25 0 8 0 642201984 2054037504 447320 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/18370/statm: 501474 447320 466 189 0 495823 0
[pid=18370/tid=18372] ppid=18368 vsize=2005896 CPUtime=4980.78 cores=0-7
/proc/18370/task/18372/stat : 18372 (claspmt) R 18368 18370 17872 0 -1 4202560 32464 0 0 0 498029 49 0 0 25 0 8 0 642202035 2054037504 447320 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=18370/tid=18373] ppid=18368 vsize=2005896 CPUtime=5007.8 cores=0-7
/proc/18370/task/18373/stat : 18373 (claspmt) R 18368 18370 17872 0 -1 4202560 76166 0 0 0 500699 81 0 0 25 0 8 0 642202035 2054037504 447320 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=18370/tid=18374] ppid=18368 vsize=2005896 CPUtime=5003.6 cores=0-7
/proc/18370/task/18374/stat : 18374 (claspmt) R 18368 18370 17872 0 -1 4202560 34200 0 0 0 500309 51 0 0 25 0 8 0 642202035 2054037504 447320 33554432000 4194304 4964800 140735355616160 18446744073709551615 4670190 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=18370/tid=18375] ppid=18368 vsize=2005896 CPUtime=5007.12 cores=0-7
/proc/18370/task/18375/stat : 18375 (claspmt) R 18368 18370 17872 0 -1 4202560 43975 0 0 0 500656 56 0 0 25 0 8 0 642202035 2054037504 447320 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668789 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=18370/tid=18376] ppid=18368 vsize=2005896 CPUtime=5004.16 cores=0-7
/proc/18370/task/18376/stat : 18376 (claspmt) R 18368 18370 17872 0 -1 4202560 44787 0 0 0 500352 64 0 0 25 0 8 0 642202035 2054037504 447320 33554432000 4194304 4964800 140735355616160 18446744073709551615 4660137 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=18370/tid=18377] ppid=18368 vsize=2005896 CPUtime=5007.11 cores=0-7
/proc/18370/task/18377/stat : 18377 (claspmt) R 18368 18370 17872 0 -1 4202560 36779 0 0 0 500662 49 0 0 25 0 8 0 642202035 2054037504 447320 33554432000 4194304 4964800 140735355616160 18446744073709551615 4378499 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=18370/tid=18378] ppid=18368 vsize=2005896 CPUtime=5006.44 cores=0-7
/proc/18370/task/18378/stat : 18378 (claspmt) R 18368 18370 17872 0 -1 4202560 148205 0 0 0 500469 175 0 0 25 0 8 0 642202035 2054037504 447320 33554432000 4194304 4964800 140735355616160 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 2005896

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009 s]
/proc/loadavg: 8.07 8.05 8.00 9/373 18526
/proc/meminfo: memFree=20167896/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=1974516 CPUtime=40000.9 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 455674 0 0 0 3999509 577 0 0 25 0 1 0 642201984 2021904384 438839 33554432000 4194304 4964800 140735355616160 18446744073709551615 264726061617 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/18370/statm: 493629 438839 476 189 0 487978 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 1974516

[startup+5009.1 s]
/proc/loadavg: 8.07 8.05 8.00 9/373 18526
/proc/meminfo: memFree=20167896/32951124 swapFree=63083172/67111528
[pid=18370] ppid=18368 vsize=549440 CPUtime=40001 cores=0-7
/proc/18370/stat : 18370 (claspmt) R 18368 18370 17872 0 -1 4202496 455674 0 0 0 3999510 586 0 0 25 0 1 0 642201984 562626560 33051 33554432000 4194304 4964800 140735355616160 18446744073709551615 264726448263 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/18370/statm: 137360 32937 476 189 0 131709 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 549440

Child status: 0
Real time (s): 5009.11
CPU time (s): 40001
CPU user time (s): 39995.1
CPU system time (s): 5.87111
CPU usage (%): 798.565
Max. virtual memory (cumulated for all children) (KiB): 2005896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39995.1
system time used= 5.87111
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 455675
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 89131
involuntary context switches= 141660

runsolver used 15.3937 second user time and 44.1343 second system time

The end

Launcher Data 

Begin job on node141 at 2011-05-16 00:17:44
IDJOB=3380971
IDBENCH=83133
IDSOLVER=1865
FILE ID=node141/3380971-1305497864
RUNJOBID= node141-1305487730-17886
PBS_JOBID= 13325396
Free space on /tmp= 73352 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom22.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380971-1305497864/watcher-3380971-1305497864 -o /tmp/evaluation-result-3380971-1305497864/solver-3380971-1305497864 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380971-1305497864.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 808b4b06b3dea960876e6772f0b9c207
RANDOM SEED=1363106526

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5362.96
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21960084 kB
Buffers:        279676 kB
Cached:        5387720 kB
SwapCached:      15728 kB
Active:        5347356 kB
Inactive:      5385632 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21960084 kB
SwapTotal:    67111528 kB
SwapFree:     63083172 kB
Dirty:            3912 kB
Writeback:           0 kB
AnonPages:     5057516 kB
Mapped:          13636 kB
Slab:           145820 kB
PageTables:      44732 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 89819696 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73348 MiB
End job on node141 at 2011-05-16 01:41:14