Trace number 3380945

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 40000.9 5009.62

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top23.cnf
MD5SUM6ee28191d649bfeef8c7d8c569a3cd59
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark640.829
Satisfiable
(Un)Satisfiability was proved
Number of variables60823
Number of clauses193450
Sum of the clauses size472824
Maximum clause length2414
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2117689
Number of clauses of size 374473
Number of clauses of size 4275
Number of clauses of size 521
Number of clauses of size over 5991

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...495791/instance-3380945-1305495791.cnf
0.79/0.86	c Solving...
40000.28/5009.11	
40000.28/5009.11	*** INTERRUPTED! ***
40000.28/5009.11	*** Shutting down threads...
40000.84/5009.61	s UNKNOWN
40000.84/5009.61	
40000.84/5009.61	c INTERRUPTED   : 1
40000.84/5009.61	c Models        : 0+    
40000.84/5009.61	c Time          : 5009.127s (Solving: 5008.27s 1st Model: 0.00s Unsat: 0.00s)
40000.84/5009.61	c CPU Time      : 40000.380s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3380945-1305495791/watcher-3380945-1305495791 -o /tmp/evaluation-result-3380945-1305495791/solver-3380945-1305495791 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380945-1305495791.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.59 5.03 2.85 1/348 10799
/proc/meminfo: memFree=19351312/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=28664 CPUtime=0 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 2158 0 0 0 0 0 0 0 23 0 1 0 661178798 29351936 2088 33554432000 4194304 4964800 140733826254016 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10799/statm: 7166 2096 376 189 0 2040 0

[startup+0.113283 s]
/proc/loadavg: 7.59 5.03 2.85 1/348 10799
/proc/meminfo: memFree=19351312/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=50768 CPUtime=0.1 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 9606 0 0 0 9 1 0 0 23 0 1 0 661178798 51986432 7724 33554432000 4194304 4964800 140733826254016 18446744073709551615 4607590 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10799/statm: 12692 7724 403 189 0 7566 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 50768

[startup+0.20034 s]
/proc/loadavg: 7.59 5.03 2.85 1/348 10799
/proc/meminfo: memFree=19351312/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=53812 CPUtime=0.19 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 10368 0 0 0 18 1 0 0 23 0 1 0 661178798 55103488 8486 33554432000 4194304 4964800 140733826254016 18446744073709551615 274473658497 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10799/statm: 13453 8486 404 189 0 8327 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 53812

[startup+0.300324 s]
/proc/loadavg: 7.59 5.03 2.85 1/348 10799
/proc/meminfo: memFree=19351312/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=56716 CPUtime=0.29 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 11126 0 0 0 28 1 0 0 23 0 1 0 661178798 58077184 9244 33554432000 4194304 4964800 140733826254016 18446744073709551615 4600312 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10799/statm: 14179 9244 404 189 0 9053 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 56716

[startup+0.700257 s]
/proc/loadavg: 7.59 5.03 2.85 1/348 10799
/proc/meminfo: memFree=19351312/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=59356 CPUtime=0.69 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 11780 0 0 0 68 1 0 0 25 0 1 0 661178798 60780544 9898 33554432000 4194304 4964800 140733826254016 18446744073709551615 4621605 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/10799/statm: 14839 9898 404 189 0 9713 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 59356

[startup+1.50104 s]
/proc/loadavg: 7.59 5.03 2.85 2/356 10807
/proc/meminfo: memFree=19273756/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=440556 CPUtime=3.12 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 27099 0 0 0 306 6 0 0 22 0 8 0 661178798 451129344 20894 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 110139 20894 464 189 0 104488 0
[pid=10799/tid=10801] ppid=10797 vsize=440556 CPUtime=0.24 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 1472 0 0 0 24 0 0 0 16 0 8 0 661178885 451129344 20894 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670194 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=440556 CPUtime=0.24 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 2680 0 0 0 24 0 0 0 16 0 8 0 661178885 451129344 20894 33554432000 4194304 4964800 140733826254016 18446744073709551615 4320942 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=440556 CPUtime=0.23 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 2443 0 0 0 23 0 0 0 16 0 8 0 661178885 451129344 20894 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=440556 CPUtime=0.23 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 1674 0 0 0 23 0 0 0 16 0 8 0 661178885 451129344 20894 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=440556 CPUtime=0.53 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 2331 0 0 0 53 0 0 0 18 0 8 0 661178885 451129344 20894 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670349 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=440556 CPUtime=0.24 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 2357 0 0 0 24 0 0 0 16 0 8 0 661178885 451129344 20894 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668797 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=440556 CPUtime=0.24 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 1979 0 0 0 24 0 0 0 16 0 8 0 661178885 451129344 20894 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670020 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.12
Current children cumulated vsize (KiB) 440556

[startup+3.10076 s]
/proc/loadavg: 7.59 5.03 2.85 10/356 10807
/proc/meminfo: memFree=19263216/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=440556 CPUtime=15.91 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 30795 0 0 0 1583 8 0 0 25 0 8 0 661178798 451129344 24590 33554432000 4194304 4964800 140733826254016 18446744073709551615 4362287 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 110139 24591 464 189 0 104488 0
[pid=10799/tid=10801] ppid=10797 vsize=440556 CPUtime=1.84 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 1834 0 0 0 184 0 0 0 17 0 8 0 661178885 451129344 24591 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=440556 CPUtime=1.85 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 3333 0 0 0 184 1 0 0 18 0 8 0 661178885 451129344 24591 33554432000 4194304 4964800 140733826254016 18446744073709551615 4320947 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=440556 CPUtime=1.84 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 3073 0 0 0 183 1 0 0 18 0 8 0 661178885 451129344 24591 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669011 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=440556 CPUtime=1.83 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 2224 0 0 0 183 0 0 0 17 0 8 0 661178885 451129344 24591 33554432000 4194304 4964800 140733826254016 18446744073709551615 4653207 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=440556 CPUtime=2.13 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 2341 0 0 0 213 0 0 0 21 0 8 0 661178885 451129344 24591 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=440556 CPUtime=1.84 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 2770 0 0 0 184 0 0 0 17 0 8 0 661178885 451129344 24591 33554432000 4194304 4964800 140733826254016 18446744073709551615 274473628705 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=440556 CPUtime=1.83 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 2649 0 0 0 183 0 0 0 18 0 8 0 661178885 451129344 24591 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 15.91
Current children cumulated vsize (KiB) 440556

[startup+6.3012 s]
/proc/loadavg: 7.70 5.09 2.88 9/356 10807
/proc/meminfo: memFree=19236680/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=444216 CPUtime=41.46 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 36531 0 0 0 4134 12 0 0 25 0 8 0 661178798 454877184 30326 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669538 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 111054 30326 464 189 0 105403 0
[pid=10799/tid=10801] ppid=10797 vsize=444216 CPUtime=5.04 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 2161 0 0 0 503 1 0 0 25 0 8 0 661178885 454877184 30326 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=444216 CPUtime=5.03 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 4534 0 0 0 502 1 0 0 25 0 8 0 661178885 454877184 30326 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=444216 CPUtime=5.03 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 4013 0 0 0 502 1 0 0 25 0 8 0 661178885 454877184 30326 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669017 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=444216 CPUtime=5.03 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 3001 0 0 0 502 1 0 0 25 0 8 0 661178885 454877184 30326 33554432000 4194304 4964800 140733826254016 18446744073709551615 4660280 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=444216 CPUtime=5.33 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 2414 0 0 0 533 0 0 0 25 0 8 0 661178885 454877184 30326 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=444216 CPUtime=5.04 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 3699 0 0 0 503 1 0 0 25 0 8 0 661178885 454877184 30326 33554432000 4194304 4964800 140733826254016 18446744073709551615 4361330 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=444216 CPUtime=5 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 3680 0 0 0 499 1 0 0 25 0 8 0 661178885 454877184 30326 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 41.46
Current children cumulated vsize (KiB) 444216

[startup+12.7011 s]
/proc/loadavg: 7.72 5.14 2.91 9/356 10807
/proc/meminfo: memFree=19203728/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=448220 CPUtime=92.58 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 44936 0 0 0 9240 18 0 0 25 0 8 0 661178798 458977280 38731 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669538 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 112055 38731 466 189 0 106404 0
[pid=10799/tid=10801] ppid=10797 vsize=448220 CPUtime=11.43 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 2759 0 0 0 1142 1 0 0 25 0 8 0 661178885 458977280 38731 33554432000 4194304 4964800 140733826254016 18446744073709551615 4320905 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=448220 CPUtime=11.44 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 5934 0 0 0 1142 2 0 0 25 0 8 0 661178885 458977280 38731 33554432000 4194304 4964800 140733826254016 18446744073709551615 4363438 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=448220 CPUtime=11.44 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 4777 0 0 0 1141 3 0 0 25 0 8 0 661178885 458977280 38731 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=448220 CPUtime=11.43 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 3775 0 0 0 1142 1 0 0 25 0 8 0 661178885 458977280 38731 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=448220 CPUtime=11.74 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 4297 0 0 0 1172 2 0 0 25 0 8 0 661178885 458977280 38731 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=448220 CPUtime=11.44 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 4478 0 0 0 1142 2 0 0 25 0 8 0 661178885 458977280 38731 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=448220 CPUtime=11.32 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 5178 0 0 0 1130 2 0 0 25 0 8 0 661178885 458977280 38731 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 92.58
Current children cumulated vsize (KiB) 448220

[startup+25.5008 s]
/proc/loadavg: 7.78 5.28 2.99 9/356 10807
/proc/meminfo: memFree=19177076/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=453320 CPUtime=194.82 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 52548 0 0 0 19458 24 0 0 25 0 8 0 661178798 464199680 46343 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670310 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 113330 46343 466 189 0 107679 0
[pid=10799/tid=10801] ppid=10797 vsize=453320 CPUtime=24.23 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 3332 0 0 0 2421 2 0 0 25 0 8 0 661178885 464199680 46343 33554432000 4194304 4964800 140733826254016 18446744073709551615 4678036 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=453320 CPUtime=24.23 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 7039 0 0 0 2421 2 0 0 25 0 8 0 661178885 464199680 46343 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668924 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=453320 CPUtime=24.23 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 5406 0 0 0 2420 3 0 0 25 0 8 0 661178885 464199680 46343 33554432000 4194304 4964800 140733826254016 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=453320 CPUtime=24.23 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 4260 0 0 0 2422 1 0 0 25 0 8 0 661178885 464199680 46343 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=453320 CPUtime=24.53 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 6308 0 0 0 2450 3 0 0 25 0 8 0 661178885 464199680 46343 33554432000 4194304 4964800 140733826254016 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=453320 CPUtime=24.23 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 5082 0 0 0 2421 2 0 0 25 0 8 0 661178885 464199680 46343 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=453320 CPUtime=23.97 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 6778 0 0 0 2393 4 0 0 25 0 8 0 661178885 464199680 46343 33554432000 4194304 4964800 140733826254016 18446744073709551615 274473628705 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 194.82
Current children cumulated vsize (KiB) 453320

[startup+51.1013 s]
/proc/loadavg: 7.86 5.50 3.12 9/356 10808
/proc/meminfo: memFree=19116744/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=461928 CPUtime=399.3 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 67604 0 0 0 39895 35 0 0 25 0 8 0 661178798 473014272 61395 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668709 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 115482 61395 466 189 0 109831 0
[pid=10799/tid=10801] ppid=10797 vsize=461928 CPUtime=49.82 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 4778 0 0 0 4979 3 0 0 25 0 8 0 661178885 473014272 61395 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=461928 CPUtime=49.83 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 9572 0 0 0 4980 3 0 0 25 0 8 0 661178885 473014272 61395 33554432000 4194304 4964800 140733826254016 18446744073709551615 4320905 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=461928 CPUtime=49.84 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 6285 0 0 0 4980 4 0 0 25 0 8 0 661178885 473014272 61395 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=461928 CPUtime=49.83 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 5943 0 0 0 4980 3 0 0 25 0 8 0 661178885 473014272 61395 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=461928 CPUtime=50.14 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 8276 0 0 0 5009 5 0 0 25 0 8 0 661178885 473014272 61395 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670203 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=461928 CPUtime=49.83 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 6495 0 0 0 4980 3 0 0 25 0 8 0 661178885 473014272 61395 33554432000 4194304 4964800 140733826254016 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=461928 CPUtime=49.28 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 10405 0 0 0 4921 7 0 0 25 0 8 0 661178885 473014272 61395 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669276 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 399.3

################
# More data... #
################

/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 27775 0 0 0 466034 27 0 0 25 0 8 0 661178885 1676181504 323683 33554432000 4194304 4964800 140733826254016 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=1636896 CPUtime=4645.54 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 97834 0 0 0 464421 133 0 0 25 0 8 0 661178885 1676181504 323683 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37230.9
Current children cumulated vsize (KiB) 1636896

[startup+4722.3 s]
/proc/loadavg: 8.02 8.03 8.00 9/356 10962
/proc/meminfo: memFree=18043896/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=1637532 CPUtime=37710.2 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 340494 0 0 0 3770610 415 0 0 25 0 8 0 661178798 1676832768 328190 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670507 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 409383 328190 466 189 0 403732 0
[pid=10799/tid=10801] ppid=10797 vsize=1637532 CPUtime=4714 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 25973 0 0 0 471374 26 0 0 25 0 8 0 661178885 1676832768 328190 33554432000 4194304 4964800 140733826254016 18446744073709551615 4370264 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=1637532 CPUtime=4698.89 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 42347 0 0 0 469844 45 0 0 25 0 8 0 661178885 1676832768 328190 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=1637532 CPUtime=4720.6 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 23228 0 0 0 472028 32 0 0 25 0 8 0 661178885 1676832768 328190 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=1637532 CPUtime=4707.86 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 40980 0 0 0 470731 55 0 0 25 0 8 0 661178885 1676832768 328190 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=1637532 CPUtime=4721.14 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 45252 0 0 0 472057 57 0 0 25 0 8 0 661178885 1676832768 328190 33554432000 4194304 4964800 140733826254016 18446744073709551615 4644876 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=1637532 CPUtime=4720.62 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 28496 0 0 0 472034 28 0 0 25 0 8 0 661178885 1676832768 328190 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=1637532 CPUtime=4705.55 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 98968 0 0 0 470420 135 0 0 25 0 8 0 661178885 1676832768 328190 33554432000 4194304 4964800 140733826254016 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 37710.2
Current children cumulated vsize (KiB) 1637532

[startup+4782.3 s]
/proc/loadavg: 8.06 8.04 8.00 9/356 10963
/proc/meminfo: memFree=18042996/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=1637532 CPUtime=38189.4 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 340702 0 0 0 3818529 415 0 0 25 0 8 0 661178798 1676832768 328398 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669509 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 409383 328398 466 189 0 403732 0
[pid=10799/tid=10801] ppid=10797 vsize=1637532 CPUtime=4773.99 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 25973 0 0 0 477373 26 0 0 25 0 8 0 661178885 1676832768 328398 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=1637532 CPUtime=4758.86 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 42366 0 0 0 475841 45 0 0 25 0 8 0 661178885 1676832768 328398 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=1637532 CPUtime=4780.59 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 23234 0 0 0 478027 32 0 0 25 0 8 0 661178885 1676832768 328398 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=1637532 CPUtime=4767.14 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 41057 0 0 0 476659 55 0 0 25 0 8 0 661178885 1676832768 328398 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=1637532 CPUtime=4781.13 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 45255 0 0 0 478056 57 0 0 25 0 8 0 661178885 1676832768 328398 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=1637532 CPUtime=4780.6 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 28497 0 0 0 478032 28 0 0 25 0 8 0 661178885 1676832768 328398 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=1637532 CPUtime=4765.51 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 99028 0 0 0 476416 135 0 0 25 0 8 0 661178885 1676832768 328398 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38189.4
Current children cumulated vsize (KiB) 1637532

[startup+4842.31 s]
/proc/loadavg: 8.02 8.03 8.00 9/356 10965
/proc/meminfo: memFree=18036248/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=1642584 CPUtime=38668.8 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 342356 0 0 0 3866458 419 0 0 25 0 8 0 661178798 1682006016 329858 33554432000 4194304 4964800 140733826254016 18446744073709551615 4684732 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 410646 329858 466 189 0 404995 0
[pid=10799/tid=10801] ppid=10797 vsize=1642584 CPUtime=4833.97 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 26182 0 0 0 483371 26 0 0 25 0 8 0 661178885 1682006016 329858 33554432000 4194304 4964800 140733826254016 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=1642584 CPUtime=4818.88 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 42485 0 0 0 481843 45 0 0 25 0 8 0 661178885 1682006016 329858 33554432000 4194304 4964800 140733826254016 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=1642584 CPUtime=4840.6 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 23310 0 0 0 484027 33 0 0 25 0 8 0 661178885 1682006016 329858 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668689 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=1642584 CPUtime=4826.43 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 41841 0 0 0 482586 57 0 0 25 0 8 0 661178885 1682006016 329858 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=1642584 CPUtime=4841.14 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 45544 0 0 0 484057 57 0 0 25 0 8 0 661178885 1682006016 329858 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=1642584 CPUtime=4840.61 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 28546 0 0 0 484033 28 0 0 25 0 8 0 661178885 1682006016 329858 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=1642584 CPUtime=4825.53 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 99035 0 0 0 482417 136 0 0 25 0 8 0 661178885 1682006016 329858 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 38668.8
Current children cumulated vsize (KiB) 1642584

[startup+4902.3 s]
/proc/loadavg: 8.24 8.10 8.02 9/356 10969
/proc/meminfo: memFree=18034480/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=1642584 CPUtime=39147.1 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 342472 0 0 0 3914292 421 0 0 25 0 8 0 661178798 1682006016 329959 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 410646 329959 466 189 0 404995 0
[pid=10799/tid=10801] ppid=10797 vsize=1642584 CPUtime=4893.96 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 26182 0 0 0 489370 26 0 0 25 0 8 0 661178885 1682006016 329959 33554432000 4194304 4964800 140733826254016 18446744073709551615 4320848 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=1642584 CPUtime=4878.86 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 42485 0 0 0 487841 45 0 0 25 0 8 0 661178885 1682006016 329959 33554432000 4194304 4964800 140733826254016 18446744073709551615 4668748 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=1642584 CPUtime=4899.87 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 23366 0 0 0 489952 35 0 0 25 0 8 0 661178885 1682006016 329959 33554432000 4194304 4964800 140733826254016 18446744073709551615 4321047 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=1642584 CPUtime=4885.72 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 41849 0 0 0 488515 57 0 0 25 0 8 0 661178885 1682006016 329959 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=1642584 CPUtime=4901.13 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 45547 0 0 0 490056 57 0 0 25 0 8 0 661178885 1682006016 329959 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=1642584 CPUtime=4900.52 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 28584 0 0 0 490024 28 0 0 25 0 8 0 661178885 1682006016 329959 33554432000 4194304 4964800 140733826254016 18446744073709551615 4653351 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=1642584 CPUtime=4885.48 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 99046 0 0 0 488412 136 0 0 25 0 8 0 661178885 1682006016 329959 33554432000 4194304 4964800 140733826254016 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39147.1
Current children cumulated vsize (KiB) 1642584

[startup+4962.3 s]
/proc/loadavg: 8.08 8.07 8.02 9/356 10971
/proc/meminfo: memFree=18028872/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=1643904 CPUtime=39626.4 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 344530 0 0 0 3962213 425 0 0 25 0 8 0 661178798 1683357696 332017 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 410976 332017 466 189 0 405325 0
[pid=10799/tid=10801] ppid=10797 vsize=1643904 CPUtime=4953.96 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 26293 0 0 0 495370 26 0 0 25 0 8 0 661178885 1683357696 332017 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669140 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=1643904 CPUtime=4938.85 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 42550 0 0 0 493839 46 0 0 25 0 8 0 661178885 1683357696 332017 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=1643904 CPUtime=4959.87 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 23821 0 0 0 495951 36 0 0 25 0 8 0 661178885 1683357696 332017 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=1643904 CPUtime=4945 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 42729 0 0 0 494442 58 0 0 25 0 8 0 661178885 1683357696 332017 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=1643904 CPUtime=4961.13 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 45701 0 0 0 496056 57 0 0 25 0 8 0 661178885 1683357696 332017 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=1643904 CPUtime=4960.52 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 28710 0 0 0 496023 29 0 0 25 0 8 0 661178885 1683357696 332017 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=1643904 CPUtime=4945.46 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 99236 0 0 0 494410 136 0 0 25 0 8 0 661178885 1683357696 332017 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 39626.4
Current children cumulated vsize (KiB) 1643904



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.1 s]
/proc/loadavg: 8.08 8.08 8.02 9/356 10972
/proc/meminfo: memFree=18027852/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=1643904 CPUtime=40000.3 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 344656 0 0 0 3999602 426 0 0 25 0 8 0 661178798 1683357696 332143 33554432000 4194304 4964800 140733826254016 18446744073709551615 4380234 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/10799/statm: 410976 332143 466 189 0 405325 0
[pid=10799/tid=10801] ppid=10797 vsize=1643904 CPUtime=5000.77 cores=0-7
/proc/10799/task/10801/stat : 10801 (claspmt) R 10797 10799 10428 0 -1 4202560 26293 0 0 0 500051 26 0 0 25 0 8 0 661178885 1683357696 332143 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=10799/tid=10802] ppid=10797 vsize=1643904 CPUtime=4985.67 cores=0-7
/proc/10799/task/10802/stat : 10802 (claspmt) R 10797 10799 10428 0 -1 4202560 42568 0 0 0 498521 46 0 0 25 0 8 0 661178885 1683357696 332143 33554432000 4194304 4964800 140733826254016 18446744073709551615 4320989 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=10799/tid=10803] ppid=10797 vsize=1643904 CPUtime=5006.68 cores=0-7
/proc/10799/task/10803/stat : 10803 (claspmt) R 10797 10799 10428 0 -1 4202560 23821 0 0 0 500632 36 0 0 25 0 8 0 661178885 1683357696 332143 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669338 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=10799/tid=10804] ppid=10797 vsize=1643904 CPUtime=4991.26 cores=0-7
/proc/10799/task/10804/stat : 10804 (claspmt) R 10797 10799 10428 0 -1 4202560 42731 0 0 0 499068 58 0 0 25 0 8 0 661178885 1683357696 332143 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669413 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=10799/tid=10805] ppid=10797 vsize=1643904 CPUtime=5007.94 cores=0-7
/proc/10799/task/10805/stat : 10805 (claspmt) R 10797 10799 10428 0 -1 4202560 45701 0 0 0 500737 57 0 0 25 0 8 0 661178885 1683357696 332143 33554432000 4194304 4964800 140733826254016 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=10799/tid=10806] ppid=10797 vsize=1643904 CPUtime=5007.33 cores=0-7
/proc/10799/task/10806/stat : 10806 (claspmt) R 10797 10799 10428 0 -1 4202560 28719 0 0 0 500704 29 0 0 25 0 8 0 661178885 1683357696 332143 33554432000 4194304 4964800 140733826254016 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=10799/tid=10807] ppid=10797 vsize=1643904 CPUtime=4992.27 cores=0-7
/proc/10799/task/10807/stat : 10807 (claspmt) R 10797 10799 10428 0 -1 4202560 99236 0 0 0 499091 136 0 0 25 0 8 0 661178885 1683357696 332143 33554432000 4194304 4964800 140733826254016 18446744073709551615 4653186 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 40000.3
Current children cumulated vsize (KiB) 1643904

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5009.51 s]
/proc/loadavg: 8.08 8.08 8.02 2/350 10973
/proc/meminfo: memFree=18054808/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=1608244 CPUtime=40000.8 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 344666 0 0 0 3999650 426 0 0 25 0 1 0 661178798 1646841856 323782 33554432000 4194304 4964800 140733826254016 18446744073709551615 274473624113 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/10799/statm: 402061 323782 476 189 0 396410 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 1608244

[startup+5009.6 s]
/proc/loadavg: 8.08 8.08 8.02 2/350 10973
/proc/meminfo: memFree=18054808/32950928 swapFree=67042944/67111528
[pid=10799] ppid=10797 vsize=506488 CPUtime=40000.8 cores=0-7
/proc/10799/stat : 10799 (claspmt) R 10797 10799 10428 0 -1 4202496 344666 0 0 0 3999653 431 0 0 25 0 1 0 661178798 518643712 81645 33554432000 4194304 4964800 140733826254016 18446744073709551615 274474010983 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/10799/statm: 126622 81645 476 189 0 120971 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 506488

Child status: 0
Real time (s): 5009.62
CPU time (s): 40000.9
CPU user time (s): 39996.5
CPU system time (s): 4.33934
CPU usage (%): 798.481
Max. virtual memory (cumulated for all children) (KiB): 1643904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39996.5
system time used= 4.33934
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 344667
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 85180
involuntary context switches= 189624

runsolver used 16.4815 second user time and 42.6705 second system time

The end

Launcher Data 

Begin job on node125 at 2011-05-15 23:43:11
IDJOB=3380945
IDBENCH=83114
IDSOLVER=1865
FILE ID=node125/3380945-1305495791
RUNJOBID= node125-1305487384-10442
PBS_JOBID= 13325390
Free space on /tmp= 73184 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top23.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3380945-1305495791/watcher-3380945-1305495791 -o /tmp/evaluation-result-3380945-1305495791/solver-3380945-1305495791 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3380945-1305495791.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6ee28191d649bfeef8c7d8c569a3cd59
RANDOM SEED=1839496232

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19351592 kB
Buffers:        184660 kB
Cached:        1905248 kB
SwapCached:      55108 kB
Active:        6093404 kB
Inactive:      7170460 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19351592 kB
SwapTotal:    67111528 kB
SwapFree:     67042944 kB
Dirty:            4324 kB
Writeback:           0 kB
AnonPages:    11119076 kB
Mapped:          34916 kB
Slab:           219664 kB
PageTables:      42952 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 79241532 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73184 MiB
End job on node125 at 2011-05-16 01:06:43