Trace number 3299955

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.21 1202.04

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
128/aes_128_10_keyfind_1.cnf
MD5SUMf35f3aee72237c1bf3d673feb4883756
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables8080
Number of clauses96704
Sum of the clauses size539496
Maximum clause length8
Minimum clause length1
Number of clauses of size 1336
Number of clauses of size 21152
Number of clauses of size 315040
Number of clauses of size 42944
Number of clauses of size 518432
Number of clauses of size over 558800

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...095520/instance-3299955-1304095520.cnf
0.19/0.23	c Solving...
4800.04/1201.91	
4800.04/1201.91	*** INTERRUPTED! ***
4800.04/1201.91	*** Shutting down threads...
4800.17/1202.03	s UNKNOWN
4800.17/1202.03	
4800.17/1202.03	c INTERRUPTED   : 1
4800.17/1202.03	c Models        : 0+    
4800.17/1202.03	c Time          : 1201.917s (Solving: 1201.69s 1st Model: 0.00s Unsat: 0.00s)
4800.17/1202.03	c CPU Time      : 4800.080s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299955-1304095520/watcher-3299955-1304095520 -o /tmp/evaluation-result-3299955-1304095520/solver-3299955-1304095520 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299955-1304095520.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.06 8.02 7.23 1/175 3036
/proc/meminfo: memFree=20745712/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=22424 CPUtime=0 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 877 0 0 0 0 0 0 0 19 0 1 0 599782682 22962176 771 33554432000 4194304 4964704 140733723672720 18446744073709551615 4679071 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/3036/statm: 5606 775 376 189 0 480 0

[startup+0.0633741 s]
/proc/loadavg: 8.06 8.02 7.23 1/175 3036
/proc/meminfo: memFree=20745712/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=30940 CPUtime=0.05 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 3564 0 0 0 5 0 0 0 19 0 1 0 599782682 31682560 2879 33554432000 4194304 4964704 140733723672720 18446744073709551615 231895151301 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/3036/statm: 7735 2880 398 189 0 2609 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 30940

[startup+0.10037 s]
/proc/loadavg: 8.06 8.02 7.23 1/175 3036
/proc/meminfo: memFree=20745712/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=33048 CPUtime=0.09 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 4036 0 0 0 9 0 0 0 19 0 1 0 599782682 33841152 3351 33554432000 4194304 4964704 140733723672720 18446744073709551615 4607771 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/3036/statm: 8262 3351 402 189 0 3136 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 33048

[startup+0.300359 s]
/proc/loadavg: 8.06 8.02 7.23 1/175 3036
/proc/meminfo: memFree=20745712/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=251356 CPUtime=0.44 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 9263 0 0 0 43 1 0 0 18 0 4 0 599782682 257388544 8255 33554432000 4194304 4964704 140733723672720 18446744073709551615 4371527 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 62839 8256 458 189 0 57188 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 251356

[startup+0.700194 s]
/proc/loadavg: 8.06 8.02 7.23 1/175 3036
/proc/meminfo: memFree=20745712/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=252080 CPUtime=2.05 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 10929 0 0 0 203 2 0 0 18 0 4 0 599782682 258129920 9921 33554432000 4194304 4964704 140733723672720 18446744073709551615 4321010 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 63020 9921 458 189 0 57369 0
Current children cumulated CPU time (s) 2.05
Current children cumulated vsize (KiB) 252080

[startup+1.50104 s]
/proc/loadavg: 8.06 8.02 7.23 9/184 3071
/proc/meminfo: memFree=20695528/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=253160 CPUtime=5.25 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 13038 0 0 0 522 3 0 0 19 0 4 0 599782682 259235840 12030 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670454 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 63290 12030 458 189 0 57639 0
[pid=3036/tid=3061] ppid=3034 vsize=253160 CPUtime=1.25 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 1569 0 0 0 125 0 0 0 19 0 4 0 599782706 259235840 12030 33554432000 4194304 4964704 140733723672720 18446744073709551615 4370288 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=253160 CPUtime=1.24 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 3465 0 0 0 124 0 0 0 19 0 4 0 599782706 259235840 12030 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=253160 CPUtime=1.25 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 2574 0 0 0 125 0 0 0 19 0 4 0 599782706 259235840 12030 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.25
Current children cumulated vsize (KiB) 253160

[startup+3.10074 s]
/proc/loadavg: 8.06 8.02 7.23 9/184 3071
/proc/meminfo: memFree=20682632/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=254360 CPUtime=11.63 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 14704 0 0 0 1159 4 0 0 24 0 4 0 599782682 260464640 13696 33554432000 4194304 4964704 140733723672720 18446744073709551615 4668629 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 63590 13696 460 189 0 57939 0
[pid=3036/tid=3061] ppid=3034 vsize=254360 CPUtime=2.85 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 1682 0 0 0 285 0 0 0 24 0 4 0 599782706 260464640 13696 33554432000 4194304 4964704 140733723672720 18446744073709551615 4370266 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=254360 CPUtime=2.84 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 4253 0 0 0 283 1 0 0 24 0 4 0 599782706 260464640 13696 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=254360 CPUtime=2.85 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 3139 0 0 0 284 1 0 0 23 0 4 0 599782706 260464640 13696 33554432000 4194304 4964704 140733723672720 18446744073709551615 4660223 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.63
Current children cumulated vsize (KiB) 254360

[startup+6.30115 s]
/proc/loadavg: 8.06 8.02 7.24 9/184 3071
/proc/meminfo: memFree=20660376/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=257744 CPUtime=24.42 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 17523 0 0 0 2436 6 0 0 25 0 4 0 599782682 263929856 16515 33554432000 4194304 4964704 140733723672720 18446744073709551615 4627272 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 64436 16515 460 189 0 58785 0
[pid=3036/tid=3061] ppid=3034 vsize=257744 CPUtime=6.05 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 1892 0 0 0 605 0 0 0 25 0 4 0 599782706 263929856 16515 33554432000 4194304 4964704 140733723672720 18446744073709551615 4338784 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=257744 CPUtime=6.02 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 5467 0 0 0 600 2 0 0 25 0 4 0 599782706 263929856 16515 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670366 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=257744 CPUtime=6.05 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 4242 0 0 0 604 1 0 0 25 0 4 0 599782706 263929856 16515 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.42
Current children cumulated vsize (KiB) 257744

[startup+12.7009 s]
/proc/loadavg: 8.05 8.02 7.24 9/184 3071
/proc/meminfo: memFree=20628044/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=268024 CPUtime=49.98 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 23875 0 0 0 4988 10 0 0 25 0 4 0 599782682 274456576 22867 33554432000 4194304 4964704 140733723672720 18446744073709551615 231895151649 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 67006 22867 460 189 0 61355 0
[pid=3036/tid=3061] ppid=3034 vsize=268024 CPUtime=12.45 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 2375 0 0 0 1244 1 0 0 25 0 4 0 599782706 274456576 22867 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=268024 CPUtime=12.38 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 7563 0 0 0 1235 3 0 0 25 0 4 0 599782706 274456576 22867 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670080 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=268024 CPUtime=12.44 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 7252 0 0 0 1241 3 0 0 25 0 4 0 599782706 274456576 22867 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 49.98
Current children cumulated vsize (KiB) 268024

[startup+25.5005 s]
/proc/loadavg: 8.04 8.01 7.25 9/184 3072
/proc/meminfo: memFree=20598932/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=269632 CPUtime=101.1 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 28555 0 0 0 10095 15 0 0 25 0 4 0 599782682 276103168 27546 33554432000 4194304 4964704 140733723672720 18446744073709551615 4684659 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 67408 27546 460 189 0 61757 0
[pid=3036/tid=3061] ppid=3034 vsize=269632 CPUtime=25.25 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 3415 0 0 0 2523 2 0 0 25 0 4 0 599782706 276103168 27546 33554432000 4194304 4964704 140733723672720 18446744073709551615 4627293 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=269632 CPUtime=25.11 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 9416 0 0 0 2506 5 0 0 25 0 4 0 599782706 276103168 27546 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=269632 CPUtime=25.25 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 8401 0 0 0 2520 5 0 0 25 0 4 0 599782706 276103168 27546 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.1
Current children cumulated vsize (KiB) 269632

[startup+51.1008 s]
/proc/loadavg: 8.03 8.01 7.27 9/184 3072
/proc/meminfo: memFree=20538780/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=277876 CPUtime=203.35 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 40572 0 0 0 20310 25 0 0 25 0 4 0 599782682 284545024 39114 33554432000 4194304 4964704 140733723672720 18446744073709551615 4321099 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 69469 39114 460 189 0 63818 0
[pid=3036/tid=3061] ppid=3034 vsize=277876 CPUtime=50.83 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 4923 0 0 0 5080 3 0 0 25 0 4 0 599782706 284545024 39114 33554432000 4194304 4964704 140733723672720 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=277876 CPUtime=50.57 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 13172 0 0 0 5050 7 0 0 25 0 4 0 599782706 284545024 39114 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=277876 CPUtime=50.84 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 11541 0 0 0 5077 7 0 0 25 0 4 0 599782706 284545024 39114 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.35
Current children cumulated vsize (KiB) 277876

[startup+102.306 s]
/proc/loadavg: 8.01 8.01 7.31 9/184 3074
/proc/meminfo: memFree=20460272/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=298408 CPUtime=407.88 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 56087 0 0 0 40749 39 0 0 25 0 4 0 599782682 305569792 54575 33554432000 4194304 4964704 140733723672720 18446744073709551615 4654417 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 74602 54575 460 189 0 68951 0
[pid=3036/tid=3061] ppid=3034 vsize=298408 CPUtime=102.04 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 7347 0 0 0 10198 6 0 0 25 0 4 0 599782706 305569792 54575 33554432000 4194304 4964704 140733723672720 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=298408 CPUtime=101.49 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 14394 0 0 0 10140 9 0 0 25 0 4 0 599782706 305569792 54575 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=298408 CPUtime=102.05 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 14824 0 0 0 10195 10 0 0 25 0 4 0 599782706 305569792 54575 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.88
Current children cumulated vsize (KiB) 298408

[startup+162.301 s]
/proc/loadavg: 8.06 8.02 7.35 9/184 3075
/proc/meminfo: memFree=20419444/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=308836 CPUtime=647.51 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 63788 0 0 0 64705 46 0 0 25 0 4 0 599782682 316248064 62175 33554432000 4194304 4964704 140733723672720 18446744073709551615 4669218 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 77209 62175 460 189 0 71558 0
[pid=3036/tid=3061] ppid=3034 vsize=308836 CPUtime=162.01 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 8047 0 0 0 16195 6 0 0 25 0 4 0 599782706 316248064 62175 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=308836 CPUtime=161.16 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 14563 0 0 0 16107 9 0 0 25 0 4 0 599782706 316248064 62175 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=308836 CPUtime=162.04 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 19034 0 0 0 16190 14 0 0 25 0 4 0 599782706 316248064 62175 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 647.51
Current children cumulated vsize (KiB) 308836

[startup+222.301 s]
/proc/loadavg: 8.07 8.03 7.39 9/184 3077
/proc/meminfo: memFree=20360388/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=517620 CPUtime=887.16 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 76527 0 0 0 88656 60 0 0 25 0 4 0 599782682 530042880 74914 33554432000 4194304 4964704 140733723672720 18446744073709551615 231895151649 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 129405 74914 460 189 0 123754 0
[pid=3036/tid=3061] ppid=3034 vsize=517620 CPUtime=221.99 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 9853 0 0 0 22191 8 0 0 25 0 4 0 599782706 530042880 74914 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670176 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=517620 CPUtime=220.83 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 15757 0 0 0 22074 9 0 0 25 0 4 0 599782706 530042880 74914 33554432000 4194304 4964704 140733723672720 18446744073709551615 4321116 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=517620 CPUtime=222.05 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 21529 0 0 0 22188 17 0 0 25 0 4 0 599782706 530042880 74914 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 887.16
Current children cumulated vsize (KiB) 517620

[startup+282.3 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2564.82
Current children cumulated vsize (KiB) 570584

[startup+702.301 s]
/proc/loadavg: 8.12 8.05 7.65 9/184 3091
/proc/meminfo: memFree=20154760/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=570584 CPUtime=2804.46 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 120989 0 0 0 280338 108 0 0 25 0 4 0 599782682 584278016 118501 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 142646 118501 460 189 0 136995 0
[pid=3036/tid=3061] ppid=3034 vsize=570584 CPUtime=701.89 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 12809 0 0 0 70180 9 0 0 22 0 4 0 599782706 584278016 118501 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670269 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=570584 CPUtime=698.21 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 21703 0 0 0 69806 15 0 0 25 0 4 0 599782706 584278016 118501 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=570584 CPUtime=702.05 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 33385 0 0 0 70171 34 0 0 25 0 4 0 599782706 584278016 118501 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2804.46
Current children cumulated vsize (KiB) 570584

[startup+762.307 s]
/proc/loadavg: 8.16 8.07 7.68 9/184 3092
/proc/meminfo: memFree=20149636/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=570584 CPUtime=3044.16 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 122006 0 0 0 304306 110 0 0 25 0 4 0 599782682 584278016 119515 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320958 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 142646 119515 460 189 0 136995 0
[pid=3036/tid=3061] ppid=3034 vsize=570584 CPUtime=761.9 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 12855 0 0 0 76181 9 0 0 25 0 4 0 599782706 584278016 119515 33554432000 4194304 4964704 140733723672720 18446744073709551615 4627792 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=570584 CPUtime=757.88 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 22137 0 0 0 75772 16 0 0 25 0 4 0 599782706 584278016 119515 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=570584 CPUtime=762.07 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 33579 0 0 0 76172 35 0 0 25 0 4 0 599782706 584278016 119515 33554432000 4194304 4964704 140733723672720 18446744073709551615 4379076 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3044.16
Current children cumulated vsize (KiB) 570584

[startup+822.3 s]
/proc/loadavg: 8.10 8.07 7.70 9/184 3094
/proc/meminfo: memFree=20139188/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=570584 CPUtime=3283.78 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 123466 0 0 0 328266 112 0 0 25 0 4 0 599782682 584278016 120780 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670271 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 142646 120780 460 189 0 136995 0
[pid=3036/tid=3061] ppid=3034 vsize=570584 CPUtime=821.87 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 13083 0 0 0 82178 9 0 0 25 0 4 0 599782706 584278016 120780 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=570584 CPUtime=817.55 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 22221 0 0 0 81739 16 0 0 25 0 4 0 599782706 584278016 120780 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=570584 CPUtime=822.06 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 33582 0 0 0 82171 35 0 0 25 0 4 0 599782706 584278016 120780 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3283.78
Current children cumulated vsize (KiB) 570584

[startup+882.301 s]
/proc/loadavg: 8.07 8.07 7.72 9/184 3095
/proc/meminfo: memFree=20116460/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=583092 CPUtime=3523.45 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 128717 0 0 0 352229 116 0 0 25 0 4 0 599782682 597086208 125836 33554432000 4194304 4964704 140733723672720 18446744073709551615 4362287 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 145773 125836 460 189 0 140122 0
[pid=3036/tid=3061] ppid=3034 vsize=583092 CPUtime=881.85 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 13286 0 0 0 88176 9 0 0 25 0 4 0 599782706 597086208 125836 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670458 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=583092 CPUtime=877.22 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 24827 0 0 0 87705 17 0 0 25 0 4 0 599782706 597086208 125836 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=583092 CPUtime=882.06 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 35870 0 0 0 88169 37 0 0 25 0 4 0 599782706 597086208 125836 33554432000 4194304 4964704 140733723672720 18446744073709551615 4342157 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3523.45
Current children cumulated vsize (KiB) 583092

[startup+942.301 s]
/proc/loadavg: 8.06 8.07 7.74 9/184 3107
/proc/meminfo: memFree=20110588/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=584360 CPUtime=3763.1 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 129630 0 0 0 376194 116 0 0 25 0 4 0 599782682 598384640 126554 33554432000 4194304 4964704 140733723672720 18446744073709551615 4659143 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 146090 126554 460 189 0 140439 0
[pid=3036/tid=3061] ppid=3034 vsize=584360 CPUtime=941.86 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 13516 0 0 0 94176 10 0 0 25 0 4 0 599782706 598384640 126554 33554432000 4194304 4964704 140733723672720 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=584360 CPUtime=936.9 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 25031 0 0 0 93673 17 0 0 25 0 4 0 599782706 598384640 126554 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=584360 CPUtime=942.04 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 36090 0 0 0 94167 37 0 0 25 0 4 0 599782706 598384640 126554 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3763.1
Current children cumulated vsize (KiB) 584360

[startup+1002.3 s]
/proc/loadavg: 8.05 8.07 7.76 9/184 3109
/proc/meminfo: memFree=20079656/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=649896 CPUtime=4002.76 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 136459 0 0 0 400151 125 0 0 25 0 4 0 599782682 665493504 133188 33554432000 4194304 4964704 140733723672720 18446744073709551615 4653264 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 162474 133188 460 189 0 156823 0
[pid=3036/tid=3061] ppid=3034 vsize=649896 CPUtime=1001.84 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 20194 0 0 0 100166 18 0 0 25 0 4 0 599782706 665493504 133188 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=649896 CPUtime=996.57 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 25033 0 0 0 99640 17 0 0 25 0 4 0 599782706 665493504 133188 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=649896 CPUtime=1002.04 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 36162 0 0 0 100167 37 0 0 25 0 4 0 599782706 665493504 133188 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4002.76
Current children cumulated vsize (KiB) 649896

[startup+1062.3 s]
/proc/loadavg: 8.02 8.05 7.77 9/184 3112
/proc/meminfo: memFree=20064740/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=716340 CPUtime=4242.42 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 139645 0 0 0 424111 131 0 0 25 0 4 0 599782682 733532160 136374 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 179085 136374 460 189 0 173434 0
[pid=3036/tid=3061] ppid=3034 vsize=716340 CPUtime=1061.82 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 20508 0 0 0 106164 18 0 0 25 0 4 0 599782706 733532160 136374 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=716340 CPUtime=1056.24 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 25073 0 0 0 105607 17 0 0 25 0 4 0 599782706 733532160 136374 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=716340 CPUtime=1062.04 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 36329 0 0 0 106167 37 0 0 25 0 4 0 599782706 733532160 136374 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4242.42
Current children cumulated vsize (KiB) 716340

[startup+1122.3 s]
/proc/loadavg: 8.17 8.09 7.80 9/184 3114
/proc/meminfo: memFree=20053792/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=716340 CPUtime=4482.07 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 141633 0 0 0 448073 134 0 0 25 0 4 0 599782682 733532160 138147 33554432000 4194304 4964704 140733723672720 18446744073709551615 4658326 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 179085 138147 460 189 0 173434 0
[pid=3036/tid=3061] ppid=3034 vsize=716340 CPUtime=1121.81 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 21349 0 0 0 112161 20 0 0 25 0 4 0 599782706 733532160 138147 33554432000 4194304 4964704 140733723672720 18446744073709551615 4334332 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=716340 CPUtime=1115.91 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 25951 0 0 0 111573 18 0 0 25 0 4 0 599782706 733532160 138147 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670323 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=716340 CPUtime=1122.04 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 36507 0 0 0 112167 37 0 0 25 0 4 0 599782706 733532160 138147 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4482.07
Current children cumulated vsize (KiB) 716340

[startup+1182.3 s]
/proc/loadavg: 8.18 8.10 7.82 9/184 3115
/proc/meminfo: memFree=20034044/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=727436 CPUtime=4721.74 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 146387 0 0 0 472035 139 0 0 25 0 4 0 599782682 744894464 142706 33554432000 4194304 4964704 140733723672720 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 181859 142706 460 189 0 176208 0
[pid=3036/tid=3061] ppid=3034 vsize=727436 CPUtime=1181.8 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 21634 0 0 0 118160 20 0 0 25 0 4 0 599782706 744894464 142706 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670181 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=727436 CPUtime=1175.59 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 26861 0 0 0 117539 20 0 0 25 0 4 0 599782706 744894464 142706 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=727436 CPUtime=1182.05 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 36560 0 0 0 118167 38 0 0 25 0 4 0 599782706 744894464 142706 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4721.74
Current children cumulated vsize (KiB) 727436



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.13 8.09 7.82 9/184 3117
/proc/meminfo: memFree=20033040/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=727436 CPUtime=4800.04 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 146670 0 0 0 479865 139 0 0 25 0 4 0 599782682 744894464 142985 33554432000 4194304 4964704 140733723672720 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/3036/statm: 181859 142985 460 189 0 176208 0
[pid=3036/tid=3061] ppid=3034 vsize=727436 CPUtime=1201.4 cores=1,3,5,7
/proc/3036/task/3061/stat : 3061 (claspmt) R 3034 3036 2922 0 -1 4202560 21634 0 0 0 120120 20 0 0 25 0 4 0 599782706 744894464 142985 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=3036/tid=3062] ppid=3034 vsize=727436 CPUtime=1195.08 cores=1,3,5,7
/proc/3036/task/3062/stat : 3062 (claspmt) R 3034 3036 2922 0 -1 4202560 27136 0 0 0 119488 20 0 0 25 0 4 0 599782706 744894464 142985 33554432000 4194304 4964704 140733723672720 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=3036/tid=3063] ppid=3034 vsize=727436 CPUtime=1201.66 cores=1,3,5,7
/proc/3036/task/3063/stat : 3063 (claspmt) R 3034 3036 2922 0 -1 4202560 36568 0 0 0 120128 38 0 0 25 0 4 0 599782706 744894464 142985 33554432000 4194304 4964704 140733723672720 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.04
Current children cumulated vsize (KiB) 727436

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.01 s]
/proc/loadavg: 8.13 8.09 7.82 9/184 3117
/proc/meminfo: memFree=20033040/32950928 swapFree=67111524/67111528
[pid=3036] ppid=3034 vsize=656024 CPUtime=4800.17 cores=1,3,5,7
/proc/3036/stat : 3036 (claspmt) R 3034 3036 2922 0 -1 4202496 146681 0 0 0 479878 139 0 0 25 0 1 0 599782682 671768576 138455 33554432000 4194304 4964704 140733723672720 18446744073709551615 231895145595 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/3036/statm: 164006 138455 471 189 0 158355 0
Current children cumulated CPU time (s) 4800.17
Current children cumulated vsize (KiB) 656024

Child status: 0
Real time (s): 1202.04
CPU time (s): 4800.21
CPU user time (s): 4798.79
CPU system time (s): 1.42478
CPU usage (%): 399.339
Max. virtual memory (cumulated for all children) (KiB): 727436

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.79
system time used= 1.42478
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 146682
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7827
involuntary context switches= 34916

runsolver used 2.03069 second user time and 4.53131 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-29 18:45:20
IDJOB=3299955
IDBENCH=83413
IDSOLVER=1683
FILE ID=node114/3299955-1304095520
RUNJOBID= node114-1304094316-2944
PBS_JOBID= 13170591
Free space on /tmp= 71800 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/128/aes_128_10_keyfind_1.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299955-1304095520/watcher-3299955-1304095520 -o /tmp/evaluation-result-3299955-1304095520/solver-3299955-1304095520 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299955-1304095520.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f35f3aee72237c1bf3d673feb4883756
RANDOM SEED=937954382

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20745868 kB
Buffers:       2224496 kB
Cached:        9334944 kB
SwapCached:          4 kB
Active:        2841760 kB
Inactive:      8784016 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20745868 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            3940 kB
Writeback:           0 kB
AnonPages:       66284 kB
Mapped:          15076 kB
Slab:           515788 kB
PageTables:       4284 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   216576 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71800 MiB
End job on node114 at 2011-04-29 19:05:24