Trace number 3373575

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.19 1202.97

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
128/aes_128_3_keyfind_1.cnf
MD5SUMff59ad0e88befc51bfa041e45143dc53
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2808
Number of clauses30432
Sum of the clauses size167020
Maximum clause length8
Minimum clause length1
Number of clauses of size 1280
Number of clauses of size 2384
Number of clauses of size 35024
Number of clauses of size 4960
Number of clauses of size 56144
Number of clauses of size over 517640

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...427610/instance-3373575-1305427610.cnf
0.03/0.07	c Solving...
4800.10/1202.91	
4800.10/1202.91	*** INTERRUPTED! ***
4800.10/1202.91	*** Shutting down threads...
4800.10/1202.97	s UNKNOWN
4800.10/1202.97	
4800.10/1202.97	c INTERRUPTED   : 1
4800.10/1202.97	c Models        : 0+    
4800.10/1202.97	c Time          : 1202.915s (Solving: 1202.84s 1st Model: 0.00s Unsat: 0.00s)
4800.10/1202.97	c CPU Time      : 4800.120s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373575-1305427610/watcher-3373575-1305427610 -o /tmp/evaluation-result-3373575-1305427610/solver-3373575-1305427610 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373575-1305427610.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.75 7.95 8.21 5/298 13222
/proc/meminfo: memFree=12805456/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=22348 CPUtime=0 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 900 0 0 0 0 0 0 0 25 0 1 0 654360706 22884352 810 33554432000 4194304 4964800 140737141827952 18446744073709551615 4599599 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/13222/statm: 5587 810 388 189 0 461 0

[startup+0.040509 s]
/proc/loadavg: 7.75 7.95 8.21 5/298 13222
/proc/meminfo: memFree=12805456/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=24704 CPUtime=0.03 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 1571 0 0 0 3 0 0 0 25 0 1 0 654360706 25296896 1365 33554432000 4194304 4964800 140737141827952 18446744073709551615 4607486 0 0 4096 18946 0 0 0 17 3 0 0 0
/proc/13222/statm: 6176 1365 402 189 0 1050 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 24704

[startup+0.107209 s]
/proc/loadavg: 7.75 7.95 8.21 5/298 13222
/proc/meminfo: memFree=12805456/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=238748 CPUtime=0.16 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 3612 0 0 0 16 0 0 0 25 0 4 0 654360706 244477952 3292 33554432000 4194304 4964800 140737141827952 18446744073709551615 4370377 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 59687 3292 458 189 0 54036 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 238748

[startup+0.300464 s]
/proc/loadavg: 7.75 7.95 8.21 5/298 13222
/proc/meminfo: memFree=12805456/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=239392 CPUtime=0.93 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 4666 0 0 0 93 0 0 0 25 0 4 0 654360706 245137408 4346 33554432000 4194304 4964800 140737141827952 18446744073709551615 4364587 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 59848 4346 458 189 0 54197 0
Current children cumulated CPU time (s) 0.93
Current children cumulated vsize (KiB) 239392

[startup+0.700389 s]
/proc/loadavg: 7.75 7.95 8.21 5/298 13222
/proc/meminfo: memFree=12805456/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=240496 CPUtime=2.54 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 5653 0 0 0 253 1 0 0 25 0 4 0 654360706 246267904 5333 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 60124 5333 458 189 0 54473 0
Current children cumulated CPU time (s) 2.54
Current children cumulated vsize (KiB) 240496

[startup+1.50024 s]
/proc/loadavg: 7.75 7.95 8.21 9/302 13226
/proc/meminfo: memFree=12782120/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=242100 CPUtime=5.73 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 7416 0 0 0 571 2 0 0 25 0 4 0 654360706 247910400 7096 33554432000 4194304 4964800 140737141827952 18446744073709551615 4370224 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 60525 7096 458 189 0 54874 0
[pid=13222/tid=13224] ppid=13220 vsize=242100 CPUtime=1.4 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 810 0 0 0 140 0 0 0 25 0 4 0 654360714 247910400 7096 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=242100 CPUtime=1.41 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 2275 0 0 0 141 0 0 0 25 0 4 0 654360714 247910400 7096 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=242100 CPUtime=1.41 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 1662 0 0 0 141 0 0 0 20 0 4 0 654360714 247910400 7096 33554432000 4194304 4964800 140737141827952 18446744073709551615 4627275 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.73
Current children cumulated vsize (KiB) 242100

[startup+3.10093 s]
/proc/loadavg: 7.75 7.95 8.21 9/302 13226
/proc/meminfo: memFree=12774200/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=245256 CPUtime=12.13 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 10215 0 0 0 1210 3 0 0 25 0 4 0 654360706 251142144 9895 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670323 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 61314 9895 460 189 0 55663 0
[pid=13222/tid=13224] ppid=13220 vsize=245256 CPUtime=2.99 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 1407 0 0 0 299 0 0 0 25 0 4 0 654360714 251142144 9895 33554432000 4194304 4964800 140737141827952 18446744073709551615 4644876 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=245256 CPUtime=3.01 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 3174 0 0 0 300 1 0 0 25 0 4 0 654360714 251142144 9895 33554432000 4194304 4964800 140737141827952 18446744073709551615 4320934 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=245256 CPUtime=3.01 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 2475 0 0 0 301 0 0 0 25 0 4 0 654360714 251142144 9895 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.13
Current children cumulated vsize (KiB) 245256

[startup+6.30032 s]
/proc/loadavg: 7.77 7.95 8.20 9/302 13226
/proc/meminfo: memFree=12757676/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=248980 CPUtime=24.89 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 13267 0 0 0 2484 5 0 0 25 0 4 0 654360706 254955520 12826 33554432000 4194304 4964800 140737141827952 18446744073709551615 4626894 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 62245 12826 460 189 0 56594 0
[pid=13222/tid=13224] ppid=13220 vsize=248980 CPUtime=6.16 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 1721 0 0 0 616 0 0 0 25 0 4 0 654360714 254955520 12826 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=248980 CPUtime=6.21 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 4339 0 0 0 620 1 0 0 25 0 4 0 654360714 254955520 12826 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=248980 CPUtime=6.21 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 3380 0 0 0 620 1 0 0 25 0 4 0 654360714 254955520 12826 33554432000 4194304 4964800 140737141827952 18446744073709551615 208079893189 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.89
Current children cumulated vsize (KiB) 248980

[startup+12.7011 s]
/proc/loadavg: 7.87 7.96 8.21 9/302 13226
/proc/meminfo: memFree=12739468/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=255768 CPUtime=50.43 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 18261 0 0 0 5035 8 0 0 25 0 4 0 654360706 261906432 17639 33554432000 4194304 4964800 140737141827952 18446744073709551615 4362080 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 63942 17639 460 189 0 58291 0
[pid=13222/tid=13224] ppid=13220 vsize=255768 CPUtime=12.5 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 2444 0 0 0 1249 1 0 0 25 0 4 0 654360714 261906432 17639 33554432000 4194304 4964800 140737141827952 18446744073709551615 4644896 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=255768 CPUtime=12.61 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 5775 0 0 0 1259 2 0 0 25 0 4 0 654360714 261906432 17639 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=255768 CPUtime=12.6 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 5257 0 0 0 1258 2 0 0 25 0 4 0 654360714 261906432 17639 33554432000 4194304 4964800 140737141827952 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.43
Current children cumulated vsize (KiB) 255768

[startup+25.5007 s]
/proc/loadavg: 7.97 7.98 8.21 9/302 13226
/proc/meminfo: memFree=12719140/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=256584 CPUtime=101.5 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 22059 0 0 0 10139 11 0 0 25 0 4 0 654360706 262742016 21411 33554432000 4194304 4964800 140737141827952 18446744073709551615 4675467 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 64146 21411 460 189 0 58495 0
[pid=13222/tid=13224] ppid=13220 vsize=256584 CPUtime=25.17 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 2961 0 0 0 2516 1 0 0 25 0 4 0 654360714 262742016 21411 33554432000 4194304 4964800 140737141827952 18446744073709551615 4334248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=256584 CPUtime=25.4 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 6017 0 0 0 2538 2 0 0 25 0 4 0 654360714 262742016 21411 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=256584 CPUtime=25.4 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 7553 0 0 0 2536 4 0 0 25 0 4 0 654360714 262742016 21411 33554432000 4194304 4964800 140737141827952 18446744073709551615 4325342 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.5
Current children cumulated vsize (KiB) 256584

[startup+51.1008 s]
/proc/loadavg: 7.98 7.98 8.20 9/302 13227
/proc/meminfo: memFree=12677664/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=271456 CPUtime=203.67 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 32239 0 0 0 20348 19 0 0 25 0 4 0 654360706 277970944 31542 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670332 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 67864 31542 460 189 0 62213 0
[pid=13222/tid=13224] ppid=13220 vsize=271456 CPUtime=50.54 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 4928 0 0 0 5051 3 0 0 25 0 4 0 654360714 277970944 31542 33554432000 4194304 4964800 140737141827952 18446744073709551615 4669272 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=271456 CPUtime=51 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 8095 0 0 0 5097 3 0 0 25 0 4 0 654360714 277970944 31542 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=271456 CPUtime=51 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 11346 0 0 0 5093 7 0 0 25 0 4 0 654360714 277970944 31542 33554432000 4194304 4964800 140737141827952 18446744073709551615 4668709 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.67
Current children cumulated vsize (KiB) 271456

[startup+102.311 s]
/proc/loadavg: 7.99 7.98 8.19 9/302 13229
/proc/meminfo: memFree=12635372/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=281872 CPUtime=408.01 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 42574 0 0 0 40773 28 0 0 25 0 4 0 654360706 288636928 41729 33554432000 4194304 4964800 140737141827952 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 70468 41729 460 189 0 64817 0
[pid=13222/tid=13224] ppid=13220 vsize=281872 CPUtime=101.66 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 7635 0 0 0 10160 6 0 0 25 0 4 0 654360714 288636928 41729 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670371 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=281872 CPUtime=102.21 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 9473 0 0 0 10217 4 0 0 25 0 4 0 654360714 288636928 41729 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=281872 CPUtime=101.82 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 13393 0 0 0 10172 10 0 0 25 0 4 0 654360714 288636928 41729 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.01
Current children cumulated vsize (KiB) 281872

[startup+162.301 s]
/proc/loadavg: 8.03 8.00 8.18 9/302 13230
/proc/meminfo: memFree=12610044/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=285252 CPUtime=647.4 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 48073 0 0 0 64706 34 0 0 25 0 4 0 654360706 292098048 47154 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 71313 47154 460 189 0 65662 0
[pid=13222/tid=13224] ppid=13220 vsize=285252 CPUtime=161.63 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 8974 0 0 0 16154 9 0 0 25 0 4 0 654360714 292098048 47154 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=285252 CPUtime=162.19 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 9542 0 0 0 16215 4 0 0 25 0 4 0 654360714 292098048 47154 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=285252 CPUtime=161.27 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 14245 0 0 0 16117 10 0 0 25 0 4 0 654360714 292098048 47154 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 647.4
Current children cumulated vsize (KiB) 285252

[startup+222.301 s]
/proc/loadavg: 8.01 8.00 8.17 9/302 13232
/proc/meminfo: memFree=12595904/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=289992 CPUtime=886.84 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 50627 0 0 0 88646 38 0 0 25 0 4 0 654360706 296951808 49634 33554432000 4194304 4964800 140737141827952 18446744073709551615 4668715 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 72498 49634 460 189 0 66847 0
[pid=13222/tid=13224] ppid=13220 vsize=289992 CPUtime=221.61 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 9856 0 0 0 22151 10 0 0 25 0 4 0 654360714 296951808 49634 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=289992 CPUtime=222.19 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 9553 0 0 0 22215 4 0 0 25 0 4 0 654360714 296951808 49634 33554432000 4194304 4964800 140737141827952 18446744073709551615 4627168 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=289992 CPUtime=220.72 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 14876 0 0 0 22061 11 0 0 25 0 4 0 654360714 296951808 49634 33554432000 4194304 4964800 140737141827952 18446744073709551615 4320942 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 886.84
Current children cumulated vsize (KiB) 289992

[startup+282.301 s]

################
# More data... #
################

[pid=13222] ppid=13220 vsize=520232 CPUtime=2802.38 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 80849 0 0 0 280161 77 0 0 25 0 4 0 654360706 532717568 79264 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 130058 79264 460 189 0 124407 0
[pid=13222/tid=13224] ppid=13220 vsize=520232 CPUtime=698.33 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 13089 0 0 0 69819 14 0 0 25 0 4 0 654360714 532717568 79264 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=520232 CPUtime=702.17 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 13613 0 0 0 70208 9 0 0 25 0 4 0 654360714 532717568 79264 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=520232 CPUtime=699.56 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 25275 0 0 0 69934 22 0 0 25 0 4 0 654360714 532717568 79264 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2802.38
Current children cumulated vsize (KiB) 520232

[startup+762.311 s]
/proc/loadavg: 8.12 8.08 8.12 9/302 13277
/proc/meminfo: memFree=12587532/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=520380 CPUtime=3041.87 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 82492 0 0 0 304106 81 0 0 25 0 4 0 654360706 532869120 80785 33554432000 4194304 4964800 140737141827952 18446744073709551615 4321020 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 130095 80785 460 189 0 124444 0
[pid=13222/tid=13224] ppid=13220 vsize=520380 CPUtime=757.79 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 13240 0 0 0 75764 15 0 0 25 0 4 0 654360714 532869120 80785 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=520380 CPUtime=762.18 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 13615 0 0 0 76209 9 0 0 25 0 4 0 654360714 532869120 80785 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=520380 CPUtime=759.57 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 25277 0 0 0 75935 22 0 0 25 0 4 0 654360714 532869120 80785 33554432000 4194304 4964800 140737141827952 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3041.87
Current children cumulated vsize (KiB) 520380

[startup+822.301 s]
/proc/loadavg: 8.15 8.10 8.12 9/302 13279
/proc/meminfo: memFree=12575736/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=520380 CPUtime=3281.27 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 85215 0 0 0 328042 85 0 0 25 0 4 0 654360706 532869120 83362 33554432000 4194304 4964800 140737141827952 18446744073709551615 4321038 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 130095 83362 460 189 0 124444 0
[pid=13222/tid=13224] ppid=13220 vsize=520380 CPUtime=817.22 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 13540 0 0 0 81707 15 0 0 25 0 4 0 654360714 532869120 83362 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=520380 CPUtime=822.17 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 13732 0 0 0 82208 9 0 0 25 0 4 0 654360714 532869120 83362 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=520380 CPUtime=819.56 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 27052 0 0 0 81931 25 0 0 25 0 4 0 654360714 532869120 83362 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3281.27
Current children cumulated vsize (KiB) 520380

[startup+882.3 s]
/proc/loadavg: 8.10 8.09 8.11 9/302 13289
/proc/meminfo: memFree=12565128/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=520380 CPUtime=3520.68 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 87767 0 0 0 351978 90 0 0 25 0 4 0 654360706 532869120 85500 33554432000 4194304 4964800 140737141827952 18446744073709551615 4659391 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 130095 85500 460 189 0 124444 0
[pid=13222/tid=13224] ppid=13220 vsize=520380 CPUtime=876.67 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 13629 0 0 0 87651 16 0 0 25 0 4 0 654360714 532869120 85500 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=520380 CPUtime=882.17 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 13845 0 0 0 88207 10 0 0 25 0 4 0 654360714 532869120 85500 33554432000 4194304 4964800 140737141827952 18446744073709551615 4668814 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=520380 CPUtime=879.56 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 29279 0 0 0 87927 29 0 0 25 0 4 0 654360714 532869120 85500 33554432000 4194304 4964800 140737141827952 18446744073709551615 4320966 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3520.68
Current children cumulated vsize (KiB) 520380

[startup+942.301 s]
/proc/loadavg: 8.08 8.08 8.11 9/302 13291
/proc/meminfo: memFree=12558776/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=520380 CPUtime=3760.14 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 89164 0 0 0 375921 93 0 0 25 0 4 0 654360706 532869120 86895 33554432000 4194304 4964800 140737141827952 18446744073709551615 4342144 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 130095 86895 460 189 0 124444 0
[pid=13222/tid=13224] ppid=13220 vsize=520380 CPUtime=936.13 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 13788 0 0 0 93597 16 0 0 25 0 4 0 654360714 532869120 86895 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=520380 CPUtime=942.17 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 13858 0 0 0 94207 10 0 0 25 0 4 0 654360714 532869120 86895 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=520380 CPUtime=939.56 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 29283 0 0 0 93927 29 0 0 25 0 4 0 654360714 532869120 86895 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3760.14
Current children cumulated vsize (KiB) 520380

[startup+1002.3 s]
/proc/loadavg: 6.79 7.70 7.97 9/302 13323
/proc/meminfo: memFree=12322752/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=532264 CPUtime=3999.58 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 94407 0 0 0 399859 99 0 0 25 0 4 0 654360706 545038336 91990 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 133066 91990 460 189 0 127415 0
[pid=13222/tid=13224] ppid=13220 vsize=532264 CPUtime=995.57 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 17183 0 0 0 99537 20 0 0 25 0 4 0 654360714 545038336 91990 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=532264 CPUtime=1002.15 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 14479 0 0 0 100205 10 0 0 25 0 4 0 654360714 545038336 91990 33554432000 4194304 4964800 140737141827952 18446744073709551615 4684107 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=532264 CPUtime=999.56 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 29754 0 0 0 99926 30 0 0 25 0 4 0 654360714 545038336 91990 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3999.58
Current children cumulated vsize (KiB) 532264

[startup+1062.3 s]
/proc/loadavg: 6.40 7.48 7.88 6/299 13384
/proc/meminfo: memFree=12183532/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=534192 CPUtime=4238.98 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 98973 0 0 0 423792 106 0 0 25 0 4 0 654360706 547012608 96408 33554432000 4194304 4964800 140737141827952 18446744073709551615 4332431 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 133548 96408 460 189 0 127897 0
[pid=13222/tid=13224] ppid=13220 vsize=534192 CPUtime=1054.98 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 17485 0 0 0 105478 20 0 0 25 0 4 0 654360714 547012608 96408 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670349 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=534192 CPUtime=1062.16 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 14951 0 0 0 106205 11 0 0 25 0 4 0 654360714 547012608 96408 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=534192 CPUtime=1059.55 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 30803 0 0 0 105924 31 0 0 25 0 4 0 654360714 547012608 96408 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4238.98
Current children cumulated vsize (KiB) 534192

[startup+1122.3 s]
/proc/loadavg: 5.55 7.04 7.70 6/299 13386
/proc/meminfo: memFree=12183088/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=534192 CPUtime=4478.42 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 99124 0 0 0 447734 108 0 0 25 0 4 0 654360706 547012608 96401 33554432000 4194304 4964800 140737141827952 18446744073709551615 4320981 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 133548 96401 460 189 0 127897 0
[pid=13222/tid=13224] ppid=13220 vsize=534192 CPUtime=1114.42 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 17629 0 0 0 111421 21 0 0 25 0 4 0 654360714 547012608 96401 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=534192 CPUtime=1122.15 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 14951 0 0 0 112204 11 0 0 25 0 4 0 654360714 547012608 96401 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670264 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=534192 CPUtime=1119.56 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 30804 0 0 0 111924 32 0 0 25 0 4 0 654360714 547012608 96401 33554432000 4194304 4964800 140737141827952 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4478.42
Current children cumulated vsize (KiB) 534192

[startup+1182.3 s]
/proc/loadavg: 5.90 6.83 7.58 10/302 13390
/proc/meminfo: memFree=11707272/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=534192 CPUtime=4717.87 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 99126 0 0 0 471678 109 0 0 25 0 4 0 654360706 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 133548 95720 460 189 0 127897 0
[pid=13222/tid=13224] ppid=13220 vsize=534192 CPUtime=1173.88 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 17629 0 0 0 117366 22 0 0 25 0 4 0 654360714 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=534192 CPUtime=1182.15 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 14951 0 0 0 118204 11 0 0 25 0 4 0 654360714 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670273 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=534192 CPUtime=1179.56 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 30804 0 0 0 117924 32 0 0 25 0 4 0 654360714 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4717.87
Current children cumulated vsize (KiB) 534192



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.9 s]
/proc/loadavg: 6.63 6.93 7.60 9/302 13391
/proc/meminfo: memFree=11650856/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=534192 CPUtime=4800.1 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 99126 0 0 0 479901 109 0 0 25 0 4 0 654360706 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 133548 95720 460 189 0 127897 0
[pid=13222/tid=13224] ppid=13220 vsize=534192 CPUtime=1194.29 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 17629 0 0 0 119407 22 0 0 25 0 4 0 654360714 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4321057 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=534192 CPUtime=1202.76 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 14951 0 0 0 120265 11 0 0 25 0 4 0 654360714 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=534192 CPUtime=1200.17 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 30804 0 0 0 119985 32 0 0 25 0 4 0 654360714 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 534192

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.9 s]
/proc/loadavg: 6.63 6.93 7.60 9/302 13391
/proc/meminfo: memFree=11650856/32950928 swapFree=67083212/67111528
[pid=13222] ppid=13220 vsize=534192 CPUtime=4800.1 cores=1,3,5,7
/proc/13222/stat : 13222 (claspmt) R 13220 13222 4446 0 -1 4202496 99126 0 0 0 479901 109 0 0 25 0 4 0 654360706 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 3 0 0 0
/proc/13222/statm: 133548 95720 460 189 0 127897 0
[pid=13222/tid=13224] ppid=13220 vsize=534192 CPUtime=1194.29 cores=1,3,5,7
/proc/13222/task/13224/stat : 13224 (claspmt) R 13220 13222 4446 0 -1 4202560 17629 0 0 0 119407 22 0 0 25 0 4 0 654360714 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4321057 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=13222/tid=13225] ppid=13220 vsize=534192 CPUtime=1202.76 cores=1,3,5,7
/proc/13222/task/13225/stat : 13225 (claspmt) R 13220 13222 4446 0 -1 4202560 14951 0 0 0 120265 11 0 0 25 0 4 0 654360714 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670340 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=13222/tid=13226] ppid=13220 vsize=534192 CPUtime=1200.17 cores=1,3,5,7
/proc/13222/task/13226/stat : 13226 (claspmt) R 13220 13222 4446 0 -1 4202560 30804 0 0 0 119985 32 0 0 25 0 4 0 654360714 547012608 95720 33554432000 4194304 4964800 140737141827952 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 534192

Child status: 0
Real time (s): 1202.97
CPU time (s): 4800.19
CPU user time (s): 4799.07
CPU system time (s): 1.11683
CPU usage (%): 399.028
Max. virtual memory (cumulated for all children) (KiB): 534192

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.07
system time used= 1.11683
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 99138
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 23551
involuntary context switches= 32370

runsolver used 3.13952 second user time and 7.81381 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-15 04:46:50
IDJOB=3373575
IDBENCH=83408
IDSOLVER=1853
FILE ID=node127/3373575-1305427610
RUNJOBID= node127-1305427085-13156
PBS_JOBID= 13324590
Free space on /tmp= 73512 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/128/aes_128_3_keyfind_1.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373575-1305427610/watcher-3373575-1305427610 -o /tmp/evaluation-result-3373575-1305427610/solver-3373575-1305427610 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373575-1305427610.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ff59ad0e88befc51bfa041e45143dc53
RANDOM SEED=980021050

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12805736 kB
Buffers:        298592 kB
Cached:        3556904 kB
SwapCached:       1620 kB
Active:       16973820 kB
Inactive:      2841256 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12805736 kB
SwapTotal:    67111528 kB
SwapFree:     67083212 kB
Dirty:            1580 kB
Writeback:           0 kB
AnonPages:    15958244 kB
Mapped:          26956 kB
Slab:           222104 kB
PageTables:      47012 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 44479632 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73412 MiB
End job on node127 at 2011-05-15 05:06:55