Trace number 3322494

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 40000.7 5007.4

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf
MD5SUMb61e426b264831836f140414cdcf3e23
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables238
Number of clauses15812
Sum of the clauses size70446
Maximum clause length16
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 314042
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51770

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...386820/instance-3322494-1304386820.cnf
0.00/0.05	c Solving...
40000.57/5007.31	
40000.57/5007.31	*** INTERRUPTED! ***
40000.57/5007.31	*** Shutting down threads...
40000.57/5007.39	s UNKNOWN
40000.57/5007.39	
40000.57/5007.39	c INTERRUPTED   : 1
40000.57/5007.39	c Models        : 0+    
40000.57/5007.39	c Time          : 5007.315s (Solving: 5007.26s 1st Model: 0.00s Unsat: 0.00s)
40000.57/5007.39	c CPU Time      : 40000.610s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322494-1304386820/watcher-3322494-1304386820 -o /tmp/evaluation-result-3322494-1304386820/solver-3322494-1304386820 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322494-1304386820.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.38 7.89 7.96 2/310 26826
/proc/meminfo: memFree=21100072/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=22472 CPUtime=0 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 911 0 0 0 0 0 0 0 25 0 1 0 550280766 23011328 839 33554432000 4194304 4964704 140735302517232 18446744073709551615 4608680 0 0 4096 18946 0 0 0 17 6 0 0 0
/proc/26826/statm: 5618 839 399 189 0 492 0

[startup+0.065124 s]
/proc/loadavg: 7.38 7.89 7.96 2/310 26826
/proc/meminfo: memFree=21100072/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=250940 CPUtime=0.08 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 1249 0 0 0 8 0 0 0 18 0 8 0 550280766 256962560 1135 33554432000 4194304 4964704 140735302517232 18446744073709551615 4653356 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 62735 1136 454 189 0 57084 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 250940

[startup+0.124728 s]
/proc/loadavg: 7.38 7.89 7.96 2/310 26826
/proc/meminfo: memFree=21100072/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=251600 CPUtime=0.53 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 2006 0 0 0 53 0 0 0 18 0 8 0 550280766 257638400 1892 33554432000 4194304 4964704 140735302517232 18446744073709551615 4668645 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 62900 1892 464 189 0 57249 0
Current children cumulated CPU time (s) 0.53
Current children cumulated vsize (KiB) 251600

[startup+0.300085 s]
/proc/loadavg: 7.38 7.89 7.96 2/310 26826
/proc/meminfo: memFree=21100072/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=318512 CPUtime=1.94 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 3551 0 0 0 193 1 0 0 18 0 8 0 550280766 326156288 3437 33554432000 4194304 4964704 140735302517232 18446744073709551615 4631252 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 79628 3437 464 189 0 73977 0
Current children cumulated CPU time (s) 1.94
Current children cumulated vsize (KiB) 318512

[startup+0.701013 s]
/proc/loadavg: 7.38 7.89 7.96 2/310 26826
/proc/meminfo: memFree=21100072/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=319060 CPUtime=5.15 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 4396 0 0 0 514 1 0 0 18 0 8 0 550280766 326717440 4282 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670263 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 79765 4282 464 189 0 74114 0
Current children cumulated CPU time (s) 5.15
Current children cumulated vsize (KiB) 319060

[startup+1.50087 s]
/proc/loadavg: 7.43 7.89 7.96 9/318 26834
/proc/meminfo: memFree=21083276/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=319456 CPUtime=11.54 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 5571 0 0 0 1152 2 0 0 20 0 8 0 550280766 327122944 5457 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670431 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 79864 5457 464 189 0 74213 0
[pid=26826/tid=26828] ppid=26824 vsize=319456 CPUtime=1.43 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 629 0 0 0 143 0 0 0 20 0 8 0 550280772 327122944 5457 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=319456 CPUtime=1.43 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 734 0 0 0 143 0 0 0 25 0 8 0 550280772 327122944 5457 33554432000 4194304 4964704 140735302517232 18446744073709551615 4627248 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=319456 CPUtime=1.43 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 486 0 0 0 143 0 0 0 20 0 8 0 550280772 327122944 5457 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=319456 CPUtime=1.43 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 521 0 0 0 143 0 0 0 25 0 8 0 550280772 327122944 5457 33554432000 4194304 4964704 140735302517232 18446744073709551615 4320993 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=319456 CPUtime=1.43 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 479 0 0 0 143 0 0 0 25 0 8 0 550280772 327122944 5457 33554432000 4194304 4964704 140735302517232 18446744073709551615 4364587 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=319456 CPUtime=1.43 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 542 0 0 0 143 0 0 0 20 0 8 0 550280772 327122944 5457 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=319456 CPUtime=1.41 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 695 0 0 0 141 0 0 0 25 0 8 0 550280772 327122944 5457 33554432000 4194304 4964704 140735302517232 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.54
Current children cumulated vsize (KiB) 319456

[startup+3.10059 s]
/proc/loadavg: 7.43 7.89 7.96 9/318 26834
/proc/meminfo: memFree=21077472/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=321924 CPUtime=24.31 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 7982 0 0 0 2428 3 0 0 25 0 8 0 550280766 329650176 7814 33554432000 4194304 4964704 140735302517232 18446744073709551615 4628055 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 80481 7814 466 189 0 74830 0
[pid=26826/tid=26828] ppid=26824 vsize=321924 CPUtime=3.03 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 904 0 0 0 303 0 0 0 25 0 8 0 550280772 329650176 7814 33554432000 4194304 4964704 140735302517232 18446744073709551615 4668673 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=321924 CPUtime=3.02 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 1205 0 0 0 302 0 0 0 25 0 8 0 550280772 329650176 7814 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=321924 CPUtime=3.03 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 776 0 0 0 303 0 0 0 25 0 8 0 550280772 329650176 7814 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=321924 CPUtime=3.03 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 758 0 0 0 303 0 0 0 25 0 8 0 550280772 329650176 7814 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670250 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=321924 CPUtime=3.03 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 711 0 0 0 303 0 0 0 25 0 8 0 550280772 329650176 7814 33554432000 4194304 4964704 140735302517232 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=321924 CPUtime=3.03 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 816 0 0 0 303 0 0 0 25 0 8 0 550280772 329650176 7814 33554432000 4194304 4964704 140735302517232 18446744073709551615 4627878 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=321924 CPUtime=2.99 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 1121 0 0 0 299 0 0 0 25 0 8 0 550280772 329650176 7814 33554432000 4194304 4964704 140735302517232 18446744073709551615 4320981 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.31
Current children cumulated vsize (KiB) 321924

[startup+6.30102 s]
/proc/loadavg: 7.43 7.89 7.96 10/318 26834
/proc/meminfo: memFree=21063220/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=324412 CPUtime=49.88 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 10919 0 0 0 4983 5 0 0 25 0 8 0 550280766 332197888 10670 33554432000 4194304 4964704 140735302517232 18446744073709551615 4627170 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 81103 10670 466 189 0 75452 0
[pid=26826/tid=26828] ppid=26824 vsize=324412 CPUtime=6.23 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 1201 0 0 0 623 0 0 0 25 0 8 0 550280772 332197888 10671 33554432000 4194304 4964704 140735302517232 18446744073709551615 4346000 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=324412 CPUtime=6.22 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 2087 0 0 0 621 1 0 0 25 0 8 0 550280772 332197888 10671 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670419 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=324412 CPUtime=6.23 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 1037 0 0 0 623 0 0 0 19 0 8 0 550280772 332197888 10671 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=324412 CPUtime=6.23 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 1099 0 0 0 623 0 0 0 25 0 8 0 550280772 332197888 10671 33554432000 4194304 4964704 140735302517232 18446744073709551615 268272350241 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=324412 CPUtime=6.23 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 974 0 0 0 623 0 0 0 25 0 8 0 550280772 332197888 10671 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=324412 CPUtime=6.23 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 1081 0 0 0 623 0 0 0 25 0 8 0 550280772 332197888 10671 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=324412 CPUtime=6.17 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 1539 0 0 0 616 1 0 0 25 0 8 0 550280772 332197888 10671 33554432000 4194304 4964704 140735302517232 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.88
Current children cumulated vsize (KiB) 324412

[startup+12.7009 s]
/proc/loadavg: 7.66 7.93 7.97 9/318 26835
/proc/meminfo: memFree=21051712/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=326532 CPUtime=100.99 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 14025 0 0 0 10092 7 0 0 25 0 8 0 550280766 334368768 13776 33554432000 4194304 4964704 140735302517232 18446744073709551615 4332144 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 81633 13776 466 189 0 75982 0
[pid=26826/tid=26828] ppid=26824 vsize=326532 CPUtime=12.63 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 1653 0 0 0 1263 0 0 0 25 0 8 0 550280772 334368768 13776 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=326532 CPUtime=12.62 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 2834 0 0 0 1261 1 0 0 25 0 8 0 550280772 334368768 13776 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670241 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=326532 CPUtime=12.62 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 1278 0 0 0 1262 0 0 0 25 0 8 0 550280772 334368768 13776 33554432000 4194304 4964704 140735302517232 18446744073709551615 4627197 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=326532 CPUtime=12.62 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 1497 0 0 0 1262 0 0 0 25 0 8 0 550280772 334368768 13776 33554432000 4194304 4964704 140735302517232 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=326532 CPUtime=12.63 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 1227 0 0 0 1263 0 0 0 25 0 8 0 550280772 334368768 13776 33554432000 4194304 4964704 140735302517232 18446744073709551615 4668673 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=326532 CPUtime=12.63 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 1392 0 0 0 1262 1 0 0 25 0 8 0 550280772 334368768 13776 33554432000 4194304 4964704 140735302517232 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=326532 CPUtime=12.49 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 1958 0 0 0 1248 1 0 0 25 0 8 0 550280772 334368768 13776 33554432000 4194304 4964704 140735302517232 18446744073709551615 4668645 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.99
Current children cumulated vsize (KiB) 326532

[startup+25.5006 s]
/proc/loadavg: 7.71 7.93 7.97 9/318 26835
/proc/meminfo: memFree=21031456/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=331196 CPUtime=203.25 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 18505 0 0 0 20311 14 0 0 25 0 8 0 550280766 339144704 18247 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 82799 18247 466 189 0 77148 0
[pid=26826/tid=26828] ppid=26824 vsize=331196 CPUtime=25.43 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 2402 0 0 0 2542 1 0 0 25 0 8 0 550280772 339144704 18247 33554432000 4194304 4964704 140735302517232 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=331196 CPUtime=25.41 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 3572 0 0 0 2540 1 0 0 25 0 8 0 550280772 339144704 18247 33554432000 4194304 4964704 140735302517232 18446744073709551615 4627281 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=331196 CPUtime=25.42 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 1761 0 0 0 2541 1 0 0 25 0 8 0 550280772 339144704 18247 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=331196 CPUtime=25.42 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 2113 0 0 0 2541 1 0 0 25 0 8 0 550280772 339144704 18247 33554432000 4194304 4964704 140735302517232 18446744073709551615 4660077 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=331196 CPUtime=25.43 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 1752 0 0 0 2542 1 0 0 25 0 8 0 550280772 339144704 18247 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=331196 CPUtime=25.43 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 1846 0 0 0 2541 2 0 0 25 0 8 0 550280772 339144704 18247 33554432000 4194304 4964704 140735302517232 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=331196 CPUtime=25.16 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 2547 0 0 0 2514 2 0 0 25 0 8 0 550280772 339144704 18247 33554432000 4194304 4964704 140735302517232 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.25
Current children cumulated vsize (KiB) 331196

[startup+51.101 s]
/proc/loadavg: 7.83 7.94 7.97 9/318 26836
/proc/meminfo: memFree=21013836/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=335556 CPUtime=407.75 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 22994 0 0 0 40754 21 0 0 25 0 8 0 550280766 343609344 22687 33554432000 4194304 4964704 140735302517232 18446744073709551615 4362240 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 83889 22687 466 189 0 78238 0
[pid=26826/tid=26828] ppid=26824 vsize=335556 CPUtime=51.02 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 3337 0 0 0 5100 2 0 0 25 0 8 0 550280772 343609344 22687 33554432000 4194304 4964704 140735302517232 18446744073709551615 4659143 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=335556 CPUtime=51 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 4554 0 0 0 5098 2 0 0 25 0 8 0 550280772 343609344 22687 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=335556 CPUtime=51.02 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 2038 0 0 0 5100 2 0 0 25 0 8 0 550280772 343609344 22687 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670298 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=335556 CPUtime=51.01 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 2689 0 0 0 5100 1 0 0 25 0 8 0 550280772 343609344 22687 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=335556 CPUtime=51.02 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 2527 0 0 0 5101 1 0 0 25 0 8 0 550280772 343609344 22687 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=335556 CPUtime=51.03 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 2099 0 0 0 5099 4 0 0 25 0 8 0 550280772 343609344 22687 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=335556 CPUtime=50.5 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 2978 0 0 0 5048 2 0 0 25 0 8 0 550280772 343609344 22687 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.75

################
# More data... #
################


[startup+4722.31 s]
/proc/loadavg: 8.13 8.05 8.06 9/318 29232
/proc/meminfo: memFree=20746788/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=448360 CPUtime=37723.7 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 77140 0 0 0 3771680 690 0 0 25 0 8 0 550280766 459120640 73717 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 112090 73717 466 189 0 106439 0
[pid=26826/tid=26828] ppid=26824 vsize=448360 CPUtime=4692.46 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 20432 0 0 0 469160 86 0 0 25 0 8 0 550280772 459120640 73717 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=448360 CPUtime=4720.68 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 15699 0 0 0 471990 78 0 0 25 0 8 0 550280772 459120640 73717 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670230 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=448360 CPUtime=4717.15 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 5201 0 0 0 471630 85 0 0 25 0 8 0 550280772 459120640 73717 33554432000 4194304 4964704 140735302517232 18446744073709551615 4325305 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=448360 CPUtime=4714.64 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 7952 0 0 0 471389 75 0 0 25 0 8 0 550280772 459120640 73717 33554432000 4194304 4964704 140735302517232 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=448360 CPUtime=4721.9 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 7597 0 0 0 472115 75 0 0 25 0 8 0 550280772 459120640 73717 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=448360 CPUtime=4721.62 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 6024 0 0 0 472068 94 0 0 25 0 8 0 550280772 459120640 73717 33554432000 4194304 4964704 140735302517232 18446744073709551615 4673211 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=448360 CPUtime=4713.5 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 8594 0 0 0 471236 114 0 0 25 0 8 0 550280772 459120640 73717 33554432000 4194304 4964704 140735302517232 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37723.7
Current children cumulated vsize (KiB) 448360

[startup+4782.3 s]
/proc/loadavg: 8.05 8.04 8.05 9/318 29234
/proc/meminfo: memFree=20745632/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=448360 CPUtime=38203 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 77353 0 0 0 3819601 696 0 0 25 0 8 0 550280766 459120640 73930 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670354 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 112090 73930 466 189 0 106439 0
[pid=26826/tid=26828] ppid=26824 vsize=448360 CPUtime=4751.85 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 20434 0 0 0 475098 87 0 0 25 0 8 0 550280772 459120640 73930 33554432000 4194304 4964704 140735302517232 18446744073709551615 4668629 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=448360 CPUtime=4780.66 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 15772 0 0 0 477988 78 0 0 25 0 8 0 550280772 459120640 73930 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670252 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=448360 CPUtime=4777.13 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 5243 0 0 0 477628 85 0 0 25 0 8 0 550280772 459120640 73930 33554432000 4194304 4964704 140735302517232 18446744073709551615 4321013 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=448360 CPUtime=4774.63 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 7991 0 0 0 477387 76 0 0 25 0 8 0 550280772 459120640 73930 33554432000 4194304 4964704 140735302517232 18446744073709551615 4668635 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=448360 CPUtime=4781.87 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 7597 0 0 0 478111 76 0 0 25 0 8 0 550280772 459120640 73930 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=448360 CPUtime=4781.61 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 6030 0 0 0 478066 95 0 0 25 0 8 0 550280772 459120640 73930 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=448360 CPUtime=4773.48 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 8606 0 0 0 477233 115 0 0 25 0 8 0 550280772 459120640 73930 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670271 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38203
Current children cumulated vsize (KiB) 448360

[startup+4842.3 s]
/proc/loadavg: 8.02 8.03 8.04 9/318 29244
/proc/meminfo: memFree=20742100/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=448360 CPUtime=38682.3 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 77664 0 0 0 3867527 701 0 0 25 0 8 0 550280766 459120640 74241 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 112090 74241 466 189 0 106439 0
[pid=26826/tid=26828] ppid=26824 vsize=448360 CPUtime=4811.25 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 20434 0 0 0 481037 88 0 0 25 0 8 0 550280772 459120640 74241 33554432000 4194304 4964704 140735302517232 18446744073709551615 4659152 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=448360 CPUtime=4840.63 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 15819 0 0 0 483984 79 0 0 25 0 8 0 550280772 459120640 74241 33554432000 4194304 4964704 140735302517232 18446744073709551615 4668609 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=448360 CPUtime=4837.13 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 5348 0 0 0 483627 86 0 0 25 0 8 0 550280772 459120640 74241 33554432000 4194304 4964704 140735302517232 18446744073709551615 4627168 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=448360 CPUtime=4834.63 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 8033 0 0 0 483386 77 0 0 25 0 8 0 550280772 459120640 74241 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=448360 CPUtime=4841.86 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 7599 0 0 0 484109 77 0 0 25 0 8 0 550280772 459120640 74241 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=448360 CPUtime=4841.6 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 6033 0 0 0 484065 95 0 0 25 0 8 0 550280772 459120640 74241 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=448360 CPUtime=4833.48 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 8677 0 0 0 483232 116 0 0 25 0 8 0 550280772 459120640 74241 33554432000 4194304 4964704 140735302517232 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 38682.3
Current children cumulated vsize (KiB) 448360

[startup+4902.3 s]
/proc/loadavg: 8.06 8.04 8.04 9/318 29246
/proc/meminfo: memFree=20743096/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=448360 CPUtime=39161.6 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 77923 0 0 0 3915456 708 0 0 25 0 8 0 550280766 459120640 74500 33554432000 4194304 4964704 140735302517232 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 112090 74500 466 189 0 106439 0
[pid=26826/tid=26828] ppid=26824 vsize=448360 CPUtime=4870.64 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 20435 0 0 0 486976 88 0 0 25 0 8 0 550280772 459120640 74500 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=448360 CPUtime=4900.62 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 15825 0 0 0 489981 81 0 0 25 0 8 0 550280772 459120640 74500 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=448360 CPUtime=4897.13 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 5383 0 0 0 489626 87 0 0 25 0 8 0 550280772 459120640 74500 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670434 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=448360 CPUtime=4894.63 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 8084 0 0 0 489385 78 0 0 25 0 8 0 550280772 459120640 74500 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=448360 CPUtime=4901.84 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 7639 0 0 0 490107 77 0 0 25 0 8 0 550280772 459120640 74500 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670193 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=448360 CPUtime=4901.6 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 6121 0 0 0 490064 96 0 0 25 0 8 0 550280772 459120640 74500 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=448360 CPUtime=4893.47 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 8677 0 0 0 489230 117 0 0 25 0 8 0 550280772 459120640 74500 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39161.6
Current children cumulated vsize (KiB) 448360

[startup+4962.3 s]
/proc/loadavg: 8.02 8.03 8.04 9/318 29248
/proc/meminfo: memFree=20742436/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=448588 CPUtime=39641 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 78033 0 0 0 3963382 717 0 0 25 0 8 0 550280766 459354112 74610 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 112147 74610 466 189 0 106496 0
[pid=26826/tid=26828] ppid=26824 vsize=448588 CPUtime=4930.03 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 20435 0 0 0 492914 89 0 0 25 0 8 0 550280772 459354112 74610 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=448588 CPUtime=4960.62 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 15825 0 0 0 495980 82 0 0 25 0 8 0 550280772 459354112 74610 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=448588 CPUtime=4957.12 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 5383 0 0 0 495624 88 0 0 25 0 8 0 550280772 459354112 74610 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=448588 CPUtime=4954.62 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 8084 0 0 0 495384 78 0 0 25 0 8 0 550280772 459354112 74610 33554432000 4194304 4964704 140735302517232 18446744073709551615 4668635 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=448588 CPUtime=4961.83 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 7643 0 0 0 496104 79 0 0 25 0 8 0 550280772 459354112 74610 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670243 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=448588 CPUtime=4961.59 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 6121 0 0 0 496062 97 0 0 25 0 8 0 550280772 459354112 74610 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=448588 CPUtime=4953.46 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 8713 0 0 0 495228 118 0 0 25 0 8 0 550280772 459354112 74610 33554432000 4194304 4964704 140735302517232 18446744073709551615 4627365 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 39641
Current children cumulated vsize (KiB) 448588



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5007.3 s]
/proc/loadavg: 8.07 8.04 8.04 9/318 29249
/proc/meminfo: memFree=20742032/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=448776 CPUtime=40000.6 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 78183 0 0 0 3999335 722 0 0 25 0 8 0 550280766 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 112194 74760 466 189 0 106543 0
[pid=26826/tid=26828] ppid=26824 vsize=448776 CPUtime=4974.57 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 20469 0 0 0 497367 90 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=448776 CPUtime=5005.62 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 15830 0 0 0 500480 82 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=448776 CPUtime=5002.13 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 5427 0 0 0 500124 89 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=448776 CPUtime=4999.62 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 8084 0 0 0 499884 78 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=448776 CPUtime=5006.83 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 7644 0 0 0 500603 80 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=448776 CPUtime=5006.6 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 6154 0 0 0 500562 98 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=448776 CPUtime=4998.48 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 8746 0 0 0 499728 120 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 448776

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5007.3 s]
/proc/loadavg: 8.07 8.04 8.04 9/318 29249
/proc/meminfo: memFree=20742032/32950928 swapFree=67111464/67111528
[pid=26826] ppid=26824 vsize=448776 CPUtime=40000.6 cores=0-7
/proc/26826/stat : 26826 (claspmt) R 26824 26826 26800 0 -1 4202496 78183 0 0 0 3999335 722 0 0 25 0 8 0 550280766 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/26826/statm: 112194 74760 466 189 0 106543 0
[pid=26826/tid=26828] ppid=26824 vsize=448776 CPUtime=4974.57 cores=0-7
/proc/26826/task/26828/stat : 26828 (claspmt) R 26824 26826 26800 0 -1 4202560 20469 0 0 0 497367 90 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=26826/tid=26829] ppid=26824 vsize=448776 CPUtime=5005.62 cores=0-7
/proc/26826/task/26829/stat : 26829 (claspmt) R 26824 26826 26800 0 -1 4202560 15830 0 0 0 500480 82 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=26826/tid=26830] ppid=26824 vsize=448776 CPUtime=5002.13 cores=0-7
/proc/26826/task/26830/stat : 26830 (claspmt) R 26824 26826 26800 0 -1 4202560 5427 0 0 0 500124 89 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=26826/tid=26831] ppid=26824 vsize=448776 CPUtime=4999.62 cores=0-7
/proc/26826/task/26831/stat : 26831 (claspmt) R 26824 26826 26800 0 -1 4202560 8084 0 0 0 499884 78 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=26826/tid=26832] ppid=26824 vsize=448776 CPUtime=5006.83 cores=0-7
/proc/26826/task/26832/stat : 26832 (claspmt) R 26824 26826 26800 0 -1 4202560 7644 0 0 0 500603 80 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=26826/tid=26833] ppid=26824 vsize=448776 CPUtime=5006.6 cores=0-7
/proc/26826/task/26833/stat : 26833 (claspmt) R 26824 26826 26800 0 -1 4202560 6154 0 0 0 500562 98 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=26826/tid=26834] ppid=26824 vsize=448776 CPUtime=4998.48 cores=0-7
/proc/26826/task/26834/stat : 26834 (claspmt) R 26824 26826 26800 0 -1 4202560 8746 0 0 0 499728 120 0 0 25 0 8 0 550280772 459546624 74760 33554432000 4194304 4964704 140735302517232 18446744073709551615 4670263 0 0 4096 18946 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 448776

Child status: 0
Real time (s): 5007.4
CPU time (s): 40000.7
CPU user time (s): 39993.5
CPU system time (s): 7.2449
CPU usage (%): 798.832
Max. virtual memory (cumulated for all children) (KiB): 448776

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39993.5
system time used= 7.2449
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 78194
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 663425
involuntary context switches= 200791

runsolver used 14.8407 second user time and 35.2606 second system time

The end

Launcher Data 

Begin job on node122 at 2011-05-03 03:40:20
IDJOB=3322494
IDBENCH=83365
IDSOLVER=1711
FILE ID=node122/3322494-1304386820
RUNJOBID= node122-1304386820-26814
PBS_JOBID= 13181813
Free space on /tmp= 73484 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322494-1304386820/watcher-3322494-1304386820 -o /tmp/evaluation-result-3322494-1304386820/solver-3322494-1304386820 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322494-1304386820.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b61e426b264831836f140414cdcf3e23
RANDOM SEED=1713988554

node122.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      21100352 kB
Buffers:        390728 kB
Cached:        3111460 kB
SwapCached:         64 kB
Active:        8544416 kB
Inactive:      2921892 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      21100352 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:            1184 kB
Writeback:           0 kB
AnonPages:     7964340 kB
Mapped:          25160 kB
Slab:           287620 kB
PageTables:      32732 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 52524232 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73812 MiB
End job on node122 at 2011-05-03 05:03:49