Trace number 3299912

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095? (TO) 4800.41 1201.84

General information on the benchmark

Nameindustrial/fuhs/hard/
AProVE07-01.cnf
MD5SUMd2f77e32530988f77dca5112174eee00
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables7502
Number of clauses28770
Sum of the clauses size76290
Maximum clause length847
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 215814
Number of clauses of size 311119
Number of clauses of size 4733
Number of clauses of size 5172
Number of clauses of size over 5931

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...037903/instance-3299912-1304037903.cnf
0.00/0.05	c Solving...
4800.36/1201.81	
4800.36/1201.81	*** INTERRUPTED! ***
4800.36/1201.81	*** Shutting down threads...
4800.36/1201.83	s UNKNOWN
4800.36/1201.83	
4800.36/1201.83	c INTERRUPTED   : 1
4800.36/1201.83	c Models        : 0+    
4800.36/1201.83	c Time          : 1201.809s (Solving: 1201.75s 1st Model: 0.00s Unsat: 0.00s)
4800.36/1201.83	c CPU Time      : 4800.380s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3299912-1304037903/watcher-3299912-1304037903 -o /tmp/evaluation-result-3299912-1304037903/solver-3299912-1304037903 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299912-1304037903.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.17 8.11 7.95 5/180 17686
/proc/meminfo: memFree=18083556/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=22452 CPUtime=0 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 963 0 0 0 0 0 0 0 25 0 1 0 515388288 22990848 834 33554432000 4194304 4964704 140736593475856 18446744073709551615 228122713856 0 0 4096 18946 0 0 0 17 1 0 0 0
/proc/17686/statm: 5613 835 388 189 0 487 0

[startup+0.079463 s]
/proc/loadavg: 8.17 8.11 7.95 5/180 17686
/proc/meminfo: memFree=18083556/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=174888 CPUtime=0.11 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 3013 0 0 0 11 0 0 0 25 0 4 0 515388288 179085312 2472 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670255 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 43722 2472 454 189 0 38071 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 174888

[startup+0.158564 s]
/proc/loadavg: 8.17 8.11 7.95 5/180 17686
/proc/meminfo: memFree=18083556/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=175284 CPUtime=0.42 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 3278 0 0 0 42 0 0 0 25 0 4 0 515388288 179490816 2737 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668632 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 43821 2737 458 189 0 38170 0
Current children cumulated CPU time (s) 0.42
Current children cumulated vsize (KiB) 175284

[startup+0.300171 s]
/proc/loadavg: 8.17 8.11 7.95 5/180 17686
/proc/meminfo: memFree=18083556/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=175812 CPUtime=0.99 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 3715 0 0 0 99 0 0 0 25 0 4 0 515388288 180031488 3174 33554432000 4194304 4964704 140736593475856 18446744073709551615 4660310 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 43953 3174 458 189 0 38302 0
Current children cumulated CPU time (s) 0.99
Current children cumulated vsize (KiB) 175812

[startup+0.701097 s]
/proc/loadavg: 8.17 8.11 7.95 5/180 17686
/proc/meminfo: memFree=18083556/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=177064 CPUtime=2.6 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 4404 0 0 0 259 1 0 0 25 0 4 0 515388288 181313536 3863 33554432000 4194304 4964704 140736593475856 18446744073709551615 4660034 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 44266 3863 458 189 0 38615 0
Current children cumulated CPU time (s) 2.6
Current children cumulated vsize (KiB) 177064

[startup+1.50095 s]
/proc/loadavg: 8.15 8.11 7.95 9/184 17690
/proc/meminfo: memFree=18067576/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=178256 CPUtime=5.79 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 5109 0 0 0 578 1 0 0 25 0 4 0 515388288 182534144 4568 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670266 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 44564 4568 458 189 0 38913 0
[pid=17686/tid=17688] ppid=17684 vsize=178256 CPUtime=1.43 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 735 0 0 0 143 0 0 0 20 0 4 0 515388294 182534144 4568 33554432000 4194304 4964704 140736593475856 18446744073709551615 4342218 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=178256 CPUtime=1.42 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 1200 0 0 0 142 0 0 0 25 0 4 0 515388294 182534144 4568 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670416 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=178256 CPUtime=1.43 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 800 0 0 0 143 0 0 0 25 0 4 0 515388294 182534144 4568 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.79
Current children cumulated vsize (KiB) 178256

[startup+3.10067 s]
/proc/loadavg: 8.15 8.11 7.95 9/184 17690
/proc/meminfo: memFree=18064848/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=178924 CPUtime=12.18 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 6164 0 0 0 1216 2 0 0 25 0 4 0 515388288 183218176 5623 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670230 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 44731 5623 458 189 0 39080 0
[pid=17686/tid=17688] ppid=17684 vsize=178924 CPUtime=3.03 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 962 0 0 0 303 0 0 0 25 0 4 0 515388294 183218176 5623 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=178924 CPUtime=3.02 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 1684 0 0 0 302 0 0 0 25 0 4 0 515388294 183218176 5623 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=178924 CPUtime=3.02 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 952 0 0 0 302 0 0 0 25 0 4 0 515388294 183218176 5623 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668618 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.18
Current children cumulated vsize (KiB) 178924

[startup+6.30109 s]
/proc/loadavg: 8.14 8.11 7.95 9/184 17690
/proc/meminfo: memFree=18052936/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=181644 CPUtime=24.97 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 8424 0 0 0 2494 3 0 0 25 0 4 0 515388288 186003456 7883 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 45411 7883 460 189 0 39760 0
[pid=17686/tid=17688] ppid=17684 vsize=181644 CPUtime=6.22 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 1327 0 0 0 622 0 0 0 25 0 4 0 515388294 186003456 7883 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=181644 CPUtime=6.23 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 2919 0 0 0 622 1 0 0 25 0 4 0 515388294 186003456 7883 33554432000 4194304 4964704 140736593475856 18446744073709551615 4361293 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=181644 CPUtime=6.2 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 1355 0 0 0 620 0 0 0 25 0 4 0 515388294 186003456 7883 33554432000 4194304 4964704 140736593475856 18446744073709551615 4362990 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.97
Current children cumulated vsize (KiB) 181644

[startup+12.7009 s]
/proc/loadavg: 8.13 8.10 7.95 9/184 17690
/proc/meminfo: memFree=18043004/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=183200 CPUtime=50.53 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 10120 0 0 0 5049 4 0 0 25 0 4 0 515388288 187596800 9579 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669270 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 45800 9579 460 189 0 40149 0
[pid=17686/tid=17688] ppid=17684 vsize=183200 CPUtime=12.63 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 1762 0 0 0 1262 1 0 0 25 0 4 0 515388294 187596800 9579 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668840 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=183200 CPUtime=12.62 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 3710 0 0 0 1261 1 0 0 25 0 4 0 515388294 187596800 9579 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=183200 CPUtime=12.56 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 1665 0 0 0 1256 0 0 0 25 0 4 0 515388294 187596800 9579 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.53
Current children cumulated vsize (KiB) 183200

[startup+25.5006 s]
/proc/loadavg: 8.17 8.11 7.96 9/184 17690
/proc/meminfo: memFree=18029744/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=187516 CPUtime=101.65 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 13286 0 0 0 10158 7 0 0 25 0 4 0 515388288 192016384 12664 33554432000 4194304 4964704 140736593475856 18446744073709551615 4653319 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 46879 12664 460 189 0 41228 0
[pid=17686/tid=17688] ppid=17684 vsize=187516 CPUtime=25.42 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 2296 0 0 0 2541 1 0 0 25 0 4 0 515388294 192016384 12664 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=187516 CPUtime=25.43 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 5414 0 0 0 2540 3 0 0 25 0 4 0 515388294 192016384 12664 33554432000 4194304 4964704 140736593475856 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=187516 CPUtime=25.29 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 2182 0 0 0 2528 1 0 0 25 0 4 0 515388294 192016384 12664 33554432000 4194304 4964704 140736593475856 18446744073709551615 4660433 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 101.65
Current children cumulated vsize (KiB) 187516

[startup+51.101 s]
/proc/loadavg: 8.18 8.12 7.96 9/184 17691
/proc/meminfo: memFree=18010728/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=190824 CPUtime=203.91 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 15183 0 0 0 20382 9 0 0 25 0 4 0 515388288 195403776 14561 33554432000 4194304 4964704 140736593475856 18446744073709551615 4653336 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 47706 14561 460 189 0 42055 0
[pid=17686/tid=17688] ppid=17684 vsize=190824 CPUtime=51.02 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 2622 0 0 0 5101 1 0 0 25 0 4 0 515388294 195403776 14561 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=190824 CPUtime=51.03 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 6250 0 0 0 5099 4 0 0 25 0 4 0 515388294 195403776 14561 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669333 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=190824 CPUtime=50.76 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 2457 0 0 0 5074 2 0 0 25 0 4 0 515388294 195403776 14561 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 203.91
Current children cumulated vsize (KiB) 190824

[startup+102.307 s]
/proc/loadavg: 8.21 8.13 7.97 9/184 17692
/proc/meminfo: memFree=17971264/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=258660 CPUtime=408.44 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 18305 0 0 0 40831 13 0 0 25 0 4 0 515388288 264867840 17669 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 64665 17669 460 189 0 59014 0
[pid=17686/tid=17688] ppid=17684 vsize=258660 CPUtime=102.22 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 3209 0 0 0 10219 3 0 0 25 0 4 0 515388294 264867840 17669 33554432000 4194304 4964704 140736593475856 18446744073709551615 4320921 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=258660 CPUtime=102.23 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 8238 0 0 0 10217 6 0 0 25 0 4 0 515388294 264867840 17669 33554432000 4194304 4964704 140736593475856 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=258660 CPUtime=101.68 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 2776 0 0 0 10166 2 0 0 25 0 4 0 515388294 264867840 17669 33554432000 4194304 4964704 140736593475856 18446744073709551615 4660139 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 408.44
Current children cumulated vsize (KiB) 258660

[startup+162.301 s]
/proc/loadavg: 7.73 8.04 7.95 9/184 17725
/proc/meminfo: memFree=18149372/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=263664 CPUtime=648.09 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 24366 0 0 0 64787 22 0 0 25 0 4 0 515388288 269991936 23691 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668632 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 65916 23691 460 189 0 60265 0
[pid=17686/tid=17688] ppid=17684 vsize=263664 CPUtime=162.2 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4199 0 0 0 16216 4 0 0 25 0 4 0 515388294 269991936 23691 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670288 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=263664 CPUtime=162.22 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 11949 0 0 0 16212 10 0 0 25 0 4 0 515388294 269991936 23691 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670233 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=263664 CPUtime=161.35 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4060 0 0 0 16130 5 0 0 25 0 4 0 515388294 269991936 23691 33554432000 4194304 4964704 140736593475856 18446744073709551615 4342144 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 648.09
Current children cumulated vsize (KiB) 263664

[startup+222.301 s]
/proc/loadavg: 7.97 8.04 7.96 9/184 17726
/proc/meminfo: memFree=18115176/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=269488 CPUtime=887.76 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 27437 0 0 0 88751 25 0 0 25 0 4 0 515388288 275955712 26753 33554432000 4194304 4964704 140736593475856 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 67372 26753 460 189 0 61721 0
[pid=17686/tid=17688] ppid=17684 vsize=269488 CPUtime=222.2 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4534 0 0 0 22215 5 0 0 25 0 4 0 515388294 275955712 26753 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=269488 CPUtime=222.22 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 14684 0 0 0 22210 12 0 0 25 0 4 0 515388294 275955712 26753 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=269488 CPUtime=221.02 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4060 0 0 0 22097 5 0 0 25 0 4 0 515388294 275955712 26753 33554432000 4194304 4964704 140736593475856 18446744073709551615 4660415 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 887.76
Current children cumulated vsize (KiB) 269488

[startup+282.3 s]

################
# More data... #
################

[pid=17686] ppid=17684 vsize=272208 CPUtime=2565.46 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 33282 0 0 0 256508 38 0 0 25 0 4 0 515388288 278740992 32434 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68052 32434 460 189 0 62401 0
[pid=17686/tid=17688] ppid=17684 vsize=272208 CPUtime=642.18 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4959 0 0 0 64211 7 0 0 25 0 4 0 515388294 278740992 32434 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272208 CPUtime=642.22 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 19244 0 0 0 64201 21 0 0 25 0 4 0 515388294 278740992 32434 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272208 CPUtime=638.73 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4299 0 0 0 63868 5 0 0 25 0 4 0 515388294 278740992 32434 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2565.46
Current children cumulated vsize (KiB) 272208

[startup+702.301 s]
/proc/loadavg: 8.13 8.12 8.02 9/184 17739
/proc/meminfo: memFree=17928728/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=272352 CPUtime=2805.11 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 33747 0 0 0 280472 39 0 0 25 0 4 0 515388288 278888448 32872 33554432000 4194304 4964704 140736593475856 18446744073709551615 4660362 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68088 32872 460 189 0 62437 0
[pid=17686/tid=17688] ppid=17684 vsize=272352 CPUtime=702.18 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4963 0 0 0 70210 8 0 0 25 0 4 0 515388294 278888448 32872 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668531 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272352 CPUtime=702.21 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 19705 0 0 0 70200 21 0 0 25 0 4 0 515388294 278888448 32872 33554432000 4194304 4964704 140736593475856 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272352 CPUtime=698.4 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4299 0 0 0 69835 5 0 0 25 0 4 0 515388294 278888448 32872 33554432000 4194304 4964704 140736593475856 18446744073709551615 4362996 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2805.11
Current children cumulated vsize (KiB) 272352

[startup+762.307 s]
/proc/loadavg: 8.08 8.11 8.02 9/184 17741
/proc/meminfo: memFree=17909952/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=272352 CPUtime=3044.79 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 34316 0 0 0 304439 40 0 0 25 0 4 0 515388288 278888448 33441 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668488 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68088 33441 460 189 0 62437 0
[pid=17686/tid=17688] ppid=17684 vsize=272352 CPUtime=762.18 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4980 0 0 0 76210 8 0 0 25 0 4 0 515388294 278888448 33441 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272352 CPUtime=762.21 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 20253 0 0 0 76199 22 0 0 25 0 4 0 515388294 278888448 33441 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272352 CPUtime=758.09 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4301 0 0 0 75803 6 0 0 25 0 4 0 515388294 278888448 33441 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3044.79
Current children cumulated vsize (KiB) 272352

[startup+822.301 s]
/proc/loadavg: 8.06 8.10 8.02 9/184 17742
/proc/meminfo: memFree=17891180/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=272352 CPUtime=3284.45 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 34318 0 0 0 328404 41 0 0 25 0 4 0 515388288 278888448 33259 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668512 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68088 33259 460 189 0 62437 0
[pid=17686/tid=17688] ppid=17684 vsize=272352 CPUtime=822.17 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4980 0 0 0 82209 8 0 0 25 0 4 0 515388294 278888448 33259 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669429 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272352 CPUtime=822.2 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 20255 0 0 0 82198 22 0 0 25 0 4 0 515388294 278888448 33259 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670215 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272352 CPUtime=817.76 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4301 0 0 0 81770 6 0 0 25 0 4 0 515388294 278888448 33259 33554432000 4194304 4964704 140736593475856 18446744073709551615 4361114 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3284.45
Current children cumulated vsize (KiB) 272352

[startup+882.3 s]
/proc/loadavg: 8.05 8.10 8.02 9/184 17744
/proc/meminfo: memFree=17864608/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=272352 CPUtime=3524.11 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 34323 0 0 0 352370 41 0 0 25 0 4 0 515388288 278888448 33264 33554432000 4194304 4964704 140736593475856 18446744073709551615 4332059 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68088 33264 460 189 0 62437 0
[pid=17686/tid=17688] ppid=17684 vsize=272352 CPUtime=882.17 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4980 0 0 0 88209 8 0 0 25 0 4 0 515388294 278888448 33264 33554432000 4194304 4964704 140736593475856 18446744073709551615 4362514 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272352 CPUtime=882.21 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 20260 0 0 0 88198 23 0 0 25 0 4 0 515388294 278888448 33264 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272352 CPUtime=877.43 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4301 0 0 0 87737 6 0 0 25 0 4 0 515388294 278888448 33264 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670574 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3524.11
Current children cumulated vsize (KiB) 272352

[startup+942.301 s]
/proc/loadavg: 8.02 8.08 8.01 9/184 17746
/proc/meminfo: memFree=17847208/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=272352 CPUtime=3763.79 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 35392 0 0 0 376336 43 0 0 25 0 4 0 515388288 278888448 34333 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668609 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68088 34333 460 189 0 62437 0
[pid=17686/tid=17688] ppid=17684 vsize=272352 CPUtime=942.16 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4981 0 0 0 94208 8 0 0 25 0 4 0 515388294 278888448 34333 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669306 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272352 CPUtime=942.2 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 21328 0 0 0 94196 24 0 0 25 0 4 0 515388294 278888448 34333 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272352 CPUtime=937.11 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4301 0 0 0 93705 6 0 0 25 0 4 0 515388294 278888448 34333 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669429 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3763.79
Current children cumulated vsize (KiB) 272352

[startup+1002.3 s]
/proc/loadavg: 8.08 8.07 8.01 9/184 17756
/proc/meminfo: memFree=17833184/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=272352 CPUtime=4003.44 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 35935 0 0 0 400300 44 0 0 25 0 4 0 515388288 278888448 34862 33554432000 4194304 4964704 140736593475856 18446744073709551615 4668673 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68088 34862 460 189 0 62437 0
[pid=17686/tid=17688] ppid=17684 vsize=272352 CPUtime=1002.16 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4982 0 0 0 100208 8 0 0 25 0 4 0 515388294 278888448 34862 33554432000 4194304 4964704 140736593475856 18446744073709551615 4653350 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272352 CPUtime=1002.2 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 21870 0 0 0 100195 25 0 0 25 0 4 0 515388294 278888448 34862 33554432000 4194304 4964704 140736593475856 18446744073709551615 4660156 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272352 CPUtime=996.77 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4301 0 0 0 99671 6 0 0 25 0 4 0 515388294 278888448 34862 33554432000 4194304 4964704 140736593475856 18446744073709551615 4653563 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4003.44
Current children cumulated vsize (KiB) 272352

[startup+1062.3 s]
/proc/loadavg: 8.10 8.07 8.01 9/184 17758
/proc/meminfo: memFree=17823712/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=272352 CPUtime=4243.11 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 35935 0 0 0 424267 44 0 0 25 0 4 0 515388288 278888448 34862 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669333 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68088 34862 460 189 0 62437 0
[pid=17686/tid=17688] ppid=17684 vsize=272352 CPUtime=1062.16 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4982 0 0 0 106208 8 0 0 25 0 4 0 515388294 278888448 34862 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670266 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272352 CPUtime=1062.2 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 21870 0 0 0 106195 25 0 0 25 0 4 0 515388294 278888448 34862 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670277 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272352 CPUtime=1056.45 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4301 0 0 0 105639 6 0 0 25 0 4 0 515388294 278888448 34862 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669333 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4243.11
Current children cumulated vsize (KiB) 272352

[startup+1122.3 s]
/proc/loadavg: 8.10 8.07 8.01 9/184 17759
/proc/meminfo: memFree=17813240/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=272352 CPUtime=4482.78 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 35936 0 0 0 448233 45 0 0 25 0 4 0 515388288 278888448 34863 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670230 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68088 34863 460 189 0 62437 0
[pid=17686/tid=17688] ppid=17684 vsize=272352 CPUtime=1122.16 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4982 0 0 0 112207 9 0 0 25 0 4 0 515388294 278888448 34863 33554432000 4194304 4964704 140736593475856 18446744073709551615 4370236 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272352 CPUtime=1122.2 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 21870 0 0 0 112195 25 0 0 25 0 4 0 515388294 278888448 34863 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670184 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272352 CPUtime=1116.12 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4301 0 0 0 111606 6 0 0 25 0 4 0 515388294 278888448 34863 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669452 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4482.78
Current children cumulated vsize (KiB) 272352

[startup+1182.3 s]
/proc/loadavg: 8.36 8.14 8.03 9/184 17764
/proc/meminfo: memFree=17803024/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=272352 CPUtime=4722.45 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 35939 0 0 0 472199 46 0 0 25 0 4 0 515388288 278888448 34866 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669013 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68088 34866 460 189 0 62437 0
[pid=17686/tid=17688] ppid=17684 vsize=272352 CPUtime=1182.15 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4982 0 0 0 118206 9 0 0 25 0 4 0 515388294 278888448 34866 33554432000 4194304 4964704 140736593475856 18446744073709551615 4342228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272352 CPUtime=1182.2 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 21870 0 0 0 118194 26 0 0 25 0 4 0 515388294 278888448 34866 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272352 CPUtime=1175.79 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4301 0 0 0 117573 6 0 0 25 0 4 0 515388294 278888448 34866 33554432000 4194304 4964704 140736593475856 18446744073709551615 4669391 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4722.45
Current children cumulated vsize (KiB) 272352



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.26 8.13 8.03 9/184 17765
/proc/meminfo: memFree=17799816/32951124 swapFree=67111528/67111528
[pid=17686] ppid=17684 vsize=272352 CPUtime=4800.36 cores=1,3,5,7
/proc/17686/stat : 17686 (claspmt) R 17684 17686 17518 0 -1 4202496 35939 0 0 0 479990 46 0 0 25 0 4 0 515388288 278888448 34866 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670266 0 0 4096 18946 18446744073709551615 0 0 17 1 0 0 0
/proc/17686/statm: 68088 34866 460 189 0 62437 0
[pid=17686/tid=17688] ppid=17684 vsize=272352 CPUtime=1201.66 cores=1,3,5,7
/proc/17686/task/17688/stat : 17688 (claspmt) R 17684 17686 17518 0 -1 4202560 4982 0 0 0 120157 9 0 0 25 0 4 0 515388294 278888448 34866 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=17686/tid=17689] ppid=17684 vsize=272352 CPUtime=1201.7 cores=1,3,5,7
/proc/17686/task/17689/stat : 17689 (claspmt) R 17684 17686 17518 0 -1 4202560 21870 0 0 0 120144 26 0 0 25 0 4 0 515388294 278888448 34866 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 3 0 0 0
[pid=17686/tid=17690] ppid=17684 vsize=272352 CPUtime=1195.18 cores=1,3,5,7
/proc/17686/task/17690/stat : 17690 (claspmt) R 17684 17686 17518 0 -1 4202560 4301 0 0 0 119512 6 0 0 25 0 4 0 515388294 278888448 34866 33554432000 4194304 4964704 140736593475856 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 272352

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1201.84
CPU time (s): 4800.41
CPU user time (s): 4799.94
CPU system time (s): 0.470928
CPU usage (%): 399.422
Max. virtual memory (cumulated for all children) (KiB): 272816

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4799.94
system time used= 0.470928
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 35951
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9013
involuntary context switches= 36563

runsolver used 1.64975 second user time and 4.91625 second system time

The end

Launcher Data 

Begin job on node138 at 2011-04-29 02:45:03
IDJOB=3299912
IDBENCH=20399
IDSOLVER=1683
FILE ID=node138/3299912-1304037903
RUNJOBID= node138-1304036586-17537
PBS_JOBID= 13170360
Free space on /tmp= 71796 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT07/industrial/fuhs/hard/AProVE07-01.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3299912-1304037903/watcher-3299912-1304037903 -o /tmp/evaluation-result-3299912-1304037903/solver-3299912-1304037903 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3299912-1304037903.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d2f77e32530988f77dca5112174eee00
RANDOM SEED=751738585

node138.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18083836 kB
Buffers:       2041116 kB
Cached:       11661184 kB
SwapCached:          0 kB
Active:        3855108 kB
Inactive:     10448560 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18083836 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            1172 kB
Writeback:           0 kB
AnonPages:      600912 kB
Mapped:          15728 kB
Slab:           500284 kB
PageTables:       6028 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   765704 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71792 MiB
End job on node138 at 2011-04-29 03:05:07