Trace number 3373522

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.45 1206.66

General information on the benchmark

NameSAT03/industrial/kukula/addm_bench/
am_7_7.shuffled-as.sat03-363.cnf
MD5SUMc7f51e1ee7556440ab29e1c4bfe29538
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4264
Number of clauses14751
Sum of the clauses size40035
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 24214
Number of clauses of size 310535
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...429978/instance-3373522-1305429978.cnf
0.00/0.02	c Solving...
4800.37/1206.63	
4800.37/1206.63	*** INTERRUPTED! ***
4800.37/1206.63	*** Shutting down threads...
4800.37/1206.65	s UNKNOWN
4800.37/1206.65	
4800.37/1206.65	c INTERRUPTED   : 1
4800.37/1206.65	c Models        : 0+    
4800.37/1206.65	c Time          : 1206.631s (Solving: 1206.61s 1st Model: 0.00s Unsat: 0.00s)
4800.37/1206.65	c CPU Time      : 4800.420s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373522-1305429978/watcher-3373522-1305429978 -o /tmp/evaluation-result-3373522-1305429978/solver-3373522-1305429978 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373522-1305429978.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.91 7.05 5.97 3/395 4860
/proc/meminfo: memFree=24237856/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=21892 CPUtime=0 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 810 0 0 0 0 0 0 0 23 0 1 0 654596473 22417408 707 33554432000 4194304 4964800 140735302177312 18446744073709551615 242970211013 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/4860/statm: 5473 709 388 189 0 347 0

[startup+0.0821779 s]
/proc/loadavg: 4.91 7.05 5.97 3/395 4860
/proc/meminfo: memFree=24237856/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=170792 CPUtime=0.23 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 1869 0 0 0 23 0 0 0 24 0 4 0 654596473 174891008 1551 33554432000 4194304 4964800 140735302177312 18446744073709551615 4320984 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/4860/statm: 42698 1551 458 189 0 37047 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 170792

[startup+0.100161 s]
/proc/loadavg: 4.91 7.05 5.97 3/395 4860
/proc/meminfo: memFree=24237856/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=170792 CPUtime=0.3 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 1940 0 0 0 30 0 0 0 24 0 4 0 654596473 174891008 1622 33554432000 4194304 4964800 140735302177312 18446744073709551615 4660564 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/4860/statm: 42698 1622 458 189 0 37047 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 170792

[startup+0.300164 s]
/proc/loadavg: 4.91 7.05 5.97 3/395 4860
/proc/meminfo: memFree=24237856/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=236592 CPUtime=0.72 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 2272 0 0 0 58 14 0 0 25 0 4 0 654596473 242270208 1954 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/4860/statm: 59148 1954 458 189 0 53497 0
Current children cumulated CPU time (s) 0.72
Current children cumulated vsize (KiB) 236592

[startup+0.701105 s]
/proc/loadavg: 4.91 7.05 5.97 3/395 4860
/proc/meminfo: memFree=24237856/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=236856 CPUtime=1.59 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 2610 0 0 0 111 48 0 0 25 0 4 0 654596473 242540544 2292 33554432000 4194304 4964800 140735302177312 18446744073709551615 4668698 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/4860/statm: 59214 2292 458 189 0 53563 0
Current children cumulated CPU time (s) 1.59
Current children cumulated vsize (KiB) 236856

[startup+1.50092 s]
/proc/loadavg: 4.91 7.05 5.97 5/399 4864
/proc/meminfo: memFree=24210428/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=237432 CPUtime=3.97 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 3340 0 0 0 311 86 0 0 25 0 4 0 654596473 243130368 3022 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/4860/statm: 59358 3022 458 189 0 53707 0
[pid=4860/tid=4862] ppid=4858 vsize=237432 CPUtime=0.98 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 445 0 0 0 89 9 0 0 16 0 4 0 654596475 243130368 3022 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669347 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=237432 CPUtime=1.05 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 819 0 0 0 67 38 0 0 17 0 4 0 654596475 243130368 3022 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670328 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=237432 CPUtime=1.12 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 590 0 0 0 80 32 0 0 18 0 4 0 654596475 243130368 3022 33554432000 4194304 4964800 140735302177312 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3.97
Current children cumulated vsize (KiB) 237432

[startup+3.10065 s]
/proc/loadavg: 4.91 7.05 5.97 6/399 4865
/proc/meminfo: memFree=24185760/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=240416 CPUtime=10.36 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 5864 0 0 0 946 90 0 0 25 0 4 0 654596473 246185984 5492 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321097 0 0 4096 18946 18446744073709551615 0 0 17 4 0 0 0
/proc/4860/statm: 60104 5492 458 189 0 54453 0
[pid=4860/tid=4862] ppid=4858 vsize=240416 CPUtime=2.58 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 914 0 0 0 248 10 0 0 18 0 4 0 654596475 246185984 5492 33554432000 4194304 4964800 140735302177312 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=240416 CPUtime=2.64 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 1912 0 0 0 224 40 0 0 20 0 4 0 654596475 246185984 5492 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669479 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=240416 CPUtime=2.72 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 1185 0 0 0 240 32 0 0 21 0 4 0 654596475 246185984 5492 33554432000 4194304 4964800 140735302177312 18446744073709551615 4653304 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.36
Current children cumulated vsize (KiB) 240416

[startup+6.3011 s]
/proc/loadavg: 4.99 7.03 5.97 6/402 4871
/proc/meminfo: memFree=23730264/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=243728 CPUtime=21.91 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 8190 0 0 0 2048 143 0 0 17 0 4 0 654596473 249577472 7818 33554432000 4194304 4964800 140735302177312 18446744073709551615 4658589 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 60932 7818 460 189 0 55281 0
[pid=4860/tid=4862] ppid=4858 vsize=243728 CPUtime=5.59 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 1520 0 0 0 548 11 0 0 18 0 4 0 654596475 249577472 7818 33554432000 4194304 4964800 140735302177312 18446744073709551615 4668773 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=243728 CPUtime=5.11 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 2792 0 0 0 466 45 0 0 25 0 4 0 654596475 249577472 7818 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=243728 CPUtime=5.75 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 1576 0 0 0 510 65 0 0 18 0 4 0 654596475 249577472 7818 33554432000 4194304 4964800 140735302177312 18446744073709551615 242970593463 0 0 4096 18946 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 21.91
Current children cumulated vsize (KiB) 243728

[startup+12.7022 s]
/proc/loadavg: 5.07 7.02 5.97 6/402 4871
/proc/meminfo: memFree=23637360/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=245268 CPUtime=43.21 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 10003 0 0 0 4036 285 0 0 20 0 4 0 654596473 251154432 9550 33554432000 4194304 4964800 140735302177312 18446744073709551615 242970593463 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 61317 9550 460 189 0 55666 0
[pid=4860/tid=4862] ppid=4858 vsize=245268 CPUtime=11.86 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 2188 0 0 0 1132 54 0 0 20 0 4 0 654596475 251154432 9550 33554432000 4194304 4964800 140735302177312 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=245268 CPUtime=9.2 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 3357 0 0 0 815 105 0 0 20 0 4 0 654596475 251154432 9550 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=245268 CPUtime=10.4 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 1849 0 0 0 947 93 0 0 25 0 4 0 654596475 251154432 9550 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 43.21
Current children cumulated vsize (KiB) 245268

[startup+25.5008 s]
/proc/loadavg: 5.43 7.00 5.98 9/405 4874
/proc/meminfo: memFree=23290128/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=248040 CPUtime=91.61 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 13287 0 0 0 8721 440 0 0 25 0 4 0 654596473 253992960 12834 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321102 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 62010 12834 460 189 0 56359 0
[pid=4860/tid=4862] ppid=4858 vsize=248040 CPUtime=24.45 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 2772 0 0 0 2362 83 0 0 25 0 4 0 654596475 253992960 12834 33554432000 4194304 4964800 140735302177312 18446744073709551615 4653426 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=248040 CPUtime=21.84 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 5120 0 0 0 1965 219 0 0 25 0 4 0 654596475 253992960 12834 33554432000 4194304 4964800 140735302177312 18446744073709551615 4653216 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=248040 CPUtime=21 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 2335 0 0 0 1997 103 0 0 25 0 4 0 654596475 253992960 12834 33554432000 4194304 4964800 140735302177312 18446744073709551615 4653186 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 91.61
Current children cumulated vsize (KiB) 248040

[startup+51.1004 s]
/proc/loadavg: 6.36 7.09 6.04 9/405 4875
/proc/meminfo: memFree=23266820/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=251120 CPUtime=193.67 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 17664 0 0 0 18924 443 0 0 25 0 4 0 654596473 257146880 17208 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670340 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 62780 17208 460 189 0 57129 0
[pid=4860/tid=4862] ppid=4858 vsize=251120 CPUtime=50.05 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 3520 0 0 0 4921 84 0 0 25 0 4 0 654596475 257146880 17208 33554432000 4194304 4964800 140735302177312 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=251120 CPUtime=47.44 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 7668 0 0 0 4524 220 0 0 25 0 4 0 654596475 257146880 17208 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=251120 CPUtime=46.6 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 2660 0 0 0 4556 104 0 0 25 0 4 0 654596475 257146880 17208 33554432000 4194304 4964800 140735302177312 18446744073709551615 4325336 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 193.67
Current children cumulated vsize (KiB) 251120

[startup+102.316 s]
/proc/loadavg: 7.33 7.25 6.14 9/405 4876
/proc/meminfo: memFree=23239388/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=257848 CPUtime=397.84 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 21899 0 0 0 39337 447 0 0 25 0 4 0 654596473 264036352 21431 33554432000 4194304 4964800 140735302177312 18446744073709551615 4675546 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 64462 21431 460 189 0 58811 0
[pid=4860/tid=4862] ppid=4858 vsize=257848 CPUtime=101.25 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 3906 0 0 0 10041 84 0 0 25 0 4 0 654596475 264036352 21431 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=257848 CPUtime=98.66 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 10056 0 0 0 9644 222 0 0 25 0 4 0 654596475 264036352 21431 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670640 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=257848 CPUtime=97.79 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 2772 0 0 0 9674 105 0 0 25 0 4 0 654596475 264036352 21431 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321010 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 397.84
Current children cumulated vsize (KiB) 257848

[startup+162.3 s]
/proc/loadavg: 7.86 7.41 6.27 9/405 4878
/proc/meminfo: memFree=23203764/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=259336 CPUtime=636.98 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 27146 0 0 0 63246 452 0 0 25 0 4 0 654596473 265560064 26655 33554432000 4194304 4964800 140735302177312 18446744073709551615 4644876 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 64834 26655 460 189 0 59183 0
[pid=4860/tid=4862] ppid=4858 vsize=259336 CPUtime=161.23 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 4633 0 0 0 16038 85 0 0 25 0 4 0 654596475 265560064 26655 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670530 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=259336 CPUtime=158.64 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 12917 0 0 0 15640 224 0 0 25 0 4 0 654596475 265560064 26655 33554432000 4194304 4964800 140735302177312 18446744073709551615 4320944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=259336 CPUtime=157.75 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 3569 0 0 0 15668 107 0 0 25 0 4 0 654596475 265560064 26655 33554432000 4194304 4964800 140735302177312 18446744073709551615 4668987 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 636.98
Current children cumulated vsize (KiB) 259336

[startup+222.301 s]
/proc/loadavg: 8.02 7.53 6.38 9/405 4879
/proc/meminfo: memFree=23172640/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=268828 CPUtime=876.18 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 29964 0 0 0 87164 454 0 0 25 0 4 0 654596473 275279872 29460 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670299 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 67207 29460 460 189 0 61556 0
[pid=4860/tid=4862] ppid=4858 vsize=268828 CPUtime=221.22 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 5250 0 0 0 22037 85 0 0 25 0 4 0 654596475 275279872 29460 33554432000 4194304 4964800 140735302177312 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=268828 CPUtime=218.64 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 14391 0 0 0 21640 224 0 0 25 0 4 0 654596475 275279872 29460 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=268828 CPUtime=217.72 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 4271 0 0 0 21664 108 0 0 25 0 4 0 654596475 275279872 29460 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 876.18
Current children cumulated vsize (KiB) 268828

[startup+282.301 s]

################
# More data... #
################

[pid=4860] ppid=4858 vsize=271656 CPUtime=2550.64 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 39070 0 0 0 254588 476 0 0 25 0 4 0 654596473 278175744 38204 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670310 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 67914 38204 460 189 0 62263 0
[pid=4860/tid=4862] ppid=4858 vsize=271656 CPUtime=641.19 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 7643 0 0 0 64031 88 0 0 25 0 4 0 654596475 278175744 38204 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=271656 CPUtime=638.66 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 18362 0 0 0 63638 228 0 0 25 0 4 0 654596475 278175744 38204 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=271656 CPUtime=637.55 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 6108 0 0 0 63635 120 0 0 25 0 4 0 654596475 278175744 38204 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669011 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2550.64
Current children cumulated vsize (KiB) 271656

[startup+702.3 s]
/proc/loadavg: 8.03 7.98 7.07 9/405 4892
/proc/meminfo: memFree=22814676/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=272580 CPUtime=2789.81 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 42027 0 0 0 278501 480 0 0 25 0 4 0 654596473 279121920 41155 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669509 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 68145 41155 460 189 0 62494 0
[pid=4860/tid=4862] ppid=4858 vsize=272580 CPUtime=701.17 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 8609 0 0 0 70028 89 0 0 25 0 4 0 654596475 279121920 41155 33554432000 4194304 4964800 140735302177312 18446744073709551615 4320951 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=272580 CPUtime=698.64 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 19555 0 0 0 69635 229 0 0 25 0 4 0 654596475 279121920 41155 33554432000 4194304 4964800 140735302177312 18446744073709551615 4362944 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=272580 CPUtime=697.51 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 6451 0 0 0 69629 122 0 0 25 0 4 0 654596475 279121920 41155 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2789.81
Current children cumulated vsize (KiB) 272580

[startup+762.315 s]
/proc/loadavg: 8.01 7.98 7.13 9/405 4894
/proc/meminfo: memFree=22775716/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=278392 CPUtime=3029.06 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 43880 0 0 0 302423 483 0 0 25 0 4 0 654596473 285073408 42924 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670295 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 69598 42924 460 189 0 63947 0
[pid=4860/tid=4862] ppid=4858 vsize=278392 CPUtime=761.17 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 8644 0 0 0 76028 89 0 0 25 0 4 0 654596475 285073408 42924 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=278392 CPUtime=758.65 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 21148 0 0 0 75635 230 0 0 25 0 4 0 654596475 285073408 42924 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=278392 CPUtime=757.49 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 6650 0 0 0 75625 124 0 0 25 0 4 0 654596475 285073408 42924 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3029.06
Current children cumulated vsize (KiB) 278392

[startup+822.301 s]
/proc/loadavg: 8.10 8.01 7.18 9/405 4895
/proc/meminfo: memFree=22738380/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=278392 CPUtime=3268.22 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 44055 0 0 0 326337 485 0 0 25 0 4 0 654596473 285073408 43093 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670225 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/4860/statm: 69598 43093 460 189 0 63947 0
[pid=4860/tid=4862] ppid=4858 vsize=278392 CPUtime=821.16 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 8813 0 0 0 82026 90 0 0 25 0 4 0 654596475 285073408 43093 33554432000 4194304 4964800 140735302177312 18446744073709551615 4653507 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=278392 CPUtime=818.64 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 21148 0 0 0 81634 230 0 0 25 0 4 0 654596475 285073408 43093 33554432000 4194304 4964800 140735302177312 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=278392 CPUtime=817.46 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 6652 0 0 0 81621 125 0 0 25 0 4 0 654596475 285073408 43093 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3268.22
Current children cumulated vsize (KiB) 278392

[startup+882.3 s]
/proc/loadavg: 8.07 8.02 7.24 9/405 4897
/proc/meminfo: memFree=22700300/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=278392 CPUtime=3507.41 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 44284 0 0 0 350255 486 0 0 25 0 4 0 654596473 285073408 43315 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669086 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4860/statm: 69598 43315 460 189 0 63947 0
[pid=4860/tid=4862] ppid=4858 vsize=278392 CPUtime=880.46 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 9031 0 0 0 87956 90 0 0 25 0 4 0 654596475 285073408 43315 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=278392 CPUtime=878.64 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 21154 0 0 0 87634 230 0 0 25 0 4 0 654596475 285073408 43315 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670343 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=278392 CPUtime=877.42 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 6653 0 0 0 87616 126 0 0 25 0 4 0 654596475 285073408 43315 33554432000 4194304 4964800 140735302177312 18446744073709551615 242970205537 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3507.41
Current children cumulated vsize (KiB) 278392

[startup+942.301 s]
/proc/loadavg: 8.17 8.06 7.30 9/405 4898
/proc/meminfo: memFree=22666816/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=278392 CPUtime=3746.62 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 44303 0 0 0 374174 488 0 0 25 0 4 0 654596473 285073408 43325 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4860/statm: 69598 43325 460 189 0 63947 0
[pid=4860/tid=4862] ppid=4858 vsize=278392 CPUtime=939.7 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 9045 0 0 0 93880 90 0 0 25 0 4 0 654596475 285073408 43325 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669085 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=278392 CPUtime=938.64 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 21159 0 0 0 93634 230 0 0 25 0 4 0 654596475 285073408 43325 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669338 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=278392 CPUtime=937.4 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 6653 0 0 0 93612 128 0 0 25 0 4 0 654596475 285073408 43325 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3746.62
Current children cumulated vsize (KiB) 278392

[startup+1002.3 s]
/proc/loadavg: 8.25 8.09 7.35 9/405 4900
/proc/meminfo: memFree=22635304/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=278392 CPUtime=3985.82 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 44516 0 0 0 398093 489 0 0 25 0 4 0 654596473 285073408 43514 33554432000 4194304 4964800 140735302177312 18446744073709551615 4653334 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4860/statm: 69598 43514 460 189 0 63947 0
[pid=4860/tid=4862] ppid=4858 vsize=278392 CPUtime=998.92 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 9175 0 0 0 99802 90 0 0 25 0 4 0 654596475 285073408 43514 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670499 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=278392 CPUtime=998.64 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 21159 0 0 0 99634 230 0 0 25 0 4 0 654596475 285073408 43514 33554432000 4194304 4964800 140735302177312 18446744073709551615 4320872 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=278392 CPUtime=997.37 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 6658 0 0 0 99608 129 0 0 25 0 4 0 654596475 285073408 43514 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321023 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3985.82
Current children cumulated vsize (KiB) 278392

[startup+1062.3 s]
/proc/loadavg: 8.34 8.14 7.41 9/405 4902
/proc/meminfo: memFree=22593988/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=278392 CPUtime=4225.02 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 45139 0 0 0 422009 493 0 0 25 0 4 0 654596473 285073408 44111 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4860/statm: 69598 44111 460 189 0 63947 0
[pid=4860/tid=4862] ppid=4858 vsize=278392 CPUtime=1058.16 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 9260 0 0 0 105726 90 0 0 25 0 4 0 654596475 285073408 44111 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=278392 CPUtime=1058.65 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 21260 0 0 0 105634 231 0 0 25 0 4 0 654596475 285073408 44111 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=278392 CPUtime=1057.34 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 7089 0 0 0 105602 132 0 0 25 0 4 0 654596475 285073408 44111 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669333 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4225.02
Current children cumulated vsize (KiB) 278392

[startup+1122.3 s]
/proc/loadavg: 8.26 8.14 7.46 9/405 4903
/proc/meminfo: memFree=22557408/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=279492 CPUtime=4464.23 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 47216 0 0 0 445926 497 0 0 25 0 4 0 654596473 286199808 46180 33554432000 4194304 4964800 140735302177312 18446744073709551615 4668797 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4860/statm: 69873 46180 460 189 0 64222 0
[pid=4860/tid=4862] ppid=4858 vsize=279492 CPUtime=1117.39 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 9552 0 0 0 111648 91 0 0 25 0 4 0 654596475 286199808 46180 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321079 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=279492 CPUtime=1118.65 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 22969 0 0 0 111633 232 0 0 25 0 4 0 654596475 286199808 46180 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670538 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=279492 CPUtime=1117.32 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 7147 0 0 0 111599 133 0 0 25 0 4 0 654596475 286199808 46180 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669532 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4464.23
Current children cumulated vsize (KiB) 279492

[startup+1182.3 s]
/proc/loadavg: 8.16 8.13 7.49 9/405 4905
/proc/meminfo: memFree=22537928/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=279492 CPUtime=4703.45 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 48298 0 0 0 469845 500 0 0 25 0 4 0 654596473 286199808 47254 33554432000 4194304 4964800 140735302177312 18446744073709551615 4669568 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4860/statm: 69873 47254 460 189 0 64222 0
[pid=4860/tid=4862] ppid=4858 vsize=279492 CPUtime=1176.63 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 9595 0 0 0 117572 91 0 0 25 0 4 0 654596475 286199808 47254 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=279492 CPUtime=1178.65 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 23904 0 0 0 117632 233 0 0 25 0 4 0 654596475 286199808 47254 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=279492 CPUtime=1177.3 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 7233 0 0 0 117595 135 0 0 25 0 4 0 654596475 286199808 47254 33554432000 4194304 4964800 140735302177312 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4703.45
Current children cumulated vsize (KiB) 279492



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1206.6 s]
/proc/loadavg: 8.10 8.12 7.50 10/405 4906
/proc/meminfo: memFree=22536440/32951132 swapFree=67093844/67111528
[pid=4860] ppid=4858 vsize=279492 CPUtime=4800.37 cores=0,2,4,6
/proc/4860/stat : 4860 (claspmt) R 4858 4860 29580 0 -1 4202496 48393 0 0 0 479536 501 0 0 25 0 4 0 654596473 286199808 47338 33554432000 4194304 4964800 140735302177312 18446744073709551615 4312158 0 0 4096 18946 18446744073709551615 0 0 17 0 0 0 0
/proc/4860/statm: 69873 47338 460 189 0 64222 0
[pid=4860/tid=4862] ppid=4858 vsize=279492 CPUtime=1200.62 cores=0,2,4,6
/proc/4860/task/4862/stat : 4862 (claspmt) R 4858 4860 29580 0 -1 4202560 9690 0 0 0 119971 91 0 0 25 0 4 0 654596475 286199808 47338 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321016 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=4860/tid=4863] ppid=4858 vsize=279492 CPUtime=1202.97 cores=0,2,4,6
/proc/4860/task/4863/stat : 4863 (claspmt) R 4858 4860 29580 0 -1 4202560 23904 0 0 0 120064 233 0 0 25 0 4 0 654596475 286199808 47338 33554432000 4194304 4964800 140735302177312 18446744073709551615 4684107 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=4860/tid=4864] ppid=4858 vsize=279492 CPUtime=1201.6 cores=0,2,4,6
/proc/4860/task/4864/stat : 4864 (claspmt) R 4858 4860 29580 0 -1 4202560 7233 0 0 0 120025 135 0 0 25 0 4 0 654596475 286199808 47338 33554432000 4194304 4964800 140735302177312 18446744073709551615 4321102 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.37
Current children cumulated vsize (KiB) 279492

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1206.66
CPU time (s): 4800.45
CPU user time (s): 4795.43
CPU system time (s): 5.02424
CPU usage (%): 397.829
Max. virtual memory (cumulated for all children) (KiB): 279492

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.43
system time used= 5.02424
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 48405
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 26110
involuntary context switches= 20656

runsolver used 4.45032 second user time and 10.9393 second system time

The end

Launcher Data 

Begin job on node128 at 2011-05-15 05:26:18
IDJOB=3373522
IDBENCH=84237
IDSOLVER=1853
FILE ID=node128/3373522-1305429978
RUNJOBID= node128-1305429978-4846
PBS_JOBID= 13324542
Free space on /tmp= 73620 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT03/industrial/kukula/addm_bench/am_7_7.shuffled-as.sat03-363.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373522-1305429978/watcher-3373522-1305429978 -o /tmp/evaluation-result-3373522-1305429978/solver-3373522-1305429978 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373522-1305429978.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c7f51e1ee7556440ab29e1c4bfe29538
RANDOM SEED=989581607

node128.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5434.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      24238160 kB
Buffers:        274984 kB
Cached:        2889412 kB
SwapCached:       1440 kB
Active:        6344568 kB
Inactive:      2078108 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      24238160 kB
SwapTotal:    67111528 kB
SwapFree:     67093844 kB
Dirty:            1188 kB
Writeback:           0 kB
AnonPages:     5257060 kB
Mapped:          31408 kB
Slab:           187416 kB
PageTables:      38220 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 100674548 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73556 MiB
End job on node128 at 2011-05-15 05:46:27