Trace number 3373570

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095-patched (fixed)? (TO) 4800.67 1204.66

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf
MD5SUMa8ad0173824ed9404a8c153da07c5f9c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark938.798
Satisfiable
(Un)Satisfiability was proved
Number of variables183325
Number of clauses546914
Sum of the clauses size1276130
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2364608
Number of clauses of size 3182304
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...421763/instance-3373570-1305421763.cnf
1.49/1.57	c Solving...
4800.27/1204.31	
4800.27/1204.31	*** INTERRUPTED! ***
4800.27/1204.31	*** Shutting down threads...
4800.59/1204.65	s UNKNOWN
4800.59/1204.65	
4800.59/1204.65	c INTERRUPTED   : 1
4800.59/1204.65	c Models        : 0+    
4800.59/1204.65	c Time          : 1204.316s (Solving: 1202.75s 1st Model: 0.00s Unsat: 0.00s)
4800.59/1204.65	c CPU Time      : 4800.310s

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3373570-1305421763/watcher-3373570-1305421763 -o /tmp/evaluation-result-3373570-1305421763/solver-3373570-1305421763 -C 4800 -W 1300 -M 15500 HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373570-1305421763.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.73 8.04 8.02 5/311 15398
/proc/meminfo: memFree=8700888/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=44152 CPUtime=0 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 1284 0 0 0 0 0 0 0 25 0 1 0 653775117 45211648 1214 33554432000 4194304 4964800 140736935133184 18446744073709551615 4700412 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/15398/statm: 11038 1222 375 189 0 5912 0

[startup+0.095553 s]
/proc/loadavg: 7.73 8.04 8.02 5/311 15398
/proc/meminfo: memFree=8700888/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=67952 CPUtime=0.08 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 14524 0 0 0 7 1 0 0 25 0 1 0 653775117 69582848 11872 33554432000 4194304 4964800 140736935133184 18446744073709551615 235594866432 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/15398/statm: 16988 11875 385 189 0 11862 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 67952

[startup+0.100548 s]
/proc/loadavg: 7.73 8.04 8.02 5/311 15398
/proc/meminfo: memFree=8700888/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=68612 CPUtime=0.09 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 14732 0 0 0 8 1 0 0 25 0 1 0 653775117 70258688 12080 33554432000 4194304 4964800 140736935133184 18446744073709551615 235594527429 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/15398/statm: 17153 12081 385 189 0 12027 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 68612

[startup+0.300518 s]
/proc/loadavg: 7.73 8.04 8.02 5/311 15398
/proc/meminfo: memFree=8700888/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=106568 CPUtime=0.29 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 27208 0 0 0 26 3 0 0 25 0 1 0 653775117 109125632 21201 33554432000 4194304 4964800 140736935133184 18446744073709551615 4618467 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/15398/statm: 26642 21201 398 189 0 21516 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 106568

[startup+0.700447 s]
/proc/loadavg: 7.73 8.04 8.02 5/311 15398
/proc/meminfo: memFree=8700888/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=119864 CPUtime=0.69 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 30510 0 0 0 66 3 0 0 25 0 1 0 653775117 122740736 24503 33554432000 4194304 4964800 140736935133184 18446744073709551615 4615743 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/15398/statm: 29966 24503 403 189 0 24840 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 119864

[startup+1.50031 s]
/proc/loadavg: 7.73 8.04 8.02 6/312 15399
/proc/meminfo: memFree=8587924/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=129028 CPUtime=1.49 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 32815 0 0 0 145 4 0 0 25 0 1 0 653775117 132124672 26808 33554432000 4194304 4964800 140736935133184 18446744073709551615 235594527429 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/15398/statm: 32257 26808 405 189 0 27131 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 129028

[startup+3.10103 s]
/proc/loadavg: 7.51 7.99 8.00 9/315 15402
/proc/meminfo: memFree=8523264/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=368444 CPUtime=7.6 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 54570 0 0 0 751 9 0 0 25 0 4 0 653775117 377286656 41294 33554432000 4194304 4964800 140736935133184 18446744073709551615 4669149 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15398/statm: 92111 41294 458 189 0 86460 0
[pid=15398/tid=15400] ppid=15396 vsize=368444 CPUtime=1.51 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 5477 0 0 0 150 1 0 0 25 0 4 0 653775275 377286656 41294 33554432000 4194304 4964800 140736935133184 18446744073709551615 4370264 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=368444 CPUtime=1.52 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 7350 0 0 0 151 1 0 0 20 0 4 0 653775275 377286656 41294 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=368444 CPUtime=1.51 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 7945 0 0 0 150 1 0 0 25 0 4 0 653775275 377286656 41294 33554432000 4194304 4964800 140736935133184 18446744073709551615 4361293 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 7.6
Current children cumulated vsize (KiB) 368444

[startup+6.30047 s]
/proc/loadavg: 7.51 7.99 8.00 9/315 15402
/proc/meminfo: memFree=8500472/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=368444 CPUtime=20.36 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 55396 0 0 0 2026 10 0 0 25 0 4 0 653775117 377286656 42120 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668712 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15398/statm: 92111 42120 458 189 0 86460 0
[pid=15398/tid=15400] ppid=15396 vsize=368444 CPUtime=4.71 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 5619 0 0 0 470 1 0 0 25 0 4 0 653775275 377286656 42120 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670437 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=368444 CPUtime=4.72 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 7725 0 0 0 470 2 0 0 25 0 4 0 653775275 377286656 42120 33554432000 4194304 4964800 140736935133184 18446744073709551615 4669005 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=368444 CPUtime=4.71 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 8220 0 0 0 470 1 0 0 25 0 4 0 653775275 377286656 42120 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 20.36
Current children cumulated vsize (KiB) 368444

[startup+12.7003 s]
/proc/loadavg: 7.59 7.99 8.00 9/315 15402
/proc/meminfo: memFree=8470120/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=368444 CPUtime=45.89 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 56866 0 0 0 4577 12 0 0 25 0 4 0 653775117 377286656 43590 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15398/statm: 92111 43590 458 189 0 86460 0
[pid=15398/tid=15400] ppid=15396 vsize=368444 CPUtime=11.1 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 5756 0 0 0 1109 1 0 0 25 0 4 0 653775275 377286656 43590 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=368444 CPUtime=11.12 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 8340 0 0 0 1109 3 0 0 25 0 4 0 653775275 377286656 43590 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=368444 CPUtime=11.11 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 8874 0 0 0 1109 2 0 0 25 0 4 0 653775275 377286656 43590 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 45.89
Current children cumulated vsize (KiB) 368444

[startup+25.5011 s]
/proc/loadavg: 7.65 7.99 8.00 9/315 15402
/proc/meminfo: memFree=8457344/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=369512 CPUtime=96.96 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 59885 0 0 0 9682 14 0 0 25 0 4 0 653775117 378380288 46609 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668712 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15398/statm: 92378 46609 458 189 0 86727 0
[pid=15398/tid=15400] ppid=15396 vsize=369512 CPUtime=23.9 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 6007 0 0 0 2389 1 0 0 25 0 4 0 653775275 378380288 46609 33554432000 4194304 4964800 140736935133184 18446744073709551615 4370229 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=369512 CPUtime=23.92 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 10051 0 0 0 2387 5 0 0 25 0 4 0 653775275 378380288 46609 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668789 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=369512 CPUtime=23.92 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 9841 0 0 0 2389 3 0 0 25 0 4 0 653775275 378380288 46609 33554432000 4194304 4964800 140736935133184 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 96.96
Current children cumulated vsize (KiB) 369512

[startup+51.1006 s]
/proc/loadavg: 7.61 7.96 7.99 10/315 15464
/proc/meminfo: memFree=14239712/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=372020 CPUtime=199.1 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 63295 0 0 0 19891 19 0 0 25 0 4 0 653775117 380948480 50019 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15398/statm: 93005 50019 460 189 0 87354 0
[pid=15398/tid=15400] ppid=15396 vsize=372020 CPUtime=49.49 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 6117 0 0 0 4948 1 0 0 25 0 4 0 653775275 380948480 50019 33554432000 4194304 4964800 140736935133184 18446744073709551615 4669276 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=372020 CPUtime=49.52 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 11604 0 0 0 4945 7 0 0 25 0 4 0 653775275 380948480 50019 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668712 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=372020 CPUtime=49.51 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 11443 0 0 0 4947 4 0 0 25 0 4 0 653775275 380948480 50019 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668568 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 199.1
Current children cumulated vsize (KiB) 372020

[startup+102.312 s]
/proc/loadavg: 7.88 7.97 7.99 10/315 15465
/proc/meminfo: memFree=14100736/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=388532 CPUtime=403.41 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 77891 0 0 0 40306 35 0 0 25 0 4 0 653775117 397856768 64615 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670340 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15398/statm: 97133 64615 460 189 0 91482 0
[pid=15398/tid=15400] ppid=15396 vsize=388532 CPUtime=100.69 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 7562 0 0 0 10065 4 0 0 25 0 4 0 653775275 397856768 64615 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=388532 CPUtime=100.72 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 19515 0 0 0 10058 14 0 0 25 0 4 0 653775275 397856768 64615 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=388532 CPUtime=100.72 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 15173 0 0 0 10063 9 0 0 25 0 4 0 653775275 397856768 64615 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 403.41
Current children cumulated vsize (KiB) 388532

[startup+162.301 s]
/proc/loadavg: 7.99 7.99 8.00 10/315 15467
/proc/meminfo: memFree=13973080/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=396588 CPUtime=642.77 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 88955 0 0 0 64229 48 0 0 25 0 4 0 653775117 406106112 75679 33554432000 4194304 4964800 140736935133184 18446744073709551615 4370266 0 0 4096 18946 18446744073709551615 0 0 17 6 0 0 0
/proc/15398/statm: 99147 75679 460 189 0 93496 0
[pid=15398/tid=15400] ppid=15396 vsize=396588 CPUtime=160.68 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 8201 0 0 0 16063 5 0 0 25 0 4 0 653775275 406106112 75679 33554432000 4194304 4964800 140736935133184 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=396588 CPUtime=160.72 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 27125 0 0 0 16048 24 0 0 25 0 4 0 653775275 406106112 75679 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670346 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=396588 CPUtime=160.71 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 17283 0 0 0 16060 11 0 0 25 0 4 0 653775275 406106112 75679 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 642.77
Current children cumulated vsize (KiB) 396588

[startup+222.301 s]
/proc/loadavg: 8.07 8.02 8.00 9/315 15469
/proc/meminfo: memFree=13857208/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=469176 CPUtime=882.17 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 101141 0 0 0 88155 62 0 0 25 0 4 0 653775117 480436224 87863 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 117294 87863 460 189 0 111643 0
[pid=15398/tid=15400] ppid=15396 vsize=469176 CPUtime=220.35 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 9249 0 0 0 22029 6 0 0 25 0 4 0 653775275 480436224 87863 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668737 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=469176 CPUtime=220.72 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 34878 0 0 0 22041 31 0 0 25 0 4 0 653775275 480436224 87863 33554432000 4194304 4964800 140736935133184 18446744073709551615 4320928 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=469176 CPUtime=220.72 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 19365 0 0 0 22057 15 0 0 25 0 4 0 653775275 480436224 87863 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 882.17
Current children cumulated vsize (KiB) 469176

[startup+282.301 s]
/proc/loadavg: 8.09 8.04 8.01 9/315 15470
/proc/meminfo: memFree=13701912/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=487000 CPUtime=1121.56 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 113638 0 0 0 112082 74 0 0 25 0 4 0 653775117 498688000 100355 33554432000 4194304 4964800 140736935133184 18446744073709551615 4321079 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 121750 100355 460 189 0 116099 0
[pid=15398/tid=15400] ppid=15396 vsize=487000 CPUtime=279.75 cores=0,2,4,6

################
# More data... #
################

Current children cumulated CPU time (s) 2557.94
Current children cumulated vsize (KiB) 712688

[startup+702.301 s]
/proc/loadavg: 8.09 8.08 8.02 10/315 15481
/proc/meminfo: memFree=13269092/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=712688 CPUtime=2797.32 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 151239 0 0 0 279614 118 0 0 25 0 4 0 653775117 729792512 137757 33554432000 4194304 4964800 140736935133184 18446744073709551615 4669280 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 178172 137757 460 189 0 172521 0
[pid=15398/tid=15400] ppid=15396 vsize=712688 CPUtime=695.55 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 13452 0 0 0 69545 10 0 0 25 0 4 0 653775275 729792512 137757 33554432000 4194304 4964800 140736935133184 18446744073709551615 4320872 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=712688 CPUtime=700.73 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 63914 0 0 0 70007 66 0 0 25 0 4 0 653775275 729792512 137757 33554432000 4194304 4964800 140736935133184 18446744073709551615 4320909 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=712688 CPUtime=700.72 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 30031 0 0 0 70049 23 0 0 25 0 4 0 653775275 729792512 137757 33554432000 4194304 4964800 140736935133184 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2797.32
Current children cumulated vsize (KiB) 712688

[startup+762.312 s]
/proc/loadavg: 8.08 8.08 8.02 10/315 15483
/proc/meminfo: memFree=13208528/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=724656 CPUtime=3036.76 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 158413 0 0 0 303548 128 0 0 25 0 4 0 653775117 742047744 144931 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670180 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 181164 144931 460 189 0 175513 0
[pid=15398/tid=15400] ppid=15396 vsize=724656 CPUtime=754.96 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 13470 0 0 0 75486 10 0 0 25 0 4 0 653775275 742047744 144931 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=724656 CPUtime=760.74 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 66899 0 0 0 76006 68 0 0 25 0 4 0 653775275 742047744 144931 33554432000 4194304 4964800 140736935133184 18446744073709551615 4660157 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=724656 CPUtime=760.73 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 34202 0 0 0 76043 30 0 0 25 0 4 0 653775275 742047744 144931 33554432000 4194304 4964800 140736935133184 18446744073709551615 4669350 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3036.76
Current children cumulated vsize (KiB) 724656

[startup+822.301 s]
/proc/loadavg: 8.12 8.09 8.03 9/315 15485
/proc/meminfo: memFree=13133988/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=725100 CPUtime=3276.11 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 165906 0 0 0 327474 137 0 0 25 0 4 0 653775117 742502400 152424 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668675 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 181275 152424 460 189 0 175624 0
[pid=15398/tid=15400] ppid=15396 vsize=725100 CPUtime=814.35 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 13611 0 0 0 81425 10 0 0 25 0 4 0 653775275 742502400 152424 33554432000 4194304 4964800 140736935133184 18446744073709551615 4653515 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=725100 CPUtime=820.73 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 70521 0 0 0 82000 73 0 0 25 0 4 0 653775275 742502400 152424 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=725100 CPUtime=820.73 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 37918 0 0 0 82038 35 0 0 25 0 4 0 653775275 742502400 152424 33554432000 4194304 4964800 140736935133184 18446744073709551615 4654683 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3276.11
Current children cumulated vsize (KiB) 725100

[startup+882.301 s]
/proc/loadavg: 8.08 8.08 8.03 9/315 15486
/proc/meminfo: memFree=13028316/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=887720 CPUtime=3515.5 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 183496 0 0 0 351394 156 0 0 25 0 4 0 653775117 909025280 170014 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670534 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 221930 170014 460 189 0 216279 0
[pid=15398/tid=15400] ppid=15396 vsize=887720 CPUtime=873.75 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 18268 0 0 0 87357 18 0 0 25 0 4 0 653775275 909025280 170014 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=887720 CPUtime=880.73 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 79277 0 0 0 87994 79 0 0 25 0 4 0 653775275 909025280 170014 33554432000 4194304 4964800 140736935133184 18446744073709551615 4320970 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=887720 CPUtime=880.72 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 39809 0 0 0 88035 37 0 0 25 0 4 0 653775275 909025280 170014 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668737 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3515.5
Current children cumulated vsize (KiB) 887720

[startup+942.301 s]
/proc/loadavg: 8.12 8.10 8.03 9/315 15488
/proc/meminfo: memFree=12991196/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=890592 CPUtime=3754.9 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 184940 0 0 0 375333 157 0 0 25 0 4 0 653775117 911966208 171387 33554432000 4194304 4964800 140736935133184 18446744073709551615 4684107 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 222648 171387 460 189 0 216997 0
[pid=15398/tid=15400] ppid=15396 vsize=890592 CPUtime=933.16 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 18906 0 0 0 93297 19 0 0 25 0 4 0 653775275 911966208 171387 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=890592 CPUtime=940.73 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 79602 0 0 0 93994 79 0 0 25 0 4 0 653775275 911966208 171387 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670310 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=890592 CPUtime=940.73 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 39810 0 0 0 94036 37 0 0 25 0 4 0 653775275 911966208 171387 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3754.9
Current children cumulated vsize (KiB) 890592

[startup+1002.3 s]
/proc/loadavg: 8.08 8.09 8.03 9/315 15489
/proc/meminfo: memFree=12940680/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=911300 CPUtime=3994.29 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 193502 0 0 0 399264 165 0 0 25 0 4 0 653775117 933171200 179949 33554432000 4194304 4964800 140736935133184 18446744073709551615 4338784 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 227825 179949 460 189 0 222174 0
[pid=15398/tid=15400] ppid=15396 vsize=911300 CPUtime=992.55 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 21045 0 0 0 99235 20 0 0 25 0 4 0 653775275 933171200 179949 33554432000 4194304 4964800 140736935133184 18446744073709551615 4669509 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=911300 CPUtime=1000.73 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 82736 0 0 0 99992 81 0 0 25 0 4 0 653775275 933171200 179949 33554432000 4194304 4964800 140736935133184 18446744073709551615 4313761 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=911300 CPUtime=1000.73 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 43095 0 0 0 100031 42 0 0 25 0 4 0 653775275 933171200 179949 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3994.29
Current children cumulated vsize (KiB) 911300

[startup+1062.3 s]
/proc/loadavg: 8.10 8.10 8.04 9/315 15491
/proc/meminfo: memFree=12857684/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=923772 CPUtime=4233.69 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 202269 0 0 0 423195 174 0 0 25 0 4 0 653775117 945942528 188634 33554432000 4194304 4964800 140736935133184 18446744073709551615 4669350 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 230943 188634 460 189 0 225292 0
[pid=15398/tid=15400] ppid=15396 vsize=923772 CPUtime=1051.95 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 21472 0 0 0 105175 20 0 0 25 0 4 0 653775275 945942528 188634 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670308 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=923772 CPUtime=1060.73 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 84571 0 0 0 105992 81 0 0 25 0 4 0 653775275 945942528 188634 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=923772 CPUtime=1060.73 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 45787 0 0 0 106029 44 0 0 25 0 4 0 653775275 945942528 188634 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668734 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4233.69
Current children cumulated vsize (KiB) 923772

[startup+1122.3 s]
/proc/loadavg: 8.04 8.08 8.03 9/315 15493
/proc/meminfo: memFree=12767120/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=945044 CPUtime=4473.08 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 209820 0 0 0 447128 180 0 0 25 0 4 0 653775117 967725056 196185 33554432000 4194304 4964800 140736935133184 18446744073709551615 4669479 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 236261 196185 460 189 0 230610 0
[pid=15398/tid=15400] ppid=15396 vsize=945044 CPUtime=1111.36 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 21516 0 0 0 111115 21 0 0 25 0 4 0 653775275 967725056 196185 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=945044 CPUtime=1120.74 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 84787 0 0 0 111992 82 0 0 25 0 4 0 653775275 967725056 196185 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=945044 CPUtime=1120.73 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 51021 0 0 0 112025 48 0 0 25 0 4 0 653775275 967725056 196185 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670180 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4473.08
Current children cumulated vsize (KiB) 945044

[startup+1182.3 s]
/proc/loadavg: 8.04 8.08 8.03 9/315 15494
/proc/meminfo: memFree=12738432/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=945544 CPUtime=4712.47 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 211779 0 0 0 471065 182 0 0 25 0 4 0 653775117 968237056 198141 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670346 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 236386 198141 460 189 0 230735 0
[pid=15398/tid=15400] ppid=15396 vsize=945544 CPUtime=1170.76 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 21665 0 0 0 117055 21 0 0 25 0 4 0 653775275 968237056 198141 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=945544 CPUtime=1180.74 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 84862 0 0 0 117992 82 0 0 25 0 4 0 653775275 968237056 198141 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670299 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=945544 CPUtime=1180.73 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 52755 0 0 0 118023 50 0 0 25 0 4 0 653775275 968237056 198141 33554432000 4194304 4964800 140736935133184 18446744073709551615 4342174 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4712.47
Current children cumulated vsize (KiB) 945544



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.3 s]
/proc/loadavg: 8.03 8.07 8.03 9/315 15495
/proc/meminfo: memFree=12733588/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=945544 CPUtime=4800.27 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 211811 0 0 0 479845 182 0 0 25 0 4 0 653775117 968237056 198173 33554432000 4194304 4964800 140736935133184 18446744073709551615 4670308 0 0 4096 18946 18446744073709551615 0 0 17 2 0 0 0
/proc/15398/statm: 236386 198173 460 189 0 230735 0
[pid=15398/tid=15400] ppid=15396 vsize=945544 CPUtime=1192.54 cores=0,2,4,6
/proc/15398/task/15400/stat : 15400 (claspmt) R 15396 15398 15036 0 -1 4202560 21665 0 0 0 119233 21 0 0 25 0 4 0 653775275 968237056 198173 33554432000 4194304 4964800 140736935133184 18446744073709551615 4320865 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=15398/tid=15401] ppid=15396 vsize=945544 CPUtime=1202.76 cores=0,2,4,6
/proc/15398/task/15401/stat : 15401 (claspmt) R 15396 15398 15036 0 -1 4202560 84894 0 0 0 120194 82 0 0 25 0 4 0 653775275 968237056 198173 33554432000 4194304 4964800 140736935133184 18446744073709551615 4669276 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=15398/tid=15402] ppid=15396 vsize=945544 CPUtime=1202.74 cores=0,2,4,6
/proc/15398/task/15402/stat : 15402 (claspmt) R 15396 15398 15036 0 -1 4202560 52755 0 0 0 120224 50 0 0 25 0 4 0 653775275 968237056 198173 33554432000 4194304 4964800 140736935133184 18446744073709551615 4668737 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.27
Current children cumulated vsize (KiB) 945544

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.6 s]
/proc/loadavg: 8.03 8.07 8.03 6/313 15496
/proc/meminfo: memFree=12756048/32950928 swapFree=67111348/67111528
[pid=15398] ppid=15396 vsize=905256 CPUtime=4800.59 cores=0,2,4,6
/proc/15398/stat : 15398 (claspmt) R 15396 15398 15036 0 -1 4202496 211822 0 0 0 479877 182 0 0 25 0 1 0 653775117 926982144 187972 33554432000 4194304 4964800 140736935133184 18446744073709551615 235594521953 0 0 4096 18946 0 0 0 17 2 0 0 0
/proc/15398/statm: 226314 187972 470 189 0 220663 0
Current children cumulated CPU time (s) 4800.59
Current children cumulated vsize (KiB) 905256

Child status: 0
Real time (s): 1204.66
CPU time (s): 4800.67
CPU user time (s): 4798.81
CPU system time (s): 1.86072
CPU usage (%): 398.507
Max. virtual memory (cumulated for all children) (KiB): 945544

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.81
system time used= 1.86072
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 211824
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2306
involuntary context switches= 20917

runsolver used 3.39848 second user time and 8.66668 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-15 03:09:24
IDJOB=3373570
IDBENCH=82481
IDSOLVER=1853
FILE ID=node120/3373570-1305421763
RUNJOBID= node120-1305419310-15054
PBS_JOBID= 13324572
Free space on /tmp= 73368 MiB

SOLVER NAME= claspmt 2.0-R4095-patched (fixed)
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtvisns3p00-tseitin.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3373570-1305421763/watcher-3373570-1305421763 -o /tmp/evaluation-result-3373570-1305421763/solver-3373570-1305421763 -C 4800 -W 1300 -M 15500  HOME/claspmt -t4 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3373570-1305421763.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a8ad0173824ed9404a8c153da07c5f9c
RANDOM SEED=744343941

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       8701044 kB
Buffers:        221648 kB
Cached:        1452928 kB
SwapCached:          0 kB
Active:       22304072 kB
Inactive:      1655124 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       8701044 kB
SwapTotal:    67111528 kB
SwapFree:     67111348 kB
Dirty:           10592 kB
Writeback:           0 kB
AnonPages:    22284028 kB
Mapped:          25420 kB
Slab:           169120 kB
PageTables:      60460 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 57389252 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73488 MiB
End job on node120 at 2011-05-15 03:29:30