Trace number 1776628

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (TO) 2703.65 1000.08

General information on the benchmark

Namemizh-md5-47-3.cnf
MD5SUM3bb585fcdaeb772457dbcffd3371aab9
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark468.76
Satisfiable
(Un)Satisfiability was proved
Number of variables65604
Number of clauses273522
Sum of the clauses size814950
Maximum clause length4
Minimum clause length1
Number of clauses of size 1199
Number of clauses of size 2118260
Number of clauses of size 342021
Number of clauses of size 4113042
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

1.72/1.78	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1776628-1243675302.cnf 
1.72/1.78	c Using SATTIMEOUT of 10000
1.72/1.78	c Using SATRAM of 2047
1.72/1.78	c Size of subset node = 16
1.72/1.78	c Variables = 65604
1.72/1.78	c Clauses = 273522
1.72/1.78	c Literals = 814950
1.72/1.78	c Reduced size:
1.72/1.78	c Variables = 65604
1.72/1.78	c Clauses = 233457
1.72/1.78	c Literals = 672889
1.72/1.78	c a2
2.32/2.32	c a1
44.48/44.55	c Independent sub-problems = 1
44.48/44.55	c Sub-problem with 60256 variables and 233457 clauses
44.48/44.55	c using permutation method 4
44.48/44.55	c count = 1
44.48/44.55	c Ordering finished 44.410 seconds
44.48/44.55	c mapped 44.520 seconds
44.48/44.55	c permuted 44.520 seconds
44.48/44.55	c about to sort
44.58/44.63	c sorted
45.88/45.96	c clauses now 233457
45.88/45.96	c init finished 44.990 seconds
45.88/45.96	c tree built 45.930 seconds
45.88/45.96	c 
45.88/45.96	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
45.88/45.96	c ---------------------------------|----------------------------------|------------------------------------------------------
45.88/45.96	c ................................ | ..........                       |                       45.9           0.0             
45.88/45.96	c ................................ | ..........                     1 |                       45.9           0.0             
45.88/45.96	c ................................ | ..........                     2 |                       45.9           0.0             
45.88/45.96	c ................................ | ..........                     3 |                       45.9           0.1             
45.88/45.96	c ................................ | ..........                     4 |                       45.9           0.1             
45.88/45.96	c ................................ | ..........                     5 |                       45.9           0.1             
45.88/45.96	c ................................ | ..........                  1000 |                       45.9          21.8            5
200.33/109.30	c ................................ | ..........               3655000 | 57633                200.3       18244.9      1464909
399.98/188.62	c ................................ | ..........               6704000 | 145001               400.0       16759.6      3172448
599.93/255.75	c ................................ | ..........              11903000 | 290711               600.0       19837.0      5342606
799.88/322.85	c ................................ | ..........              17963000 | 467172               800.0       22453.5      7282874
999.94/389.85	c ................................ | *.........              22558000 | 595809              1000.1       22556.6     10151560
1199.87/457.01	c ................................ | *.........              26061000 | 725189              1200.2       21714.8     12958019
1399.74/524.30	c ................................ | *.........              29429000 | 843807              1400.0       21020.6     16864359
1599.81/591.60	c ................................ | *.........              32702000 | 959922              1600.0       20438.1     20447007
1799.89/658.56	c ................................ | *.........              35984000 | 1080724             1800.0       19990.7     23692272
2000.11/725.91	c ................................ | **........              39092000 | 1192285             2000.1       19544.9     26774446

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1776628-1243675302/watcher-1776628-1243675302 -o /tmp/evaluation-result-1776628-1243675302/solver-1776628-1243675302 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1776628-1243675302.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 6.38 6.41 5.48 4/117 26902
/proc/meminfo: memFree=3082996/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=1712 CPUtime=0.02
/proc/26902/stat : 26902 (ttsth-5-0) R 26900 26902 10612 0 -1 4202496 315 0 0 0 2 0 0 0 19 0 1 0 1132193091 1753088 271 4294967295 134512640 135237372 3218258032 3218257480 134732614 0 0 0 0 0 0 0 17 0 0 0 0
/proc/26902/statm: 428 271 75 177 0 250 0

[startup+0.022329 s]
/proc/loadavg: 6.38 6.41 5.48 4/117 26902
/proc/meminfo: memFree=3082996/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=1996 CPUtime=0.03
/proc/26902/stat : 26902 (ttsth-5-0) R 26900 26902 10612 0 -1 4202496 379 0 0 0 3 0 0 0 19 0 1 0 1132193091 2043904 335 4294967295 134512640 135237372 3218258032 3218257664 134536395 0 0 0 0 0 0 0 17 0 0 0 0
/proc/26902/statm: 499 335 75 177 0 321 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 1996

[startup+0.112335 s]
/proc/loadavg: 6.38 6.41 5.48 4/117 26902
/proc/meminfo: memFree=3082996/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=5956 CPUtime=0.12
/proc/26902/stat : 26902 (ttsth-5-0) R 26900 26902 10612 0 -1 4202496 1358 0 0 0 12 0 0 0 21 0 1 0 1132193091 6098944 1314 4294967295 134512640 135237372 3218258032 3218256828 134639534 0 0 0 0 0 0 0 17 0 0 0 0
/proc/26902/statm: 1489 1315 75 177 0 1311 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 5956

[startup+0.312312 s]
/proc/loadavg: 6.38 6.41 5.48 4/117 26902
/proc/meminfo: memFree=3082996/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=14860 CPUtime=0.32
/proc/26902/stat : 26902 (ttsth-5-0) R 26900 26902 10612 0 -1 4202496 3503 0 0 0 32 0 0 0 22 0 1 0 1132193091 15216640 3459 4294967295 134512640 135237372 3218258032 3218256556 134639534 0 0 0 0 0 0 0 17 0 0 0 0
/proc/26902/statm: 3715 3459 75 177 0 3537 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 14860

[startup+0.712291 s]
/proc/loadavg: 6.38 6.41 5.48 4/117 26902
/proc/meminfo: memFree=3082996/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=21552 CPUtime=0.72
/proc/26902/stat : 26902 (ttsth-5-0) R 26900 26902 10612 0 -1 4202496 5102 0 0 0 71 1 0 0 25 0 1 0 1132193091 22069248 5058 4294967295 134512640 135237372 3218258032 3218257724 134534397 0 0 0 0 0 0 0 17 0 0 0 0
/proc/26902/statm: 5388 5058 75 177 0 5210 0
Current children cumulated CPU time (s) 0.72
Current children cumulated vsize (KiB) 21552

[startup+1.51225 s]
/proc/loadavg: 6.38 6.41 5.48 4/118 26904
/proc/meminfo: memFree=3063608/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=21552 CPUtime=1.52
/proc/26902/stat : 26902 (ttsth-5-0) R 26900 26902 10612 0 -1 4202496 5102 0 0 0 151 1 0 0 25 0 1 0 1132193091 22069248 5058 4294967295 134512640 135237372 3218258032 3218257724 134534243 0 0 0 0 0 0 0 17 0 0 0 0
/proc/26902/statm: 5388 5058 75 177 0 5210 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 21552

[startup+3.11217 s]
/proc/loadavg: 6.38 6.41 5.48 4/118 26908
/proc/meminfo: memFree=3041776/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=46228 CPUtime=3.12
/proc/26902/stat : 26902 (ttsth-5-0) R 26900 26902 10612 0 -1 4202496 12073 0 0 0 310 2 0 0 25 0 1 0 1132193091 47337472 11219 4294967295 134512640 135237372 3218258032 3218257360 134555272 0 0 0 0 0 0 0 17 0 0 0 0
/proc/26902/statm: 11557 11219 77 177 0 11379 0
Current children cumulated CPU time (s) 3.12
Current children cumulated vsize (KiB) 46228

[startup+6.312 s]
/proc/loadavg: 6.11 6.36 5.47 4/118 26912
/proc/meminfo: memFree=3037568/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=46888 CPUtime=6.32
/proc/26902/stat : 26902 (ttsth-5-0) R 26900 26902 10612 0 -1 4202496 12241 0 0 0 630 2 0 0 25 0 1 0 1132193091 48013312 11387 4294967295 134512640 135237372 3218258032 3218257160 134732614 0 0 0 0 0 0 0 17 0 0 0 0
/proc/26902/statm: 11722 11387 77 177 0 11544 0
Current children cumulated CPU time (s) 6.32
Current children cumulated vsize (KiB) 46888

[startup+12.7117 s]
/proc/loadavg: 5.86 6.30 5.46 4/118 26920
/proc/meminfo: memFree=3036144/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=48324 CPUtime=12.72
/proc/26902/stat : 26902 (ttsth-5-0) R 26900 26902 10612 0 -1 4202496 12547 0 0 0 1270 2 0 0 25 0 1 0 1132193091 49483776 11693 4294967295 134512640 135237372 3218258032 3218257392 134600738 0 0 0 0 0 0 0 17 0 0 0 0
/proc/26902/statm: 12081 11693 77 177 0 11903 0
Current children cumulated CPU time (s) 12.72
Current children cumulated vsize (KiB) 48324

[startup+25.511 s]
/proc/loadavg: 5.23 6.14 5.42 4/118 26941
/proc/meminfo: memFree=3035604/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=48456 CPUtime=25.52
/proc/26902/stat : 26902 (ttsth-5-0) R 26900 26902 10612 0 -1 4202496 12577 0 0 0 2550 2 0 0 25 0 1 0 1132193091 49618944 11723 4294967295 134512640 135237372 3218258032 3218257392 134600972 0 0 0 0 0 0 0 17 0 0 0 0
/proc/26902/statm: 12114 11723 77 177 0 11936 0
Current children cumulated CPU time (s) 25.52
Current children cumulated vsize (KiB) 48456

[startup+51.1097 s]
/proc/loadavg: 4.79 5.95 5.37 7/122 27166
/proc/meminfo: memFree=2809840/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=298036 CPUtime=56.19
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 69750 0 0 0 5604 15 0 0 25 0 5 0 1132193091 305188864 68083 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 74509 68083 95 177 0 74331 0
[pid=26902/tid=27159] ppid=26900 vsize=298036 CPUtime=3.81
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 650 0 0 0 380 1 0 0 25 0 5 0 1132197688 305188864 68083 4294967295 134512640 135237372 3218258032 3071747552 134561510 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=298036 CPUtime=1.34
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 1333 0 0 0 134 0 0 0 25 0 5 0 1132197688 305188864 68083 4294967295 134512640 135237372 3218258032 3062577164 134636641 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=298036 CPUtime=2.48
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 1055 0 0 0 248 0 0 0 25 0 5 0 1132197689 305188864 68083 4294967295 134512640 135237372 3218258032 3054004992 134591065 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=298036 CPUtime=2.63
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 1108 0 0 0 262 1 0 0 25 0 5 0 1132197689 305188864 68083 4294967295 134512640 135237372 3218258032 3046156960 134591304 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 56.19
Current children cumulated vsize (KiB) 298036

[startup+102.307 s]
/proc/loadavg: 5.56 5.99 5.41 7/122 27246
/proc/meminfo: memFree=2778572/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=330236 CPUtime=182.91
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 77644 0 0 0 18267 24 0 0 25 0 5 0 1132193091 338161664 75977 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 82559 75977 95 177 0 82381 0
[pid=26902/tid=27159] ppid=26900 vsize=330236 CPUtime=29.24
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 3272 0 0 0 2923 1 0 0 25 0 5 0 1132197688 338161664 75977 4294967295 134512640 135237372 3218258032 3070057136 134550994 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=330236 CPUtime=26.87
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 3104 0 0 0 2681 6 0 0 25 0 5 0 1132197688 338161664 75977 4294967295 134512640 135237372 3218258032 3063837740 134636382 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=330236 CPUtime=31.95
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 2556 0 0 0 3194 1 0 0 25 0 5 0 1132197689 338161664 75977 4294967295 134512640 135237372 3218258032 3054395808 134591065 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=330236 CPUtime=48.92
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 3108 0 0 0 4889 3 0 0 25 0 5 0 1132197689 338161664 75977 4294967295 134512640 135237372 3218258032 3047081776 134680257 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 182.91
Current children cumulated vsize (KiB) 330236

[startup+162.314 s]
/proc/loadavg: 6.15 6.09 5.48 8/122 27522
/proc/meminfo: memFree=2755308/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=355012 CPUtime=332.48
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 83473 0 0 0 33218 30 0 0 25 0 5 0 1132193091 363532288 81806 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 88753 81806 95 177 0 88575 0
[pid=26902/tid=27159] ppid=26900 vsize=355012 CPUtime=59.25
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 5546 0 0 0 5923 2 0 0 25 0 5 0 1132197688 363532288 81806 4294967295 134512640 135237372 3218258032 3070718704 134590501 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=355012 CPUtime=61.61
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 4328 0 0 0 6154 7 0 0 25 0 5 0 1132197688 363532288 81806 4294967295 134512640 135237372 3218258032 3063220416 134680474 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=355012 CPUtime=66.81
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 3463 0 0 0 6679 2 0 0 25 0 5 0 1132197689 363532288 81806 4294967295 134512640 135237372 3218258032 3053903984 134680322 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=355012 CPUtime=98.88
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 4532 0 0 0 9882 6 0 0 25 0 5 0 1132197689 363532288 81806 4294967295 134512640 135237372 3218258032 3046045624 134728901 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 332.48
Current children cumulated vsize (KiB) 355012

[startup+222.311 s]
/proc/loadavg: 6.25 6.14 5.54 8/122 27802
/proc/meminfo: memFree=2729012/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=381176 CPUtime=500.73
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 89959 0 0 0 50035 38 0 0 25 0 5 0 1132193091 390324224 88292 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 95294 88292 95 177 0 95116 0
[pid=26902/tid=27159] ppid=26900 vsize=381176 CPUtime=108.08
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 7904 0 0 0 10804 4 0 0 25 0 5 0 1132197688 390324224 88292 4294967295 134512640 135237372 3218258032 3069782768 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=381176 CPUtime=91.41
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 6468 0 0 0 9133 8 0 0 25 0 5 0 1132197688 390324224 88292 4294967295 134512640 135237372 3218258032 3062718464 134588397 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=381176 CPUtime=126.3
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 4757 0 0 0 12628 2 0 0 25 0 5 0 1132197689 390324224 88292 4294967295 134512640 135237372 3218258032 3053793888 134588776 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=381176 CPUtime=129.01
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 5226 0 0 0 12890 11 0 0 25 0 5 0 1132197689 390324224 88292 4294967295 134512640 135237372 3218258032 3045368844 134680214 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 500.73
Current children cumulated vsize (KiB) 381176

[startup+282.308 s]
/proc/loadavg: 6.45 6.23 5.60 7/122 28078
/proc/meminfo: memFree=2698508/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=413392 CPUtime=679.4
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 97638 0 0 0 67891 49 0 0 25 0 5 0 1132193091 423313408 95971 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 103348 95971 95 177 0 103170 0
[pid=26902/tid=27159] ppid=26900 vsize=413392 CPUtime=167.74
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 11171 0 0 0 16769 5 0 0 25 0 5 0 1132197688 423313408 95971 4294967295 134512640 135237372 3218258032 3070201216 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=413392 CPUtime=120.91
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 8622 0 0 0 12081 10 0 0 25 0 5 0 1132197688 423313408 95971 4294967295 134512640 135237372 3218258032 3062787276 134549950 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=413392 CPUtime=175.4
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 6060 0 0 0 17536 4 0 0 25 0 5 0 1132197689 423313408 95972 4294967295 134512640 135237372 3218258032 3055381920 134591065 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=413392 CPUtime=169.42
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 6181 0 0 0 16925 17 0 0 25 0 5 0 1132197689 423313408 95972 4294967295 134512640 135237372 3218258032 3045316972 134680502 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 679.4
Current children cumulated vsize (KiB) 413392

[startup+342.304 s]
/proc/loadavg: 6.49 6.28 5.66 7/122 28352
/proc/meminfo: memFree=2666956/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=447012 CPUtime=858.18
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 105700 0 0 0 85755 63 0 0 25 0 5 0 1132193091 457740288 104033 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 111753 104033 95 177 0 111575 0
[pid=26902/tid=27159] ppid=26900 vsize=447012 CPUtime=227.5
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 15406 0 0 0 22743 7 0 0 25 0 5 0 1132197688 457740288 104033 4294967295 134512640 135237372 3218258032 3070887824 134680229 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=447012 CPUtime=172.44
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 10622 0 0 0 17233 11 0 0 25 0 5 0 1132197688 457740288 104033 4294967295 134512640 135237372 3218258032 3062306336 134590129 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=447012 CPUtime=213.18
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 7152 0 0 0 21309 9 0 0 25 0 5 0 1132197689 457740288 104034 4294967295 134512640 135237372 3218258032 3054876972 134680506 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=447012 CPUtime=199.13
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 6916 0 0 0 19890 23 0 0 25 0 5 0 1132197689 457740288 104034 4294967295 134512640 135237372 3218258032 3046101968 134749345 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 858.18

################
# More data... #
################

[pid=26902/tid=27160] ppid=26900 vsize=536036 CPUtime=248.87
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 15315 0 0 0 24870 17 0 0 25 0 5 0 1132197688 548900864 125292 4294967295 134512640 135237372 3218258032 3062907536 134680270 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=536036 CPUtime=315
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 11359 0 0 0 31484 16 0 0 25 0 5 0 1132197689 548900864 125292 4294967295 134512640 135237372 3218258032 3054988768 134551002 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=536036 CPUtime=259.13
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 9466 0 0 0 25880 33 0 0 25 0 5 0 1132197689 548900864 125292 4294967295 134512640 135237372 3218258032 3045886688 134680343 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1216.02
Current children cumulated vsize (KiB) 536036

[startup+522.315 s]
/proc/loadavg: 6.50 6.42 5.82 8/122 29183
/proc/meminfo: memFree=2525196/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=596028 CPUtime=1394.08
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 141036 0 0 0 139301 107 0 0 25 0 5 0 1132193091 610332672 139369 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 149007 139369 95 177 0 148829 0
[pid=26902/tid=27159] ppid=26900 vsize=596028 CPUtime=407.03
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 31416 0 0 0 40684 19 0 0 25 0 5 0 1132197688 610332672 139369 4294967295 134512640 135237372 3218258032 3070520992 134591099 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=596028 CPUtime=307
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 19604 0 0 0 30675 25 0 0 25 0 5 0 1132197688 610332672 139369 4294967295 134512640 135237372 3218258032 3062425980 134549950 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=596028 CPUtime=345.39
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 12690 0 0 0 34523 16 0 0 25 0 5 0 1132197689 610332672 139369 4294967295 134512640 135237372 3218258032 3054303456 134551717 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=596028 CPUtime=288.73
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 11722 0 0 0 28839 34 0 0 25 0 5 0 1132197689 610332672 139369 4294967295 134512640 135237372 3218258032 3046062176 134561407 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1394.08
Current children cumulated vsize (KiB) 596028

[startup+582.312 s]
/proc/loadavg: 6.50 6.43 5.86 7/122 29464
/proc/meminfo: memFree=2474236/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=650588 CPUtime=1572.31
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 153773 0 0 0 157110 121 0 0 25 0 5 0 1132193091 666202112 152106 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 162647 152106 95 177 0 162469 0
[pid=26902/tid=27159] ppid=26900 vsize=650588 CPUtime=466.96
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 36928 0 0 0 46673 23 0 0 25 0 5 0 1132197688 666202112 152106 4294967295 134512640 135237372 3218258032 3070933888 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=650588 CPUtime=360.18
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 22210 0 0 0 35986 32 0 0 25 0 5 0 1132197688 666202112 152106 4294967295 134512640 135237372 3218258032 3062625296 134592032 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=650588 CPUtime=375.65
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 14373 0 0 0 37547 18 0 0 25 0 5 0 1132197689 666202112 152106 4294967295 134512640 135237372 3218258032 3054360240 134749351 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=650588 CPUtime=323.59
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 14658 0 0 0 32324 35 0 0 25 0 5 0 1132197689 666202112 152106 4294967295 134512640 135237372 3218258032 3045749008 134593221 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1572.31
Current children cumulated vsize (KiB) 650588

[startup+642.309 s]
/proc/loadavg: 6.78 6.51 5.92 7/122 29738
/proc/meminfo: memFree=2427604/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=698896 CPUtime=1751.46
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 165312 0 0 0 175006 140 0 0 25 0 5 0 1132193091 715669504 163645 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 174724 163645 95 177 0 174546 0
[pid=26902/tid=27159] ppid=26900 vsize=698896 CPUtime=526.81
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 42222 0 0 0 52654 27 0 0 25 0 5 0 1132197688 715669504 163645 4294967295 134512640 135237372 3218258032 3070537884 134680208 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=698896 CPUtime=390.12
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 23546 0 0 0 38978 34 0 0 25 0 5 0 1132197688 715669504 163645 4294967295 134512640 135237372 3218258032 3062297148 134680502 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=698896 CPUtime=434.77
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 16692 0 0 0 43455 22 0 0 25 0 5 0 1132197689 715669504 163645 4294967295 134512640 135237372 3218258032 3053909472 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=698896 CPUtime=353.83
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 17248 0 0 0 35339 44 0 0 25 0 5 0 1132197689 715669504 163645 4294967295 134512640 135237372 3218258032 3046398800 134680336 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1751.46
Current children cumulated vsize (KiB) 698896

[startup+702.306 s]
/proc/loadavg: 6.64 6.50 5.95 7/122 30015
/proc/meminfo: memFree=2383220/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=745504 CPUtime=1929.57
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 176273 0 0 0 192805 152 0 0 25 0 5 0 1132193091 763396096 174606 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 186376 174607 95 177 0 186198 0
[pid=26902/tid=27159] ppid=26900 vsize=745504 CPUtime=586.62
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 46860 0 0 0 58632 30 0 0 25 0 5 0 1132197688 763396096 174607 4294967295 134512640 135237372 3218258032 3070435888 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=745504 CPUtime=425.41
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 25790 0 0 0 42501 40 0 0 25 0 5 0 1132197688 763396096 174607 4294967295 134512640 135237372 3218258032 3063040880 134590684 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=745504 CPUtime=487.56
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 18765 0 0 0 48733 23 0 0 25 0 5 0 1132197689 763396096 174607 4294967295 134512640 135237372 3218258032 3054436816 134749343 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=745504 CPUtime=384.05
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 19255 0 0 0 38359 46 0 0 25 0 5 0 1132197689 763396096 174607 4294967295 134512640 135237372 3218258032 3046520064 134749351 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1929.57
Current children cumulated vsize (KiB) 745504

[startup+762.313 s]
/proc/loadavg: 6.50 6.47 5.97 8/123 30279
/proc/meminfo: memFree=2340616/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=790444 CPUtime=2107.84
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 186826 0 0 0 210616 168 0 0 25 0 5 0 1132193091 809414656 185159 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 197611 185159 95 177 0 197433 0
[pid=26902/tid=27159] ppid=26900 vsize=790444 CPUtime=646.52
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 51976 0 0 0 64619 33 0 0 25 0 5 0 1132197688 809414656 185159 4294967295 134512640 135237372 3218258032 3070632128 134552748 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=790444 CPUtime=469.4
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 27478 0 0 0 46894 46 0 0 25 0 5 0 1132197688 809414656 185159 4294967295 134512640 135237372 3218258032 3062230008 134549942 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=790444 CPUtime=524.26
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 19855 0 0 0 52400 26 0 0 25 0 5 0 1132197689 809414656 185159 4294967295 134512640 135237372 3218258032 3053894320 134680480 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=790444 CPUtime=421.73
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 21913 0 0 0 42123 50 0 0 25 0 5 0 1132197689 809414656 185159 4294967295 134512640 135237372 3218258032 3045527296 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2107.84
Current children cumulated vsize (KiB) 790444

[startup+822.319 s]
/proc/loadavg: 6.52 6.48 6.00 9/123 30515
/proc/meminfo: memFree=2307208/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=827400 CPUtime=2252.54
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 195649 0 0 0 225070 184 0 0 25 0 5 0 1132193091 847257600 193982 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 206850 193982 95 177 0 206672 0
[pid=26902/tid=27159] ppid=26900 vsize=827400 CPUtime=705.99
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 56826 0 0 0 70563 36 0 0 25 0 5 0 1132197688 847257600 193982 4294967295 134512640 135237372 3218258032 3069975552 134680467 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=827400 CPUtime=499.51
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 28328 0 0 0 49901 50 0 0 25 0 5 0 1132197688 847257600 193982 4294967295 134512640 135237372 3218258032 3062612848 134680467 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=827400 CPUtime=553.11
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 21180 0 0 0 55280 31 0 0 25 0 5 0 1132197689 847257600 193982 4294967295 134512640 135237372 3218258032 3054744864 134593489 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=827400 CPUtime=448
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 23711 0 0 0 44746 54 0 0 25 0 5 0 1132197689 847257600 193982 4294967295 134512640 135237372 3218258032 3045667904 134561510 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2252.54
Current children cumulated vsize (KiB) 827400

[startup+882.316 s]
/proc/loadavg: 6.47 6.47 6.03 9/123 30742
/proc/meminfo: memFree=2266236/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=871196 CPUtime=2397.54
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 205744 0 0 0 239550 204 0 0 25 0 5 0 1132193091 892104704 204077 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 217799 204077 95 177 0 217621 0
[pid=26902/tid=27159] ppid=26900 vsize=871196 CPUtime=765.93
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 62558 0 0 0 76554 39 0 0 25 0 5 0 1132197688 892104704 204077 4294967295 134512640 135237372 3218258032 3070470368 134680374 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=871196 CPUtime=529.6
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 29234 0 0 0 52904 56 0 0 25 0 5 0 1132197688 892104704 204077 4294967295 134512640 135237372 3218258032 3062632416 134680503 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=871196 CPUtime=578.25
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 22647 0 0 0 57788 37 0 0 25 0 5 0 1132197689 892104704 204077 4294967295 134512640 135237372 3218258032 3054051680 134680290 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=871196 CPUtime=477.83
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 25701 0 0 0 47724 59 0 0 25 0 5 0 1132197689 892104704 204077 4294967295 134512640 135237372 3218258032 3045507168 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2397.54
Current children cumulated vsize (KiB) 871196

[startup+942.313 s]
/proc/loadavg: 6.68 6.55 6.08 7/122 30938
/proc/meminfo: memFree=2230564/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=910596 CPUtime=2540.96
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 214818 0 0 0 253875 221 0 0 25 0 5 0 1132193091 932450304 213151 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 227649 213151 95 177 0 227471 0
[pid=26902/tid=27159] ppid=26900 vsize=910596 CPUtime=825.52
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 67552 0 0 0 82509 43 0 0 25 0 5 0 1132197688 932450304 213151 4294967295 134512640 135237372 3218258032 3070414208 134680720 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=910596 CPUtime=560.11
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 30504 0 0 0 55949 62 0 0 25 0 5 0 1132197688 932450304 213151 4294967295 134512640 135237372 3218258032 3062582716 134680502 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=910596 CPUtime=605.73
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 23533 0 0 0 60533 40 0 0 25 0 5 0 1132197689 932450304 213151 4294967295 134512640 135237372 3218258032 3053954464 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=910596 CPUtime=503.67
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 27625 0 0 0 50304 63 0 0 25 0 5 0 1132197689 932450304 213151 4294967295 134512640 135237372 3218258032 3046152784 134749345 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2540.96
Current children cumulated vsize (KiB) 910596



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 6.56 6.55 6.11 8/124 31217
/proc/meminfo: memFree=2190092/3368532 swapFree=1959840/1959888
[pid=26902] ppid=26900 vsize=952600 CPUtime=2703.54
/proc/26902/stat : 26902 (ttsth-5-0) S 26900 26902 10612 0 -1 4202496 224681 0 0 0 270116 238 0 0 25 0 5 0 1132193091 975462400 223014 4294967295 134512640 135237372 3218258032 3218257628 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/26902/statm: 238150 223014 95 177 0 237972 0
[pid=26902/tid=27159] ppid=26900 vsize=952600 CPUtime=882.71
/proc/26902/task/27159/stat : 27159 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 71778 0 0 0 88225 46 0 0 25 0 5 0 1132197688 975462400 223014 4294967295 134512640 135237372 3218258032 3070554016 134680237 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=26902/tid=27160] ppid=26900 vsize=952600 CPUtime=588.59
/proc/26902/task/27160/stat : 27160 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 31232 0 0 0 58792 67 0 0 25 0 5 0 1132197688 975462400 223014 4294967295 134512640 135237372 3218258032 3063508016 134592187 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27161] ppid=26900 vsize=952600 CPUtime=634.85
/proc/26902/task/27161/stat : 27161 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 24591 0 0 0 63443 42 0 0 25 0 5 0 1132197689 975462400 223014 4294967295 134512640 135237372 3218258032 3055558000 134561443 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=26902/tid=27162] ppid=26900 vsize=952600 CPUtime=551.46
/proc/26902/task/27162/stat : 27162 (ttsth-5-0) R 26900 26902 10612 0 -1 4202560 31476 0 0 0 55076 70 0 0 25 0 5 0 1132197689 975462400 223014 4294967295 134512640 135237372 3218258032 3046304944 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2703.54
Current children cumulated vsize (KiB) 952600

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.08
CPU time (s): 2703.65
CPU user time (s): 2701.22
CPU system time (s): 2.43
CPU usage (%): 270.343
Max. virtual memory (cumulated for all children) (KiB): 952600

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2701.22
system time used= 2.43
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 224681
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1715
involuntary context switches= 91415

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 11:21:42
IDJOB=1776628
IDBENCH=69562
IDSOLVER=632
FILE ID=/1776628-1243675302
PBS_JOBID=
Free space on /tmp= 7977 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT_RACE08/cnf/mizh-md5-47-3.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1776628-1243675302/watcher-1776628-1243675302 -o /tmp/evaluation-result-1776628-1243675302/solver-1776628-1243675302 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1776628-1243675302.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 3bb585fcdaeb772457dbcffd3371aab9
RANDOM SEED= 979044101

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.12
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.073
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3083244 kB
Buffers:         88908 kB
Cached:          81328 kB
SwapCached:          0 kB
Active:         125824 kB
Inactive:        66836 kB
HighTotal:     2489216 kB
HighFree:      2385748 kB
LowTotal:       879316 kB
LowFree:        697496 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:            6384 kB
Writeback:           0 kB
AnonPages:       22220 kB
Mapped:           8060 kB
Slab:            83024 kB
SReclaimable:    70736 kB
SUnreclaim:      12288 kB
PageTables:        768 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   123552 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 7977 MiB
End job on  at 2009-05-30 11:38:25