Trace number 1781023

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (TO) 2229 1000.12

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rpoc_xits_09_UNSAT.cnf
MD5SUMfeb620c17f2a4d7899a2e7883baa7391
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1430
Number of clauses87044
Sum of the clauses size258924
Maximum clause length10
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22369
Number of clauses of size 384652
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data 

0.12/0.14	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781023-1243685151.cnf 
0.12/0.14	c Using SATTIMEOUT of 10000
0.12/0.14	c Using SATRAM of 2047
0.12/0.14	c Size of subset node = 16
0.12/0.14	c Variables = 1430
0.12/0.14	c Clauses = 87044
0.12/0.14	c Literals = 258924
0.12/0.14	c Reduced size:
0.12/0.14	c Variables = 1430
0.12/0.14	c Clauses = 87044
0.12/0.14	c Literals = 258924
0.12/0.14	c a2
0.31/0.37	c a1
0.81/0.80	c Independent sub-problems = 1
0.81/0.80	c Sub-problem with 1430 variables and 87044 clauses
0.81/0.80	c using permutation method 4
0.81/0.80	c count = 1
0.81/0.80	c Ordering finished 0.770 seconds
0.81/0.80	c mapped 0.810 seconds
0.81/0.80	c permuted 0.810 seconds
0.81/0.80	c about to sort
0.81/0.83	c sorted
1.30/1.32	c clauses now 87044
1.30/1.32	c init finished 0.850 seconds
1.30/1.32	c tree built 1.310 seconds
1.30/1.32	c 
1.30/1.32	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
1.30/1.32	c ---------------------------------|----------------------------------|------------------------------------------------------
1.30/1.32	c ................................ | ..........                       |                        1.3           0.0             
1.30/1.32	c ................................ | ..........                     1 |                        1.3           0.8             
1.30/1.32	c ................................ | ..........                     2 |                        1.3           1.5             
1.30/1.32	c ................................ | ..........                     3 |                        1.3           2.3             
1.30/1.32	c ................................ | ..........                     4 |                        1.3           3.1             
1.30/1.32	c ................................ | ..........                     5 |                        1.3           3.8             
1.30/1.32	c ................................ | ..........                  1000 | 7                      1.3         757.6          541
200.04/100.96	c ................................ | ..........               1122000 | 94005                200.2        5605.8     18634954
400.22/200.91	c ................................ | ..........               1792000 | 145630               400.2        4477.2     30958091
599.89/286.59	c ................................ | ..........               2315000 | 189722               600.1        3857.8     41418609
800.03/366.83	c ................................ | ..........               2797000 | 225539               800.1        3495.8     50985381
1000.11/448.06	c ................................ | *.........               3292000 | 254394              1000.3        3291.1     60122901
1200.01/529.20	c ................................ | *.........               3768000 | 283462              1200.2        3139.5     68981153
1399.95/610.93	c ................................ | *.........               4309000 | 325866              1400.1        3077.7     77189010
1599.99/699.82	c ................................ | *.........               4859000 | 375256              1600.0        3036.8     84525779
1800.30/791.23	c ................................ | *.........               5301000 | 418413              1800.3        2944.4     93548855
2000.21/891.30	c ................................ | **........               5664000 | 448274              2000.4        2831.5    100604195

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1781023-1243685151/watcher-1781023-1243685151 -o /tmp/evaluation-result-1781023-1243685151/solver-1781023-1243685151 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781023-1243685151.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 6.53 6.48 5.79 4/104 13128
/proc/meminfo: memFree=2195872/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=1144 CPUtime=0.01
/proc/13128/stat : 13128 (ttsth-5-0) R 13126 13128 2540 0 -1 4202496 191 0 0 0 1 0 0 0 20 0 1 0 1122616214 1171456 147 4294967295 134512640 135237372 3218264176 3218262740 134685152 0 0 0 0 0 0 0 17 0 0 0 0
/proc/13128/statm: 286 147 75 177 0 108 0

[startup+0.115418 s]
/proc/loadavg: 6.53 6.48 5.79 4/104 13128
/proc/meminfo: memFree=2195872/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=5732 CPUtime=0.12
/proc/13128/stat : 13128 (ttsth-5-0) R 13126 13128 2540 0 -1 4202496 1313 0 0 0 11 1 0 0 21 0 1 0 1122616214 5869568 1269 4294967295 134512640 135237372 3218264176 3218263852 134536352 0 0 0 0 0 0 0 17 0 0 0 0
/proc/13128/statm: 1433 1269 75 177 0 1255 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 5732

[startup+0.205413 s]
/proc/loadavg: 6.53 6.48 5.79 4/104 13128
/proc/meminfo: memFree=2195872/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=12680 CPUtime=0.21
/proc/13128/stat : 13128 (ttsth-5-0) R 13126 13128 2540 0 -1 4202496 2972 0 0 0 20 1 0 0 21 0 1 0 1122616214 12984320 2927 4294967295 134512640 135237372 3218264176 3218262608 134680257 0 0 0 0 0 0 0 17 0 0 0 0
/proc/13128/statm: 3170 2927 76 177 0 2992 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 12680

[startup+0.305402 s]
/proc/loadavg: 6.53 6.48 5.79 4/104 13128
/proc/meminfo: memFree=2195872/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=12680 CPUtime=0.31
/proc/13128/stat : 13128 (ttsth-5-0) R 13126 13128 2540 0 -1 4202496 2972 0 0 0 30 1 0 0 21 0 1 0 1122616214 12984320 2927 4294967295 134512640 135237372 3218264176 3218263464 134519986 0 0 0 0 0 0 0 17 0 0 0 0
/proc/13128/statm: 3170 2927 76 177 0 2992 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 12680

[startup+0.705376 s]
/proc/loadavg: 6.53 6.48 5.79 4/104 13128
/proc/meminfo: memFree=2195872/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=13188 CPUtime=0.71
/proc/13128/stat : 13128 (ttsth-5-0) R 13126 13128 2540 0 -1 4202496 3382 0 0 0 70 1 0 0 22 0 1 0 1122616214 13504512 3165 4294967295 134512640 135237372 3218264176 3218263536 134600826 0 0 0 0 0 0 0 17 0 0 0 0
/proc/13128/statm: 3297 3165 77 177 0 3119 0
Current children cumulated CPU time (s) 0.71
Current children cumulated vsize (KiB) 13188

[startup+1.50532 s]
/proc/loadavg: 6.32 6.44 5.78 4/105 13129
/proc/meminfo: memFree=2178408/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=58436 CPUtime=1.65
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 6449 0 0 0 162 3 0 0 25 0 5 0 1122616214 59838464 6060 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 14609 6060 95 177 0 14431 0
Current children cumulated CPU time (s) 1.65
Current children cumulated vsize (KiB) 58436

[startup+3.10522 s]
/proc/loadavg: 6.32 6.44 5.78 7/109 13133
/proc/meminfo: memFree=2169100/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=65264 CPUtime=4.83
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 8263 0 0 0 477 6 0 0 25 0 5 0 1122616214 66830336 7874 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 16316 7874 95 177 0 16138 0
[pid=13128/tid=13130] ppid=13126 vsize=65264 CPUtime=1.16
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 743 0 0 0 116 0 0 0 25 0 5 0 1122616346 66830336 7874 4294967295 134512640 135237372 3218264176 3084964432 134680474 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=65264 CPUtime=0.6
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 428 0 0 0 58 2 0 0 25 0 5 0 1122616346 66830336 7874 4294967295 134512640 135237372 3218264176 3076531800 134636382 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=65264 CPUtime=0.85
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 457 0 0 0 85 0 0 0 25 0 5 0 1122616346 66830336 7874 4294967295 134512640 135237372 3218264176 3068194244 134732614 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=65264 CPUtime=0.91
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 613 0 0 0 90 1 0 0 25 0 5 0 1122616346 66830336 7874 4294967295 134512640 135237372 3218264176 3059781792 134562309 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4.83
Current children cumulated vsize (KiB) 65264

[startup+6.305 s]
/proc/loadavg: 6.30 6.43 5.78 8/109 13133
/proc/meminfo: memFree=2154052/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=80908 CPUtime=11.19
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 11912 0 0 0 1109 10 0 0 25 0 5 0 1122616214 82849792 11523 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 20227 11523 95 177 0 20049 0
[pid=13128/tid=13130] ppid=13126 vsize=80908 CPUtime=2.89
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 1618 0 0 0 286 3 0 0 25 0 5 0 1122616346 82849792 11523 4294967295 134512640 135237372 3218264176 3084956416 134680273 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=80908 CPUtime=2.03
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 1256 0 0 0 201 2 0 0 25 0 5 0 1122616346 82849792 11523 4294967295 134512640 135237372 3218264176 3076539408 134680727 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=80908 CPUtime=2.41
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 1392 0 0 0 240 1 0 0 25 0 5 0 1122616346 82849792 11523 4294967295 134512640 135237372 3218264176 3068192496 134591038 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=80908 CPUtime=2.55
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 1624 0 0 0 254 1 0 0 25 0 5 0 1122616346 82849792 11523 4294967295 134512640 135237372 3218264176 3059806288 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.19
Current children cumulated vsize (KiB) 80908

[startup+12.7046 s]
/proc/loadavg: 6.27 6.42 5.78 7/109 13134
/proc/meminfo: memFree=2128868/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=105256 CPUtime=23.97
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 17789 0 0 0 2383 14 0 0 25 0 5 0 1122616214 107782144 17400 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 26314 17400 95 177 0 26136 0
[pid=13128/tid=13130] ppid=13126 vsize=105256 CPUtime=6.17
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 2899 0 0 0 612 5 0 0 25 0 5 0 1122616346 107782144 17400 4294967295 134512640 135237372 3218264176 3084969552 134550405 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=105256 CPUtime=5.13
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 2516 0 0 0 510 3 0 0 25 0 5 0 1122616346 107782144 17400 4294967295 134512640 135237372 3218264176 3076533872 134590180 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=105256 CPUtime=5.61
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 3102 0 0 0 560 1 0 0 25 0 5 0 1122616346 107782144 17400 4294967295 134512640 135237372 3218264176 3068180512 134561549 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=105256 CPUtime=5.75
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 3250 0 0 0 573 2 0 0 25 0 5 0 1122616346 107782144 17400 4294967295 134512640 135237372 3218264176 3059772160 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 23.97
Current children cumulated vsize (KiB) 105256

[startup+25.5037 s]
/proc/loadavg: 6.29 6.42 5.79 7/109 13134
/proc/meminfo: memFree=2077416/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=157052 CPUtime=49.51
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 30302 0 0 0 4929 22 0 0 25 0 5 0 1122616214 160821248 29913 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 39263 29913 95 177 0 39085 0
[pid=13128/tid=13130] ppid=13126 vsize=157052 CPUtime=13.03
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 6110 0 0 0 1294 9 0 0 25 0 5 0 1122616346 160821248 29913 4294967295 134512640 135237372 3218264176 3084944528 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=157052 CPUtime=11.13
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 5561 0 0 0 1108 5 0 0 25 0 5 0 1122616346 160821248 29913 4294967295 134512640 135237372 3218264176 3076552588 134561392 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=157052 CPUtime=11.61
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 5699 0 0 0 1159 2 0 0 25 0 5 0 1122616346 160821248 29913 4294967295 134512640 135237372 3218264176 3068182880 134749353 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=157052 CPUtime=12.43
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 6910 0 0 0 1240 3 0 0 25 0 5 0 1122616346 160821248 29913 4294967295 134512640 135237372 3218264176 3059799376 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 49.51
Current children cumulated vsize (KiB) 157052

[startup+51.1119 s]
/proc/loadavg: 6.73 6.51 5.83 7/109 13320
/proc/meminfo: memFree=1996944/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=242924 CPUtime=100.7
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 50601 0 0 0 10038 32 0 0 25 0 5 0 1122616214 248754176 50212 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 60731 50212 95 177 0 60553 0
[pid=13128/tid=13130] ppid=13126 vsize=242924 CPUtime=25.91
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 10487 0 0 0 2579 12 0 0 25 0 5 0 1122616346 248754176 50212 4294967295 134512640 135237372 3218264176 3084970144 134590501 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=242924 CPUtime=23.83
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 10633 0 0 0 2374 9 0 0 25 0 5 0 1122616346 248754176 50212 4294967295 134512640 135237372 3218264176 3076549388 134562272 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=242924 CPUtime=24.24
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 11173 0 0 0 2421 3 0 0 25 0 5 0 1122616346 248754176 50212 4294967295 134512640 135237372 3218264176 3068160384 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=242924 CPUtime=25.41
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 12286 0 0 0 2536 5 0 0 25 0 5 0 1122616346 248754176 50212 4294967295 134512640 135237372 3218264176 3059788208 134680270 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 100.7
Current children cumulated vsize (KiB) 242924

[startup+102.308 s]
/proc/loadavg: 6.96 6.57 5.89 8/109 13506
/proc/meminfo: memFree=1875620/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=368776 CPUtime=202.84
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 80298 0 0 0 20219 65 0 0 25 0 5 0 1122616214 377626624 79909 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 92194 79909 95 177 0 92016 0
[pid=13128/tid=13130] ppid=13126 vsize=368776 CPUtime=51.64
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 17479 0 0 0 5138 26 0 0 25 0 5 0 1122616346 377626624 79909 4294967295 134512640 135237372 3218264176 3084957296 134562351 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=368776 CPUtime=49.03
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 18426 0 0 0 4884 19 0 0 25 0 5 0 1122616346 377626624 79909 4294967295 134512640 135237372 3218264176 3076551968 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=368776 CPUtime=49.75
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 18940 0 0 0 4968 7 0 0 25 0 5 0 1122616346 377626624 79909 4294967295 134512640 135237372 3218264176 3068196672 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=368776 CPUtime=51.11
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 19431 0 0 0 5101 10 0 0 25 0 5 0 1122616346 377626624 79909 4294967295 134512640 135237372 3218264176 3059760992 134749345 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 202.84
Current children cumulated vsize (KiB) 368776

[startup+162.304 s]
/proc/loadavg: 6.85 6.58 5.93 9/110 13663
/proc/meminfo: memFree=1756356/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=494692 CPUtime=323.05
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 110068 0 0 0 32216 89 0 0 25 0 5 0 1122616214 506564608 109679 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 123673 109679 95 177 0 123495 0
[pid=13128/tid=13130] ppid=13126 vsize=494692 CPUtime=81.95
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 25426 0 0 0 8163 32 0 0 25 0 5 0 1122616346 506564608 109679 4294967295 134512640 135237372 3218264176 3084937568 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=494692 CPUtime=78.85
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 24512 0 0 0 7862 23 0 0 25 0 5 0 1122616346 506564608 109679 4294967295 134512640 135237372 3218264176 3076543136 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=494692 CPUtime=79.91
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 26879 0 0 0 7976 15 0 0 25 0 5 0 1122616346 506564608 109679 4294967295 134512640 135237372 3218264176 3068175888 134551745 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=494692 CPUtime=81.03
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 27229 0 0 0 8087 16 0 0 25 0 5 0 1122616346 506564608 109679 4294967295 134512640 135237372 3218264176 3059771904 134562363 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 323.05
Current children cumulated vsize (KiB) 494692

[startup+222.31 s]
/proc/loadavg: 6.89 6.60 5.97 8/110 13878
/proc/meminfo: memFree=1647840/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=608264 CPUtime=443.04
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 136973 0 0 0 44195 109 0 0 25 0 5 0 1122616214 622862336 136584 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 152066 136584 95 177 0 151888 0
[pid=13128/tid=13130] ppid=13126 vsize=608264 CPUtime=112.05
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 33286 0 0 0 11168 37 0 0 25 0 5 0 1122616346 622862336 136584 4294967295 134512640 135237372 3218264176 3084965664 134680474 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=608264 CPUtime=108.85
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 30128 0 0 0 10856 29 0 0 25 0 5 0 1122616346 622862336 136584 4294967295 134512640 135237372 3218264176 3076548668 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=608264 CPUtime=109.82
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 34264 0 0 0 10962 20 0 0 25 0 5 0 1122616346 622862336 136584 4294967295 134512640 135237372 3218264176 3068151360 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=608264 CPUtime=111.01
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 33273 0 0 0 11081 20 0 0 25 0 5 0 1122616346 622862336 136584 4294967295 134512640 135237372 3218264176 3059792368 134562351 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 443.04
Current children cumulated vsize (KiB) 608264


################
# More data... #
################

[pid=13128/tid=13131] ppid=13126 vsize=1186676 CPUtime=283.8
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 66109 0 0 0 28327 53 0 0 25 0 5 0 1122616346 1215156224 273526 4294967295 134512640 135237372 3218264176 3076548176 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=1186676 CPUtime=287.01
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 68263 0 0 0 28656 45 0 0 25 0 5 0 1122616346 1215156224 273526 4294967295 134512640 135237372 3218264176 3068159232 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=1186676 CPUtime=351.86
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 65996 0 0 0 35154 32 0 0 25 0 5 0 1122616346 1215156224 273526 4294967295 134512640 135237372 3218264176 3059781472 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1185.54
Current children cumulated vsize (KiB) 1186676

[startup+582.305 s]
/proc/loadavg: 6.57 6.59 6.16 7/109 14832
/proc/meminfo: memFree=1002896/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=1285444 CPUtime=1328.76
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 297441 0 0 0 132659 217 0 0 25 0 5 0 1122616214 1316294656 297052 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 321361 297052 95 177 0 321183 0
[pid=13128/tid=13130] ppid=13126 vsize=1285444 CPUtime=291.45
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 75110 0 0 0 29071 74 0 0 25 0 5 0 1122616346 1316294656 297052 4294967295 134512640 135237372 3218264176 3084947712 134680346 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=1285444 CPUtime=336.19
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 74939 0 0 0 33562 57 0 0 25 0 5 0 1122616346 1316294656 297052 4294967295 134512640 135237372 3218264176 3076567808 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=1285444 CPUtime=316.9
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 71555 0 0 0 31642 48 0 0 25 0 5 0 1122616346 1316294656 297052 4294967295 134512640 135237372 3218264176 3068164624 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=1285444 CPUtime=382.91
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 69815 0 0 0 38256 35 0 0 25 0 5 0 1122616346 1316294656 297052 4294967295 134512640 135237372 3218264176 3059762112 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1328.76
Current children cumulated vsize (KiB) 1285444

[startup+642.311 s]
/proc/loadavg: 6.54 6.60 6.19 7/109 15024
/proc/meminfo: memFree=913480/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=1381124 CPUtime=1478.35
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 319790 0 0 0 147599 236 0 0 25 0 5 0 1122616214 1414270976 319401 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 345281 319401 95 177 0 345103 0
[pid=13128/tid=13130] ppid=13126 vsize=1381124 CPUtime=327.45
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 83472 0 0 0 32665 80 0 0 25 0 5 0 1122616346 1414270976 319401 4294967295 134512640 135237372 3218264176 3084937256 134732535 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=1381124 CPUtime=389.67
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 83026 0 0 0 38905 62 0 0 25 0 5 0 1122616346 1414270976 319401 4294967295 134512640 135237372 3218264176 3076548592 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=1381124 CPUtime=347.21
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 74078 0 0 0 34671 50 0 0 25 0 5 0 1122616346 1414270976 319401 4294967295 134512640 135237372 3218264176 3068166096 134562328 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=1381124 CPUtime=412.71
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 73192 0 0 0 41230 41 0 0 25 0 5 0 1122616346 1414270976 319401 4294967295 134512640 135237372 3218264176 3059772208 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1478.35
Current children cumulated vsize (KiB) 1381124

[startup+702.307 s]
/proc/loadavg: 6.32 6.54 6.19 7/109 15214
/proc/meminfo: memFree=838668/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=1460844 CPUtime=1604.98
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 338190 0 0 0 160248 250 0 0 25 0 5 0 1122616214 1495904256 337801 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 365211 337801 95 177 0 365033 0
[pid=13128/tid=13130] ppid=13126 vsize=1460844 CPUtime=357.44
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 89896 0 0 0 35661 83 0 0 25 0 5 0 1122616346 1495904256 337801 4294967295 134512640 135237372 3218264176 3084947144 134732535 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=1460844 CPUtime=422.73
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 88061 0 0 0 42210 63 0 0 25 0 5 0 1122616346 1495904256 337801 4294967295 134512640 135237372 3218264176 3076559200 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=1460844 CPUtime=377.11
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 76792 0 0 0 37656 55 0 0 25 0 5 0 1122616346 1495904256 337801 4294967295 134512640 135237372 3218264176 3068165152 134562401 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=1460844 CPUtime=446.39
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 77419 0 0 0 44593 46 0 0 25 0 5 0 1122616346 1495904256 337801 4294967295 134512640 135237372 3218264176 3059783804 134680208 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1604.98
Current children cumulated vsize (KiB) 1460844

[startup+762.313 s]
/proc/loadavg: 6.39 6.55 6.21 7/109 15403
/proc/meminfo: memFree=736648/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=1566776 CPUtime=1742.54
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 363370 0 0 0 173986 268 0 0 25 0 5 0 1122616214 1604378624 362981 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 391694 362981 95 177 0 391516 0
[pid=13128/tid=13130] ppid=13126 vsize=1566776 CPUtime=387.6
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 95546 0 0 0 38671 89 0 0 25 0 5 0 1122616346 1604378624 362981 4294967295 134512640 135237372 3218264176 3084970892 134519936 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=1566776 CPUtime=470.41
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 94707 0 0 0 46973 68 0 0 25 0 5 0 1122616346 1604378624 362981 4294967295 134512640 135237372 3218264176 3076557008 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=1566776 CPUtime=407.01
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 82337 0 0 0 40644 57 0 0 25 0 5 0 1122616346 1604378624 362981 4294967295 134512640 135237372 3218264176 3068180224 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=1566776 CPUtime=476.21
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 84758 0 0 0 47570 51 0 0 25 0 5 0 1122616346 1604378624 362981 4294967295 134512640 135237372 3218264176 3059782976 134562344 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1742.54
Current children cumulated vsize (KiB) 1566776

[startup+822.319 s]
/proc/loadavg: 6.36 6.53 6.23 7/109 15591
/proc/meminfo: memFree=661892/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=1646256 CPUtime=1862.47
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 382066 0 0 0 185966 281 0 0 25 0 5 0 1122616214 1685766144 381677 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 411564 381677 95 177 0 411386 0
[pid=13128/tid=13130] ppid=13126 vsize=1646256 CPUtime=417.53
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 101273 0 0 0 41662 91 0 0 25 0 5 0 1122616346 1685766144 381677 4294967295 134512640 135237372 3218264176 3084943392 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=1646256 CPUtime=500.43
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 98626 0 0 0 49973 70 0 0 25 0 5 0 1122616346 1685766144 381677 4294967295 134512640 135237372 3218264176 3076555088 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=1646256 CPUtime=436.99
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 86805 0 0 0 43637 62 0 0 25 0 5 0 1122616346 1685766144 381677 4294967295 134512640 135237372 3218264176 3068168400 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=1646256 CPUtime=506.21
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 89340 0 0 0 50566 55 0 0 25 0 5 0 1122616346 1685766144 381677 4294967295 134512640 135237372 3218264176 3059782352 134562309 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1862.47
Current children cumulated vsize (KiB) 1646256

[startup+882.315 s]
/proc/loadavg: 6.45 6.54 6.25 7/109 15778
/proc/meminfo: memFree=596188/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=1714884 CPUtime=1982.41
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 398060 0 0 0 197951 290 0 0 25 0 5 0 1122616214 1756041216 397671 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 428721 397671 95 177 0 428543 0
[pid=13128/tid=13130] ppid=13126 vsize=1714884 CPUtime=447.47
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 106524 0 0 0 44651 96 0 0 25 0 5 0 1122616346 1756041216 397671 4294967295 134512640 135237372 3218264176 3084957552 134562380 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=1714884 CPUtime=530.51
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 102329 0 0 0 52981 70 0 0 25 0 5 0 1122616346 1756041216 397671 4294967295 134512640 135237372 3218264176 3076562976 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=1714884 CPUtime=466.91
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 90485 0 0 0 46626 65 0 0 25 0 5 0 1122616346 1756041216 397671 4294967295 134512640 135237372 3218264176 3068169152 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=1714884 CPUtime=536.21
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 92700 0 0 0 53565 56 0 0 25 0 5 0 1122616346 1756041216 397671 4294967295 134512640 135237372 3218264176 3059797936 134680285 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1982.41
Current children cumulated vsize (KiB) 1714884

[startup+942.311 s]
/proc/loadavg: 6.48 6.53 6.26 7/109 15966
/proc/meminfo: memFree=532852/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=1782384 CPUtime=2102.35
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 413928 0 0 0 209925 310 0 0 25 0 5 0 1122616214 1825161216 413539 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 445596 413539 95 177 0 445418 0
[pid=13128/tid=13130] ppid=13126 vsize=1782384 CPUtime=477.51
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 112186 0 0 0 47645 106 0 0 25 0 5 0 1122616346 1825161216 413539 4294967295 134512640 135237372 3218264176 3084940492 134749296 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=1782384 CPUtime=560.43
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 105642 0 0 0 55972 71 0 0 25 0 5 0 1122616346 1825161216 413539 4294967295 134512640 135237372 3218264176 3076563920 134562328 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=1782384 CPUtime=496.99
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 93496 0 0 0 49631 68 0 0 25 0 5 0 1122616346 1825161216 413539 4294967295 134512640 135237372 3218264176 3068159840 134562317 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=1782384 CPUtime=566.11
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 96582 0 0 0 56549 62 0 0 25 0 5 0 1122616346 1825161216 413539 4294967295 134512640 135237372 3218264176 3059804864 134552720 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2102.35
Current children cumulated vsize (KiB) 1782384



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 6.64 6.56 6.29 8/109 16157
/proc/meminfo: memFree=463220/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=1853636 CPUtime=2228.9
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 431018 0 0 0 222566 324 0 0 25 0 5 0 1122616214 1898123264 430629 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 463409 430629 95 177 0 463231 0
[pid=13128/tid=13130] ppid=13126 vsize=1853636 CPUtime=506.41
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 116990 0 0 0 50529 112 0 0 25 0 5 0 1122616346 1898123264 430629 4294967295 134512640 135237372 3218264176 3084969424 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=1853636 CPUtime=589.33
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 109023 0 0 0 58858 75 0 0 25 0 5 0 1122616346 1898123264 430629 4294967295 134512640 135237372 3218264176 3076563264 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=1853636 CPUtime=525.71
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 97288 0 0 0 52502 69 0 0 25 0 5 0 1122616346 1898123264 430629 4294967295 134512640 135237372 3218264176 3068150656 134562380 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=1853636 CPUtime=606.14
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 101695 0 0 0 60549 65 0 0 25 0 5 0 1122616346 1898123264 430629 4294967295 134512640 135237372 3218264176 3059780800 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2228.9
Current children cumulated vsize (KiB) 1853636

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1000.01 s]
/proc/loadavg: 6.64 6.56 6.29 8/109 16157
/proc/meminfo: memFree=463220/3368532 swapFree=1954076/1959888
[pid=13128] ppid=13126 vsize=1853636 CPUtime=2228.9
/proc/13128/stat : 13128 (ttsth-5-0) S 13126 13128 2540 0 -1 4202496 431018 0 0 0 222566 324 0 0 25 0 5 0 1122616214 1898123264 430629 4294967295 134512640 135237372 3218264176 3218263772 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/13128/statm: 463409 430629 95 177 0 463231 0
[pid=13128/tid=13130] ppid=13126 vsize=1853636 CPUtime=506.41
/proc/13128/task/13130/stat : 13130 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 116990 0 0 0 50529 112 0 0 25 0 5 0 1122616346 1898123264 430629 4294967295 134512640 135237372 3218264176 3084969424 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13131] ppid=13126 vsize=1853636 CPUtime=589.33
/proc/13128/task/13131/stat : 13131 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 109023 0 0 0 58858 75 0 0 25 0 5 0 1122616346 1898123264 430629 4294967295 134512640 135237372 3218264176 3076563264 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=13128/tid=13132] ppid=13126 vsize=1853636 CPUtime=525.71
/proc/13128/task/13132/stat : 13132 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 97288 0 0 0 52502 69 0 0 25 0 5 0 1122616346 1898123264 430629 4294967295 134512640 135237372 3218264176 3068150656 134562380 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=13128/tid=13133] ppid=13126 vsize=1853636 CPUtime=606.14
/proc/13128/task/13133/stat : 13133 (ttsth-5-0) R 13126 13128 2540 0 -1 4202560 101695 0 0 0 60549 65 0 0 25 0 5 0 1122616346 1898123264 430629 4294967295 134512640 135237372 3218264176 3059780800 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2228.9
Current children cumulated vsize (KiB) 1853636

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.12
CPU time (s): 2229
CPU user time (s): 2225.67
CPU system time (s): 3.33
CPU usage (%): 222.874
Max. virtual memory (cumulated for all children) (KiB): 1853636

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2225.67
system time used= 3.33
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 431018
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 467
involuntary context switches= 70115

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on tipi44 at 2009-05-30 14:05:51
IDJOB=1781023
IDBENCH=71089
IDSOLVER=632
FILE ID=tipi44/1781023-1243685151
PBS_JOBID=
Free space on /tmp= 15892 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rpoc_xits_09_UNSAT.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1781023-1243685151/watcher-1781023-1243685151 -o /tmp/evaluation-result-1781023-1243685151/solver-1781023-1243685151 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781023-1243685151.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= feb620c17f2a4d7899a2e7883baa7391
RANDOM SEED= 1283763794

Linux tipi44 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.116
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.116
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.116
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.116
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2196168 kB
Buffers:        128452 kB
Cached:         699492 kB
SwapCached:       2068 kB
Active:         443620 kB
Inactive:       620500 kB
HighTotal:     2489216 kB
HighFree:      1571372 kB
LowTotal:       879316 kB
LowFree:        624796 kB
SwapTotal:     1959888 kB
SwapFree:      1954076 kB
Dirty:            2400 kB
Writeback:           0 kB
AnonPages:      235308 kB
Mapped:           5456 kB
Slab:            97620 kB
SReclaimable:    87412 kB
SUnreclaim:      10208 kB
PageTables:        816 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   318284 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15892 MiB
End job on tipi44 at 2009-05-30 14:22:33