Trace number 1781188

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 2694.12 675.828

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rpoc_xits_11_UNKNOWN.cnf
MD5SUMe0639bbed56c8b8c34616f8cb99c381c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1740
Number of clauses114011
Sum of the clauses size339448
Maximum clause length12
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22792
Number of clauses of size 3111196
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data 

0.10/0.17	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781188-1243685595.cnf 
0.10/0.17	c Using SATTIMEOUT of 10000
0.10/0.17	c Using SATRAM of 2047
0.10/0.17	c Size of subset node = 16
0.10/0.17	c Variables = 1740
0.10/0.17	c Clauses = 114011
0.10/0.17	c Literals = 339448
0.10/0.17	c Reduced size:
0.10/0.17	c Variables = 1740
0.10/0.17	c Clauses = 114011
0.10/0.17	c Literals = 339448
0.10/0.17	c a2
0.40/0.46	c a1
1.01/1.01	c Independent sub-problems = 1
1.01/1.01	c Sub-problem with 1740 variables and 114011 clauses
1.01/1.01	c using permutation method 4
1.01/1.01	c count = 1
1.01/1.01	c Ordering finished 0.970 seconds
1.01/1.01	c mapped 1.020 seconds
1.01/1.01	c permuted 1.020 seconds
1.01/1.01	c about to sort
1.01/1.05	c sorted
1.60/1.67	c clauses now 114011
1.60/1.67	c init finished 1.080 seconds
1.60/1.67	c tree built 1.670 seconds
1.60/1.67	c 
1.60/1.67	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
1.60/1.67	c ---------------------------------|----------------------------------|------------------------------------------------------
1.60/1.67	c ................................ | ..........                       |                        1.7           0.0             
1.60/1.67	c ................................ | ..........                     1 |                        1.7           0.6             
1.60/1.67	c ................................ | ..........                     2 |                        1.7           1.2             
1.60/1.67	c ................................ | ..........                     3 |                        1.7           1.8             
1.60/1.67	c ................................ | ..........                     4 |                        1.7           2.4             
1.60/1.67	c ................................ | ..........                     5 |                        1.7           3.0             
1.60/1.67	c ................................ | ..........                  1000 |                        1.7         598.8          275
200.37/51.54	c ................................ | ..........               1046000 | 136029               200.5        5218.0     19847921
400.28/101.62	c ................................ | ..........               1556000 | 239144               400.3        3886.8     33160124
599.90/151.67	c ................................ | ..........               1941000 | 307846               600.2        3234.0     43396360
800.30/201.87	c ................................ | ..........               2269000 | 368364               800.5        2834.4     52741089
999.92/251.88	c ................................ | *.........               2544000 | 428150              1000.2        2543.5     61239333
1200.91/302.11	c ................................ | *.........               2814000 | 486432              1200.9        2343.2     70233067
1400.25/352.05	c ................................ | *.........               3058000 | 533625              1400.4        2183.6     79704125
1600.05/402.08	c ................................ | *.........               3280000 | 577275              1600.3        2049.6     88611636
1800.45/452.12	c ................................ | *.........               3487000 | 615597              1800.5        1936.7     95655277
2000.35/502.14	c ................................ | **........               3735000 | 664795              2000.5        1867.1    101749581

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1781188-1243685595/watcher-1781188-1243685595 -o /tmp/evaluation-result-1781188-1243685595/solver-1781188-1243685595 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781188-1243685595.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 4.07 4.36 3.85 3/99 2191
/proc/meminfo: memFree=2950132/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=1016 CPUtime=0
/proc/2191/stat : 2191 (ttsth-5-0) R 2189 2191 20984 0 -1 4202496 159 0 0 0 0 0 0 0 18 0 1 0 1133223904 1040384 114 4294967295 134512640 135237372 3212868432 3212866956 134639534 0 0 0 0 0 0 0 17 3 0 0 0
/proc/2191/statm: 254 114 75 177 0 76 0

[startup+0.046927 s]
/proc/loadavg: 4.07 4.36 3.85 3/99 2191
/proc/meminfo: memFree=2950132/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=3028 CPUtime=0.04
/proc/2191/stat : 2191 (ttsth-5-0) R 2189 2191 20984 0 -1 4202496 654 0 0 0 3 1 0 0 18 0 1 0 1133223904 3100672 609 4294967295 134512640 135237372 3212868432 3212867880 134732614 0 0 0 0 0 0 0 17 3 0 0 0
/proc/2191/statm: 757 609 75 177 0 579 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 3028

[startup+0.106921 s]
/proc/loadavg: 4.07 4.36 3.85 3/99 2191
/proc/meminfo: memFree=2950132/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=5736 CPUtime=0.1
/proc/2191/stat : 2191 (ttsth-5-0) R 2189 2191 20984 0 -1 4202496 1323 0 0 0 8 2 0 0 18 0 1 0 1133223904 5873664 1278 4294967295 134512640 135237372 3212868432 3212867228 134639534 0 0 0 0 0 0 0 17 3 0 0 0
/proc/2191/statm: 1434 1279 75 177 0 1256 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 5736

[startup+0.306901 s]
/proc/loadavg: 4.07 4.36 3.85 3/99 2191
/proc/meminfo: memFree=2950132/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=16016 CPUtime=0.3
/proc/2191/stat : 2191 (ttsth-5-0) R 2189 2191 20984 0 -1 4202496 3804 0 0 0 27 3 0 0 18 0 1 0 1133223904 16400384 3758 4294967295 134512640 135237372 3212868432 3212866656 134749353 0 0 0 0 0 0 0 17 3 0 0 0
/proc/2191/statm: 4004 3758 76 177 0 3826 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 16016

[startup+0.706863 s]
/proc/loadavg: 4.07 4.36 3.85 3/99 2191
/proc/meminfo: memFree=2950132/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=16052 CPUtime=0.7
/proc/2191/stat : 2191 (ttsth-5-0) R 2189 2191 20984 0 -1 4202496 4133 0 0 0 67 3 0 0 18 0 1 0 1133223904 16437248 3863 4294967295 134512640 135237372 3212868432 3212867476 134732614 0 0 0 0 0 0 0 17 3 0 0 0
/proc/2191/statm: 4013 3864 77 177 0 3835 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 16052

[startup+1.50679 s]
/proc/loadavg: 4.07 4.36 3.85 2/100 2192
/proc/meminfo: memFree=2933928/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=24736 CPUtime=1.5
/proc/2191/stat : 2191 (ttsth-5-0) R 2189 2191 20984 0 -1 4202496 6373 0 0 0 147 3 0 0 20 0 1 0 1133223904 25329664 5991 4294967295 134512640 135237372 3212868432 3212806052 134732614 0 0 0 0 0 0 0 17 3 0 0 0
/proc/2191/statm: 6184 5991 90 177 0 6006 0
Current children cumulated CPU time (s) 1.5
Current children cumulated vsize (KiB) 24736

[startup+3.10664 s]
/proc/loadavg: 4.06 4.35 3.85 5/104 2196
/proc/meminfo: memFree=2919720/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=75860 CPUtime=7.32
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 10979 0 0 0 728 4 0 0 20 0 5 0 1133223904 77680640 10485 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 18965 10485 95 177 0 18787 0
[pid=2191/tid=2193] ppid=2189 vsize=75860 CPUtime=1.43
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 867 0 0 0 143 0 0 0 25 0 5 0 1133224071 77680640 10485 4294967295 134512640 135237372 3212868432 3084967108 134634454 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=75860 CPUtime=1.4
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 950 0 0 0 140 0 0 0 25 0 5 0 1133224071 77680640 10485 4294967295 134512640 135237372 3212868432 3076552924 134550041 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=75860 CPUtime=1.42
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 851 0 0 0 141 1 0 0 25 0 5 0 1133224071 77680640 10485 4294967295 134512640 135237372 3212868432 3068190608 134680467 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=75860 CPUtime=1.4
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 915 0 0 0 140 0 0 0 25 0 5 0 1133224071 77680640 10485 4294967295 134512640 135237372 3212868432 3059797808 134680257 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 7.32
Current children cumulated vsize (KiB) 75860

[startup+6.30633 s]
/proc/loadavg: 4.06 4.35 3.85 5/104 2196
/proc/meminfo: memFree=2888620/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=106312 CPUtime=20.12
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 18313 0 0 0 2004 8 0 0 20 0 5 0 1133223904 108863488 17819 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 26578 17819 95 177 0 26400 0
[pid=2191/tid=2193] ppid=2189 vsize=106312 CPUtime=4.63
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 2330 0 0 0 463 0 0 0 25 0 5 0 1133224071 108863488 17819 4294967295 134512640 135237372 3212868432 3084982736 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=106312 CPUtime=4.6
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 2918 0 0 0 457 3 0 0 25 0 5 0 1133224071 108863488 17819 4294967295 134512640 135237372 3212868432 3076614160 134680727 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=106312 CPUtime=4.62
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 3070 0 0 0 460 2 0 0 25 0 5 0 1133224071 108863488 17819 4294967295 134512640 135237372 3212868432 3068225536 134591429 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=106312 CPUtime=4.6
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 2599 0 0 0 460 0 0 0 25 0 5 0 1133224071 108863488 17819 4294967295 134512640 135237372 3212868432 3059834448 134550999 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 20.12
Current children cumulated vsize (KiB) 106312

[startup+12.7157 s]
/proc/loadavg: 4.13 4.36 3.85 6/104 2196
/proc/meminfo: memFree=2834416/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=160952 CPUtime=45.69
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 31055 0 0 0 4549 20 0 0 20 0 5 0 1133223904 164814848 30561 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 40238 30561 95 177 0 40060 0
[pid=2191/tid=2193] ppid=2189 vsize=160952 CPUtime=10.97
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 4741 0 0 0 1092 5 0 0 25 0 5 0 1133224071 164814848 30561 4294967295 134512640 135237372 3212868432 3084986576 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=160952 CPUtime=11.01
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 6879 0 0 0 1095 6 0 0 25 0 5 0 1133224071 164814848 30561 4294967295 134512640 135237372 3212868432 3076597872 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=160952 CPUtime=11.03
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 6575 0 0 0 1100 3 0 0 25 0 5 0 1133224071 164814848 30561 4294967295 134512640 135237372 3212868432 3068180544 134551477 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=160952 CPUtime=11.01
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 5464 0 0 0 1098 3 0 0 25 0 5 0 1133224071 164814848 30561 4294967295 134512640 135237372 3212868432 3059811728 134592816 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 45.69
Current children cumulated vsize (KiB) 160952

[startup+25.5145 s]
/proc/loadavg: 4.19 4.36 3.86 6/104 2379
/proc/meminfo: memFree=2746116/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=249352 CPUtime=96.43
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 52144 0 0 0 9613 30 0 0 20 0 5 0 1133223904 255336448 51650 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 62338 51650 95 177 0 62160 0
[pid=2191/tid=2193] ppid=2189 vsize=249352 CPUtime=23.76
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 8126 0 0 0 2367 9 0 0 25 0 5 0 1133224071 255336448 51650 4294967295 134512640 135237372 3212868432 3084973088 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=249352 CPUtime=23.53
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 12917 0 0 0 2344 9 0 0 25 0 5 0 1133224071 255336448 51650 4294967295 134512640 135237372 3212868432 3076558992 134591102 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=249352 CPUtime=23.77
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 12542 0 0 0 2373 4 0 0 25 0 5 0 1133224071 255336448 51650 4294967295 134512640 135237372 3212868432 3068184336 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=249352 CPUtime=23.7
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 11163 0 0 0 2365 5 0 0 25 0 5 0 1133224071 255336448 51650 4294967295 134512640 135237372 3212868432 3059790704 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 96.43
Current children cumulated vsize (KiB) 249352

[startup+51.1121 s]
/proc/loadavg: 4.26 4.36 3.87 5/104 2381
/proc/meminfo: memFree=2615068/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=391060 CPUtime=198.77
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 85368 0 0 0 19830 47 0 0 20 0 5 0 1133223904 400445440 84874 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 97765 84874 95 177 0 97587 0
[pid=2191/tid=2193] ppid=2189 vsize=391060 CPUtime=49.3
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 16046 0 0 0 4918 12 0 0 25 0 5 0 1133224071 400445440 84874 4294967295 134512640 135237372 3212868432 3084987008 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=391060 CPUtime=49.13
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 21576 0 0 0 4902 11 0 0 25 0 5 0 1133224071 400445440 84874 4294967295 134512640 135237372 3212868432 3076577040 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=391060 CPUtime=49.37
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 20787 0 0 0 4924 13 0 0 25 0 5 0 1133224071 400445440 84874 4294967295 134512640 135237372 3212868432 3068188048 134562401 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=391060 CPUtime=49.3
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 19563 0 0 0 4922 8 0 0 25 0 5 0 1133224071 400445440 84874 4294967295 134512640 135237372 3212868432 3059810272 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 198.77
Current children cumulated vsize (KiB) 391060

[startup+102.307 s]
/proc/loadavg: 4.43 4.38 3.90 5/104 2571
/proc/meminfo: memFree=2398724/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=616424 CPUtime=403.08
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 138624 0 0 0 40226 82 0 0 20 0 5 0 1133223904 631218176 138130 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 154106 138130 95 177 0 153928 0
[pid=2191/tid=2193] ppid=2189 vsize=616424 CPUtime=100.4
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 27813 0 0 0 10016 24 0 0 25 0 5 0 1133224071 631218176 138130 4294967295 134512640 135237372 3212868432 3084975216 134751534 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=616424 CPUtime=100.28
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 35966 0 0 0 10008 20 0 0 25 0 5 0 1133224071 631218176 138130 4294967295 134512640 135237372 3212868432 3076570620 134636641 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=616424 CPUtime=100.54
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 36757 0 0 0 10031 23 0 0 25 0 5 0 1133224071 631218176 138130 4294967295 134512640 135237372 3212868432 3068183632 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=616424 CPUtime=100.19
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 30692 0 0 0 10007 12 0 0 25 0 5 0 1133224071 631218176 138130 4294967295 134512640 135237372 3212868432 3059799536 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 403.08
Current children cumulated vsize (KiB) 616424

[startup+162.311 s]
/proc/loadavg: 4.45 4.38 3.93 5/104 2766
/proc/meminfo: memFree=2208968/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=818568 CPUtime=642.41
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 186477 0 0 0 64126 115 0 0 20 0 5 0 1133223904 838213632 185983 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 204681 185984 95 177 0 204503 0
[pid=2191/tid=2193] ppid=2189 vsize=818724 CPUtime=160.19
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 36686 0 0 0 15985 34 0 0 25 0 5 0 1133224071 838373376 185984 4294967295 134512640 135237372 3212868432 3084975632 134546026 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=818724 CPUtime=160.22
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 50859 0 0 0 15991 31 0 0 25 0 5 0 1133224071 838373376 185984 4294967295 134512640 135237372 3212868432 3076597600 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=818724 CPUtime=160.52
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 46680 0 0 0 16023 29 0 0 25 0 5 0 1133224071 838373376 185984 4294967295 134512640 135237372 3212868432 3068212616 134732535 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=818724 CPUtime=159.81
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 44857 0 0 0 15963 18 0 0 25 0 5 0 1133224071 838373376 185984 4294967295 134512640 135237372 3212868432 3059827488 134562420 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 642.41
Current children cumulated vsize (KiB) 818568

[startup+222.316 s]
/proc/loadavg: 4.63 4.42 3.97 5/104 2961
/proc/meminfo: memFree=2039472/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=997428 CPUtime=881.96
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 228479 0 0 0 88047 149 0 0 20 0 5 0 1133223904 1021366272 227985 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 249357 227985 95 177 0 249179 0
[pid=2191/tid=2193] ppid=2189 vsize=997428 CPUtime=220.05
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 43687 0 0 0 21960 45 0 0 25 0 5 0 1133224071 1021366272 227985 4294967295 134512640 135237372 3212868432 3084985712 134562420 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=997428 CPUtime=220.22
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 64886 0 0 0 21983 39 0 0 25 0 5 0 1133224071 1021366272 227985 4294967295 134512640 135237372 3212868432 3076586608 134562363 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=997428 CPUtime=220.51
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 54040 0 0 0 22017 34 0 0 25 0 5 0 1133224071 1021366272 227985 4294967295 134512640 135237372 3212868432 3068199884 134680502 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=997428 CPUtime=219.51
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 58470 0 0 0 21923 28 0 0 25 0 5 0 1133224071 1021366272 227985 4294967295 134512640 135237372 3212868432 3059820752 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 881.96
Current children cumulated vsize (KiB) 997428

[startup+282.31 s]
/proc/loadavg: 4.84 4.51 4.03 6/104 3150
/proc/meminfo: memFree=1876928/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=1170384 CPUtime=1121.79
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 269434 0 0 0 111996 183 0 0 20 0 5 0 1133223904 1198473216 268940 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 292596 268940 95 177 0 292418 0
[pid=2191/tid=2193] ppid=2189 vsize=1170384 CPUtime=279.98
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 50010 0 0 0 27942 56 0 0 25 0 5 0 1133224071 1198473216 268940 4294967295 134512640 135237372 3212868432 3084979328 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=1170384 CPUtime=280.18
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 81063 0 0 0 27968 50 0 0 25 0 5 0 1133224071 1198473216 268940 4294967295 134512640 135237372 3212868432 3076604496 134591096 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=1170384 CPUtime=280.5
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 60514 0 0 0 28013 37 0 0 25 0 5 0 1133224071 1198473216 268940 4294967295 134512640 135237372 3212868432 3068197952 134562459 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=1170384 CPUtime=279.46
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 70451 0 0 0 27909 37 0 0 25 0 5 0 1133224071 1198473216 268941 4294967295 134512640 135237372 3212868432 3059815616 134591429 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1121.79
Current children cumulated vsize (KiB) 1170384

[startup+342.304 s]
/proc/loadavg: 4.61 4.48 4.05 5/104 3343
/proc/meminfo: memFree=1698176/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=1356952 CPUtime=1361.42
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 313536 0 0 0 135936 206 0 0 20 0 5 0 1133223904 1389518848 313042 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 339238 313042 95 177 0 339060 0
[pid=2191/tid=2193] ppid=2189 vsize=1356952 CPUtime=339.94
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 56620 0 0 0 33934 60 0 0 25 0 5 0 1133224071 1389518848 313042 4294967295 134512640 135237372 3212868432 3084986672 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=1356952 CPUtime=340.12
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 97465 0 0 0 33951 61 0 0 25 0 5 0 1133224071 1389518848 313042 4294967295 134512640 135237372 3212868432 3076589472 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=1356952 CPUtime=340.26
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 69554 0 0 0 33987 39 0 0 25 0 5 0 1133224071 1389518848 313042 4294967295 134512640 135237372 3212868432 3068198896 134562444 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=1356952 CPUtime=339.43
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 82501 0 0 0 33900 43 0 0 25 0 5 0 1133224071 1389518848 313042 4294967295 134512640 135237372 3212868432 3059790608 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1361.42
Current children cumulated vsize (KiB) 1356952

[startup+402.309 s]
/proc/loadavg: 5.00 4.59 4.10 5/104 3557
/proc/meminfo: memFree=1532124/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=1534464 CPUtime=1601.25
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 355607 0 0 0 159885 240 0 0 20 0 5 0 1133223904 1571291136 355113 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 383616 355114 95 177 0 383438 0
[pid=2191/tid=2193] ppid=2189 vsize=1534464 CPUtime=399.95
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 61065 0 0 0 39926 69 0 0 25 0 5 0 1133224071 1571291136 355114 4294967295 134512640 135237372 3212868432 3084976732 134562323 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=1534464 CPUtime=400.08
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 114962 0 0 0 39937 71 0 0 25 0 5 0 1133224071 1571291136 355114 4294967295 134512640 135237372 3212868432 3076566192 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=1534464 CPUtime=400.18
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 79565 0 0 0 39968 50 0 0 25 0 5 0 1133224071 1571291136 355114 4294967295 134512640 135237372 3212868432 3068189040 134680254 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=1534464 CPUtime=399.37
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 92620 0 0 0 39890 47 0 0 25 0 5 0 1133224071 1571291136 355114 4294967295 134512640 135237372 3212868432 3059818688 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1601.25
Current children cumulated vsize (KiB) 1534464

[startup+462.313 s]
/proc/loadavg: 4.93 4.61 4.14 7/105 3744
/proc/meminfo: memFree=1401332/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=1671108 CPUtime=1841.2
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 387841 0 0 0 183842 278 0 0 20 0 5 0 1133223904 1711214592 387347 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 417777 387347 95 177 0 417599 0
[pid=2191/tid=2193] ppid=2189 vsize=1671108 CPUtime=459.95
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 64606 0 0 0 45916 79 0 0 25 0 5 0 1133224071 1711214592 387347 4294967295 134512640 135237372 3212868432 3084979776 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=1671108 CPUtime=460.09
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 128128 0 0 0 45927 82 0 0 25 0 5 0 1133224071 1711214592 387347 4294967295 134512640 135237372 3212868432 3076587312 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=1671108 CPUtime=460.17
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 87679 0 0 0 45955 62 0 0 25 0 5 0 1133224071 1711214592 387347 4294967295 134512640 135237372 3212868432 3068210176 134562334 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=1671108 CPUtime=459.32
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 100032 0 0 0 45880 52 0 0 25 0 5 0 1133224071 1711214592 387348 4294967295 134512640 135237372 3212868432 3059810992 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1841.2
Current children cumulated vsize (KiB) 1671108

[startup+522.317 s]
/proc/loadavg: 4.80 4.62 4.17 5/104 3935
/proc/meminfo: memFree=1284468/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=1795520 CPUtime=2081.04
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 417145 0 0 0 207795 309 0 0 20 0 5 0 1133223904 1838612480 416651 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 448880 416651 95 177 0 448702 0
[pid=2191/tid=2193] ppid=2189 vsize=1795520 CPUtime=519.93
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 70623 0 0 0 51901 92 0 0 25 0 5 0 1133224071 1838612480 416651 4294967295 134512640 135237372 3212868432 3084991500 134562272 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=1795520 CPUtime=520.03
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 138354 0 0 0 51911 92 0 0 25 0 5 0 1133224071 1838612480 416651 4294967295 134512640 135237372 3212868432 3076586896 134562380 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=1795520 CPUtime=520.16
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 94411 0 0 0 51950 66 0 0 25 0 5 0 1133224071 1838612480 416651 4294967295 134512640 135237372 3212868432 3068197168 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=1795520 CPUtime=519.26
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 106361 0 0 0 51870 56 0 0 25 0 5 0 1133224071 1838612480 416651 4294967295 134512640 135237372 3212868432 3059812432 134549885 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2081.04
Current children cumulated vsize (KiB) 1795520

[startup+582.311 s]
/proc/loadavg: 4.68 4.59 4.19 7/105 4074
/proc/meminfo: memFree=1165788/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=1920600 CPUtime=2320.82
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 446630 0 0 0 231748 334 0 0 20 0 5 0 1133223904 1966694400 446136 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 480150 446136 95 177 0 479972 0
[pid=2191/tid=2193] ppid=2189 vsize=1920600 CPUtime=579.92
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 75380 0 0 0 57895 97 0 0 25 0 5 0 1133224071 1966694400 446136 4294967295 134512640 135237372 3212868432 3084986448 134562430 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=1920600 CPUtime=580.03
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 150396 0 0 0 57902 101 0 0 25 0 5 0 1133224071 1966694400 446136 4294967295 134512640 135237372 3212868432 3076590672 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=1920600 CPUtime=580.16
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 100786 0 0 0 57946 70 0 0 25 0 5 0 1133224071 1966694400 446136 4294967295 134512640 135237372 3212868432 3068187760 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=1920600 CPUtime=579.05
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 112672 0 0 0 57842 63 0 0 25 0 5 0 1133224071 1966694400 446136 4294967295 134512640 135237372 3212868432 3059832928 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2320.82
Current children cumulated vsize (KiB) 1920600

[startup+642.306 s]
/proc/loadavg: 4.52 4.56 4.20 5/104 4313
/proc/meminfo: memFree=1057232/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=2035112 CPUtime=2560.46
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 473648 0 0 0 255686 360 0 0 20 0 5 0 1133223904 2083954688 473154 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 508778 473154 95 177 0 508600 0
[pid=2191/tid=2193] ppid=2189 vsize=2035112 CPUtime=639.84
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 80151 0 0 0 63883 101 0 0 25 0 5 0 1133224071 2083954688 473154 4294967295 134512640 135237372 3212868432 3084976992 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=2035112 CPUtime=639.92
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 159437 0 0 0 63889 103 0 0 25 0 5 0 1133224071 2083954688 473154 4294967295 134512640 135237372 3212868432 3076587664 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=2035112 CPUtime=640.13
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 108720 0 0 0 63926 87 0 0 25 0 5 0 1133224071 2083954688 473154 4294967295 134512640 135237372 3212868432 3068198400 134562344 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=2035112 CPUtime=638.9
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 117944 0 0 0 63824 66 0 0 25 0 5 0 1133224071 2083954688 473154 4294967295 134512640 135237372 3212868432 3059789840 134562344 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2560.46
Current children cumulated vsize (KiB) 2035112



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+675.703 s]
/proc/loadavg: 4.39 4.52 4.19 5/104 4317
/proc/meminfo: memFree=999800/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=2096856 CPUtime=2693.96
/proc/2191/stat : 2191 (ttsth-5-0) S 2189 2191 20984 0 -1 4202496 488067 0 0 0 269022 374 0 0 20 0 5 0 1133223904 2147180544 487573 4294967295 134512640 135237372 3212868432 3212868028 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 524214 487573 95 177 0 524036 0
[pid=2191/tid=2193] ppid=2189 vsize=2096856 CPUtime=673.24
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 83063 0 0 0 67223 101 0 0 25 0 5 0 1133224071 2147180544 487573 4294967295 134512640 135237372 3212868432 3084981584 134562380 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2191/tid=2194] ppid=2189 vsize=2096856 CPUtime=673.32
/proc/2191/task/2194/stat : 2194 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 163892 0 0 0 67224 108 0 0 25 0 5 0 1133224071 2147180544 487573 4294967295 134512640 135237372 3212868432 3076566144 134562328 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2191/tid=2195] ppid=2189 vsize=2096856 CPUtime=673.53
/proc/2191/task/2195/stat : 2195 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 112849 0 0 0 67260 93 0 0 25 0 5 0 1133224071 2147180544 487573 4294967295 134512640 135237372 3212868432 3068209552 134562407 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2191/tid=2196] ppid=2189 vsize=2096856 CPUtime=672.2
/proc/2191/task/2196/stat : 2196 (ttsth-5-0) R 2189 2191 20984 0 -1 4202560 120867 0 0 0 67151 69 0 0 25 0 5 0 1133224071 2147180544 487573 4294967295 134512640 135237372 3212868432 3059817440 134562287 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2693.96
Current children cumulated vsize (KiB) 2096856

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+675.823 s]
/proc/loadavg: 4.39 4.52 4.19 5/104 4317
/proc/meminfo: memFree=999800/3368532 swapFree=1953580/1959888
[pid=2191] ppid=2189 vsize=0 CPUtime=2694.12
/proc/2191/stat : 2191 (ttsth-5-0) Z 2189 2191 20984 0 -1 4203524 488071 0 0 0 269029 383 0 0 18 0 2 0 1133223904 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2191/statm: 0 0 0 0 0 0 0
[pid=2191/tid=2193] ppid=2189 vsize=0 CPUtime=673.35
/proc/2191/task/2193/stat : 2193 (ttsth-5-0) R 2189 2191 20984 0 -1 4203588 83063 0 0 0 67225 110 0 0 25 0 2 0 1133224071 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2694.12
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2191 and gives
#  childrusage.ru_utime.tv_sec=2690
#  childrusage.ru_utime.tv_usec=290000
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=830000
# CPU time returned by wait4() is 2694.12
# while last known CPU time is 2694.12
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 675.828
CPU time (s): 2694.12
CPU user time (s): 2690.29
CPU system time (s): 3.83
CPU usage (%): 398.64
Max. virtual memory (cumulated for all children) (KiB): 2096856

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2690.29
system time used= 3.83
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 488071
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1020
involuntary context switches= 51291

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 14:13:15
IDJOB=1781188
IDBENCH=71103
IDSOLVER=632
FILE ID=/1781188-1243685595
PBS_JOBID=
Free space on /tmp= 15883 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rpoc_xits_11_UNKNOWN.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1781188-1243685595/watcher-1781188-1243685595 -o /tmp/evaluation-result-1781188-1243685595/solver-1781188-1243685595 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781188-1243685595.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= e0639bbed56c8b8c34616f8cb99c381c
RANDOM SEED= 376424591

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.105
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2950132 kB
Buffers:        134452 kB
Cached:         170456 kB
SwapCached:       2424 kB
Active:         190900 kB
Inactive:       124476 kB
HighTotal:     2489216 kB
HighFree:      2305552 kB
LowTotal:       879316 kB
LowFree:        644580 kB
SwapTotal:     1959888 kB
SwapFree:      1953580 kB
Dirty:            2712 kB
Writeback:           0 kB
AnonPages:        9548 kB
Mapped:           4884 kB
Slab:            93276 kB
SReclaimable:    84036 kB
SUnreclaim:       9240 kB
PageTables:        520 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:    93564 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15883 MiB
End job on  at 2009-05-30 14:24:33