Trace number 1780033

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 1507.91 769.932

General information on the benchmark

NameAPPLICATIONS/bioinfo/
q_query_3_l38_lambda.cnf
MD5SUM208fab3c6bb011254beb601f462aad3b
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark5.5
Satisfiable
(Un)Satisfiability was proved
Number of variables26986
Number of clauses132388
Sum of the clauses size380643
Maximum clause length9
Minimum clause length1
Number of clauses of size 13644
Number of clauses of size 234225
Number of clauses of size 375813
Number of clauses of size 412876
Number of clauses of size 55716
Number of clauses of size over 5114

Solver Data 

0.31/0.34	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780033-1243680569.cnf 
0.31/0.34	c Using SATTIMEOUT of 10000
0.31/0.34	c Using SATRAM of 2047
0.31/0.34	c Size of subset node = 16
0.31/0.34	c Variables = 26986
0.31/0.34	c Clauses = 132388
0.31/0.34	c Literals = 380643
0.31/0.34	c Reduced size:
0.31/0.34	c Variables = 26986
0.31/0.34	c Clauses = 118243
0.31/0.34	c Literals = 345096
0.31/0.34	c a2
0.61/0.64	c a1
6.81/6.92	c Independent sub-problems = 1
6.81/6.92	c Sub-problem with 22434 variables and 118243 clauses
6.81/6.92	c using permutation method 4
6.81/6.92	c count = 1
6.81/6.92	c Ordering finished 6.830 seconds
6.81/6.92	c mapped 6.890 seconds
6.81/6.92	c permuted 6.890 seconds
6.81/6.92	c about to sort
6.91/6.96	c sorted
8.51/8.55	c clauses now 118243
8.51/8.55	c init finished 7.080 seconds
8.51/8.55	c tree built 8.520 seconds
8.51/8.55	c 
8.51/8.55	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
8.51/8.55	c ---------------------------------|----------------------------------|------------------------------------------------------
8.51/8.55	c ................................ | ..........                       |                        8.5           0.0             
8.51/8.55	c ................................ | ..........                     1 |                        8.5           0.1             
8.51/8.55	c ****************................ | ..........                     2 |                        8.5           0.2            1
8.51/8.55	c ****************................ | ..........                     3 |                        8.5           0.4            1
8.51/8.55	c ****************................ | ..........                     4 |                        8.5           0.5            1
8.51/8.55	c ****************................ | ..........                     5 |                        8.5           0.6            1
8.51/8.55	c ****************................ | ..........                     6 |                        8.5           0.7            1
8.51/8.56	c ****************................ | ..........                  1000 | 2                      8.5         117.2          116
199.97/107.39	c ****************................ | ..........               2081000 | 44368                200.1       10401.4     17788126
399.96/208.13	c ****************................ | ..........               3402000 | 89274                400.1        8502.9     34240774
600.11/309.72	c ****************................ | ..........               4581000 | 121530               600.3        7631.6     48670832
799.93/411.32	c ****************................ | ..........               6511000 | 152769               800.1        8137.4     63143888
1000.17/512.84	c ****************................ | *.........               7688000 | 187269              1000.2        7686.6     79449998
1200.10/613.67	c ****************................ | *.........               8624000 | 216206              1200.2        7185.8     93779805
1399.99/714.92	c ****************................ | *.........               9556000 | 236679              1400.1        6825.1    109401377

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780033-1243680569/watcher-1780033-1243680569 -o /tmp/evaluation-result-1780033-1243680569/solver-1780033-1243680569 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780033-1243680569.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 7.22 7.28 7.10 6/111 16495
/proc/meminfo: memFree=3011292/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=3180 CPUtime=0.05
/proc/16495/stat : 16495 (ttsth-5-0) R 16493 16495 20065 0 -1 4202496 680 0 0 0 5 0 0 0 21 0 1 0 1132721007 3256320 636 4294967295 134512640 135237372 3218489520 3218489076 134738768 0 0 0 0 0 0 0 17 1 0 0 0
/proc/16495/statm: 795 636 75 177 0 617 0

[startup+0.149986 s]
/proc/loadavg: 7.22 7.28 7.10 6/111 16495
/proc/meminfo: memFree=3011292/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=7256 CPUtime=0.15
/proc/16495/stat : 16495 (ttsth-5-0) R 16493 16495 20065 0 -1 4202496 1664 0 0 0 15 0 0 0 22 0 1 0 1132721007 7430144 1620 4294967295 134512640 135237372 3218489520 3218489076 134738764 0 0 0 0 0 0 0 17 1 0 0 0
/proc/16495/statm: 1814 1620 75 177 0 1636 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 7256

[startup+0.209985 s]
/proc/loadavg: 7.22 7.28 7.10 6/111 16495
/proc/meminfo: memFree=3011292/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=10040 CPUtime=0.21
/proc/16495/stat : 16495 (ttsth-5-0) R 16493 16495 20065 0 -1 4202496 2255 0 0 0 21 0 0 0 22 0 1 0 1132721007 10280960 2211 4294967295 134512640 135237372 3218489520 3218489232 134536984 0 0 0 0 0 0 0 17 1 0 0 0
/proc/16495/statm: 2510 2211 75 177 0 2332 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 10040

[startup+0.309974 s]
/proc/loadavg: 7.22 7.28 7.10 6/111 16495
/proc/meminfo: memFree=3011292/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=10040 CPUtime=0.31
/proc/16495/stat : 16495 (ttsth-5-0) R 16493 16495 20065 0 -1 4202496 2357 0 0 0 31 0 0 0 22 0 1 0 1132721007 10280960 2313 4294967295 134512640 135237372 3218489520 3218489212 134534101 0 0 0 0 0 0 0 17 1 0 0 0
/proc/16495/statm: 2510 2313 75 177 0 2332 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 10040

[startup+0.709941 s]
/proc/loadavg: 7.22 7.28 7.10 6/111 16495
/proc/meminfo: memFree=3011292/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=18664 CPUtime=0.71
/proc/16495/stat : 16495 (ttsth-5-0) R 16493 16495 20065 0 -1 4202496 4854 0 0 0 70 1 0 0 24 0 1 0 1132721007 19111936 4449 4294967295 134512640 135237372 3218489520 3218488848 134555272 0 0 0 0 0 0 0 17 1 0 0 0
/proc/16495/statm: 4666 4449 77 177 0 4488 0
Current children cumulated CPU time (s) 0.71
Current children cumulated vsize (KiB) 18664

[startup+1.50987 s]
/proc/loadavg: 6.97 7.22 7.08 5/112 16496
/proc/meminfo: memFree=2991756/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=22652 CPUtime=1.51
/proc/16495/stat : 16495 (ttsth-5-0) R 16493 16495 20065 0 -1 4202496 5876 0 0 0 150 1 0 0 25 0 1 0 1132721007 23195648 5471 4294967295 134512640 135237372 3218489520 3218488848 134555272 0 0 0 0 0 0 0 17 1 0 0 0
/proc/16495/statm: 5663 5471 77 177 0 5485 0
Current children cumulated CPU time (s) 1.51
Current children cumulated vsize (KiB) 22652

[startup+3.10974 s]
/proc/loadavg: 6.97 7.22 7.08 5/112 16496
/proc/meminfo: memFree=2991348/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=22924 CPUtime=3.11
/proc/16495/stat : 16495 (ttsth-5-0) R 16493 16495 20065 0 -1 4202496 5917 0 0 0 310 1 0 0 25 0 1 0 1132721007 23474176 5512 4294967295 134512640 135237372 3218489520 3218488880 134600707 0 0 0 0 0 0 0 17 1 0 0 0
/proc/16495/statm: 5731 5512 77 177 0 5553 0
Current children cumulated CPU time (s) 3.11
Current children cumulated vsize (KiB) 22924

[startup+6.30948 s]
/proc/loadavg: 6.97 7.22 7.08 5/112 16496
/proc/meminfo: memFree=2991100/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=23056 CPUtime=6.31
/proc/16495/stat : 16495 (ttsth-5-0) R 16493 16495 20065 0 -1 4202496 5945 0 0 0 630 1 0 0 25 0 1 0 1132721007 23609344 5540 4294967295 134512640 135237372 3218489520 3218488880 134600718 0 0 0 0 0 0 0 17 1 0 0 0
/proc/16495/statm: 5764 5540 77 177 0 5586 0
Current children cumulated CPU time (s) 6.31
Current children cumulated vsize (KiB) 23056

[startup+12.7089 s]
/proc/loadavg: 6.75 7.16 7.06 8/116 16501
/proc/meminfo: memFree=2894820/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=152568 CPUtime=16.18
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 30782 0 0 0 1610 8 0 0 25 0 5 0 1132721007 156229632 30145 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 38142 30145 95 177 0 37964 0
[pid=16495/tid=16497] ppid=16493 vsize=152568 CPUtime=2.28
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 1020 0 0 0 228 0 0 0 25 0 5 0 1132721860 156229632 30145 4294967295 134512640 135237372 3218489520 3081954160 134749351 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=152568 CPUtime=1.91
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 1176 0 0 0 191 0 0 0 25 0 5 0 1132721860 156229632 30145 4294967295 134512640 135237372 3218489520 3073522768 134590176 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=152568 CPUtime=1.65
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 1169 0 0 0 165 0 0 0 25 0 5 0 1132721862 156229632 30145 4294967295 134512640 135237372 3218489520 3065125568 134680499 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=152568 CPUtime=1.83
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 1074 0 0 0 183 0 0 0 25 0 5 0 1132721862 156229632 30145 4294967295 134512640 135237372 3218489520 3056723056 134680729 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 16.18
Current children cumulated vsize (KiB) 152568

[startup+25.5079 s]
/proc/loadavg: 6.79 7.16 7.06 8/116 16501
/proc/meminfo: memFree=2846632/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=199992 CPUtime=39.79
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 42515 0 0 0 3963 16 0 0 25 0 5 0 1132721007 204791808 41878 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 49998 41878 95 177 0 49820 0
[pid=16495/tid=16497] ppid=16493 vsize=199992 CPUtime=8.72
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 4191 0 0 0 871 1 0 0 25 0 5 0 1132721860 204791808 41878 4294967295 134512640 135237372 3218489520 3081989416 134561445 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=199992 CPUtime=7.57
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 4314 0 0 0 756 1 0 0 25 0 5 0 1132721860 204791808 41878 4294967295 134512640 135237372 3218489520 3073519996 134636382 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=199992 CPUtime=7.16
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 3627 0 0 0 712 4 0 0 25 0 5 0 1132721862 204791808 41878 4294967295 134512640 135237372 3218489520 3065087888 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=199992 CPUtime=7.82
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 4040 0 0 0 780 2 0 0 25 0 5 0 1132721862 204791808 41878 4294967295 134512640 135237372 3218489520 3056777616 134562430 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 39.79
Current children cumulated vsize (KiB) 199992

[startup+51.1058 s]
/proc/loadavg: 7.06 7.19 7.07 9/117 16558
/proc/meminfo: memFree=2769032/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=282172 CPUtime=89.57
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 62153 0 0 0 8937 20 0 0 25 0 5 0 1132721007 288944128 61516 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 70543 61516 95 177 0 70365 0
[pid=16495/tid=16497] ppid=16493 vsize=282172 CPUtime=21.77
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 10973 0 0 0 2175 2 0 0 25 0 5 0 1132721860 288944128 61516 4294967295 134512640 135237372 3218489520 3081961920 134591217 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=282172 CPUtime=19.81
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 9799 0 0 0 1980 1 0 0 25 0 5 0 1132721860 288944128 61516 4294967295 134512640 135237372 3218489520 3073487376 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=282172 CPUtime=19.6
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 6658 0 0 0 1955 5 0 0 25 0 5 0 1132721862 288944128 61516 4294967295 134512640 135237372 3218489520 3065209184 134588792 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=282172 CPUtime=19.88
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 8380 0 0 0 1984 4 0 0 25 0 5 0 1132721862 288944128 61516 4294967295 134512640 135237372 3218489520 3056757792 134590740 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 89.57
Current children cumulated vsize (KiB) 282172

[startup+102.312 s]
/proc/loadavg: 7.23 7.23 7.09 8/116 16690
/proc/meminfo: memFree=2634144/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=421584 CPUtime=189.97
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 95640 0 0 0 18956 41 0 0 25 0 5 0 1132721007 431702016 95003 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 105396 95003 95 177 0 105218 0
[pid=16495/tid=16497] ppid=16493 vsize=421584 CPUtime=47.32
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 19051 0 0 0 4727 5 0 0 25 0 5 0 1132721860 431702016 95003 4294967295 134512640 135237372 3218489520 3081870864 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=421584 CPUtime=45.11
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 19678 0 0 0 4508 3 0 0 25 0 5 0 1132721860 431702016 95003 4294967295 134512640 135237372 3218489520 3073609136 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=421584 CPUtime=44.19
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 13200 0 0 0 4402 17 0 0 25 0 5 0 1132721862 431702016 95003 4294967295 134512640 135237372 3218489520 3065193488 134592281 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=421584 CPUtime=44.83
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 17368 0 0 0 4475 8 0 0 25 0 5 0 1132721862 431702016 95003 4294967295 134512640 135237372 3218489520 3056756160 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 189.97
Current children cumulated vsize (KiB) 421584

[startup+162.307 s]
/proc/loadavg: 7.41 7.29 7.12 9/116 16879
/proc/meminfo: memFree=2491816/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=571592 CPUtime=309.3
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 131390 0 0 0 30875 55 0 0 25 0 5 0 1132721007 585310208 130753 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 142898 130753 95 177 0 142720 0
[pid=16495/tid=16497] ppid=16493 vsize=571592 CPUtime=77.76
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 33492 0 0 0 7768 8 0 0 25 0 5 0 1132721860 585310208 130753 4294967295 134512640 135237372 3218489520 3081961276 134680208 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=571592 CPUtime=74.85
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 29470 0 0 0 7477 8 0 0 25 0 5 0 1132721860 585310208 130753 4294967295 134512640 135237372 3218489520 3073596464 134680257 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=571592 CPUtime=73.75
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 16871 0 0 0 7358 17 0 0 25 0 5 0 1132721862 585310208 130753 4294967295 134512640 135237372 3218489520 3065205580 134680502 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=571592 CPUtime=74.43
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 25214 0 0 0 7429 14 0 0 25 0 5 0 1132721862 585310208 130753 4294967295 134512640 135237372 3218489520 3056814096 134590528 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 309.3
Current children cumulated vsize (KiB) 571592

[startup+222.312 s]
/proc/loadavg: 7.27 7.28 7.12 8/116 17071
/proc/meminfo: memFree=2329304/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=741608 CPUtime=428.09
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 171695 0 0 0 42735 74 0 0 25 0 5 0 1132721007 759406592 171058 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 185402 171058 95 177 0 185224 0
[pid=16495/tid=16497] ppid=16493 vsize=741608 CPUtime=108.12
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 50835 0 0 0 10801 11 0 0 25 0 5 0 1132721860 759406592 171058 4294967295 134512640 135237372 3218489520 3081941040 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=741608 CPUtime=104.25
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 39146 0 0 0 10408 17 0 0 25 0 5 0 1132721860 759406592 171058 4294967295 134512640 135237372 3218489520 3073567648 134546026 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=741608 CPUtime=103.17
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 22783 0 0 0 10296 21 0 0 25 0 5 0 1132721862 759406592 171058 4294967295 134512640 135237372 3218489520 3065183296 134680474 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=741608 CPUtime=104.03
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 32588 0 0 0 10386 17 0 0 25 0 5 0 1132721862 759406592 171058 4294967295 134512640 135237372 3218489520 3056791968 134562351 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 428.09
Current children cumulated vsize (KiB) 741608

[startup+282.307 s]
/proc/loadavg: 7.35 7.30 7.14 9/116 17259
/proc/meminfo: memFree=2202968/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=877100 CPUtime=546.3
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 203560 0 0 0 54544 86 0 0 25 0 5 0 1132721007 898150400 202923 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 219275 202923 95 177 0 219097 0
[pid=16495/tid=16497] ppid=16493 vsize=877100 CPUtime=138.24
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 63541 0 0 0 13811 13 0 0 25 0 5 0 1132721860 898150400 202923 4294967295 134512640 135237372 3218489520 3081965488 134551002 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=877100 CPUtime=133.51
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 47712 0 0 0 13329 22 0 0 25 0 5 0 1132721860 898150400 202923 4294967295 134512640 135237372 3218489520 3073577856 134562416 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=877100 CPUtime=133.05
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 27543 0 0 0 13282 23 0 0 25 0 5 0 1132721862 898150400 202923 4294967295 134512640 135237372 3218489520 3065166928 134680285 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=877100 CPUtime=132.98
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 38421 0 0 0 13278 20 0 0 25 0 5 0 1132721862 898150400 202923 4294967295 134512640 135237372 3218489520 3056826192 134749353 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 546.3
Current children cumulated vsize (KiB) 877100

################
# More data... #
################


[startup+402.317 s]
/proc/loadavg: 7.30 7.31 7.16 8/116 17635
/proc/meminfo: memFree=1937924/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=1155856 CPUtime=782.4
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 269700 0 0 0 78124 116 0 0 25 0 5 0 1132721007 1183596544 269063 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 288964 269063 95 177 0 288786 0
[pid=16495/tid=16497] ppid=16493 vsize=1155856 CPUtime=198.12
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 79826 0 0 0 19790 22 0 0 25 0 5 0 1132721860 1183596544 269063 4294967295 134512640 135237372 3218489520 3081910272 134680374 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=1155856 CPUtime=192.14
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 62748 0 0 0 19185 29 0 0 25 0 5 0 1132721860 1183596544 269063 4294967295 134512640 135237372 3218489520 3073574800 134562388 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=1155856 CPUtime=191.95
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 39892 0 0 0 19169 26 0 0 25 0 5 0 1132721862 1183596544 269063 4294967295 134512640 135237372 3218489520 3065207744 134591082 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=1155856 CPUtime=191.67
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 60891 0 0 0 19136 31 0 0 25 0 5 0 1132721862 1183596544 269063 4294967295 134512640 135237372 3218489520 3056826160 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 782.4
Current children cumulated vsize (KiB) 1155856

[startup+462.312 s]
/proc/loadavg: 7.40 7.34 7.18 8/116 17824
/proc/meminfo: memFree=1777420/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=1323516 CPUtime=900.08
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 309630 0 0 0 89877 131 0 0 25 0 5 0 1132721007 1355280384 308993 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 330879 308993 95 177 0 330701 0
[pid=16495/tid=16497] ppid=16493 vsize=1323516 CPUtime=227.72
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 97592 0 0 0 22744 28 0 0 25 0 5 0 1132721860 1355280384 308993 4294967295 134512640 135237372 3218489520 3081943296 134680364 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=1323516 CPUtime=221.41
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 68620 0 0 0 22109 32 0 0 25 0 5 0 1132721860 1355280384 308993 4294967295 134512640 135237372 3218489520 3073571984 134680237 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=1323516 CPUtime=221.4
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 44802 0 0 0 22109 31 0 0 25 0 5 0 1132721862 1355280384 308993 4294967295 134512640 135237372 3218489520 3065184704 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=1323516 CPUtime=221.03
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 72273 0 0 0 22071 32 0 0 25 0 5 0 1132721862 1355280384 308993 4294967295 134512640 135237372 3218489520 3056713872 134591529 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 900.08
Current children cumulated vsize (KiB) 1323516

[startup+522.317 s]
/proc/loadavg: 7.34 7.35 7.19 8/116 18012
/proc/meminfo: memFree=1637372/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=1468568 CPUtime=1019.18
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 344903 0 0 0 101766 152 0 0 25 0 5 0 1132721007 1503813632 344266 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 367142 344266 95 177 0 366964 0
[pid=16495/tid=16497] ppid=16493 vsize=1468568 CPUtime=257.62
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 118467 0 0 0 25723 39 0 0 25 0 5 0 1132721860 1503813632 344266 4294967295 134512640 135237372 3218489520 3081965072 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=1468568 CPUtime=251.01
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 74352 0 0 0 25064 37 0 0 25 0 5 0 1132721860 1503813632 344266 4294967295 134512640 135237372 3218489520 3073576624 134591208 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=1468568 CPUtime=251.05
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 48967 0 0 0 25071 34 0 0 25 0 5 0 1132721862 1503813632 344266 4294967295 134512640 135237372 3218489520 3065202016 134749345 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=1468568 CPUtime=250.98
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 76774 0 0 0 25064 34 0 0 25 0 5 0 1132721862 1503813632 344266 4294967295 134512640 135237372 3218489520 3056794768 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1019.18
Current children cumulated vsize (KiB) 1468568

[startup+582.312 s]
/proc/loadavg: 7.23 7.33 7.19 8/116 18204
/proc/meminfo: memFree=1498600/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=1611228 CPUtime=1138.09
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 379245 0 0 0 113644 165 0 0 25 0 5 0 1132721007 1649897472 378608 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 402807 378609 95 177 0 402629 0
[pid=16495/tid=16497] ppid=16493 vsize=1611228 CPUtime=287.76
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 139538 0 0 0 28733 43 0 0 25 0 5 0 1132721860 1649897472 378609 4294967295 134512640 135237372 3218489520 3081956012 134562323 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=1611228 CPUtime=280.6
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 79874 0 0 0 28016 44 0 0 25 0 5 0 1132721860 1649897472 378609 4294967295 134512640 135237372 3218489520 3073570240 134680311 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=1611228 CPUtime=280.89
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 52300 0 0 0 28055 34 0 0 25 0 5 0 1132721862 1649897472 378609 4294967295 134512640 135237372 3218489520 3065211552 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=1611228 CPUtime=280.33
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 81191 0 0 0 27997 36 0 0 25 0 5 0 1132721862 1649897472 378609 4294967295 134512640 135237372 3218489520 3056815616 134562309 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1138.09
Current children cumulated vsize (KiB) 1611228

[startup+642.307 s]
/proc/loadavg: 7.24 7.32 7.20 8/116 18390
/proc/meminfo: memFree=1367176/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=1752052 CPUtime=1256.78
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 412409 0 0 0 125491 187 0 0 25 0 5 0 1132721007 1794101248 411772 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 438013 411772 95 177 0 437835 0
[pid=16495/tid=16497] ppid=16493 vsize=1752052 CPUtime=317.52
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 157875 0 0 0 31700 52 0 0 25 0 5 0 1132721860 1794101248 411772 4294967295 134512640 135237372 3218489520 3081957008 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=1752052 CPUtime=310.11
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 85439 0 0 0 30961 50 0 0 25 0 5 0 1132721860 1794101248 411772 4294967295 134512640 135237372 3218489520 3073582976 134680474 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=1752052 CPUtime=310.6
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 56869 0 0 0 31023 37 0 0 25 0 5 0 1132721862 1794101248 411772 4294967295 134512640 135237372 3218489520 3065189968 134749351 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=1752052 CPUtime=310.03
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 85883 0 0 0 30963 40 0 0 25 0 5 0 1132721862 1794101248 411772 4294967295 134512640 135237372 3218489520 3056798976 134591122 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1256.78
Current children cumulated vsize (KiB) 1752052

[startup+702.312 s]
/proc/loadavg: 7.26 7.32 7.20 8/116 18578
/proc/meminfo: memFree=1220864/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=1907136 CPUtime=1375.62
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 448850 0 0 0 137358 204 0 0 25 0 5 0 1132721007 1952907264 448213 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 476784 448213 95 177 0 476606 0
[pid=16495/tid=16497] ppid=16493 vsize=1907136 CPUtime=347.31
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 175857 0 0 0 34670 61 0 0 25 0 5 0 1132721860 1952907264 448213 4294967295 134512640 135237372 3218489520 3081961616 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=1907136 CPUtime=339.91
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 93976 0 0 0 33937 54 0 0 25 0 5 0 1132721860 1952907264 448213 4294967295 134512640 135237372 3218489520 3073604992 134680364 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=1907136 CPUtime=340.33
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 61914 0 0 0 33995 38 0 0 25 0 5 0 1132721862 1952907264 448213 4294967295 134512640 135237372 3218489520 3065183728 134680229 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=1907136 CPUtime=339.56
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 90760 0 0 0 33913 43 0 0 25 0 5 0 1132721862 1952907264 448213 4294967295 134512640 135237372 3218489520 3056793856 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1375.62
Current children cumulated vsize (KiB) 1907136

[startup+762.307 s]
/proc/loadavg: 7.21 7.29 7.19 8/116 18767
/proc/meminfo: memFree=1061844/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=2074392 CPUtime=1493.27
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 488139 0 0 0 149114 213 0 0 25 0 5 0 1132721007 2124177408 487502 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 518598 487502 95 177 0 518420 0
[pid=16495/tid=16497] ppid=16493 vsize=2074392 CPUtime=376.83
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 194344 0 0 0 37618 65 0 0 25 0 5 0 1132721860 2124177408 487502 4294967295 134512640 135237372 3218489520 3081985808 134549888 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=2074392 CPUtime=369.04
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 104705 0 0 0 36848 56 0 0 25 0 5 0 1132721860 2124177408 487502 4294967295 134512640 135237372 3218489520 3073477504 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=2074392 CPUtime=369.75
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 67141 0 0 0 36936 39 0 0 25 0 5 0 1132721862 2124177408 487502 4294967295 134512640 135237372 3218489520 3065199680 134590200 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=2074392 CPUtime=369.13
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 95606 0 0 0 36868 45 0 0 25 0 5 0 1132721862 2124177408 487502 4294967295 134512640 135237372 3218489520 3056810736 134680367 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1493.27
Current children cumulated vsize (KiB) 2074392



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+769.806 s]
/proc/loadavg: 7.19 7.28 7.19 9/117 18776
/proc/meminfo: memFree=1040380/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=2096628 CPUtime=1507.79
/proc/16495/stat : 16495 (ttsth-5-0) S 16493 16495 20065 0 -1 4202496 493431 0 0 0 150563 216 0 0 25 0 5 0 1132721007 2146947072 492794 4294967295 134512640 135237372 3218489520 3218489116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 524157 492794 95 177 0 523979 0
[pid=16495/tid=16497] ppid=16493 vsize=2096628 CPUtime=380.46
/proc/16495/task/16497/stat : 16497 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 196651 0 0 0 37980 66 0 0 25 0 5 0 1132721860 2146947072 492794 4294967295 134512640 135237372 3218489520 3081872480 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=2096628 CPUtime=372.71
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 106520 0 0 0 37214 57 0 0 25 0 5 0 1132721860 2146947072 492794 4294967295 134512640 135237372 3218489520 3073507200 134680322 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16499] ppid=16493 vsize=2096628 CPUtime=373.38
/proc/16495/task/16499/stat : 16499 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 67697 0 0 0 37299 39 0 0 25 0 5 0 1132721862 2146947072 492794 4294967295 134512640 135237372 3218489520 3065182064 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=16495/tid=16500] ppid=16493 vsize=2096628 CPUtime=372.72
/proc/16495/task/16500/stat : 16500 (ttsth-5-0) R 16493 16495 20065 0 -1 4202560 96220 0 0 0 37226 46 0 0 25 0 5 0 1132721862 2146947072 492794 4294967295 134512640 135237372 3218489520 3056821728 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1507.79
Current children cumulated vsize (KiB) 2096628

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+769.926 s]
/proc/loadavg: 7.19 7.28 7.19 9/117 18776
/proc/meminfo: memFree=1040380/3368532 swapFree=1953788/1959888
[pid=16495] ppid=16493 vsize=0 CPUtime=1507.91
/proc/16495/stat : 16495 (ttsth-5-0) Z 16493 16495 20065 0 -1 4203524 493434 0 0 0 150565 226 0 0 18 0 2 0 1132721007 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/16495/statm: 0 0 0 0 0 0 0
[pid=16495/tid=16498] ppid=16493 vsize=0 CPUtime=372.81
/proc/16495/task/16498/stat : 16498 (ttsth-5-0) R 16493 16495 20065 0 -1 4203588 106520 0 0 0 37214 67 0 0 25 0 2 0 1132721860 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1507.91
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16495 and gives
#  childrusage.ru_utime.tv_sec=1505
#  childrusage.ru_utime.tv_usec=650000
#  childrusage.ru_stime.tv_sec=2
#  childrusage.ru_stime.tv_usec=260000
# CPU time returned by wait4() is 1507.91
# while last known CPU time is 1507.91
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 769.932
CPU time (s): 1507.91
CPU user time (s): 1505.65
CPU system time (s): 2.26
CPU usage (%): 195.85
Max. virtual memory (cumulated for all children) (KiB): 2096628

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1505.65
system time used= 2.26
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 493434
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 857
involuntary context switches= 25150

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 12:49:29
IDJOB=1780033
IDBENCH=70948
IDSOLVER=632
FILE ID=/1780033-1243680569
PBS_JOBID=
Free space on /tmp= 6474 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/bioinfo/q_query_3_l38_lambda.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780033-1243680569/watcher-1780033-1243680569 -o /tmp/evaluation-result-1780033-1243680569/solver-1780033-1243680569 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780033-1243680569.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 208fab3c6bb011254beb601f462aad3b
RANDOM SEED= 358419293

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.12
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3012920 kB
Buffers:        123224 kB
Cached:         115220 kB
SwapCached:       2256 kB
Active:         163744 kB
Inactive:        91440 kB
HighTotal:     2489216 kB
HighFree:      2356164 kB
LowTotal:       879316 kB
LowFree:        656756 kB
SwapTotal:     1959888 kB
SwapFree:      1953788 kB
Dirty:            3312 kB
Writeback:           0 kB
AnonPages:       16012 kB
Mapped:           5228 kB
Slab:            90980 kB
SReclaimable:    77196 kB
SUnreclaim:      13784 kB
PageTables:        696 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   112676 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 6474 MiB
End job on  at 2009-05-30 13:02:21