Trace number 1780783

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 2033.69 918.861

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rbcl_xits_10_UNKNOWN.cnf
MD5SUMe868383f091c36fa9594c670095c9824
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1584
Number of clauses91646
Sum of the clauses size272553
Maximum clause length11
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22569
Number of clauses of size 389054
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data 

0.12/0.13	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780783-1243683722.cnf 
0.12/0.13	c Using SATTIMEOUT of 10000
0.12/0.13	c Using SATRAM of 2047
0.12/0.13	c Size of subset node = 16
0.12/0.13	c Variables = 1584
0.12/0.13	c Clauses = 91646
0.12/0.13	c Literals = 272553
0.12/0.13	c Reduced size:
0.12/0.13	c Variables = 1584
0.12/0.13	c Clauses = 91646
0.12/0.13	c Literals = 272553
0.12/0.13	c a2
0.32/0.37	c a1
0.82/0.82	c Independent sub-problems = 1
0.82/0.82	c Sub-problem with 1584 variables and 91646 clauses
0.82/0.82	c using permutation method 4
0.82/0.82	c count = 1
0.82/0.82	c Ordering finished 0.770 seconds
0.82/0.82	c mapped 0.810 seconds
0.82/0.82	c permuted 0.810 seconds
0.82/0.82	c about to sort
0.82/0.85	c sorted
1.32/1.35	c clauses now 91646
1.32/1.35	c init finished 0.860 seconds
1.32/1.35	c tree built 1.350 seconds
1.32/1.35	c 
1.32/1.35	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
1.32/1.35	c ---------------------------------|----------------------------------|------------------------------------------------------
1.32/1.35	c ................................ | ..........                       |                        1.4           0.0             
1.32/1.35	c ................................ | ..........                     1 |                        1.4           0.7             
1.32/1.35	c ................................ | ..........                     2 |                        1.4           1.5             
1.32/1.35	c ................................ | ..........                     3 |                        1.4           2.2             
1.32/1.35	c ................................ | ..........                     4 |                        1.4           3.0             
1.32/1.35	c ................................ | ..........                     5 |                        1.4           3.7             
1.32/1.36	c ................................ | ..........                  1000 | 4                      1.4         735.3          212
200.35/94.03	c ................................ | ..........                851000 | 56637                200.4        4246.9     24468210
400.08/183.83	c ................................ | ..........               1187000 | 85652                400.1        2966.6     41737780
600.15/281.00	c ................................ | ..........               1540000 | 122761               600.3        2565.3     55505968
800.76/381.21	c ................................ | ..........               1913000 | 166276               800.8        2389.0     66791199
1000.58/481.14	c ................................ | *.........               2214000 | 181492              1000.6        2212.7     76120177
1200.37/579.87	c ................................ | *.........               2533000 | 198682              1200.5        2110.0     84848334
1400.25/659.73	c ................................ | *.........               2764000 | 212009              1400.3        1973.8     93603822
1599.97/739.86	c ................................ | *.........               3112000 | 233064              1600.1        1944.9    100459594
1800.35/824.11	c ................................ | *.........               3402000 | 248377              1800.4        1889.6    111885136
2000.56/905.56	c ................................ | **........               3590000 | 258674              2000.6        1794.4    122165979

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1780783-1243683722/watcher-1780783-1243683722 -o /tmp/evaluation-result-1780783-1243683722/solver-1780783-1243683722 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780783-1243683722.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.95 3.02 3.19 4/104 8869
/proc/meminfo: memFree=2026436/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=1540 CPUtime=0.02
/proc/8869/stat : 8869 (ttsth-5-0) R 8867 8869 2540 0 -1 4202496 293 0 0 0 1 1 0 0 19 0 1 0 1122473379 1576960 248 4294967295 134512640 135237372 3220683456 3220682904 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/8869/statm: 385 248 75 177 0 207 0

[startup+0.070532 s]
/proc/loadavg: 2.95 3.02 3.19 4/104 8869
/proc/meminfo: memFree=2026436/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=4160 CPUtime=0.08
/proc/8869/stat : 8869 (ttsth-5-0) R 8867 8869 2540 0 -1 4202496 917 0 0 0 7 1 0 0 21 0 1 0 1122473379 4259840 872 4294967295 134512640 135237372 3220683456 3220682904 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/8869/statm: 1040 872 75 177 0 862 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 4160

[startup+0.11053 s]
/proc/loadavg: 2.95 3.02 3.19 4/104 8869
/proc/meminfo: memFree=2026436/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=5864 CPUtime=0.12
/proc/8869/stat : 8869 (ttsth-5-0) R 8867 8869 2540 0 -1 4202496 1346 0 0 0 11 1 0 0 21 0 1 0 1122473379 6004736 1301 4294967295 134512640 135237372 3220683456 3220682904 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/8869/statm: 1466 1302 75 177 0 1288 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 5864

[startup+0.310516 s]
/proc/loadavg: 2.95 3.02 3.19 4/104 8869
/proc/meminfo: memFree=2026436/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=13300 CPUtime=0.32
/proc/8869/stat : 8869 (ttsth-5-0) R 8867 8869 2540 0 -1 4202496 3156 0 0 0 31 1 0 0 22 0 1 0 1122473379 13619200 3110 4294967295 134512640 135237372 3220683456 3220682744 134519979 0 0 0 0 0 0 0 17 1 0 0 0
/proc/8869/statm: 3325 3110 76 177 0 3147 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 13300

[startup+0.710488 s]
/proc/loadavg: 2.95 3.02 3.19 4/104 8869
/proc/meminfo: memFree=2026436/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=14044 CPUtime=0.72
/proc/8869/stat : 8869 (ttsth-5-0) R 8867 8869 2540 0 -1 4202496 4516 0 0 0 70 2 0 0 24 0 1 0 1122473379 14381056 3370 4294967295 134512640 135237372 3220683456 3220682688 134599538 0 0 0 0 0 0 0 17 1 0 0 0
/proc/8869/statm: 3511 3370 77 177 0 3333 0
Current children cumulated CPU time (s) 0.72
Current children cumulated vsize (KiB) 14044

[startup+1.51044 s]
/proc/loadavg: 2.95 3.02 3.19 4/105 8870
/proc/meminfo: memFree=2010288/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=59684 CPUtime=1.64
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 7645 0 0 0 161 3 0 0 25 0 5 0 1122473379 61116416 6319 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 14921 6319 95 177 0 14743 0
Current children cumulated CPU time (s) 1.64
Current children cumulated vsize (KiB) 59684

[startup+3.11033 s]
/proc/loadavg: 2.95 3.02 3.19 7/109 8874
/proc/meminfo: memFree=1997412/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=69192 CPUtime=4.8
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 10225 0 0 0 476 4 0 0 25 0 5 0 1122473379 70852608 8899 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 17298 8899 95 177 0 17120 0
[pid=8869/tid=8871] ppid=8867 vsize=69192 CPUtime=1.22
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 727 0 0 0 121 1 0 0 25 0 5 0 1122473515 70852608 8899 4294967295 134512640 135237372 3220683456 3084875328 134562413 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=69192 CPUtime=0.9
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 845 0 0 0 90 0 0 0 25 0 5 0 1122473515 70852608 8899 4294967295 134512640 135237372 3220683456 3076486972 134680208 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=69192 CPUtime=0.51
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 529 0 0 0 51 0 0 0 25 0 5 0 1122473515 70852608 8899 4294967295 134512640 135237372 3220683456 3068068640 134561428 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=69192 CPUtime=0.81
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 838 0 0 0 80 1 0 0 25 0 5 0 1122473515 70852608 8899 4294967295 134512640 135237372 3220683456 3059671644 134680208 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4.8
Current children cumulated vsize (KiB) 69192

[startup+6.31011 s]
/proc/loadavg: 3.19 3.07 3.20 7/109 8874
/proc/meminfo: memFree=1978480/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=88528 CPUtime=11.2
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 14988 0 0 0 1116 4 0 0 25 0 5 0 1122473379 90652672 13662 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 22132 13662 95 177 0 21954 0
[pid=8869/tid=8871] ppid=8867 vsize=88528 CPUtime=3.11
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 1666 0 0 0 310 1 0 0 25 0 5 0 1122473515 90652672 13662 4294967295 134512640 135237372 3220683456 3084876784 134551008 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=88528 CPUtime=2.42
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 2185 0 0 0 242 0 0 0 25 0 5 0 1122473515 90652672 13662 4294967295 134512640 135237372 3220683456 3076447344 134593504 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=88528 CPUtime=1.82
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 1570 0 0 0 182 0 0 0 25 0 5 0 1122473515 90652672 13662 4294967295 134512640 135237372 3220683456 3068062012 134636382 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=88528 CPUtime=2.49
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 2281 0 0 0 248 1 0 0 25 0 5 0 1122473515 90652672 13662 4294967295 134512640 135237372 3220683456 3059700592 134749353 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 11.2
Current children cumulated vsize (KiB) 88528

[startup+12.7097 s]
/proc/loadavg: 3.42 3.11 3.22 7/109 8874
/proc/meminfo: memFree=1940784/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=126760 CPUtime=23.99
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 24026 0 0 0 2391 8 0 0 25 0 5 0 1122473379 129802240 22700 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 31690 22700 95 177 0 31512 0
[pid=8869/tid=8871] ppid=8867 vsize=126760 CPUtime=6.46
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 3442 0 0 0 644 2 0 0 25 0 5 0 1122473515 129802240 22700 4294967295 134512640 135237372 3220683456 3084879824 134551736 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=126760 CPUtime=5.64
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 4838 0 0 0 562 2 0 0 25 0 5 0 1122473515 129802240 22700 4294967295 134512640 135237372 3220683456 3076440968 134636382 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=126760 CPUtime=4.72
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 3502 0 0 0 472 0 0 0 25 0 5 0 1122473515 129802240 22700 4294967295 134512640 135237372 3220683456 3068073704 134549924 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=126760 CPUtime=5.81
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 4958 0 0 0 579 2 0 0 25 0 5 0 1122473515 129802240 22700 4294967295 134512640 135237372 3220683456 3059711160 134549877 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 23.99
Current children cumulated vsize (KiB) 126760

[startup+25.5088 s]
/proc/loadavg: 4.14 3.29 3.27 7/109 8875
/proc/meminfo: memFree=1864468/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=204308 CPUtime=54.56
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 42669 0 0 0 5440 16 0 0 25 0 5 0 1122473379 209211392 41343 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 51077 41343 95 177 0 50899 0
[pid=8869/tid=8871] ppid=8867 vsize=204308 CPUtime=12.55
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 6236 0 0 0 1251 4 0 0 25 0 5 0 1122473515 209211392 41343 4294967295 134512640 135237372 3220683456 3084842528 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=204308 CPUtime=11.92
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 9304 0 0 0 1188 4 0 0 25 0 5 0 1122473515 209211392 41343 4294967295 134512640 135237372 3220683456 3076473408 134593243 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=204308 CPUtime=15.29
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 8500 0 0 0 1527 2 0 0 25 0 5 0 1122473515 209211392 41343 4294967295 134512640 135237372 3220683456 3068066704 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=204308 CPUtime=13.44
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 11343 0 0 0 1340 4 0 0 25 0 5 0 1122473515 209211392 41343 4294967295 134512640 135237372 3220683456 3059687936 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 54.56
Current children cumulated vsize (KiB) 204308

[startup+51.107 s]
/proc/loadavg: 5.10 3.58 3.37 8/110 8923
/proc/meminfo: memFree=1755616/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=317068 CPUtime=114.42
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 69777 0 0 0 11414 28 0 0 25 0 5 0 1122473379 324677632 68451 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 79267 68451 95 177 0 79089 0
[pid=8869/tid=8871] ppid=8867 vsize=317068 CPUtime=25.25
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 10273 0 0 0 2520 5 0 0 25 0 5 0 1122473515 324677632 68451 4294967295 134512640 135237372 3220683456 3084867232 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=317068 CPUtime=25.6
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 15973 0 0 0 2552 8 0 0 25 0 5 0 1122473515 324677632 68451 4294967295 134512640 135237372 3220683456 3076471664 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=317068 CPUtime=32.6
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 15696 0 0 0 3255 5 0 0 25 0 5 0 1122473515 324677632 68451 4294967295 134512640 135237372 3220683456 3068105244 134551013 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=317068 CPUtime=29.61
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 20549 0 0 0 2953 8 0 0 25 0 5 0 1122473515 324677632 68451 4294967295 134512640 135237372 3220683456 3059688704 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 114.42
Current children cumulated vsize (KiB) 317068

[startup+102.324 s]
/proc/loadavg: 5.86 4.03 3.53 8/109 9064
/proc/meminfo: memFree=1588232/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=489612 CPUtime=216.92
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 111053 0 0 0 21639 53 0 0 25 0 5 0 1122473379 501362688 109727 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 122403 109727 95 177 0 122225 0
[pid=8869/tid=8871] ppid=8867 vsize=489612 CPUtime=51.18
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 18358 0 0 0 5104 14 0 0 25 0 5 0 1122473515 501362688 109727 4294967295 134512640 135237372 3220683456 3084873904 134562380 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=489612 CPUtime=51.22
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 29690 0 0 0 5109 13 0 0 25 0 5 0 1122473515 501362688 109727 4294967295 134512640 135237372 3220683456 3076478560 134552726 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=489612 CPUtime=58.35
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 25949 0 0 0 5828 7 0 0 25 0 5 0 1122473515 501362688 109727 4294967295 134512640 135237372 3220683456 3068107520 134680282 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=489612 CPUtime=54.81
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 29770 0 0 0 5464 17 0 0 25 0 5 0 1122473515 501362688 109727 4294967295 134512640 135237372 3220683456 3059700760 134519949 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 216.92
Current children cumulated vsize (KiB) 489612

[startup+162.309 s]
/proc/loadavg: 6.31 4.50 3.72 8/109 9257
/proc/meminfo: memFree=1411096/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=676940 CPUtime=346.61
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 155436 0 0 0 34576 85 0 0 25 0 5 0 1122473379 693186560 154110 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 169235 154110 95 177 0 169057 0
[pid=8869/tid=8871] ppid=8867 vsize=676940 CPUtime=80.98
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 24851 0 0 0 8078 20 0 0 25 0 5 0 1122473515 693186560 154110 4294967295 134512640 135237372 3220683456 3084864032 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=676940 CPUtime=81.12
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 41648 0 0 0 8092 20 0 0 25 0 5 0 1122473515 693186560 154111 4294967295 134512640 135237372 3220683456 3076494880 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=676940 CPUtime=97.84
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 44017 0 0 0 9761 23 0 0 25 0 5 0 1122473515 693186560 154111 4294967295 134512640 135237372 3220683456 3068065408 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=676940 CPUtime=85.31
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 37635 0 0 0 8511 20 0 0 25 0 5 0 1122473515 693186560 154111 4294967295 134512640 135237372 3220683456 3059693952 134562278 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 346.61
Current children cumulated vsize (KiB) 676940

[startup+222.305 s]
/proc/loadavg: 6.40 4.86 3.89 7/109 9446
/proc/meminfo: memFree=1241732/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=853432 CPUtime=482.96
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 197242 0 0 0 48190 106 0 0 25 0 5 0 1122473379 873914368 195916 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 213358 195916 95 177 0 213180 0
[pid=8869/tid=8871] ppid=8867 vsize=853432 CPUtime=110.84
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 32565 0 0 0 11061 23 0 0 25 0 5 0 1122473515 873914368 195916 4294967295 134512640 135237372 3220683456 3084889392 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=853432 CPUtime=111.82
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 52110 0 0 0 11154 28 0 0 25 0 5 0 1122473515 873914368 195916 4294967295 134512640 135237372 3220683456 3076490832 134588270 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=853432 CPUtime=143.53
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 59071 0 0 0 14324 29 0 0 25 0 5 0 1122473515 873914368 195916 4294967295 134512640 135237372 3220683456 3068087424 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=853432 CPUtime=115.41
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 46210 0 0 0 11517 24 0 0 25 0 5 0 1122473515 873914368 195916 4294967295 134512640 135237372 3220683456 3059686912 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 482.96
Current children cumulated vsize (KiB) 853432


################
# More data... #
################

/proc/meminfo: memFree=829432/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=1285384 CPUtime=962.96
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 299523 0 0 0 96129 167 0 0 25 0 5 0 1122473379 1316233216 298197 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 321346 298197 95 177 0 321168 0
[pid=8869/tid=8871] ppid=8867 vsize=1285384 CPUtime=230.95
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 51829 0 0 0 23065 30 0 0 25 0 5 0 1122473515 1316233216 298197 4294967295 134512640 135237372 3220683456 3084855040 134562290 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=1285384 CPUtime=232.13
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 90897 0 0 0 23164 49 0 0 25 0 5 0 1122473515 1316233216 298197 4294967295 134512640 135237372 3220683456 3076465072 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=1285384 CPUtime=263.21
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 79046 0 0 0 26281 40 0 0 25 0 5 0 1122473515 1316233216 298197 4294967295 134512640 135237372 3220683456 3068059552 134562328 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=1285384 CPUtime=235.31
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 70465 0 0 0 23485 46 0 0 25 0 5 0 1122473515 1316233216 298197 4294967295 134512640 135237372 3220683456 3059679872 134562360 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 962.96
Current children cumulated vsize (KiB) 1285384

[startup+522.315 s]
/proc/loadavg: 6.47 5.96 4.64 7/109 10391
/proc/meminfo: memFree=750796/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=1368196 CPUtime=1082.9
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 319034 0 0 0 108112 178 0 0 25 0 5 0 1122473379 1401032704 317708 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 342049 317708 95 177 0 341871 0
[pid=8869/tid=8871] ppid=8867 vsize=1368196 CPUtime=261.16
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 57139 0 0 0 26082 34 0 0 25 0 5 0 1122473515 1401032704 317708 4294967295 134512640 135237372 3220683456 3084865904 134562341 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=1368196 CPUtime=262.02
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 96944 0 0 0 26151 51 0 0 25 0 5 0 1122473515 1401032704 317708 4294967295 134512640 135237372 3220683456 3076483360 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=1368196 CPUtime=293.11
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 82933 0 0 0 29268 43 0 0 25 0 5 0 1122473515 1401032704 317708 4294967295 134512640 135237372 3220683456 3068075760 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=1368196 CPUtime=265.25
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 74732 0 0 0 26477 48 0 0 25 0 5 0 1122473515 1401032704 317708 4294967295 134512640 135237372 3220683456 3059677792 134562344 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1082.9
Current children cumulated vsize (KiB) 1368196

[startup+582.31 s]
/proc/loadavg: 6.70 6.10 4.77 8/109 10578
/proc/meminfo: memFree=660676/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=1464532 CPUtime=1207.67
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 341713 0 0 0 120574 193 0 0 25 0 5 0 1122473379 1499680768 340387 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 366133 340387 95 177 0 365955 0
[pid=8869/tid=8871] ppid=8867 vsize=1464532 CPUtime=293.43
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 62622 0 0 0 29308 35 0 0 25 0 5 0 1122473515 1499680768 340387 4294967295 134512640 135237372 3220683456 3084862784 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=1464532 CPUtime=292.02
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 102421 0 0 0 29148 54 0 0 25 0 5 0 1122473515 1499680768 340387 4294967295 134512640 135237372 3220683456 3076462080 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=1464532 CPUtime=322.91
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 89582 0 0 0 32241 50 0 0 25 0 5 0 1122473515 1499680768 340387 4294967295 134512640 135237372 3220683456 3068087504 134562380 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=1464532 CPUtime=297.95
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 79802 0 0 0 29743 52 0 0 25 0 5 0 1122473515 1499680768 340387 4294967295 134512640 135237372 3220683456 3059688288 134562444 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1207.67
Current children cumulated vsize (KiB) 1464532

[startup+642.306 s]
/proc/loadavg: 6.91 6.24 4.89 7/109 10766
/proc/meminfo: memFree=551632/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=1577516 CPUtime=1357.16
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 368565 0 0 0 135501 215 0 0 25 0 5 0 1122473379 1615376384 367239 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 394379 367239 95 177 0 394201 0
[pid=8869/tid=8871] ppid=8867 vsize=1577516 CPUtime=323.65
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 67144 0 0 0 32328 37 0 0 25 0 5 0 1122473515 1615376384 367239 4294967295 134512640 135237372 3220683456 3084853584 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=1577516 CPUtime=350.68
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 112810 0 0 0 35002 66 0 0 25 0 5 0 1122473515 1615376384 367239 4294967295 134512640 135237372 3220683456 3076475904 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=1577516 CPUtime=352.76
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 97694 0 0 0 35221 55 0 0 25 0 5 0 1122473515 1615376384 367239 4294967295 134512640 135237372 3220683456 3068076544 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=1577516 CPUtime=328.71
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 83631 0 0 0 32816 55 0 0 25 0 5 0 1122473515 1615376384 367239 4294967295 134512640 135237372 3220683456 3059678448 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1357.16
Current children cumulated vsize (KiB) 1577516

[startup+702.312 s]
/proc/loadavg: 6.93 6.35 5.01 7/109 10953
/proc/meminfo: memFree=471048/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=1663232 CPUtime=1506.42
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 388800 0 0 0 150406 236 0 0 25 0 5 0 1122473379 1703149568 387474 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 415808 387474 95 177 0 415630 0
[pid=8869/tid=8871] ppid=8867 vsize=1663232 CPUtime=376.05
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 73832 0 0 0 37556 49 0 0 25 0 5 0 1122473515 1703149568 387474 4294967295 134512640 135237372 3220683456 3084862752 134562309 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=1663232 CPUtime=380.89
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 116779 0 0 0 38018 71 0 0 25 0 5 0 1122473515 1703149568 387474 4294967295 134512640 135237372 3220683456 3076476720 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=1663232 CPUtime=382.71
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 102939 0 0 0 38213 58 0 0 25 0 5 0 1122473515 1703149568 387474 4294967295 134512640 135237372 3220683456 3068073584 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=1663232 CPUtime=365.41
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 87964 0 0 0 36485 56 0 0 25 0 5 0 1122473515 1703149568 387474 4294967295 134512640 135237372 3220683456 3059685632 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1506.42
Current children cumulated vsize (KiB) 1663232

[startup+762.318 s]
/proc/loadavg: 6.74 6.38 5.10 8/110 11101
/proc/meminfo: memFree=381580/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=1755692 CPUtime=1649.3
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 410642 0 0 0 164683 247 0 0 25 0 5 0 1122473379 1797828608 409316 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 438923 409316 95 177 0 438745 0
[pid=8869/tid=8871] ppid=8867 vsize=1755692 CPUtime=417.75
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 78975 0 0 0 41724 51 0 0 25 0 5 0 1122473515 1797828608 409316 4294967295 134512640 135237372 3220683456 3084864544 134562380 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=1755692 CPUtime=410.81
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 123770 0 0 0 41006 75 0 0 25 0 5 0 1122473515 1797828608 409316 4294967295 134512640 135237372 3220683456 3076486576 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=1755692 CPUtime=412.47
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 108095 0 0 0 41186 61 0 0 25 0 5 0 1122473515 1797828608 409316 4294967295 134512640 135237372 3220683456 3068087664 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=1755692 CPUtime=406.91
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 92516 0 0 0 40633 58 0 0 25 0 5 0 1122473515 1797828608 409316 4294967295 134512640 135237372 3220683456 3059687184 134562320 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1649.3
Current children cumulated vsize (KiB) 1755692

[startup+822.304 s]
/proc/loadavg: 6.58 6.40 5.19 8/110 11238
/proc/meminfo: memFree=244860/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=1899732 CPUtime=1795.85
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 445126 0 0 0 179308 277 0 0 25 0 5 0 1122473379 1945325568 443800 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 474933 443800 95 177 0 474755 0
[pid=8869/tid=8871] ppid=8867 vsize=1899732 CPUtime=466.07
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 83968 0 0 0 46549 58 0 0 25 0 5 0 1122473515 1945325568 443800 4294967295 134512640 135237372 3220683456 3084863936 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=1899732 CPUtime=446.3
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 136659 0 0 0 44549 81 0 0 25 0 5 0 1122473515 1945325568 443800 4294967295 134512640 135237372 3220683456 3076476256 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=1899732 CPUtime=442.31
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 112624 0 0 0 44164 67 0 0 25 0 5 0 1122473515 1945325568 443800 4294967295 134512640 135237372 3220683456 3068076064 134562290 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=1899732 CPUtime=439.81
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 104589 0 0 0 43912 69 0 0 25 0 5 0 1122473515 1945325568 443800 4294967295 134512640 135237372 3220683456 3059678992 134562388 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1795.85
Current children cumulated vsize (KiB) 1899732

[startup+882.32 s]
/proc/loadavg: 6.51 6.41 5.27 9/110 11391
/proc/meminfo: memFree=126276/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=2028276 CPUtime=1942.66
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 475916 0 0 0 193973 293 0 0 25 0 5 0 1122473379 2076954624 474590 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 507069 474590 95 177 0 506891 0
[pid=8869/tid=8871] ppid=8867 vsize=2028276 CPUtime=498.12
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 87690 0 0 0 49752 60 0 0 25 0 5 0 1122473515 2076954624 474590 4294967295 134512640 135237372 3220683456 3084852288 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=2028276 CPUtime=491.28
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 148355 0 0 0 49041 87 0 0 25 0 5 0 1122473515 2076954624 474590 4294967295 134512640 135237372 3220683456 3076495840 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=2028276 CPUtime=475.21
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 117470 0 0 0 47452 69 0 0 25 0 5 0 1122473515 2076954624 474590 4294967295 134512640 135237372 3220683456 3068087424 134562328 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=2028276 CPUtime=476.69
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 115115 0 0 0 47594 75 0 0 25 0 5 0 1122473515 2076954624 474590 4294967295 134512640 135237372 3220683456 3059658656 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1942.66
Current children cumulated vsize (KiB) 2028276



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+918.717 s]
/proc/loadavg: 6.71 6.48 5.34 7/109 11524
/proc/meminfo: memFree=126036/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=2097044 CPUtime=2033.54
/proc/8869/stat : 8869 (ttsth-5-0) S 8867 8869 2540 0 -1 4202496 491704 0 0 0 203054 300 0 0 25 0 5 0 1122473379 2147373056 490378 4294967295 134512640 135237372 3220683456 3220683052 134629544 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 524261 490378 95 177 0 524083 0
[pid=8869/tid=8871] ppid=8867 vsize=2097044 CPUtime=516.25
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 89665 0 0 0 51564 61 0 0 25 0 5 0 1122473515 2147373056 490379 4294967295 134512640 135237372 3220683456 3084852512 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=8869/tid=8872] ppid=8867 vsize=2097044 CPUtime=512.12
/proc/8869/task/8872/stat : 8872 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 152469 0 0 0 51125 87 0 0 25 0 5 0 1122473515 2147373056 490379 4294967295 134512640 135237372 3220683456 3076494768 134680467 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=8869/tid=8873] ppid=8867 vsize=2097044 CPUtime=509.05
/proc/8869/task/8873/stat : 8873 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 122631 0 0 0 50830 75 0 0 25 0 5 0 1122473515 2147373056 490380 4294967295 134512640 135237372 3220683456 3068086336 134546034 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=8869/tid=8874] ppid=8867 vsize=2097044 CPUtime=494.76
/proc/8869/task/8874/stat : 8874 (ttsth-5-0) R 8867 8869 2540 0 -1 4202560 119655 0 0 0 49401 75 0 0 25 0 5 0 1122473515 2147373056 490380 4294967295 134512640 135237372 3220683456 3059677904 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2033.54
Current children cumulated vsize (KiB) 2097044

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+918.837 s]
/proc/loadavg: 6.71 6.48 5.34 7/109 11524
/proc/meminfo: memFree=126036/3368532 swapFree=1954076/1959888
[pid=8869] ppid=8867 vsize=0 CPUtime=2033.67
/proc/8869/stat : 8869 (ttsth-5-0) Z 8867 8869 2540 0 -1 4203524 491715 0 0 0 203058 309 0 0 18 0 2 0 1122473379 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 3 0 0 0
/proc/8869/statm: 0 0 0 0 0 0 0
[pid=8869/tid=8871] ppid=8867 vsize=0 CPUtime=516.34
/proc/8869/task/8871/stat : 8871 (ttsth-5-0) R 8867 8869 2540 0 -1 4203588 89665 0 0 0 51564 70 0 0 25 0 2 0 1122473515 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2033.67
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 918.861
CPU time (s): 2033.69
CPU user time (s): 2030.58
CPU system time (s): 3.11
CPU usage (%): 221.327
Max. virtual memory (cumulated for all children) (KiB): 2097044

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2030.58
system time used= 3.11
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 491715
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 648
involuntary context switches= 43812

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on tipi44 at 2009-05-30 13:42:02
IDJOB=1780783
IDBENCH=71066
IDSOLVER=632
FILE ID=tipi44/1780783-1243683722
PBS_JOBID=
Free space on /tmp= 15892 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rbcl_xits_10_UNKNOWN.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1780783-1243683722/watcher-1780783-1243683722 -o /tmp/evaluation-result-1780783-1243683722/solver-1780783-1243683722 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1780783-1243683722.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= e868383f091c36fa9594c670095c9824
RANDOM SEED= 1915493625

Linux tipi44 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.116
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.116
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.116
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.116
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2026732 kB
Buffers:        191132 kB
Cached:         806392 kB
SwapCached:       2152 kB
Active:         898088 kB
Inactive:       333056 kB
HighTotal:     2489216 kB
HighFree:      1463460 kB
LowTotal:       879316 kB
LowFree:        563272 kB
SwapTotal:     1959888 kB
SwapFree:      1954076 kB
Dirty:            3588 kB
Writeback:           0 kB
AnonPages:      232672 kB
Mapped:           5676 kB
Slab:            99564 kB
SReclaimable:    89308 kB
SUnreclaim:      10256 kB
PageTables:        808 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   315608 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15892 MiB
End job on tipi44 at 2009-05-30 13:57:23