Trace number 1781158

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (MO) 2882.47 789.739

General information on the benchmark

NameAPPLICATIONS/satComp09_BioInstances/
rpoc_xits_10_UNKNOWN.cnf
MD5SUM8ece32bbd9e6c3f5c8cdf0e94e0569cd
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1584
Number of clauses100116
Sum of the clauses size297952
Maximum clause length11
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22580
Number of clauses of size 397513
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 523

Solver Data 

0.10/0.16	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781158-1243685875.cnf 
0.10/0.16	c Using SATTIMEOUT of 10000
0.10/0.16	c Using SATRAM of 2047
0.10/0.16	c Size of subset node = 16
0.10/0.16	c Variables = 1584
0.10/0.16	c Clauses = 100116
0.10/0.16	c Literals = 297952
0.10/0.16	c Reduced size:
0.10/0.16	c Variables = 1584
0.10/0.16	c Clauses = 100116
0.10/0.16	c Literals = 297952
0.10/0.16	c a2
0.40/0.42	c a1
0.80/0.89	c Independent sub-problems = 1
0.80/0.89	c Sub-problem with 1584 variables and 100116 clauses
0.80/0.89	c using permutation method 4
0.80/0.89	c count = 1
0.80/0.89	c Ordering finished 0.830 seconds
0.80/0.89	c mapped 0.880 seconds
0.80/0.89	c permuted 0.880 seconds
0.80/0.89	c about to sort
0.90/0.92	c sorted
1.40/1.46	c clauses now 100116
1.40/1.46	c init finished 0.930 seconds
1.40/1.46	c tree built 1.450 seconds
1.40/1.46	c 
1.40/1.46	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
1.40/1.46	c ---------------------------------|----------------------------------|------------------------------------------------------
1.40/1.46	c ................................ | ..........                       |                        1.4           0.0             
1.40/1.46	c ................................ | ..........                     1 |                        1.4           0.7             
1.40/1.46	c ................................ | ..........                     2 |                        1.4           1.4             
1.40/1.46	c ................................ | ..........                     3 |                        1.4           2.1             
1.40/1.46	c ................................ | ..........                     4 |                        1.4           2.8             
1.40/1.46	c ................................ | ..........                     5 |                        1.4           3.4             
1.40/1.47	c ................................ | ..........                  1000 | 4                      1.5         684.9          431
200.02/55.86	c ................................ | ..........               1017000 | 103928               200.2        5078.7     15975765
400.60/110.86	c ................................ | ..........               1401000 | 151449               400.5        3498.3     28931991
599.83/165.29	c ................................ | ..........               1734000 | 197880               600.1        2889.3     39126977
800.03/220.02	c ................................ | ..........               2174000 | 267163               800.0        2717.4     48961359
1000.24/274.95	c ................................ | *.........               2517000 | 299825              1000.4        2516.0     56619319
1200.54/329.82	c ................................ | *.........               2778000 | 324276              1200.6        2313.9     63841591
1400.59/384.61	c ................................ | *.........               3018000 | 352493              1400.6        2154.7     71210281
1601.77/439.60	c ................................ | *.........               3237000 | 374570              1601.8        2020.9     77627727
1800.14/493.85	c ................................ | *.........               3404000 | 392777              1800.3        1890.8     83761225
2000.16/548.47	c ................................ | **........               3581000 | 412502              2000.4        1790.2     89940665

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1781158-1243685875/watcher-1781158-1243685875 -o /tmp/evaluation-result-1781158-1243685875/solver-1781158-1243685875 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781158-1243685875.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 4.90 5.24 4.86 4/104 12138
/proc/meminfo: memFree=2990268/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=1144 CPUtime=0
/proc/12138/stat : 12138 (ttsth-5-0) R 12136 12138 30226 0 -1 4202496 177 0 0 0 0 0 0 0 18 0 1 0 950164301 1171456 132 4294967295 134512640 135237372 3219503520 3219502968 134732614 0 0 0 0 0 0 0 17 2 0 0 0
/proc/12138/statm: 286 132 75 177 0 108 0

[startup+0.0889 s]
/proc/loadavg: 4.90 5.24 4.86 4/104 12138
/proc/meminfo: memFree=2990268/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=4808 CPUtime=0.08
/proc/12138/stat : 12138 (ttsth-5-0) R 12136 12138 30226 0 -1 4202496 1075 0 0 0 8 0 0 0 18 0 1 0 950164301 4923392 1030 4294967295 134512640 135237372 3219503520 3219502044 134639534 0 0 0 0 0 0 0 17 1 0 0 0
/proc/12138/statm: 1202 1030 75 177 0 1024 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 4808

[startup+0.108897 s]
/proc/loadavg: 4.90 5.24 4.86 4/104 12138
/proc/meminfo: memFree=2990268/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=5600 CPUtime=0.1
/proc/12138/stat : 12138 (ttsth-5-0) R 12136 12138 30226 0 -1 4202496 1279 0 0 0 10 0 0 0 18 0 1 0 950164301 5734400 1234 4294967295 134512640 135237372 3219503520 3219502968 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/12138/statm: 1400 1234 75 177 0 1222 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 5600

[startup+0.30888 s]
/proc/loadavg: 4.90 5.24 4.86 4/104 12138
/proc/meminfo: memFree=2990268/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=14420 CPUtime=0.3
/proc/12138/stat : 12138 (ttsth-5-0) R 12136 12138 30226 0 -1 4202496 3421 0 0 0 28 2 0 0 18 0 1 0 950164301 14766080 3375 4294967295 134512640 135237372 3219503520 3219502048 134680308 0 0 0 0 0 0 0 17 1 0 0 0
/proc/12138/statm: 3605 3375 76 177 0 3427 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 14420

[startup+0.708848 s]
/proc/loadavg: 4.90 5.24 4.86 4/104 12138
/proc/meminfo: memFree=2990268/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=15060 CPUtime=0.7
/proc/12138/stat : 12138 (ttsth-5-0) R 12136 12138 30226 0 -1 4202496 3873 0 0 0 68 2 0 0 18 0 1 0 950164301 15421440 3631 4294967295 134512640 135237372 3219503520 3219502848 134555272 0 0 0 0 0 0 0 17 1 0 0 0
/proc/12138/statm: 3765 3631 77 177 0 3587 0
Current children cumulated CPU time (s) 0.7
Current children cumulated vsize (KiB) 15060

[startup+1.50879 s]
/proc/loadavg: 4.90 5.24 4.86 3/105 12139
/proc/meminfo: memFree=2974432/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=60344 CPUtime=1.57
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 6915 0 0 0 155 2 0 0 20 0 5 0 950164301 61792256 6477 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 15086 6477 95 177 0 14908 0
Current children cumulated CPU time (s) 1.57
Current children cumulated vsize (KiB) 60344

[startup+3.10866 s]
/proc/loadavg: 4.90 5.24 4.86 6/109 12143
/proc/meminfo: memFree=2960020/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=74448 CPUtime=7.31
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 10478 0 0 0 728 3 0 0 20 0 5 0 950164301 76234752 10040 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 18612 10040 95 177 0 18434 0
[pid=12138/tid=12140] ppid=12136 vsize=74448 CPUtime=1.54
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 893 0 0 0 154 0 0 0 25 0 5 0 950164447 76234752 10040 4294967295 134512640 135237372 3219503520 3085611568 134589109 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=74448 CPUtime=1.64
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 1019 0 0 0 164 0 0 0 25 0 5 0 950164447 76234752 10040 4294967295 134512640 135237372 3219503520 3077170976 134588043 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=74448 CPUtime=1.06
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 770 0 0 0 105 1 0 0 24 0 5 0 950164447 76234752 10041 4294967295 134512640 135237372 3219503520 3068798112 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=74448 CPUtime=1.62
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 1089 0 0 0 162 0 0 0 25 0 5 0 950164448 76234752 10041 4294967295 134512640 135237372 3219503520 3060413488 134588108 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 7.31
Current children cumulated vsize (KiB) 74448

[startup+6.3084 s]
/proc/loadavg: 4.91 5.24 4.86 7/109 12143
/proc/meminfo: memFree=2932792/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=100268 CPUtime=19.04
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 16598 0 0 0 1898 6 0 0 20 0 5 0 950164301 102674432 16160 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 25067 16161 95 177 0 24889 0
[pid=12138/tid=12140] ppid=12136 vsize=100268 CPUtime=4.74
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 2515 0 0 0 474 0 0 0 25 0 5 0 950164447 102674432 16161 4294967295 134512640 135237372 3219503520 3085579872 134749353 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=100268 CPUtime=4.82
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 2755 0 0 0 480 2 0 0 25 0 5 0 950164447 102674432 16161 4294967295 134512640 135237372 3219503520 3077187024 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=100268 CPUtime=3.21
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 2004 0 0 0 320 1 0 0 25 0 5 0 950164447 102674432 16161 4294967295 134512640 135237372 3219503520 3068820096 134590129 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=100268 CPUtime=4.82
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 2617 0 0 0 481 1 0 0 25 0 5 0 950164448 102674432 16161 4294967295 134512640 135237372 3219503520 3060384592 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 19.04
Current children cumulated vsize (KiB) 100268

[startup+12.7079 s]
/proc/loadavg: 4.91 5.23 4.86 9/110 12188
/proc/meminfo: memFree=2891932/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=139436 CPUtime=42.31
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 25859 0 0 0 4218 13 0 0 20 0 5 0 950164301 142782464 25421 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 34859 25421 95 177 0 34681 0
[pid=12138/tid=12140] ppid=12136 vsize=139436 CPUtime=10.27
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 4990 0 0 0 1025 2 0 0 25 0 5 0 950164447 142782464 25421 4294967295 134512640 135237372 3219503520 3085584064 134590245 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=139436 CPUtime=11.19
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 5072 0 0 0 1114 5 0 0 25 0 5 0 950164447 142782464 25421 4294967295 134512640 135237372 3219503520 3077177420 134636641 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=139436 CPUtime=8.26
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 4535 0 0 0 824 2 0 0 25 0 5 0 950164447 142782464 25421 4294967295 134512640 135237372 3219503520 3068793536 134551008 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=139436 CPUtime=11.14
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 4554 0 0 0 1112 2 0 0 25 0 5 0 950164448 142782464 25421 4294967295 134512640 135237372 3219503520 3060408256 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 42.31
Current children cumulated vsize (KiB) 139436

[startup+25.5068 s]
/proc/loadavg: 4.93 5.22 4.86 6/109 12327
/proc/meminfo: memFree=2829244/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=204728 CPUtime=89.03
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 41227 0 0 0 8881 22 0 0 20 0 5 0 950164301 209641472 40789 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 51182 40789 95 177 0 51004 0
[pid=12138/tid=12140] ppid=12136 vsize=204728 CPUtime=22.66
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 8451 0 0 0 2263 3 0 0 25 0 5 0 950164447 209641472 40789 4294967295 134512640 135237372 3219503520 3085588064 134751534 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=204728 CPUtime=23.98
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 9177 0 0 0 2391 7 0 0 25 0 5 0 950164447 209641472 40789 4294967295 134512640 135237372 3219503520 3077188944 134561426 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=204728 CPUtime=17.01
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 7838 0 0 0 1698 3 0 0 25 0 5 0 950164447 209641472 40789 4294967295 134512640 135237372 3219503520 3068787968 134562328 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=204728 CPUtime=23.93
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 9053 0 0 0 2386 7 0 0 25 0 5 0 950164448 209641472 40789 4294967295 134512640 135237372 3219503520 3060443728 134562344 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 89.03
Current children cumulated vsize (KiB) 204728

[startup+51.1047 s]
/proc/loadavg: 5.08 5.23 4.87 6/109 12331
/proc/meminfo: memFree=2733316/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=307996 CPUtime=182.83
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 65570 0 0 0 18249 34 0 0 20 0 5 0 950164301 315387904 65132 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 76999 65132 95 177 0 76821 0
[pid=12138/tid=12140] ppid=12136 vsize=307996 CPUtime=48.26
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 13322 0 0 0 4821 5 0 0 25 0 5 0 950164447 315387904 65132 4294967295 134512640 135237372 3219503520 3085581824 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=307996 CPUtime=49.58
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 16030 0 0 0 4947 11 0 0 25 0 5 0 950164447 315387904 65132 4294967295 134512640 135237372 3219503520 3077189712 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=307996 CPUtime=34.1
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 11662 0 0 0 3406 4 0 0 25 0 5 0 950164447 315387904 65132 4294967295 134512640 135237372 3219503520 3068807648 134566099 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=307996 CPUtime=49.44
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 17848 0 0 0 4932 12 0 0 25 0 5 0 950164448 315387904 65132 4294967295 134512640 135237372 3219503520 3060389472 134565869 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 182.83
Current children cumulated vsize (KiB) 307996

[startup+102.311 s]
/proc/loadavg: 5.12 5.21 4.88 6/109 12516
/proc/meminfo: memFree=2536148/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=511580 CPUtime=369.45
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 114194 0 0 0 36877 68 0 0 20 0 5 0 950164301 523857920 113756 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 127895 113756 95 177 0 127717 0
[pid=12138/tid=12140] ppid=12136 vsize=511580 CPUtime=86.32
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 18646 0 0 0 8626 6 0 0 25 0 5 0 950164447 523857920 113756 4294967295 134512640 135237372 3219503520 3085583968 134680251 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=511580 CPUtime=100.29
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 34813 0 0 0 10009 20 0 0 25 0 5 0 950164447 523857920 113756 4294967295 134512640 135237372 3219503520 3077177200 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=511580 CPUtime=80.89
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 21731 0 0 0 8076 13 0 0 25 0 5 0 950164447 523857920 113756 4294967295 134512640 135237372 3219503520 3068788400 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=511580 CPUtime=100.5
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 32296 0 0 0 10023 27 0 0 25 0 5 0 950164448 523857920 113756 4294967295 134512640 135237372 3219503520 3060408192 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 369.45
Current children cumulated vsize (KiB) 511580

[startup+162.316 s]
/proc/loadavg: 5.21 5.22 4.91 6/109 12705
/proc/meminfo: memFree=2360696/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=698728 CPUtime=589.23
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 158367 0 0 0 58821 102 0 0 20 0 5 0 950164301 715497472 157929 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 174682 157929 95 177 0 174504 0
[pid=12138/tid=12140] ppid=12136 vsize=698728 CPUtime=126.33
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 23846 0 0 0 12622 11 0 0 25 0 5 0 950164447 715497472 157929 4294967295 134512640 135237372 3219503520 3085588608 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=698728 CPUtime=160.22
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 53703 0 0 0 15992 30 0 0 25 0 5 0 950164447 715497472 157929 4294967295 134512640 135237372 3219503520 3077170368 134562341 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=698728 CPUtime=140.83
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 34911 0 0 0 14060 23 0 0 25 0 5 0 950164447 715497472 157929 4294967295 134512640 135237372 3219503520 3068784560 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=698728 CPUtime=160.4
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 39199 0 0 0 16004 36 0 0 25 0 5 0 950164448 715497472 157929 4294967295 134512640 135237372 3219503520 3060398768 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 589.23
Current children cumulated vsize (KiB) 698728

[startup+222.311 s]
/proc/loadavg: 5.24 5.22 4.93 6/109 12893
/proc/meminfo: memFree=2190508/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=877644 CPUtime=808.44
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 200620 0 0 0 80710 134 0 0 20 0 5 0 950164301 898707456 200182 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 219411 200182 95 177 0 219233 0
[pid=12138/tid=12140] ppid=12136 vsize=877644 CPUtime=170.14
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 33767 0 0 0 16999 15 0 0 25 0 5 0 950164447 898707456 200182 4294967295 134512640 135237372 3219503520 3085607392 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=877644 CPUtime=219.95
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 68620 0 0 0 21952 43 0 0 25 0 5 0 950164447 898707456 200182 4294967295 134512640 135237372 3219503520 3077158928 134562344 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=877644 CPUtime=196.57
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 45476 0 0 0 19627 30 0 0 25 0 5 0 950164447 898707456 200182 4294967295 134512640 135237372 3219503520 3068787008 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=877644 CPUtime=220.33
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 46049 0 0 0 21989 44 0 0 25 0 5 0 950164448 898707456 200182 4294967295 134512640 135237372 3219503520 3060419872 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 808.44
Current children cumulated vsize (KiB) 877644


################
# More data... #
################

/proc/meminfo: memFree=1933864/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=1149128 CPUtime=1245.83
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 264723 0 0 0 124398 185 0 0 20 0 5 0 950164301 1176707072 264285 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 287282 264285 95 177 0 287104 0
[pid=12138/tid=12140] ppid=12136 vsize=1149128 CPUtime=290.13
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 49404 0 0 0 28989 24 0 0 25 0 5 0 950164447 1176707072 264285 4294967295 134512640 135237372 3219503520 3085585152 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=1149128 CPUtime=325.16
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 91502 0 0 0 32457 59 0 0 25 0 5 0 950164447 1176707072 264285 4294967295 134512640 135237372 3219503520 3077187328 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=1149128 CPUtime=288.96
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 57530 0 0 0 28856 40 0 0 25 0 5 0 950164447 1176707072 264285 4294967295 134512640 135237372 3219503520 3068820800 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=1149128 CPUtime=340.13
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 59579 0 0 0 33953 60 0 0 25 0 5 0 950164448 1176707072 264285 4294967295 134512640 135237372 3219503520 3060409424 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1245.83
Current children cumulated vsize (KiB) 1149128

[startup+402.306 s]
/proc/loadavg: 5.72 5.45 5.06 8/105 13461
/proc/meminfo: memFree=1815376/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=1276652 CPUtime=1465.04
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 295042 0 0 0 146299 205 0 0 20 0 5 0 950164301 1307291648 294604 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 319163 294604 95 177 0 318985 0
[pid=12138/tid=12140] ppid=12136 vsize=1276652 CPUtime=350.07
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 56121 0 0 0 34978 29 0 0 25 0 5 0 950164447 1307291648 294604 4294967295 134512640 135237372 3219503520 3085585616 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=1276652 CPUtime=378.96
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 101609 0 0 0 37835 61 0 0 25 0 5 0 950164447 1307291648 294604 4294967295 134512640 135237372 3219503520 3077190400 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=1276652 CPUtime=334.6
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 64947 0 0 0 33415 45 0 0 25 0 5 0 950164447 1307291648 294604 4294967295 134512640 135237372 3219503520 3068781104 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=1276652 CPUtime=399.96
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 65657 0 0 0 39928 68 0 0 25 0 5 0 950164448 1307291648 294604 4294967295 134512640 135237372 3219503520 3060398064 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1465.04
Current children cumulated vsize (KiB) 1276652

[startup+462.311 s]
/proc/loadavg: 5.62 5.44 5.08 6/105 13650
/proc/meminfo: memFree=1706644/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=1391216 CPUtime=1684.66
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 321878 0 0 0 168242 224 0 0 20 0 5 0 950164301 1424605184 321440 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 347804 321440 95 177 0 347626 0
[pid=12138/tid=12140] ppid=12136 vsize=1391216 CPUtime=407.63
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 62011 0 0 0 40733 30 0 0 25 0 5 0 950164447 1424605184 321440 4294967295 134512640 135237372 3219503520 3085582304 134552745 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=1391216 CPUtime=423.54
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 109516 0 0 0 42288 66 0 0 25 0 5 0 950164447 1424605184 321440 4294967295 134512640 135237372 3219503520 3077172976 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=1391216 CPUtime=394.36
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 73635 0 0 0 39388 48 0 0 25 0 5 0 950164447 1424605184 321440 4294967295 134512640 135237372 3219503520 3068814032 134562420 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=1391216 CPUtime=457.68
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 70008 0 0 0 45690 78 0 0 25 0 5 0 950164448 1424605184 321440 4294967295 134512640 135237372 3219503520 3060398544 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1684.66
Current children cumulated vsize (KiB) 1391216

[startup+522.316 s]
/proc/loadavg: 5.26 5.37 5.08 6/105 13838
/proc/meminfo: memFree=1603588/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=1501144 CPUtime=1904.51
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 347752 0 0 0 190210 241 0 0 20 0 5 0 950164301 1537171456 347314 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 375286 347314 95 177 0 375108 0
[pid=12138/tid=12140] ppid=12136 vsize=1501144 CPUtime=447.62
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 67028 0 0 0 44727 35 0 0 25 0 5 0 950164447 1537171456 347314 4294967295 134512640 135237372 3219503520 3085585360 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=1501144 CPUtime=483.54
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 119742 0 0 0 48284 70 0 0 25 0 5 0 950164447 1537171456 347314 4294967295 134512640 135237372 3219503520 3077186800 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=1501144 CPUtime=454.27
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 80438 0 0 0 45376 51 0 0 25 0 5 0 950164447 1537171456 347314 4294967295 134512640 135237372 3219503520 3068798304 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=1501144 CPUtime=517.63
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 73836 0 0 0 51680 83 0 0 25 0 5 0 950164448 1537171456 347314 4294967295 134512640 135237372 3219503520 3060398416 134562278 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1904.51
Current children cumulated vsize (KiB) 1501144

[startup+582.311 s]
/proc/loadavg: 5.09 5.30 5.07 6/105 14026
/proc/meminfo: memFree=1483524/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=1625836 CPUtime=2124.16
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 377553 0 0 0 212155 261 0 0 20 0 5 0 950164301 1664856064 377115 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 406459 377115 95 177 0 406281 0
[pid=12138/tid=12140] ppid=12136 vsize=1625836 CPUtime=487.43
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 70891 0 0 0 48698 45 0 0 25 0 5 0 950164447 1664856064 377115 4294967295 134512640 135237372 3219503520 3085584288 134562341 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=1625836 CPUtime=543.49
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 135641 0 0 0 54273 76 0 0 25 0 5 0 950164447 1664856064 377115 4294967295 134512640 135237372 3219503520 3077196752 134562309 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=1625836 CPUtime=514.19
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 86446 0 0 0 51365 54 0 0 25 0 5 0 950164447 1664856064 377115 4294967295 134512640 135237372 3219503520 3068788592 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=1625836 CPUtime=577.6
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 77867 0 0 0 57676 84 0 0 25 0 5 0 950164448 1664856064 377115 4294967295 134512640 135237372 3219503520 3060390288 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2124.16
Current children cumulated vsize (KiB) 1625836

[startup+642.316 s]
/proc/loadavg: 5.35 5.33 5.10 6/105 14214
/proc/meminfo: memFree=1323424/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=1796732 CPUtime=2343.98
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 417530 0 0 0 234105 293 0 0 20 0 5 0 950164301 1839853568 417092 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 449183 417092 95 177 0 449005 0
[pid=12138/tid=12140] ppid=12136 vsize=1796732 CPUtime=533.48
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 74582 0 0 0 53292 56 0 0 25 0 5 0 950164447 1839853568 417092 4294967295 134512640 135237372 3219503520 3085585696 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=1796732 CPUtime=603.5
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 155966 0 0 0 60257 93 0 0 25 0 5 0 950164447 1839853568 417092 4294967295 134512640 135237372 3219503520 3077200880 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=1796732 CPUtime=574.06
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 95444 0 0 0 57349 57 0 0 25 0 5 0 950164447 1839853568 417092 4294967295 134512640 135237372 3219503520 3068818560 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=1796732 CPUtime=631.49
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 84830 0 0 0 63064 85 0 0 25 0 5 0 950164448 1839853568 417092 4294967295 134512640 135237372 3219503520 3060418780 134636641 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2343.98
Current children cumulated vsize (KiB) 1796732

[startup+702.311 s]
/proc/loadavg: 5.41 5.36 5.12 6/105 14400
/proc/meminfo: memFree=1207976/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=1919036 CPUtime=2562.82
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 446519 0 0 0 255967 315 0 0 20 0 5 0 950164301 1965092864 446081 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 479759 446081 95 177 0 479581 0
[pid=12138/tid=12140] ppid=12136 vsize=1919036 CPUtime=593.42
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 78829 0 0 0 59279 63 0 0 25 0 5 0 950164447 1965092864 446081 4294967295 134512640 135237372 3219503520 3085586640 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=1919036 CPUtime=662.41
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 170829 0 0 0 66138 103 0 0 25 0 5 0 950164447 1965092864 446081 4294967295 134512640 135237372 3219503520 3077197648 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=1919036 CPUtime=617.76
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 100303 0 0 0 61716 60 0 0 25 0 5 0 950164447 1965092864 446081 4294967295 134512640 135237372 3219503520 3068790448 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=1919036 CPUtime=687.78
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 89850 0 0 0 68691 87 0 0 25 0 5 0 950164448 1965092864 446081 4294967295 134512640 135237372 3219503520 3060409312 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2562.82
Current children cumulated vsize (KiB) 1919036

[startup+762.316 s]
/proc/loadavg: 5.46 5.37 5.13 6/105 14593
/proc/meminfo: memFree=1094540/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=2038268 CPUtime=2782.24
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 474535 0 0 0 277886 338 0 0 20 0 5 0 950164301 2087186432 474097 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 509567 474097 95 177 0 509389 0
[pid=12138/tid=12140] ppid=12136 vsize=2038268 CPUtime=653.34
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 82847 0 0 0 65265 69 0 0 25 0 5 0 950164447 2087186432 474097 4294967295 134512640 135237372 3219503520 3085589648 134561481 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=2038268 CPUtime=718.71
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 184225 0 0 0 71757 114 0 0 25 0 5 0 950164447 2087186432 474097 4294967295 134512640 135237372 3219503520 3077196512 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=2038268 CPUtime=660.96
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 105099 0 0 0 66032 64 0 0 25 0 5 0 950164447 2087186432 474097 4294967295 134512640 135237372 3219503520 3068814464 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=2038268 CPUtime=747.78
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 95656 0 0 0 74689 89 0 0 25 0 5 0 950164448 2087186432 474097 4294967295 134512640 135237372 3219503520 3060398768 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2782.24
Current children cumulated vsize (KiB) 2038268



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+789.604 s]
/proc/loadavg: 5.39 5.36 5.14 6/105 14596
/proc/meminfo: memFree=1038900/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=2096452 CPUtime=2882.29
/proc/12138/stat : 12138 (ttsth-5-0) S 12136 12138 30226 0 -1 4202496 488539 0 0 0 287879 350 0 0 20 0 5 0 950164301 2146766848 488101 4294967295 134512640 135237372 3219503520 3219503116 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 524113 488101 95 177 0 523935 0
[pid=12138/tid=12140] ppid=12136 vsize=2096452 CPUtime=680.62
/proc/12138/task/12140/stat : 12140 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 84851 0 0 0 67990 72 0 0 25 0 5 0 950164447 2146766848 488101 4294967295 134512640 135237372 3219503520 3085584112 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=2096452 CPUtime=736.9
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 188467 0 0 0 73575 115 0 0 25 0 5 0 950164447 2146766848 488101 4294967295 134512640 135237372 3219503520 3077195504 134562363 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=12138/tid=12142] ppid=12136 vsize=2096452 CPUtime=688.25
/proc/12138/task/12142/stat : 12142 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 109566 0 0 0 68755 70 0 0 25 0 5 0 950164447 2146766848 488101 4294967295 134512640 135237372 3219503520 3068807952 134562290 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=12138/tid=12143] ppid=12136 vsize=2096452 CPUtime=775.07
/proc/12138/task/12143/stat : 12143 (ttsth-5-0) R 12136 12138 30226 0 -1 4202560 98947 0 0 0 77416 91 0 0 25 0 5 0 950164448 2146766848 488101 4294967295 134512640 135237372 3219503520 3060381040 134546026 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2882.29
Current children cumulated vsize (KiB) 2096452

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+789.724 s]
/proc/loadavg: 5.39 5.36 5.14 3/103 14597
/proc/meminfo: memFree=2736756/3368532 swapFree=1959840/1959888
[pid=12138] ppid=12136 vsize=0 CPUtime=2882.46
/proc/12138/stat : 12138 (ttsth-5-0) Z 12136 12138 30226 0 -1 4203524 488554 0 0 0 287887 359 0 0 18 0 2 0 950164301 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/12138/statm: 0 0 0 0 0 0 0
[pid=12138/tid=12141] ppid=12136 vsize=0 CPUtime=737.01
/proc/12138/task/12141/stat : 12141 (ttsth-5-0) R 12136 12138 30226 0 -1 4203588 188475 0 0 0 73577 124 0 0 25 0 2 0 950164447 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2882.46
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 789.739
CPU time (s): 2882.47
CPU user time (s): 2878.87
CPU system time (s): 3.6
CPU usage (%): 364.99
Max. virtual memory (cumulated for all children) (KiB): 2096452

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2878.87
system time used= 3.6
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 488554
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1061
involuntary context switches= 58829

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on tipi39 at 2009-05-30 14:17:55
IDJOB=1781158
IDBENCH=71101
IDSOLVER=632
FILE ID=tipi39/1781158-1243685875
PBS_JOBID=
Free space on /tmp= 5742 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT09/APPLICATIONS/satComp09_BioInstances/rpoc_xits_10_UNKNOWN.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1781158-1243685875/watcher-1781158-1243685875 -o /tmp/evaluation-result-1781158-1243685875/solver-1781158-1243685875 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1781158-1243685875.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 8ece32bbd9e6c3f5c8cdf0e94e0569cd
RANDOM SEED= 1009929151

Linux tipi39 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.10
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.16
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.067
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2990268 kB
Buffers:        118596 kB
Cached:         135576 kB
SwapCached:          0 kB
Active:         168780 kB
Inactive:       104140 kB
HighTotal:     2489216 kB
HighFree:      2337624 kB
LowTotal:       879316 kB
LowFree:        652644 kB
SwapTotal:     1959888 kB
SwapFree:      1959840 kB
Dirty:            2480 kB
Writeback:           0 kB
AnonPages:       18764 kB
Mapped:           8032 kB
Slab:            95268 kB
SReclaimable:    84660 kB
SUnreclaim:      10608 kB
PageTables:        588 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   102444 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 5742 MiB
End job on tipi39 at 2009-05-30 14:31:07