Trace number 1776913

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (TO) 3854.58 1000.11

General information on the benchmark

Namemizh-md5-47-4.cnf
MD5SUMb0a37265834986ac9165bda379d279fd
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark522.09
Satisfiable
(Un)Satisfiability was proved
Number of variables65604
Number of clauses273506
Sum of the clauses size814918
Maximum clause length4
Minimum clause length1
Number of clauses of size 1199
Number of clauses of size 2118244
Number of clauses of size 342021
Number of clauses of size 4113042
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

1.71/1.78	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1776913-1243676791.cnf 
1.71/1.78	c Using SATTIMEOUT of 10000
1.71/1.78	c Using SATRAM of 2047
1.71/1.78	c Size of subset node = 16
1.71/1.78	c Variables = 65604
1.71/1.78	c Clauses = 273506
1.71/1.78	c Literals = 814918
1.71/1.78	c Reduced size:
1.71/1.78	c Variables = 65604
1.71/1.78	c Clauses = 233565
1.71/1.78	c Literals = 673193
1.71/1.78	c a2
2.31/2.33	c a1
45.13/45.27	c Independent sub-problems = 1
45.13/45.27	c Sub-problem with 60286 variables and 233565 clauses
45.13/45.27	c using permutation method 4
45.13/45.27	c count = 1
45.13/45.27	c Ordering finished 45.100 seconds
45.13/45.27	c mapped 45.200 seconds
45.13/45.27	c permuted 45.200 seconds
45.13/45.27	c about to sort
45.23/45.35	c sorted
46.53/46.68	c clauses now 233565
46.53/46.68	c init finished 45.680 seconds
46.53/46.68	c tree built 46.610 seconds
46.53/46.68	c 
46.53/46.68	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
46.53/46.68	c ---------------------------------|----------------------------------|------------------------------------------------------
46.53/46.68	c ................................ | ..........                       |                       46.6           0.0             
46.53/46.68	c ................................ | ..........                     1 |                       46.6           0.0             
46.53/46.68	c ................................ | ..........                     2 |                       46.6           0.0             
46.53/46.68	c ................................ | ..........                     3 |                       46.6           0.1             
46.53/46.68	c ................................ | ..........                     4 |                       46.6           0.1             
46.53/46.68	c ................................ | ..........                     5 |                       46.6           0.1             
46.53/46.68	c ................................ | ..........                  1000 |                       46.6          21.5            5
200.10/85.12	c ................................ | ..........               4156000 | 19140                200.1       20765.5       178041
399.71/135.18	c ................................ | ..........               8930000 | 46077                400.0       22323.9       758724
599.72/185.31	c ................................ | ..........              13043000 | 177333               600.1       21734.3      4475272
799.88/235.34	c ................................ | ..........              16836000 | 297522               800.0       21045.0      6970384
999.93/285.44	c ................................ | *.........              20613000 | 416994              1000.1       20611.4      9081810
1199.84/335.46	c ................................ | *.........              23765000 | 509381              1200.0       19803.5     11008137
1399.91/385.53	c ................................ | *.........              27002000 | 603347              1400.1       19286.3     13187650
1600.00/435.64	c ................................ | *.........              29890000 | 682966              1600.1       18679.8     15935519
1800.07/485.73	c ................................ | *.........              32108000 | 766372              1800.2       17836.0     19890157
2000.12/535.81	c ................................ | **........              33613000 | 826886              2000.1       16805.3     24958966

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1776913-1243676791/watcher-1776913-1243676791 -o /tmp/evaluation-result-1776913-1243676791/solver-1776913-1243676791 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1776913-1243676791.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 0.91 0.95 0.90 3/115 27265
/proc/meminfo: memFree=2995568/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=1144 CPUtime=0.01
/proc/27265/stat : 27265 (ttsth-5-0) R 27263 27265 11443 0 -1 4202496 181 0 0 0 1 0 0 0 18 0 1 0 1132358910 1171456 137 4294967295 134512640 135237372 3220654784 3220654232 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27265/statm: 286 137 75 177 0 108 0

[startup+0.03089 s]
/proc/loadavg: 0.91 0.95 0.90 3/115 27265
/proc/meminfo: memFree=2995568/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=2296 CPUtime=0.03
/proc/27265/stat : 27265 (ttsth-5-0) R 27263 27265 11443 0 -1 4202496 471 0 0 0 3 0 0 0 18 0 1 0 1132358910 2351104 427 4294967295 134512640 135237372 3220654784 3220654232 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27265/statm: 574 427 75 177 0 396 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 2296

[startup+0.110885 s]
/proc/loadavg: 0.91 0.95 0.90 3/115 27265
/proc/meminfo: memFree=2995568/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=5828 CPUtime=0.11
/proc/27265/stat : 27265 (ttsth-5-0) R 27263 27265 11443 0 -1 4202496 1338 0 0 0 11 0 0 0 18 0 1 0 1132358910 5967872 1294 4294967295 134512640 135237372 3220654784 3220654232 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27265/statm: 1457 1295 75 177 0 1279 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 5828

[startup+0.310878 s]
/proc/loadavg: 0.91 0.95 0.90 3/115 27265
/proc/meminfo: memFree=2995568/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=14328 CPUtime=0.31
/proc/27265/stat : 27265 (ttsth-5-0) R 27263 27265 11443 0 -1 4202496 3485 0 0 0 29 2 0 0 18 0 1 0 1132358910 14671872 3441 4294967295 134512640 135237372 3220654784 3220653308 134639534 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27265/statm: 3582 3441 75 177 0 3404 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 14328

[startup+0.710861 s]
/proc/loadavg: 0.91 0.95 0.90 3/115 27265
/proc/meminfo: memFree=2995568/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=21424 CPUtime=0.71
/proc/27265/stat : 27265 (ttsth-5-0) R 27263 27265 11443 0 -1 4202496 5102 0 0 0 68 3 0 0 18 0 1 0 1132358910 21938176 5058 4294967295 134512640 135237372 3220654784 3220654476 134534215 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27265/statm: 5356 5058 75 177 0 5178 0
Current children cumulated CPU time (s) 0.71
Current children cumulated vsize (KiB) 21424

[startup+1.51083 s]
/proc/loadavg: 0.91 0.95 0.90 2/116 27266
/proc/meminfo: memFree=2975764/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=21424 CPUtime=1.51
/proc/27265/stat : 27265 (ttsth-5-0) R 27263 27265 11443 0 -1 4202496 5102 0 0 0 148 3 0 0 20 0 1 0 1132358910 21938176 5058 4294967295 134512640 135237372 3220654784 3220654476 134534098 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27265/statm: 5356 5058 75 177 0 5178 0
Current children cumulated CPU time (s) 1.51
Current children cumulated vsize (KiB) 21424

[startup+3.11076 s]
/proc/loadavg: 0.91 0.95 0.90 2/116 27266
/proc/meminfo: memFree=2954832/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=46248 CPUtime=3.11
/proc/27265/stat : 27265 (ttsth-5-0) R 27263 27265 11443 0 -1 4202496 12076 0 0 0 306 5 0 0 25 0 1 0 1132358910 47357952 11221 4294967295 134512640 135237372 3220654784 3220654144 134600960 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27265/statm: 11562 11221 77 177 0 11384 0
Current children cumulated CPU time (s) 3.11
Current children cumulated vsize (KiB) 46248

[startup+6.31064 s]
/proc/loadavg: 0.92 0.95 0.90 2/116 27268
/proc/meminfo: memFree=2950624/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=46908 CPUtime=6.3
/proc/27265/stat : 27265 (ttsth-5-0) R 27263 27265 11443 0 -1 4202496 12243 0 0 0 625 5 0 0 25 0 1 0 1132358910 48033792 11388 4294967295 134512640 135237372 3220654784 3220653912 134732614 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27265/statm: 11727 11388 77 177 0 11549 0
Current children cumulated CPU time (s) 6.3
Current children cumulated vsize (KiB) 46908

[startup+12.7104 s]
/proc/loadavg: 0.93 0.95 0.90 2/116 27268
/proc/meminfo: memFree=2949144/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=48344 CPUtime=12.69
/proc/27265/stat : 27265 (ttsth-5-0) R 27263 27265 11443 0 -1 4202496 12539 0 0 0 1262 7 0 0 25 0 1 0 1132358910 49504256 11684 4294967295 134512640 135237372 3220654784 3220654144 134600718 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27265/statm: 12086 11684 77 177 0 11908 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 48344

[startup+25.5099 s]
/proc/loadavg: 0.94 0.96 0.91 2/116 27269
/proc/meminfo: memFree=2948908/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=48476 CPUtime=25.43
/proc/27265/stat : 27265 (ttsth-5-0) R 27263 27265 11443 0 -1 4202496 12568 0 0 0 2533 10 0 0 25 0 1 0 1132358910 49639424 11713 4294967295 134512640 135237372 3220654784 3220654144 134600721 0 0 0 0 0 0 0 17 1 0 0 0
/proc/27265/statm: 12119 11713 77 177 0 11941 0
Current children cumulated CPU time (s) 25.43
Current children cumulated vsize (KiB) 48476

[startup+51.1089 s]
/proc/loadavg: 1.20 1.01 0.92 5/120 27457
/proc/meminfo: memFree=2731748/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=297064 CPUtime=64.22
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 68376 0 0 0 6381 41 0 0 25 0 5 0 1132358910 304193536 66705 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 74266 66705 95 177 0 74088 0
[pid=27265/tid=27454] ppid=27263 vsize=297064 CPUtime=4.42
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 710 0 0 0 442 0 0 0 25 0 5 0 1132363578 304193536 66705 4294967295 134512640 135237372 3220654784 3071893216 134680262 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=297064 CPUtime=4.39
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 719 0 0 0 434 5 0 0 25 0 5 0 1132363578 304193536 66705 4294967295 134512640 135237372 3220654784 3063760028 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=297064 CPUtime=4.4
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 715 0 0 0 438 2 0 0 25 0 5 0 1132363578 304193536 66705 4294967295 134512640 135237372 3220654784 3054826380 134636641 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=297064 CPUtime=4.4
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 714 0 0 0 435 5 0 0 25 0 5 0 1132363580 304193536 66705 4294967295 134512640 135237372 3220654784 3046936184 134549873 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 64.22
Current children cumulated vsize (KiB) 297064

[startup+102.317 s]
/proc/loadavg: 2.86 1.50 1.09 5/120 27645
/proc/meminfo: memFree=2722244/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=302244 CPUtime=268.56
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 69885 0 0 0 26704 152 0 0 25 0 5 0 1132358910 309497856 68214 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 75561 68214 95 177 0 75383 0
[pid=27265/tid=27454] ppid=27263 vsize=302244 CPUtime=55.59
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 1084 0 0 0 5553 6 0 0 25 0 5 0 1132363578 309497856 68214 4294967295 134512640 135237372 3220654784 3072133104 134550402 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=302244 CPUtime=55.45
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 1324 0 0 0 5507 38 0 0 25 0 5 0 1132363578 309497856 68214 4294967295 134512640 135237372 3220654784 3063245472 134749343 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=302244 CPUtime=55.46
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 1039 0 0 0 5510 36 0 0 25 0 5 0 1132363578 309497856 68214 4294967295 134512640 135237372 3220654784 3054944496 134591177 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=302244 CPUtime=55.45
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 920 0 0 0 5502 43 0 0 25 0 5 0 1132363580 309497856 68214 4294967295 134512640 135237372 3220654784 3047315488 134591304 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 268.56
Current children cumulated vsize (KiB) 302244

[startup+162.314 s]
/proc/loadavg: 3.66 1.98 1.28 6/120 27833
/proc/meminfo: memFree=2686168/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=338300 CPUtime=508.15
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 79105 0 0 0 50580 235 0 0 25 0 5 0 1132358910 346419200 77434 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 84575 77434 95 177 0 84397 0
[pid=27265/tid=27454] ppid=27263 vsize=338300 CPUtime=115.55
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 7658 0 0 0 11544 11 0 0 25 0 5 0 1132363578 346419200 77434 4294967295 134512640 135237372 3220654784 3070174672 134680467 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=338300 CPUtime=115.32
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 1949 0 0 0 11474 58 0 0 25 0 5 0 1132363578 346419200 77434 4294967295 134512640 135237372 3220654784 3064338160 134551008 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=338300 CPUtime=115.38
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 2267 0 0 0 11474 64 0 0 25 0 5 0 1132363578 346419200 77434 4294967295 134512640 135237372 3220654784 3055825452 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=338300 CPUtime=115.29
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 1713 0 0 0 11456 73 0 0 25 0 5 0 1132363580 346419200 77434 4294967295 134512640 135237372 3220654784 3046526336 134749345 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 508.15
Current children cumulated vsize (KiB) 338300

[startup+222.312 s]
/proc/loadavg: 3.98 2.37 1.46 5/120 28023
/proc/meminfo: memFree=2619728/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=407112 CPUtime=747.86
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 95645 0 0 0 74465 321 0 0 25 0 5 0 1132358910 416882688 93974 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 101778 93974 95 177 0 101600 0
[pid=27265/tid=27454] ppid=27263 vsize=407112 CPUtime=175.53
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 21098 0 0 0 17531 22 0 0 25 0 5 0 1132363578 416882688 93974 4294967295 134512640 135237372 3220654784 3070484624 134749353 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=407112 CPUtime=175.21
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 2610 0 0 0 17435 86 0 0 25 0 5 0 1132363578 416882688 93974 4294967295 134512640 135237372 3220654784 3063534960 134561521 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=407112 CPUtime=175.33
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 3833 0 0 0 17445 88 0 0 25 0 5 0 1132363578 416882688 93974 4294967295 134512640 135237372 3220654784 3055384668 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=407112 CPUtime=175.18
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 2586 0 0 0 17422 96 0 0 25 0 5 0 1132363580 416882688 93974 4294967295 134512640 135237372 3220654784 3047406604 134636641 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 747.86
Current children cumulated vsize (KiB) 407112

[startup+282.31 s]
/proc/loadavg: 4.31 2.76 1.65 6/120 28211
/proc/meminfo: memFree=2574380/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=455556 CPUtime=987.55
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 107107 0 0 0 98333 422 0 0 25 0 5 0 1132358910 466489344 105436 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 113889 105436 95 177 0 113711 0
[pid=27265/tid=27454] ppid=27263 vsize=455556 CPUtime=235.5
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 29879 0 0 0 23521 29 0 0 25 0 5 0 1132363578 466489344 105436 4294967295 134512640 135237372 3220654784 3070665176 134519962 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=455556 CPUtime=235.13
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 3456 0 0 0 23394 119 0 0 25 0 5 0 1132363578 466489344 105436 4294967295 134512640 135237372 3220654784 3064208272 134551475 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=455556 CPUtime=235.2
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 4622 0 0 0 23401 119 0 0 25 0 5 0 1132363578 466489344 105436 4294967295 134512640 135237372 3220654784 3055971036 134636641 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=455556 CPUtime=235.11
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 3632 0 0 0 23385 126 0 0 25 0 5 0 1132363580 466489344 105436 4294967295 134512640 135237372 3220654784 3047312864 134749302 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 987.55
Current children cumulated vsize (KiB) 455556

[startup+342.307 s]
/proc/loadavg: 4.31 3.03 1.81 5/120 28402
/proc/meminfo: memFree=2540556/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=492088 CPUtime=1227.2
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 115606 0 0 0 122206 514 0 0 25 0 5 0 1132358910 503898112 113935 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 123022 113935 95 177 0 122844 0
[pid=27265/tid=27454] ppid=27263 vsize=492088 CPUtime=295.42
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 35502 0 0 0 29504 38 0 0 25 0 5 0 1132363578 503898112 113935 4294967295 134512640 135237372 3220654784 3070597648 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=492088 CPUtime=295.05
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 4207 0 0 0 29360 145 0 0 25 0 5 0 1132363578 503898112 113935 4294967295 134512640 135237372 3220654784 3063764512 134549882 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=492088 CPUtime=295.07
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 5827 0 0 0 29359 148 0 0 25 0 5 0 1132363578 503898112 113935 4294967295 134512640 135237372 3220654784 3055469520 134591177 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=492088 CPUtime=295.05
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 4552 0 0 0 29351 154 0 0 25 0 5 0 1132363580 503898112 113935 4294967295 134512640 135237372 3220654784 3047116748 134683155 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1227.2

################
# More data... #
################

[pid=27265/tid=27455] ppid=27263 vsize=609584 CPUtime=414.99
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 6049 0 0 0 41306 193 0 0 25 0 5 0 1132363578 624214016 142294 4294967295 134512640 135237372 3220654784 3063740808 134680505 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=609584 CPUtime=414.81
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 20765 0 0 0 41276 205 0 0 25 0 5 0 1132363578 624214016 142294 4294967295 134512640 135237372 3220654784 3053614656 134587914 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=609584 CPUtime=414.82
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 6549 0 0 0 41286 196 0 0 25 0 5 0 1132363580 624214016 142294 4294967295 134512640 135237372 3220654784 3046521328 134590948 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1706.53
Current children cumulated vsize (KiB) 609584

[startup+522.31 s]
/proc/loadavg: 4.14 3.54 2.22 5/120 28964
/proc/meminfo: memFree=2338536/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=704548 CPUtime=1946.14
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 166530 0 0 0 193880 734 0 0 25 0 5 0 1132358910 721457152 164859 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 176137 164859 95 177 0 175959 0
[pid=27265/tid=27454] ppid=27263 vsize=704548 CPUtime=475.27
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 55420 0 0 0 47468 59 0 0 25 0 5 0 1132363578 721457152 164859 4294967295 134512640 135237372 3220654784 3070201936 134593463 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=704548 CPUtime=474.89
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 7092 0 0 0 47280 209 0 0 25 0 5 0 1132363578 721457152 164859 4294967295 134512640 135237372 3220654784 3063783024 134680251 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=704548 CPUtime=474.66
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 30893 0 0 0 47239 227 0 0 25 0 5 0 1132363578 721457152 164859 4294967295 134512640 135237372 3220654784 3053725264 134562351 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=704548 CPUtime=474.71
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 7607 0 0 0 47261 210 0 0 25 0 5 0 1132363580 721457152 164859 4294967295 134512640 135237372 3220654784 3046425608 134732535 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1946.14
Current children cumulated vsize (KiB) 704548

[startup+582.308 s]
/proc/loadavg: 4.15 3.65 2.34 5/120 29156
/proc/meminfo: memFree=2240792/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=805388 CPUtime=2185.79
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 190599 0 0 0 217794 785 0 0 25 0 5 0 1132358910 824717312 188928 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 201347 188928 95 177 0 201169 0
[pid=27265/tid=27454] ppid=27263 vsize=805388 CPUtime=535.22
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 67414 0 0 0 53457 65 0 0 25 0 5 0 1132363578 824717312 188928 4294967295 134512640 135237372 3220654784 3070289392 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=805388 CPUtime=534.83
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 8363 0 0 0 53261 222 0 0 25 0 5 0 1132363578 824717312 188928 4294967295 134512640 135237372 3220654784 3064092092 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=805388 CPUtime=534.57
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 40343 0 0 0 53210 247 0 0 25 0 5 0 1132363578 824717312 188928 4294967295 134512640 135237372 3220654784 3053650764 134636641 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=805388 CPUtime=534.56
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 8961 0 0 0 53234 222 0 0 25 0 5 0 1132363580 824717312 188928 4294967295 134512640 135237372 3220654784 3046505776 134591181 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2185.79
Current children cumulated vsize (KiB) 805388

[startup+642.315 s]
/proc/loadavg: 4.32 3.79 2.47 5/120 29345
/proc/meminfo: memFree=2148604/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=903520 CPUtime=2425.55
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 213491 0 0 0 241717 838 0 0 25 0 5 0 1132358910 925204480 211820 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 225880 211820 95 177 0 225702 0
[pid=27265/tid=27454] ppid=27263 vsize=903520 CPUtime=595.19
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 80742 0 0 0 59442 77 0 0 25 0 5 0 1132363578 925204480 211820 4294967295 134512640 135237372 3220654784 3070271152 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=903520 CPUtime=594.74
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 9566 0 0 0 59242 232 0 0 25 0 5 0 1132363578 925204480 211821 4294967295 134512640 135237372 3220654784 3063619392 134680374 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=903520 CPUtime=594.52
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 47492 0 0 0 59188 264 0 0 25 0 5 0 1132363578 925204480 211821 4294967295 134512640 135237372 3220654784 3053644800 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=903520 CPUtime=594.49
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 10173 0 0 0 59213 236 0 0 25 0 5 0 1132363580 925204480 211821 4294967295 134512640 135237372 3220654784 3047447008 134680257 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2425.55
Current children cumulated vsize (KiB) 903520

[startup+702.313 s]
/proc/loadavg: 4.19 3.84 2.57 5/120 29533
/proc/meminfo: memFree=2051024/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=1006988 CPUtime=2665.21
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 238050 0 0 0 265629 892 0 0 25 0 5 0 1132358910 1031155712 236379 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 251747 236379 95 177 0 251569 0
[pid=27265/tid=27454] ppid=27263 vsize=1006988 CPUtime=655.15
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 97704 0 0 0 65431 84 0 0 25 0 5 0 1132363578 1031155712 236379 4294967295 134512640 135237372 3220654784 3070080736 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=1006988 CPUtime=654.66
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 10593 0 0 0 65221 245 0 0 25 0 5 0 1132363578 1031155712 236379 4294967295 134512640 135237372 3220654784 3063582624 134680367 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=1006988 CPUtime=654.45
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 52984 0 0 0 65167 278 0 0 25 0 5 0 1132363578 1031155712 236379 4294967295 134512640 135237372 3220654784 3053727408 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=1006988 CPUtime=654.34
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 11251 0 0 0 65178 256 0 0 25 0 5 0 1132363580 1031155712 236379 4294967295 134512640 135237372 3220654784 3047327872 134591082 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2665.21
Current children cumulated vsize (KiB) 1006988

[startup+762.31 s]
/proc/loadavg: 4.19 3.90 2.66 5/120 29721
/proc/meminfo: memFree=1947756/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=1114236 CPUtime=2904.84
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 263687 0 0 0 289541 943 0 0 25 0 5 0 1132358910 1140977664 262016 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 278559 262017 95 177 0 278381 0
[pid=27265/tid=27454] ppid=27263 vsize=1114236 CPUtime=715.11
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 112879 0 0 0 71413 98 0 0 25 0 5 0 1132363578 1140977664 262017 4294967295 134512640 135237372 3220654784 3070268128 134546026 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=1114236 CPUtime=714.52
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 11466 0 0 0 71198 254 0 0 25 0 5 0 1132363578 1140977664 262017 4294967295 134512640 135237372 3220654784 3063954528 134680503 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=1114236 CPUtime=714.36
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 59249 0 0 0 71151 285 0 0 25 0 5 0 1132363578 1140977664 262017 4294967295 134512640 135237372 3220654784 3053730672 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=1114236 CPUtime=714.24
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 14576 0 0 0 71147 277 0 0 25 0 5 0 1132363580 1140977664 262017 4294967295 134512640 135237372 3220654784 3045638768 134749353 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2904.84
Current children cumulated vsize (KiB) 1114236

[startup+822.318 s]
/proc/loadavg: 4.19 3.95 2.75 6/120 29907
/proc/meminfo: memFree=1819892/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=1248280 CPUtime=3144.53
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 295622 0 0 0 313462 991 0 0 25 0 5 0 1132358910 1278238720 293951 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 312070 293951 95 177 0 311892 0
[pid=27265/tid=27454] ppid=27263 vsize=1248280 CPUtime=775.05
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 125258 0 0 0 77394 111 0 0 25 0 5 0 1132363578 1278238720 293951 4294967295 134512640 135237372 3220654784 3069950332 134680208 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=1248280 CPUtime=774.47
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 14924 0 0 0 77184 263 0 0 25 0 5 0 1132363578 1278238720 293951 4294967295 134512640 135237372 3220654784 3062085596 134636641 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=1248280 CPUtime=774.33
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 65518 0 0 0 77134 299 0 0 25 0 5 0 1132363578 1278238720 293951 4294967295 134512640 135237372 3220654784 3053722560 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=1248280 CPUtime=774.07
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 24404 0 0 0 77118 289 0 0 25 0 5 0 1132363580 1278238720 293951 4294967295 134512640 135237372 3220654784 3045587968 134562459 0 0 0 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3144.53
Current children cumulated vsize (KiB) 1248280

[startup+882.316 s]
/proc/loadavg: 4.28 4.03 2.85 5/120 30095
/proc/meminfo: memFree=1702700/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=1370872 CPUtime=3384.25
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 324762 0 0 0 337410 1015 0 0 25 0 5 0 1132358910 1403772928 323091 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 342718 323091 95 177 0 342540 0
[pid=27265/tid=27454] ppid=27263 vsize=1370872 CPUtime=835.02
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 136883 0 0 0 83385 117 0 0 25 0 5 0 1132363578 1403772928 323091 4294967295 134512640 135237372 3220654784 3069833888 134680226 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=1370872 CPUtime=834.37
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 19639 0 0 0 83168 269 0 0 25 0 5 0 1132363578 1403772928 323091 4294967295 134512640 135237372 3220654784 3062117584 134550408 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=1370872 CPUtime=834.3
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 70523 0 0 0 83126 304 0 0 25 0 5 0 1132363578 1403772928 323091 4294967295 134512640 135237372 3220654784 3053820540 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=1370872 CPUtime=833.95
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 32199 0 0 0 83099 296 0 0 25 0 5 0 1132363580 1403772928 323091 4294967295 134512640 135237372 3220654784 3045293116 134636641 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3384.25
Current children cumulated vsize (KiB) 1370872

[startup+942.303 s]
/proc/loadavg: 4.10 4.02 2.92 5/120 30288
/proc/meminfo: memFree=1573740/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=1509404 CPUtime=3623.92
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 357376 0 0 0 361336 1056 0 0 25 0 5 0 1132358910 1545629696 355705 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 377351 355705 95 177 0 377173 0
[pid=27265/tid=27454] ppid=27263 vsize=1509404 CPUtime=894.96
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 148283 0 0 0 89372 124 0 0 25 0 5 0 1132363578 1545629696 355705 4294967295 134512640 135237372 3220654784 3070179008 134751534 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=1509404 CPUtime=894.31
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 27085 0 0 0 89148 283 0 0 25 0 5 0 1132363578 1545629696 355705 4294967295 134512640 135237372 3220654784 3062391328 134749353 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=1509404 CPUtime=894.16
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 75837 0 0 0 89103 313 0 0 25 0 5 0 1132363578 1545629696 355705 4294967295 134512640 135237372 3220654784 3053721468 134636641 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=1509404 CPUtime=893.88
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 40653 0 0 0 89081 307 0 0 25 0 5 0 1132363580 1545629696 355705 4294967295 134512640 135237372 3220654784 3045523084 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3623.92
Current children cumulated vsize (KiB) 1509404



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 4.11 4.03 2.99 5/120 30475
/proc/meminfo: memFree=1449272/3368532 swapFree=1941392/1959888
[pid=27265] ppid=27263 vsize=1639232 CPUtime=3854.45
/proc/27265/stat : 27265 (ttsth-5-0) S 27263 27265 11443 0 -1 4202496 387941 0 0 0 384350 1095 0 0 25 0 5 0 1132358910 1678573568 386270 4294967295 134512640 135237372 3220654784 3220654380 134629544 0 0 0 0 4294967295 0 0 17 1 0 0 0
/proc/27265/statm: 409808 386270 95 177 0 409630 0
[pid=27265/tid=27454] ppid=27263 vsize=1639232 CPUtime=952.56
/proc/27265/task/27454/stat : 27454 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 160102 0 0 0 95123 133 0 0 25 0 5 0 1132363578 1678573568 386270 4294967295 134512640 135237372 3220654784 3070275244 134562272 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=27265/tid=27455] ppid=27263 vsize=1639232 CPUtime=951.95
/proc/27265/task/27455/stat : 27455 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 33598 0 0 0 94900 295 0 0 25 0 5 0 1132363578 1678573568 386270 4294967295 134512640 135237372 3220654784 3061927724 134680208 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=27265/tid=27456] ppid=27263 vsize=1639232 CPUtime=951.78
/proc/27265/task/27456/stat : 27456 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 80554 0 0 0 94855 323 0 0 25 0 5 0 1132363578 1678573568 386271 4294967295 134512640 135237372 3220654784 3053718960 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=27265/tid=27457] ppid=27263 vsize=1639232 CPUtime=951.55
/proc/27265/task/27457/stat : 27457 (ttsth-5-0) R 27263 27265 11443 0 -1 4202560 48170 0 0 0 94840 315 0 0 25 0 5 0 1132363580 1678573568 386271 4294967295 134512640 135237372 3220654784 3045257408 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3854.45
Current children cumulated vsize (KiB) 1639232

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.11
CPU time (s): 3854.58
CPU user time (s): 3843.55
CPU system time (s): 11.03
CPU usage (%): 385.415
Max. virtual memory (cumulated for all children) (KiB): 1639232

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3843.55
system time used= 11.03
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 387955
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 128412
involuntary context switches= 85422

runsolver used 0 second user time and 0.01 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 11:46:31
IDJOB=1776913
IDBENCH=69611
IDSOLVER=632
FILE ID=/1776913-1243676791
PBS_JOBID=
Free space on /tmp= 15725 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT_RACE08/cnf/mizh-md5-47-4.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1776913-1243676791/watcher-1776913-1243676791 -o /tmp/evaluation-result-1776913-1243676791/solver-1776913-1243676791 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1776913-1243676791.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= b0a37265834986ac9165bda379d279fd
RANDOM SEED= 879324971

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.42
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.11
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.17
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.143
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.15
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       2995864 kB
Buffers:         87664 kB
Cached:         181752 kB
SwapCached:       4320 kB
Active:         184400 kB
Inactive:        95444 kB
HighTotal:     2489216 kB
HighFree:      2294952 kB
LowTotal:       879316 kB
LowFree:        700912 kB
SwapTotal:     1959888 kB
SwapFree:      1941392 kB
Dirty:            6204 kB
Writeback:           4 kB
AnonPages:        9196 kB
Mapped:           4340 kB
Slab:            81884 kB
SReclaimable:    72080 kB
SUnreclaim:       9804 kB
PageTables:        748 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   127080 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 15725 MiB
End job on  at 2009-05-30 12:03:13