Trace number 1776868

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19 (4 threads)? (TO) 1974.04 1000.13

General information on the benchmark

Namevange-col-abb313GPIA-9-c.cnf
MD5SUM0baefedb2aaa81442743e253487854d8
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables6228
Number of clauses484871
Sum of the clauses size3850952
Maximum clause length8
Minimum clause length1
Number of clauses of size 115
Number of clauses of size 24651
Number of clauses of size 31
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5480204

Solver Data 

2.12/2.14	c Command: HOME/ttsth-5-0 -num-threads 4 HOME/instance-1776868-1243676048.cnf 
2.12/2.14	c Using SATTIMEOUT of 10000
2.12/2.14	c Using SATRAM of 2047
2.12/2.14	c Size of subset node = 16
2.12/2.14	c Variables = 6228
2.12/2.14	c Clauses = 484871
2.12/2.14	c Literals = 3850952
2.12/2.14	c Reduced size:
2.12/2.14	c Variables = 6228
2.12/2.14	c Clauses = 482552
2.12/2.14	c Literals = 3827965
2.12/2.14	c a2
10.02/10.02	c a1
20.12/20.14	c Independent sub-problems = 1
20.12/20.14	c Sub-problem with 6204 variables and 482552 clauses
20.12/20.14	c using permutation method 4
20.12/20.14	c count = 1
20.12/20.14	c Ordering finished 19.570 seconds
20.12/20.14	c mapped 20.150 seconds
20.12/20.14	c permuted 20.150 seconds
20.12/20.14	c about to sort
20.52/20.57	c sorted
24.92/25.00	c clauses now 482552
24.92/25.00	c init finished 20.720 seconds
24.92/25.00	c tree built 25.000 seconds
24.92/25.00	c 
24.92/25.00	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
24.92/25.00	c ---------------------------------|----------------------------------|------------------------------------------------------
24.92/25.00	c ................................ | ..........                       |                       25.0           0.0             
24.92/25.00	c ................................ | ..........                     1 |                       25.0           0.0             
24.92/25.00	c ................................ | ..........                     2 |                       25.0           0.1             
24.92/25.00	c ................................ | ..........                     3 |                       25.0           0.1             
24.92/25.00	c ................................ | ..........                     4 |                       25.0           0.2             
24.92/25.00	c ................................ | ..........                     5 |                       25.0           0.2             
24.92/25.01	c ................................ | ..........                  1000 | 88                    25.0          40.0         3215
199.94/108.37	c ................................ | ..........               2177000 | 332391               200.1       10881.2     17947608
400.13/208.98	c ................................ | ..........               3578000 | 552621               400.3        8939.2     30135523
599.82/309.10	c ................................ | ..........               4732000 | 732717               600.0        7886.7     40450268
800.06/410.24	c ................................ | ..........               5720000 | 895081               800.1        7149.0     52514842
1000.04/511.01	c ................................ | *.........               6527000 | 1029254             1000.1        6526.6     62569542
1199.91/611.37	c ................................ | *.........               7230000 | 1145149             1200.0        6024.8     71542326
1400.26/712.21	c ................................ | *.........               7950000 | 1267491             1400.3        5677.4     80795771
1600.19/812.65	c ................................ | *.........               8498000 | 1365563             1600.3        5310.2     88369908
1800.12/912.92	c ................................ | *.........               9037000 | 1463327             1800.2        5020.1     94734171

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:503) (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w /tmp/evaluation-result-1776868-1243676048/watcher-1776868-1243676048 -o /tmp/evaluation-result-1776868-1243676048/solver-1776868-1243676048 -C 10000 -W 1000 -M 2047 HOME/ttsth-5-0 -num-threads 4 HOME/instance-1776868-1243676048.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 10000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 10030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 2096128 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 2147328 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 5.73 6.43 6.09 5/111 2078
/proc/meminfo: memFree=3008416/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=2600 CPUtime=0.05
/proc/2078/stat : 2078 (ttsth-5-0) R 2076 2078 20065 0 -1 4202496 526 0 0 0 5 0 0 0 25 0 1 0 1132268953 2662400 481 4294967295 134512640 135237372 3220693712 3220693076 134732592 0 0 0 0 0 0 0 17 0 0 0 0
/proc/2078/statm: 650 481 75 177 0 472 0

[startup+0.147027 s]
/proc/loadavg: 5.73 6.43 6.09 5/111 2078
/proc/meminfo: memFree=3008416/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=5756 CPUtime=0.15
/proc/2078/stat : 2078 (ttsth-5-0) R 2076 2078 20065 0 -1 4202496 1300 0 0 0 15 0 0 0 25 0 1 0 1132268953 5894144 1255 4294967295 134512640 135237372 3220693712 3220692308 134886075 0 0 0 0 0 0 0 17 0 0 0 0
/proc/2078/statm: 1439 1255 75 177 0 1261 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 5756

[startup+0.217022 s]
/proc/loadavg: 5.73 6.43 6.09 5/111 2078
/proc/meminfo: memFree=3008416/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=7988 CPUtime=0.22
/proc/2078/stat : 2078 (ttsth-5-0) R 2076 2078 20065 0 -1 4202496 1859 0 0 0 22 0 0 0 25 0 1 0 1132268953 8179712 1814 4294967295 134512640 135237372 3220693712 3220692580 134884319 0 0 0 0 0 0 0 17 0 0 0 0
/proc/2078/statm: 1997 1814 75 177 0 1819 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 7988

[startup+0.317014 s]
/proc/loadavg: 5.73 6.43 6.09 5/111 2078
/proc/meminfo: memFree=3008416/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=11024 CPUtime=0.32
/proc/2078/stat : 2078 (ttsth-5-0) R 2076 2078 20065 0 -1 4202496 2640 0 0 0 31 1 0 0 25 0 1 0 1132268953 11288576 2595 4294967295 134512640 135237372 3220693712 3220692308 134886368 0 0 0 0 0 0 0 17 0 0 0 0
/proc/2078/statm: 2756 2595 75 177 0 2578 0
Current children cumulated CPU time (s) 0.32
Current children cumulated vsize (KiB) 11024

[startup+0.716982 s]
/proc/loadavg: 5.73 6.43 6.09 5/111 2078
/proc/meminfo: memFree=3008416/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=23484 CPUtime=0.72
/proc/2078/stat : 2078 (ttsth-5-0) R 2076 2078 20065 0 -1 4202496 5758 0 0 0 70 2 0 0 25 0 1 0 1132268953 24047616 5713 4294967295 134512640 135237372 3220693712 3220693268 134738902 0 0 0 0 0 0 0 17 0 0 0 0
/proc/2078/statm: 5871 5713 75 177 0 5693 0
Current children cumulated CPU time (s) 0.72
Current children cumulated vsize (KiB) 23484

[startup+1.51691 s]
/proc/loadavg: 5.73 6.43 6.09 5/112 2079
/proc/meminfo: memFree=2974368/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=48520 CPUtime=1.52
/proc/2078/stat : 2078 (ttsth-5-0) R 2076 2078 20065 0 -1 4202496 11978 0 0 0 149 3 0 0 25 0 1 0 1132268953 49684480 11933 4294967295 134512640 135237372 3220693712 3220692192 134685582 0 0 0 0 0 0 0 17 0 0 0 0
/proc/2078/statm: 12130 11933 75 177 0 11952 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 48520

[startup+3.11678 s]
/proc/loadavg: 5.59 6.39 6.07 5/112 2079
/proc/meminfo: memFree=2938256/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=251196 CPUtime=3.12
/proc/2078/stat : 2078 (ttsth-5-0) R 2076 2078 20065 0 -1 4202496 55050 0 0 0 297 15 0 0 25 0 1 0 1132268953 257224704 55004 4294967295 134512640 135237372 3220693712 3220692144 134680326 0 0 0 0 0 0 0 17 0 0 0 0
/proc/2078/statm: 62799 55004 76 177 0 62621 0
Current children cumulated CPU time (s) 3.12
Current children cumulated vsize (KiB) 251196

[startup+6.31651 s]
/proc/loadavg: 5.59 6.39 6.07 5/112 2080
/proc/meminfo: memFree=2789324/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=251196 CPUtime=6.32
/proc/2078/stat : 2078 (ttsth-5-0) R 2076 2078 20065 0 -1 4202496 55057 0 0 0 617 15 0 0 25 0 1 0 1132268953 257224704 55011 4294967295 134512640 135237372 3220693712 3220691744 134749353 0 0 0 0 0 0 0 17 0 0 0 0
/proc/2078/statm: 62799 55011 76 177 0 62621 0
Current children cumulated CPU time (s) 6.32
Current children cumulated vsize (KiB) 251196

[startup+12.716 s]
/proc/loadavg: 5.51 6.34 6.06 5/112 2080
/proc/meminfo: memFree=2786948/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=250500 CPUtime=12.72
/proc/2078/stat : 2078 (ttsth-5-0) R 2076 2078 20065 0 -1 4202496 56915 0 0 0 1256 16 0 0 25 0 1 0 1132268953 256512000 55923 4294967295 134512640 135237372 3220693712 3220693040 134555272 0 0 0 0 0 0 0 17 0 0 0 0
/proc/2078/statm: 62625 55923 77 177 0 62447 0
Current children cumulated CPU time (s) 12.72
Current children cumulated vsize (KiB) 250500

[startup+25.5149 s]
/proc/loadavg: 5.27 6.27 6.04 10/117 2123
/proc/meminfo: memFree=2777692/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=283968 CPUtime=25.72
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 59794 0 0 0 2555 17 0 0 25 0 5 0 1132268953 290783232 58330 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 70992 58330 95 177 0 70814 0
[pid=2078/tid=2107] ppid=2076 vsize=283968 CPUtime=0.28
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 118 0 0 0 28 0 0 0 25 0 5 0 1132271453 290783232 58330 4294967295 134512640 135237372 3220693712 3086272336 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=283968 CPUtime=0.18
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 161 0 0 0 18 0 0 0 25 0 5 0 1132271453 290783232 58330 4294967295 134512640 135237372 3220693712 3077863532 134636382 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=283968 CPUtime=0.21
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 175 0 0 0 21 0 0 0 25 0 5 0 1132271453 290783232 58330 4294967295 134512640 135237372 3220693712 3069514272 134590200 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=283968 CPUtime=0.05
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 33 0 0 0 5 0 0 0 25 0 5 0 1132271457 290783232 58330 4294967295 134512640 135237372 3220693712 3061083760 134680229 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.72
Current children cumulated vsize (KiB) 283968

[startup+51.1128 s]
/proc/loadavg: 6.34 6.44 6.10 8/116 2269
/proc/meminfo: memFree=2698600/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=357632 CPUtime=77.52
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 79896 0 0 0 7726 26 0 0 25 0 5 0 1132268953 366215168 78432 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 89408 78432 95 177 0 89230 0
[pid=2078/tid=2107] ppid=2076 vsize=357632 CPUtime=13.49
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 5327 0 0 0 1344 5 0 0 25 0 5 0 1132271453 366215168 78432 4294967295 134512640 135237372 3220693712 3086149328 134751534 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=357632 CPUtime=13.71
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 6326 0 0 0 1368 3 0 0 25 0 5 0 1132271453 366215168 78432 4294967295 134512640 135237372 3220693712 3077739408 134561428 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=357632 CPUtime=13.02
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 4656 0 0 0 1302 0 0 0 25 0 5 0 1132271453 366215168 78432 4294967295 134512640 135237372 3220693712 3069374356 134636436 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=357632 CPUtime=12.3
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 4280 0 0 0 1229 1 0 0 25 0 5 0 1132271457 366215168 78432 4294967295 134512640 135237372 3220693712 3060997024 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 77.52
Current children cumulated vsize (KiB) 357632

[startup+102.309 s]
/proc/loadavg: 7.12 6.65 6.19 8/116 2458
/proc/meminfo: memFree=2589896/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=454912 CPUtime=188.05
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 106487 0 0 0 18768 37 0 0 25 0 5 0 1132268953 465829888 105023 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 113728 105023 95 177 0 113550 0
[pid=2078/tid=2107] ppid=2076 vsize=454912 CPUtime=48.08
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 12842 0 0 0 4795 13 0 0 25 0 5 0 1132271453 465829888 105023 4294967295 134512640 135237372 3220693712 3086159132 134549960 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=454912 CPUtime=38.71
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 14946 0 0 0 3867 4 0 0 25 0 5 0 1132271453 465829888 105023 4294967295 134512640 135237372 3220693712 3077748128 134562338 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=454912 CPUtime=38.41
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 8811 0 0 0 3841 0 0 0 25 0 5 0 1132271453 465829888 105023 4294967295 134512640 135237372 3220693712 3069381792 134562344 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=454912 CPUtime=37.85
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 10581 0 0 0 3782 3 0 0 25 0 5 0 1132271457 465829888 105023 4294967295 134512640 135237372 3220693712 3060985568 134562363 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 188.05
Current children cumulated vsize (KiB) 454912

[startup+162.314 s]
/proc/loadavg: 7.41 6.80 6.27 8/116 2651
/proc/meminfo: memFree=2468768/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=576992 CPUtime=307.14
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 136988 0 0 0 30659 55 0 0 25 0 5 0 1132268953 590839808 135524 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 144248 135524 95 177 0 144070 0
[pid=2078/tid=2107] ppid=2076 vsize=576992 CPUtime=78.13
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 20737 0 0 0 7796 17 0 0 25 0 5 0 1132271453 590839808 135524 4294967295 134512640 135237372 3220693712 3086143456 134589646 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=576992 CPUtime=68.21
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 24803 0 0 0 6809 12 0 0 25 0 5 0 1132271453 590839808 135524 4294967295 134512640 135237372 3220693712 3077763040 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=576992 CPUtime=68.11
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 14726 0 0 0 6809 2 0 0 25 0 5 0 1132271453 590839808 135524 4294967295 134512640 135237372 3220693712 3069369840 134590129 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=576992 CPUtime=67.69
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 17415 0 0 0 6762 7 0 0 25 0 5 0 1132271457 590839808 135524 4294967295 134512640 135237372 3220693712 3060977432 134733328 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 307.14
Current children cumulated vsize (KiB) 576992

[startup+222.319 s]
/proc/loadavg: 7.58 6.97 6.36 9/116 2844
/proc/meminfo: memFree=2359848/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=684832 CPUtime=426.83
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 163966 0 0 0 42615 68 0 0 25 0 5 0 1132268953 701267968 162502 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 171208 162502 95 177 0 171030 0
[pid=2078/tid=2107] ppid=2076 vsize=684832 CPUtime=108.01
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 28462 0 0 0 10781 20 0 0 25 0 5 0 1132271453 701267968 162502 4294967295 134512640 135237372 3220693712 3086152352 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=684832 CPUtime=98.01
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 34317 0 0 0 9784 17 0 0 25 0 5 0 1132271453 701267968 162502 4294967295 134512640 135237372 3220693712 3077762672 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=684832 CPUtime=98.11
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 19062 0 0 0 9807 4 0 0 25 0 5 0 1132271453 701267968 162502 4294967295 134512640 135237372 3220693712 3069372384 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=684832 CPUtime=97.7
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 22818 0 0 0 9760 10 0 0 25 0 5 0 1132271457 701267968 162502 4294967295 134512640 135237372 3220693712 3060982288 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 426.83
Current children cumulated vsize (KiB) 684832

[startup+282.314 s]
/proc/loadavg: 7.51 7.04 6.41 8/116 3031
/proc/meminfo: memFree=2265308/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=780192 CPUtime=546.44
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 187803 0 0 0 54560 84 0 0 25 0 5 0 1132268953 798916608 186339 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 195048 186339 95 177 0 194870 0
[pid=2078/tid=2107] ppid=2076 vsize=780192 CPUtime=137.93
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 34194 0 0 0 13771 22 0 0 25 0 5 0 1132271453 798916608 186339 4294967295 134512640 135237372 3220693712 3086156672 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=780192 CPUtime=127.94
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 42670 0 0 0 12770 24 0 0 25 0 5 0 1132271453 798916608 186339 4294967295 134512640 135237372 3220693712 3077760800 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=780192 CPUtime=128.11
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 23190 0 0 0 12806 5 0 0 25 0 5 0 1132271453 798916608 186339 4294967295 134512640 135237372 3220693712 3069376736 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=780192 CPUtime=127.46
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 28442 0 0 0 12730 16 0 0 25 0 5 0 1132271457 798916608 186339 4294967295 134512640 135237372 3220693712 3060993120 134562413 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 546.44
Current children cumulated vsize (KiB) 780192

[startup+342.309 s]
/proc/loadavg: 7.64 7.17 6.50 9/116 3225
/proc/meminfo: memFree=2155028/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=889472 CPUtime=665.47
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 215117 0 0 0 66446 101 0 0 25 0 5 0 1132268953 910819328 213653 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 222368 213653 95 177 0 222190 0
[pid=2078/tid=2107] ppid=2076 vsize=889472 CPUtime=167.63

################
# More data... #
################

/proc/meminfo: memFree=1847872/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=1197284 CPUtime=1022.32
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 292058 0 0 0 102088 144 0 0 25 0 5 0 1132268953 1226018816 290594 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 299321 290594 95 177 0 299143 0
[pid=2078/tid=2107] ppid=2076 vsize=1197284 CPUtime=257.24
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 53349 0 0 0 25690 34 0 0 25 0 5 0 1132271453 1226018816 290594 4294967295 134512640 135237372 3220693712 3086146016 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=1197284 CPUtime=246.51
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 73125 0 0 0 24609 42 0 0 25 0 5 0 1132271453 1226018816 290594 4294967295 134512640 135237372 3220693712 3077750528 134593171 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=1197284 CPUtime=247.82
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 54167 0 0 0 24769 13 0 0 25 0 5 0 1132271453 1226018816 290594 4294967295 134512640 135237372 3220693712 3069367776 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=1197284 CPUtime=245.75
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 52110 0 0 0 24537 38 0 0 25 0 5 0 1132271457 1226018816 290594 4294967295 134512640 135237372 3220693712 3060983632 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1022.32
Current children cumulated vsize (KiB) 1197284

[startup+582.319 s]
/proc/loadavg: 7.79 7.52 6.79 8/116 4006
/proc/meminfo: memFree=1759688/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=1284964 CPUtime=1141.93
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 313970 0 0 0 114036 157 0 0 25 0 5 0 1132268953 1315803136 312506 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 321241 312506 95 177 0 321063 0
[pid=2078/tid=2107] ppid=2076 vsize=1284964 CPUtime=287.25
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 56547 0 0 0 28691 34 0 0 25 0 5 0 1132271453 1315803136 312506 4294967295 134512640 135237372 3220693712 3086159152 134592831 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=1284964 CPUtime=276.32
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 78745 0 0 0 27587 45 0 0 25 0 5 0 1132271453 1315803136 312506 4294967295 134512640 135237372 3220693712 3077756528 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=1284964 CPUtime=277.81
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 62863 0 0 0 27764 17 0 0 25 0 5 0 1132271453 1315803136 312506 4294967295 134512640 135237372 3220693712 3069363360 134562416 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=1284964 CPUtime=275.55
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 56508 0 0 0 27511 44 0 0 25 0 5 0 1132271457 1315803136 312506 4294967295 134512640 135237372 3220693712 3060993456 134549905 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1141.93
Current children cumulated vsize (KiB) 1284964

[startup+642.314 s]
/proc/loadavg: 7.85 7.57 6.85 8/116 4198
/proc/meminfo: memFree=1672760/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=1373444 CPUtime=1261.26
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 336104 0 0 0 125956 170 0 0 25 0 5 0 1132268953 1406406656 334640 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 343361 334640 95 177 0 343183 0
[pid=2078/tid=2107] ppid=2076 vsize=1373444 CPUtime=317.08
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 60364 0 0 0 31672 36 0 0 25 0 5 0 1132271453 1406406656 334640 4294967295 134512640 135237372 3220693712 3086145808 134546034 0 0 0 0 0 0 0 -1 1 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=1373444 CPUtime=305.83
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 85261 0 0 0 30532 51 0 0 25 0 5 0 1132271453 1406406656 334640 4294967295 134512640 135237372 3220693712 3077770976 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=1373444 CPUtime=307.81
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 70665 0 0 0 30763 18 0 0 25 0 5 0 1132271453 1406406656 334640 4294967295 134512640 135237372 3220693712 3069365232 134590227 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=1373444 CPUtime=305.54
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 60507 0 0 0 30506 48 0 0 25 0 5 0 1132271457 1406406656 334640 4294967295 134512640 135237372 3220693712 3060988288 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1261.26
Current children cumulated vsize (KiB) 1373444

[startup+702.309 s]
/proc/loadavg: 7.78 7.61 6.91 8/116 4386
/proc/meminfo: memFree=1586184/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=1458084 CPUtime=1380.52
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 357284 0 0 0 137866 186 0 0 25 0 5 0 1132268953 1493078016 355820 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 364521 355820 95 177 0 364343 0
[pid=2078/tid=2107] ppid=2076 vsize=1458084 CPUtime=347.15
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 64642 0 0 0 34678 37 0 0 25 0 5 0 1132271453 1493078016 355820 4294967295 134512640 135237372 3220693712 3086158352 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=1458084 CPUtime=335.61
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 90374 0 0 0 33506 55 0 0 25 0 5 0 1132271453 1493078016 355820 4294967295 134512640 135237372 3220693712 3077776352 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=1458084 CPUtime=337.61
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 77532 0 0 0 33742 19 0 0 25 0 5 0 1132271453 1493078016 355820 4294967295 134512640 135237372 3220693712 3069384648 134729005 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=1458084 CPUtime=335.15
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 65429 0 0 0 33457 58 0 0 25 0 5 0 1132271457 1493078016 355820 4294967295 134512640 135237372 3220693712 3060987168 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1380.52
Current children cumulated vsize (KiB) 1458084

[startup+762.314 s]
/proc/loadavg: 7.71 7.62 6.95 8/116 4575
/proc/meminfo: memFree=1512260/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=1531204 CPUtime=1500.16
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 375596 0 0 0 149817 199 0 0 25 0 5 0 1132268953 1567952896 374132 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 382801 374132 95 177 0 382623 0
[pid=2078/tid=2107] ppid=2076 vsize=1531204 CPUtime=377.23
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 67924 0 0 0 37685 38 0 0 25 0 5 0 1132271453 1567952896 374132 4294967295 134512640 135237372 3220693712 3086151136 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=1531204 CPUtime=365.43
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 95492 0 0 0 36483 60 0 0 25 0 5 0 1132271453 1567952896 374132 4294967295 134512640 135237372 3220693712 3077750816 134562320 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=1531204 CPUtime=367.55
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 82933 0 0 0 36735 20 0 0 25 0 5 0 1132271453 1567952896 374132 4294967295 134512640 135237372 3220693712 3069371548 134550044 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=1531204 CPUtime=364.95
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 69940 0 0 0 36431 64 0 0 25 0 5 0 1132271457 1567952896 374132 4294967295 134512640 135237372 3220693712 3060983248 134749345 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1500.16
Current children cumulated vsize (KiB) 1531204

[startup+822.309 s]
/proc/loadavg: 7.81 7.65 7.00 8/116 4763
/proc/meminfo: memFree=1439144/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=1604644 CPUtime=1619.52
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 393953 0 0 0 161737 215 0 0 25 0 5 0 1132268953 1643155456 392489 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 401161 392489 95 177 0 400983 0
[pid=2078/tid=2107] ppid=2076 vsize=1604644 CPUtime=407.23
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 71216 0 0 0 40683 40 0 0 25 0 5 0 1132271453 1643155456 392489 4294967295 134512640 135237372 3220693712 3086155744 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=1604644 CPUtime=395.13
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 100507 0 0 0 39451 62 0 0 25 0 5 0 1132271453 1643155456 392489 4294967295 134512640 135237372 3220693712 3077764512 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=1604644 CPUtime=397.41
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 88424 0 0 0 39716 25 0 0 25 0 5 0 1132271453 1643155456 392489 4294967295 134512640 135237372 3220693712 3069368992 134562320 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=1604644 CPUtime=394.75
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 74499 0 0 0 39404 71 0 0 25 0 5 0 1132271457 1643155456 392489 4294967295 134512640 135237372 3220693712 3060992416 134562405 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1619.52
Current children cumulated vsize (KiB) 1604644

[startup+882.314 s]
/proc/loadavg: 7.49 7.59 7.02 8/116 4949
/proc/meminfo: memFree=1374572/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=1668804 CPUtime=1739.22
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 409952 0 0 0 173695 227 0 0 25 0 5 0 1132268953 1708855296 408488 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 417201 408488 95 177 0 417023 0
[pid=2078/tid=2107] ppid=2076 vsize=1668804 CPUtime=437.13
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 74358 0 0 0 43670 43 0 0 25 0 5 0 1132271453 1708855296 408488 4294967295 134512640 135237372 3220693712 3086165008 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=1668804 CPUtime=425.04
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 106349 0 0 0 42437 67 0 0 25 0 5 0 1132271453 1708855296 408488 4294967295 134512640 135237372 3220693712 3077773392 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=1668804 CPUtime=427.4
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 91887 0 0 0 42713 27 0 0 25 0 5 0 1132271453 1708855296 408488 4294967295 134512640 135237372 3220693712 3069370668 134636641 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=1668804 CPUtime=424.65
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 78051 0 0 0 42392 73 0 0 25 0 5 0 1132271457 1708855296 408488 4294967295 134512640 135237372 3220693712 3060989056 134562338 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1739.22
Current children cumulated vsize (KiB) 1668804

[startup+942.309 s]
/proc/loadavg: 7.52 7.58 7.05 9/116 5137
/proc/meminfo: memFree=1319656/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=1724324 CPUtime=1858.84
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 423811 0 0 0 185647 237 0 0 25 0 5 0 1132268953 1765707776 422347 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 431081 422347 95 177 0 430903 0
[pid=2078/tid=2107] ppid=2076 vsize=1724324 CPUtime=467.11
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 77744 0 0 0 46667 44 0 0 25 0 5 0 1132271453 1765707776 422347 4294967295 134512640 135237372 3220693712 3086148064 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=1724324 CPUtime=454.91
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 111310 0 0 0 45421 70 0 0 25 0 5 0 1132271453 1765707776 422347 4294967295 134512640 135237372 3220693712 3077761184 134562341 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=1724324 CPUtime=457.41
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 95010 0 0 0 45713 28 0 0 25 0 5 0 1132271453 1765707776 422347 4294967295 134512640 135237372 3220693712 3069387696 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=1724324 CPUtime=454.41
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 80440 0 0 0 45363 78 0 0 25 0 5 0 1132271457 1765707776 422347 4294967295 134512640 135237372 3220693712 3060993088 134546034 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1858.84
Current children cumulated vsize (KiB) 1724324



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1000.01 s]
/proc/loadavg: 7.75 7.64 7.10 8/116 5329
/proc/meminfo: memFree=1259304/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=1783844 CPUtime=1973.93
/proc/2078/stat : 2078 (ttsth-5-0) S 2076 2078 20065 0 -1 4202496 438722 0 0 0 197146 247 0 0 25 0 5 0 1132268953 1826656256 437258 4294967295 134512640 135237372 3220693712 3220693308 134629544 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 445961 437258 95 177 0 445783 0
[pid=2078/tid=2107] ppid=2076 vsize=1783844 CPUtime=496.03
/proc/2078/task/2107/stat : 2107 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 80504 0 0 0 49558 45 0 0 25 0 5 0 1132271453 1826656256 437258 4294967295 134512640 135237372 3220693712 3086157472 134562338 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=1783844 CPUtime=483.61
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 118421 0 0 0 48286 75 0 0 25 0 5 0 1132271453 1826656256 437258 4294967295 134512640 135237372 3220693712 3077757536 134562338 0 0 0 0 0 0 0 -1 0 0 0 0
[pid=2078/tid=2109] ppid=2076 vsize=1783844 CPUtime=486.21
/proc/2078/task/2109/stat : 2109 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 98003 0 0 0 48591 30 0 0 25 0 5 0 1132271453 1826656256 437258 4294967295 134512640 135237372 3220693712 3069347856 134546034 0 0 0 0 0 0 0 -1 3 0 0 0
[pid=2078/tid=2111] ppid=2076 vsize=1783844 CPUtime=483.08
/proc/2078/task/2111/stat : 2111 (ttsth-5-0) R 2076 2078 20065 0 -1 4202560 82487 0 0 0 48228 80 0 0 25 0 5 0 1132271457 1826656256 437258 4294967295 134512640 135237372 3220693712 3060981216 134562341 0 0 0 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1973.93
Current children cumulated vsize (KiB) 1783844

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1000.12 s]
/proc/loadavg: 7.75 7.64 7.10 8/116 5329
/proc/meminfo: memFree=1259304/3368532 swapFree=1953788/1959888
[pid=2078] ppid=2076 vsize=0 CPUtime=1974.03
/proc/2078/stat : 2078 (ttsth-5-0) Z 2076 2078 20065 0 -1 4203524 438728 0 0 0 197148 255 0 0 18 0 2 0 1132268953 0 0 4294967295 0 0 0 0 0 0 0 0 0 4294967295 0 0 17 0 0 0 0
/proc/2078/statm: 0 0 0 0 0 0 0
[pid=2078/tid=2108] ppid=2076 vsize=0 CPUtime=483.69
/proc/2078/task/2108/stat : 2108 (ttsth-5-0) R 2076 2078 20065 0 -1 4203588 118421 0 0 0 48286 83 0 0 25 0 2 0 1132271453 0 0 4294967295 0 0 0 0 0 0 0 0 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1974.03
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1000.13
CPU time (s): 1974.04
CPU user time (s): 1971.48
CPU system time (s): 2.56
CPU usage (%): 197.379
Max. virtual memory (cumulated for all children) (KiB): 1783844

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1971.48
system time used= 2.56
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 438728
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 399
involuntary context switches= 51589

runsolver used 0 second user time and 0 second system time

The end

Launcher Data 

Begin job on  at 2009-05-30 11:34:08
IDJOB=1776868
IDBENCH=69600
IDSOLVER=632
FILE ID=/1776868-1243676048
PBS_JOBID=
Free space on /tmp= 6457 MiB

SOLVER NAME= ttsth-5-0 2009-03-19 (4 threads)
BENCH NAME= SAT_RACE08/cnf/vange-col-abb313GPIA-9-c.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= runsolver --timestamp  -w /tmp/evaluation-result-1776868-1243676048/watcher-1776868-1243676048 -o /tmp/evaluation-result-1776868-1243676048/solver-1776868-1243676048 -C 10000 -W 1000 -M 2047  HOME/ttsth-5-0 -num-threads 4 HOME/instance-1776868-1243676048.cnf

TIME LIMIT= 10000 seconds
MEMORY LIMIT= 2047 MiB
MAX NB THREAD= 4

MD5SUM BENCH= 0baefedb2aaa81442743e253487854d8
RANDOM SEED= 1717370642

Linux (none) 2.6.21.5 #6 SMP Wed Jul 4 17:16:38 CEST 2007 i686 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3992.41
clflush size	: 64

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 0
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.12
clflush size	: 64

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 0
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 15
model name	: Intel(R) Xeon(R) CPU            5130  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.061
cache size	: 4096 KB
physical id	: 3
siblings	: 2
core id		: 1
cpu cores	: 2
fdiv_bug	: no
hlt_bug		: no
f00f_bug	: no
coma_bug	: no
fpu		: yes
fpu_exception	: yes
cpuid level	: 10
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
bogomips	: 3990.14
clflush size	: 64


/proc/meminfo:
MemTotal:      3368532 kB
MemFree:       3010044 kB
Buffers:        118548 kB
Cached:         123208 kB
SwapCached:       2256 kB
Active:         177364 kB
Inactive:        81356 kB
HighTotal:     2489216 kB
HighFree:      2347976 kB
LowTotal:       879316 kB
LowFree:        662068 kB
SwapTotal:     1959888 kB
SwapFree:      1953788 kB
Dirty:           27152 kB
Writeback:           0 kB
AnonPages:       15996 kB
Mapped:           5272 kB
Slab:            91192 kB
SReclaimable:    77100 kB
SUnreclaim:      14092 kB
PageTables:        668 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   3644152 kB
Committed_AS:   112684 kB
VmallocTotal:   114680 kB
VmallocUsed:      1444 kB
VmallocChunk:   113072 kB

Free space on /tmp at the end= 6457 MiB
End job on  at 2009-05-30 11:50:51