Trace number 1531282

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (TO) 1200.24 1200.67

General information on the benchmark

NameRANDOM/LARGE/3SAT/UNKNOWN/12000/
unif-k3-r4.2-v12000-c50400-S15767910-042.cnf
MD5SUMc210a2e606daadbb1d4386048a71e2b1
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark67.4987
Satisfiable
(Un)Satisfiability was proved
Number of variables12000
Number of clauses50400
Sum of the clauses size151200
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 350400
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.09/0.11	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1531282-1238409817.cnf 
0.09/0.11	c Using SATTIMEOUT of 1200
0.09/0.11	c Using SATRAM of 1800
0.09/0.11	c Size of subset node = 16
0.09/0.11	c Variables = 12000
0.09/0.11	c Clauses = 50400
0.09/0.11	c Literals = 151200
0.09/0.11	c Reduced size:
0.09/0.11	c Variables = 12000
0.09/0.11	c Clauses = 50063
0.09/0.11	c Literals = 150189
0.09/0.11	c a2
0.29/0.30	c a1
6.19/6.25	c Independent sub-problems = 1
6.19/6.25	c Sub-problem with 11946 variables and 50063 clauses
6.19/6.25	c using permutation method 4
6.19/6.25	c count = 1
6.19/6.25	c Ordering finished 6.220 seconds
6.19/6.25	c mapped 6.250 seconds
6.19/6.25	c permuted 6.250 seconds
6.19/6.25	c about to sort
6.19/6.27	c sorted
6.69/6.70	c clauses now 50063
6.69/6.70	c init finished 6.330 seconds
6.69/6.70	c tree built 6.700 seconds
6.69/6.70	c 
6.69/6.70	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
6.69/6.70	c ---------------------------------|----------------------------------|------------------------------------------------------
6.69/6.70	c ................................ | ..........                       |                        6.7           0.0             
6.69/6.70	c ................................ | ..........                     1 |                        6.7           0.1             
6.69/6.70	c ................................ | ..........                     2 |                        6.7           0.3             
6.69/6.70	c ................................ | ..........                     3 |                        6.7           0.4             
6.69/6.70	c ................................ | ..........                     4 |                        6.7           0.6             
6.69/6.70	c ................................ | ..........                     5 |                        6.7           0.7             
6.69/6.71	c ................................ | ..........                  1000 |                        6.7         149.3            3
23.99/24.00	c ................................ | ..........                695000 | 51457                 24.0       28958.3       185404
48.07/48.16	c ................................ | ..........               1119000 | 95819                 48.1       23244.7      1119949
72.06/72.17	c ................................ | ..........               1347000 | 123624                72.1       18672.0      2253861
96.25/96.33	c ................................ | ..........               1554000 | 147956                96.3       16137.1      3482296
120.05/120.18	c ................................ | *.........               1696000 | 166682               120.2       14115.7      4659234
144.04/144.16	c ................................ | *.........               1839000 | 185227               144.1       12760.2      5936285
168.23/168.37	c ................................ | *.........               1984000 | 203828               168.3       11786.4      7041031
192.32/192.44	c ................................ | *.........               2078000 | 217470               192.4       10801.0      8547281
216.01/216.17	c ................................ | *.........               2176000 | 231217               216.1       10068.5      9580925
240.00/240.16	c ................................ | **........               2256000 | 242898               240.1        9395.7     10640573
263.99/264.19	c ................................ | **........               2389000 | 259540               264.1        9045.1     11249859
288.09/288.24	c ................................ | **........               2497000 | 273581               288.2        8665.0     11993930
312.08/312.23	c ................................ | **........               2556000 | 282740               312.2        8188.1     13048235
336.27/336.40	c ................................ | **........               2610000 | 291454               336.3        7760.2     14061436
359.96/360.19	c ................................ | ***.......               2654000 | 298674               360.1        7370.0     14987789
383.96/384.19	c ................................ | ***.......               2707000 | 307016               384.1        7047.5     15912096
408.25/408.46	c ................................ | ***.......               2781000 | 317037               408.4        6810.0     16929173
432.04/432.23	c ................................ | ***.......               2859000 | 327408               432.1        6615.9     17545837
456.24/456.48	c ................................ | ***.......               2916000 | 336072               456.4        6389.3     18425676
480.02/480.26	c ................................ | ****......               2998000 | 347807               480.1        6243.9     19129061
504.01/504.24	c ................................ | ****......               3080000 | 359317               504.1        6109.4     20051828
528.01/528.29	c ................................ | ****......               3193000 | 374117               528.2        6045.3     20875728
552.00/552.26	c ................................ | ****......               3393000 | 396665               552.1        6145.2     21597745
576.19/576.44	c ................................ | ****......               3478000 | 409071               576.3        6034.8     22907519
599.98/600.28	c ................................ | *****.....               3609000 | 424833               600.2        6013.4     24051626
624.07/624.31	c ................................ | *****.....               3765000 | 443773               624.2        6032.0     25074302
647.96/648.30	c ................................ | *****.....               3906000 | 461626               648.2        6026.3     25962432
672.05/672.34	c ................................ | *****.....               4046000 | 479089               672.2        6019.0     26962875
696.25/696.51	c ................................ | *****.....               4126000 | 490401               696.4        5925.0     28882544
720.04/720.32	c ................................ | ******....               4195000 | 500766               720.2        5825.0     30538572
743.83/744.15	c ................................ | ******....               4239000 | 508586               744.0        5697.6     32551230
768.02/768.36	c ................................ | ******....               4298000 | 517294               768.2        5594.9     33863484
791.91/792.28	c ................................ | ******....               4410000 | 530167               792.1        5567.3     35135992
816.00/816.36	c ................................ | ******....               4535000 | 545774               816.2        5556.3     36099911
839.90/840.28	c ................................ | *******...               4694000 | 564579               840.1        5587.4     37806453
863.99/864.30	c ................................ | *******...               4898000 | 585838               864.1        5668.2     39461836
888.28/888.69	c ................................ | *******...               5063000 | 604746               888.5        5698.3     41372211
911.97/912.34	c ................................ | *******...               5119000 | 613908               912.1        5612.0     43506958
936.17/936.56	c ................................ | *******...               5181000 | 623612               936.4        5533.1     45136232
960.16/960.56	c ................................ | ********..               5258000 | 634530               960.4        5475.0     47099678
984.54/984.90	c ................................ | ********..               5299000 | 641365               984.7        5381.3     48960966
1008.13/1008.51	c ................................ | ********..               5330000 | 646752              1008.3        5286.1     50437571
1032.13/1032.52	c ................................ | ********..               5376000 | 654267              1032.3        5207.7     52218901
1056.12/1056.60	c ................................ | ********..               5420000 | 661339              1056.4        5130.7     53902813
1080.10/1080.60	c ................................ | *********.               5455000 | 667172              1080.4        5049.2     55390574
1104.70/1105.18	c ................................ | *********.               5485000 | 672218              1105.0        4964.0     57235316
1127.89/1128.39	c ................................ | *********.               5517000 | 677552              1128.2        4890.3     58920394
1152.18/1152.61	c ................................ | *********.               5557000 | 684162              1152.4        4822.2     60456312
1176.48/1176.98	c ................................ | *********.               5590000 | 689403              1176.7        4750.4     61664581

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:489) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1531282-1238409817/watcher-1531282-1238409817 -o /tmp/evaluation-result-1531282-1238409817/solver-1531282-1238409817 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1531282-1238409817.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.83 2.94 2.86 4/86 26557
/proc/meminfo: memFree=1759584/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=1064 CPUtime=0
/proc/26557/stat : 26557 (ttsth-5-0) R 26555 26557 26328 0 -1 4194304 151 0 0 0 0 0 0 0 20 0 1 0 467312137 1089536 135 1992294400 134512640 135237372 4294956192 18446744073709551615 134520493 0 0 4096 0 0 0 0 17 1 0 0
/proc/26557/statm: 266 135 77 176 0 88 0

[startup+0.068099 s]
/proc/loadavg: 2.83 2.94 2.86 4/86 26557
/proc/meminfo: memFree=1759584/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=3208 CPUtime=0.06
/proc/26557/stat : 26557 (ttsth-5-0) R 26555 26557 26328 0 -1 4194304 682 0 0 0 6 0 0 0 20 0 1 0 467312137 3284992 666 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 1 0 0
/proc/26557/statm: 802 666 78 176 0 624 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 3208

[startup+0.101104 s]
/proc/loadavg: 2.83 2.94 2.86 4/86 26557
/proc/meminfo: memFree=1759584/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=4404 CPUtime=0.09
/proc/26557/stat : 26557 (ttsth-5-0) R 26555 26557 26328 0 -1 4194304 941 0 0 0 9 0 0 0 20 0 1 0 467312137 4509696 925 1992294400 134512640 135237372 4294956192 18446744073709551615 134534067 0 0 4096 0 0 0 0 17 1 0 0
/proc/26557/statm: 1101 925 78 176 0 923 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4404

[startup+0.30114 s]
/proc/loadavg: 2.83 2.94 2.86 4/86 26557
/proc/meminfo: memFree=1759584/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=8496 CPUtime=0.29
/proc/26557/stat : 26557 (ttsth-5-0) R 26555 26557 26328 0 -1 4194304 1968 0 0 0 29 0 0 0 22 0 1 0 467312137 8699904 1952 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 17 1 0 0
/proc/26557/statm: 2124 1952 79 176 0 1946 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 8496

[startup+0.701215 s]
/proc/loadavg: 2.83 2.94 2.86 4/86 26557
/proc/meminfo: memFree=1759584/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=10976 CPUtime=0.69
/proc/26557/stat : 26557 (ttsth-5-0) R 26555 26557 26328 0 -1 4194304 2702 0 0 0 68 1 0 0 25 0 1 0 467312137 11239424 2587 1992294400 134512640 135237372 4294956192 18446744073709551615 134555279 0 0 4096 0 0 0 0 17 1 0 0
/proc/26557/statm: 2744 2587 80 176 0 2566 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 10976

[startup+1.50136 s]
/proc/loadavg: 2.83 2.94 2.86 3/87 26558
/proc/meminfo: memFree=1749528/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=10976 CPUtime=1.49
/proc/26557/stat : 26557 (ttsth-5-0) R 26555 26557 26328 0 -1 4194304 2706 0 0 0 148 1 0 0 25 0 1 0 467312137 11239424 2591 1992294400 134512640 135237372 4294956192 18446744073709551615 134555279 0 0 4096 0 0 0 0 17 1 0 0
/proc/26557/statm: 2744 2591 80 176 0 2566 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 10976

[startup+3.10166 s]
/proc/loadavg: 2.83 2.94 2.86 3/87 26558
/proc/meminfo: memFree=1749272/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=10976 CPUtime=3.09
/proc/26557/stat : 26557 (ttsth-5-0) R 26555 26557 26328 0 -1 4194304 2715 0 0 0 308 1 0 0 25 0 1 0 467312137 11239424 2600 1992294400 134512640 135237372 4294956192 18446744073709551615 134555272 0 0 4096 0 0 0 0 17 1 0 0
/proc/26557/statm: 2744 2600 80 176 0 2566 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 10976

[startup+6.30125 s]
/proc/loadavg: 2.77 2.92 2.86 3/87 26558
/proc/meminfo: memFree=1749144/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=17372 CPUtime=6.29
/proc/26557/stat : 26557 (ttsth-5-0) R 26555 26557 26328 0 -1 4194304 4330 0 0 0 627 2 0 0 25 0 1 0 467312137 17788928 4166 1992294400 134512640 135237372 4294956192 18446744073709551615 134574468 0 0 4096 0 0 0 0 17 1 0 0
/proc/26557/statm: 4376 4171 88 176 0 4198 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 17372

[startup+12.7014 s]
/proc/loadavg: 2.79 2.92 2.86 4/89 26560
/proc/meminfo: memFree=1713544/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=65988 CPUtime=12.69
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 11745 0 0 0 1263 6 0 0 25 0 3 0 467312137 67571712 11516 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 16497 11516 98 176 0 16319 0
[pid=26557/tid=26559] ppid=26555 vsize=65988 CPUtime=3
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 505 0 0 0 300 0 0 0 25 0 3 0 467312808 67571712 11516 1992294400 134512640 135237372 4294956192 18446744073709551615 134590129 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=65988 CPUtime=2.98
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 282 0 0 0 298 0 0 0 25 0 3 0 467312808 67571712 11516 1992294400 134512640 135237372 4294956192 18446744073709551615 134587943 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 65988

[startup+25.5018 s]
/proc/loadavg: 2.83 2.93 2.86 4/89 26560
/proc/meminfo: memFree=1709640/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=69728 CPUtime=25.48
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 12718 0 0 0 2541 7 0 0 25 0 3 0 467312137 71401472 12489 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 17432 12489 98 176 0 17254 0
[pid=26557/tid=26559] ppid=26555 vsize=69728 CPUtime=9.39
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 1222 0 0 0 939 0 0 0 25 0 3 0 467312808 71401472 12489 1992294400 134512640 135237372 4294956192 18446744073709551615 134587921 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=69728 CPUtime=9.37
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 538 0 0 0 937 0 0 0 25 0 3 0 467312808 71401472 12489 1992294400 134512640 135237372 4294956192 18446744073709551615 134561426 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 69728

[startup+51.1015 s]
/proc/loadavg: 2.89 2.93 2.86 4/89 26560
/proc/meminfo: memFree=1692040/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=87420 CPUtime=51.07
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 17178 0 0 0 5098 9 0 0 25 0 3 0 467312137 89518080 16948 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 21855 16948 98 176 0 21677 0
[pid=26557/tid=26559] ppid=26555 vsize=87420 CPUtime=22.2
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 5054 0 0 0 2217 3 0 0 25 0 3 0 467312808 89518080 16948 1992294400 134512640 135237372 4294956192 18446744073709551615 134562370 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=87420 CPUtime=22.17
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 1166 0 0 0 2216 1 0 0 25 0 3 0 467312808 89518080 16948 1992294400 134512640 135237372 4294956192 18446744073709551615 134590581 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 87420

[startup+102.307 s]
/proc/loadavg: 2.95 2.94 2.87 4/89 26560
/proc/meminfo: memFree=1650248/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=129284 CPUtime=102.26
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 27481 0 0 0 10212 14 0 0 25 0 3 0 467312137 132386816 27251 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 32321 27251 98 176 0 32143 0
[pid=26557/tid=26559] ppid=26555 vsize=129284 CPUtime=47.79
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 13655 0 0 0 4772 7 0 0 25 0 3 0 467312808 132386816 27251 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=129284 CPUtime=47.76
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 2868 0 0 0 4774 2 0 0 25 0 3 0 467312808 132386816 27251 1992294400 134512640 135237372 4294956192 18446744073709551615 134561524 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 129284

[startup+162.302 s]
/proc/loadavg: 2.98 2.95 2.87 4/89 26560
/proc/meminfo: memFree=1604232/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=175920 CPUtime=162.23
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 39011 0 0 0 16202 21 0 0 25 0 3 0 467312137 180142080 38781 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 43980 38781 98 176 0 43802 0
[pid=26557/tid=26559] ppid=26555 vsize=175920 CPUtime=77.78
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 21952 0 0 0 7768 10 0 0 25 0 3 0 467312808 180142080 38781 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=175920 CPUtime=77.74
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 6101 0 0 0 7769 5 0 0 25 0 3 0 467312808 180142080 38781 1992294400 134512640 135237372 4294956192 18446744073709551615 134590166 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 175920

[startup+222.302 s]
/proc/loadavg: 2.99 2.95 2.88 4/89 26560
/proc/meminfo: memFree=1554696/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=225484 CPUtime=222.21
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 51318 0 0 0 22194 27 0 0 25 0 3 0 467312137 230895616 51088 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 56371 51088 98 176 0 56193 0
[pid=26557/tid=26559] ppid=26555 vsize=225484 CPUtime=107.78
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 31210 0 0 0 10763 15 0 0 25 0 3 0 467312808 230895616 51088 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=225484 CPUtime=107.72
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 9150 0 0 0 10765 7 0 0 25 0 3 0 467312808 230895616 51088 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 225484

[startup+282.301 s]
/proc/loadavg: 2.99 2.96 2.89 4/89 26560
/proc/meminfo: memFree=1524104/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=256744 CPUtime=282.19
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 59058 0 0 0 28188 31 0 0 25 0 3 0 467312137 262905856 58828 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 64186 58828 98 176 0 64008 0
[pid=26557/tid=26559] ppid=26555 vsize=256744 CPUtime=137.77
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 36340 0 0 0 13761 16 0 0 25 0 3 0 467312808 262905856 58828 1992294400 134512640 135237372 4294956192 18446744073709551615 134562377 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=256744 CPUtime=137.7
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 11760 0 0 0 13761 9 0 0 25 0 3 0 467312808 262905856 58828 1992294400 134512640 135237372 4294956192 18446744073709551615 134546026 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 282.19
Current children cumulated vsize (KiB) 256744

[startup+342.301 s]
/proc/loadavg: 2.99 2.96 2.89 4/89 26560
/proc/meminfo: memFree=1483720/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=296756 CPUtime=342.17
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 68999 0 0 0 34179 38 0 0 25 0 3 0 467312137 303878144 68769 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 74189 68769 98 176 0 74011 0
[pid=26557/tid=26559] ppid=26555 vsize=296756 CPUtime=167.77
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 43545 0 0 0 16757 20 0 0 25 0 3 0 467312808 303878144 68769 1992294400 134512640 135237372 4294956192 18446744073709551615 134591211 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=296756 CPUtime=167.69
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 14496 0 0 0 16757 12 0 0 25 0 3 0 467312808 303878144 68769 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 342.17
Current children cumulated vsize (KiB) 296756

[startup+402.301 s]
/proc/loadavg: 2.99 2.97 2.90 4/89 26560
/proc/meminfo: memFree=1447560/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=336364 CPUtime=402.14
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 78255 0 0 0 40171 43 0 0 25 0 3 0 467312137 344436736 78025 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 84091 78025 98 176 0 83913 0
[pid=26557/tid=26559] ppid=26555 vsize=336364 CPUtime=197.76
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 50745 0 0 0 19753 23 0 0 25 0 3 0 467312808 344436736 78025 1992294400 134512640 135237372 4294956192 18446744073709551615 134680467 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=336364 CPUtime=197.67
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 16552 0 0 0 19753 14 0 0 25 0 3 0 467312808 344436736 78025 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 402.14
Current children cumulated vsize (KiB) 336364


################
# More data... #
################

[pid=26557] ppid=26555 vsize=439328 CPUtime=582.09
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 104003 0 0 0 58151 58 0 0 25 0 3 0 467312137 449871872 103773 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 109832 103773 98 176 0 109654 0
[pid=26557/tid=26559] ppid=26555 vsize=439328 CPUtime=287.73
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 67923 0 0 0 28740 33 0 0 25 0 3 0 467312808 449871872 103773 1992294400 134512640 135237372 4294956192 18446744073709551615 134562294 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=439328 CPUtime=287.65
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 25122 0 0 0 28746 19 0 0 25 0 3 0 467312808 449871872 103773 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 582.09
Current children cumulated vsize (KiB) 439328

[startup+642.302 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26562
/proc/meminfo: memFree=1303368/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=478868 CPUtime=642.07
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 113905 0 0 0 64143 64 0 0 25 0 3 0 467312137 490360832 113675 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 119717 113675 98 176 0 119539 0
[pid=26557/tid=26559] ppid=26555 vsize=478868 CPUtime=317.71
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 74804 0 0 0 31734 37 0 0 25 0 3 0 467312808 490360832 113675 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=478868 CPUtime=317.64
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 28143 0 0 0 31743 21 0 0 25 0 3 0 467312808 490360832 113675 1992294400 134512640 135237372 4294956192 18446744073709551615 134549693 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 642.07
Current children cumulated vsize (KiB) 478868

[startup+702.302 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26562
/proc/meminfo: memFree=1248392/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=534024 CPUtime=702.04
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 127715 0 0 0 70133 71 0 0 25 0 3 0 467312137 546840576 127485 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 133506 127485 98 176 0 133328 0
[pid=26557/tid=26559] ppid=26555 vsize=534024 CPUtime=347.7
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 83561 0 0 0 34728 42 0 0 25 0 3 0 467312808 546840576 127485 1992294400 134512640 135237372 4294956192 18446744073709551615 134587166 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=534024 CPUtime=347.64
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 33196 0 0 0 34740 24 0 0 25 0 3 0 467312808 546840576 127485 1992294400 134512640 135237372 4294956192 18446744073709551615 134562272 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 702.04
Current children cumulated vsize (KiB) 534024

[startup+762.307 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26562
/proc/meminfo: memFree=1182408/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=600372 CPUtime=762.03
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 144095 0 0 0 76125 78 0 0 25 0 3 0 467312137 614780928 143865 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 150093 143865 98 176 0 149915 0
[pid=26557/tid=26559] ppid=26555 vsize=600372 CPUtime=377.68
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 94829 0 0 0 37722 46 0 0 25 0 3 0 467312808 614780928 143865 1992294400 134512640 135237372 4294956192 18446744073709551615 134519965 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=600372 CPUtime=377.63
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 38308 0 0 0 37737 26 0 0 25 0 3 0 467312808 614780928 143865 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 762.03
Current children cumulated vsize (KiB) 600372

[startup+822.302 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26562
/proc/meminfo: memFree=1132680/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=650748 CPUtime=822
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 156661 0 0 0 82115 85 0 0 25 0 3 0 467312137 666365952 156431 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 162687 156431 98 176 0 162509 0
[pid=26557/tid=26559] ppid=26555 vsize=650748 CPUtime=407.66
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 102456 0 0 0 40717 49 0 0 25 0 3 0 467312808 666365952 156431 1992294400 134512640 135237372 4294956192 18446744073709551615 134562278 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=650748 CPUtime=407.63
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 43247 0 0 0 40733 30 0 0 25 0 3 0 467312808 666365952 156431 1992294400 134512640 135237372 4294956192 18446744073709551615 134680249 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 822
Current children cumulated vsize (KiB) 650748

[startup+882.303 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26562
/proc/meminfo: memFree=1062856/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=720620 CPUtime=881.99
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 173948 0 0 0 88105 94 0 0 25 0 3 0 467312137 737914880 173718 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 180155 173718 98 176 0 179977 0
[pid=26557/tid=26559] ppid=26555 vsize=720620 CPUtime=437.65
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 109273 0 0 0 43711 54 0 0 25 0 3 0 467312808 737914880 173718 1992294400 134512640 135237372 4294956192 18446744073709551615 134562399 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=720620 CPUtime=437.62
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 53717 0 0 0 43728 34 0 0 25 0 3 0 467312808 737914880 173718 1992294400 134512640 135237372 4294956192 18446744073709551615 134562416 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 881.99
Current children cumulated vsize (KiB) 720620

[startup+942.302 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26562
/proc/meminfo: memFree=991112/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=792464 CPUtime=941.96
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 191929 0 0 0 94093 103 0 0 25 0 3 0 467312137 811483136 191699 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 198116 191699 98 176 0 197938 0
[pid=26557/tid=26559] ppid=26555 vsize=792464 CPUtime=467.62
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 119592 0 0 0 46703 59 0 0 25 0 3 0 467312808 811483136 191699 1992294400 134512640 135237372 4294956192 18446744073709551615 134552720 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=792464 CPUtime=467.62
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 61379 0 0 0 46724 38 0 0 25 0 3 0 467312808 811483136 191699 1992294400 134512640 135237372 4294956192 18446744073709551615 134562416 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 941.96
Current children cumulated vsize (KiB) 792464

[startup+1002.3 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26562
/proc/meminfo: memFree=919176/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=864396 CPUtime=1001.93
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 209734 0 0 0 100082 111 0 0 25 0 3 0 467312137 885141504 209504 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 216099 209504 98 176 0 215921 0
[pid=26557/tid=26559] ppid=26555 vsize=864396 CPUtime=497.62
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 132398 0 0 0 49697 65 0 0 25 0 3 0 467312808 885141504 209504 1992294400 134512640 135237372 4294956192 18446744073709551615 134561481 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=864396 CPUtime=497.61
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 66378 0 0 0 49720 41 0 0 25 0 3 0 467312808 885141504 209504 1992294400 134512640 135237372 4294956192 18446744073709551615 134680290 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1001.93
Current children cumulated vsize (KiB) 864396

[startup+1062.3 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26568
/proc/meminfo: memFree=853824/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=930812 CPUtime=1061.91
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 226163 0 0 0 106071 120 0 0 25 0 3 0 467312137 953151488 225933 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 232703 225933 98 176 0 232525 0
[pid=26557/tid=26559] ppid=26555 vsize=930812 CPUtime=527.61
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 145280 0 0 0 52691 70 0 0 25 0 3 0 467312808 953151488 225933 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=930812 CPUtime=527.58
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 69925 0 0 0 52714 44 0 0 25 0 3 0 467312808 953151488 225933 1992294400 134512640 135237372 4294956192 18446744073709551615 134562300 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1061.91
Current children cumulated vsize (KiB) 930812

[startup+1122.3 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26568
/proc/meminfo: memFree=788480/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=995156 CPUtime=1121.89
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 242380 0 0 0 112062 127 0 0 25 0 3 0 467312137 1019039744 242150 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 248789 242150 98 176 0 248611 0
[pid=26557/tid=26559] ppid=26555 vsize=995156 CPUtime=557.61
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 157564 0 0 0 55685 76 0 0 25 0 3 0 467312808 1019039744 242150 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=995156 CPUtime=557.57
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 73858 0 0 0 55712 45 0 0 25 0 3 0 467312808 1019039744 242150 1992294400 134512640 135237372 4294956192 18446744073709551615 134591217 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1121.89
Current children cumulated vsize (KiB) 995156

[startup+1182.3 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26568
/proc/meminfo: memFree=730944/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=1054080 CPUtime=1181.87
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 256793 0 0 0 118054 133 0 0 25 0 3 0 467312137 1079377920 256563 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 263520 256563 98 176 0 263342 0
[pid=26557/tid=26559] ppid=26555 vsize=1054080 CPUtime=587.61
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 167055 0 0 0 58681 80 0 0 25 0 3 0 467312808 1079377920 256563 1992294400 134512640 135237372 4294956192 18446744073709551615 134749335 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=1054080 CPUtime=587.56
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 78780 0 0 0 58708 48 0 0 25 0 3 0 467312808 1079377920 256563 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1181.87
Current children cumulated vsize (KiB) 1054080



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.5 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26568
/proc/meminfo: memFree=713664/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=1070660 CPUtime=1200.07
/proc/26557/stat : 26557 (ttsth-5-0) S 26555 26557 26328 0 -1 4194304 260942 0 0 0 119871 136 0 0 25 0 3 0 467312137 1096355840 260712 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/26557/statm: 267665 260712 98 176 0 267487 0
[pid=26557/tid=26559] ppid=26555 vsize=1070660 CPUtime=596.7
/proc/26557/task/26559/stat : 26559 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 169931 0 0 0 59588 82 0 0 25 0 3 0 467312808 1096355840 260712 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=26557/tid=26560] ppid=26555 vsize=1070660 CPUtime=596.65
/proc/26557/task/26560/stat : 26560 (ttsth-5-0) R 26555 26557 26328 0 -1 4194368 80053 0 0 0 59617 48 0 0 25 0 3 0 467312808 1096355840 260712 1992294400 134512640 135237372 4294956192 18446744073709551615 134519965 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 1070660

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.61 s]
/proc/loadavg: 2.99 2.97 2.91 4/89 26568
/proc/meminfo: memFree=713664/2055924 swapFree=4179644/4192956
[pid=26557] ppid=26555 vsize=0 CPUtime=1200.17
/proc/26557/stat : 26557 (ttsth-5-0) R 26555 26557 26328 0 -1 4195332 260942 0 0 0 119871 146 0 0 17 0 1 0 467312137 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 0 0 0
/proc/26557/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.17
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.67
CPU time (s): 1200.24
CPU user time (s): 1198.72
CPU system time (s): 1.52177
CPU usage (%): 99.9644
Max. virtual memory (cumulated for all children) (KiB): 1070660

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1198.72
system time used= 1.52177
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 260942
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5
involuntary context switches= 13967

runsolver used 1.51477 second user time and 3.9644 second system time

The end

Launcher Data 

Begin job on node83 at 2009-03-30 12:43:37
IDJOB=1531282
IDBENCH=70370
IDSOLVER=549
FILE ID=node83/1531282-1238409817
PBS_JOBID= 9061447
Free space on /tmp= 66504 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/RANDOM/LARGE/3SAT/UNKNOWN/12000/unif-k3-r4.2-v12000-c50400-S15767910-042.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1531282-1238409817/watcher-1531282-1238409817 -o /tmp/evaluation-result-1531282-1238409817/solver-1531282-1238409817 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1531282-1238409817.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= c210a2e606daadbb1d4386048a71e2b1
RANDOM SEED=1006587283

node83.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.268
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.268
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055924 kB
MemFree:       1760064 kB
Buffers:         49320 kB
Cached:         154668 kB
SwapCached:       7492 kB
Active:          83460 kB
Inactive:       139044 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055924 kB
LowFree:       1760064 kB
SwapTotal:     4192956 kB
SwapFree:      4179644 kB
Dirty:            1768 kB
Writeback:           0 kB
Mapped:          25992 kB
Slab:            57388 kB
Committed_AS:  1067532 kB
PageTables:       2680 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66504 MiB
End job on node83 at 2009-03-30 13:03:40