Trace number 1561148

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (TO) 1200.2 1207.15

General information on the benchmark

NameCRAFTED/edgematching/
compact/em_9_3_5_cmp.cnf
MD5SUMb2b9255b6dd854658cbd4bd594382e55
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark485.063
Satisfiable
(Un)Satisfiability was proved
Number of variables3857
Number of clauses39932
Sum of the clauses size134967
Maximum clause length49
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24591
Number of clauses of size 326002
Number of clauses of size 44516
Number of clauses of size 54669
Number of clauses of size over 5154

Solver Data 

0.05/0.08	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1561148-1238762302.cnf 
0.05/0.08	c Using SATTIMEOUT of 1200
0.05/0.08	c Using SATRAM of 1800
0.05/0.08	c Size of subset node = 16
0.05/0.08	c Variables = 3857
0.05/0.08	c Clauses = 39932
0.05/0.08	c Literals = 134967
0.05/0.08	c Reduced size:
0.05/0.08	c Variables = 3857
0.05/0.08	c Clauses = 39932
0.05/0.08	c Literals = 134967
0.05/0.08	c a2
0.28/0.31	c a1
6.55/6.69	c Independent sub-problems = 1
6.55/6.69	c Sub-problem with 3857 variables and 39932 clauses
6.55/6.69	c using permutation method 4
6.55/6.69	c count = 1
6.55/6.69	c Ordering finished 6.630 seconds
6.55/6.69	c mapped 6.650 seconds
6.55/6.69	c permuted 6.650 seconds
6.55/6.69	c about to sort
6.64/6.71	c sorted
6.85/6.94	c clauses now 39932
6.85/6.94	c init finished 6.690 seconds
6.85/6.94	c tree built 6.900 seconds
6.85/6.94	c 
6.85/6.94	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
6.85/6.94	c ---------------------------------|----------------------------------|------------------------------------------------------
6.85/6.94	c ................................ | ..........                       |                        6.9           0.0             
6.85/6.94	c ................................ | ..........                     1 |                        6.9           0.1             
6.85/6.94	c ................................ | ..........                     2 |                        6.9           0.3             
6.85/6.94	c ................................ | ..........                     3 |                        6.9           0.4             
6.85/6.94	c ................................ | ..........                     4 |                        6.9           0.6             
6.85/6.94	c ................................ | ..........                     5 |                        6.9           0.7             
6.85/6.97	c ................................ | ..........                  1000 | 2                      6.9         144.3        10803
23.96/24.16	c ................................ | ..........                133000 | 2406                  24.0        5537.1      2552465
48.01/48.32	c ................................ | ..........                273000 | 5634                  48.0        5682.8      5130756
72.07/72.51	c ................................ | ..........                399000 | 8302                  72.1        5534.7      6928051
96.03/96.64	c ................................ | ..........                502000 | 10903                 96.1        5224.3      9028123
119.99/120.77	c ................................ | *.........                597000 | 13815                120.1        4971.3     10959542
144.16/145.09	c ................................ | *.........                678000 | 18521                144.3        4699.2     12732257
168.22/169.23	c ................................ | *.........                748000 | 23018                168.3        4445.2     14559471
192.17/193.38	c ................................ | *.........                817000 | 29350                192.3        4248.6     16522269
216.24/217.50	c ................................ | *.........                911000 | 31917                216.3        4212.1     17476855
240.10/241.51	c ................................ | **........                993000 | 33838                240.2        4134.7     18918945
264.17/265.79	c ................................ | **........               1071000 | 35826                264.3        4052.2     20105195
287.93/289.68	c ................................ | **........               1148000 | 37767                288.1        3985.4     21289518
312.08/313.99	c ................................ | **........               1221000 | 39966                312.2        3910.7     22421031
336.14/338.13	c ................................ | **........               1298000 | 41937                336.2        3860.5     23463605
360.11/362.22	c ................................ | ***.......               1372000 | 43688                360.2        3809.2     24636737
384.07/386.36	c ................................ | ***.......               1440000 | 46803                384.2        3748.1     25922031
408.12/410.52	c ................................ | ***.......               1500000 | 51330                408.2        3674.6     27241409
432.29/434.83	c ................................ | ***.......               1554000 | 54804                432.4        3594.0     28778012
456.15/458.84	c ................................ | ***.......               1613000 | 58197                456.3        3535.2     30047421
479.92/482.74	c ................................ | ****......               1676000 | 61256                480.0        3491.4     31247332
503.88/506.87	c ................................ | ****......               1751000 | 62764                504.0        3474.0     32065440
527.84/530.99	c ................................ | ****......               1824000 | 64297                528.0        3454.5     32907572
552.10/555.32	c ................................ | ****......               1895000 | 66346                552.2        3431.7     33799226
575.86/579.28	c ................................ | ****......               1972000 | 67907                576.0        3423.4     34709924
599.82/603.39	c ................................ | *****.....               2047000 | 69197                600.0        3411.7     35607942
624.08/627.73	c ................................ | *****.....               2121000 | 70481                624.2        3397.9     36586803
648.04/651.83	c ................................ | *****.....               2185000 | 73291                648.2        3371.0     37865092
672.10/676.05	c ................................ | *****.....               2244000 | 76210                672.3        3338.0     38811548
695.86/699.95	c ................................ | *****.....               2302000 | 79016                696.0        3307.4     39621109
720.13/724.33	c ................................ | ******....               2367000 | 80782                720.3        3286.3     40075656
744.18/748.58	c ................................ | ******....               2431000 | 85756                744.4        3265.8     41146353
768.24/772.71	c ................................ | ******....               2496000 | 87453                768.4        3248.4     42164632
792.01/796.68	c ................................ | ******....               2560000 | 89391                792.2        3231.5     43176777
815.97/820.78	c ................................ | ******....               2631000 | 90507                816.2        3223.6     43861035
840.03/844.96	c ................................ | *******...               2696000 | 91370                840.2        3208.7     44522723
864.00/869.07	c ................................ | *******...               2759000 | 92535                864.2        3192.5     45175333
888.06/893.26	c ................................ | *******...               2816000 | 93799                888.2        3170.3     46170571
911.92/917.20	c ................................ | *******...               2877000 | 94823                912.1        3154.4     46867806
936.08/941.58	c ................................ | *******...               2942000 | 95996                936.3        3142.2     47635886
959.94/965.58	c ................................ | ********..               3000000 | 97148                960.2        3124.4     48435063
984.20/989.99	c ................................ | ********..               3061000 | 98128                984.4        3109.4     48972127
1007.76/1013.68	c ................................ | ********..               3117000 | 99189               1008.0        3092.3     49630208
1031.83/1037.87	c ................................ | ********..               3174000 | 100332              1032.0        3075.4     50843011
1056.18/1062.35	c ................................ | ********..               3231000 | 101158              1056.4        3058.5     51923386
1079.94/1086.29	c ................................ | *********.               3282000 | 102677              1080.2        3038.3     53174280
1104.01/1110.43	c ................................ | *********.               3334000 | 103571              1104.2        3019.4     54233076
1128.17/1134.73	c ................................ | *********.               3387000 | 104611              1128.4        3001.7     54990874
1152.13/1158.82	c ................................ | *********.               3440000 | 106124              1152.3        2985.3     55785328
1176.08/1182.99	c ................................ | *********.               3488000 | 107700              1176.4        2965.1     56428499

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1561148-1238762302/watcher-1561148-1238762302 -o /tmp/evaluation-result-1561148-1238762302/solver-1561148-1238762302 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1561148-1238762302.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.08 2.02 2.01 4/94 2363
/proc/meminfo: memFree=1821408/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=932 CPUtime=0
/proc/2363/stat : 2363 (ttsth-5-0) R 2361 2363 2167 0 -1 4194304 121 0 0 0 0 0 0 0 19 0 1 0 1148893859 954368 105 1992294400 134512640 135237372 4294956192 18446744073709551615 134730444 0 0 4096 0 0 0 0 17 0 0 0
/proc/2363/statm: 233 105 77 176 0 55 0

[startup+0.0574259 s]
/proc/loadavg: 2.08 2.02 2.01 4/94 2363
/proc/meminfo: memFree=1821408/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=2780 CPUtime=0.05
/proc/2363/stat : 2363 (ttsth-5-0) R 2361 2363 2167 0 -1 4194304 570 0 0 0 5 0 0 0 19 0 1 0 1148893859 2846720 554 1992294400 134512640 135237372 4294956192 18446744073709551615 134885886 0 0 4096 0 0 0 0 17 1 0 0
/proc/2363/statm: 695 554 78 176 0 517 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 2780

[startup+0.101429 s]
/proc/loadavg: 2.08 2.02 2.01 4/94 2363
/proc/meminfo: memFree=1821408/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=5424 CPUtime=0.09
/proc/2363/stat : 2363 (ttsth-5-0) R 2361 2363 2167 0 -1 4194304 1233 0 0 0 9 0 0 0 19 0 1 0 1148893859 5554176 1217 1992294400 134512640 135237372 4294956192 18446744073709551615 134730115 0 0 4096 0 0 0 0 17 1 0 0
/proc/2363/statm: 1356 1217 79 176 0 1178 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 5424

[startup+0.301451 s]
/proc/loadavg: 2.08 2.02 2.01 4/94 2363
/proc/meminfo: memFree=1821408/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=8600 CPUtime=0.28
/proc/2363/stat : 2363 (ttsth-5-0) R 2361 2363 2167 0 -1 4194304 2027 0 0 0 28 0 0 0 21 0 1 0 1148893859 8806400 2010 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 17 1 0 0
/proc/2363/statm: 2150 2010 79 176 0 1972 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 8600

[startup+0.701489 s]
/proc/loadavg: 2.08 2.02 2.01 4/94 2363
/proc/meminfo: memFree=1821408/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=8864 CPUtime=0.68
/proc/2363/stat : 2363 (ttsth-5-0) R 2361 2363 2167 0 -1 4194304 2163 0 0 0 68 0 0 0 25 0 1 0 1148893859 9076736 2068 1992294400 134512640 135237372 4294956192 18446744073709551615 134555272 0 0 4096 0 0 0 0 17 1 0 0
/proc/2363/statm: 2216 2068 80 176 0 2038 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 8864

[startup+1.50158 s]
/proc/loadavg: 2.08 2.02 2.01 3/95 2364
/proc/meminfo: memFree=1813272/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=8864 CPUtime=1.48
/proc/2363/stat : 2363 (ttsth-5-0) R 2361 2363 2167 0 -1 4194304 2163 0 0 0 148 0 0 0 25 0 1 0 1148893859 9076736 2068 1992294400 134512640 135237372 4294956192 18446744073709551615 134555279 0 0 4096 0 0 0 0 17 1 0 0
/proc/2363/statm: 2216 2068 80 176 0 2038 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 8864

[startup+3.10276 s]
/proc/loadavg: 2.07 2.02 2.00 3/95 2364
/proc/meminfo: memFree=1813080/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=8864 CPUtime=3.07
/proc/2363/stat : 2363 (ttsth-5-0) R 2361 2363 2167 0 -1 4194304 2164 0 0 0 307 0 0 0 25 0 1 0 1148893859 9076736 2069 1992294400 134512640 135237372 4294956192 18446744073709551615 134555279 0 0 4096 0 0 0 0 17 1 0 0
/proc/2363/statm: 2216 2069 80 176 0 2038 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 8864

[startup+6.30111 s]
/proc/loadavg: 2.07 2.02 2.00 3/95 2364
/proc/meminfo: memFree=1813080/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=8864 CPUtime=6.25
/proc/2363/stat : 2363 (ttsth-5-0) R 2361 2363 2167 0 -1 4194304 2165 0 0 0 625 0 0 0 25 0 1 0 1148893859 9076736 2070 1992294400 134512640 135237372 4294956192 18446744073709551615 134555272 0 0 4096 0 0 0 0 17 1 0 0
/proc/2363/statm: 2216 2070 80 176 0 2038 0
Current children cumulated CPU time (s) 6.25
Current children cumulated vsize (KiB) 8864

[startup+12.7018 s]
/proc/loadavg: 2.14 2.03 2.01 4/97 2366
/proc/meminfo: memFree=1787592/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=56048 CPUtime=12.62
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 8896 0 0 0 1258 4 0 0 25 0 3 0 1148893859 57393152 8762 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 14012 8762 98 176 0 13834 0
[pid=2363/tid=2365] ppid=2361 vsize=56048 CPUtime=2.89
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 1429 0 0 0 289 0 0 0 25 0 3 0 1148894554 57393152 8762 1992294400 134512640 135237372 4294956192 18446744073709551615 134519949 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=56048 CPUtime=2.82
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 2526 0 0 0 281 1 0 0 25 0 3 0 1148894554 57393152 8762 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 56048

[startup+25.5013 s]
/proc/loadavg: 2.27 2.06 2.02 4/97 2366
/proc/meminfo: memFree=1759240/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=84144 CPUtime=25.34
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 15703 0 0 0 2527 7 0 0 25 0 3 0 1148893859 86163456 15569 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 21036 15569 98 176 0 20858 0
[pid=2363/tid=2365] ppid=2361 vsize=84144 CPUtime=9.24
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 3712 0 0 0 922 2 0 0 25 0 3 0 1148894554 86163456 15569 1992294400 134512640 135237372 4294956192 18446744073709551615 134549981 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=84144 CPUtime=9.19
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 7050 0 0 0 917 2 0 0 25 0 3 0 1148894554 86163456 15569 1992294400 134512640 135237372 4294956192 18446744073709551615 134591531 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 25.34
Current children cumulated vsize (KiB) 84144

[startup+51.1011 s]
/proc/loadavg: 2.52 2.14 2.04 4/97 2366
/proc/meminfo: memFree=1717960/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=125560 CPUtime=50.8
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 26057 0 0 0 5066 14 0 0 25 0 3 0 1148893859 128573440 25923 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 31390 25923 98 176 0 31212 0
[pid=2363/tid=2365] ppid=2361 vsize=125560 CPUtime=21.97
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 7640 0 0 0 2191 6 0 0 25 0 3 0 1148894554 128573440 25923 1992294400 134512640 135237372 4294956192 18446744073709551615 134593350 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=125560 CPUtime=21.92
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 13476 0 0 0 2186 6 0 0 25 0 3 0 1148894554 128573440 25923 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 50.8
Current children cumulated vsize (KiB) 125560

[startup+102.309 s]
/proc/loadavg: 2.81 2.28 2.10 4/97 2366
/proc/meminfo: memFree=1651976/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=191564 CPUtime=101.7
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 42361 0 0 0 10145 25 0 0 25 0 3 0 1148893859 196161536 42227 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 47891 42227 98 176 0 47713 0
[pid=2363/tid=2365] ppid=2361 vsize=191564 CPUtime=47.38
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 14279 0 0 0 4727 11 0 0 25 0 3 0 1148894554 196161536 42227 1992294400 134512640 135237372 4294956192 18446744073709551615 134590777 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=191564 CPUtime=47.41
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 23141 0 0 0 4729 12 0 0 25 0 3 0 1148894554 196161536 42227 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 101.7
Current children cumulated vsize (KiB) 191564

[startup+162.301 s]
/proc/loadavg: 2.93 2.41 2.15 4/97 2366
/proc/meminfo: memFree=1580040/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=263936 CPUtime=161.35
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 60465 0 0 0 16101 34 0 0 25 0 3 0 1148893859 270270464 60331 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 65984 60331 98 176 0 65806 0
[pid=2363/tid=2365] ppid=2361 vsize=263936 CPUtime=77.13
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 24403 0 0 0 7697 16 0 0 25 0 3 0 1148894554 270270464 60331 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=263936 CPUtime=77.32
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 31121 0 0 0 7716 16 0 0 25 0 3 0 1148894554 270270464 60331 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 161.35
Current children cumulated vsize (KiB) 263936

[startup+222.301 s]
/proc/loadavg: 2.97 2.51 2.20 4/97 2366
/proc/meminfo: memFree=1523784/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=319420 CPUtime=221
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 74317 0 0 0 22058 42 0 0 25 0 3 0 1148893859 327086080 74183 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 79855 74183 98 176 0 79677 0
[pid=2363/tid=2365] ppid=2361 vsize=319420 CPUtime=106.93
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 32800 0 0 0 10672 21 0 0 25 0 3 0 1148894554 327086080 74183 1992294400 134512640 135237372 4294956192 18446744073709551615 134562317 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=319420 CPUtime=107.17
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 36576 0 0 0 10698 19 0 0 25 0 3 0 1148894554 327086080 74183 1992294400 134512640 135237372 4294956192 18446744073709551615 134562399 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 221
Current children cumulated vsize (KiB) 319420

[startup+282.302 s]
/proc/loadavg: 2.99 2.60 2.25 4/97 2366
/proc/meminfo: memFree=1473480/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=370360 CPUtime=280.67
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 87038 0 0 0 28019 48 0 0 25 0 3 0 1148893859 379248640 86904 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 92590 86904 98 176 0 92412 0
[pid=2363/tid=2365] ppid=2361 vsize=370360 CPUtime=136.72
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 38733 0 0 0 13649 23 0 0 25 0 3 0 1148894554 379248640 86904 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=370360 CPUtime=137.04
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 43364 0 0 0 13681 23 0 0 25 0 3 0 1148894554 379248640 86904 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 280.67
Current children cumulated vsize (KiB) 370360

[startup+342.302 s]
/proc/loadavg: 2.99 2.67 2.29 4/97 2366
/proc/meminfo: memFree=1430408/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=412844 CPUtime=340.32
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 97623 0 0 0 33979 53 0 0 25 0 3 0 1148893859 422752256 97489 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 103211 97489 98 176 0 103033 0
[pid=2363/tid=2365] ppid=2361 vsize=412844 CPUtime=166.51
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 44328 0 0 0 16626 25 0 0 25 0 3 0 1148894554 422752256 97489 1992294400 134512640 135237372 4294956192 18446744073709551615 134680282 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=412844 CPUtime=166.89
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 48354 0 0 0 16664 25 0 0 25 0 3 0 1148894554 422752256 97489 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 340.32
Current children cumulated vsize (KiB) 412844

[startup+402.301 s]
/proc/loadavg: 2.99 2.73 2.33 4/97 2366
/proc/meminfo: memFree=1382024/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=461304 CPUtime=399.98
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 109781 0 0 0 39939 59 0 0 25 0 3 0 1148893859 472375296 109647 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 115326 109647 98 176 0 115148 0
[pid=2363/tid=2365] ppid=2361 vsize=461304 CPUtime=196.38
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 51248 0 0 0 19609 29 0 0 25 0 3 0 1148894554 472375296 109647 1992294400 134512640 135237372 4294956192 18446744073709551615 134587833 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=461304 CPUtime=196.69
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 53592 0 0 0 19641 28 0 0 25 0 3 0 1148894554 472375296 109647 1992294400 134512640 135237372 4294956192 18446744073709551615 134562418 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 399.98
Current children cumulated vsize (KiB) 461304


################
# More data... #
################

[pid=2363] ppid=2361 vsize=587092 CPUtime=578.94
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 141206 0 0 0 57818 76 0 0 25 0 3 0 1148893859 601182208 141072 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 146773 141072 98 176 0 146595 0
[pid=2363/tid=2365] ppid=2361 vsize=587092 CPUtime=285.86
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 65916 0 0 0 28549 37 0 0 25 0 3 0 1148894554 601182208 141072 1992294400 134512640 135237372 4294956192 18446744073709551615 134681656 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=587092 CPUtime=286.18
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 70349 0 0 0 28581 37 0 0 25 0 3 0 1148894554 601182208 141072 1992294400 134512640 135237372 4294956192 18446744073709551615 134561524 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 578.94
Current children cumulated vsize (KiB) 587092

[startup+642.302 s]
/proc/loadavg: 2.99 2.87 2.47 4/97 2368
/proc/meminfo: memFree=1214600/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=627720 CPUtime=638.6
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 151367 0 0 0 63777 83 0 0 25 0 3 0 1148893859 642785280 151233 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 156930 151233 98 176 0 156752 0
[pid=2363/tid=2365] ppid=2361 vsize=627720 CPUtime=315.69
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 70246 0 0 0 31529 40 0 0 25 0 3 0 1148894554 642785280 151233 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=627720 CPUtime=316
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 76180 0 0 0 31559 41 0 0 25 0 3 0 1148894554 642785280 151233 1992294400 134512640 135237372 4294956192 18446744073709551615 134562351 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 638.6
Current children cumulated vsize (KiB) 627720

[startup+702.302 s]
/proc/loadavg: 2.99 2.89 2.50 4/97 2368
/proc/meminfo: memFree=1179336/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=662876 CPUtime=698.25
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 160167 0 0 0 69737 88 0 0 25 0 3 0 1148893859 678785024 160033 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 165719 160033 98 176 0 165541 0
[pid=2363/tid=2365] ppid=2361 vsize=662876 CPUtime=345.49
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 74243 0 0 0 34506 43 0 0 25 0 3 0 1148894554 678785024 160033 1992294400 134512640 135237372 4294956192 18446744073709551615 134587952 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=662876 CPUtime=345.85
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 80983 0 0 0 34542 43 0 0 25 0 3 0 1148894554 678785024 160033 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 698.25
Current children cumulated vsize (KiB) 662876

[startup+762.308 s]
/proc/loadavg: 2.99 2.91 2.53 4/97 2368
/proc/meminfo: memFree=1147336/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=694756 CPUtime=757.91
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 168108 0 0 0 75697 94 0 0 25 0 3 0 1148893859 711430144 167974 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 173689 167974 98 176 0 173511 0
[pid=2363/tid=2365] ppid=2361 vsize=694756 CPUtime=375.34
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 78840 0 0 0 37488 46 0 0 25 0 3 0 1148894554 711430144 167974 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=694756 CPUtime=375.66
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 84327 0 0 0 37521 45 0 0 25 0 3 0 1148894554 711430144 167974 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 757.91
Current children cumulated vsize (KiB) 694756

[startup+822.302 s]
/proc/loadavg: 2.99 2.92 2.56 4/97 2368
/proc/meminfo: memFree=1112968/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=730376 CPUtime=817.56
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 176710 0 0 0 81657 99 0 0 25 0 3 0 1148893859 747905024 176576 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 182594 176576 98 176 0 182416 0
[pid=2363/tid=2365] ppid=2361 vsize=730376 CPUtime=405.18
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 83791 0 0 0 40468 50 0 0 25 0 3 0 1148894554 747905024 176576 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=730376 CPUtime=405.47
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 87978 0 0 0 40500 47 0 0 25 0 3 0 1148894554 747905024 176576 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 817.56
Current children cumulated vsize (KiB) 730376

[startup+882.302 s]
/proc/loadavg: 2.99 2.93 2.58 4/97 2368
/proc/meminfo: memFree=1085320/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=758240 CPUtime=877.22
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 183596 0 0 0 87619 103 0 0 25 0 3 0 1148893859 776437760 183462 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 189560 183462 98 176 0 189382 0
[pid=2363/tid=2365] ppid=2361 vsize=758240 CPUtime=434.97
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 88567 0 0 0 43445 52 0 0 25 0 3 0 1148894554 776437760 183462 1992294400 134512640 135237372 4294956192 18446744073709551615 134590241 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=758240 CPUtime=435.33
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 90088 0 0 0 43485 48 0 0 25 0 3 0 1148894554 776437760 183462 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 877.22
Current children cumulated vsize (KiB) 758240

[startup+942.302 s]
/proc/loadavg: 2.99 2.94 2.61 4/97 2368
/proc/meminfo: memFree=1054088/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=789648 CPUtime=936.87
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 191419 0 0 0 93579 108 0 0 25 0 3 0 1148893859 808599552 191285 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 197412 191285 98 176 0 197234 0
[pid=2363/tid=2365] ppid=2361 vsize=789648 CPUtime=464.87
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 93342 0 0 0 46432 55 0 0 25 0 3 0 1148894554 808599552 191285 1992294400 134512640 135237372 4294956192 18446744073709551615 134562272 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=789648 CPUtime=465.09
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 93136 0 0 0 46459 50 0 0 25 0 3 0 1148894554 808599552 191285 1992294400 134512640 135237372 4294956192 18446744073709551615 134749351 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 936.87
Current children cumulated vsize (KiB) 789648

[startup+1002.3 s]
/proc/loadavg: 2.99 2.95 2.63 4/97 2368
/proc/meminfo: memFree=1027592/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=815900 CPUtime=996.52
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 197957 0 0 0 99540 112 0 0 25 0 3 0 1148893859 835481600 197823 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 203975 197823 98 176 0 203797 0
[pid=2363/tid=2365] ppid=2361 vsize=815900 CPUtime=494.66
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 97132 0 0 0 49409 57 0 0 25 0 3 0 1148894554 835481600 197823 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=815900 CPUtime=494.95
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 95884 0 0 0 49443 52 0 0 25 0 3 0 1148894554 835481600 197823 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 996.52
Current children cumulated vsize (KiB) 815900

[startup+1062.3 s]
/proc/loadavg: 2.99 2.95 2.65 4/97 2368
/proc/meminfo: memFree=987528/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=856444 CPUtime=1056.18
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 208090 0 0 0 105500 118 0 0 25 0 3 0 1148893859 876998656 207956 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 214111 207956 98 176 0 213933 0
[pid=2363/tid=2365] ppid=2361 vsize=856444 CPUtime=524.46
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 101403 0 0 0 52386 60 0 0 25 0 3 0 1148894554 876998656 207956 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=856444 CPUtime=524.81
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 101746 0 0 0 52426 55 0 0 25 0 3 0 1148894554 876998656 207956 1992294400 134512640 135237372 4294956192 18446744073709551615 134562388 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1056.18
Current children cumulated vsize (KiB) 856444

[startup+1122.3 s]
/proc/loadavg: 2.99 2.96 2.67 4/97 2368
/proc/meminfo: memFree=944648/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=898480 CPUtime=1115.84
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 218627 0 0 0 111459 125 0 0 25 0 3 0 1148893859 920043520 218493 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 224620 218493 98 176 0 224442 0
[pid=2363/tid=2365] ppid=2361 vsize=898480 CPUtime=554.3
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 106793 0 0 0 55366 64 0 0 25 0 3 0 1148894554 920043520 218493 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=898480 CPUtime=554.63
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 106893 0 0 0 55405 58 0 0 25 0 3 0 1148894554 920043520 218493 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1115.84
Current children cumulated vsize (KiB) 898480

[startup+1182.3 s]
/proc/loadavg: 2.99 2.97 2.68 4/97 2368
/proc/meminfo: memFree=916808/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=926448 CPUtime=1175.49
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 225631 0 0 0 117421 128 0 0 25 0 3 0 1148893859 948682752 225497 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 231612 225497 98 176 0 231434 0
[pid=2363/tid=2365] ppid=2361 vsize=926448 CPUtime=584.16
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 110451 0 0 0 58350 66 0 0 25 0 3 0 1148894554 948682752 225497 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=926448 CPUtime=584.42
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 110239 0 0 0 58382 60 0 0 25 0 3 0 1148894554 948682752 225497 1992294400 134512640 135237372 4294956192 18446744073709551615 134562430 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1175.49
Current children cumulated vsize (KiB) 926448



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1207 s]
/proc/loadavg: 2.99 2.97 2.69 4/97 2368
/proc/meminfo: memFree=907912/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=934888 CPUtime=1200.04
/proc/2363/stat : 2363 (ttsth-5-0) S 2361 2363 2167 0 -1 4194304 227740 0 0 0 119875 129 0 0 25 0 3 0 1148893859 957325312 227606 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 233722 227606 98 176 0 233544 0
[pid=2363/tid=2365] ppid=2361 vsize=934888 CPUtime=596.45
/proc/2363/task/2365/stat : 2365 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 111809 0 0 0 59579 66 0 0 25 0 3 0 1148894554 957325312 227606 1992294400 134512640 135237372 4294956192 18446744073709551615 134562454 0 0 4096 0 0 0 0 -1 1 0 0
[pid=2363/tid=2366] ppid=2361 vsize=934888 CPUtime=596.69
/proc/2363/task/2366/stat : 2366 (ttsth-5-0) R 2361 2363 2167 0 -1 4194368 110990 0 0 0 59608 61 0 0 25 0 3 0 1148894554 957325312 227606 1992294400 134512640 135237372 4294956192 18446744073709551615 134562459 0 0 4096 0 0 0 0 -1 1 0 0
Current children cumulated CPU time (s) 1200.04
Current children cumulated vsize (KiB) 934888

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1207.11 s]
/proc/loadavg: 2.99 2.97 2.69 4/97 2368
/proc/meminfo: memFree=907912/2055920 swapFree=4165840/4192956
[pid=2363] ppid=2361 vsize=0 CPUtime=1200.15
/proc/2363/stat : 2363 (ttsth-5-0) Z 2361 2363 2167 0 -1 4195340 227740 0 0 0 119876 139 0 0 16 0 2 0 1148893859 0 0 1992294400 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0
/proc/2363/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.15
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1207.15
CPU time (s): 1200.2
CPU user time (s): 1198.77
CPU system time (s): 1.43378
CPU usage (%): 99.4244
Max. virtual memory (cumulated for all children) (KiB): 934888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1198.77
system time used= 1.43378
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 227740
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 18
involuntary context switches= 25923

runsolver used 1.9747 second user time and 4.6303 second system time

The end

Launcher Data 

Begin job on node91 at 2009-04-03 14:38:22
IDJOB=1561148
IDBENCH=70909
IDSOLVER=549
FILE ID=node91/1561148-1238762302
PBS_JOBID= 9085504
Free space on /tmp= 66528 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/APPLICATIONS/edgematching/compact/em_9_3_5_cmp.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1561148-1238762302/watcher-1561148-1238762302 -o /tmp/evaluation-result-1561148-1238762302/solver-1561148-1238762302 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1561148-1238762302.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= b2b9255b6dd854658cbd4bd594382e55
RANDOM SEED=1655806831

node91.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.252
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.252
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1821888 kB
Buffers:         25240 kB
Cached:         128848 kB
SwapCached:       8976 kB
Active:          60748 kB
Inactive:       103800 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1821888 kB
SwapTotal:     4192956 kB
SwapFree:      4165840 kB
Dirty:            1700 kB
Writeback:           0 kB
Mapped:          16148 kB
Slab:            52652 kB
Committed_AS:  2483032 kB
PageTables:       3260 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264960 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66528 MiB
End job on node91 at 2009-04-03 14:58:31