Trace number 1531274

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth-5-0 2009-03-19? (TO) 1200.18 1200.73

General information on the benchmark

NameRANDOM/LARGE/3SAT/UNKNOWN/12000/
unif-k3-r4.2-v12000-c50400-S56507352-034.cnf
MD5SUM3489273d9d670dd6da5e410852c60205
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark530.094
Satisfiable
(Un)Satisfiability was proved
Number of variables12000
Number of clauses50400
Sum of the clauses size151200
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 350400
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.09/0.11	c Command: HOME/ttsth-5-0 -num-threads 2 HOME/instance-1531274-1238408613.cnf 
0.09/0.11	c Using SATTIMEOUT of 1200
0.09/0.11	c Using SATRAM of 1800
0.09/0.11	c Size of subset node = 16
0.09/0.11	c Variables = 12000
0.09/0.11	c Clauses = 50400
0.09/0.11	c Literals = 151200
0.09/0.11	c Reduced size:
0.09/0.11	c Variables = 12000
0.09/0.11	c Clauses = 50066
0.09/0.11	c Literals = 150198
0.09/0.11	c a2
0.29/0.30	c a1
6.60/6.63	c Independent sub-problems = 1
6.60/6.63	c Sub-problem with 11948 variables and 50066 clauses
6.60/6.63	c using permutation method 4
6.60/6.63	c count = 1
6.60/6.63	c Ordering finished 6.600 seconds
6.60/6.63	c mapped 6.630 seconds
6.60/6.63	c permuted 6.630 seconds
6.60/6.63	c about to sort
6.60/6.65	c sorted
6.99/7.08	c clauses now 50066
6.99/7.08	c init finished 6.710 seconds
6.99/7.08	c tree built 7.080 seconds
6.99/7.08	c 
6.99/7.08	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
6.99/7.08	c ---------------------------------|----------------------------------|------------------------------------------------------
6.99/7.08	c ................................ | ..........                       |                        7.1           0.0             
6.99/7.08	c ................................ | ..........                     1 |                        7.1           0.1             
6.99/7.08	c ................................ | ..........                     2 |                        7.1           0.3             
6.99/7.08	c ................................ | ..........                     3 |                        7.1           0.4             
6.99/7.08	c ................................ | ..........                     4 |                        7.1           0.6             
6.99/7.08	c ................................ | ..........                     5 |                        7.1           0.7             
6.99/7.08	c ................................ | ..........                  1000 |                        7.1         141.2            6
24.09/24.10	c ................................ | ..........                639000 | 46132                 24.1       26525.5       226383
48.07/48.12	c ................................ | ..........               1096000 | 93264                 48.1       22790.6       935319
71.96/72.03	c ................................ | ..........               1390000 | 124687                72.0       19305.6      1936919
95.95/96.06	c ................................ | ..........               1756000 | 160799                96.0       18287.9      2622285
119.94/120.09	c ................................ | *.........               1943000 | 182931               120.0       16184.9      3548098
143.93/144.05	c ................................ | *.........               2123000 | 203910               144.0       14743.1      4583036
167.92/168.08	c ................................ | *.........               2305000 | 224782               168.0       13717.8      5465616
192.00/192.10	c ................................ | *.........               2477000 | 245079               192.0       12899.0      6406801
215.89/216.09	c ................................ | *.........               2676000 | 267872               216.0       12387.7      7348084
239.98/240.14	c ................................ | **........               2841000 | 288187               240.1       11834.0      8444229
263.97/264.10	c ................................ | **........               2996000 | 306758               264.0       11347.6      9463801
287.85/288.09	c ................................ | **........               3137000 | 323218               288.0       10892.4     10632924
311.95/312.17	c ................................ | **........               3288000 | 340978               312.1       10536.1     11568173
335.93/336.19	c ................................ | **........               3447000 | 359116               336.1       10256.5     12270786
359.92/360.12	c ................................ | ***.......               3572000 | 374261               360.0        9922.2     13128670
384.12/384.32	c ................................ | ***.......               3641000 | 383702               384.2        9476.8     14520659
407.91/408.14	c ................................ | ***.......               3760000 | 398570               408.0        9215.5     15344662
432.10/432.36	c ................................ | ***.......               3914000 | 417072               432.2        9055.4     16107618
456.07/456.40	c ................................ | ***.......               4071000 | 435640               456.3        8922.5     16997195
480.17/480.42	c ................................ | ****......               4190000 | 449746               480.3        8724.3     17690603
503.96/504.20	c ................................ | ****......               4329000 | 465398               504.0        8588.6     18340541
527.84/528.19	c ................................ | ****......               4414000 | 476582               528.0        8359.5     19250793
551.84/552.18	c ................................ | ****......               4546000 | 490854               552.0        8235.5     19725470
575.83/576.18	c ................................ | ****......               4730000 | 509199               576.0        8211.8     20358005
600.11/600.42	c ................................ | *****.....               4834000 | 522182               600.2        8053.7     21012344
623.90/624.20	c ................................ | *****.....               4953000 | 535827               624.0        7937.5     21628424
647.89/648.25	c ................................ | *****.....               5154000 | 556181               648.0        7953.2     22393922
671.87/672.24	c ................................ | *****.....               5313000 | 573210               672.0        7906.0     23186714
695.87/696.30	c ................................ | *****.....               5446000 | 587879               696.1        7823.9     24251512
720.25/720.63	c ................................ | ******....               5579000 | 602729               720.4        7744.4     25321965
743.85/744.29	c ................................ | ******....               5657000 | 612665               744.1        7602.9     26446547
768.03/768.46	c ................................ | ******....               5721000 | 621644               768.2        7447.2     27712983
792.32/792.74	c ................................ | ******....               5764000 | 628619               792.5        7273.3     29066798
816.01/816.48	c ................................ | ******....               5810000 | 634981               816.2        7118.2     30473573
840.30/840.72	c ................................ | *******...               5883000 | 643971               840.5        6999.8     31421944
863.88/864.31	c ................................ | *******...               5936000 | 651178               864.0        6870.1     32331273
887.88/888.34	c ................................ | *******...               6003000 | 659328               888.1        6759.7     33512940
912.47/912.97	c ................................ | *******...               6063000 | 666812               912.7        6643.1     34866296
935.96/936.49	c ................................ | *******...               6106000 | 672338               936.2        6522.1     35939496
960.04/960.52	c ................................ | ********..               6153000 | 678382               960.2        6408.0     36923219
983.84/984.33	c ................................ | ********..               6200000 | 684538               984.0        6300.6     37972872
1007.82/1008.34	c ................................ | ********..               6242000 | 689941              1008.0        6192.3     38982317
1032.42/1032.95	c ................................ | ********..               6283000 | 695233              1032.6        6084.5     39940421
1056.80/1057.34	c ................................ | ********..               6314000 | 699350              1057.0        5973.5     41009941
1080.18/1080.78	c ................................ | *********.               6339000 | 702775              1080.4        5867.1     42003232
1104.38/1104.94	c ................................ | *********.               6381000 | 707891              1104.6        5776.8     42882349
1127.87/1128.44	c ................................ | *********.               6423000 | 713235              1128.1        5693.7     43633231
1151.76/1152.37	c ................................ | *********.               6464000 | 718537              1152.0        5611.1     44525870
1176.15/1176.79	c ................................ | *********.               6500000 | 723387              1176.4        5525.2     45436016

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:489) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1531274-1238408613/watcher-1531274-1238408613 -o /tmp/evaluation-result-1531274-1238408613/solver-1531274-1238408613 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/ttsth-5-0 -num-threads 2 HOME/instance-1531274-1238408613.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.99 2.97 2.69 4/86 26527
/proc/meminfo: memFree=1760544/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=1064 CPUtime=0
/proc/26527/stat : 26527 (ttsth-5-0) R 26525 26527 26328 0 -1 4194304 152 0 0 0 0 0 0 0 18 0 1 0 467191808 1089536 136 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 0 0 0
/proc/26527/statm: 266 136 77 176 0 88 0

[startup+0.068613 s]
/proc/loadavg: 2.99 2.97 2.69 4/86 26527
/proc/meminfo: memFree=1760544/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=3208 CPUtime=0.06
/proc/26527/stat : 26527 (ttsth-5-0) R 26525 26527 26328 0 -1 4194304 693 0 0 0 6 0 0 0 18 0 1 0 467191808 3284992 677 1992294400 134512640 135237372 4294956192 18446744073709551615 134732614 0 0 4096 0 0 0 0 17 0 0 0
/proc/26527/statm: 802 677 78 176 0 624 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 3208

[startup+0.101617 s]
/proc/loadavg: 2.99 2.97 2.69 4/86 26527
/proc/meminfo: memFree=1760544/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=4404 CPUtime=0.09
/proc/26527/stat : 26527 (ttsth-5-0) R 26525 26527 26328 0 -1 4194304 941 0 0 0 9 0 0 0 18 0 1 0 467191808 4509696 925 1992294400 134512640 135237372 4294956192 18446744073709551615 134534262 0 0 4096 0 0 0 0 17 0 0 0
/proc/26527/statm: 1101 925 78 176 0 923 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 4404

[startup+0.301654 s]
/proc/loadavg: 2.99 2.97 2.69 4/86 26527
/proc/meminfo: memFree=1760544/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=8364 CPUtime=0.29
/proc/26527/stat : 26527 (ttsth-5-0) R 26525 26527 26328 0 -1 4194304 1960 0 0 0 29 0 0 0 20 0 1 0 467191808 8564736 1944 1992294400 134512640 135237372 4294956192 18446744073709551615 134519981 0 0 4096 0 0 0 0 17 0 0 0
/proc/26527/statm: 2091 1944 79 176 0 1913 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 8364

[startup+0.701728 s]
/proc/loadavg: 2.99 2.97 2.69 4/86 26527
/proc/meminfo: memFree=1760544/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=10992 CPUtime=0.69
/proc/26527/stat : 26527 (ttsth-5-0) R 26525 26527 26328 0 -1 4194304 2701 0 0 0 69 0 0 0 23 0 1 0 467191808 11255808 2586 1992294400 134512640 135237372 4294956192 18446744073709551615 134555279 0 0 4096 0 0 0 0 17 0 0 0
/proc/26527/statm: 2748 2586 80 176 0 2570 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 10992

[startup+1.50188 s]
/proc/loadavg: 2.99 2.97 2.69 3/87 26528
/proc/meminfo: memFree=1750488/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=10992 CPUtime=1.49
/proc/26527/stat : 26527 (ttsth-5-0) R 26525 26527 26328 0 -1 4194304 2704 0 0 0 149 0 0 0 25 0 1 0 467191808 11255808 2589 1992294400 134512640 135237372 4294956192 18446744073709551615 134600797 0 0 4096 0 0 0 0 17 0 0 0
/proc/26527/statm: 2748 2589 80 176 0 2570 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 10992

[startup+3.10117 s]
/proc/loadavg: 2.99 2.97 2.69 3/87 26528
/proc/meminfo: memFree=1750232/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=10992 CPUtime=3.09
/proc/26527/stat : 26527 (ttsth-5-0) R 26525 26527 26328 0 -1 4194304 2711 0 0 0 309 0 0 0 25 0 1 0 467191808 11255808 2596 1992294400 134512640 135237372 4294956192 18446744073709551615 134555279 0 0 4096 0 0 0 0 17 0 0 0
/proc/26527/statm: 2748 2596 80 176 0 2570 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 10992

[startup+6.30176 s]
/proc/loadavg: 2.91 2.95 2.68 3/87 26528
/proc/meminfo: memFree=1750168/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=10992 CPUtime=6.29
/proc/26527/stat : 26527 (ttsth-5-0) R 26525 26527 26328 0 -1 4194304 2732 0 0 0 628 1 0 0 25 0 1 0 467191808 11255808 2617 1992294400 134512640 135237372 4294956192 18446744073709551615 134555272 0 0 4096 0 0 0 0 17 0 0 0
/proc/26527/statm: 2748 2617 80 176 0 2570 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 10992

[startup+12.7029 s]
/proc/loadavg: 2.92 2.95 2.68 4/89 26530
/proc/meminfo: memFree=1714312/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=67084 CPUtime=12.69
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 11794 0 0 0 1264 5 0 0 25 0 3 0 467191808 68694016 11565 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 16771 11565 98 176 0 16593 0
[pid=26527/tid=26529] ppid=26525 vsize=67084 CPUtime=2.8
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 528 0 0 0 280 0 0 0 25 0 3 0 467192516 68694016 11565 1992294400 134512640 135237372 4294956192 18446744073709551615 134590146 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=67084 CPUtime=2.8
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 310 0 0 0 280 0 0 0 25 0 3 0 467192516 68694016 11565 1992294400 134512640 135237372 4294956192 18446744073709551615 134590186 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 67084

[startup+25.5013 s]
/proc/loadavg: 2.94 2.95 2.69 4/89 26530
/proc/meminfo: memFree=1710152/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=71188 CPUtime=25.48
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 12827 0 0 0 2542 6 0 0 25 0 3 0 467191808 72896512 12598 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 17797 12598 98 176 0 17619 0
[pid=26527/tid=26529] ppid=26525 vsize=71188 CPUtime=9.2
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 1233 0 0 0 919 1 0 0 25 0 3 0 467192516 72896512 12598 1992294400 134512640 135237372 4294956192 18446744073709551615 134590091 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=71188 CPUtime=9.19
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 638 0 0 0 919 0 0 0 25 0 3 0 467192516 72896512 12598 1992294400 134512640 135237372 4294956192 18446744073709551615 134561549 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 71188

[startup+51.102 s]
/proc/loadavg: 2.96 2.95 2.70 4/89 26530
/proc/meminfo: memFree=1697288/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=84168 CPUtime=51.07
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 16060 0 0 0 5100 7 0 0 25 0 3 0 467191808 86188032 15831 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 21042 15831 98 176 0 20864 0
[pid=26527/tid=26529] ppid=26525 vsize=84168 CPUtime=22
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 3793 0 0 0 2198 2 0 0 25 0 3 0 467192516 86188032 15831 1992294400 134512640 135237372 4294956192 18446744073709551615 134562351 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=84168 CPUtime=21.98
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 1311 0 0 0 2197 1 0 0 25 0 3 0 467192516 86188032 15831 1992294400 134512640 135237372 4294956192 18446744073709551615 134587943 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 84168

[startup+102.307 s]
/proc/loadavg: 2.98 2.96 2.71 4/89 26530
/proc/meminfo: memFree=1666632/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=113888 CPUtime=102.25
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 23702 0 0 0 10211 14 0 0 25 0 3 0 467191808 116621312 23473 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 28472 23473 98 176 0 28294 0
[pid=26527/tid=26529] ppid=26525 vsize=113888 CPUtime=47.67
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 10196 0 0 0 4760 7 0 0 25 0 3 0 467192516 116621312 23473 1992294400 134512640 135237372 4294956192 18446744073709551615 134680499 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=113888 CPUtime=47.49
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 2550 0 0 0 4747 2 0 0 25 0 3 0 467192516 116621312 23473 1992294400 134512640 135237372 4294956192 18446744073709551615 134561510 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 113888

[startup+162.302 s]
/proc/loadavg: 2.99 2.97 2.73 4/89 26530
/proc/meminfo: memFree=1628616/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=151844 CPUtime=162.21
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 33153 0 0 0 16202 19 0 0 25 0 3 0 467191808 155488256 32923 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 37961 32923 98 176 0 37783 0
[pid=26527/tid=26529] ppid=26525 vsize=151844 CPUtime=77.64
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 17944 0 0 0 7753 11 0 0 25 0 3 0 467192516 155488256 32923 1992294400 134512640 135237372 4294956192 18446744073709551615 134519962 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=151844 CPUtime=77.49
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 4253 0 0 0 7745 4 0 0 25 0 3 0 467192516 155488256 32923 1992294400 134512640 135237372 4294956192 18446744073709551615 134680308 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 162.21
Current children cumulated vsize (KiB) 151844

[startup+222.302 s]
/proc/loadavg: 2.99 2.97 2.74 4/89 26530
/proc/meminfo: memFree=1588872/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=192144 CPUtime=222.19
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 43079 0 0 0 22193 26 0 0 25 0 3 0 467191808 196755456 42849 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 48036 42849 98 176 0 47858 0
[pid=26527/tid=26529] ppid=26525 vsize=192144 CPUtime=107.61
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 25613 0 0 0 10746 15 0 0 25 0 3 0 467192516 196755456 42849 1992294400 134512640 135237372 4294956192 18446744073709551615 134749343 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=192144 CPUtime=107.48
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 6510 0 0 0 10742 6 0 0 25 0 3 0 467192516 196755456 42849 1992294400 134512640 135237372 4294956192 18446744073709551615 134749335 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 222.19
Current children cumulated vsize (KiB) 192144

[startup+282.302 s]
/proc/loadavg: 2.99 2.97 2.75 4/89 26530
/proc/meminfo: memFree=1545096/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=235440 CPUtime=282.16
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 54049 0 0 0 28184 32 0 0 25 0 3 0 467191808 241090560 53819 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 58860 53819 98 176 0 58682 0
[pid=26527/tid=26529] ppid=26525 vsize=235440 CPUtime=137.59
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 34283 0 0 0 13739 20 0 0 25 0 3 0 467192516 241090560 53819 1992294400 134512640 135237372 4294956192 18446744073709551615 134550989 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=235440 CPUtime=137.48
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 8810 0 0 0 13740 8 0 0 25 0 3 0 467192516 241090560 53819 1992294400 134512640 135237372 4294956192 18446744073709551615 134749353 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 282.16
Current children cumulated vsize (KiB) 235440

[startup+342.303 s]
/proc/loadavg: 2.99 2.97 2.76 4/89 26530
/proc/meminfo: memFree=1514184/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=266424 CPUtime=342.14
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 61717 0 0 0 34177 37 0 0 25 0 3 0 467191808 272818176 61487 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 66606 61487 98 176 0 66428 0
[pid=26527/tid=26529] ppid=26525 vsize=266424 CPUtime=167.57
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 38475 0 0 0 16735 22 0 0 25 0 3 0 467192516 272818176 61487 1992294400 134512640 135237372 4294956192 18446744073709551615 134562459 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=266424 CPUtime=167.47
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 12286 0 0 0 16737 10 0 0 25 0 3 0 467192516 272818176 61487 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 342.14
Current children cumulated vsize (KiB) 266424

[startup+402.302 s]
/proc/loadavg: 2.99 2.97 2.77 4/89 26530
/proc/meminfo: memFree=1470984/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=309124 CPUtime=402.1
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 72453 0 0 0 40168 42 0 0 25 0 3 0 467191808 316542976 72223 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 77281 72223 98 176 0 77103 0
[pid=26527/tid=26529] ppid=26525 vsize=309124 CPUtime=197.57
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 46892 0 0 0 19731 26 0 0 25 0 3 0 467192516 316542976 72223 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=309124 CPUtime=197.44
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 14605 0 0 0 19733 11 0 0 25 0 3 0 467192516 316542976 72223 1992294400 134512640 135237372 4294956192 18446744073709551615 134562363 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 402.1
Current children cumulated vsize (KiB) 309124


################
# More data... #
################

[pid=26527] ppid=26525 vsize=394780 CPUtime=582.02
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 93426 0 0 0 58145 57 0 0 25 0 3 0 467191808 404254720 93196 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 98695 93196 98 176 0 98517 0
[pid=26527/tid=26529] ppid=26525 vsize=394780 CPUtime=287.55
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 60093 0 0 0 28721 34 0 0 25 0 3 0 467192516 404254720 93196 1992294400 134512640 135237372 4294956192 18446744073709551615 134680208 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=394780 CPUtime=287.37
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 22377 0 0 0 28719 18 0 0 25 0 3 0 467192516 404254720 93196 1992294400 134512640 135237372 4294956192 18446744073709551615 134562351 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 582.02
Current children cumulated vsize (KiB) 394780

[startup+642.302 s]
/proc/loadavg: 2.99 2.97 2.82 4/89 26530
/proc/meminfo: memFree=1359944/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=421364 CPUtime=641.99
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 100086 0 0 0 64137 62 0 0 25 0 3 0 467191808 431476736 99856 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 105341 99856 98 176 0 105163 0
[pid=26527/tid=26529] ppid=26525 vsize=421364 CPUtime=317.55
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 63438 0 0 0 31718 37 0 0 25 0 3 0 467192516 431476736 99856 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=421364 CPUtime=317.35
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 25692 0 0 0 31715 20 0 0 25 0 3 0 467192516 431476736 99856 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 641.99
Current children cumulated vsize (KiB) 421364

[startup+702.301 s]
/proc/loadavg: 2.99 2.97 2.83 4/89 26530
/proc/meminfo: memFree=1322504/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=458928 CPUtime=701.96
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 109496 0 0 0 70129 67 0 0 25 0 3 0 467191808 469942272 109266 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 114732 109266 98 176 0 114554 0
[pid=26527/tid=26529] ppid=26525 vsize=458928 CPUtime=347.53
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 67390 0 0 0 34713 40 0 0 25 0 3 0 467192516 469942272 109266 1992294400 134512640 135237372 4294956192 18446744073709551615 134562416 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=458928 CPUtime=347.34
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 31150 0 0 0 34711 23 0 0 25 0 3 0 467192516 469942272 109266 1992294400 134512640 135237372 4294956192 18446744073709551615 134749353 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 701.96
Current children cumulated vsize (KiB) 458928

[startup+762.307 s]
/proc/loadavg: 2.99 2.97 2.83 4/89 26530
/proc/meminfo: memFree=1277512/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=504372 CPUtime=761.94
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 120631 0 0 0 76120 74 0 0 25 0 3 0 467191808 516476928 120401 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 126093 120401 98 176 0 125915 0
[pid=26527/tid=26529] ppid=26525 vsize=504372 CPUtime=377.51
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 72883 0 0 0 37708 43 0 0 25 0 3 0 467192516 516476928 120401 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=504372 CPUtime=377.34
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 36792 0 0 0 37708 26 0 0 25 0 3 0 467192516 516476928 120401 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 761.94
Current children cumulated vsize (KiB) 504372

[startup+822.301 s]
/proc/loadavg: 2.99 2.97 2.84 4/89 26530
/proc/meminfo: memFree=1223880/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=558736 CPUtime=821.91
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 134108 0 0 0 82110 81 0 0 25 0 3 0 467191808 572145664 133878 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 139684 133878 98 176 0 139506 0
[pid=26527/tid=26529] ppid=26525 vsize=558736 CPUtime=407.48
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 82175 0 0 0 40700 48 0 0 25 0 3 0 467192516 572145664 133878 1992294400 134512640 135237372 4294956192 18446744073709551615 134562380 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=558736 CPUtime=407.33
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 40977 0 0 0 40705 28 0 0 25 0 3 0 467192516 572145664 133878 1992294400 134512640 135237372 4294956192 18446744073709551615 134549950 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 821.91
Current children cumulated vsize (KiB) 558736

[startup+882.301 s]
/proc/loadavg: 2.99 2.97 2.84 4/89 26530
/proc/meminfo: memFree=1185608/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=597104 CPUtime=881.88
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 143603 0 0 0 88103 85 0 0 25 0 3 0 467191808 611434496 143373 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 149276 143373 98 176 0 149098 0
[pid=26527/tid=26529] ppid=26525 vsize=597104 CPUtime=437.46
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 87193 0 0 0 43695 51 0 0 25 0 3 0 467192516 611434496 143373 1992294400 134512640 135237372 4294956192 18446744073709551615 134562377 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=597104 CPUtime=437.33
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 45454 0 0 0 43703 30 0 0 25 0 3 0 467192516 611434496 143373 1992294400 134512640 135237372 4294956192 18446744073709551615 134562272 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 881.88
Current children cumulated vsize (KiB) 597104

[startup+942.301 s]
/proc/loadavg: 2.99 2.97 2.85 4/89 26530
/proc/meminfo: memFree=1138760/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=643960 CPUtime=941.85
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 155347 0 0 0 94093 92 0 0 25 0 3 0 467191808 659415040 155117 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 160990 155117 98 176 0 160812 0
[pid=26527/tid=26529] ppid=26525 vsize=643960 CPUtime=467.43
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 96422 0 0 0 46688 55 0 0 25 0 3 0 467192516 659415040 155117 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=643960 CPUtime=467.32
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 47969 0 0 0 46700 32 0 0 25 0 3 0 467192516 659415040 155117 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 941.85
Current children cumulated vsize (KiB) 643960

[startup+1002.3 s]
/proc/loadavg: 2.99 2.97 2.85 4/89 26530
/proc/meminfo: memFree=1099976/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=682712 CPUtime=1001.82
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 164986 0 0 0 100085 97 0 0 25 0 3 0 467191808 699097088 164756 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 170678 164756 98 176 0 170500 0
[pid=26527/tid=26529] ppid=26525 vsize=682712 CPUtime=497.43
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 103459 0 0 0 49684 59 0 0 25 0 3 0 467192516 699097088 164756 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=682712 CPUtime=497.3
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 50571 0 0 0 49697 33 0 0 25 0 3 0 467192516 699097088 164756 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1001.82
Current children cumulated vsize (KiB) 682712

[startup+1062.3 s]
/proc/loadavg: 2.99 2.97 2.86 4/89 26530
/proc/meminfo: memFree=1059400/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=722996 CPUtime=1061.79
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 175103 0 0 0 106078 101 0 0 25 0 3 0 467191808 740347904 174873 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 180749 174873 98 176 0 180571 0
[pid=26527/tid=26529] ppid=26525 vsize=722996 CPUtime=527.42
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 111900 0 0 0 52680 62 0 0 25 0 3 0 467192516 740347904 174873 1992294400 134512640 135237372 4294956192 18446744073709551615 134562384 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=722996 CPUtime=527.28
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 52247 0 0 0 52694 34 0 0 25 0 3 0 467192516 740347904 174873 1992294400 134512640 135237372 4294956192 18446744073709551615 134749343 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1061.79
Current children cumulated vsize (KiB) 722996

[startup+1122.3 s]
/proc/loadavg: 2.99 2.97 2.87 4/89 26530
/proc/meminfo: memFree=1025032/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=757184 CPUtime=1121.77
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 183670 0 0 0 112070 107 0 0 25 0 3 0 467191808 775356416 183440 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 189296 183440 98 176 0 189118 0
[pid=26527/tid=26529] ppid=26525 vsize=757184 CPUtime=557.41
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 118292 0 0 0 55675 66 0 0 25 0 3 0 467192516 775356416 183440 1992294400 134512640 135237372 4294956192 18446744073709551615 134562341 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=757184 CPUtime=557.26
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 54422 0 0 0 55690 36 0 0 25 0 3 0 467192516 775356416 183440 1992294400 134512640 135237372 4294956192 18446744073709551615 134562407 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1121.77
Current children cumulated vsize (KiB) 757184

[startup+1182.3 s]
/proc/loadavg: 2.99 2.97 2.87 4/89 26530
/proc/meminfo: memFree=991048/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=791248 CPUtime=1181.74
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 192193 0 0 0 118061 113 0 0 25 0 3 0 467191808 810237952 191963 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 197812 191963 98 176 0 197634 0
[pid=26527/tid=26529] ppid=26525 vsize=791248 CPUtime=587.41
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 123390 0 0 0 58671 70 0 0 25 0 3 0 467192516 810237952 191963 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=791248 CPUtime=587.24
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 57847 0 0 0 58686 38 0 0 25 0 3 0 467192516 810237952 191963 1992294400 134512640 135237372 4294956192 18446744073709551615 134562344 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1181.74
Current children cumulated vsize (KiB) 791248



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1200.6 s]
/proc/loadavg: 2.99 2.97 2.87 4/89 26530
/proc/meminfo: memFree=980232/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=801580 CPUtime=1200.04
/proc/26527/stat : 26527 (ttsth-5-0) S 26525 26527 26328 0 -1 4194304 194775 0 0 0 119889 115 0 0 25 0 3 0 467191808 820817920 194545 1992294400 134512640 135237372 4294956192 18446744073709551615 134629544 0 0 4096 0 18446744073709551615 0 0 17 0 0 0
/proc/26527/statm: 200395 194545 98 176 0 200217 0
[pid=26527/tid=26529] ppid=26525 vsize=801580 CPUtime=596.54
/proc/26527/task/26529/stat : 26529 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 124977 0 0 0 59583 71 0 0 25 0 3 0 467192516 820817920 194545 1992294400 134512640 135237372 4294956192 18446744073709551615 134749327 0 0 4096 0 0 0 0 -1 0 0 0
[pid=26527/tid=26530] ppid=26525 vsize=801580 CPUtime=596.41
/proc/26527/task/26530/stat : 26530 (ttsth-5-0) R 26525 26527 26328 0 -1 4194368 58842 0 0 0 59602 39 0 0 25 0 3 0 467192516 820817920 194545 1992294400 134512640 135237372 4294956192 18446744073709551615 134562338 0 0 4096 0 0 0 0 -1 0 0 0
Current children cumulated CPU time (s) 1200.04
Current children cumulated vsize (KiB) 801580

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1200.71 s]
/proc/loadavg: 2.99 2.97 2.87 4/89 26530
/proc/meminfo: memFree=980232/2055924 swapFree=4179644/4192956
[pid=26527] ppid=26525 vsize=0 CPUtime=1200.14
/proc/26527/stat : 26527 (ttsth-5-0) R 26525 26527 26328 0 -1 4195332 194777 0 0 0 119890 124 0 0 17 0 1 0 467191808 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/26527/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1200.14
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1200.73
CPU time (s): 1200.18
CPU user time (s): 1198.91
CPU system time (s): 1.26881
CPU usage (%): 99.9536
Max. virtual memory (cumulated for all children) (KiB): 801580

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1198.91
system time used= 1.26881
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 194777
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 16290

runsolver used 1.37079 second user time and 4.10338 second system time

The end

Launcher Data 

Begin job on node83 at 2009-03-30 12:23:34
IDJOB=1531274
IDBENCH=70366
IDSOLVER=549
FILE ID=node83/1531274-1238408613
PBS_JOBID= 9061447
Free space on /tmp= 66504 MiB

SOLVER NAME= ttsth-5-0 2009-03-19
BENCH NAME= SAT09/RANDOM/LARGE/3SAT/UNKNOWN/12000/unif-k3-r4.2-v12000-c50400-S56507352-034.cnf
COMMAND LINE= HOME/ttsth-5-0 -num-threads MAXNBTHREAD BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1531274-1238408613/watcher-1531274-1238408613 -o /tmp/evaluation-result-1531274-1238408613/solver-1531274-1238408613 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/ttsth-5-0 -num-threads 2 HOME/instance-1531274-1238408613.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 2

MD5SUM BENCH= 3489273d9d670dd6da5e410852c60205
RANDOM SEED=1077269178

node83.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.268
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.268
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5996.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055924 kB
MemFree:       1761024 kB
Buffers:         48680 kB
Cached:         154424 kB
SwapCached:       7492 kB
Active:          83372 kB
Inactive:       138156 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055924 kB
LowFree:       1761024 kB
SwapTotal:     4192956 kB
SwapFree:      4179644 kB
Dirty:            1744 kB
Writeback:           0 kB
Mapped:          25992 kB
Slab:            57436 kB
Committed_AS:  1066240 kB
PageTables:       2680 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66504 MiB
End job on node83 at 2009-03-30 12:43:36