Trace number 3261078

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.33 1227.3

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-24-57-sat.cnf
MD5SUM179851d97340610ea74d8d7b3cffb10b
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.042993
Satisfiable
(Un)Satisfiability was proved
Number of variables1368
Number of clauses16308
Sum of the clauses size64296
Maximum clause length57
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 215732
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5576

Solver Data 

0.00/0.02	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3261078-1304086618.cnf 
0.00/0.02	c Using SATTIMEOUT of 4800
0.00/0.02	c Using SATRAM of 15500
0.00/0.02	c Size of subset node = 32
0.00/0.02	c Variables = 1368
0.00/0.02	c Clauses = 16308
0.00/0.02	c Literals = 64296
0.00/0.02	c Reduced size:
0.00/0.02	c Variables = 1368
0.00/0.02	c Clauses = 16308
0.00/0.02	c Literals = 64296
0.00/0.02	c a2
0.19/0.20	c a1
32.39/32.44	c Independent sub-problems = 1
32.39/32.44	c Sub-problem with 1368 variables and 16308 clauses
32.39/32.44	c using permutation method 4
32.39/32.44	c count = 2
32.39/32.44	c Ordering finished 32.430 seconds
32.39/32.44	c mapped 32.430 seconds
32.39/32.44	c permuted 32.430 seconds
32.39/32.44	c about to sort
32.39/32.44	c sorted
32.39/32.48	c clauses now 16308
32.39/32.48	c init finished 32.450 seconds
32.39/32.48	c tree built 32.470 seconds
32.39/32.48	c 
32.39/32.48	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
32.39/32.48	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
32.39/32.48	c ................................ | ..........                    |                                 32.5         0.0             
32.39/32.48	c ................................ | ..........                  1 |                                 32.5         0.0             
32.39/32.48	c ................................ | ..........                  2 |                                 32.5         0.1             
32.39/32.48	c ................................ | ..........                  3 |                                 32.5         0.1             
32.39/32.48	c ................................ | ..........                  4 |                                 32.5         0.1             
32.39/32.48	c ................................ | ..........                  5 |                                 32.5         0.2             
32.39/32.49	c ................................ | ..........               1000 |              105                32.5        30.8          393
95.90/48.45	c ................................ | ..........             572000 | 148892       4433               96.1      5952.8      6689494
191.59/72.50	c ................................ | ..........            1139000 | 303759       6374              192.0      5932.3     13590844
288.14/96.62	c ................................ | ..........            1415000 | 383045       6965              288.2      4909.4     17975100
384.31/120.72	c ................................ | ..........            1640000 | 443656       7090              384.4      4266.5     19778289
480.03/144.75	c ................................ | *.........            1849000 | 502680       7102              480.3      3850.0     21914485
576.25/168.87	c ................................ | *.........            2049000 | 557046       7174              576.5      3554.0     23241267
671.79/192.85	c ................................ | *.........            2302000 | 623665       7207              672.0      3425.5     24165051
767.65/216.88	c ................................ | *.........            2596000 | 702911       7237              768.0      3380.2     24193643
863.91/240.97	c ................................ | *.........            2816000 | 762906       7237              864.2      3258.7     26337756
960.85/265.25	c ................................ | **........            3003000 | 812340       7270              961.0      3124.7     27753395
1055.83/289.06	c ................................ | **........            3150000 | 851559       7336             1056.1      2982.7     28971441
1152.09/313.17	c ................................ | **........            3310000 | 897569       7336             1152.4      2872.3     28990109
1248.35/337.22	c ................................ | **........            3445000 | 936643       7336             1248.4      2759.5     29586806
1344.16/361.21	c ................................ | **........            3634000 | 988663       7342             1344.2      2703.5     30779709
1440.36/385.31	c ................................ | ***.......            3805000 | 1036247      7420             1440.4      2641.6     31822688
1535.76/409.27	c ................................ | ***.......            4025000 | 1098399      7480             1536.0      2620.4     33413692
1631.99/433.40	c ................................ | ***.......            4140000 | 1130731      7503             1632.4      2536.2     35114809
1728.21/457.49	c ................................ | ***.......            4264000 | 1165280      7543             1728.6      2466.8     36491701
1824.04/481.49	c ................................ | ***.......            4351000 | 1188726      7543             1824.4      2384.9     37242120
1920.28/505.50	c ................................ | ****......            4492000 | 1230228      7543             1920.3      2339.2     37775918
2016.54/529.64	c ................................ | ****......            4610000 | 1262377      7543             2016.7      2285.9     39350576
2112.32/553.64	c ................................ | ****......            4719000 | 1293369      7543             2112.5      2233.9     40156508
2208.15/577.61	c ................................ | ****......            4822000 | 1322342      7543             2208.2      2183.7     41242083
2304.38/601.75	c ................................ | ****......            4960000 | 1359897      7543             2304.6      2152.3     42089077
2399.78/625.69	c ................................ | *****.....            5138000 | 1408201      7543             2400.2      2140.7     42089077
2495.99/649.75	c ................................ | *****.....            5321000 | 1457325      7646             2496.2      2131.6     42888731
2592.22/673.86	c ................................ | *****.....            5521000 | 1512896      7705             2592.5      2129.6     44214669
2688.26/697.91	c ................................ | *****.....            5731000 | 1571644      7789             2688.3      2131.8     44432274
2784.40/722.08	c ................................ | *****.....            6124000 | 1676893      8268             2784.7      2199.1     44432274
2880.12/746.06	c ................................ | ******....            6268000 | 1719150      8268             2880.3      2176.1     44922193
2976.24/770.10	c ................................ | ******....            6391000 | 1753641      8268             2976.2      2147.3     45277737
3072.05/794.18	c ................................ | ******....            6518000 | 1789574      8268             3072.3      2121.5     46019441
3168.19/818.21	c ................................ | ******....            6695000 | 1837108      8268             3168.2      2113.2     47183344
3263.82/842.29	c ................................ | ******....            6866000 | 1883826      8292             3264.2      2103.4     47230634
3361.65/866.77	c ................................ | *******...            7070000 | 1940273      8334             3361.9      2103.0     47281672
3456.19/890.44	c ................................ | *******...            7237000 | 1986771      8334             3456.3      2093.8     47715543
3551.95/914.43	c ................................ | *******...            7429000 | 2042402      8334             3552.1      2091.4     48586719
3648.01/938.58	c ................................ | *******...            7750000 | 2133029      8400             3648.3      2124.2     48780465
3744.24/962.63	c ................................ | *******...            7923000 | 2181393      8400             3744.4      2116.0     49127244
3839.65/986.59	c ................................ | ********..            8130000 | 2236298      8400             3840.0      2117.2     50228561
3935.67/1010.69	c ................................ | ********..            8376000 | 2300756      8628             3936.0      2128.0     51090130
4031.83/1034.75	c ................................ | ********..            8596000 | 2360679      8628             4032.1      2131.9     51090130
4128.02/1058.85	c ................................ | ********..            8751000 | 2403717      8628             4128.2      2119.8     51186264
4223.73/1082.86	c ................................ | ********..            8945000 | 2456258      8628             4224.0      2117.7     51186264
4320.70/1107.13	c ................................ | *********.            9094000 | 2498145      8628             4320.8      2104.7     51612959
4416.05/1131.09	c ................................ | *********.            9239000 | 2537837      8634             4416.4      2092.0     52267836
4511.90/1155.04	c ................................ | *********.            9388000 | 2579645      8634             4512.1      2080.6     52969197
4607.74/1179.08	c ................................ | *********.            9527000 | 2618889      8646             4608.1      2067.5     53998299
4704.39/1203.23	c ................................ | *********.            9634000 | 2647903      8664             4704.5      2047.8     55043992

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3261078-1304086618/watcher-3261078-1304086618 -o /tmp/evaluation-result-3261078-1304086618/solver-3261078-1304086618 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3261078-1304086618.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.33 2.19 5.27 6/181 25122
/proc/meminfo: memFree=17206364/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=9756 CPUtime=0 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) R 25120 25122 25048 0 -1 4202496 492 0 0 0 0 0 0 0 22 0 1 0 520262734 9990144 434 33554432000 4194304 4338100 140736985081056 18446744073709551615 270612771525 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25122/statm: 2439 435 147 36 0 344 0

[startup+0.065671 s]
/proc/loadavg: 0.33 2.19 5.27 6/181 25122
/proc/meminfo: memFree=17206364/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=34808 CPUtime=0.05 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) R 25120 25122 25048 0 -1 4202496 6026 0 0 0 5 0 0 0 22 0 1 0 520262734 35643392 5967 33554432000 4194304 4338100 140736985081056 18446744073709551615 4206993 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25122/statm: 8702 5967 152 36 0 6607 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 34808

[startup+0.100661 s]
/proc/loadavg: 0.33 2.19 5.27 6/181 25122
/proc/meminfo: memFree=17206364/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=34808 CPUtime=0.09 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) R 25120 25122 25048 0 -1 4202496 6026 0 0 0 9 0 0 0 22 0 1 0 520262734 35643392 5967 33554432000 4194304 4338100 140736985081056 18446744073709551615 270612505665 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25122/statm: 8702 5967 152 36 0 6607 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 34808

[startup+0.300612 s]
/proc/loadavg: 0.33 2.19 5.27 6/181 25122
/proc/meminfo: memFree=17206364/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=34920 CPUtime=0.29 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) R 25120 25122 25048 0 -1 4202496 6092 0 0 0 28 1 0 0 23 0 1 0 520262734 35758080 6001 33554432000 4194304 4338100 140736985081056 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25122/statm: 8730 6001 154 36 0 6635 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 34920

[startup+0.70054 s]
/proc/loadavg: 0.33 2.19 5.27 6/181 25122
/proc/meminfo: memFree=17206364/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=34920 CPUtime=0.69 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) R 25120 25122 25048 0 -1 4202496 6092 0 0 0 68 1 0 0 25 0 1 0 520262734 35758080 6001 33554432000 4194304 4338100 140736985081056 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25122/statm: 8730 6001 154 36 0 6635 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 34920

[startup+1.5004 s]
/proc/loadavg: 0.33 2.19 5.27 6/182 25123
/proc/meminfo: memFree=17172512/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=34920 CPUtime=1.49 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) R 25120 25122 25048 0 -1 4202496 6093 0 0 0 148 1 0 0 25 0 1 0 520262734 35758080 6002 33554432000 4194304 4338100 140736985081056 18446744073709551615 4296000 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25122/statm: 8730 6002 155 36 0 6635 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 34920

[startup+3.10014 s]
/proc/loadavg: 0.78 2.26 5.27 6/182 25123
/proc/meminfo: memFree=17157532/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=34920 CPUtime=3.09 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) R 25120 25122 25048 0 -1 4202496 6093 0 0 0 308 1 0 0 25 0 1 0 520262734 35758080 6002 33554432000 4194304 4338100 140736985081056 18446744073709551615 4245192 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25122/statm: 8730 6002 155 36 0 6635 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 34920

[startup+6.30055 s]
/proc/loadavg: 0.78 2.26 5.27 6/182 25123
/proc/meminfo: memFree=17128652/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=34920 CPUtime=6.29 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) R 25120 25122 25048 0 -1 4202496 6093 0 0 0 628 1 0 0 25 0 1 0 520262734 35758080 6002 33554432000 4194304 4338100 140736985081056 18446744073709551615 4296009 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25122/statm: 8730 6002 155 36 0 6635 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 34920

[startup+12.7004 s]
/proc/loadavg: 1.43 2.35 5.27 6/182 25123
/proc/meminfo: memFree=17053336/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=34920 CPUtime=12.69 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) R 25120 25122 25048 0 -1 4202496 6093 0 0 0 1268 1 0 0 25 0 1 0 520262734 35758080 6002 33554432000 4194304 4338100 140736985081056 18446744073709551615 4245192 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25122/statm: 8730 6002 155 36 0 6635 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 34920

[startup+25.5002 s]
/proc/loadavg: 1.98 2.43 5.27 6/182 25123
/proc/meminfo: memFree=16927848/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=34920 CPUtime=25.49 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) R 25120 25122 25048 0 -1 4202496 6093 0 0 0 2548 1 0 0 25 0 1 0 520262734 35758080 6002 33554432000 4194304 4338100 140736985081056 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/25122/statm: 8730 6002 155 36 0 6635 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 34920

[startup+51.1006 s]
/proc/loadavg: 3.74 2.80 5.31 9/186 25128
/proc/meminfo: memFree=16527140/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=520124 CPUtime=106.65 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 70979 0 0 0 10618 47 0 0 25 0 5 0 520262734 532606976 67713 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 130031 67713 176 36 0 127936 0
[pid=25122/tid=25124] ppid=25120 vsize=520124 CPUtime=18.53 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 7389 0 0 0 1840 13 0 0 18 0 5 0 520265982 532606976 67713 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=520124 CPUtime=18.49 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 11745 0 0 0 1834 15 0 0 18 0 5 0 520265982 532606976 67713 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=520124 CPUtime=18.52 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 31585 0 0 0 1848 4 0 0 25 0 5 0 520265982 532606976 67713 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=520124 CPUtime=18.58 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 9630 0 0 0 1847 11 0 0 25 0 5 0 520265982 532606976 67714 33554432000 4194304 4338100 140736985081056 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 106.65
Current children cumulated vsize (KiB) 520124

[startup+102.307 s]
/proc/loadavg: 6.37 3.70 5.47 9/186 25129
/proc/meminfo: memFree=16009408/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=893840 CPUtime=310.91 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 163905 0 0 0 30962 129 0 0 25 0 5 0 520262734 915292160 160639 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 223460 160639 176 36 0 221365 0
[pid=25122/tid=25124] ppid=25120 vsize=893840 CPUtime=69.61 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 23364 0 0 0 6921 40 0 0 18 0 5 0 520265982 915292160 160639 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=893840 CPUtime=69.58 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 26637 0 0 0 6917 41 0 0 20 0 5 0 520265982 915292160 160639 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=893840 CPUtime=69.44 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 81924 0 0 0 6931 13 0 0 25 0 5 0 520265982 915292160 160639 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=893840 CPUtime=69.76 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 21349 0 0 0 6945 31 0 0 25 0 5 0 520265982 915292160 160639 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 310.91
Current children cumulated vsize (KiB) 893840

[startup+162.301 s]
/proc/loadavg: 7.43 4.50 5.63 9/186 25131
/proc/meminfo: memFree=15603424/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=1043980 CPUtime=550.3 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 198705 0 0 0 54838 192 0 0 25 0 5 0 520262734 1069035520 195439 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 260995 195439 176 36 0 258900 0
[pid=25122/tid=25124] ppid=25120 vsize=1043980 CPUtime=129.5 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 27862 0 0 0 12888 62 0 0 21 0 5 0 520265982 1069035520 195439 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=1043980 CPUtime=129.49 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 28808 0 0 0 12890 59 0 0 22 0 5 0 520265982 1069035520 195439 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=1043980 CPUtime=129.06 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 107541 0 0 0 12886 20 0 0 25 0 5 0 520265982 1069035520 195439 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=1043980 CPUtime=129.73 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 23863 0 0 0 12926 47 0 0 25 0 5 0 520265982 1069035520 195439 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 550.3
Current children cumulated vsize (KiB) 1043980

[startup+222.3 s]
/proc/loadavg: 8.01 5.19 5.80 9/186 25132
/proc/meminfo: memFree=15414432/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=1126740 CPUtime=789.62 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 215826 0 0 0 78669 293 0 0 25 0 5 0 520262734 1153781760 212560 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 281685 212560 176 36 0 279590 0
[pid=25122/tid=25124] ppid=25120 vsize=1126740 CPUtime=189.4 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 30378 0 0 0 18844 96 0 0 25 0 5 0 520265982 1153781760 212560 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=1126740 CPUtime=189.37 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 29919 0 0 0 18843 94 0 0 25 0 5 0 520265982 1153781760 212560 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=1126740 CPUtime=188.83 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 119677 0 0 0 18860 23 0 0 25 0 5 0 520265982 1153781760 212560 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=1126740 CPUtime=189.5 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 25221 0 0 0 18873 77 0 0 25 0 5 0 520265982 1153781760 212560 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 789.62
Current children cumulated vsize (KiB) 1126740

[startup+282.301 s]
/proc/loadavg: 8.00 5.70 5.93 9/186 25134
/proc/meminfo: memFree=15077492/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=1254988 CPUtime=1029.13 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 247918 0 0 0 102527 386 0 0 25 0 5 0 520262734 1285107712 244652 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 313747 244652 176 36 0 311652 0
[pid=25122/tid=25124] ppid=25120 vsize=1254988 CPUtime=249.33 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 36071 0 0 0 24807 126 0 0 25 0 5 0 520265982 1285107712 244652 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=1254988 CPUtime=249.34 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 29920 0 0 0 24812 122 0 0 25 0 5 0 520265982 1285107712 244652 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=1254988 CPUtime=248.8 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 146075 0 0 0 24849 31 0 0 25 0 5 0 520265982 1285107712 244652 33554432000 4194304 4338100 140736985081056 18446744073709551615 270612505849 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=1254988 CPUtime=249.15 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 25221 0 0 0 24811 104 0 0 25 0 5 0 520265982 1285107712 244652 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1029.13
Current children cumulated vsize (KiB) 1254988

[startup+342.301 s]
/proc/loadavg: 8.07 6.13 6.07 9/186 25136
/proc/meminfo: memFree=14859980/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=1289396 CPUtime=1268.69 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 260175 0 0 0 126411 458 0 0 25 0 5 0 520262734 1320341504 256909 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 322349 256909 176 36 0 320254 0

################
# More data... #
################

[pid=25122/tid=25125] ppid=25120 vsize=1756324 CPUtime=668.93 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 36656 0 0 0 66633 260 0 0 18 0 5 0 520265982 1798475776 372148 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=1756324 CPUtime=668.12 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 251687 0 0 0 66751 61 0 0 25 0 5 0 520265982 1798475776 372148 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254275 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=1756324 CPUtime=667.64 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 27045 0 0 0 66531 233 0 0 25 0 5 0 520265982 1798475776 372148 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2705.82
Current children cumulated vsize (KiB) 1756324

[startup+762.307 s]
/proc/loadavg: 8.20 7.70 6.83 9/186 25147
/proc/meminfo: memFree=13482236/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=1778220 CPUtime=2945.15 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 381353 0 0 0 293637 878 0 0 25 0 5 0 520262734 1820897280 378087 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 444555 378087 176 36 0 442460 0
[pid=25122/tid=25124] ppid=25120 vsize=1778220 CPUtime=728.5 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 49395 0 0 0 72564 286 0 0 18 0 5 0 520265982 1820897280 378087 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=1778220 CPUtime=728.83 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 36929 0 0 0 72606 277 0 0 18 0 5 0 520265982 1820897280 378087 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=1778220 CPUtime=727.73 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 257352 0 0 0 72711 62 0 0 25 0 5 0 520265982 1820897280 378087 33554432000 4194304 4338100 140736985081056 18446744073709551615 270612506068 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=1778220 CPUtime=727.58 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 27046 0 0 0 72508 250 0 0 25 0 5 0 520265982 1820897280 378087 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2945.15
Current children cumulated vsize (KiB) 1778220

[startup+822.301 s]
/proc/loadavg: 8.20 7.79 6.91 9/186 25148
/proc/meminfo: memFree=13283292/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=1840780 CPUtime=3184.48 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 397299 0 0 0 317524 924 0 0 25 0 5 0 520262734 1884958720 394033 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 460195 394033 176 36 0 458100 0
[pid=25122/tid=25124] ppid=25120 vsize=1840780 CPUtime=788.35 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 49395 0 0 0 78533 302 0 0 18 0 5 0 520265982 1884958720 394033 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=1840780 CPUtime=788.72 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 36929 0 0 0 78581 291 0 0 25 0 5 0 520265982 1884958720 394033 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=1840780 CPUtime=787.4 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 273298 0 0 0 78674 66 0 0 25 0 5 0 520265982 1884958720 394033 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=1840780 CPUtime=787.5 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 27046 0 0 0 78488 262 0 0 25 0 5 0 520265982 1884958720 394033 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3184.48
Current children cumulated vsize (KiB) 1840780

[startup+882.301 s]
/proc/loadavg: 8.07 7.83 6.98 10/186 25150
/proc/meminfo: memFree=13153408/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=1873772 CPUtime=3423.85 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 401842 0 0 0 341415 970 0 0 25 0 5 0 520262734 1918742528 398576 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 468443 398576 176 36 0 466348 0
[pid=25122/tid=25124] ppid=25120 vsize=1873772 CPUtime=848.23 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 49395 0 0 0 84506 317 0 0 25 0 5 0 520265982 1918742528 398576 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=1873772 CPUtime=848.61 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 36929 0 0 0 84554 307 0 0 18 0 5 0 520265982 1918742528 398576 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=1873772 CPUtime=847.02 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 276329 0 0 0 84634 68 0 0 25 0 5 0 520265982 1918742528 398576 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=1873772 CPUtime=847.47 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 28558 0 0 0 84472 275 0 0 25 0 5 0 520265982 1918742528 398576 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3423.85
Current children cumulated vsize (KiB) 1873772

[startup+942.301 s]
/proc/loadavg: 8.06 7.87 7.04 9/186 25152
/proc/meminfo: memFree=12956448/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=1911440 CPUtime=3663.2 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 410934 0 0 0 365285 1035 0 0 25 0 5 0 520262734 1957314560 407668 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 477860 407668 176 36 0 475765 0
[pid=25122/tid=25124] ppid=25120 vsize=1911440 CPUtime=908.07 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 52564 0 0 0 90466 341 0 0 20 0 5 0 520265982 1957314560 407668 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=1911440 CPUtime=908.53 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 36931 0 0 0 90526 327 0 0 21 0 5 0 520265982 1957314560 407668 33554432000 4194304 4338100 140736985081056 18446744073709551615 270612505621 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=1911440 CPUtime=906.66 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 282249 0 0 0 90596 70 0 0 25 0 5 0 520265982 1957314560 407668 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=1911440 CPUtime=907.41 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 28559 0 0 0 90448 293 0 0 25 0 5 0 520265982 1957314560 407668 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3663.2
Current children cumulated vsize (KiB) 1911440

[startup+1002.3 s]
/proc/loadavg: 8.08 7.91 7.11 9/186 25153
/proc/meminfo: memFree=12766036/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=1983384 CPUtime=3902.72 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 428882 0 0 0 389188 1084 0 0 25 0 5 0 520262734 2030985216 425616 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 495846 425616 176 36 0 493751 0
[pid=25122/tid=25124] ppid=25120 vsize=1983384 CPUtime=968.01 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 56533 0 0 0 96444 357 0 0 21 0 5 0 520265982 2030985216 425616 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=1983384 CPUtime=968.45 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 36931 0 0 0 96502 343 0 0 25 0 5 0 520265982 2030985216 425616 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=1983384 CPUtime=966.33 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 296228 0 0 0 96558 75 0 0 25 0 5 0 520265982 2030985216 425616 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=1983384 CPUtime=967.41 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 28559 0 0 0 96436 305 0 0 25 0 5 0 520265982 2030985216 425616 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3902.72
Current children cumulated vsize (KiB) 1983384

[startup+1062.3 s]
/proc/loadavg: 8.10 7.95 7.17 9/186 25155
/proc/meminfo: memFree=12610376/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=1986512 CPUtime=4141.99 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 429755 0 0 0 413069 1130 0 0 25 0 5 0 520262734 2034188288 426489 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 496628 426489 176 36 0 494533 0
[pid=25122/tid=25124] ppid=25120 vsize=1986512 CPUtime=1027.85 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 56590 0 0 0 102412 373 0 0 18 0 5 0 520265982 2034188288 426489 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=1986512 CPUtime=1028.3 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 36931 0 0 0 102472 358 0 0 21 0 5 0 520265982 2034188288 426489 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=1986512 CPUtime=1025.98 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 297041 0 0 0 102523 75 0 0 25 0 5 0 520265982 2034188288 426489 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=1986512 CPUtime=1027.33 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 28562 0 0 0 102413 320 0 0 25 0 5 0 520265982 2034188288 426489 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4141.99
Current children cumulated vsize (KiB) 1986512

[startup+1122.3 s]
/proc/loadavg: 8.15 7.99 7.23 9/186 25156
/proc/meminfo: memFree=12496496/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=2014664 CPUtime=4381.32 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 440737 0 0 0 436946 1186 0 0 25 0 5 0 520262734 2063015936 437471 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 503666 437471 176 36 0 501571 0
[pid=25122/tid=25124] ppid=25120 vsize=2014664 CPUtime=1087.72 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 56590 0 0 0 108380 392 0 0 25 0 5 0 520265982 2063015936 437471 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=2014664 CPUtime=1088.22 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 36974 0 0 0 108445 377 0 0 25 0 5 0 520265982 2063015936 437471 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=2014664 CPUtime=1085.76 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 304626 0 0 0 108499 77 0 0 25 0 5 0 520265982 2063015936 437471 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=2014664 CPUtime=1087.11 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 31916 0 0 0 108374 337 0 0 25 0 5 0 520265982 2063015936 437471 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624936629 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4381.32
Current children cumulated vsize (KiB) 2014664

[startup+1182.3 s]
/proc/loadavg: 8.12 8.00 7.28 9/186 25158
/proc/meminfo: memFree=12411852/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=2094576 CPUtime=4620.92 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 457204 0 0 0 460820 1272 0 0 25 0 5 0 520262734 2144845824 453938 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 523644 453938 176 36 0 521549 0
[pid=25122/tid=25124] ppid=25120 vsize=2094576 CPUtime=1147.7 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 56590 0 0 0 114351 419 0 0 25 0 5 0 520265982 2144845824 453938 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=2094576 CPUtime=1147.88 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 37815 0 0 0 114385 403 0 0 25 0 5 0 520265982 2144845824 453938 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=2094576 CPUtime=1145.75 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 319523 0 0 0 114493 82 0 0 25 0 5 0 520265982 2144845824 453938 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254342 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=2094576 CPUtime=1147.08 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 32645 0 0 0 114343 365 0 0 25 0 5 0 520265982 2144845824 453938 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4620.92
Current children cumulated vsize (KiB) 2094576



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1227.2 s]
/proc/loadavg: 7.75 7.91 7.28 9/186 25222
/proc/meminfo: memFree=15243504/32951124 swapFree=67111528/67111528
[pid=25122] ppid=25120 vsize=2163392 CPUtime=4800.21 cores=0,2,4,6
/proc/25122/stat : 25122 (ttsth-5-4) S 25120 25122 25048 0 -1 4202496 474001 0 0 0 478708 1313 0 0 25 0 5 0 520262734 2215313408 470735 33554432000 4194304 4338100 140736985081056 18446744073709551615 270624913381 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/25122/statm: 540848 470735 176 36 0 538753 0
[pid=25122/tid=25124] ppid=25120 vsize=2163392 CPUtime=1192.58 cores=0,2,4,6
/proc/25122/task/25124/stat : 25124 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 56590 0 0 0 118827 431 0 0 25 0 5 0 520265982 2215313408 470735 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=25122/tid=25125] ppid=25120 vsize=2163392 CPUtime=1192.54 cores=0,2,4,6
/proc/25122/task/25125/stat : 25125 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 37815 0 0 0 118841 413 0 0 25 0 5 0 520265982 2215313408 470735 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254439 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=25122/tid=25126] ppid=25120 vsize=2163392 CPUtime=1190.6 cores=0,2,4,6
/proc/25122/task/25126/stat : 25126 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 336319 0 0 0 118972 88 0 0 25 0 5 0 520265982 2215313408 470735 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=25122/tid=25127] ppid=25120 vsize=2163392 CPUtime=1191.97 cores=0,2,4,6
/proc/25122/task/25127/stat : 25127 (ttsth-5-4) R 25120 25122 25048 0 -1 4202560 32646 0 0 0 118821 376 0 0 25 0 5 0 520265982 2215313408 470735 33554432000 4194304 4338100 140736985081056 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 2163392

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1227.3
CPU time (s): 4800.33
CPU user time (s): 4787.11
CPU system time (s): 13.219
CPU usage (%): 391.13
Max. virtual memory (cumulated for all children) (KiB): 2163392

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4787.11
system time used= 13.219
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 474001
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21454
involuntary context switches= 26291

runsolver used 1.93771 second user time and 4.5853 second system time

The end

Launcher Data 

Begin job on node108 at 2011-04-29 16:16:58
IDJOB=3261078
IDBENCH=83208
IDSOLVER=1654
FILE ID=node108/3261078-1304086618
RUNJOBID= node108-1304086608-25066
PBS_JOBID= 13170551
Free space on /tmp= 72120 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-24-57-sat.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3261078-1304086618/watcher-3261078-1304086618 -o /tmp/evaluation-result-3261078-1304086618/solver-3261078-1304086618 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3261078-1304086618.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 179851d97340610ea74d8d7b3cffb10b
RANDOM SEED=786600596

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17206528 kB
Buffers:       2164524 kB
Cached:       12756176 kB
SwapCached:          0 kB
Active:        4380200 kB
Inactive:     10783124 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17206528 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:             960 kB
Writeback:           0 kB
AnonPages:      242104 kB
Mapped:          15220 kB
Slab:           518088 kB
PageTables:       5020 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   432656 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72120 MiB
End job on node108 at 2011-04-29 16:37:27