Trace number 3250824

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.5 1202.39

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf
MD5SUMb61e426b264831836f140414cdcf3e23
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables238
Number of clauses15812
Sum of the clauses size70446
Maximum clause length16
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 314042
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51770

Solver Data

0.00/0.01	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3250824-1304093506.cnf 
0.00/0.01	c Using SATTIMEOUT of 4800
0.00/0.01	c Using SATRAM of 15500
0.00/0.01	c Size of subset node = 32
0.00/0.01	c Variables = 238
0.00/0.01	c Clauses = 15812
0.00/0.01	c Literals = 70446
0.00/0.01	c Reduced size:
0.00/0.01	c Variables = 238
0.00/0.01	c Clauses = 15812
0.00/0.01	c Literals = 70446
0.00/0.01	c a2
0.04/0.08	c a1
0.09/0.18	c Independent sub-problems = 1
0.09/0.18	c Sub-problem with 238 variables and 15812 clauses
0.09/0.18	c using permutation method 4
0.09/0.18	c count = 1
0.09/0.18	c Ordering finished 0.180 seconds
0.09/0.18	c mapped 0.180 seconds
0.09/0.18	c permuted 0.180 seconds
0.09/0.18	c about to sort
0.09/0.19	c sorted
0.19/0.24	c clauses now 15812
0.19/0.24	c init finished 0.190 seconds
0.19/0.24	c tree built 0.240 seconds
0.19/0.24	c 
0.19/0.24	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.19/0.24	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.19/0.24	c ................................ | ..........                    |                                  0.2         0.0             
0.19/0.24	c ................................ | ..........                  1 |                                  0.2         4.2             
0.19/0.24	c ................................ | ..........                  2 |                                  0.2         8.3             
0.19/0.24	c ................................ | ..........                  3 |                                  0.2        12.5             
0.19/0.24	c ................................ | ..........                  4 |                                  0.2        16.7             
0.19/0.24	c ................................ | ..........                  5 |                                  0.2        20.8             
0.19/0.42	c ................................ | ..........               1000 | 41           429                 0.3      3225.8        45148
95.91/24.29	c ................................ | ..........             387000 | 52640        168102             96.3      4019.1     24848668
192.18/48.33	c ................................ | ..........             594000 | 83681        259792            192.3      3088.9     39070616
288.44/72.42	c ................................ | ..........             772000 | 104678       333701            288.5      2675.7     49039526
384.34/96.43	c ................................ | ..........             930000 | 128006       391879            384.4      2419.2     58827447
479.78/120.38	c ................................ | *.........            1060000 | 145228       445123            480.1      2207.8     66323501
576.04/144.42	c ................................ | *.........            1185000 | 162038       493388            576.1      2056.8     68202990
671.91/168.48	c ................................ | *.........            1308000 | 177735       537342            672.3      1945.7     74316862
767.78/192.45	c ................................ | *.........            1424000 | 194023       582057            768.0      1854.2     80487557
864.45/216.68	c ................................ | *.........            1521000 | 206018       621889            864.8      1758.8     86951360
960.33/240.61	c ................................ | **........            1616000 | 217084       659236            960.4      1682.6     93326930
1056.60/264.77	c ................................ | **........            1708000 | 228527       697978           1056.9      1616.1     98863832
1152.45/288.79	c ................................ | **........            1791000 | 239847       731652           1152.8      1553.6    101766881
1248.32/312.71	c ................................ | **........            1874000 | 251326       767684           1248.4      1501.1    107764802
1344.98/336.97	c ................................ | **........            1964000 | 261940       803479           1345.3      1459.9    113302115
1440.07/360.72	c ................................ | ***.......            2031000 | 271889       833410           1440.2      1410.3    117792134
1537.13/385.00	c ................................ | ***.......            2115000 | 284399       865009           1537.1      1375.9    121219921
1631.79/408.78	c ................................ | ***.......            2186000 | 293920       894222           1632.1      1339.4    123266869
1728.04/432.86	c ................................ | ***.......            2262000 | 305445       923839           1728.3      1308.8    128292410
1825.12/457.16	c ................................ | ***.......            2334000 | 316993       952495           1825.3      1278.7    132810940
1920.18/480.93	c ................................ | ****......            2391000 | 324615       979955           1920.3      1245.1    133396501
2016.05/504.94	c ................................ | ****......            2461000 | 334965       1006051          2016.2      1220.6    137361161
2112.72/529.18	c ................................ | ****......            2532000 | 346282       1032730          2113.1      1198.3    141448253
2208.19/553.00	c ................................ | ****......            2604000 | 357711       1055982          2208.2      1179.2    146875688
2304.87/577.27	c ................................ | ****......            2670000 | 365860       1081075          2305.2      1158.3    150986787
2400.34/601.11	c ................................ | *****.....            2729000 | 373811       1104616          2400.4      1136.9    153928658
2497.00/625.39	c ................................ | *****.....            2797000 | 383033       1128782          2497.4      1120.0    157549038
2592.88/649.33	c ................................ | *****.....            2862000 | 393235       1153303          2593.0      1103.7    161898593
2689.15/673.45	c ................................ | *****.....            2926000 | 403285       1176837          2689.3      1088.0    165374249
2785.41/697.50	c ................................ | *****.....            2986000 | 413100       1200320          2785.4      1072.0    169659198
2880.11/721.21	c ................................ | ******....            3039000 | 421927       1222971          2880.2      1055.2    173883734
2976.38/745.39	c ................................ | ******....            3098000 | 432528       1246547          2976.7      1040.7    177946265
3073.04/769.52	c ................................ | ******....            3157000 | 442257       1272534          3073.1      1027.3    182938587
3169.32/793.65	c ................................ | ******....            3220000 | 452975       1294664          3169.5      1015.9    186819502
3265.18/817.84	c ................................ | ******....            3284000 | 463471       1314830          3265.3      1005.7    190439833
3360.64/841.72	c ................................ | *******...            3346000 | 474672       1335925          3360.7       995.6    194071287
3456.12/865.60	c ................................ | *******...            3410000 | 486044       1356497          3456.1       986.7    197154946
3553.59/890.02	c ................................ | *******...            3476000 | 497113       1379778          3553.7       978.1    201004116
3647.87/913.65	c ................................ | *******...            3528000 | 503809       1401096          3648.1       967.1    203983612
3744.53/937.82	c ................................ | *******...            3574000 | 509203       1423279          3744.6       954.4    203983612
3841.19/962.01	c ................................ | ********..            3629000 | 516572       1444772          3841.2       944.7    203983612
3936.24/985.89	c ................................ | ********..            3673000 | 521997       1465516          3936.6       933.0    204654417
4032.91/1010.05	c ................................ | ********..            3726000 | 529091       1485031          4033.1       923.9    205493096
4127.98/1033.86	c ................................ | ********..            3773000 | 535514       1507571          4128.2       914.0    207015926
4225.44/1058.22	c ................................ | ********..            3825000 | 543448       1529424          4225.5       905.2    208997614
4320.13/1081.99	c ................................ | *********.            3875000 | 550167       1548883          4320.5       896.9    211415230
4416.76/1106.19	c ................................ | *********.            3926000 | 557215       1565973          4417.1       888.8    213911451
4512.62/1130.19	c ................................ | *********.            3986000 | 565130       1584450          4513.0       883.2    213911451
4608.45/1154.16	c ................................ | *********.            4044000 | 572654       1603420          4608.7       877.5    213911451
4705.12/1178.34	c ................................ | *********.            4099000 | 580528       1623922          4705.3       871.1    213911451

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3250824-1304093506/watcher-3250824-1304093506 -o /tmp/evaluation-result-3250824-1304093506/solver-3250824-1304093506 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3250824-1304093506.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.09 8.11 7.98 7/181 1919
/proc/meminfo: memFree=30887928/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=9112 CPUtime=0 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) R 1917 1919 1676 0 -1 4202496 346 0 0 0 0 0 0 0 25 0 1 0 501766497 9330688 288 33554432000 4194304 4338100 140735462265936 18446744073709551615 220815903715 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/1919/statm: 2278 288 146 36 0 183 0

[startup+0.051555 s]
/proc/loadavg: 8.09 8.11 7.98 7/181 1919
/proc/meminfo: memFree=30887928/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=18016 CPUtime=0.04 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) R 1917 1919 1676 0 -1 4202496 2171 0 0 0 4 0 0 0 25 0 1 0 501766497 18448384 2099 33554432000 4194304 4338100 140735462265936 18446744073709551615 220815631532 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/1919/statm: 4504 2099 188 36 0 2409 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 18016

[startup+0.100546 s]
/proc/loadavg: 8.09 8.11 7.98 7/181 1919
/proc/meminfo: memFree=30887928/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=18116 CPUtime=0.09 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) R 1917 1919 1676 0 -1 4202496 2234 0 0 0 9 0 0 0 25 0 1 0 501766497 18550784 2131 33554432000 4194304 4338100 140735462265936 18446744073709551615 4296762 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/1919/statm: 4529 2131 190 36 0 2434 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 18116

[startup+0.358933 s]
/proc/loadavg: 8.09 8.11 7.98 7/181 1919
/proc/meminfo: memFree=30887928/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=200988 CPUtime=3.51 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 21300 0 0 0 347 4 0 0 25 0 5 0 501766497 205811712 20276 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 50247 20276 175 36 0 48152 0
Current children cumulated CPU time (s) 3.51
Current children cumulated vsize (KiB) 200988

[startup+1.16632 s]
/proc/loadavg: 8.09 8.11 7.98 7/181 1919
/proc/meminfo: memFree=30887928/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=213500 CPUtime=3.91 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 23062 0 0 0 387 4 0 0 25 0 5 0 501766497 218624000 22038 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 53375 22038 175 36 0 51280 0
Current children cumulated CPU time (s) 3.91
Current children cumulated vsize (KiB) 213500

[startup+1.50025 s]
/proc/loadavg: 8.09 8.11 7.98 7/181 1919
/proc/meminfo: memFree=30887928/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=229404 CPUtime=5.23 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 28395 0 0 0 519 4 0 0 25 0 5 0 501766497 234909696 27371 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 57351 27371 175 36 0 55256 0
Current children cumulated CPU time (s) 5.23
Current children cumulated vsize (KiB) 229404

[startup+3.10096 s]
/proc/loadavg: 8.09 8.11 7.98 9/186 1924
/proc/meminfo: memFree=30544996/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=377060 CPUtime=11.62 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 48814 0 0 0 1153 9 0 0 25 0 5 0 501766497 386109440 47790 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 94265 47792 175 36 0 92170 0
[pid=1919/tid=1921] ppid=1917 vsize=377060 CPUtime=2.84 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 11102 0 0 0 282 2 0 0 24 0 5 0 501766521 386109440 47792 33554432000 4194304 4338100 140735462265936 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=377060 CPUtime=2.83 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 9033 0 0 0 282 1 0 0 24 0 5 0 501766521 386109440 47793 33554432000 4194304 4338100 140735462265936 18446744073709551615 4240522 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=377060 CPUtime=2.83 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 12000 0 0 0 281 2 0 0 23 0 5 0 501766521 386109440 47793 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254433 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=377060 CPUtime=2.84 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 10335 0 0 0 282 2 0 0 23 0 5 0 501766521 386109440 47794 33554432000 4194304 4338100 140735462265936 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.62
Current children cumulated vsize (KiB) 377060

[startup+6.30037 s]
/proc/loadavg: 8.16 8.12 7.98 9/186 1924
/proc/meminfo: memFree=30279356/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=512356 CPUtime=24.41 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 82208 0 0 0 2424 17 0 0 25 0 5 0 501766497 524652544 81184 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 128089 81185 175 36 0 125994 0
[pid=1919/tid=1921] ppid=1917 vsize=512356 CPUtime=6.04 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 19202 0 0 0 600 4 0 0 25 0 5 0 501766521 524652544 81185 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254384 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=512356 CPUtime=6 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 16460 0 0 0 598 2 0 0 25 0 5 0 501766521 524652544 81185 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828049190 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=512356 CPUtime=6.04 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 21537 0 0 0 600 4 0 0 25 0 5 0 501766521 524652544 81185 33554432000 4194304 4338100 140735462265936 18446744073709551615 4263499 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=512356 CPUtime=6.04 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 18663 0 0 0 600 4 0 0 25 0 5 0 501766521 524652544 81186 33554432000 4194304 4338100 140735462265936 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.41
Current children cumulated vsize (KiB) 512356

[startup+12.7012 s]
/proc/loadavg: 8.15 8.12 7.98 9/186 1924
/proc/meminfo: memFree=29879744/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=710476 CPUtime=49.99 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 132470 0 0 0 4973 26 0 0 25 0 5 0 501766497 727527424 131446 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 177619 131446 175 36 0 175524 0
[pid=1919/tid=1921] ppid=1917 vsize=710476 CPUtime=12.44 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 31139 0 0 0 1237 7 0 0 25 0 5 0 501766521 727527424 131472 33554432000 4194304 4338100 140735462265936 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=710476 CPUtime=12.38 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 26235 0 0 0 1234 4 0 0 25 0 5 0 501766521 727527424 131472 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254213 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=710476 CPUtime=12.44 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 36928 0 0 0 1238 6 0 0 25 0 5 0 501766521 727527424 131472 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=710476 CPUtime=12.45 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 31846 0 0 0 1239 6 0 0 25 0 5 0 501766521 727527424 131472 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254326 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 49.99
Current children cumulated vsize (KiB) 710476

[startup+25.5008 s]
/proc/loadavg: 8.12 8.11 7.98 9/186 1925
/proc/meminfo: memFree=29340836/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=1021468 CPUtime=101.11 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 210382 0 0 0 10070 41 0 0 25 0 5 0 501766497 1045983232 209358 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 255367 209359 175 36 0 253272 0
[pid=1919/tid=1921] ppid=1917 vsize=1021468 CPUtime=25.25 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 50514 0 0 0 2514 11 0 0 25 0 5 0 501766521 1045983232 209359 33554432000 4194304 4338100 140735462265936 18446744073709551615 4287708 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=1021468 CPUtime=25.11 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 43282 0 0 0 2504 7 0 0 25 0 5 0 501766521 1045983232 209359 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=1021468 CPUtime=25.24 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 56160 0 0 0 2513 11 0 0 25 0 5 0 501766521 1045983232 209360 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=1021468 CPUtime=25.24 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 54081 0 0 0 2513 11 0 0 25 0 5 0 501766521 1045983232 209361 33554432000 4194304 4338100 140735462265936 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.11
Current children cumulated vsize (KiB) 1021468

[startup+51.1011 s]
/proc/loadavg: 8.08 8.10 7.98 9/186 1925
/proc/meminfo: memFree=28536768/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=1486944 CPUtime=203.36 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 327539 0 0 0 20273 63 0 0 25 0 5 0 501766497 1522630656 326515 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 371736 326515 176 36 0 369641 0
[pid=1919/tid=1921] ppid=1917 vsize=1486944 CPUtime=50.85 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 79597 0 0 0 5068 17 0 0 25 0 5 0 501766521 1522630656 326515 33554432000 4194304 4338100 140735462265936 18446744073709551615 4240496 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=1486944 CPUtime=50.57 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 73223 0 0 0 5046 11 0 0 25 0 5 0 501766521 1522630656 326515 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=1486944 CPUtime=50.83 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 83543 0 0 0 5067 16 0 0 25 0 5 0 501766521 1522630656 326515 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=1486944 CPUtime=50.84 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 84828 0 0 0 5067 17 0 0 25 0 5 0 501766521 1522630656 326515 33554432000 4194304 4338100 140735462265936 18446744073709551615 4229565 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.36
Current children cumulated vsize (KiB) 1486944

[startup+102.301 s]
/proc/loadavg: 8.14 8.12 7.99 9/186 1927
/proc/meminfo: memFree=27538548/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=2144088 CPUtime=407.88 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 490341 0 0 0 40690 98 0 0 25 0 5 0 501766497 2195546112 489317 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 536022 489317 176 36 0 533927 0
[pid=1919/tid=1921] ppid=1917 vsize=2144088 CPUtime=102.05 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 115523 0 0 0 10180 25 0 0 25 0 5 0 501766521 2195546112 489318 33554432000 4194304 4338100 140735462265936 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=2144088 CPUtime=101.74 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 121213 0 0 0 10153 21 0 0 25 0 5 0 501766521 2195546112 489318 33554432000 4194304 4338100 140735462265936 18446744073709551615 4239484 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=2144088 CPUtime=101.76 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 126825 0 0 0 10152 24 0 0 25 0 5 0 501766521 2195546112 489318 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=2144088 CPUtime=102.04 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 120433 0 0 0 10179 25 0 0 25 0 5 0 501766521 2195546112 489318 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.88
Current children cumulated vsize (KiB) 2144088

[startup+162.301 s]
/proc/loadavg: 8.15 8.12 8.00 9/186 1928
/proc/meminfo: memFree=26808276/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=2532932 CPUtime=647.56 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 585536 0 0 0 64632 124 0 0 25 0 5 0 501766497 2593722368 584512 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 633233 584512 176 36 0 631138 0
[pid=1919/tid=1921] ppid=1917 vsize=2532932 CPUtime=162.04 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 142024 0 0 0 16172 32 0 0 25 0 5 0 501766521 2593722368 584512 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=2532932 CPUtime=161.75 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 146141 0 0 0 16147 28 0 0 25 0 5 0 501766521 2593722368 584512 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=2532932 CPUtime=161.44 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 149544 0 0 0 16113 31 0 0 25 0 5 0 501766521 2593722368 584512 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=2532932 CPUtime=162.05 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 141479 0 0 0 16174 31 0 0 25 0 5 0 501766521 2593722368 584512 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 647.56
Current children cumulated vsize (KiB) 2532932

[startup+222.301 s]
/proc/loadavg: 8.14 8.13 8.01 9/186 1930
/proc/meminfo: memFree=25990324/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=3035128 CPUtime=887.22 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 712280 0 0 0 88570 152 0 0 25 0 5 0 501766497 3107971072 711256 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 758782 711256 176 36 0 756687 0
[pid=1919/tid=1921] ppid=1917 vsize=3035128 CPUtime=222.04 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 169889 0 0 0 22165 39 0 0 25 0 5 0 501766521 3107971072 711256 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254404 0 0 4096 0 0 0 0 -1 0 0 0 0

################
# More data... #
################

/proc/meminfo: memFree=21183380/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=5970304 CPUtime=3044.27 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 1448276 0 0 0 304109 318 0 0 25 0 5 0 501766497 6113591296 1447252 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 1492576 1447252 176 36 0 1490481 0
[pid=1919/tid=1921] ppid=1917 vsize=5970304 CPUtime=762.04 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 343474 0 0 0 76122 82 0 0 25 0 5 0 501766521 6113591296 1447252 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=5970304 CPUtime=761.68 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 427568 0 0 0 76080 88 0 0 25 0 5 0 501766521 6113591296 1447252 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=5970304 CPUtime=758.24 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 333095 0 0 0 75750 74 0 0 25 0 5 0 501766521 6113591296 1447252 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254317 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=5970304 CPUtime=762.04 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 337791 0 0 0 76132 72 0 0 25 0 5 0 501766521 6113591296 1447252 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3044.27
Current children cumulated vsize (KiB) 5970304

[startup+822.301 s]
/proc/loadavg: 8.44 8.19 8.05 9/186 1949
/proc/meminfo: memFree=20773328/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=6271120 CPUtime=3283.17 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 1523630 0 0 0 327980 337 0 0 25 0 5 0 501766497 6421626880 1522606 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 1567780 1522607 176 36 0 1565685 0
[pid=1919/tid=1921] ppid=1917 vsize=6271120 CPUtime=822.05 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 362883 0 0 0 82118 87 0 0 25 0 5 0 501766521 6421626880 1522611 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=6271120 CPUtime=821.54 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 453713 0 0 0 82059 95 0 0 25 0 5 0 501766521 6421626880 1522611 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=6271120 CPUtime=817.91 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 343765 0 0 0 81715 76 0 0 25 0 5 0 501766521 6421626880 1522611 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=6271120 CPUtime=821.41 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 356926 0 0 0 82064 77 0 0 25 0 5 0 501766521 6421626880 1522611 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3283.17
Current children cumulated vsize (KiB) 6271120

[startup+882.301 s]
/proc/loadavg: 8.21 8.17 8.05 9/186 1950
/proc/meminfo: memFree=20437356/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=6544048 CPUtime=3522.83 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 1590626 0 0 0 351929 354 0 0 25 0 5 0 501766497 6701105152 1589602 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 1636012 1589602 176 36 0 1633917 0
[pid=1919/tid=1921] ppid=1917 vsize=6544048 CPUtime=882.03 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 379405 0 0 0 88112 91 0 0 25 0 5 0 501766521 6701105152 1589602 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254291 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=6544048 CPUtime=881.53 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 478943 0 0 0 88051 102 0 0 25 0 5 0 501766521 6701105152 1589602 33554432000 4194304 4338100 140735462265936 18446744073709551615 4256139 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=6544048 CPUtime=877.6 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 354332 0 0 0 87681 79 0 0 25 0 5 0 501766521 6701105152 1589602 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=6544048 CPUtime=881.4 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 371598 0 0 0 88059 81 0 0 25 0 5 0 501766521 6701105152 1589602 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3522.83
Current children cumulated vsize (KiB) 6544048

[startup+942.307 s]
/proc/loadavg: 8.12 8.15 8.05 9/186 1952
/proc/meminfo: memFree=20109596/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=6727284 CPUtime=3762.51 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 1638123 0 0 0 375887 364 0 0 25 0 5 0 501766497 6888738816 1637099 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 1681821 1637099 176 36 0 1679726 0
[pid=1919/tid=1921] ppid=1917 vsize=6727284 CPUtime=942.03 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 392459 0 0 0 94109 94 0 0 25 0 5 0 501766521 6888738816 1637099 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=6727284 CPUtime=941.53 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 491624 0 0 0 94049 104 0 0 25 0 5 0 501766521 6888738816 1637099 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=6727284 CPUtime=937.27 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 364330 0 0 0 93646 81 0 0 25 0 5 0 501766521 6888738816 1637099 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254291 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=6727284 CPUtime=941.4 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 383362 0 0 0 94058 82 0 0 25 0 5 0 501766521 6888738816 1637099 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3762.51
Current children cumulated vsize (KiB) 6727284

[startup+1002.3 s]
/proc/loadavg: 8.04 8.12 8.04 9/186 1954
/proc/meminfo: memFree=19996092/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=6765480 CPUtime=4002.15 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 1648488 0 0 0 399847 368 0 0 25 0 5 0 501766497 6927851520 1647464 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 1691370 1647464 176 36 0 1689275 0
[pid=1919/tid=1921] ppid=1917 vsize=6765480 CPUtime=1002.01 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 392553 0 0 0 100107 94 0 0 25 0 5 0 501766521 6927851520 1647464 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254347 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=6765480 CPUtime=1001.51 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 495123 0 0 0 100046 105 0 0 25 0 5 0 501766521 6927851520 1647464 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=6765480 CPUtime=996.94 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 364409 0 0 0 99613 81 0 0 25 0 5 0 501766521 6927851520 1647464 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=6765480 CPUtime=1001.4 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 390055 0 0 0 100056 84 0 0 25 0 5 0 501766521 6927851520 1647464 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4002.15
Current children cumulated vsize (KiB) 6765480

[startup+1062.3 s]
/proc/loadavg: 8.01 8.09 8.04 9/186 1955
/proc/meminfo: memFree=19788736/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=6894388 CPUtime=4241.83 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 1680445 0 0 0 423806 377 0 0 25 0 5 0 501766497 7059853312 1679421 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 1723597 1679421 176 36 0 1721502 0
[pid=1919/tid=1921] ppid=1917 vsize=6894388 CPUtime=1062.02 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 392645 0 0 0 106107 95 0 0 25 0 5 0 501766521 7059853312 1679421 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=6894388 CPUtime=1061.51 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 508515 0 0 0 106043 108 0 0 25 0 5 0 501766521 7059853312 1679421 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254451 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=6894388 CPUtime=1056.63 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 365801 0 0 0 105580 83 0 0 25 0 5 0 501766521 7059853312 1679421 33554432000 4194304 4338100 140735462265936 18446744073709551615 4241507 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=6894388 CPUtime=1061.4 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 407136 0 0 0 106051 89 0 0 25 0 5 0 501766521 7059853312 1679421 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4241.83
Current children cumulated vsize (KiB) 6894388

[startup+1122.3 s]
/proc/loadavg: 8.06 8.09 8.04 9/186 1957
/proc/meminfo: memFree=19445224/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=7138208 CPUtime=4481.46 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 1733682 0 0 0 447756 390 0 0 25 0 5 0 501766497 7309524992 1732658 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 1784552 1732658 176 36 0 1782457 0
[pid=1919/tid=1921] ppid=1917 vsize=7138208 CPUtime=1122.01 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 409289 0 0 0 112100 101 0 0 25 0 5 0 501766521 7309524992 1732658 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254362 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=7138208 CPUtime=1121.5 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 524499 0 0 0 112038 112 0 0 25 0 5 0 501766521 7309524992 1732658 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=7138208 CPUtime=1116.29 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 374587 0 0 0 111545 84 0 0 25 0 5 0 501766521 7309524992 1732658 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=7138208 CPUtime=1121.38 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 418959 0 0 0 112047 91 0 0 25 0 5 0 501766521 7309524992 1732658 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4481.46
Current children cumulated vsize (KiB) 7138208

[startup+1182.3 s]
/proc/loadavg: 8.18 8.12 8.05 9/186 1958
/proc/meminfo: memFree=19250240/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=7220656 CPUtime=4721.09 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 1745170 0 0 0 471717 392 0 0 25 0 5 0 501766497 7393951744 1744146 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 1805164 1744146 176 36 0 1803069 0
[pid=1919/tid=1921] ppid=1917 vsize=7220656 CPUtime=1182 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 412114 0 0 0 118099 101 0 0 25 0 5 0 501766521 7393951744 1744146 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=7220656 CPUtime=1181.48 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 529041 0 0 0 118036 112 0 0 25 0 5 0 501766521 7393951744 1744146 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=7220656 CPUtime=1175.97 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 378585 0 0 0 117512 85 0 0 25 0 5 0 501766521 7393951744 1744146 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=7220656 CPUtime=1181.36 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 419082 0 0 0 118045 91 0 0 25 0 5 0 501766521 7393951744 1744146 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4721.09
Current children cumulated vsize (KiB) 7220656



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.1 s]
/proc/loadavg: 8.13 8.11 8.05 5/180 1960
/proc/meminfo: memFree=23932388/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=7220788 CPUtime=4800.18 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) S 1917 1919 1676 0 -1 4202496 1745303 0 0 0 479626 392 0 0 25 0 5 0 501766497 7394086912 1744279 33554432000 4194304 4338100 140735462265936 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 1805197 1744279 176 36 0 1803102 0
[pid=1919/tid=1921] ppid=1917 vsize=7220788 CPUtime=1201.81 cores=0,2,4,6
/proc/1919/task/1921/stat : 1921 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 412151 0 0 0 120080 101 0 0 25 0 5 0 501766521 7394086912 1744279 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1919/tid=1922] ppid=1917 vsize=7220788 CPUtime=1201.29 cores=0,2,4,6
/proc/1919/task/1922/stat : 1922 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 529075 0 0 0 120017 112 0 0 25 0 5 0 501766521 7394086912 1744279 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=7220788 CPUtime=1195.64 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 378613 0 0 0 119479 85 0 0 25 0 5 0 501766521 7394086912 1744279 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1919/tid=1924] ppid=1917 vsize=7220788 CPUtime=1201.17 cores=0,2,4,6
/proc/1919/task/1924/stat : 1924 (ttsth-5-4) R 1917 1919 1676 0 -1 4202560 419116 0 0 0 120026 91 0 0 25 0 5 0 501766521 7394086912 1744279 33554432000 4194304 4338100 140735462265936 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 7220788

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.3 s]
/proc/loadavg: 8.13 8.11 8.05 5/180 1960
/proc/meminfo: memFree=23932388/32951124 swapFree=67105204/67111528
[pid=1919] ppid=1917 vsize=0 CPUtime=4800.4 cores=0,2,4,6
/proc/1919/stat : 1919 (ttsth-5-4) Z 1917 1919 1676 0 -1 4203548 1745303 0 0 0 479629 411 0 0 18 0 2 0 501766497 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1919/statm: 0 0 0 0 0 0 0
[pid=1919/tid=1923] ppid=1917 vsize=0 CPUtime=1195.83 cores=0,2,4,6
/proc/1919/task/1923/stat : 1923 (ttsth-5-4) R 1917 1919 1676 0 -1 4203588 378613 0 0 0 119479 104 0 0 25 0 2 0 501766521 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.39
CPU time (s): 4800.5
CPU user time (s): 4796.29
CPU system time (s): 4.21036
CPU usage (%): 399.245
Max. virtual memory (cumulated for all children) (KiB): 7220788

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.29
system time used= 4.21036
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1745303
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1071
involuntary context switches= 22807

runsolver used 1.92171 second user time and 4.50232 second system time

The end

Launcher Data

Begin job on node147 at 2011-04-29 18:11:46
IDJOB=3250824
IDBENCH=83365
IDSOLVER=1654
FILE ID=node147/3250824-1304093506
RUNJOBID= node147-1304091097-1694
PBS_JOBID= 13170578
Free space on /tmp= 72660 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-16_238.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3250824-1304093506/watcher-3250824-1304093506 -o /tmp/evaluation-result-3250824-1304093506/solver-3250824-1304093506 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3250824-1304093506.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b61e426b264831836f140414cdcf3e23
RANDOM SEED=1067384555

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30888208 kB
Buffers:        275076 kB
Cached:        1365028 kB
SwapCached:       2968 kB
Active:         164100 kB
Inactive:      1575432 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30888208 kB
SwapTotal:    67111528 kB
SwapFree:     67105204 kB
Dirty:             404 kB
Writeback:           0 kB
AnonPages:       97300 kB
Mapped:          15008 kB
Slab:           260392 kB
PageTables:       4676 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   294584 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72660 MiB
End job on node147 at 2011-04-29 18:31:50