Trace number 3250076

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.51 1202.08

General information on the benchmark

Namecrafted/skvortsov/battleship/
battleship-15-15-unsat.cnf
MD5SUM647576009a3d34cc33c6dfd3ecb1a2ef
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables225
Number of clauses1800
Sum of the clauses size6525
Maximum clause length15
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21575
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5225

Solver Data 

0.00/0.00	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3250076-1304088494.cnf 
0.00/0.00	c Using SATTIMEOUT of 4800
0.00/0.00	c Using SATRAM of 15500
0.00/0.00	c Size of subset node = 32
0.00/0.00	c Variables = 225
0.00/0.00	c Clauses = 1800
0.00/0.00	c Literals = 6525
0.00/0.00	c Reduced size:
0.00/0.00	c Variables = 225
0.00/0.00	c Clauses = 1800
0.00/0.00	c Literals = 6525
0.00/0.00	c a2
0.00/0.00	c a1
0.10/0.15	c Independent sub-problems = 1
0.10/0.15	c Sub-problem with 225 variables and 1800 clauses
0.10/0.15	c using permutation method 4
0.10/0.15	c count = 2
0.10/0.15	c Ordering finished 0.140 seconds
0.10/0.15	c mapped 0.150 seconds
0.10/0.15	c permuted 0.150 seconds
0.10/0.15	c about to sort
0.10/0.15	c sorted
0.10/0.15	c clauses now 1800
0.10/0.15	c init finished 0.150 seconds
0.10/0.15	c tree built 0.150 seconds
0.10/0.15	c 
0.10/0.15	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.10/0.15	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.10/0.15	c ................................ | ..........                    |                                  0.1         0.0             
0.10/0.15	c ................................ | ..........                  1 |                                  0.1         6.7             
0.10/0.15	c ................................ | ..........                  2 |                                  0.1        13.3             
0.10/0.15	c ................................ | ..........                  3 |                                  0.1        20.0             
0.10/0.15	c ................................ | ..........                  4 |                                  0.1        26.7             
0.10/0.15	c ................................ | ..........                  5 |                                  0.1        33.3             
0.10/0.16	c ................................ | ..........               1000 | 218          90                  0.2      6250.0         4922
96.17/24.28	c ................................ | ..........             385000 | 123922       1791               96.5      3990.5      5625204
192.02/48.20	c ................................ | ..........             536000 | 174453       1925              192.0      2791.4      8593404
288.67/72.42	c ................................ | ..........             660000 | 215813       1931              288.8      2285.6     11268114
384.13/96.38	c ................................ | ..........             781000 | 255603       1953              384.4      2031.5     13787685
479.99/120.39	c ................................ | *.........             899000 | 294345       2061              480.4      1871.4     15047987
576.20/144.47	c ................................ | *.........            1074000 | 351870       2196              576.5      1863.0     15390946
672.05/168.46	c ................................ | *.........            1206000 | 395003       2223              672.3      1793.8     15548277
768.27/192.54	c ................................ | *.........            1366000 | 447390       2278              768.4      1777.7     15586601
864.52/216.67	c ................................ | *.........            1474000 | 482579       2293              864.8      1704.4     15971272
959.95/240.52	c ................................ | **........            1593000 | 520823       2332              960.0      1659.3     16824426
1056.20/264.62	c ................................ | **........            1708000 | 558610       2344             1056.3      1617.0     17047583
1152.04/288.66	c ................................ | **........            1854000 | 605565       2347             1152.3      1608.9     17152038
1247.85/312.68	c ................................ | **........            1997000 | 651531       2349             1248.2      1600.0     17867952
1344.08/336.73	c ................................ | **........            2111000 | 688331       2360             1344.2      1570.4     18273064
1439.95/360.73	c ................................ | ***.......            2222000 | 724407       2360             1440.0      1543.0     18945781
1536.59/385.00	c ................................ | ***.......            2346000 | 765271       2360             1537.0      1526.4     19709744
1632.43/408.92	c ................................ | ***.......            2440000 | 796203       2660             1632.5      1494.6     20802478
1727.90/432.86	c ................................ | ***.......            2535000 | 825868       3106             1728.2      1466.9     21669779
1824.17/456.92	c ................................ | ***.......            2597000 | 845674       3454             1824.3      1423.6     22772616
1920.44/481.00	c ................................ | ****......            2666000 | 867283       3491             1920.5      1388.2     24263002
2016.72/505.19	c ................................ | ****......            2736000 | 889693       3508             2017.1      1356.4     26257761
2113.39/529.30	c ................................ | ****......            2796000 | 909183       3545             2113.4      1323.0     28040422
2208.46/553.12	c ................................ | ****......            2855000 | 928294       3670             2208.6      1292.7     29583845
2305.12/577.33	c ................................ | ****......            2923000 | 950534       4157             2305.2      1268.0     31827298
2401.00/601.37	c ................................ | *****.....            2981000 | 969164       4317             2401.3      1241.4     33738168
2497.26/625.42	c ................................ | *****.....            3021000 | 982401       4420             2497.4      1209.7     35315922
2592.33/649.27	c ................................ | *****.....            3071000 | 998670       4495             2592.6      1184.5     37025299
2688.55/673.33	c ................................ | *****.....            3125000 | 1015770      4499             2688.7      1162.3     37860056
2784.44/697.32	c ................................ | *****.....            3162000 | 1027448      4532             2784.5      1135.6     39204631
2880.28/721.34	c ................................ | ******....            3221000 | 1047037      4739             2880.4      1118.2     40692830
2976.55/745.44	c ................................ | ******....            3273000 | 1064697      4782             2976.7      1099.5     40930432
3071.99/769.34	c ................................ | ******....            3317000 | 1078861      4831             3072.2      1079.7     41696879
3172.26/794.44	c ................................ | ******....            3364000 | 1094192      4899             3172.4      1060.4     42922829
3266.12/817.96	c ................................ | ******....            3398000 | 1105083      4909             3266.4      1040.3     43891910
3362.00/841.98	c ................................ | *******...            3426000 | 1114195      4950             3362.3      1018.9     44727397
3458.66/866.11	c ................................ | *******...            3452000 | 1122640      4976             3458.7       998.1     45243121
3552.14/889.56	c ................................ | *******...            3479000 | 1131128      5007             3552.4       979.3     46058393
3648.80/913.73	c ................................ | *******...            3513000 | 1142318      5007             3648.9       962.8     47104280
3747.05/938.34	c ................................ | *******...            3547000 | 1153229      5015             3747.2       946.6     47592674
3840.08/961.60	c ................................ | ********..            3573000 | 1161623      5020             3840.1       930.4     47592674
3938.35/986.21	c ................................ | ********..            3617000 | 1175684      5026             3938.4       918.4     47592674
4032.65/1009.89	c ................................ | ********..            3659000 | 1189143      5052             4033.0       907.3     48245129
4127.69/1033.68	c ................................ | ********..            3701000 | 1203169      5091             4128.1       896.5     48850683
4227.56/1058.66	c ................................ | ********..            3737000 | 1215452      5122             4227.8       883.9     49567705
4320.63/1081.94	c ................................ | *********.            3767000 | 1225379      5199             4320.8       871.8     50329642
4416.11/1105.88	c ................................ | *********.            3797000 | 1234712      5240             4416.4       859.7     51192983
4516.77/1131.09	c ................................ | *********.            3824000 | 1243538      5248             4517.2       846.5     52107615
4611.05/1154.65	c ................................ | *********.            3850000 | 1252001      5271             4611.2       834.9     53030483
4704.54/1178.04	c ................................ | *********.            3872000 | 1258819      5300             4704.7       823.0     53863734

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3250076-1304088494/watcher-3250076-1304088494 -o /tmp/evaluation-result-3250076-1304088494/solver-3250076-1304088494 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3250076-1304088494.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.26 7.65 7.61 5/181 20869
/proc/meminfo: memFree=30820816/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=9904 CPUtime=0 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) R 20867 20869 20765 0 -1 4202496 554 0 0 0 0 0 0 0 25 0 1 0 599079970 10141696 496 33554432000 4194304 4338100 140734567631808 18446744073709551615 4206990 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/20869/statm: 2476 496 152 36 0 381 0

[startup+0.0331139 s]
/proc/loadavg: 6.26 7.65 7.61 5/181 20869
/proc/meminfo: memFree=30820816/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=9904 CPUtime=0.03 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) R 20867 20869 20765 0 -1 4202496 564 0 0 0 3 0 0 0 25 0 1 0 599079970 10141696 506 33554432000 4194304 4338100 140734567631808 18446744073709551615 4296000 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/20869/statm: 2476 506 155 36 0 381 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 9904

[startup+0.101103 s]
/proc/loadavg: 6.26 7.65 7.61 5/181 20869
/proc/meminfo: memFree=30820816/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=9904 CPUtime=0.1 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) R 20867 20869 20765 0 -1 4202496 564 0 0 0 10 0 0 0 25 0 1 0 599079970 10141696 506 33554432000 4194304 4338100 140734567631808 18446744073709551615 4295959 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/20869/statm: 2476 506 155 36 0 381 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 9904

[startup+0.30103 s]
/proc/loadavg: 6.26 7.65 7.61 5/181 20869
/proc/meminfo: memFree=30820816/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=197840 CPUtime=0.72 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 2811 0 0 0 72 0 0 0 25 0 5 0 599079970 202588160 2666 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 49460 2666 175 36 0 47365 0
Current children cumulated CPU time (s) 0.72
Current children cumulated vsize (KiB) 197840

[startup+0.700958 s]
/proc/loadavg: 6.26 7.65 7.61 5/181 20869
/proc/meminfo: memFree=30820816/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=275888 CPUtime=2.32 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 5458 0 0 0 230 2 0 0 25 0 5 0 599079970 282509312 5313 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 68972 5313 175 36 0 66877 0
Current children cumulated CPU time (s) 2.32
Current children cumulated vsize (KiB) 275888

[startup+1.50081 s]
/proc/loadavg: 6.26 7.65 7.61 9/186 20874
/proc/meminfo: memFree=30776540/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=291660 CPUtime=5.52 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 9413 0 0 0 545 7 0 0 25 0 5 0 599079970 298659840 9268 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 72915 9268 175 36 0 70820 0
[pid=20869/tid=20871] ppid=20867 vsize=291660 CPUtime=1.33 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 3354 0 0 0 132 1 0 0 20 0 5 0 599079985 298659840 9268 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=291660 CPUtime=1.33 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 1881 0 0 0 132 1 0 0 25 0 5 0 599079985 298659840 9268 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254326 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=291660 CPUtime=1.33 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 1068 0 0 0 132 1 0 0 20 0 5 0 599079985 298659840 9268 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=291660 CPUtime=1.33 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 1756 0 0 0 132 1 0 0 25 0 5 0 599079985 298659840 9268 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.52
Current children cumulated vsize (KiB) 291660

[startup+3.10052 s]
/proc/loadavg: 6.26 7.65 7.61 9/186 20874
/proc/meminfo: memFree=30741456/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=307300 CPUtime=11.9 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 14029 0 0 0 1176 14 0 0 25 0 5 0 599079970 314675200 13884 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 76825 13884 175 36 0 74730 0
[pid=20869/tid=20871] ppid=20867 vsize=307300 CPUtime=2.94 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 5274 0 0 0 292 2 0 0 25 0 5 0 599079985 314675200 13884 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=307300 CPUtime=2.92 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 2894 0 0 0 289 3 0 0 25 0 5 0 599079985 314675200 13884 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=307300 CPUtime=2.93 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 1883 0 0 0 289 4 0 0 25 0 5 0 599079985 314675200 13884 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=307300 CPUtime=2.93 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 2624 0 0 0 289 4 0 0 25 0 5 0 599079985 314675200 13884 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.9
Current children cumulated vsize (KiB) 307300

[startup+6.30092 s]
/proc/loadavg: 6.40 7.65 7.61 9/186 20874
/proc/meminfo: memFree=30675868/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=329196 CPUtime=24.69 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 19936 0 0 0 2435 34 0 0 25 0 5 0 599079970 337096704 19791 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 82299 19791 175 36 0 80204 0
[pid=20869/tid=20871] ppid=20867 vsize=329196 CPUtime=6.13 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 7704 0 0 0 608 5 0 0 25 0 5 0 599079985 337096704 19791 33554432000 4194304 4338100 140734567631808 18446744073709551615 4256753 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=329196 CPUtime=6.1 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 4069 0 0 0 601 9 0 0 25 0 5 0 599079985 337096704 19791 33554432000 4194304 4338100 140734567631808 18446744073709551615 260019790887 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=329196 CPUtime=6.14 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 2990 0 0 0 604 10 0 0 25 0 5 0 599079985 337096704 19791 33554432000 4194304 4338100 140734567631808 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=329196 CPUtime=6.14 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 3819 0 0 0 605 9 0 0 25 0 5 0 599079985 337096704 19791 33554432000 4194304 4338100 140734567631808 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.69
Current children cumulated vsize (KiB) 329196

[startup+12.7007 s]
/proc/loadavg: 6.53 7.66 7.61 9/186 20874
/proc/meminfo: memFree=30600780/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=373120 CPUtime=50.24 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 30934 0 0 0 4967 57 0 0 25 0 5 0 599079970 382074880 30789 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 93280 30789 175 36 0 91185 0
[pid=20869/tid=20871] ppid=20867 vsize=373120 CPUtime=12.53 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 12448 0 0 0 1245 8 0 0 25 0 5 0 599079985 382074880 30789 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=373120 CPUtime=12.46 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 6120 0 0 0 1230 16 0 0 25 0 5 0 599079985 382074880 30789 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=373120 CPUtime=12.53 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 5017 0 0 0 1237 16 0 0 25 0 5 0 599079985 382074880 30789 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=373120 CPUtime=12.53 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 5995 0 0 0 1238 15 0 0 25 0 5 0 599079985 382074880 30789 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.24
Current children cumulated vsize (KiB) 373120

[startup+25.5004 s]
/proc/loadavg: 6.85 7.67 7.62 9/186 20875
/proc/meminfo: memFree=30463336/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=445016 CPUtime=101.34 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 47756 0 0 0 10030 104 0 0 25 0 5 0 599079970 455696384 47611 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 111254 47611 176 36 0 109159 0
[pid=20869/tid=20871] ppid=20867 vsize=445016 CPUtime=25.33 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 20239 0 0 0 2518 15 0 0 25 0 5 0 599079985 455696384 47611 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=445016 CPUtime=25.18 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 9739 0 0 0 2488 30 0 0 25 0 5 0 599079985 455696384 47611 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=445016 CPUtime=25.32 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 7262 0 0 0 2503 29 0 0 25 0 5 0 599079985 455696384 47611 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=445016 CPUtime=25.32 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 9162 0 0 0 2503 29 0 0 25 0 5 0 599079985 455696384 47611 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.34
Current children cumulated vsize (KiB) 445016

[startup+51.1007 s]
/proc/loadavg: 7.39 7.73 7.64 9/186 20875
/proc/meminfo: memFree=30222140/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=542624 CPUtime=203.6 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 72234 0 0 0 20192 168 0 0 25 0 5 0 599079970 555646976 72089 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 135656 72089 176 36 0 133561 0
[pid=20869/tid=20871] ppid=20867 vsize=542624 CPUtime=50.93 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 29459 0 0 0 5073 20 0 0 25 0 5 0 599079985 555646976 72089 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254239 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=542624 CPUtime=50.64 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 14737 0 0 0 5015 49 0 0 25 0 5 0 599079985 555646976 72089 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=542624 CPUtime=50.92 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 12357 0 0 0 5043 49 0 0 25 0 5 0 599079985 555646976 72089 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=542624 CPUtime=50.93 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 14327 0 0 0 5044 49 0 0 25 0 5 0 599079985 555646976 72089 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.6
Current children cumulated vsize (KiB) 542624

[startup+102.306 s]
/proc/loadavg: 7.88 7.80 7.66 9/186 20877
/proc/meminfo: memFree=29763912/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=710968 CPUtime=408.11 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 114537 0 0 0 40538 273 0 0 25 0 5 0 599079970 728031232 114392 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 177742 114392 176 36 0 175647 0
[pid=20869/tid=20871] ppid=20867 vsize=710968 CPUtime=102.14 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 47986 0 0 0 10188 26 0 0 25 0 5 0 599079985 728031232 114392 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=710968 CPUtime=101.56 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 23319 0 0 0 10072 84 0 0 25 0 5 0 599079985 728031232 114392 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254384 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=710968 CPUtime=102.12 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 20944 0 0 0 10129 83 0 0 25 0 5 0 599079985 728031232 114392 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=710968 CPUtime=102.12 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 20934 0 0 0 10133 79 0 0 25 0 5 0 599079985 728031232 114392 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.11
Current children cumulated vsize (KiB) 710968

[startup+162.301 s]
/proc/loadavg: 8.03 7.85 7.68 9/186 20878
/proc/meminfo: memFree=29641832/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=817292 CPUtime=647.69 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 134220 0 0 0 64350 419 0 0 25 0 5 0 599079970 836907008 134075 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 204323 134075 176 36 0 202228 0
[pid=20869/tid=20871] ppid=20867 vsize=817292 CPUtime=162.12 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 53681 0 0 0 16174 38 0 0 25 0 5 0 599079985 836907008 134075 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=817292 CPUtime=161.21 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 28367 0 0 0 15994 127 0 0 25 0 5 0 599079985 836907008 134075 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=817292 CPUtime=162.09 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 25115 0 0 0 16083 126 0 0 25 0 5 0 599079985 836907008 134075 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=817292 CPUtime=162.09 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 25703 0 0 0 16083 126 0 0 25 0 5 0 599079985 836907008 134075 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 647.69
Current children cumulated vsize (KiB) 817292


################
# More data... #
################

[pid=20869/tid=20872] ppid=20867 vsize=1571404 CPUtime=698.21 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 53450 0 0 0 69454 367 0 0 25 0 5 0 599079985 1609117696 325270 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=1571404 CPUtime=701.96 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 58986 0 0 0 69875 321 0 0 25 0 5 0 599079985 1609117696 325270 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=1571404 CPUtime=701.97 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 64695 0 0 0 69833 364 0 0 25 0 5 0 599079985 1609117696 325270 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2804.39
Current children cumulated vsize (KiB) 1571404

[startup+762.307 s]
/proc/loadavg: 8.05 8.01 7.84 9/186 20894
/proc/meminfo: memFree=28527696/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=1641076 CPUtime=3044.08 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 341618 0 0 0 303189 1219 0 0 25 0 5 0 599079970 1680461824 341473 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 410269 341473 176 36 0 408174 0
[pid=20869/tid=20871] ppid=20867 vsize=1641076 CPUtime=762.08 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 150574 0 0 0 76074 134 0 0 25 0 5 0 599079985 1680461824 341473 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=1641076 CPUtime=757.88 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 54783 0 0 0 75408 380 0 0 25 0 5 0 599079985 1680461824 341473 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=1641076 CPUtime=761.97 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 66802 0 0 0 75871 326 0 0 25 0 5 0 599079985 1680461824 341473 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=1641076 CPUtime=761.97 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 68105 0 0 0 75820 377 0 0 25 0 5 0 599079985 1680461824 341473 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3044.08
Current children cumulated vsize (KiB) 1641076

[startup+822.3 s]
/proc/loadavg: 7.81 7.94 7.82 9/186 20967
/proc/meminfo: memFree=28601828/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=1719276 CPUtime=3283.7 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 362108 0 0 0 327120 1250 0 0 25 0 5 0 599079970 1760538624 361963 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 429819 361963 176 36 0 427724 0
[pid=20869/tid=20871] ppid=20867 vsize=1719276 CPUtime=822.05 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 160945 0 0 0 82068 137 0 0 25 0 5 0 599079985 1760538624 361963 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254239 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=1719276 CPUtime=817.55 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 58812 0 0 0 81361 394 0 0 25 0 5 0 599079985 1760538624 361963 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=1719276 CPUtime=821.95 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 72892 0 0 0 81865 330 0 0 25 0 5 0 599079985 1760538624 361963 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=1719276 CPUtime=821.96 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 68105 0 0 0 81808 388 0 0 25 0 5 0 599079985 1760538624 361963 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3283.7
Current children cumulated vsize (KiB) 1719276

[startup+882.3 s]
/proc/loadavg: 7.93 7.94 7.83 9/186 20968
/proc/meminfo: memFree=28170112/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=1775580 CPUtime=3523.37 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 375672 0 0 0 351065 1272 0 0 25 0 5 0 599079970 1818193920 375527 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 443895 375527 176 36 0 441800 0
[pid=20869/tid=20871] ppid=20867 vsize=1775580 CPUtime=882.06 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 168432 0 0 0 88066 140 0 0 25 0 5 0 599079985 1818193920 375527 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254357 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=1775580 CPUtime=877.22 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 61597 0 0 0 87320 402 0 0 25 0 5 0 599079985 1818193920 375527 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=1775580 CPUtime=881.95 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 76184 0 0 0 87863 332 0 0 25 0 5 0 599079985 1818193920 375527 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254259 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=1775580 CPUtime=881.96 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 68105 0 0 0 87800 396 0 0 25 0 5 0 599079985 1818193920 375527 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254462 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3523.37
Current children cumulated vsize (KiB) 1775580

[startup+942.3 s]
/proc/loadavg: 7.97 7.95 7.83 9/186 20970
/proc/meminfo: memFree=27768928/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=1828756 CPUtime=3762.99 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 389833 0 0 0 375001 1298 0 0 25 0 5 0 599079970 1872646144 389688 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 457189 389688 176 36 0 455094 0
[pid=20869/tid=20871] ppid=20867 vsize=1828756 CPUtime=942.03 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 174857 0 0 0 94062 141 0 0 25 0 5 0 599079985 1872646144 389688 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=1828756 CPUtime=936.89 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 64759 0 0 0 93275 414 0 0 25 0 5 0 599079985 1872646144 389688 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254244 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=1828756 CPUtime=941.94 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 80373 0 0 0 93858 336 0 0 25 0 5 0 599079985 1872646144 389688 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=1828756 CPUtime=941.96 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 68490 0 0 0 93790 406 0 0 25 0 5 0 599079985 1872646144 389688 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3762.99
Current children cumulated vsize (KiB) 1828756

[startup+1002.3 s]
/proc/loadavg: 8.10 7.99 7.85 9/186 20972
/proc/meminfo: memFree=27447700/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=1841268 CPUtime=4002.66 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 393203 0 0 0 398938 1328 0 0 25 0 5 0 599079970 1885458432 393058 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 460317 393058 176 36 0 458222 0
[pid=20869/tid=20871] ppid=20867 vsize=1841268 CPUtime=1002.03 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 178227 0 0 0 100061 142 0 0 25 0 5 0 599079985 1885458432 393058 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=1841268 CPUtime=996.56 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 64759 0 0 0 99228 428 0 0 25 0 5 0 599079985 1885458432 393058 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=1841268 CPUtime=1001.94 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 80373 0 0 0 99856 338 0 0 25 0 5 0 599079985 1885458432 393058 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=1841268 CPUtime=1001.95 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 68490 0 0 0 99776 419 0 0 25 0 5 0 599079985 1885458432 393058 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032221877 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4002.66
Current children cumulated vsize (KiB) 1841268

[startup+1062.3 s]
/proc/loadavg: 8.04 7.99 7.85 9/186 20973
/proc/meminfo: memFree=27170516/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=1891316 CPUtime=4242.34 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 406108 0 0 0 422876 1358 0 0 25 0 5 0 599079970 1936707584 405963 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 472829 405963 176 36 0 470734 0
[pid=20869/tid=20871] ppid=20867 vsize=1891316 CPUtime=1062.03 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 189203 0 0 0 106059 144 0 0 25 0 5 0 599079985 1936707584 405963 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=1891316 CPUtime=1056.23 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 64759 0 0 0 105183 440 0 0 25 0 5 0 599079985 1936707584 405963 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=1891316 CPUtime=1061.94 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 82302 0 0 0 105853 341 0 0 25 0 5 0 599079985 1936707584 405963 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=1891316 CPUtime=1061.96 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 68490 0 0 0 105765 431 0 0 25 0 5 0 599079985 1936707584 405963 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4242.34
Current children cumulated vsize (KiB) 1891316

[startup+1122.3 s]
/proc/loadavg: 8.01 7.99 7.86 9/186 20975
/proc/meminfo: memFree=26959784/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=1963260 CPUtime=4482.01 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 422594 0 0 0 446820 1381 0 0 25 0 5 0 599079970 2010378240 422449 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 490815 422450 176 36 0 488720 0
[pid=20869/tid=20871] ppid=20867 vsize=1963260 CPUtime=1122.04 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 197321 0 0 0 112057 147 0 0 25 0 5 0 599079985 2010378240 422450 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=1963260 CPUtime=1115.91 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 67562 0 0 0 111142 449 0 0 25 0 5 0 599079985 2010378240 422450 33554432000 4194304 4338100 140734567631808 18446744073709551615 4206915 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=1963260 CPUtime=1121.94 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 86523 0 0 0 111849 345 0 0 25 0 5 0 599079985 2010378240 422450 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=1963260 CPUtime=1121.96 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 69835 0 0 0 111756 440 0 0 25 0 5 0 599079985 2010378240 422450 33554432000 4194304 4338100 140734567631808 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4482.01
Current children cumulated vsize (KiB) 1963260

[startup+1182.3 s]
/proc/loadavg: 8.08 8.00 7.87 9/186 20976
/proc/meminfo: memFree=26752880/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=2032076 CPUtime=4721.69 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 440122 0 0 0 470768 1401 0 0 25 0 5 0 599079970 2080845824 439977 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 508019 439977 176 36 0 505924 0
[pid=20869/tid=20871] ppid=20867 vsize=2032076 CPUtime=1182.04 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 204118 0 0 0 118056 148 0 0 25 0 5 0 599079985 2080845824 439977 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=2032076 CPUtime=1175.58 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 70577 0 0 0 117101 457 0 0 25 0 5 0 599079985 2080845824 439977 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=2032076 CPUtime=1181.93 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 90990 0 0 0 117846 347 0 0 25 0 5 0 599079985 2080845824 439977 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=2032076 CPUtime=1181.95 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 73083 0 0 0 117748 447 0 0 25 0 5 0 599079985 2080845824 439977 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4721.69
Current children cumulated vsize (KiB) 2032076



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202 s]
/proc/loadavg: 8.05 8.00 7.87 9/186 20977
/proc/meminfo: memFree=26675368/32951124 swapFree=67111464/67111528
[pid=20869] ppid=20867 vsize=2057100 CPUtime=4800.4 cores=1,3,5,7
/proc/20869/stat : 20869 (ttsth-5-4) S 20867 20869 20765 0 -1 4202496 446823 0 0 0 478629 1411 0 0 25 0 5 0 599079970 2106470400 446678 33554432000 4194304 4338100 140734567631808 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/20869/statm: 514275 446678 176 36 0 512180 0
[pid=20869/tid=20871] ppid=20867 vsize=2057100 CPUtime=1201.74 cores=1,3,5,7
/proc/20869/task/20871/stat : 20871 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 206295 0 0 0 120025 149 0 0 25 0 5 0 599079985 2106470400 446678 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=20869/tid=20872] ppid=20867 vsize=2057100 CPUtime=1195.18 cores=1,3,5,7
/proc/20869/task/20872/stat : 20872 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 71903 0 0 0 119057 461 0 0 25 0 5 0 599079985 2106470400 446678 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=20869/tid=20873] ppid=20867 vsize=2057100 CPUtime=1201.64 cores=1,3,5,7
/proc/20869/task/20873/stat : 20873 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 92800 0 0 0 119816 348 0 0 25 0 5 0 599079985 2106470400 446678 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=20869/tid=20874] ppid=20867 vsize=2057100 CPUtime=1201.66 cores=1,3,5,7
/proc/20869/task/20874/stat : 20874 (ttsth-5-4) R 20867 20869 20765 0 -1 4202560 74471 0 0 0 119714 452 0 0 25 0 5 0 599079985 2106470400 446678 33554432000 4194304 4338100 140734567631808 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.4
Current children cumulated vsize (KiB) 2057100

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.08
CPU time (s): 4800.51
CPU user time (s): 4786.32
CPU system time (s): 14.1898
CPU usage (%): 399.349
Max. virtual memory (cumulated for all children) (KiB): 2057100

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4786.32
system time used= 14.1898
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 446831
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 25526
involuntary context switches= 35044

runsolver used 2.05169 second user time and 4.51131 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-29 16:48:14
IDJOB=3250076
IDBENCH=83230
IDSOLVER=1654
FILE ID=node110/3250076-1304088494
RUNJOBID= node110-1304088491-20784
PBS_JOBID= 13170568
Free space on /tmp= 72840 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/skvortsov/battleship/battleship-15-15-unsat.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3250076-1304088494/watcher-3250076-1304088494 -o /tmp/evaluation-result-3250076-1304088494/solver-3250076-1304088494 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3250076-1304088494.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 647576009a3d34cc33c6dfd3ecb1a2ef
RANDOM SEED=1699238759

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30821104 kB
Buffers:        894448 kB
Cached:         691336 kB
SwapCached:         64 kB
Active:         189388 kB
Inactive:      1533112 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30821104 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:             700 kB
Writeback:           0 kB
AnonPages:      136696 kB
Mapped:          15292 kB
Slab:           342396 kB
PageTables:       4476 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   329092 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72836 MiB
End job on node110 at 2011-04-29 17:08:18