Trace number 3257998

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.22 1203.17

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v2100c215164g9.cnf
MD5SUMe033e9c916da557514299cce9ca2468f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2100
Number of clauses215164
Sum of the clauses size432288
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2215094
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 570

Solver Data 

0.09/0.15	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3257998-1304048911.cnf 
0.09/0.15	c Using SATTIMEOUT of 4800
0.09/0.15	c Using SATRAM of 15500
0.09/0.15	c Size of subset node = 32
0.09/0.15	c Variables = 2100
0.09/0.15	c Clauses = 215164
0.09/0.15	c Literals = 432288
0.09/0.15	c Reduced size:
0.09/0.15	c Variables = 2100
0.09/0.15	c Clauses = 215164
0.09/0.15	c Literals = 432288
0.09/0.15	c a2
0.19/0.27	c a1
0.49/0.56	c Independent sub-problems = 1
0.49/0.56	c Sub-problem with 2100 variables and 215164 clauses
0.49/0.56	c using permutation method 4
0.49/0.56	c count = 1
0.49/0.56	c Ordering finished 0.530 seconds
0.49/0.56	c mapped 0.550 seconds
0.49/0.56	c permuted 0.550 seconds
0.49/0.56	c about to sort
0.49/0.57	c sorted
1.00/1.09	c clauses now 215164
1.00/1.09	c init finished 0.610 seconds
1.00/1.09	c tree built 1.080 seconds
1.00/1.09	c 
1.00/1.09	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
1.00/1.09	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
1.00/1.09	c ................................ | ..........                    |                                  1.1         0.0             
1.00/1.09	c ................................ | ..........                  1 |                                  1.1         0.9             
1.00/1.09	c ................................ | ..........                  2 |                                  1.1         1.9             
1.00/1.09	c ................................ | ..........                  3 |                                  1.1         2.8             
1.00/1.09	c ................................ | ..........                  4 |                                  1.1         3.7             
1.00/1.09	c ................................ | ..........                  5 |                                  1.1         4.6             
1.00/1.10	c ................................ | ..........               1000 | 1            100                 1.1       917.4          563
95.77/24.86	c ................................ | ..........            3450000 | 90062        243390             96.0     35922.5     13521639
191.63/48.89	c ................................ | ..........            6189000 | 168956       410163            192.0     32232.7     21026198
287.88/72.93	c ................................ | ..........            8652000 | 247717       556348            288.0     30040.6     25415940
383.73/96.97	c ................................ | ..........           10906000 | 323204       697631            384.0     28400.3     29526420
480.00/121.01	c ................................ | *.........           12967000 | 390646       831864            480.0     27012.3     34152799
575.85/145.04	c ................................ | *.........           14939000 | 454714       961916            576.0     25935.3     40524163
671.69/169.08	c ................................ | *.........           16753000 | 511910       1091557           672.0     24929.3     43523577
767.95/193.11	c ................................ | *.........           18584000 | 569059       1213646           768.0     24197.6     43802757
863.75/217.16	c ................................ | *.........           20643000 | 630471       1327483           864.0     23892.1     46892660
959.60/241.19	c ................................ | **........           22688000 | 697417       1436281           960.0     23633.3     50632204
1055.87/265.24	c ................................ | **........           24540000 | 764591       1532610          1056.0     23238.0     56059669
1151.72/289.27	c ................................ | **........           26292000 | 826446       1622863          1152.0     22822.9     59772443
1247.97/313.31	c ................................ | **........           28023000 | 890424       1709332          1248.0     22453.8     62947267
1343.82/337.34	c ................................ | **........           29714000 | 946031       1791231          1344.0     22108.5     65945890
1439.69/361.38	c ................................ | ***.......           31245000 | 997807       1872585          1440.0     21697.3     68319415
1535.90/385.43	c ................................ | ***.......           32787000 | 1048278      1955259          1536.0     21345.1     68750367
1631.75/409.47	c ................................ | ***.......           34300000 | 1095637      2038150          1632.0     21016.6     70493569
1728.00/433.50	c ................................ | ***.......           36029000 | 1145370      2129090          1728.0     20849.6     71989559
1823.88/457.53	c ................................ | ***.......           37612000 | 1193963      2209175          1824.0     20620.6     74401953
1919.73/481.57	c ................................ | ****......           39254000 | 1243539      2289363          1920.0     20444.4     76651723
2015.99/505.61	c ................................ | ****......           40851000 | 1296400      2364074          2016.0     20263.0     79398243
2111.86/529.64	c ................................ | ****......           42375000 | 1347758      2454355          2112.0     20063.7     81603242
2207.70/553.68	c ................................ | ****......           43856000 | 1398293      2541954          2208.0     19862.0     85459101
2303.94/577.72	c ................................ | ****......           45340000 | 1444760      2627298          2304.0     19678.5     88398388
2399.83/601.75	c ................................ | *****.....           46855000 | 1492634      2707093          2400.0     19522.7     90190984
2496.00/625.80	c ................................ | *****.....           48283000 | 1541450      2779919          2496.0     19344.0     94750133
2591.85/649.84	c ................................ | *****.....           49668000 | 1588486      2852118          2592.0     19161.8     99125803
2687.70/673.88	c ................................ | *****.....           51531000 | 1629772      2947217          2688.0     19170.5    103515737
2783.90/697.93	c ................................ | *****.....           53563000 | 1668831      3044990          2784.0     19239.4    105679913
2879.68/721.98	c ................................ | ******....           55379000 | 1707245      3132593          2880.0     19228.8    107200198
2975.90/746.03	c ................................ | ******....           57104000 | 1745652      3216508          2976.0     19188.0    109344878
3071.76/770.08	c ................................ | ******....           58742000 | 1781485      3298494          3072.0     19121.5    111919952
3167.99/794.11	c ................................ | ******....           60342000 | 1815449      3382849          3168.0     19047.2    115939603
3263.84/818.14	c ................................ | ******....           61815000 | 1847831      3461489          3264.0     18938.4    117219101
3359.69/842.18	c ................................ | *******...           63400000 | 1881384      3541930          3360.0     18868.9    119065785
3455.95/866.22	c ................................ | *******...           64894000 | 1914586      3618583          3456.1     18776.9    122096941
3551.76/890.26	c ................................ | *******...           66478000 | 1944823      3699392          3552.0     18715.6    126153746
3647.63/914.29	c ................................ | *******...           67890000 | 1973747      3772273          3648.0     18610.2    127695833
3743.73/938.47	c ................................ | *******...           69322000 | 2005100      3848619          3744.0     18515.3    128197121
3839.82/962.55	c ................................ | ********..           70716000 | 2033452      3949112          3840.0     18415.6    128197121
3935.63/986.59	c ................................ | ********..           72112000 | 2062530      4053335          3936.0     18321.1    128197121
4031.90/1010.62	c ................................ | ********..           73468000 | 2089843      4157097          4032.0     18221.2    129495204
4127.76/1034.67	c ................................ | ********..           74851000 | 2116996      4258067          4128.1     18132.3    130195602
4223.61/1058.69	c ................................ | ********..           76121000 | 2142453      4349855          4224.0     18021.1    130558540
4319.85/1082.74	c ................................ | *********.           77337000 | 2170242      4435023          4320.0     17902.0    132374260
4415.68/1106.78	c ................................ | *********.           78567000 | 2197177      4521006          4416.0     17791.4    133314642
4511.88/1130.83	c ................................ | *********.           79791000 | 2225242      4600321          4512.0     17684.2    134087904
4607.63/1154.89	c ................................ | *********.           80998000 | 2250894      4684021          4608.0     17577.6    134758171
4703.86/1178.94	c ................................ | *********.           82250000 | 2277892      4777001          4704.0     17485.0    139552367
4799.72/1202.97	c CPU limit (4800) reached
4799.72/1202.97	c Time = 4800.02 seconds
4799.72/1202.97	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3257998-1304048911/watcher-3257998-1304048911 -o /tmp/evaluation-result-3257998-1304048911/solver-3257998-1304048911 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3257998-1304048911.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.40 4.19 5.33 2/174 2026
/proc/meminfo: memFree=18300292/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=9244 CPUtime=0 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) R 2024 2026 1994 0 -1 4202496 383 0 0 0 0 0 0 0 21 0 1 0 516491552 9465856 325 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808826565 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2026/statm: 2311 326 147 36 0 216 0

[startup+0.07879 s]
/proc/loadavg: 3.40 4.19 5.33 2/174 2026
/proc/meminfo: memFree=18300292/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=24176 CPUtime=0.07 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) R 2024 2026 1994 0 -1 4202496 4098 0 0 0 7 0 0 0 21 0 1 0 516491552 24756224 4040 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808826565 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2026/statm: 6044 4042 148 36 0 3949 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 24176

[startup+0.100786 s]
/proc/loadavg: 3.40 4.19 5.33 2/174 2026
/proc/meminfo: memFree=18300292/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=28808 CPUtime=0.09 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) R 2024 2026 1994 0 -1 4202496 5189 0 0 0 9 0 0 0 21 0 1 0 516491552 29499392 5131 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808826565 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2026/statm: 7202 5132 148 36 0 5107 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 28808

[startup+0.300752 s]
/proc/loadavg: 3.40 4.19 5.33 2/174 2026
/proc/meminfo: memFree=18300292/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=55524 CPUtime=0.29 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) R 2024 2026 1994 0 -1 4202496 11569 0 0 0 28 1 0 0 22 0 1 0 516491552 56856576 11510 33554432000 4194304 4338100 140734362091104 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2026/statm: 13881 11522 153 36 0 11786 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 55524

[startup+0.700679 s]
/proc/loadavg: 3.40 4.19 5.33 2/174 2026
/proc/meminfo: memFree=18300292/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=80428 CPUtime=0.69 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) R 2024 2026 1994 0 -1 4202496 19255 0 0 0 67 2 0 0 24 0 1 0 516491552 82358272 17933 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808832896 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2026/statm: 20107 17933 164 36 0 18012 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 80428

[startup+1.5005 s]
/proc/loadavg: 3.40 4.19 5.33 7/182 2037
/proc/meminfo: memFree=18110512/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=337432 CPUtime=2.7 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 39990 0 0 0 261 9 0 0 25 0 5 0 516491552 345530368 38247 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 84358 38247 176 36 0 82263 0
Current children cumulated CPU time (s) 2.7
Current children cumulated vsize (KiB) 337432

[startup+3.1012 s]
/proc/loadavg: 3.40 4.19 5.33 9/186 2041
/proc/meminfo: memFree=18019712/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=378888 CPUtime=9.09 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 49828 0 0 0 885 24 0 0 25 0 5 0 516491552 387981312 48085 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 94722 48087 176 36 0 92627 0
[pid=2026/tid=2038] ppid=2024 vsize=378888 CPUtime=1.99 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 4245 0 0 0 198 1 0 0 21 0 5 0 516491661 387981312 48087 33554432000 4194304 4338100 140734362091104 18446744073709551615 4206896 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=378888 CPUtime=2 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 2039 0 0 0 191 9 0 0 21 0 5 0 516491661 387981312 48087 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808560656 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=378888 CPUtime=1.99 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 5252 0 0 0 198 1 0 0 21 0 5 0 516491661 387981312 48087 33554432000 4194304 4338100 140734362091104 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=378888 CPUtime=1.99 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 2423 0 0 0 192 7 0 0 21 0 5 0 516491661 387981312 48087 33554432000 4194304 4338100 140734362091104 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 9.09
Current children cumulated vsize (KiB) 378888

[startup+6.30062 s]
/proc/loadavg: 3.85 4.27 5.35 9/186 2041
/proc/meminfo: memFree=17829508/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=438680 CPUtime=21.87 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 64925 0 0 0 2137 50 0 0 25 0 5 0 516491552 449208320 63182 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 109670 63182 176 36 0 107575 0
[pid=2026/tid=2038] ppid=2024 vsize=438680 CPUtime=5.17 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 9140 0 0 0 515 2 0 0 25 0 5 0 516491661 449208320 63182 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808560777 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=438680 CPUtime=5.19 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 3906 0 0 0 498 21 0 0 25 0 5 0 516491661 449208320 63182 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=438680 CPUtime=5.19 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 11530 0 0 0 517 2 0 0 25 0 5 0 516491661 449208320 63182 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254342 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=438680 CPUtime=5.19 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 4478 0 0 0 501 18 0 0 25 0 5 0 516491661 449208320 63182 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 21.87
Current children cumulated vsize (KiB) 438680

[startup+12.7004 s]
/proc/loadavg: 4.18 4.33 5.36 9/186 2042
/proc/meminfo: memFree=17505608/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=551288 CPUtime=47.43 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 93688 0 0 0 4637 106 0 0 25 0 5 0 516491552 564518912 91945 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 137822 91945 176 36 0 135727 0
[pid=2026/tid=2038] ppid=2024 vsize=551288 CPUtime=11.53 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 18495 0 0 0 1148 5 0 0 25 0 5 0 516491661 564518912 91945 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808561056 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=551288 CPUtime=11.59 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 7693 0 0 0 1110 49 0 0 25 0 5 0 516491661 564518912 91945 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=551288 CPUtime=11.6 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 22916 0 0 0 1155 5 0 0 25 0 5 0 516491661 564518912 91945 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=551288 CPUtime=11.59 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 8713 0 0 0 1118 41 0 0 25 0 5 0 516491661 564518912 91945 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 47.43
Current children cumulated vsize (KiB) 551288

[startup+25.5011 s]
/proc/loadavg: 5.10 4.52 5.41 8/186 2042
/proc/meminfo: memFree=17002932/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=760864 CPUtime=98.57 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 146412 0 0 0 9646 211 0 0 25 0 5 0 516491552 779124736 144669 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 190216 144670 176 36 0 188121 0
[pid=2026/tid=2038] ppid=2024 vsize=760864 CPUtime=24.26 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 36535 0 0 0 2415 11 0 0 25 0 5 0 516491661 779124736 144670 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=760864 CPUtime=24.39 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 13823 0 0 0 2344 95 0 0 25 0 5 0 516491661 779124736 144670 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808862349 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=760864 CPUtime=24.4 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 43171 0 0 0 2431 9 0 0 25 0 5 0 516491661 779124736 144670 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=760864 CPUtime=24.39 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 17013 0 0 0 2350 89 0 0 25 0 5 0 516491661 779124736 144670 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 98.57
Current children cumulated vsize (KiB) 760864

[startup+51.1004 s]
/proc/loadavg: 6.09 4.80 5.47 9/186 2043
/proc/meminfo: memFree=16360744/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=1033732 CPUtime=200.82 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 211811 0 0 0 19675 407 0 0 25 0 5 0 516491552 1058541568 210068 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 258433 210068 176 36 0 256338 0
[pid=2026/tid=2038] ppid=2024 vsize=1033732 CPUtime=49.78 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 64490 0 0 0 4958 20 0 0 25 0 5 0 516491661 1058541568 210068 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808862193 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=1033732 CPUtime=50 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 18388 0 0 0 4813 187 0 0 25 0 5 0 516491661 1058541568 210068 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=1033732 CPUtime=49.92 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 67183 0 0 0 4978 14 0 0 25 0 5 0 516491661 1058541568 210068 33554432000 4194304 4338100 140734362091104 18446744073709551615 4206915 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=1033732 CPUtime=49.99 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 25879 0 0 0 4820 179 0 0 25 0 5 0 516491661 1058541568 210068 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 200.82
Current children cumulated vsize (KiB) 1033732

[startup+102.307 s]
/proc/loadavg: 7.32 5.37 5.63 9/186 2044
/proc/meminfo: memFree=15434192/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=1416784 CPUtime=405.32 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 290536 0 0 0 39759 773 0 0 25 0 5 0 516491552 1450786816 287513 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 354196 287513 176 36 0 352101 0
[pid=2026/tid=2038] ppid=2024 vsize=1416784 CPUtime=100.98 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 104137 0 0 0 10062 36 0 0 25 0 5 0 516491661 1450786816 287513 33554432000 4194304 4338100 140734362091104 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=1416784 CPUtime=101.1 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 19923 0 0 0 9755 355 0 0 25 0 5 0 516491661 1450786816 287513 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254124 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=1416784 CPUtime=100.93 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 101967 0 0 0 10070 23 0 0 25 0 5 0 516491661 1450786816 287513 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=1416784 CPUtime=101.18 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 28638 0 0 0 9765 353 0 0 25 0 5 0 516491661 1450786816 287513 33554432000 4194304 4338100 140734362091104 18446744073709551615 4253954 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 405.32
Current children cumulated vsize (KiB) 1416784

[startup+162.301 s]
/proc/loadavg: 7.74 5.81 5.76 9/186 2046
/proc/meminfo: memFree=14415380/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=1838504 CPUtime=644.95 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 391895 0 0 0 63340 1155 0 0 25 0 5 0 516491552 1882628096 388872 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 459626 388874 176 36 0 457531 0
[pid=2026/tid=2038] ppid=2024 vsize=1838504 CPUtime=160.95 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 148079 0 0 0 16040 55 0 0 25 0 5 0 516491661 1882628096 388874 33554432000 4194304 4338100 140734362091104 18446744073709551615 4240533 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=1838504 CPUtime=160.92 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 23687 0 0 0 15559 533 0 0 25 0 5 0 516491661 1882628096 388875 33554432000 4194304 4338100 140734362091104 18446744073709551615 4235770 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=1838504 CPUtime=160.92 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 152830 0 0 0 16055 37 0 0 25 0 5 0 516491661 1882628096 388876 33554432000 4194304 4338100 140734362091104 18446744073709551615 4240533 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=1838504 CPUtime=161.02 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 31430 0 0 0 15579 523 0 0 25 0 5 0 516491661 1882628096 388877 33554432000 4194304 4338100 140734362091104 18446744073709551615 4235756 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 644.95
Current children cumulated vsize (KiB) 1838504

[startup+222.301 s]
/proc/loadavg: 7.95 6.25 5.92 9/186 2047
/proc/meminfo: memFree=13506080/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=2045544 CPUtime=884.51 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 440874 0 0 0 86956 1495 0 0 25 0 5 0 516491552 2094637056 437851 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 511386 437851 176 36 0 509291 0
[pid=2026/tid=2038] ppid=2024 vsize=2045544 CPUtime=220.93 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 161449 0 0 0 22028 65 0 0 25 0 5 0 516491661 2094637056 437851 33554432000 4194304 4338100 140734362091104 18446744073709551615 4284123 0 0 4096 0 0 0 0 -1 5 0 0 0

################
# More data... #
################

/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 48588 0 0 0 68158 1779 0 0 25 0 5 0 516491661 4071538688 925892 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2801.47
Current children cumulated vsize (KiB) 3976112

[startup+762.306 s]
/proc/loadavg: 8.06 7.81 6.87 9/186 2071
/proc/meminfo: memFree=8318908/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=4255688 CPUtime=3041.01 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 964074 0 0 0 299979 4122 0 0 25 0 5 0 516491552 4357824512 961051 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 1063922 961051 176 36 0 1061827 0
[pid=2026/tid=2038] ppid=2024 vsize=4255688 CPUtime=760.66 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 480398 0 0 0 75861 205 0 0 25 0 5 0 516491661 4357824512 961051 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=4255688 CPUtime=759.25 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 43496 0 0 0 73993 1932 0 0 25 0 5 0 516491661 4357824512 961051 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=4255688 CPUtime=760.83 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 353179 0 0 0 75998 85 0 0 25 0 5 0 516491661 4357824512 961051 33554432000 4194304 4338100 140734362091104 18446744073709551615 4240540 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=4255688 CPUtime=759.14 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 51130 0 0 0 74020 1894 0 0 25 0 5 0 516491661 4357824512 961051 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3041.01
Current children cumulated vsize (KiB) 4255688

[startup+822.301 s]
/proc/loadavg: 8.08 7.85 6.94 9/186 2072
/proc/meminfo: memFree=7776600/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=4474648 CPUtime=3280.6 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 1021327 0 0 0 323667 4393 0 0 25 0 5 0 516491552 4582039552 1018304 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 1118662 1018304 176 36 0 1116567 0
[pid=2026/tid=2038] ppid=2024 vsize=4474648 CPUtime=820.3 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 514578 0 0 0 81810 220 0 0 25 0 5 0 516491661 4582039552 1018304 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=4474648 CPUtime=819.23 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 44628 0 0 0 79864 2059 0 0 25 0 5 0 516491661 4582039552 1018304 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=4474648 CPUtime=820.82 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 373182 0 0 0 81991 91 0 0 25 0 5 0 516491661 4582039552 1018304 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808560795 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=4474648 CPUtime=819.13 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 53068 0 0 0 79896 2017 0 0 25 0 5 0 516491661 4582039552 1018304 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3280.6
Current children cumulated vsize (KiB) 4474648

[startup+882.301 s]
/proc/loadavg: 7.93 7.85 7.00 9/186 2074
/proc/meminfo: memFree=7324344/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=4718632 CPUtime=3520.23 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 1082699 0 0 0 347383 4640 0 0 25 0 5 0 516491552 4831879168 1079676 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 1179658 1079676 176 36 0 1177563 0
[pid=2026/tid=2038] ppid=2024 vsize=4718632 CPUtime=880.3 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 556582 0 0 0 87792 238 0 0 25 0 5 0 516491661 4831879168 1079676 33554432000 4194304 4338100 140734362091104 18446744073709551615 4253954 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=4718632 CPUtime=878.89 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 44628 0 0 0 85715 2174 0 0 25 0 5 0 516491661 4831879168 1079676 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=4718632 CPUtime=880.81 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 392550 0 0 0 87984 97 0 0 25 0 5 0 516491661 4831879168 1079676 33554432000 4194304 4338100 140734362091104 18446744073709551615 230808561390 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=4718632 CPUtime=879.11 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 53068 0 0 0 85785 2126 0 0 25 0 5 0 516491661 4831879168 1079676 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3520.23
Current children cumulated vsize (KiB) 4718632

[startup+942.301 s]
/proc/loadavg: 8.12 7.90 7.06 10/187 2078
/proc/meminfo: memFree=6969108/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=4818728 CPUtime=3759.15 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 1113277 0 0 0 371050 4865 0 0 25 0 5 0 516491552 4934377472 1110254 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 1204682 1110254 176 36 0 1202587 0
[pid=2026/tid=2038] ppid=2024 vsize=4818728 CPUtime=940.09 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 574170 0 0 0 93761 248 0 0 25 0 5 0 516491661 4934377472 1110254 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=4818728 CPUtime=938.56 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 47678 0 0 0 91574 2282 0 0 25 0 5 0 516491661 4934377472 1110254 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=4818728 CPUtime=940.31 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 399481 0 0 0 93933 98 0 0 25 0 5 0 516491661 4934377472 1110254 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254404 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=4818728 CPUtime=939.07 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 56077 0 0 0 91676 2231 0 0 25 0 5 0 516491661 4934377472 1110254 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3759.15
Current children cumulated vsize (KiB) 4818728

[startup+1002.3 s]
/proc/loadavg: 8.08 7.94 7.13 9/186 2080
/proc/meminfo: memFree=6745384/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=4834500 CPUtime=3998.74 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 1131559 0 0 0 394699 5175 0 0 25 0 5 0 516491552 4950528000 1128536 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 1208625 1128536 176 36 0 1206530 0
[pid=2026/tid=2038] ppid=2024 vsize=4834500 CPUtime=999.8 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 578361 0 0 0 99725 255 0 0 25 0 5 0 516491661 4950528000 1128536 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=4834500 CPUtime=998.46 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 54543 0 0 0 97413 2433 0 0 25 0 5 0 516491661 4950528000 1128536 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=4834500 CPUtime=1000.3 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 400153 0 0 0 99932 98 0 0 25 0 5 0 516491661 4950528000 1128536 33554432000 4194304 4338100 140734362091104 18446744073709551615 4256087 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=4834500 CPUtime=999.06 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 62631 0 0 0 97523 2383 0 0 25 0 5 0 516491661 4950528000 1128536 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3998.74
Current children cumulated vsize (KiB) 4834500

[startup+1062.3 s]
/proc/loadavg: 8.12 7.97 7.19 9/186 2082
/proc/meminfo: memFree=6337024/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=4894064 CPUtime=4238.39 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 1150165 0 0 0 418391 5448 0 0 25 0 5 0 516491552 5011521536 1147142 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 1223516 1147142 176 36 0 1221421 0
[pid=2026/tid=2038] ppid=2024 vsize=4894064 CPUtime=1059.46 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 592638 0 0 0 105681 265 0 0 25 0 5 0 516491661 5011521536 1147142 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=4894064 CPUtime=1058.45 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 56894 0 0 0 103277 2568 0 0 25 0 5 0 516491661 5011521536 1147142 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=4894064 CPUtime=1060.29 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 400156 0 0 0 105931 98 0 0 25 0 5 0 516491661 5011521536 1147142 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=4894064 CPUtime=1059.06 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 64606 0 0 0 103396 2510 0 0 25 0 5 0 516491661 5011521536 1147142 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4238.39
Current children cumulated vsize (KiB) 4894064

[startup+1122.3 s]
/proc/loadavg: 8.08 7.99 7.24 9/186 2083
/proc/meminfo: memFree=5821656/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=5164256 CPUtime=4477.92 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 1186028 0 0 0 442070 5722 0 0 25 0 5 0 516491552 5288198144 1183005 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 1291064 1183005 176 36 0 1288969 0
[pid=2026/tid=2038] ppid=2024 vsize=5164256 CPUtime=1119.28 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 607088 0 0 0 111652 276 0 0 25 0 5 0 516491661 5288198144 1183005 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=5164256 CPUtime=1118.4 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 60358 0 0 0 109142 2698 0 0 25 0 5 0 516491661 5288198144 1183005 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=5164256 CPUtime=1120.07 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 413315 0 0 0 111905 102 0 0 25 0 5 0 516491661 5288198144 1183005 33554432000 4194304 4338100 140734362091104 18446744073709551615 4239191 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=5164256 CPUtime=1119.04 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 69396 0 0 0 109264 2640 0 0 25 0 5 0 516491661 5288198144 1183005 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820991669 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4477.92
Current children cumulated vsize (KiB) 5164256

[startup+1182.3 s]
/proc/loadavg: 8.05 8.00 7.29 9/186 2085
/proc/meminfo: memFree=5475004/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=5515776 CPUtime=4717.44 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) S 2024 2026 1994 0 -1 4202496 1237197 0 0 0 465760 5984 0 0 25 0 5 0 516491552 5648154624 1234174 33554432000 4194304 4338100 140734362091104 18446744073709551615 230820968421 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 1378944 1234174 176 36 0 1376849 0
[pid=2026/tid=2038] ppid=2024 vsize=5515776 CPUtime=1179.28 cores=1,3,5,7
/proc/2026/task/2038/stat : 2038 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 625913 0 0 0 117643 285 0 0 25 0 5 0 516491661 5648154624 1234174 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254462 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=5515776 CPUtime=1178.36 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 61980 0 0 0 115012 2824 0 0 25 0 5 0 516491661 5648154624 1234174 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=2026/tid=2040] ppid=2024 vsize=5515776 CPUtime=1179.91 cores=1,3,5,7
/proc/2026/task/2040/stat : 2040 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 441444 0 0 0 117882 109 0 0 25 0 5 0 516491661 5648154624 1234174 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=2026/tid=2041] ppid=2024 vsize=5515776 CPUtime=1178.77 cores=1,3,5,7
/proc/2026/task/2041/stat : 2041 (ttsth-5-4) R 2024 2026 1994 0 -1 4202560 71989 0 0 0 115117 2760 0 0 25 0 5 0 516491661 5648154624 1234174 33554432000 4194304 4338100 140734362091104 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4717.44
Current children cumulated vsize (KiB) 5515776



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203 s]
/proc/loadavg: 8.10 8.02 7.31 6/183 2085
/proc/meminfo: memFree=5865364/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=0 CPUtime=4800.05 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) Z 2024 2026 1994 0 -1 4203548 1254039 0 0 0 473922 6083 0 0 18 0 2 0 516491552 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 0 0 0 0 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=0 CPUtime=1199.06 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4203588 61980 0 0 0 117035 2871 0 0 25 0 2 0 516491661 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.05
Current children cumulated vsize (KiB) 0

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.11 s]
/proc/loadavg: 8.10 8.02 7.31 6/183 2085
/proc/meminfo: memFree=5865364/32951124 swapFree=67111528/67111528
[pid=2026] ppid=2024 vsize=0 CPUtime=4800.15 cores=1,3,5,7
/proc/2026/stat : 2026 (ttsth-5-4) Z 2024 2026 1994 0 -1 4203548 1254039 0 0 0 473922 6093 0 0 18 0 2 0 516491552 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/2026/statm: 0 0 0 0 0 0 0
[pid=2026/tid=2039] ppid=2024 vsize=0 CPUtime=1199.16 cores=1,3,5,7
/proc/2026/task/2039/stat : 2039 (ttsth-5-4) R 2024 2026 1994 0 -1 4203588 61980 0 0 0 117035 2881 0 0 25 0 2 0 516491661 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.15
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 1203.17
CPU time (s): 4800.22
CPU user time (s): 4739.22
CPU system time (s): 60.9967
CPU usage (%): 398.964
Max. virtual memory (cumulated for all children) (KiB): 5584592

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4739.22
system time used= 60.9967
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1254039
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5132
involuntary context switches= 33018

runsolver used 1.9767 second user time and 4.5953 second system time

The end

Launcher Data 

Begin job on node104 at 2011-04-29 05:48:31
IDJOB=3257998
IDBENCH=71294
IDSOLVER=1654
FILE ID=node104/3257998-1304048911
RUNJOBID= node104-1304048911-2013
PBS_JOBID= 13170409
Free space on /tmp= 71548 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v2100c215164g9.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3257998-1304048911/watcher-3257998-1304048911 -o /tmp/evaluation-result-3257998-1304048911/solver-3257998-1304048911 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3257998-1304048911.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e033e9c916da557514299cce9ca2468f
RANDOM SEED=1217715903

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18300696 kB
Buffers:       2195808 kB
Cached:       11798748 kB
SwapCached:          0 kB
Active:        2337068 kB
Inactive:     11725024 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18300696 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            2792 kB
Writeback:           0 kB
AnonPages:       67672 kB
Mapped:          14424 kB
Slab:           522708 kB
PageTables:       4456 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   193500 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71544 MiB
End job on node104 at 2011-04-29 06:08:36