Trace number 3262618

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.38 1202.06

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-14_186.cnf
MD5SUM642fce7e30a701c3223fa5771c2e57dc
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables186
Number of clauses9795
Sum of the clauses size43014
Maximum clause length14
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 38556
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51239

Solver Data 

0.00/0.01	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262618-1304093319.cnf 
0.00/0.01	c Using SATTIMEOUT of 4800
0.00/0.01	c Using SATRAM of 15500
0.00/0.01	c Size of subset node = 32
0.00/0.01	c Variables = 186
0.00/0.01	c Clauses = 9795
0.00/0.01	c Literals = 43014
0.00/0.01	c Reduced size:
0.00/0.01	c Variables = 186
0.00/0.01	c Clauses = 9795
0.00/0.01	c Literals = 43014
0.00/0.01	c a2
0.00/0.05	c a1
0.09/0.10	c Independent sub-problems = 1
0.09/0.10	c Sub-problem with 186 variables and 9795 clauses
0.09/0.10	c using permutation method 4
0.09/0.10	c count = 1
0.09/0.10	c Ordering finished 0.090 seconds
0.09/0.10	c mapped 0.100 seconds
0.09/0.10	c permuted 0.100 seconds
0.09/0.10	c about to sort
0.09/0.10	c sorted
0.09/0.13	c clauses now 9795
0.09/0.13	c init finished 0.100 seconds
0.09/0.13	c tree built 0.130 seconds
0.09/0.13	c 
0.09/0.13	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.09/0.13	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.09/0.13	c ................................ | ..........                    |                                  0.1         0.0             
0.09/0.13	c ................................ | ..........                  1 |                                  0.1         7.7             
0.09/0.13	c ................................ | ..........                  2 |                                  0.1        15.4             
0.09/0.13	c ................................ | ..........                  3 |                                  0.1        23.1             
0.09/0.13	c ................................ | ..........                  4 |                                  0.1        30.8             
0.09/0.13	c ................................ | ..........                  5 |                                  0.1        38.5             
0.09/0.15	c ................................ | ..........               1000 | 20           594                 0.2      5555.6        30306
95.85/24.18	c ................................ | ..........             481000 | 42194        323077             96.2      5002.6     20829693
192.51/48.31	c ................................ | ..........             721000 | 66786        486057            192.5      3744.9     31777397
288.35/72.31	c ................................ | ..........             889000 | 84362        605767            288.4      3082.4     39846402
384.21/96.35	c ................................ | ..........            1046000 | 100208       704940            384.4      2720.9     46388137
480.49/120.40	c ................................ | *.........            1193000 | 115638       796187            480.5      2482.9     52451128
575.96/144.40	c ................................ | *.........            1347000 | 131298       877348            576.4      2337.1     57659221
672.22/168.48	c ................................ | *.........            1480000 | 145797       951945            672.5      2200.6     62588418
768.11/192.49	c ................................ | *.........            1603000 | 156988       1023346           768.5      2086.0     64101900
863.95/216.43	c ................................ | *.........            1713000 | 167171       1086522           864.1      1982.5     68384465
960.61/240.66	c ................................ | **........            1815000 | 178270       1152362           960.9      1888.9     71826574
1056.47/264.65	c ................................ | **........            1913000 | 188924       1214427          1056.7      1810.4     74856102
1152.34/288.62	c ................................ | **........            2007000 | 199161       1271111          1152.4      1741.5     78280537
1247.80/312.58	c ................................ | **........            2093000 | 209383       1323245          1248.2      1676.9     81435906
1344.09/336.61	c ................................ | **........            2180000 | 219946       1376093          1344.1      1621.9     85056898
1439.95/360.65	c ................................ | ***.......            2268000 | 230459       1426026          1440.2      1574.8     88595221
1536.21/384.75	c ................................ | ***.......            2347000 | 239459       1474104          1536.4      1527.6     91968795
1631.68/408.68	c ................................ | ***.......            2413000 | 245629       1519552          1632.0      1478.5     95128294
1727.95/432.73	c ................................ | ***.......            2483000 | 252740       1567026          1728.1      1436.9     98245155
1824.22/456.82	c ................................ | ***.......            2555000 | 260700       1610351          1824.3      1400.5    101549502
1920.48/480.98	c ................................ | ****......            2623000 | 268840       1653478          1920.8      1365.6    105009688
2017.55/505.20	c ................................ | ****......            2692000 | 275848       1697067          2017.5      1334.3    108005004
2112.22/528.95	c ................................ | ****......            2764000 | 283504       1742402          2112.4      1308.5    111015175
2208.10/552.96	c ................................ | ****......            2840000 | 291032       1785271          2208.3      1286.0    114090894
2303.96/576.91	c ................................ | ****......            2918000 | 298767       1821301          2304.0      1266.5    116901265
2399.83/600.98	c ................................ | *****.....            2993000 | 306106       1864221          2400.2      1247.0    119906233
2496.50/625.11	c ................................ | *****.....            3074000 | 313361       1908151          2496.5      1231.3    122800980
2592.76/649.29	c ................................ | *****.....            3148000 | 320226       1947529          2593.1      1214.0    125495343
2688.65/673.24	c ................................ | *****.....            3222000 | 327142       1990094          2688.8      1198.3    128466501
2784.09/697.18	c ................................ | *****.....            3299000 | 335150       2029713          2784.4      1184.8    131204460
2879.96/721.16	c ................................ | ******....            3376000 | 342848       2066471          2880.2      1172.1    133640458
2975.84/745.16	c ................................ | ******....            3445000 | 349568       2105569          2976.1      1157.6    136469517
3072.10/769.23	c ................................ | ******....            3519000 | 356325       2142000          3072.2      1145.4    139184797
3168.77/793.44	c ................................ | ******....            3591000 | 363720       2177576          3169.0      1133.2    141753646
3264.64/817.42	c ................................ | ******....            3662000 | 370493       2216010          3264.7      1121.7    143097440
3360.11/841.37	c ................................ | *******...            3725000 | 376968       2252862          3360.4      1108.5    144505227
3456.78/865.50	c ................................ | *******...            3788000 | 383634       2291019          3456.8      1095.8    146877936
3552.23/889.47	c ................................ | *******...            3853000 | 390764       2326040          3552.5      1084.6    149653079
3648.91/913.61	c ................................ | *******...            3924000 | 399446       2361119          3649.0      1075.4    152361600
3743.97/937.48	c ................................ | *******...            3995000 | 406737       2397371          3744.3      1067.0    154978245
3841.04/961.72	c ................................ | ********..            4061000 | 413261       2436768          3841.2      1057.2    157500266
3936.90/985.70	c ................................ | ********..            4126000 | 420000       2473142          3936.9      1048.0    159169732
4032.35/1009.64	c ................................ | ********..            4187000 | 426309       2508047          4032.5      1038.3    161461546
4129.42/1033.99	c ................................ | ********..            4242000 | 431752       2543952          4129.8      1027.2    163602440
4224.07/1057.69	c ................................ | ********..            4293000 | 437018       2579027          4224.5      1016.2    164022520
4320.34/1081.74	c ................................ | *********.            4353000 | 443199       2614813          4320.5      1007.5    165445216
4416.21/1105.78	c ................................ | *********.            4420000 | 449793       2650683          4416.6      1000.8    167432843
4512.87/1129.93	c ................................ | *********.            4479000 | 455711       2682520          4513.0       992.5    169942409
4607.95/1153.73	c ................................ | *********.            4541000 | 462006       2717785          4608.1       985.4    172490580
4704.22/1177.86	c ................................ | *********.            4594000 | 467421       2753501          4704.5       976.5    174280621

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3262618-1304093319/watcher-3262618-1304093319 -o /tmp/evaluation-result-3262618-1304093319/solver-3262618-1304093319 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262618-1304093319.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.06 8.02 7.64 2/174 21297
/proc/meminfo: memFree=30885368/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=9408 CPUtime=0 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) R 21295 21297 20765 0 -1 4202496 431 0 0 0 0 0 0 0 25 0 1 0 599562486 9633792 373 33554432000 4194304 4338100 140733898505760 18446744073709551615 260020056773 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21297/statm: 2352 374 146 36 0 257 0

[startup+0.095548 s]
/proc/loadavg: 8.06 8.02 7.64 2/174 21297
/proc/meminfo: memFree=30885368/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=14756 CPUtime=0.09 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) R 21295 21297 20765 0 -1 4202496 1551 0 0 0 9 0 0 0 25 0 1 0 599562486 15110144 1484 33554432000 4194304 4338100 140733898505760 18446744073709551615 4295924 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21297/statm: 3689 1484 190 36 0 1594 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 14756

[startup+0.100548 s]
/proc/loadavg: 8.06 8.02 7.64 2/174 21297
/proc/meminfo: memFree=30885368/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=14756 CPUtime=0.09 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) R 21295 21297 20765 0 -1 4202496 1551 0 0 0 9 0 0 0 25 0 1 0 599562486 15110144 1484 33554432000 4194304 4338100 140733898505760 18446744073709551615 4295940 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/21297/statm: 3689 1484 190 36 0 1594 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 14756

[startup+0.300444 s]
/proc/loadavg: 8.06 8.02 7.64 2/174 21297
/proc/meminfo: memFree=30885368/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=148256 CPUtime=0.76 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 7783 0 0 0 76 0 0 0 25 0 5 0 599562486 151814144 7051 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 37064 7051 175 36 0 34969 0
Current children cumulated CPU time (s) 0.76
Current children cumulated vsize (KiB) 148256

[startup+0.700369 s]
/proc/loadavg: 8.06 8.02 7.64 2/174 21297
/proc/meminfo: memFree=30885368/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=177200 CPUtime=2.36 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 14899 0 0 0 235 1 0 0 25 0 5 0 599562486 181452800 14167 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 44300 14168 175 36 0 42205 0
Current children cumulated CPU time (s) 2.36
Current children cumulated vsize (KiB) 177200

[startup+1.50119 s]
/proc/loadavg: 8.06 8.02 7.64 9/186 21312
/proc/meminfo: memFree=30747884/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=224912 CPUtime=5.56 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 26561 0 0 0 553 3 0 0 25 0 5 0 599562486 230309888 25829 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 56228 25829 175 36 0 54133 0
[pid=21297/tid=21305] ppid=21295 vsize=224912 CPUtime=1.35 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 5846 0 0 0 134 1 0 0 19 0 5 0 599562500 230309888 25829 33554432000 4194304 4338100 140733898505760 18446744073709551615 4263499 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=224912 CPUtime=1.35 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 5072 0 0 0 135 0 0 0 19 0 5 0 599562500 230309888 25830 33554432000 4194304 4338100 140733898505760 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=224912 CPUtime=1.34 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 6037 0 0 0 134 0 0 0 19 0 5 0 599562500 230309888 25830 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=224912 CPUtime=1.34 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 5478 0 0 0 134 0 0 0 25 0 5 0 599562500 230309888 25830 33554432000 4194304 4338100 140733898505760 18446744073709551615 4256403 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.56
Current children cumulated vsize (KiB) 224912

[startup+3.1009 s]
/proc/loadavg: 8.06 8.02 7.64 9/186 21312
/proc/meminfo: memFree=30636408/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=294652 CPUtime=11.95 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 44886 0 0 0 1189 6 0 0 25 0 5 0 599562486 301723648 44154 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 73663 44154 175 36 0 71568 0
[pid=21297/tid=21305] ppid=21295 vsize=294652 CPUtime=2.95 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 10417 0 0 0 293 2 0 0 24 0 5 0 599562500 301723648 44154 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=294652 CPUtime=2.95 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 9500 0 0 0 294 1 0 0 24 0 5 0 599562500 301723648 44154 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032210179 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=294652 CPUtime=2.95 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 11043 0 0 0 294 1 0 0 24 0 5 0 599562500 301723648 44154 33554432000 4194304 4338100 140733898505760 18446744073709551615 4284160 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=294652 CPUtime=2.93 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 9797 0 0 0 292 1 0 0 25 0 5 0 599562500 301723648 44154 33554432000 4194304 4338100 140733898505760 18446744073709551615 4239500 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.95
Current children cumulated vsize (KiB) 294652

[startup+6.30031 s]
/proc/loadavg: 8.06 8.02 7.64 9/186 21312
/proc/meminfo: memFree=30366800/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=408712 CPUtime=24.73 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 73526 0 0 0 2462 11 0 0 25 0 5 0 599562486 418521088 72794 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 102178 72794 175 36 0 100083 0
[pid=21297/tid=21305] ppid=21295 vsize=408712 CPUtime=6.15 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 18325 0 0 0 612 3 0 0 25 0 5 0 599562500 418521088 72794 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254304 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=408712 CPUtime=6.16 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 16536 0 0 0 614 2 0 0 25 0 5 0 599562500 418521088 72794 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=408712 CPUtime=6.15 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 18096 0 0 0 613 2 0 0 25 0 5 0 599562500 418521088 72794 33554432000 4194304 4338100 140733898505760 18446744073709551615 4287310 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=408712 CPUtime=6.12 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 16440 0 0 0 610 2 0 0 25 0 5 0 599562500 418521088 72794 33554432000 4194304 4338100 140733898505760 18446744073709551615 4239484 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.73
Current children cumulated vsize (KiB) 408712

[startup+12.7011 s]
/proc/loadavg: 8.05 8.02 7.64 9/186 21312
/proc/meminfo: memFree=29966448/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=572952 CPUtime=50.3 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 114656 0 0 0 5012 18 0 0 25 0 5 0 599562486 586702848 113924 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 143238 113924 175 36 0 141143 0
[pid=21297/tid=21305] ppid=21295 vsize=572952 CPUtime=12.55 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 27749 0 0 0 1249 6 0 0 25 0 5 0 599562500 586702848 113924 33554432000 4194304 4338100 140733898505760 18446744073709551615 4230463 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=572952 CPUtime=12.55 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 27297 0 0 0 1252 3 0 0 25 0 5 0 599562500 586702848 113924 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032208599 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=572952 CPUtime=12.54 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 29157 0 0 0 1251 3 0 0 25 0 5 0 599562500 586702848 113924 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=572952 CPUtime=12.48 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 26324 0 0 0 1244 4 0 0 25 0 5 0 599562500 586702848 113924 33554432000 4194304 4338100 140733898505760 18446744073709551615 4253954 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.3
Current children cumulated vsize (KiB) 572952

[startup+25.5008 s]
/proc/loadavg: 8.04 8.02 7.65 9/186 21312
/proc/meminfo: memFree=29335172/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=822440 CPUtime=101.42 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 176866 0 0 0 10111 31 0 0 25 0 5 0 599562486 842178560 176134 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 205610 176134 175 36 0 203515 0
[pid=21297/tid=21305] ppid=21295 vsize=822440 CPUtime=25.35 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 42503 0 0 0 2526 9 0 0 25 0 5 0 599562500 842178560 176134 33554432000 4194304 4338100 140733898505760 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=822440 CPUtime=25.35 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 42998 0 0 0 2528 7 0 0 25 0 5 0 599562500 842178560 176134 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254384 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=822440 CPUtime=25.35 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 46207 0 0 0 2528 7 0 0 25 0 5 0 599562500 842178560 176134 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=822440 CPUtime=25.21 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 41029 0 0 0 2514 7 0 0 25 0 5 0 599562500 842178560 176134 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.42
Current children cumulated vsize (KiB) 822440

[startup+51.1011 s]
/proc/loadavg: 8.08 8.03 7.66 9/186 21313
/proc/meminfo: memFree=28387376/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=1244640 CPUtime=203.68 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 266064 0 0 0 20316 52 0 0 25 0 5 0 599562486 1274511360 265332 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 311160 265332 175 36 0 309065 0
[pid=21297/tid=21305] ppid=21295 vsize=1244640 CPUtime=50.96 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 64005 0 0 0 5081 15 0 0 25 0 5 0 599562500 1274511360 265332 33554432000 4194304 4338100 140733898505760 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=1244640 CPUtime=50.94 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 67803 0 0 0 5082 12 0 0 25 0 5 0 599562500 1274511360 265332 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=1244640 CPUtime=50.95 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 69109 0 0 0 5083 12 0 0 25 0 5 0 599562500 1274511360 265332 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=1244640 CPUtime=50.68 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 61018 0 0 0 5056 12 0 0 25 0 5 0 599562500 1274511360 265332 33554432000 4194304 4338100 140733898505760 18446744073709551615 4286124 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.68
Current children cumulated vsize (KiB) 1244640

[startup+102.307 s]
/proc/loadavg: 8.10 8.04 7.68 9/186 21314
/proc/meminfo: memFree=26994676/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=1727504 CPUtime=408.2 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 387881 0 0 0 40739 81 0 0 25 0 5 0 599562486 1768964096 387149 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 431876 387149 176 36 0 429781 0
[pid=21297/tid=21305] ppid=21295 vsize=1727504 CPUtime=102.16 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 91225 0 0 0 10193 23 0 0 25 0 5 0 599562500 1768964096 387149 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=1727504 CPUtime=102.09 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 100871 0 0 0 10190 19 0 0 25 0 5 0 599562500 1768964096 387149 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=1727504 CPUtime=102.15 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 103295 0 0 0 10195 20 0 0 25 0 5 0 599562500 1768964096 387149 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=1727504 CPUtime=101.64 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 88361 0 0 0 10146 18 0 0 25 0 5 0 599562500 1768964096 387149 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.2
Current children cumulated vsize (KiB) 1727504

[startup+162.301 s]
/proc/loadavg: 8.10 8.05 7.70 9/186 21316
/proc/meminfo: memFree=25676360/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=2174656 CPUtime=647.85 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 500056 0 0 0 64673 112 0 0 25 0 5 0 599562486 2226847744 499324 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 543664 499324 176 36 0 541569 0
[pid=21297/tid=21305] ppid=21295 vsize=2174656 CPUtime=162.15 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 123133 0 0 0 16183 32 0 0 25 0 5 0 599562500 2226847744 499324 33554432000 4194304 4338100 140733898505760 18446744073709551615 4256403 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=2174656 CPUtime=162.08 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 127841 0 0 0 16182 26 0 0 25 0 5 0 599562500 2226847744 499324 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=2174656 CPUtime=162.15 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 132210 0 0 0 16186 29 0 0 25 0 5 0 599562500 2226847744 499324 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254384 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=2174656 CPUtime=161.31 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 112743 0 0 0 16108 23 0 0 25 0 5 0 599562500 2226847744 499324 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 647.85
Current children cumulated vsize (KiB) 2174656


################
# More data... #
################

/proc/meminfo: memFree=17311396/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=4626636 CPUtime=3044.56 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 1115822 0 0 0 304175 281 0 0 25 0 5 0 599562486 4737675264 1115090 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 1156659 1115090 176 36 0 1154564 0
[pid=21297/tid=21305] ppid=21295 vsize=4626636 CPUtime=762.17 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 287454 0 0 0 76135 82 0 0 25 0 5 0 599562500 4737675264 1115090 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=4626636 CPUtime=758.99 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 280409 0 0 0 75834 65 0 0 25 0 5 0 599562500 4737675264 1115090 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=4626636 CPUtime=762.15 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 270796 0 0 0 76149 66 0 0 25 0 5 0 599562500 4737675264 1115090 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=4626636 CPUtime=761.08 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 273034 0 0 0 76042 66 0 0 25 0 5 0 599562500 4737675264 1115090 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3044.56
Current children cumulated vsize (KiB) 4626636

[startup+822.301 s]
/proc/loadavg: 8.23 8.13 7.90 9/186 21334
/proc/meminfo: memFree=16698516/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=4777968 CPUtime=3284.21 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 1153496 0 0 0 328129 292 0 0 25 0 5 0 599562486 4892639232 1152764 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 1194492 1152764 176 36 0 1192397 0
[pid=21297/tid=21305] ppid=21295 vsize=4777968 CPUtime=822.16 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 297437 0 0 0 82131 85 0 0 25 0 5 0 599562500 4892639232 1152764 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=4777968 CPUtime=818.66 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 291030 0 0 0 81797 69 0 0 25 0 5 0 599562500 4892639232 1152764 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254304 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=4777968 CPUtime=822.15 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 279800 0 0 0 82147 68 0 0 25 0 5 0 599562500 4892639232 1152764 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254418 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=4777968 CPUtime=821.08 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 281100 0 0 0 82039 69 0 0 25 0 5 0 599562500 4892639232 1152764 33554432000 4194304 4338100 140733898505760 18446744073709551615 4239498 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3284.21
Current children cumulated vsize (KiB) 4777968

[startup+882.301 s]
/proc/loadavg: 8.22 8.13 7.91 9/186 21335
/proc/meminfo: memFree=16022912/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=4957320 CPUtime=3523.87 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 1198641 0 0 0 352082 305 0 0 25 0 5 0 599562486 5076295680 1197909 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 1239330 1197909 176 36 0 1237235 0
[pid=21297/tid=21305] ppid=21295 vsize=4957320 CPUtime=882.13 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 308427 0 0 0 88123 90 0 0 25 0 5 0 599562500 5076295680 1197909 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=4957320 CPUtime=878.36 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 303375 0 0 0 87764 72 0 0 25 0 5 0 599562500 5076295680 1197909 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=4957320 CPUtime=882.15 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 294544 0 0 0 88144 71 0 0 25 0 5 0 599562500 5076295680 1197909 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=4957320 CPUtime=881.08 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 288166 0 0 0 88037 71 0 0 25 0 5 0 599562500 5076295680 1197909 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3523.87
Current children cumulated vsize (KiB) 4957320

[startup+942.301 s]
/proc/loadavg: 8.20 8.14 7.92 9/186 21337
/proc/meminfo: memFree=15369000/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=5161828 CPUtime=3763.55 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 1250852 0 0 0 376034 321 0 0 25 0 5 0 599562486 5285711872 1250120 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 1290457 1250120 176 36 0 1288362 0
[pid=21297/tid=21305] ppid=21295 vsize=5161828 CPUtime=941.8 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 323136 0 0 0 94086 94 0 0 25 0 5 0 599562500 5285711872 1250120 33554432000 4194304 4338100 140733898505760 18446744073709551615 4256007 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=5161828 CPUtime=938.36 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 315276 0 0 0 93761 75 0 0 25 0 5 0 599562500 5285711872 1250120 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=5161828 CPUtime=942.15 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 307532 0 0 0 94140 75 0 0 25 0 5 0 599562500 5285711872 1250120 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=5161828 CPUtime=941.07 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 300779 0 0 0 94033 74 0 0 25 0 5 0 599562500 5285711872 1250120 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3763.55
Current children cumulated vsize (KiB) 5161828

[startup+1002.3 s]
/proc/loadavg: 8.19 8.14 7.94 9/186 21338
/proc/meminfo: memFree=14752040/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=5332192 CPUtime=4003.19 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 1292965 0 0 0 399985 334 0 0 25 0 5 0 599562486 5460164608 1292233 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 1333048 1292233 176 36 0 1330953 0
[pid=21297/tid=21305] ppid=21295 vsize=5332192 CPUtime=1001.56 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 332906 0 0 0 100060 96 0 0 25 0 5 0 599562500 5460164608 1292233 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=5332192 CPUtime=998.36 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 326035 0 0 0 99756 80 0 0 25 0 5 0 599562500 5460164608 1292233 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=5332192 CPUtime=1002.14 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 317296 0 0 0 100136 78 0 0 25 0 5 0 599562500 5460164608 1292233 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=5332192 CPUtime=1000.97 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 312599 0 0 0 100019 78 0 0 25 0 5 0 599562500 5460164608 1292233 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254231 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4003.19
Current children cumulated vsize (KiB) 5332192

[startup+1062.3 s]
/proc/loadavg: 8.12 8.13 7.94 9/186 21340
/proc/meminfo: memFree=14267636/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=5442596 CPUtime=4242.84 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 1320852 0 0 0 423942 342 0 0 25 0 5 0 599562486 5573218304 1320120 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 1360649 1320120 176 36 0 1358554 0
[pid=21297/tid=21305] ppid=21295 vsize=5442596 CPUtime=1061.55 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 341600 0 0 0 106057 98 0 0 25 0 5 0 599562500 5573218304 1320120 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=5442596 CPUtime=1058.34 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 332070 0 0 0 105752 82 0 0 25 0 5 0 599562500 5573218304 1320120 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=5442596 CPUtime=1062.15 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 323932 0 0 0 106134 81 0 0 25 0 5 0 599562500 5573218304 1320120 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254231 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=5442596 CPUtime=1060.64 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 319121 0 0 0 105984 80 0 0 25 0 5 0 599562500 5573218304 1320120 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254244 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4242.84
Current children cumulated vsize (KiB) 5442596

[startup+1122.3 s]
/proc/loadavg: 8.04 8.10 7.94 9/186 21342
/proc/meminfo: memFree=13716668/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=5593928 CPUtime=4482.51 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 1359918 0 0 0 447898 353 0 0 25 0 5 0 599562486 5728182272 1359186 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 1398482 1359186 176 36 0 1396387 0
[pid=21297/tid=21305] ppid=21295 vsize=5593928 CPUtime=1121.54 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 354652 0 0 0 112053 101 0 0 25 0 5 0 599562500 5728182272 1359186 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=5593928 CPUtime=1118.34 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 338527 0 0 0 111750 84 0 0 25 0 5 0 599562500 5728182272 1359186 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=5593928 CPUtime=1122.14 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 331703 0 0 0 112131 83 0 0 25 0 5 0 599562500 5728182272 1359186 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=5593928 CPUtime=1120.31 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 330907 0 0 0 111948 83 0 0 25 0 5 0 599562500 5728182272 1359186 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254404 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4482.51
Current children cumulated vsize (KiB) 5593928

[startup+1182.3 s]
/proc/loadavg: 8.01 8.08 7.94 9/186 21343
/proc/meminfo: memFree=13137764/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=5766020 CPUtime=4722.2 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 1402499 0 0 0 471852 368 0 0 25 0 5 0 599562486 5904404480 1401767 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 1441505 1401767 176 36 0 1439410 0
[pid=21297/tid=21305] ppid=21295 vsize=5766020 CPUtime=1181.55 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 366209 0 0 0 118049 106 0 0 25 0 5 0 599562500 5904404480 1401767 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=5766020 CPUtime=1178.34 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 350374 0 0 0 117746 88 0 0 25 0 5 0 599562500 5904404480 1401767 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=5766020 CPUtime=1182.14 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 340632 0 0 0 118129 85 0 0 25 0 5 0 599562500 5904404480 1401767 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=5766020 CPUtime=1180 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 341155 0 0 0 117913 87 0 0 25 0 5 0 599562500 5904404480 1401767 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4722.2
Current children cumulated vsize (KiB) 5766020



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.01 8.08 7.94 9/186 21344
/proc/meminfo: memFree=12989436/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=5772540 CPUtime=4800.1 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) S 21295 21297 20765 0 -1 4202496 1404663 0 0 0 479642 368 0 0 25 0 5 0 599562486 5911080960 1403931 33554432000 4194304 4338100 140733898505760 18446744073709551615 260032198629 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 1443135 1403931 176 36 0 1441040 0
[pid=21297/tid=21305] ppid=21295 vsize=5772540 CPUtime=1201.05 cores=0,2,4,6
/proc/21297/task/21305/stat : 21305 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 366260 0 0 0 119999 106 0 0 25 0 5 0 599562500 5911080960 1403931 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=21297/tid=21306] ppid=21295 vsize=5772540 CPUtime=1197.85 cores=0,2,4,6
/proc/21297/task/21306/stat : 21306 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 350424 0 0 0 119697 88 0 0 25 0 5 0 599562500 5911080960 1403931 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=21297/tid=21307] ppid=21295 vsize=5772540 CPUtime=1201.65 cores=0,2,4,6
/proc/21297/task/21307/stat : 21307 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 341674 0 0 0 120079 86 0 0 25 0 5 0 599562500 5911080960 1403931 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=5772540 CPUtime=1199.39 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4202560 342176 0 0 0 119852 87 0 0 25 0 5 0 599562500 5911080960 1403931 33554432000 4194304 4338100 140733898505760 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.1
Current children cumulated vsize (KiB) 5772540

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202 s]
/proc/loadavg: 8.01 8.08 7.94 9/186 21344
/proc/meminfo: memFree=12989436/32951124 swapFree=67111464/67111528
[pid=21297] ppid=21295 vsize=0 CPUtime=4800.31 cores=0,2,4,6
/proc/21297/stat : 21297 (ttsth-5-4) Z 21295 21297 20765 0 -1 4203548 1404663 0 0 0 479644 387 0 0 18 0 2 0 599562486 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/21297/statm: 0 0 0 0 0 0 0
[pid=21297/tid=21308] ppid=21295 vsize=0 CPUtime=1199.59 cores=0,2,4,6
/proc/21297/task/21308/stat : 21308 (ttsth-5-4) R 21295 21297 20765 0 -1 4203588 342176 0 0 0 119853 106 0 0 25 0 2 0 599562500 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.31
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.06
CPU time (s): 4800.38
CPU user time (s): 4796.45
CPU system time (s): 3.9314
CPU usage (%): 399.347
Max. virtual memory (cumulated for all children) (KiB): 5772540

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.45
system time used= 3.9314
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1404663
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1457
involuntary context switches= 19768

runsolver used 2.01669 second user time and 4.54831 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-29 18:08:39
IDJOB=3262618
IDBENCH=83356
IDSOLVER=1654
FILE ID=node110/3262618-1304093319
RUNJOBID= node110-1304092115-21178
PBS_JOBID= 13170568
Free space on /tmp= 72840 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-14_186.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3262618-1304093319/watcher-3262618-1304093319 -o /tmp/evaluation-result-3262618-1304093319/solver-3262618-1304093319 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262618-1304093319.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 642fce7e30a701c3223fa5771c2e57dc
RANDOM SEED=1626281637

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30886144 kB
Buffers:        900156 kB
Cached:         692492 kB
SwapCached:         64 kB
Active:         120056 kB
Inactive:      1539796 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30886144 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:             412 kB
Writeback:           0 kB
AnonPages:       67600 kB
Mapped:          14684 kB
Slab:           341772 kB
PageTables:       5044 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   192992 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72840 MiB
End job on node110 at 2011-04-29 18:28:43