Trace number 3262662

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.51 1201.98

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/
VanderWaerden3k/VanDerWaerden_2-3-12_135.cnf
MD5SUMf20ed0313cfa494f86b5c8ef723973ee
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark36.1265
Satisfiable
(Un)Satisfiability was proved
Number of variables135
Number of clauses5251
Sum of the clauses size22611
Maximum clause length12
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 34489
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5762

Solver Data 

0.00/0.00	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262662-1304093505.cnf 
0.00/0.00	c Using SATTIMEOUT of 4800
0.00/0.00	c Using SATRAM of 15500
0.00/0.00	c Size of subset node = 32
0.00/0.00	c Variables = 135
0.00/0.00	c Clauses = 5251
0.00/0.00	c Literals = 22611
0.00/0.00	c Reduced size:
0.00/0.00	c Variables = 135
0.00/0.00	c Clauses = 5251
0.00/0.00	c Literals = 22611
0.00/0.00	c a2
0.00/0.02	c a1
0.00/0.04	c Independent sub-problems = 1
0.00/0.04	c Sub-problem with 135 variables and 5251 clauses
0.00/0.04	c using permutation method 4
0.00/0.04	c count = 1
0.00/0.04	c Ordering finished 0.040 seconds
0.00/0.04	c mapped 0.040 seconds
0.00/0.04	c permuted 0.040 seconds
0.00/0.04	c about to sort
0.00/0.04	c sorted
0.00/0.05	c clauses now 5251
0.00/0.05	c init finished 0.040 seconds
0.00/0.05	c tree built 0.050 seconds
0.00/0.05	c 
0.00/0.05	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.00/0.05	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.00/0.05	c ................................ | ..........                    |                                  0.1         0.0             
0.00/0.05	c ................................ | ..........                  1 |                                  0.1        10.0             
0.00/0.05	c ................................ | ..........                  2 |                                  0.1        20.0             
0.00/0.05	c ................................ | ..........                  3 |                                  0.1        30.0             
0.00/0.05	c ................................ | ..........                  4 |                                  0.1        40.0             
0.00/0.05	c ................................ | ..........                  5 |                                  0.1        50.0             
0.00/0.56	c ................................ | ..........               1000 | 14           932                 0.1     10000.0        38251
96.08/24.14	c ................................ | ..........             486000 | 23837        539749             96.2      5049.4     22638230
191.97/48.18	c ................................ | ..........             728000 | 38680        820307            192.3      3786.3     32414583
288.22/72.25	c ................................ | ..........             928000 | 51767        1026594           288.4      3217.6     40439124
384.47/96.33	c ................................ | ..........            1099000 | 64156        1211848           384.6      2857.5     41222633
396.05/99.28	c *............................... | ..........            1115971 | 65376        1232949           396.4      2815.4     41498039
479.94/120.30	c *............................... | *.........            1291000 | 75451        1389441           480.3      2687.7     44957858
576.20/144.33	c *............................... | *.........            1462000 | 87043        1550329           576.4      2536.6     49638655
672.05/168.30	c *............................... | *.........            1613000 | 97742        1698579           672.1      2400.0     53474639
768.32/192.43	c *............................... | *.........            1758000 | 109941       1830934           768.4      2287.8     58062596
863.80/216.39	c *............................... | *.........            1886000 | 121705       1953276           864.2      2182.4     61885637
960.03/240.45	c *............................... | **........            2015000 | 131944       2073303           960.3      2098.4     62834432
1056.30/264.58	c *............................... | **........            2138000 | 142399       2181093          1056.6      2023.4     65028096
1152.55/288.64	c *............................... | **........            2245000 | 152636       2295266          1152.7      1947.6     68363975
1248.02/312.50	c *............................... | **........            2369000 | 160735       2399055          1248.0      1898.2     72420336
1344.28/336.63	c *............................... | **........            2486000 | 168382       2506496          1344.4      1849.2     75955998
1440.52/360.73	c *............................... | ***.......            2600000 | 176071       2614223          1440.7      1804.7     78294950
1536.41/384.73	c *............................... | ***.......            2701000 | 183968       2714750          1536.5      1757.9     81981763
1632.67/408.81	c *............................... | ***.......            2802000 | 191486       2811942          1632.7      1716.2     85644785
1728.93/432.90	c *............................... | ***.......            2903000 | 199384       2904507          1728.9      1679.1     88385116
1824.00/456.74	c *............................... | ***.......            3000000 | 206290       2995110          1824.2      1644.6     91491951
1920.28/480.86	c *............................... | ****......            3113000 | 214272       3094313          1920.5      1620.9     95108204
2015.74/504.76	c *............................... | ****......            3220000 | 223504       3196146          2016.0      1597.2     98949989
2112.40/528.90	c *............................... | ****......            3303000 | 229317       3283693          2112.4      1563.6    102304024
2207.87/552.90	c *............................... | ****......            3393000 | 235287       3371258          2208.3      1536.5    104962113
2304.14/576.92	c *............................... | ****......            3477000 | 241744       3447790          2304.2      1509.0    107399828
2400.01/600.98	c *............................... | *****.....            3564000 | 249704       3527213          2400.4      1484.8    110365332
2497.09/625.21	c *............................... | *****.....            3648000 | 257548       3601536          2497.1      1460.9    112716171
2591.76/648.96	c *............................... | *****.....            3736000 | 264988       3674532          2592.0      1441.4    115027321
2688.41/673.19	c *............................... | *****.....            3816000 | 271672       3751185          2688.8      1419.2    117359726
2784.27/697.12	c *............................... | *****.....            3896000 | 279390       3826868          2784.4      1399.2    117770134
2880.13/721.10	c *............................... | ******....            3979000 | 287338       3903145          2880.1      1381.5    118702440
2976.36/745.25	c *............................... | ******....            4057000 | 294892       3974790          2976.6      1363.0    118702440
3072.60/769.39	c *............................... | ******....            4135000 | 301636       4050606          3073.0      1345.6    118702440
3168.47/793.33	c *............................... | ******....            4208000 | 308348       4123636          3168.6      1328.0    119683704
3264.34/817.32	c *............................... | ******....            4278000 | 314716       4189732          3264.4      1310.5    121527853
3361.00/841.51	c *............................... | *******...            4347000 | 318782       4255881          3361.1      1293.3    122370351
3456.50/865.46	c *............................... | *******...            4419000 | 323579       4323042          3456.7      1278.4    123140535
3551.96/889.37	c *............................... | *******...            4500000 | 328811       4394735          3552.2      1266.8    124174635
3647.84/913.34	c *............................... | *******...            4578000 | 334645       4470247          3648.0      1254.9    126002185
3744.10/937.49	c *............................... | *******...            4658000 | 340963       4539517          3744.5      1244.0    127638043
3840.38/961.50	c *............................... | ********..            4732000 | 346397       4607586          3840.4      1232.2    128141863
3936.64/985.70	c *............................... | ********..            4803000 | 351708       4674774          3937.0      1220.0    129067605
4032.52/1009.62	c *............................... | ********..            4865000 | 356153       4732403          4032.6      1206.4    130216040
4128.81/1033.73	c *............................... | ********..            4937000 | 360878       4794285          4128.9      1195.7    130687077
4223.86/1057.59	c *............................... | ********..            5007000 | 365850       4856960          4224.2      1185.3    132255391
4320.55/1081.74	c *............................... | *********.            5074000 | 371089       4918710          4320.7      1174.3    133650887
4417.22/1105.94	c *............................... | *********.            5148000 | 376084       4985685          4417.4      1165.4    135356962
4513.10/1129.92	c *............................... | *********.            5220000 | 381750       5048966          4513.2      1156.6    137210587
4608.96/1153.93	c *............................... | *********.            5287000 | 387126       5112240          4609.1      1147.1    139466080
4704.03/1177.77	c *............................... | *********.            5347000 | 392088       5166976          4704.3      1136.6    141004948

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3262662-1304093505/watcher-3262662-1304093505 -o /tmp/evaluation-result-3262662-1304093505/solver-3262662-1304093505 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262662-1304093505.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.18 8.13 7.98 1/175 1888
/proc/meminfo: memFree=30923464/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=9112 CPUtime=0 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) R 1886 1888 1676 0 -1 4202496 362 0 0 0 0 0 0 0 22 0 1 0 501766459 9330688 304 33554432000 4194304 4338100 140733832913792 18446744073709551615 220815897285 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/1888/statm: 2278 305 146 36 0 183 0

[startup+0.242352 s]
/proc/loadavg: 8.18 8.13 7.98 1/175 1888
/proc/meminfo: memFree=30923464/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=258524 CPUtime=3.3 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 18867 0 0 0 327 3 0 0 22 0 5 0 501766459 264728576 18561 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 64631 18561 175 36 0 62536 0
Current children cumulated CPU time (s) 3.3
Current children cumulated vsize (KiB) 258524

[startup+0.971242 s]
/proc/loadavg: 8.18 8.13 7.98 1/175 1888
/proc/meminfo: memFree=30923464/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=268040 CPUtime=3.69 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 20738 0 0 0 366 3 0 0 22 0 5 0 501766459 274472960 20432 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 67010 20432 175 36 0 64915 0
Current children cumulated CPU time (s) 3.69
Current children cumulated vsize (KiB) 268040

[startup+1.07122 s]
/proc/loadavg: 8.18 8.13 7.98 1/175 1888
/proc/meminfo: memFree=30923464/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=274428 CPUtime=4.09 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 22660 0 0 0 406 3 0 0 22 0 5 0 501766459 281014272 22354 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 68607 22355 175 36 0 66512 0
Current children cumulated CPU time (s) 4.09
Current children cumulated vsize (KiB) 274428

[startup+1.17121 s]
/proc/loadavg: 8.18 8.13 7.98 1/175 1888
/proc/meminfo: memFree=30923464/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=280812 CPUtime=4.49 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 24523 0 0 0 446 3 0 0 22 0 5 0 501766459 287551488 24217 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 70203 24217 175 36 0 68108 0
Current children cumulated CPU time (s) 4.49
Current children cumulated vsize (KiB) 280812

[startup+1.50015 s]
/proc/loadavg: 8.18 8.13 7.98 1/175 1888
/proc/meminfo: memFree=30923464/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=299976 CPUtime=5.81 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 29601 0 0 0 577 4 0 0 22 0 5 0 501766459 307175424 29295 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 74994 29295 175 36 0 72899 0
Current children cumulated CPU time (s) 5.81
Current children cumulated vsize (KiB) 299976

[startup+3.10085 s]
/proc/loadavg: 8.09 8.11 7.98 9/186 1924
/proc/meminfo: memFree=30570416/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=385856 CPUtime=12.21 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 50098 0 0 0 1214 7 0 0 22 0 5 0 501766459 395116544 49792 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 96464 49792 175 36 0 94369 0
[pid=1888/tid=1890] ppid=1886 vsize=385856 CPUtime=3.03 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 10986 0 0 0 302 1 0 0 25 0 5 0 501766465 395116544 49792 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=385856 CPUtime=3.01 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 13093 0 0 0 300 1 0 0 25 0 5 0 501766465 395116544 49792 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=385856 CPUtime=3.03 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 10886 0 0 0 302 1 0 0 25 0 5 0 501766465 395116544 49792 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=385856 CPUtime=3.03 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 13015 0 0 0 302 1 0 0 25 0 5 0 501766465 395116544 49792 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828049190 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.21
Current children cumulated vsize (KiB) 385856

[startup+6.30626 s]
/proc/loadavg: 8.16 8.12 7.98 9/186 1924
/proc/meminfo: memFree=30299692/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=509540 CPUtime=25 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 81018 0 0 0 2488 12 0 0 22 0 5 0 501766459 521768960 80712 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 127385 80712 175 36 0 125290 0
[pid=1888/tid=1890] ppid=1886 vsize=509540 CPUtime=6.24 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 18192 0 0 0 622 2 0 0 25 0 5 0 501766465 521768960 80712 33554432000 4194304 4338100 140733832913792 18446744073709551615 4229577 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=509540 CPUtime=6.2 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 21185 0 0 0 618 2 0 0 25 0 5 0 501766465 521768960 80712 33554432000 4194304 4338100 140733832913792 18446744073709551615 220815631483 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=509540 CPUtime=6.23 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 18556 0 0 0 621 2 0 0 25 0 5 0 501766465 521768960 80712 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=509540 CPUtime=6.24 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 20967 0 0 0 620 4 0 0 25 0 5 0 501766465 521768960 80712 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254317 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25
Current children cumulated vsize (KiB) 509540

[startup+12.7011 s]
/proc/loadavg: 8.15 8.12 7.98 9/186 1924
/proc/meminfo: memFree=29951144/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=696940 CPUtime=50.54 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 127986 0 0 0 5032 22 0 0 22 0 5 0 501766459 713666560 127680 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 174235 127680 175 36 0 172140 0
[pid=1888/tid=1890] ppid=1886 vsize=696940 CPUtime=12.63 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 28419 0 0 0 1258 5 0 0 25 0 5 0 501766465 713666560 127680 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254437 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=696940 CPUtime=12.6 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 34629 0 0 0 1255 5 0 0 25 0 5 0 501766465 713666560 127680 33554432000 4194304 4338100 140733832913792 18446744073709551615 4286350 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=696940 CPUtime=12.63 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 29904 0 0 0 1258 5 0 0 25 0 5 0 501766465 713666560 127680 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254407 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=696940 CPUtime=12.6 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 32916 0 0 0 1254 6 0 0 25 0 5 0 501766465 713666560 127680 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.54
Current children cumulated vsize (KiB) 696940

[startup+25.5007 s]
/proc/loadavg: 8.13 8.11 7.98 9/186 1925
/proc/meminfo: memFree=29352120/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=946428 CPUtime=101.68 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 191776 0 0 0 10132 36 0 0 22 0 5 0 501766459 969142272 191470 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 236607 191470 176 36 0 234512 0
[pid=1888/tid=1890] ppid=1886 vsize=946428 CPUtime=25.41 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 42026 0 0 0 2534 7 0 0 25 0 5 0 501766465 969142272 191470 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=946428 CPUtime=25.4 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 52335 0 0 0 2531 9 0 0 25 0 5 0 501766465 969142272 191470 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=946428 CPUtime=25.43 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 44583 0 0 0 2534 9 0 0 25 0 5 0 501766465 969142272 191470 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=946428 CPUtime=25.34 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 50714 0 0 0 2525 9 0 0 25 0 5 0 501766465 969142272 191470 33554432000 4194304 4338100 140733832913792 18446744073709551615 4256763 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.68
Current children cumulated vsize (KiB) 946428

[startup+51.101 s]
/proc/loadavg: 8.08 8.10 7.98 9/186 1925
/proc/meminfo: memFree=28544580/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=1287240 CPUtime=203.93 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 275996 0 0 0 20334 59 0 0 22 0 5 0 501766459 1318133760 275682 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 321810 275682 176 36 0 319715 0
[pid=1888/tid=1890] ppid=1886 vsize=1287240 CPUtime=50.88 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 61356 0 0 0 5076 12 0 0 25 0 5 0 501766465 1318133760 275682 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=1287240 CPUtime=50.99 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 77212 0 0 0 5082 17 0 0 25 0 5 0 501766465 1318133760 275682 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=1287240 CPUtime=51.03 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 61161 0 0 0 5090 13 0 0 25 0 5 0 501766465 1318133760 275682 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=1287240 CPUtime=50.94 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 74149 0 0 0 5079 15 0 0 25 0 5 0 501766465 1318133760 275682 33554432000 4194304 4338100 140733832913792 18446744073709551615 4230411 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.93
Current children cumulated vsize (KiB) 1287240

[startup+102.301 s]
/proc/loadavg: 8.14 8.12 7.99 9/186 1927
/proc/meminfo: memFree=27542020/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=1614840 CPUtime=408.43 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 357667 0 0 0 40664 179 0 0 22 0 5 0 501766459 1653596160 357353 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 403710 357353 176 36 0 401615 0
[pid=1888/tid=1890] ppid=1886 vsize=1614840 CPUtime=101.79 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 77876 0 0 0 10116 63 0 0 25 0 5 0 501766465 1653596160 357353 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=1614840 CPUtime=102.19 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 99679 0 0 0 10195 24 0 0 25 0 5 0 501766465 1653596160 357353 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=1614840 CPUtime=102.22 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 77952 0 0 0 10154 68 0 0 25 0 5 0 501766465 1653596160 357353 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=1614840 CPUtime=102.14 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 100042 0 0 0 10192 22 0 0 25 0 5 0 501766465 1653596160 357353 33554432000 4194304 4338100 140733832913792 18446744073709551615 4256139 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.43
Current children cumulated vsize (KiB) 1614840

[startup+162.301 s]
/proc/loadavg: 8.15 8.12 8.00 9/186 1928
/proc/meminfo: memFree=26827124/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=1946140 CPUtime=648.09 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 442377 0 0 0 64367 442 0 0 22 0 5 0 501766459 1992847360 442063 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 486535 442063 176 36 0 484440 0
[pid=1888/tid=1890] ppid=1886 vsize=1946140 CPUtime=161.47 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 84624 0 0 0 15962 185 0 0 25 0 5 0 501766465 1992847360 442063 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254213 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=1946140 CPUtime=162.19 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 131663 0 0 0 16185 34 0 0 25 0 5 0 501766465 1992847360 442063 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=1946140 CPUtime=162.22 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 86688 0 0 0 16035 187 0 0 25 0 5 0 501766465 1992847360 442063 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=1946140 CPUtime=162.12 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 137284 0 0 0 16178 34 0 0 25 0 5 0 501766465 1992847360 442063 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 648.09
Current children cumulated vsize (KiB) 1946140

[startup+222.3 s]
/proc/loadavg: 8.14 8.13 8.01 9/186 1930
/proc/meminfo: memFree=25992680/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=2256864 CPUtime=887.74 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 521479 0 0 0 88104 670 0 0 22 0 5 0 501766459 2311028736 521165 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 564216 521165 176 36 0 562121 0
[pid=1888/tid=1890] ppid=1886 vsize=2256864 CPUtime=221.13 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 97856 0 0 0 21820 293 0 0 25 0 5 0 501766465 2311028736 521165 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 7 0 0 0

################
# More data... #
################

/proc/meminfo: memFree=21185240/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=4077600 CPUtime=3044.63 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 984467 0 0 0 302335 2128 0 0 22 0 5 0 501766459 4175462400 984153 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 1019400 984153 176 36 0 1017305 0
[pid=1888/tid=1890] ppid=1886 vsize=4077600 CPUtime=758.17 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 162597 0 0 0 74836 981 0 0 25 0 5 0 501766465 4175462400 984153 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=4077600 CPUtime=762.16 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 320866 0 0 0 76131 85 0 0 25 0 5 0 501766465 4175462400 984153 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=4077600 CPUtime=762.15 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 165548 0 0 0 75245 970 0 0 25 0 5 0 501766465 4175462400 984153 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=4077600 CPUtime=762.07 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 333338 0 0 0 76116 91 0 0 25 0 5 0 501766465 4175462400 984153 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3044.63
Current children cumulated vsize (KiB) 4077600

[startup+822.301 s]
/proc/loadavg: 8.44 8.19 8.05 9/186 1949
/proc/meminfo: memFree=20780892/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=4179516 CPUtime=3284.32 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 1010696 0 0 0 326189 2243 0 0 22 0 5 0 501766459 4279824384 1010382 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 1044879 1010382 176 36 0 1042784 0
[pid=1888/tid=1890] ppid=1886 vsize=4179516 CPUtime=818.16 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 162930 0 0 0 80784 1032 0 0 25 0 5 0 501766465 4279824384 1010382 33554432000 4194304 4338100 140733832913792 18446744073709551615 4255963 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=4179516 CPUtime=822.16 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 337586 0 0 0 82125 91 0 0 25 0 5 0 501766465 4279824384 1010382 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=4179516 CPUtime=821.83 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 165857 0 0 0 81159 1024 0 0 25 0 5 0 501766465 4279824384 1010382 33554432000 4194304 4338100 140733832913792 18446744073709551615 4240537 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=4179516 CPUtime=822.08 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 342205 0 0 0 82114 94 0 0 25 0 5 0 501766465 4279824384 1010382 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3284.32
Current children cumulated vsize (KiB) 4179516

[startup+882.301 s]
/proc/loadavg: 8.21 8.17 8.05 9/186 1950
/proc/meminfo: memFree=20439464/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=4241300 CPUtime=3523.99 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 1028550 0 0 0 350031 2368 0 0 22 0 5 0 501766459 4343091200 1028236 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 1060325 1028236 176 36 0 1058230 0
[pid=1888/tid=1890] ppid=1886 vsize=4241300 CPUtime=878.17 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 163719 0 0 0 86727 1090 0 0 25 0 5 0 501766465 4343091200 1028236 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=4241300 CPUtime=882.06 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 348750 0 0 0 88110 96 0 0 25 0 5 0 501766465 4343091200 1028236 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=4241300 CPUtime=881.78 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 166163 0 0 0 87093 1085 0 0 25 0 5 0 501766465 4343091200 1028236 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=4241300 CPUtime=881.91 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 347800 0 0 0 88095 96 0 0 25 0 5 0 501766465 4343091200 1028236 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254291 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3523.99
Current children cumulated vsize (KiB) 4241300

[startup+942.301 s]
/proc/loadavg: 8.12 8.15 8.05 9/186 1952
/proc/meminfo: memFree=20109844/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=4375020 CPUtime=3763.69 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 1061777 0 0 0 373874 2495 0 0 22 0 5 0 501766459 4480020480 1061463 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 1093755 1061463 176 36 0 1091660 0
[pid=1888/tid=1890] ppid=1886 vsize=4375020 CPUtime=938.16 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 164084 0 0 0 92668 1148 0 0 25 0 5 0 501766465 4480020480 1061463 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828062389 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=4375020 CPUtime=942.06 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 366530 0 0 0 94104 102 0 0 25 0 5 0 501766465 4480020480 1061463 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=4375020 CPUtime=941.78 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 166519 0 0 0 93037 1141 0 0 25 0 5 0 501766465 4480020480 1061463 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828062389 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=4375020 CPUtime=941.6 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 362526 0 0 0 94058 102 0 0 25 0 5 0 501766465 4480020480 1061463 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3763.69
Current children cumulated vsize (KiB) 4375020

[startup+1002.3 s]
/proc/loadavg: 8.04 8.12 8.04 9/186 1954
/proc/meminfo: memFree=19996960/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=4442660 CPUtime=4003.36 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 1080062 0 0 0 397725 2611 0 0 22 0 5 0 501766459 4549283840 1079748 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 1110665 1079748 176 36 0 1108570 0
[pid=1888/tid=1890] ppid=1886 vsize=4442660 CPUtime=998.17 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 164402 0 0 0 98614 1203 0 0 25 0 5 0 501766465 4549283840 1079748 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=4442660 CPUtime=1002.06 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 377624 0 0 0 100100 106 0 0 25 0 5 0 501766465 4549283840 1079748 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=4442660 CPUtime=1001.78 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 166839 0 0 0 98981 1197 0 0 25 0 5 0 501766465 4549283840 1079748 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828062389 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=4442660 CPUtime=1001.27 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 369079 0 0 0 100023 104 0 0 25 0 5 0 501766465 4549283840 1079748 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4003.36
Current children cumulated vsize (KiB) 4442660

[startup+1062.31 s]
/proc/loadavg: 8.01 8.09 8.04 9/186 1955
/proc/meminfo: memFree=19789728/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=4516560 CPUtime=4243.06 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 1099521 0 0 0 421584 2722 0 0 22 0 5 0 501766459 4624957440 1099207 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 1129140 1099207 176 36 0 1127045 0
[pid=1888/tid=1890] ppid=1886 vsize=4516560 CPUtime=1058.17 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 164727 0 0 0 104560 1257 0 0 25 0 5 0 501766465 4624957440 1099207 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828062389 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=4516560 CPUtime=1062.06 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 384668 0 0 0 106097 109 0 0 25 0 5 0 501766465 4624957440 1099207 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=4516560 CPUtime=1061.78 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 167135 0 0 0 104932 1246 0 0 25 0 5 0 501766465 4624957440 1099207 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=4516560 CPUtime=1060.96 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 380873 0 0 0 105988 108 0 0 25 0 5 0 501766465 4624957440 1099207 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4243.06
Current children cumulated vsize (KiB) 4516560

[startup+1122.3 s]
/proc/loadavg: 8.06 8.09 8.04 9/186 1957
/proc/meminfo: memFree=19446340/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=4640624 CPUtime=4482.73 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 1132382 0 0 0 445428 2845 0 0 22 0 5 0 501766459 4751998976 1132068 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 1160156 1132068 176 36 0 1158061 0
[pid=1888/tid=1890] ppid=1886 vsize=4640624 CPUtime=1118.17 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 165630 0 0 0 110503 1314 0 0 25 0 5 0 501766465 4751998976 1132068 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=4640624 CPUtime=1122.06 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 397818 0 0 0 112092 114 0 0 25 0 5 0 501766465 4751998976 1132068 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=4640624 CPUtime=1121.78 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 171224 0 0 0 110876 1302 0 0 25 0 5 0 501766465 4751998976 1132068 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=4640624 CPUtime=1120.64 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 395592 0 0 0 111951 113 0 0 25 0 5 0 501766465 4751998976 1132068 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4482.73
Current children cumulated vsize (KiB) 4640624

[startup+1182.3 s]
/proc/loadavg: 8.18 8.12 8.05 9/186 1958
/proc/meminfo: memFree=19250240/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=4786716 CPUtime=4722.39 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 1169187 0 0 0 469285 2954 0 0 22 0 5 0 501766459 4901597184 1168873 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 1196679 1168873 176 36 0 1194584 0
[pid=1888/tid=1890] ppid=1886 vsize=4786716 CPUtime=1178.16 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 171481 0 0 0 116452 1364 0 0 25 0 5 0 501766465 4901597184 1168873 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828062389 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=4786716 CPUtime=1182.06 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 411125 0 0 0 118088 118 0 0 25 0 5 0 501766465 4901597184 1168873 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=4786716 CPUtime=1181.78 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 177032 0 0 0 116825 1353 0 0 25 0 5 0 501766465 4901597184 1168873 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828062389 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=4786716 CPUtime=1180.32 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 407431 0 0 0 117914 118 0 0 25 0 5 0 501766465 4901597184 1168873 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4722.39
Current children cumulated vsize (KiB) 4786716



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.13 8.11 8.05 9/186 1959
/proc/meminfo: memFree=19248000/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=4787372 CPUtime=4800.31 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) S 1886 1888 1676 0 -1 4202496 1169581 0 0 0 477044 2987 0 0 22 0 5 0 501766459 4902268928 1169267 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 1196843 1169267 176 36 0 1194748 0
[pid=1888/tid=1890] ppid=1886 vsize=4787372 CPUtime=1197.67 cores=1,3,5,7
/proc/1888/task/1890/stat : 1890 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 171579 0 0 0 118387 1380 0 0 25 0 5 0 501766465 4902268928 1169267 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1888/tid=1891] ppid=1886 vsize=4787372 CPUtime=1201.56 cores=1,3,5,7
/proc/1888/task/1891/stat : 1891 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 411213 0 0 0 120038 118 0 0 25 0 5 0 501766465 4902268928 1169267 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1888/tid=1892] ppid=1886 vsize=4787372 CPUtime=1201.29 cores=1,3,5,7
/proc/1888/task/1892/stat : 1892 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 177135 0 0 0 118760 1369 0 0 25 0 5 0 501766465 4902268928 1169267 33554432000 4194304 4338100 140733832913792 18446744073709551615 220828062389 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=4787372 CPUtime=1199.72 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4202560 407536 0 0 0 119854 118 0 0 25 0 5 0 501766465 4902268928 1169267 33554432000 4194304 4338100 140733832913792 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.31
Current children cumulated vsize (KiB) 4787372

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.91 s]
/proc/loadavg: 8.13 8.11 8.05 6/184 1960
/proc/meminfo: memFree=22002300/32951124 swapFree=67105204/67111528
[pid=1888] ppid=1886 vsize=0 CPUtime=4800.44 cores=1,3,5,7
/proc/1888/stat : 1888 (ttsth-5-4) Z 1886 1888 1676 0 -1 4203548 1169581 0 0 0 477047 2997 0 0 18 0 2 0 501766459 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/1888/statm: 0 0 0 0 0 0 0
[pid=1888/tid=1893] ppid=1886 vsize=0 CPUtime=1199.82 cores=1,3,5,7
/proc/1888/task/1893/stat : 1893 (ttsth-5-4) R 1886 1888 1676 0 -1 4203588 407536 0 0 0 119854 128 0 0 25 0 2 0 501766465 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.44
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.98
CPU time (s): 4800.51
CPU user time (s): 4770.47
CPU system time (s): 30.0354
CPU usage (%): 399.384
Max. virtual memory (cumulated for all children) (KiB): 4787372

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4770.47
system time used= 30.0354
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1169581
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3266
involuntary context switches= 29719

runsolver used 1.86772 second user time and 4.63429 second system time

The end

Launcher Data 

Begin job on node147 at 2011-04-29 18:11:46
IDJOB=3262662
IDBENCH=83361
IDSOLVER=1654
FILE ID=node147/3262662-1304093505
RUNJOBID= node147-1304091097-1695
PBS_JOBID= 13170578
Free space on /tmp= 72660 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden3k/VanDerWaerden_2-3-12_135.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3262662-1304093505/watcher-3262662-1304093505 -o /tmp/evaluation-result-3262662-1304093505/solver-3262662-1304093505 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262662-1304093505.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f20ed0313cfa494f86b5c8ef723973ee
RANDOM SEED=1067384555

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30923860 kB
Buffers:        275048 kB
Cached:        1365444 kB
SwapCached:       2968 kB
Active:         127980 kB
Inactive:      1575376 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30923860 kB
SwapTotal:    67111528 kB
SwapFree:     67105204 kB
Dirty:              16 kB
Writeback:           0 kB
AnonPages:       60828 kB
Mapped:          15008 kB
Slab:           260392 kB
PageTables:       4676 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   219188 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72660 MiB
End job on node147 at 2011-04-29 18:31:49