Trace number 3262442

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.62 1202.41

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-22_445.cnf
MD5SUM4f7ff14ba0d33c4cf7de4e3c004f2f79
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark899.169
Satisfiable
(Un)Satisfiability was proved
Number of variables223
Number of clauses26441
Sum of the clauses size116565
Maximum clause length22
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2296
Number of clauses of size 324153
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51992

Solver Data 

0.00/0.03	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262442-1304092302.cnf 
0.00/0.03	c Using SATTIMEOUT of 4800
0.00/0.03	c Using SATRAM of 15500
0.00/0.03	c Size of subset node = 32
0.00/0.03	c Variables = 223
0.00/0.03	c Clauses = 26441
0.00/0.03	c Literals = 116565
0.00/0.03	c Reduced size:
0.00/0.03	c Variables = 223
0.00/0.03	c Clauses = 26441
0.00/0.03	c Literals = 116565
0.00/0.03	c a2
0.09/0.17	c a1
0.39/0.41	c Independent sub-problems = 1
0.39/0.41	c Sub-problem with 223 variables and 26441 clauses
0.39/0.41	c using permutation method 4
0.39/0.41	c count = 1
0.39/0.41	c Ordering finished 0.400 seconds
0.39/0.41	c mapped 0.410 seconds
0.39/0.41	c permuted 0.410 seconds
0.39/0.41	c about to sort
0.39/0.42	c sorted
0.49/0.50	c clauses now 26441
0.49/0.50	c init finished 0.420 seconds
0.49/0.50	c tree built 0.500 seconds
0.49/0.50	c 
0.49/0.50	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.49/0.50	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.49/0.50	c ................................ | ..........                    |                                  0.5         0.0             
0.49/0.50	c ................................ | ..........                  1 |                                  0.5         2.0             
0.49/0.50	c ................................ | ..........                  2 |                                  0.5         4.0             
0.49/0.50	c ................................ | ..........                  3 |                                  0.5         6.0             
0.49/0.50	c ................................ | ..........                  4 |                                  0.5         8.0             
0.49/0.50	c ................................ | ..........                  5 |                                  0.5        10.0             
3.68/1.31	c ................................ | ..........               1000 | 15           468                 0.6      1666.7        35193
95.96/24.42	c ................................ | ..........             318000 | 38685        141705             96.0      3310.8     21311319
192.21/48.60	c ................................ | ..........             484000 | 60456        223975            192.6      2513.1     32683375
288.07/72.53	c ................................ | ..........             615000 | 78499        288493            288.2      2134.0     43524773
384.33/96.65	c ................................ | ..........             731000 | 97550        347831            384.5      1901.0     53386313
480.61/120.72	c ................................ | *.........             837000 | 113617       396243            480.7      1741.2     61720446
576.07/144.63	c ................................ | *.........             937000 | 128575       434619            576.2      1626.1     69012396
672.75/168.85	c ................................ | *.........            1024000 | 143314       473720            672.9      1521.7     75871707
768.60/192.80	c ................................ | *.........            1104000 | 156224       510431            768.6      1436.4     82288404
864.07/216.72	c ................................ | *.........            1174000 | 169015       538543            864.2      1358.5     88231694
960.75/240.96	c ................................ | **........            1246000 | 181081       567206            961.0      1296.6     94067785
1056.61/264.91	c ................................ | **........            1323000 | 192007       596802           1056.7      1252.0    100330409
1153.28/289.19	c ................................ | **........            1394000 | 202206       625719           1153.7      1208.3    105819472
1247.94/312.83	c ................................ | **........            1460000 | 211277       651500           1248.1      1169.8    110309046
1345.01/337.19	c ................................ | **........            1530000 | 219932       680414           1345.4      1137.2    115594514
1441.28/361.25	c ................................ | ***.......            1581000 | 228790       704219           1441.5      1096.8    120601759
1536.35/385.02	c ................................ | ***.......            1632000 | 236490       728953           1536.4      1062.2    125239215
1632.22/409.06	c ................................ | ***.......            1681000 | 243469       751791           1632.5      1029.7    130008738
1729.29/433.33	c ................................ | ***.......            1732000 | 251939       773278           1729.4      1001.5    134918534
1824.36/457.16	c ................................ | ***.......            1778000 | 260206       793534           1824.6       974.4    138416870
1920.63/481.21	c ................................ | ****......            1821000 | 266199       816023           1920.7       948.1    142342599
2016.90/505.39	c ................................ | ****......            1866000 | 272781       835681           2017.3       925.0    146637778
2111.97/529.19	c ................................ | ****......            1907000 | 280658       855004           2112.3       902.8    150706252
2209.46/553.59	c ................................ | ****......            1954000 | 287645       873768           2209.8       884.2    154684969
2304.49/577.32	c ................................ | ****......            2002000 | 295656       890624           2304.6       868.7    156267563
2400.75/601.42	c ................................ | *****.....            2046000 | 302451       910478           2400.8       852.2    158112634
2497.82/625.75	c ................................ | *****.....            2090000 | 308389       928894           2498.0       836.7    160653156
2594.09/649.81	c ................................ | *****.....            2126000 | 313331       947889           2594.1       819.5    164251887
2689.16/673.60	c ................................ | *****.....            2167000 | 319682       967134           2689.2       805.8    167926547
2783.83/697.37	c ................................ | *****.....            2202000 | 326768       984028           2784.1       790.9    171427477
2881.30/721.71	c ................................ | ******....            2239000 | 332810       1002056          2881.3       777.1    174813707
2976.37/745.55	c ................................ | ******....            2271000 | 338191       1019371          2976.6       763.0    178032011
3072.63/769.63	c ................................ | ******....            2310000 | 344142       1040491          3072.8       751.8    181317588
3170.50/794.19	c ................................ | ******....            2346000 | 350161       1056358          3170.9       739.9    185141671
3263.99/817.55	c ................................ | ******....            2379000 | 355593       1071574          3264.2       728.8    187812890
3359.85/841.55	c ................................ | *******...            2412000 | 360522       1089158          3360.1       717.8    189268776
3456.11/865.60	c ................................ | *******...            2446000 | 364814       1104106          3456.1       707.7    191871812
3552.38/889.70	c ................................ | *******...            2480000 | 369063       1119989          3552.4       698.1    194878077
3650.67/914.31	c ................................ | *******...            2515000 | 374720       1135588          3650.7       688.9    198002864
3745.31/938.00	c ................................ | *******...            2550000 | 379919       1149683          3745.3       680.9    201422307
3839.98/961.75	c ................................ | ********..            2585000 | 384778       1164133          3840.2       673.1    204149040
3937.05/986.07	c ................................ | ********..            2625000 | 392003       1181039          3937.3       666.7    206309808
4033.32/1010.15	c ................................ | ********..            2659000 | 398238       1196567          4033.5       659.2    209349689
4127.99/1033.89	c ................................ | ********..            2693000 | 404344       1209394          4128.4       652.3    212908337
4224.25/1057.95	c ................................ | ********..            2722000 | 409740       1222279          4224.5       644.3    216456815
4320.13/1081.93	c ................................ | *********.            2758000 | 414583       1238163          4320.2       638.4    219846180
4417.59/1106.38	c ................................ | *********.            2800000 | 418985       1253392          4417.9       633.8    223220551
4511.89/1129.95	c ................................ | *********.            2830000 | 423350       1266189          4512.1       627.2    226412411
4608.93/1154.24	c ................................ | *********.            2863000 | 428797       1279720          4609.1       621.2    229598050
4704.82/1178.24	c ................................ | *********.            2896000 | 433624       1294097          4705.0       615.5    232788285

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3262442-1304092302/watcher-3262442-1304092302 -o /tmp/evaluation-result-3262442-1304092302/solver-3262442-1304092302 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262442-1304092302.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.43 7.89 7.71 3/177 1810
/proc/meminfo: memFree=30920148/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=8980 CPUtime=0 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) R 1808 1810 1676 0 -1 4202496 330 0 0 0 0 0 0 0 25 0 1 0 501646061 9195520 273 33554432000 4194304 4338100 140733763289840 18446744073709551615 220815897285 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/1810/statm: 2245 273 146 36 0 150 0

[startup+0.096414 s]
/proc/loadavg: 7.43 7.89 7.71 3/177 1810
/proc/meminfo: memFree=30920148/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=26764 CPUtime=0.09 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) R 1808 1810 1676 0 -1 4202496 3986 0 0 0 9 0 0 0 25 0 1 0 501646061 27406336 3797 33554432000 4194304 4338100 140733763289840 18446744073709551615 4206993 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/1810/statm: 6691 3797 339 36 0 4596 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26764

[startup+0.100423 s]
/proc/loadavg: 7.43 7.89 7.71 3/177 1810
/proc/meminfo: memFree=30920148/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=26764 CPUtime=0.09 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) R 1808 1810 1676 0 -1 4202496 3989 0 0 0 9 0 0 0 25 0 1 0 501646061 27406336 3797 33554432000 4194304 4338100 140733763289840 18446744073709551615 4206980 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/1810/statm: 6691 3797 337 36 0 4596 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26764

[startup+0.300307 s]
/proc/loadavg: 7.43 7.89 7.71 3/177 1810
/proc/meminfo: memFree=30920148/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=14912 CPUtime=0.29 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) R 1808 1810 1676 0 -1 4202496 4400 0 0 0 29 0 0 0 25 0 1 0 501646061 15269888 1765 33554432000 4194304 4338100 140733763289840 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/1810/statm: 3728 1765 155 36 0 1633 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 14912

[startup+0.86091 s]
/proc/loadavg: 7.43 7.89 7.71 3/177 1810
/proc/meminfo: memFree=30920148/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=230560 CPUtime=1.9 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 14678 0 0 0 188 2 0 0 25 0 5 0 501646061 236093440 11926 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 57640 11926 176 36 0 55545 0
Current children cumulated CPU time (s) 1.9
Current children cumulated vsize (KiB) 230560

[startup+1.50106 s]
/proc/loadavg: 7.43 7.89 7.71 11/186 1819
/proc/meminfo: memFree=30765032/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=268492 CPUtime=4.46 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 23701 0 0 0 444 2 0 0 25 0 5 0 501646061 274935808 20950 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 67123 20951 176 36 0 65028 0
[pid=1810/tid=1816] ppid=1808 vsize=268492 CPUtime=0.98 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 2188 0 0 0 98 0 0 0 19 0 5 0 501646112 274935808 20953 33554432000 4194304 4338100 140733763289840 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=268492 CPUtime=0.98 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 3902 0 0 0 98 0 0 0 25 0 5 0 501646112 274935808 20953 33554432000 4194304 4338100 140733763289840 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=268492 CPUtime=0.98 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 3886 0 0 0 98 0 0 0 19 0 5 0 501646112 274935808 20954 33554432000 4194304 4338100 140733763289840 18446744073709551615 220815631603 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=268492 CPUtime=0.98 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 4303 0 0 0 98 0 0 0 19 0 5 0 501646112 274935808 20954 33554432000 4194304 4338100 140733763289840 18446744073709551615 220815631841 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.46
Current children cumulated vsize (KiB) 268492

[startup+3.10076 s]
/proc/loadavg: 7.43 7.89 7.71 9/186 1819
/proc/meminfo: memFree=30644876/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=341096 CPUtime=10.86 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 41957 0 0 0 1080 6 0 0 25 0 5 0 501646061 349282304 39205 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 85274 39207 176 36 0 83179 0
[pid=1810/tid=1816] ppid=1808 vsize=341096 CPUtime=2.58 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 5033 0 0 0 258 0 0 0 23 0 5 0 501646112 349282304 39207 33554432000 4194304 4338100 140733763289840 18446744073709551615 4256989 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=341096 CPUtime=2.58 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 9090 0 0 0 257 1 0 0 25 0 5 0 501646112 349282304 39207 33554432000 4194304 4338100 140733763289840 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=341096 CPUtime=2.57 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 8810 0 0 0 256 1 0 0 22 0 5 0 501646112 349282304 39208 33554432000 4194304 4338100 140733763289840 18446744073709551615 4239484 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=341096 CPUtime=2.58 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 9601 0 0 0 257 1 0 0 22 0 5 0 501646112 349282304 39208 33554432000 4194304 4338100 140733763289840 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 10.86
Current children cumulated vsize (KiB) 341096

[startup+6.30117 s]
/proc/loadavg: 7.56 7.91 7.72 9/186 1819
/proc/meminfo: memFree=30364340/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=463748 CPUtime=23.64 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 73056 0 0 0 2353 11 0 0 25 0 5 0 501646061 474877952 70304 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 115937 70305 176 36 0 113842 0
[pid=1810/tid=1816] ppid=1808 vsize=463748 CPUtime=5.78 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 10388 0 0 0 577 1 0 0 25 0 5 0 501646112 474877952 70305 33554432000 4194304 4338100 140733763289840 18446744073709551615 4256139 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=463748 CPUtime=5.78 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 16980 0 0 0 576 2 0 0 25 0 5 0 501646112 474877952 70305 33554432000 4194304 4338100 140733763289840 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=463748 CPUtime=5.75 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 16575 0 0 0 573 2 0 0 25 0 5 0 501646112 474877952 70305 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254294 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=463748 CPUtime=5.78 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 19688 0 0 0 575 3 0 0 25 0 5 0 501646112 474877952 70305 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 23.64
Current children cumulated vsize (KiB) 463748

[startup+12.701 s]
/proc/loadavg: 7.59 7.91 7.72 9/186 1819
/proc/meminfo: memFree=29957896/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=645964 CPUtime=49.2 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 117584 0 0 0 4901 19 0 0 25 0 5 0 501646061 661467136 114832 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 161491 114832 176 36 0 159396 0
[pid=1810/tid=1816] ppid=1808 vsize=645964 CPUtime=12.16 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 16005 0 0 0 1214 2 0 0 25 0 5 0 501646112 661467136 114832 33554432000 4194304 4338100 140733763289840 18446744073709551615 4239504 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=645964 CPUtime=12.18 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 29137 0 0 0 1213 5 0 0 25 0 5 0 501646112 661467136 114832 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=645964 CPUtime=12.14 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 28899 0 0 0 1210 4 0 0 25 0 5 0 501646112 661467136 114832 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828050587 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=645964 CPUtime=12.18 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 34117 0 0 0 1213 5 0 0 25 0 5 0 501646112 661467136 114832 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828062389 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 49.2
Current children cumulated vsize (KiB) 645964

[startup+25.5066 s]
/proc/loadavg: 7.76 7.93 7.73 9/186 1819
/proc/meminfo: memFree=29380560/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=906896 CPUtime=100.35 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 183018 0 0 0 10002 33 0 0 25 0 5 0 501646061 928661504 180266 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 226724 180266 176 36 0 224629 0
[pid=1810/tid=1816] ppid=1808 vsize=906896 CPUtime=24.89 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 25424 0 0 0 2485 4 0 0 25 0 5 0 501646112 928661504 180266 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=906896 CPUtime=24.99 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 44434 0 0 0 2490 9 0 0 25 0 5 0 501646112 928661504 180266 33554432000 4194304 4338100 140733763289840 18446744073709551615 4284198 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=906896 CPUtime=24.95 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 46570 0 0 0 2488 7 0 0 25 0 5 0 501646112 928661504 180266 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254462 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=906896 CPUtime=24.99 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 57164 0 0 0 2489 10 0 0 25 0 5 0 501646112 928661504 180266 33554432000 4194304 4338100 140733763289840 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 100.35
Current children cumulated vsize (KiB) 906896

[startup+51.1009 s]
/proc/loadavg: 7.84 7.94 7.73 9/186 1820
/proc/meminfo: memFree=28563724/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=1286836 CPUtime=202.59 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 278911 0 0 0 20207 52 0 0 25 0 5 0 501646061 1317720064 276159 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 321709 276159 176 36 0 319614 0
[pid=1810/tid=1816] ppid=1808 vsize=1286836 CPUtime=50.35 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 40895 0 0 0 5027 8 0 0 25 0 5 0 501646112 1317720064 276159 33554432000 4194304 4338100 140733763289840 18446744073709551615 4256416 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=1286836 CPUtime=50.58 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 69268 0 0 0 5043 15 0 0 25 0 5 0 501646112 1317720064 276159 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=1286836 CPUtime=50.54 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 75191 0 0 0 5042 12 0 0 25 0 5 0 501646112 1317720064 276159 33554432000 4194304 4338100 140733763289840 18446744073709551615 4256288 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=1286836 CPUtime=50.59 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 84131 0 0 0 5044 15 0 0 25 0 5 0 501646112 1317720064 276159 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 202.59
Current children cumulated vsize (KiB) 1286836

[startup+102.3 s]
/proc/loadavg: 7.99 7.96 7.75 9/186 1821
/proc/meminfo: memFree=27287136/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=1970632 CPUtime=407.11 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 450223 0 0 0 40625 86 0 0 25 0 5 0 501646061 2017927168 447471 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 492658 447471 176 36 0 490563 0
[pid=1810/tid=1816] ppid=1808 vsize=1970632 CPUtime=101.27 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 67174 0 0 0 10113 14 0 0 25 0 5 0 501646112 2017927168 447472 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254329 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=1970632 CPUtime=101.77 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 131527 0 0 0 10150 27 0 0 25 0 5 0 501646112 2017927168 447472 33554432000 4194304 4338100 140733763289840 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=1970632 CPUtime=101.74 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 112242 0 0 0 10156 18 0 0 25 0 5 0 501646112 2017927168 447473 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=1970632 CPUtime=101.78 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 129855 0 0 0 10154 24 0 0 25 0 5 0 501646112 2017927168 447473 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.11
Current children cumulated vsize (KiB) 1970632

[startup+162.3 s]
/proc/loadavg: 8.11 8.00 7.77 9/186 1823
/proc/meminfo: memFree=26147056/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=2561804 CPUtime=646.78 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 597030 0 0 0 64561 117 0 0 25 0 5 0 501646061 2623287296 594278 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 640451 594278 176 36 0 638356 0
[pid=1810/tid=1816] ppid=1808 vsize=2561804 CPUtime=160.95 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 91209 0 0 0 16075 20 0 0 25 0 5 0 501646112 2623287296 594278 33554432000 4194304 4338100 140733763289840 18446744073709551615 4256989 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=2561804 CPUtime=161.78 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 176368 0 0 0 16141 37 0 0 25 0 5 0 501646112 2623287296 594278 33554432000 4194304 4338100 140733763289840 18446744073709551615 4256013 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=2561804 CPUtime=161.74 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 139899 0 0 0 16149 25 0 0 25 0 5 0 501646112 2623287296 594278 33554432000 4194304 4338100 140733763289840 18446744073709551615 4284177 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=2561804 CPUtime=161.78 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 180128 0 0 0 16145 33 0 0 25 0 5 0 501646112 2623287296 594278 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 646.78
Current children cumulated vsize (KiB) 2561804


################
# More data... #
################

/proc/meminfo: memFree=19680144/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=5930284 CPUtime=3043.47 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 1438280 0 0 0 304062 285 0 0 25 0 5 0 501646061 6072610816 1435528 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 1482571 1435528 176 36 0 1480476 0
[pid=1810/tid=1816] ppid=1808 vsize=5930284 CPUtime=760.5 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 207668 0 0 0 76004 46 0 0 25 0 5 0 501646112 6072610816 1435528 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=5930284 CPUtime=761.64 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 454193 0 0 0 76074 90 0 0 25 0 5 0 501646112 6072610816 1435528 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=5930284 CPUtime=759.07 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 304904 0 0 0 75847 60 0 0 25 0 5 0 501646112 6072610816 1435528 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=5930284 CPUtime=761.72 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 462089 0 0 0 76086 86 0 0 25 0 5 0 501646112 6072610816 1435528 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3043.47
Current children cumulated vsize (KiB) 5930284

[startup+822.301 s]
/proc/loadavg: 8.23 8.11 7.93 9/186 1850
/proc/meminfo: memFree=19127316/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=6184048 CPUtime=3283.14 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 1502286 0 0 0 328013 301 0 0 25 0 5 0 501646061 6332465152 1499534 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 1546012 1499534 176 36 0 1543917 0
[pid=1810/tid=1816] ppid=1808 vsize=6184048 CPUtime=820.5 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 217171 0 0 0 82001 49 0 0 25 0 5 0 501646112 6332465152 1499534 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=6184048 CPUtime=821.65 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 473047 0 0 0 82070 95 0 0 25 0 5 0 501646112 6332465152 1499534 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=6184048 CPUtime=818.74 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 318592 0 0 0 81811 63 0 0 25 0 5 0 501646112 6332465152 1499534 33554432000 4194304 4338100 140733763289840 18446744073709551615 4287920 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=6184048 CPUtime=821.73 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 484050 0 0 0 82081 92 0 0 25 0 5 0 501646112 6332465152 1499534 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254254 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3283.14
Current children cumulated vsize (KiB) 6184048

[startup+882.301 s]
/proc/loadavg: 8.16 8.10 7.93 9/186 1851
/proc/meminfo: memFree=18947612/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=6359612 CPUtime=3522.83 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 1546111 0 0 0 351972 311 0 0 25 0 5 0 501646061 6512242688 1543359 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 1589903 1543359 176 36 0 1587808 0
[pid=1810/tid=1816] ppid=1808 vsize=6359612 CPUtime=880.5 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 225256 0 0 0 87999 51 0 0 25 0 5 0 501646112 6512242688 1543359 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254231 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=6359612 CPUtime=881.66 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 487683 0 0 0 88068 98 0 0 25 0 5 0 501646112 6512242688 1543359 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=6359612 CPUtime=878.5 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 329815 0 0 0 87784 66 0 0 25 0 5 0 501646112 6512242688 1543359 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254221 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=6359612 CPUtime=881.64 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 493931 0 0 0 88071 93 0 0 25 0 5 0 501646112 6512242688 1543359 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3522.83
Current children cumulated vsize (KiB) 6359612

[startup+942.301 s]
/proc/loadavg: 8.12 8.09 7.94 9/186 1853
/proc/meminfo: memFree=18547188/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=6613508 CPUtime=3762.49 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 1609290 0 0 0 375925 324 0 0 25 0 5 0 501646061 6772232192 1606538 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 1653377 1606538 176 36 0 1651282 0
[pid=1810/tid=1816] ppid=1808 vsize=6613508 CPUtime=940.49 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 233099 0 0 0 93996 53 0 0 25 0 5 0 501646112 6772232192 1606538 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=6613508 CPUtime=941.65 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 509621 0 0 0 94063 102 0 0 25 0 5 0 501646112 6772232192 1606538 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828049180 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=6613508 CPUtime=938.5 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 342193 0 0 0 93782 68 0 0 25 0 5 0 501646112 6772232192 1606538 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=6613508 CPUtime=941.32 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 514951 0 0 0 94034 98 0 0 25 0 5 0 501646112 6772232192 1606538 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254231 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3762.49
Current children cumulated vsize (KiB) 6613508

[startup+1002.31 s]
/proc/loadavg: 8.18 8.11 7.95 9/186 1854
/proc/meminfo: memFree=18192868/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=6813660 CPUtime=4002.19 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 1660102 0 0 0 399884 335 0 0 25 0 5 0 501646061 6977187840 1657350 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 1703415 1657350 176 36 0 1701320 0
[pid=1810/tid=1816] ppid=1808 vsize=6813660 CPUtime=1000.49 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 244652 0 0 0 99993 56 0 0 25 0 5 0 501646112 6977187840 1657350 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=6813660 CPUtime=1001.65 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 528971 0 0 0 100060 105 0 0 25 0 5 0 501646112 6977187840 1657350 33554432000 4194304 4338100 140733763289840 18446744073709551615 4286323 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=6813660 CPUtime=998.5 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 349390 0 0 0 99780 70 0 0 25 0 5 0 501646112 6977187840 1657350 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=6813660 CPUtime=1001 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 527663 0 0 0 99999 101 0 0 25 0 5 0 501646112 6977187840 1657350 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4002.19
Current children cumulated vsize (KiB) 6813660

[startup+1062.3 s]
/proc/loadavg: 8.19 8.12 7.96 9/186 1856
/proc/meminfo: memFree=17767772/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=7089320 CPUtime=4241.84 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 1728581 0 0 0 423836 348 0 0 25 0 5 0 501646061 7259463680 1725829 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 1772330 1725829 176 36 0 1770235 0
[pid=1810/tid=1816] ppid=1808 vsize=7089320 CPUtime=1060.48 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 259324 0 0 0 105990 58 0 0 25 0 5 0 501646112 7259463680 1725829 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=7089320 CPUtime=1061.65 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 554604 0 0 0 106054 111 0 0 25 0 5 0 501646112 7259463680 1725829 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=7089320 CPUtime=1058.5 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 361719 0 0 0 105778 72 0 0 25 0 5 0 501646112 7259463680 1725829 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254437 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=7089320 CPUtime=1060.67 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 543508 0 0 0 105963 104 0 0 25 0 5 0 501646112 7259463680 1725829 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4241.84
Current children cumulated vsize (KiB) 7089320

[startup+1122.3 s]
/proc/loadavg: 8.13 8.11 7.97 9/186 1858
/proc/meminfo: memFree=17287836/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=7352468 CPUtime=4481.5 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 1794105 0 0 0 447789 361 0 0 25 0 5 0 501646061 7528927232 1791353 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 1838117 1791353 176 36 0 1836022 0
[pid=1810/tid=1816] ppid=1808 vsize=7352468 CPUtime=1120.48 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 274953 0 0 0 111986 62 0 0 25 0 5 0 501646112 7528927232 1791353 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254254 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=7352468 CPUtime=1121.65 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 576713 0 0 0 112050 115 0 0 25 0 5 0 501646112 7528927232 1791353 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=7352468 CPUtime=1118.5 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 376579 0 0 0 111775 75 0 0 25 0 5 0 501646112 7528927232 1791353 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=7352468 CPUtime=1120.34 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 556434 0 0 0 111928 106 0 0 25 0 5 0 501646112 7528927232 1791353 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4481.5
Current children cumulated vsize (KiB) 7352468

[startup+1182.3 s]
/proc/loadavg: 8.15 8.12 7.98 9/186 1859
/proc/meminfo: memFree=16855652/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=7593852 CPUtime=4721.18 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 1855214 0 0 0 471745 373 0 0 25 0 5 0 501646061 7776104448 1852462 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 1898463 1852462 176 36 0 1896368 0
[pid=1810/tid=1816] ppid=1808 vsize=7593852 CPUtime=1180.47 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 289469 0 0 0 117982 65 0 0 25 0 5 0 501646112 7776104448 1852462 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=7593852 CPUtime=1181.66 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 597799 0 0 0 118047 119 0 0 25 0 5 0 501646112 7776104448 1852462 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=7593852 CPUtime=1178.5 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 387073 0 0 0 117773 77 0 0 25 0 5 0 501646112 7776104448 1852462 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828050587 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=7593852 CPUtime=1180.01 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 571447 0 0 0 117891 110 0 0 25 0 5 0 501646112 7776104448 1852462 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4721.18
Current children cumulated vsize (KiB) 7593852



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.1 s]
/proc/loadavg: 8.18 8.13 7.98 5/180 1861
/proc/meminfo: memFree=23434984/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=7656544 CPUtime=4800.28 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) S 1808 1810 1676 0 -1 4202496 1871128 0 0 0 479653 375 0 0 25 0 5 0 501646061 7840301056 1868376 33554432000 4194304 4338100 140733763289840 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 1914136 1868376 176 36 0 1912041 0
[pid=1810/tid=1816] ppid=1808 vsize=7656544 CPUtime=1200.28 cores=0,2,4,6
/proc/1810/task/1816/stat : 1816 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 293671 0 0 0 119962 66 0 0 25 0 5 0 501646112 7840301056 1868376 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=1810/tid=1817] ppid=1808 vsize=7656544 CPUtime=1201.46 cores=0,2,4,6
/proc/1810/task/1817/stat : 1817 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 600615 0 0 0 120027 119 0 0 25 0 5 0 501646112 7840301056 1868376 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254451 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=1810/tid=1818] ppid=1808 vsize=7656544 CPUtime=1198.3 cores=0,2,4,6
/proc/1810/task/1818/stat : 1818 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 390129 0 0 0 119753 77 0 0 25 0 5 0 501646112 7840301056 1868376 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=7656544 CPUtime=1199.7 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4202560 577287 0 0 0 119860 110 0 0 25 0 5 0 501646112 7840301056 1868376 33554432000 4194304 4338100 140733763289840 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4800.28
Current children cumulated vsize (KiB) 7656544

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.4 s]
/proc/loadavg: 8.18 8.13 7.98 2/178 1862
/proc/meminfo: memFree=30676660/32951124 swapFree=67105204/67111528
[pid=1810] ppid=1808 vsize=0 CPUtime=4800.6 cores=0,2,4,6
/proc/1810/stat : 1810 (ttsth-5-4) Z 1808 1810 1676 0 -1 4203548 1871130 0 0 0 479656 404 0 0 18 0 2 0 501646061 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/1810/statm: 0 0 0 0 0 0 0
[pid=1810/tid=1819] ppid=1808 vsize=0 CPUtime=1200 cores=0,2,4,6
/proc/1810/task/1819/stat : 1819 (ttsth-5-4) R 1808 1810 1676 0 -1 4203588 577287 0 0 0 119860 140 0 0 25 0 2 0 501646112 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4800.6
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.41
CPU time (s): 4800.62
CPU user time (s): 4796.56
CPU system time (s): 4.05538
CPU usage (%): 399.25
Max. virtual memory (cumulated for all children) (KiB): 7656544

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.56
system time used= 4.05538
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1871130
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 760
involuntary context switches= 22497

runsolver used 1.9427 second user time and 4.6283 second system time

The end

Launcher Data 

Begin job on node147 at 2011-04-29 17:51:42
IDJOB=3262442
IDBENCH=83311
IDSOLVER=1654
FILE ID=node147/3262442-1304092302
RUNJOBID= node147-1304091097-1694
PBS_JOBID= 13170578
Free space on /tmp= 72660 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/VanDerWaerden_pd_2-3-22_445.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3262442-1304092302/watcher-3262442-1304092302 -o /tmp/evaluation-result-3262442-1304092302/solver-3262442-1304092302 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262442-1304092302.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4f7ff14ba0d33c4cf7de4e3c004f2f79
RANDOM SEED=1609872022

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30920428 kB
Buffers:        274144 kB
Cached:        1365408 kB
SwapCached:       2968 kB
Active:         132280 kB
Inactive:      1574764 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30920428 kB
SwapTotal:    67111528 kB
SwapFree:     67105204 kB
Dirty:            1184 kB
Writeback:           0 kB
AnonPages:       65244 kB
Mapped:          14988 kB
Slab:           260388 kB
PageTables:       4676 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   212548 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72660 MiB
End job on node147 at 2011-04-29 18:11:46