Trace number 3262398

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.6 1202.24

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-21_406.cnf
MD5SUM906590ef62b3db2841b2d529fd1636f7
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark698.76
Satisfiable
(Un)Satisfiability was proved
Number of variables203
Number of clauses22241
Sum of the clauses size99837
Maximum clause length21
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 268
Number of clauses of size 320324
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51849

Solver Data 

0.00/0.02	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262398-1304092301.cnf 
0.00/0.02	c Using SATTIMEOUT of 4800
0.00/0.02	c Using SATRAM of 15500
0.00/0.02	c Size of subset node = 32
0.00/0.02	c Variables = 203
0.00/0.02	c Clauses = 22241
0.00/0.02	c Literals = 99837
0.00/0.02	c Reduced size:
0.00/0.02	c Variables = 203
0.00/0.02	c Clauses = 22241
0.00/0.02	c Literals = 99837
0.00/0.02	c a2
0.09/0.14	c a1
0.29/0.32	c Independent sub-problems = 1
0.29/0.32	c Sub-problem with 203 variables and 22241 clauses
0.29/0.32	c using permutation method 4
0.29/0.32	c count = 1
0.29/0.32	c Ordering finished 0.310 seconds
0.29/0.32	c mapped 0.320 seconds
0.29/0.32	c permuted 0.320 seconds
0.29/0.32	c about to sort
0.29/0.33	c sorted
0.29/0.40	c clauses now 22241
0.29/0.40	c init finished 0.320 seconds
0.29/0.40	c tree built 0.380 seconds
0.29/0.40	c 
0.29/0.40	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.29/0.40	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.29/0.40	c ................................ | ..........                    |                                  0.4         0.0             
0.39/0.40	c ................................ | ..........                  1 |                                  0.4         2.6             
0.39/0.40	c ................................ | ..........                  2 |                                  0.4         5.1             
0.39/0.40	c ................................ | ..........                  3 |                                  0.4         7.7             
0.39/0.40	c ................................ | ..........                  4 |                                  0.4        10.3             
0.39/0.40	c ................................ | ..........                  5 |                                  0.4        12.8             
0.39/0.41	c ................................ | ..........               1000 | 7            378                 0.5      2173.9        30189
95.85/24.35	c ................................ | ..........             447000 | 29853        161058             96.1      4651.9     24458383
192.15/48.43	c ................................ | ..........             675000 | 46709        246577            192.3      3510.9     37996912
288.00/72.40	c ................................ | ..........             846000 | 60112        308039            288.0      2937.3     47745736
384.27/96.50	c ................................ | ..........            1011000 | 74740        361878            384.3      2630.8     56545055
480.14/120.55	c ................................ | *.........            1180000 | 89424        413363            480.4      2456.5     63668638
576.01/144.53	c ................................ | *.........            1308000 | 97821        459150            576.2      2270.2     70413805
672.28/168.61	c ................................ | *.........            1431000 | 107439       504063            672.3      2128.5     76678854
768.16/192.67	c ................................ | *.........            1536000 | 116448       542275            768.5      1998.8     82464880
864.44/216.78	c ................................ | *.........            1650000 | 125554       579199            864.7      1908.1     88635675
959.89/240.69	c ................................ | **........            1777000 | 135975       618520            960.3      1850.5     95100177
1056.16/264.70	c ................................ | **........            1888000 | 146804       654976           1056.2      1787.6    100661267
1152.82/288.93	c ................................ | **........            1994000 | 155396       688372           1153.0      1729.5    104606613
1247.89/312.74	c ................................ | **........            2089000 | 163986       719836           1248.1      1673.8    106040931
1344.16/336.88	c ................................ | **........            2194000 | 174549       751240           1344.5      1631.8    109394961
1440.43/360.90	c ................................ | ***.......            2294000 | 185848       779429           1440.4      1592.6    115350040
1536.32/384.97	c ................................ | ***.......            2387000 | 196344       810793           1536.6      1553.4    120823874
1631.78/408.89	c ................................ | ***.......            2470000 | 205109       835076           1632.2      1513.3    125955267
1728.86/433.17	c ................................ | ***.......            2547000 | 213729       858545           1729.2      1473.0    128428218
1823.92/456.93	c ................................ | ***.......            2621000 | 222355       883541           1824.1      1436.9    132350818
1919.80/480.96	c ................................ | ****......            2700000 | 231360       906932           1920.1      1406.2    137408704
2016.47/505.15	c ................................ | ****......            2781000 | 240509       930148           2016.7      1379.0    141875022
2112.36/529.15	c ................................ | ****......            2862000 | 249785       954257           2112.6      1354.8    146505448
2208.62/553.29	c ................................ | ****......            2936000 | 257984       977711           2209.0      1329.1    150579653
2304.48/577.26	c ................................ | ****......            3005000 | 265840       1001332          2304.8      1303.8    154970362
2401.14/601.44	c ................................ | *****.....            3071000 | 273004       1022099          2401.3      1278.9    158381148
2496.62/625.37	c ................................ | *****.....            3137000 | 280076       1040813          2496.9      1256.4    158381148
2592.08/649.29	c ................................ | *****.....            3202000 | 288950       1058791          2592.4      1235.1    158969469
2688.75/673.48	c ................................ | *****.....            3269000 | 296333       1077891          2689.1      1215.6    160622914
2784.65/697.42	c ................................ | *****.....            3337000 | 301758       1097828          2784.7      1198.3    163724448
2880.10/721.35	c ................................ | ******....            3398000 | 307172       1116036          2880.3      1179.7    166481249
2976.77/745.56	c ................................ | ******....            3460000 | 312770       1135158          2977.1      1162.2    168871945
3072.24/769.41	c ................................ | ******....            3515000 | 317825       1155193          3072.3      1144.1    170815661
3168.52/793.59	c ................................ | ******....            3568000 | 323022       1177088          3168.9      1125.9    174222238
3265.16/817.72	c ................................ | ******....            3632000 | 329162       1196488          3265.3      1112.3    174362204
3360.63/841.60	c ................................ | *******...            3707000 | 336237       1219927          3360.7      1103.1    174362204
3456.52/865.68	c ................................ | *******...            3777000 | 343653       1238130          3456.8      1092.6    174362204
3552.79/889.75	c ................................ | *******...            3846000 | 348769       1259103          3553.0      1082.5    174545315
3648.66/913.76	c ................................ | *******...            3917000 | 352940       1277870          3648.9      1073.5    176563063
3744.13/937.60	c ................................ | *******...            3986000 | 357339       1295775          3744.2      1064.6    178810710
3840.40/961.80	c ................................ | ********..            4058000 | 362318       1316073          3840.8      1056.6    180828820
3937.47/986.00	c ................................ | ********..            4122000 | 366087       1336857          3937.5      1046.9    182675342
4032.15/1009.75	c ................................ | ********..            4183000 | 369625       1356818          4032.3      1037.4    184291339
4128.83/1033.95	c ................................ | ********..            4252000 | 374446       1377061          4129.0      1029.8    186045010
4224.29/1057.87	c ................................ | ********..            4306000 | 377650       1395105          4224.6      1019.3    188193914
4321.35/1082.15	c ................................ | *********.            4366000 | 381478       1412449          4321.6      1010.3    190919348
4416.43/1105.95	c ................................ | *********.            4420000 | 385266       1429457          4416.6      1000.8    193660855
4513.51/1130.29	c ................................ | *********.            4474000 | 388886       1449236          4513.9       991.2    196259266
4608.97/1154.11	c ................................ | *********.            4521000 | 391908       1465800          4609.0       980.9    198634897
4704.46/1178.06	c ................................ | *********.            4571000 | 395328       1481078          4704.7       971.6    201053809

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3262398-1304092301/watcher-3262398-1304092301 -o /tmp/evaluation-result-3262398-1304092301/solver-3262398-1304092301 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262398-1304092301.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.43 7.89 7.71 2/173 1799
/proc/meminfo: memFree=30926508/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=9112 CPUtime=0 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) R 1797 1799 1676 0 -1 4202496 344 0 0 0 0 0 0 0 20 0 1 0 501646036 9330688 287 33554432000 4194304 4338100 140736779212432 18446744073709551615 220816236288 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/1799/statm: 2278 287 146 36 0 183 0

[startup+0.0485459 s]
/proc/loadavg: 7.43 7.89 7.71 2/173 1799
/proc/meminfo: memFree=30926508/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=24132 CPUtime=0.04 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) R 1797 1799 1676 0 -1 4202496 3461 0 0 0 4 0 0 0 20 0 1 0 501646036 24711168 3325 33554432000 4194304 4338100 140736779212432 18446744073709551615 4206976 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/1799/statm: 6033 3325 360 36 0 3938 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 24132

[startup+0.100534 s]
/proc/loadavg: 7.43 7.89 7.71 2/173 1799
/proc/meminfo: memFree=30926508/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=24132 CPUtime=0.09 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) R 1797 1799 1676 0 -1 4202496 3462 0 0 0 9 0 0 0 21 0 1 0 501646036 24711168 3325 33554432000 4194304 4338100 140736779212432 18446744073709551615 4206993 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/1799/statm: 6033 3325 359 36 0 3938 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 24132

[startup+0.300509 s]
/proc/loadavg: 7.43 7.89 7.71 2/173 1799
/proc/meminfo: memFree=30926508/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=14488 CPUtime=0.29 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) R 1797 1799 1676 0 -1 4202496 3918 0 0 0 29 0 0 0 21 0 1 0 501646036 14835712 1631 33554432000 4194304 4338100 140736779212432 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/1799/statm: 3622 1631 155 36 0 1527 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 14488

[startup+0.700391 s]
/proc/loadavg: 7.43 7.89 7.71 2/173 1799
/proc/meminfo: memFree=30926508/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=163596 CPUtime=1.58 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 13573 0 0 0 157 1 0 0 21 0 5 0 501646036 167522304 11199 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 40899 11200 176 36 0 38804 0
Current children cumulated CPU time (s) 1.58
Current children cumulated vsize (KiB) 163596

[startup+1.50024 s]
/proc/loadavg: 7.43 7.89 7.71 11/186 1819
/proc/meminfo: memFree=30819148/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=285964 CPUtime=4.78 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 26869 0 0 0 474 4 0 0 21 0 5 0 501646036 292827136 24494 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 71491 24494 176 36 0 69396 0
[pid=1799/tid=1812] ppid=1797 vsize=285964 CPUtime=1.09 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 4645 0 0 0 109 0 0 0 19 0 5 0 501646076 292827136 24494 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=285964 CPUtime=1.09 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 5705 0 0 0 109 0 0 0 19 0 5 0 501646076 292827136 24494 33554432000 4194304 4338100 140736779212432 18446744073709551615 4255956 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=285964 CPUtime=1.09 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 3550 0 0 0 108 1 0 0 19 0 5 0 501646076 292827136 24494 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828050576 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=285964 CPUtime=1.08 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 5037 0 0 0 108 0 0 0 19 0 5 0 501646076 292827136 24494 33554432000 4194304 4338100 140736779212432 18446744073709551615 4240510 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.78
Current children cumulated vsize (KiB) 285964

[startup+3.10095 s]
/proc/loadavg: 7.43 7.89 7.71 9/186 1819
/proc/meminfo: memFree=30690632/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=373944 CPUtime=11.18 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 49340 0 0 0 1110 8 0 0 21 0 5 0 501646036 382918656 46965 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 93486 46965 176 36 0 91391 0
[pid=1799/tid=1812] ppid=1797 vsize=373944 CPUtime=2.69 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 9355 0 0 0 269 0 0 0 23 0 5 0 501646076 382918656 46965 33554432000 4194304 4338100 140736779212432 18446744073709551615 4284177 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=373944 CPUtime=2.69 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 12461 0 0 0 268 1 0 0 23 0 5 0 501646076 382918656 46965 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=373944 CPUtime=2.68 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 8351 0 0 0 267 1 0 0 23 0 5 0 501646076 382918656 46966 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254221 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=373944 CPUtime=2.68 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 11241 0 0 0 266 2 0 0 23 0 5 0 501646076 382918656 46966 33554432000 4194304 4338100 140736779212432 18446744073709551615 4286296 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.18
Current children cumulated vsize (KiB) 373944

[startup+6.30036 s]
/proc/loadavg: 7.56 7.91 7.72 9/186 1819
/proc/meminfo: memFree=30397696/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=509240 CPUtime=23.95 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 83129 0 0 0 2382 13 0 0 21 0 5 0 501646036 521461760 80754 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 127310 80754 176 36 0 125215 0
[pid=1799/tid=1812] ppid=1797 vsize=509240 CPUtime=5.89 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 17647 0 0 0 588 1 0 0 25 0 5 0 501646076 521461760 80754 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254418 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=509240 CPUtime=5.89 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 23377 0 0 0 586 3 0 0 25 0 5 0 501646076 521461760 80754 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254384 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=509240 CPUtime=5.89 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 14431 0 0 0 586 3 0 0 25 0 5 0 501646076 521461760 80754 33554432000 4194304 4338100 140736779212432 18446744073709551615 4285363 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=509240 CPUtime=5.85 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 19742 0 0 0 582 3 0 0 25 0 5 0 501646076 521461760 80754 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.95
Current children cumulated vsize (KiB) 509240

[startup+12.7012 s]
/proc/loadavg: 7.59 7.91 7.72 9/186 1819
/proc/meminfo: memFree=29980712/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=713352 CPUtime=49.53 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 134372 0 0 0 4931 22 0 0 21 0 5 0 501646036 730472448 131997 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 178338 131998 176 36 0 176243 0
[pid=1799/tid=1812] ppid=1797 vsize=713352 CPUtime=12.29 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 30116 0 0 0 1226 3 0 0 25 0 5 0 501646076 730472448 131998 33554432000 4194304 4338100 140736779212432 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=713352 CPUtime=12.28 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 41486 0 0 0 1222 6 0 0 25 0 5 0 501646076 730472448 131998 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=713352 CPUtime=12.29 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 22532 0 0 0 1224 5 0 0 25 0 5 0 501646076 730472448 131998 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254357 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=713352 CPUtime=12.22 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 32307 0 0 0 1217 5 0 0 25 0 5 0 501646076 730472448 131998 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254275 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.53
Current children cumulated vsize (KiB) 713352

[startup+25.5008 s]
/proc/loadavg: 7.76 7.93 7.73 9/186 1819
/proc/meminfo: memFree=29397676/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=1005576 CPUtime=100.65 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 207616 0 0 0 10031 34 0 0 21 0 5 0 501646036 1029709824 205241 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 251394 205241 176 36 0 249299 0
[pid=1799/tid=1812] ppid=1797 vsize=1005576 CPUtime=25.09 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 46531 0 0 0 2503 6 0 0 25 0 5 0 501646076 1029709824 205241 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254239 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=1005576 CPUtime=25.09 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 60169 0 0 0 2500 9 0 0 25 0 5 0 501646076 1029709824 205241 33554432000 4194304 4338100 140736779212432 18446744073709551615 4230408 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=1005576 CPUtime=25.09 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 34057 0 0 0 2502 7 0 0 25 0 5 0 501646076 1029709824 205241 33554432000 4194304 4338100 140736779212432 18446744073709551615 4256993 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=1005576 CPUtime=24.95 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 58927 0 0 0 2486 9 0 0 25 0 5 0 501646076 1029709824 205241 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 100.65
Current children cumulated vsize (KiB) 1005576

[startup+51.1011 s]
/proc/loadavg: 7.84 7.94 7.73 9/186 1820
/proc/meminfo: memFree=28579472/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=1445616 CPUtime=202.92 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 317973 0 0 0 20236 56 0 0 21 0 5 0 501646036 1480310784 315598 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 361404 315598 176 36 0 359309 0
[pid=1799/tid=1812] ppid=1797 vsize=1445616 CPUtime=50.69 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 72340 0 0 0 5058 11 0 0 25 0 5 0 501646076 1480310784 315598 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254221 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=1445616 CPUtime=50.69 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 83555 0 0 0 5055 14 0 0 25 0 5 0 501646076 1480310784 315598 33554432000 4194304 4338100 140736779212432 18446744073709551615 4256403 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=1445616 CPUtime=50.69 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 60116 0 0 0 5057 12 0 0 25 0 5 0 501646076 1480310784 315598 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254342 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=1445616 CPUtime=50.41 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 94030 0 0 0 5025 16 0 0 25 0 5 0 501646076 1480310784 315598 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 202.92
Current children cumulated vsize (KiB) 1445616

[startup+102.307 s]
/proc/loadavg: 7.99 7.96 7.75 9/186 1821
/proc/meminfo: memFree=27271512/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=2045340 CPUtime=407.46 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 468417 0 0 0 40659 87 0 0 21 0 5 0 501646036 2094428160 466042 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 511335 466042 176 36 0 509240 0
[pid=1799/tid=1812] ppid=1797 vsize=2045340 CPUtime=101.9 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 119646 0 0 0 10168 22 0 0 25 0 5 0 501646076 2094428160 466042 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=2045340 CPUtime=101.9 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 118427 0 0 0 10169 21 0 0 25 0 5 0 501646076 2094428160 466042 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=2045340 CPUtime=101.9 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 83584 0 0 0 10174 16 0 0 25 0 5 0 501646076 2094428160 466042 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=2045340 CPUtime=101.34 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 138828 0 0 0 10108 26 0 0 25 0 5 0 501646076 2094428160 466042 33554432000 4194304 4338100 140736779212432 18446744073709551615 4240516 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 407.46
Current children cumulated vsize (KiB) 2045340

[startup+162.301 s]
/proc/loadavg: 8.11 8.00 7.77 9/186 1823
/proc/meminfo: memFree=26154620/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=2578552 CPUtime=647.12 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 601859 0 0 0 64598 114 0 0 21 0 5 0 501646036 2640437248 599484 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 644638 599484 176 36 0 642543 0
[pid=1799/tid=1812] ppid=1797 vsize=2578552 CPUtime=161.62 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 157126 0 0 0 16132 30 0 0 25 0 5 0 501646076 2640437248 599485 33554432000 4194304 4338100 140736779212432 18446744073709551615 4241252 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=2578552 CPUtime=161.9 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 152119 0 0 0 16164 26 0 0 25 0 5 0 501646076 2640437248 599485 33554432000 4194304 4338100 140736779212432 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=2578552 CPUtime=161.89 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 102272 0 0 0 16169 20 0 0 25 0 5 0 501646076 2640437248 599485 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254362 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=2578552 CPUtime=161.28 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 182411 0 0 0 16093 35 0 0 25 0 5 0 501646076 2640437248 599485 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254342 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 647.12
Current children cumulated vsize (KiB) 2578552


################
# More data... #
################

/proc/meminfo: memFree=19675432/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=5728204 CPUtime=3043.9 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 1374396 0 0 0 304088 302 0 0 21 0 5 0 501646036 5865680896 1372021 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 1432051 1372021 176 36 0 1429956 0
[pid=1799/tid=1812] ppid=1797 vsize=5728204 CPUtime=760.24 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 382784 0 0 0 75938 86 0 0 25 0 5 0 501646076 5865680896 1372021 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=5728204 CPUtime=761.92 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 395226 0 0 0 76107 85 0 0 25 0 5 0 501646076 5865680896 1372021 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=5728204 CPUtime=760.02 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 228450 0 0 0 75951 51 0 0 25 0 5 0 501646076 5865680896 1372021 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254407 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=5728204 CPUtime=761.29 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 360004 0 0 0 76051 78 0 0 25 0 5 0 501646076 5865680896 1372021 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3043.9
Current children cumulated vsize (KiB) 5728204

[startup+822.301 s]
/proc/loadavg: 8.23 8.11 7.93 9/186 1850
/proc/meminfo: memFree=19129176/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=6098888 CPUtime=3283.54 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 1447334 0 0 0 328035 319 0 0 21 0 5 0 501646036 6245261312 1444959 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 1524722 1444959 176 36 0 1522627 0
[pid=1799/tid=1812] ppid=1797 vsize=6098888 CPUtime=820.21 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 414577 0 0 0 81928 93 0 0 25 0 5 0 501646076 6245261312 1444959 33554432000 4194304 4338100 140736779212432 18446744073709551615 4256403 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=6098888 CPUtime=821.92 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 414600 0 0 0 82103 89 0 0 25 0 5 0 501646076 6245261312 1444959 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=6098888 CPUtime=819.69 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 247235 0 0 0 81913 56 0 0 25 0 5 0 501646076 6245261312 1444959 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=6098888 CPUtime=821.28 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 362990 0 0 0 82050 78 0 0 25 0 5 0 501646076 6245261312 1444959 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3283.54
Current children cumulated vsize (KiB) 6098888

[startup+882.301 s]
/proc/loadavg: 8.16 8.10 7.93 9/186 1851
/proc/meminfo: memFree=18949472/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=6099548 CPUtime=3523.22 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 1447664 0 0 0 352002 320 0 0 21 0 5 0 501646036 6245937152 1445289 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 1524887 1445289 176 36 0 1522792 0
[pid=1799/tid=1812] ppid=1797 vsize=6099548 CPUtime=880.22 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 414673 0 0 0 87928 94 0 0 25 0 5 0 501646076 6245937152 1445289 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=6099548 CPUtime=881.92 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 414708 0 0 0 88103 89 0 0 25 0 5 0 501646076 6245937152 1445289 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=6099548 CPUtime=879.36 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 247291 0 0 0 87880 56 0 0 25 0 5 0 501646076 6245937152 1445289 33554432000 4194304 4338100 140736779212432 18446744073709551615 4255938 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=6099548 CPUtime=881.29 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 363060 0 0 0 88050 79 0 0 25 0 5 0 501646076 6245937152 1445289 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3523.22
Current children cumulated vsize (KiB) 6099548

[startup+942.301 s]
/proc/loadavg: 8.12 8.09 7.94 9/186 1853
/proc/meminfo: memFree=18550164/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=6250220 CPUtime=3762.91 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 1485331 0 0 0 375960 331 0 0 21 0 5 0 501646036 6400225280 1482956 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 1562555 1482956 176 36 0 1560460 0
[pid=1799/tid=1812] ppid=1797 vsize=6250220 CPUtime=940.22 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 414759 0 0 0 93928 94 0 0 25 0 5 0 501646076 6400225280 1482956 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=6250220 CPUtime=941.92 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 437819 0 0 0 94096 96 0 0 25 0 5 0 501646076 6400225280 1482956 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=6250220 CPUtime=939.04 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 247337 0 0 0 93848 56 0 0 25 0 5 0 501646076 6400225280 1482956 33554432000 4194304 4338100 140736779212432 18446744073709551615 4285817 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=6250220 CPUtime=941.29 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 377484 0 0 0 94047 82 0 0 25 0 5 0 501646076 6400225280 1482956 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3762.91
Current children cumulated vsize (KiB) 6250220

[startup+1002.3 s]
/proc/loadavg: 8.18 8.11 7.95 9/186 1854
/proc/meminfo: memFree=18195968/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=6394636 CPUtime=4002.58 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 1522034 0 0 0 399916 342 0 0 21 0 5 0 501646036 6548107264 1519659 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 1598659 1519659 176 36 0 1596564 0
[pid=1799/tid=1812] ppid=1797 vsize=6394636 CPUtime=1000.22 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 414828 0 0 0 99928 94 0 0 25 0 5 0 501646076 6548107264 1519659 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=6394636 CPUtime=1001.91 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 460022 0 0 0 100089 102 0 0 25 0 5 0 501646076 6548107264 1519659 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=6394636 CPUtime=998.71 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 247412 0 0 0 99815 56 0 0 25 0 5 0 501646076 6548107264 1519659 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=6394636 CPUtime=1001.3 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 391840 0 0 0 100043 87 0 0 25 0 5 0 501646076 6548107264 1519659 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4002.58
Current children cumulated vsize (KiB) 6394636

[startup+1062.3 s]
/proc/loadavg: 8.19 8.12 7.96 9/186 1856
/proc/meminfo: memFree=17771988/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=6551564 CPUtime=4242.26 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 1560769 0 0 0 423874 352 0 0 21 0 5 0 501646036 6708801536 1558394 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 1637891 1558394 176 36 0 1635796 0
[pid=1799/tid=1812] ppid=1797 vsize=6551564 CPUtime=1060.23 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 417730 0 0 0 105927 96 0 0 25 0 5 0 501646076 6708801536 1558394 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=6551564 CPUtime=1061.92 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 482116 0 0 0 106085 107 0 0 25 0 5 0 501646076 6708801536 1558394 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=6551564 CPUtime=1058.39 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 247466 0 0 0 105783 56 0 0 25 0 5 0 501646076 6708801536 1558394 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254400 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=6551564 CPUtime=1061.29 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 405525 0 0 0 106039 90 0 0 25 0 5 0 501646076 6708801536 1558394 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4242.26
Current children cumulated vsize (KiB) 6551564

[startup+1122.3 s]
/proc/loadavg: 8.13 8.11 7.97 9/186 1858
/proc/meminfo: memFree=17291308/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=6764664 CPUtime=4481.94 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 1614042 0 0 0 447828 366 0 0 21 0 5 0 501646036 6927015936 1611667 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 1691166 1611667 176 36 0 1689071 0
[pid=1799/tid=1812] ppid=1797 vsize=6764664 CPUtime=1120.22 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 434358 0 0 0 111922 100 0 0 25 0 5 0 501646076 6927015936 1611667 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=6764664 CPUtime=1121.92 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 503963 0 0 0 112079 113 0 0 25 0 5 0 501646076 6927015936 1611667 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=6764664 CPUtime=1118.06 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 247516 0 0 0 111750 56 0 0 25 0 5 0 501646076 6927015936 1611667 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=6764664 CPUtime=1121.29 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 420273 0 0 0 112035 94 0 0 25 0 5 0 501646076 6927015936 1611667 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4481.94
Current children cumulated vsize (KiB) 6764664

[startup+1182.3 s]
/proc/loadavg: 8.15 8.12 7.98 9/186 1859
/proc/meminfo: memFree=16859248/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=6952740 CPUtime=4721.63 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 1661696 0 0 0 471783 380 0 0 21 0 5 0 501646036 7119605760 1659321 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 1738185 1659321 176 36 0 1736090 0
[pid=1799/tid=1812] ppid=1797 vsize=6952740 CPUtime=1180.23 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 446471 0 0 0 117919 104 0 0 25 0 5 0 501646076 7119605760 1659322 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=6952740 CPUtime=1181.93 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 526702 0 0 0 118074 119 0 0 25 0 5 0 501646076 7119605760 1659322 33554432000 4194304 4338100 140736779212432 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=6952740 CPUtime=1177.74 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 247559 0 0 0 117718 56 0 0 25 0 5 0 501646076 7119605760 1659322 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=6952740 CPUtime=1181.3 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 433033 0 0 0 118032 98 0 0 25 0 5 0 501646076 7119605760 1659323 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4721.63
Current children cumulated vsize (KiB) 6952740



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202 s]
/proc/loadavg: 8.18 8.13 7.98 9/186 1860
/proc/meminfo: memFree=16693180/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=7043584 CPUtime=4800.33 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) S 1797 1799 1676 0 -1 4202496 1685503 0 0 0 479649 384 0 0 21 0 5 0 501646036 7212630016 1683128 33554432000 4194304 4338100 140736779212432 18446744073709551615 220828039141 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 1760896 1683128 176 36 0 1758801 0
[pid=1799/tid=1812] ppid=1797 vsize=7043584 CPUtime=1199.93 cores=1,3,5,7
/proc/1799/task/1812/stat : 1812 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 451408 0 0 0 119888 105 0 0 25 0 5 0 501646076 7212630016 1683128 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=1799/tid=1813] ppid=1797 vsize=7043584 CPUtime=1201.63 cores=1,3,5,7
/proc/1799/task/1813/stat : 1813 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 535671 0 0 0 120043 120 0 0 25 0 5 0 501646076 7212630016 1683128 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254291 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=7043584 CPUtime=1197.34 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 250766 0 0 0 119677 57 0 0 25 0 5 0 501646076 7212630016 1683128 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254400 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=1799/tid=1815] ppid=1797 vsize=7043584 CPUtime=1201 cores=1,3,5,7
/proc/1799/task/1815/stat : 1815 (ttsth-5-4) R 1797 1799 1676 0 -1 4202560 439726 0 0 0 120001 99 0 0 25 0 5 0 501646076 7212630016 1683128 33554432000 4194304 4338100 140736779212432 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 7043584

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.2 s]
/proc/loadavg: 8.18 8.13 7.98 6/184 1861
/proc/meminfo: memFree=22249732/32951124 swapFree=67105204/67111528
[pid=1799] ppid=1797 vsize=0 CPUtime=4800.55 cores=1,3,5,7
/proc/1799/stat : 1799 (ttsth-5-4) Z 1797 1799 1676 0 -1 4203548 1685504 0 0 0 479651 404 0 0 18 0 2 0 501646036 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/1799/statm: 0 0 0 0 0 0 0
[pid=1799/tid=1814] ppid=1797 vsize=0 CPUtime=1197.53 cores=1,3,5,7
/proc/1799/task/1814/stat : 1814 (ttsth-5-4) R 1797 1799 1676 0 -1 4203588 250766 0 0 0 119677 76 0 0 25 0 2 0 501646076 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.55
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.24
CPU time (s): 4800.6
CPU user time (s): 4796.52
CPU system time (s): 4.07538
CPU usage (%): 399.304
Max. virtual memory (cumulated for all children) (KiB): 7043584

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.52
system time used= 4.07538
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1685504
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 684
involuntary context switches= 30133

runsolver used 1.9607 second user time and 4.6063 second system time

The end

Launcher Data 

Begin job on node147 at 2011-04-29 17:51:41
IDJOB=3262398
IDBENCH=83298
IDSOLVER=1654
FILE ID=node147/3262398-1304092301
RUNJOBID= node147-1304091097-1695
PBS_JOBID= 13170578
Free space on /tmp= 72660 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/VanDerWaerden_pd_2-3-21_406.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3262398-1304092301/watcher-3262398-1304092301 -o /tmp/evaluation-result-3262398-1304092301/solver-3262398-1304092301 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3262398-1304092301.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 906590ef62b3db2841b2d529fd1636f7
RANDOM SEED=1609872022

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30926656 kB
Buffers:        274116 kB
Cached:        1365436 kB
SwapCached:       2968 kB
Active:         126140 kB
Inactive:      1574680 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30926656 kB
SwapTotal:    67111528 kB
SwapFree:     67105204 kB
Dirty:             408 kB
Writeback:           0 kB
AnonPages:       59036 kB
Mapped:          14600 kB
Slab:           260388 kB
PageTables:       4676 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185968 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72656 MiB
End job on node147 at 2011-04-29 18:11:45