Trace number 3249680

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.12 1204.84

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-14x38.cnf
MD5SUM56980124bab6f1dbe07ec523b7d59019
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2128
Number of clauses259616
Sum of the clauses size1032080
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 23192
Number of clauses of size 30
Number of clauses of size 4256424
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.19/0.28	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3249680-1304065018.cnf 
0.19/0.28	c Using SATTIMEOUT of 4800
0.19/0.28	c Using SATRAM of 15500
0.19/0.28	c Size of subset node = 32
0.19/0.28	c Variables = 2128
0.19/0.28	c Clauses = 259616
0.19/0.28	c Literals = 1032080
0.19/0.28	c Reduced size:
0.19/0.28	c Variables = 2128
0.19/0.28	c Clauses = 259616
0.19/0.28	c Literals = 1032080
0.19/0.28	c a2
0.79/0.81	c a1
2.09/2.18	c Independent sub-problems = 1
2.09/2.18	c Sub-problem with 2128 variables and 259616 clauses
2.09/2.18	c using permutation method 4
2.09/2.18	c count = 1
2.09/2.18	c Ordering finished 2.120 seconds
2.09/2.18	c mapped 2.180 seconds
2.09/2.18	c permuted 2.180 seconds
2.09/2.18	c about to sort
2.20/2.22	c sorted
2.69/2.74	c clauses now 259616
2.69/2.74	c init finished 2.250 seconds
2.69/2.74	c tree built 2.740 seconds
2.69/2.74	c 
2.69/2.74	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
2.69/2.74	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
2.69/2.74	c ................................ | ..........                    |                                  2.7         0.0             
2.69/2.74	c ................................ | ..........                  1 |                                  2.7         0.4             
2.69/2.74	c ................................ | ..........                  2 |                                  2.7         0.7             
2.69/2.74	c ................................ | ..........                  3 |                                  2.7         1.1             
2.69/2.74	c ................................ | ..........                  4 |                                  2.7         1.5             
2.69/2.74	c ................................ | ..........                  5 |                                  2.7         1.8             
2.69/2.75	c ................................ | ..........               1000 |              87                  2.8       361.0           60
96.12/26.21	c ................................ | ..........             963000 | 106196       337600             96.2     10014.6      2576207
191.82/50.25	c ................................ | ..........            1514000 | 165220       500494            192.0      7884.2      3944430
287.78/74.36	c ................................ | ..........            2299000 | 250172       735233            288.0      7981.8      6024988
383.86/98.44	c ................................ | ..........            2890000 | 309283       930086            384.1      7525.1      7528466
480.40/122.63	c ................................ | *.........            3122000 | 342346       996067            480.5      6497.0      8772667
576.17/146.60	c ................................ | *.........            3304000 | 367584       1045218           576.2      5734.4      9773722
671.96/170.61	c ................................ | *.........            3430000 | 386720       1075743           672.0      5103.9     10647856
767.71/194.70	c ................................ | *.........            3643000 | 412752       1128863           768.1      4742.9     11479544
863.88/218.76	c ................................ | *.........            3872000 | 437965       1178322           864.1      4480.7     12285180
960.04/242.89	c ................................ | **........            4075000 | 460548       1216518           960.4      4243.0     12988857
1056.22/266.95	c ................................ | **........            4228000 | 477362       1242970          1056.4      4002.2     13500800
1152.41/291.08	c ................................ | **........            4378000 | 494519       1270276          1152.8      3797.8     14056780
1248.24/315.04	c ................................ | **........            4500000 | 511322       1296690          1248.4      3604.6     14628004
1343.64/338.99	c ................................ | **........            4593000 | 524587       1312082          1344.0      3417.4     15149833
1440.66/363.24	c ................................ | ***.......            4751000 | 543434       1339397          1440.8      3297.4     15800805
1536.06/387.14	c ................................ | ***.......            4941000 | 563033       1374517          1536.2      3216.4     16371131
1631.84/411.17	c ................................ | ***.......            5080000 | 579045       1396411          1632.1      3112.5     16766132
1729.29/435.50	c ................................ | ***.......            5181000 | 591713       1409532          1729.3      2996.0     17299632
1825.09/459.50	c ................................ | ***.......            5293000 | 604592       1434978          1825.1      2900.1     17792360
1920.50/483.41	c ................................ | ****......            5396000 | 613532       1458384          1920.6      2809.6     18042354
2015.91/507.32	c ................................ | ****......            5526000 | 624001       1482235          2016.0      2741.1     18240408
2115.74/532.33	c ................................ | ****......            5617000 | 633650       1498741          2115.8      2654.7     18515281
2208.39/555.51	c ................................ | ****......            5665000 | 640594       1505734          2208.4      2565.2     18759466
2303.82/579.46	c ................................ | ****......            5702000 | 646579       1509373          2304.1      2474.8     18964686
2400.02/603.51	c ................................ | *****.....            5849000 | 657994       1536152          2400.1      2437.0     19123618
2496.22/627.65	c ................................ | *****.....            5972000 | 668190       1559172          2496.4      2392.2     19359972
2591.62/651.59	c ................................ | *****.....            6102000 | 680053       1582199          2592.0      2354.1     19584995
2687.87/675.68	c ................................ | *****.....            6163000 | 687211       1589333          2688.2      2292.6     19704597
2784.09/699.71	c ................................ | *****.....            6247000 | 696378       1602180          2784.1      2243.8     19824054
2879.88/723.76	c ................................ | ******....            6491000 | 717565       1656009          2880.1      2253.7     20211907
2976.01/747.81	c ................................ | ******....            6739000 | 738564       1708004          2976.1      2264.4     20567369
3072.18/771.94	c ................................ | ******....            6938000 | 755678       1745021          3072.4      2258.2     20931245
3167.95/795.92	c ................................ | ******....            7119000 | 770994       1776995          3168.0      2247.1     21243265
3264.12/820.02	c ................................ | ******....            7351000 | 791010       1826745          3264.2      2252.0     21711760
3359.90/844.05	c ................................ | *******...            7529000 | 806085       1862251          3360.1      2240.7     22063736
3455.69/868.08	c ................................ | *******...            7671000 | 818545       1889965          3456.0      2219.6     22387061
3551.92/892.12	c ................................ | *******...            7794000 | 829419       1914657          3552.0      2194.3     22645394
3647.69/916.18	c ................................ | *******...            7945000 | 842672       1943305          3648.0      2177.9     22956710
3744.26/940.37	c ................................ | *******...            8127000 | 858794       1967453          3744.6      2170.3     23206475
3840.44/964.41	c ................................ | ********..            8321000 | 875339       1992208          3840.5      2166.6     23431515
3936.25/988.48	c ................................ | ********..            8461000 | 887154       2010292          3936.6      2149.3     23601356
4032.05/1012.49	c ................................ | ********..            8615000 | 901975       2034786          4032.4      2136.4     23913068
4129.49/1036.85	c ................................ | ********..            8703000 | 911521       2046017          4129.7      2107.4     24204024
4224.52/1060.61	c ................................ | ********..            8793000 | 920856       2055594          4224.6      2081.4     24489328
4320.38/1084.63	c ................................ | *********.            8908000 | 931156       2066700          4320.5      2061.8     24716802
4416.14/1108.69	c ................................ | *********.            9043000 | 944571       2106103          4416.5      2047.5     25038579
4511.94/1132.69	c ................................ | *********.            9165000 | 957136       2143988          4512.3      2031.1     25510481
4607.74/1156.68	c ................................ | *********.            9292000 | 969360       2178507          4608.1      2016.5     25881519
4703.91/1180.76	c ................................ | *********.            9437000 | 983756       2221568          4704.1      2006.1     26302664
4799.72/1204.78	c CPU limit (4800) reached
4799.72/1204.78	c Time = 4800.06 seconds
4799.72/1204.78	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3249680-1304065018/watcher-3249680-1304065018 -o /tmp/evaluation-result-3249680-1304065018/solver-3249680-1304065018 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3249680-1304065018.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.74 8.00 7.91 5/181 29715
/proc/meminfo: memFree=17798552/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=9540 CPUtime=0 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) R 29713 29715 28847 0 -1 4202496 454 0 0 0 0 0 0 0 25 0 1 0 518100655 9768960 396 33554432000 4194304 4338100 140735648388016 18446744073709551615 4223897 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29715/statm: 2385 397 147 36 0 290 0

[startup+0.0519249 s]
/proc/loadavg: 7.74 8.00 7.91 5/181 29715
/proc/meminfo: memFree=17798552/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=15256 CPUtime=0.04 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) R 29713 29715 28847 0 -1 4202496 1892 0 0 0 4 0 0 0 25 0 1 0 518100655 15622144 1834 33554432000 4194304 4338100 140735648388016 18446744073709551615 268272349893 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29715/statm: 3847 1835 148 36 0 1752 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 15256

[startup+0.100917 s]
/proc/loadavg: 7.74 8.00 7.91 5/181 29715
/proc/meminfo: memFree=17798552/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=21400 CPUtime=0.09 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) R 29713 29715 28847 0 -1 4202496 3364 0 0 0 9 0 0 0 25 0 1 0 518100655 21913600 3306 33554432000 4194304 4338100 140735648388016 18446744073709551615 268272349893 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29715/statm: 5350 3307 148 36 0 3255 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 21400

[startup+0.300885 s]
/proc/loadavg: 7.74 8.00 7.91 5/181 29715
/proc/meminfo: memFree=17798552/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=51816 CPUtime=0.29 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) R 29713 29715 28847 0 -1 4202496 10665 0 0 0 28 1 0 0 25 0 1 0 518100655 53059584 10607 33554432000 4194304 4338100 140735648388016 18446744073709551615 268272385803 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29715/statm: 12954 10616 151 36 0 10859 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 51816

[startup+0.700809 s]
/proc/loadavg: 7.74 8.00 7.91 5/181 29715
/proc/meminfo: memFree=17798552/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=109896 CPUtime=0.69 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) R 29713 29715 28847 0 -1 4202496 22304 0 0 0 67 2 0 0 25 0 1 0 518100655 112533504 21663 33554432000 4194304 4338100 140735648388016 18446744073709551615 4206976 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29715/statm: 27474 21663 733 36 0 25379 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 109896

[startup+1.50067 s]
/proc/loadavg: 7.74 8.00 7.91 6/182 29716
/proc/meminfo: memFree=17750564/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=63200 CPUtime=1.49 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) R 29713 29715 28847 0 -1 4202496 27344 0 0 0 146 3 0 0 25 0 1 0 518100655 64716800 13829 33554432000 4194304 4338100 140735648388016 18446744073709551615 4245192 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/29715/statm: 15800 13830 155 36 0 13705 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 63200

[startup+3.10038 s]
/proc/loadavg: 7.74 8.00 7.91 6/182 29716
/proc/meminfo: memFree=17723408/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=295608 CPUtime=4.13 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 40952 0 0 0 407 6 0 0 25 0 5 0 518100655 302702592 26421 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 73902 26421 176 36 0 71807 0
Current children cumulated CPU time (s) 4.13
Current children cumulated vsize (KiB) 295608

[startup+6.30082 s]
/proc/loadavg: 7.76 8.00 7.91 9/186 29720
/proc/meminfo: memFree=17657532/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=374580 CPUtime=16.89 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 45440 0 0 0 1670 19 0 0 25 0 5 0 518100655 383569920 30909 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 93645 30909 176 36 0 91550 0
[pid=29715/tid=29717] ppid=29713 vsize=374580 CPUtime=3.54 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 1114 0 0 0 351 3 0 0 19 0 5 0 518100930 383569920 30909 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=374580 CPUtime=3.52 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 2732 0 0 0 349 3 0 0 18 0 5 0 518100930 383569920 30909 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254337 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=374580 CPUtime=3.53 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 929 0 0 0 351 2 0 0 19 0 5 0 518100930 383569920 30909 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=374580 CPUtime=3.51 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 741 0 0 0 348 3 0 0 25 0 5 0 518100930 383569920 30909 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254342 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16.89
Current children cumulated vsize (KiB) 374580

[startup+12.7007 s]
/proc/loadavg: 7.78 8.00 7.91 9/186 29720
/proc/meminfo: memFree=17614664/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=393876 CPUtime=42.37 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 50452 0 0 0 4186 51 0 0 25 0 5 0 518100655 403329024 35921 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 98469 35921 176 36 0 96374 0
[pid=29715/tid=29717] ppid=29713 vsize=393876 CPUtime=9.94 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 2099 0 0 0 986 8 0 0 25 0 5 0 518100930 403329024 35921 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284514997 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=393876 CPUtime=9.88 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 4176 0 0 0 977 11 0 0 21 0 5 0 518100930 403329024 35921 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284514997 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=393876 CPUtime=9.91 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 2277 0 0 0 979 12 0 0 21 0 5 0 518100930 403329024 35921 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284514997 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=393876 CPUtime=9.86 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 1976 0 0 0 974 12 0 0 18 0 5 0 518100930 403329024 35921 33554432000 4194304 4338100 140735648388016 18446744073709551615 4255963 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 42.37
Current children cumulated vsize (KiB) 393876

[startup+25.5004 s]
/proc/loadavg: 7.76 7.98 7.90 9/186 29721
/proc/meminfo: memFree=17538760/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=435860 CPUtime=93.33 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 62199 0 0 0 9222 111 0 0 25 0 5 0 518100655 446320640 47668 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 108965 47668 176 36 0 106870 0
[pid=29715/tid=29717] ppid=29713 vsize=435860 CPUtime=22.72 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 3362 0 0 0 2253 19 0 0 25 0 5 0 518100930 446320640 47668 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284514997 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=435860 CPUtime=22.6 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 6729 0 0 0 2237 23 0 0 20 0 5 0 518100930 446320640 47668 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=435860 CPUtime=22.66 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 6196 0 0 0 2235 31 0 0 18 0 5 0 518100930 446320640 47668 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=435860 CPUtime=22.57 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 5988 0 0 0 2227 30 0 0 18 0 5 0 518100930 446320640 47668 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 93.33
Current children cumulated vsize (KiB) 435860

[startup+51.1008 s]
/proc/loadavg: 7.92 8.00 7.91 9/186 29721
/proc/meminfo: memFree=17447016/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=485176 CPUtime=195.39 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 74952 0 0 0 19327 212 0 0 25 0 5 0 518100655 496820224 60421 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 121294 60421 176 36 0 119199 0
[pid=29715/tid=29717] ppid=29713 vsize=485176 CPUtime=48.26 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 4550 0 0 0 4791 35 0 0 18 0 5 0 518100930 496820224 60421 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=485176 CPUtime=48.11 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 7744 0 0 0 4768 43 0 0 20 0 5 0 518100930 496820224 60421 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=485176 CPUtime=48.17 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 11984 0 0 0 4752 65 0 0 18 0 5 0 518100930 496820224 60421 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=485176 CPUtime=48.06 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 10750 0 0 0 4745 61 0 0 25 0 5 0 518100930 496820224 60421 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 195.39
Current children cumulated vsize (KiB) 485176

[startup+102.307 s]
/proc/loadavg: 7.93 7.98 7.91 10/186 29786
/proc/meminfo: memFree=21470904/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=605612 CPUtime=399.43 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 106751 0 0 0 39503 440 0 0 25 0 5 0 518100655 620146688 92220 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 151403 92220 176 36 0 149308 0
[pid=29715/tid=29717] ppid=29713 vsize=605612 CPUtime=99.26 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 9647 0 0 0 9844 82 0 0 25 0 5 0 518100930 620146688 92220 33554432000 4194304 4338100 140735648388016 18446744073709551615 268272084718 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=605612 CPUtime=99.13 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 13845 0 0 0 9814 99 0 0 25 0 5 0 518100930 620146688 92220 33554432000 4194304 4338100 140735648388016 18446744073709551615 268272084706 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=605612 CPUtime=99.26 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 22378 0 0 0 9796 130 0 0 25 0 5 0 518100930 620146688 92220 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=605612 CPUtime=98.99 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 20957 0 0 0 9778 121 0 0 18 0 5 0 518100930 620146688 92220 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254462 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 399.43
Current children cumulated vsize (KiB) 605612

[startup+162.301 s]
/proc/loadavg: 8.08 8.02 7.92 9/186 29787
/proc/meminfo: memFree=20930492/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=690764 CPUtime=638.85 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 127987 0 0 0 63337 548 0 0 25 0 5 0 518100655 707342336 113456 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 172691 113456 176 36 0 170596 0
[pid=29715/tid=29717] ppid=29713 vsize=690764 CPUtime=158.92 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 10806 0 0 0 15774 118 0 0 25 0 5 0 518100930 707342336 113456 33554432000 4194304 4338100 140735648388016 18446744073709551615 268272385760 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=690764 CPUtime=159.1 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 15232 0 0 0 15777 133 0 0 25 0 5 0 518100930 707342336 113456 33554432000 4194304 4338100 140735648388016 18446744073709551615 268272083997 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=690764 CPUtime=159.26 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 31631 0 0 0 15773 153 0 0 25 0 5 0 518100930 707342336 113456 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254239 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=690764 CPUtime=158.79 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 30394 0 0 0 15743 136 0 0 18 0 5 0 518100930 707342336 113456 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254362 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 638.85
Current children cumulated vsize (KiB) 690764

[startup+222.3 s]
/proc/loadavg: 8.14 8.04 7.93 9/186 29789
/proc/meminfo: memFree=20534668/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=753984 CPUtime=878.23 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 144572 0 0 0 87173 650 0 0 25 0 5 0 518100655 772079616 130041 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 188496 130041 176 36 0 186401 0
[pid=29715/tid=29717] ppid=29713 vsize=753984 CPUtime=218.57 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 12062 0 0 0 21703 154 0 0 25 0 5 0 518100930 772079616 130041 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=753984 CPUtime=219.07 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 16680 0 0 0 21740 167 0 0 25 0 5 0 518100930 772079616 130041 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254221 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=753984 CPUtime=219.25 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 38285 0 0 0 21752 173 0 0 25 0 5 0 518100930 772079616 130041 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=753984 CPUtime=218.55 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 37621 0 0 0 21707 148 0 0 18 0 5 0 518100930 772079616 130041 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254362 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 878.23
Current children cumulated vsize (KiB) 753984

################
# More data... #
################

/proc/meminfo: memFree=18842868/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=1001532 CPUtime=2794.46 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 207616 0 0 0 278338 1108 0 0 25 0 5 0 518100655 1025568768 193085 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 250383 193085 176 36 0 248288 0
[pid=29715/tid=29717] ppid=29713 vsize=1001532 CPUtime=696.54 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 15802 0 0 0 69357 297 0 0 25 0 5 0 518100930 1025568768 193085 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254384 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=1001532 CPUtime=698.36 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 21924 0 0 0 69531 305 0 0 22 0 5 0 518100930 1025568768 193085 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254294 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=1001532 CPUtime=699.26 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 62089 0 0 0 69643 283 0 0 25 0 5 0 518100930 1025568768 193085 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254221 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=1001532 CPUtime=697.54 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 67877 0 0 0 69538 216 0 0 18 0 5 0 518100930 1025568768 193085 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2794.46
Current children cumulated vsize (KiB) 1001532

[startup+762.306 s]
/proc/loadavg: 8.20 8.13 8.01 9/186 29803
/proc/meminfo: memFree=18637880/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=1029684 CPUtime=3033.89 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 215272 0 0 0 302188 1201 0 0 25 0 5 0 518100655 1054396416 200741 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 257421 200741 176 36 0 255326 0
[pid=29715/tid=29717] ppid=29713 vsize=1029684 CPUtime=756.19 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 16723 0 0 0 75292 327 0 0 25 0 5 0 518100930 1054396416 200741 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=1029684 CPUtime=758.34 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 23271 0 0 0 75499 335 0 0 25 0 5 0 518100930 1054396416 200741 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=1029684 CPUtime=759.26 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 63154 0 0 0 75623 303 0 0 25 0 5 0 518100930 1054396416 200741 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284514997 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=1029684 CPUtime=757.3 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 72200 0 0 0 75502 228 0 0 19 0 5 0 518100930 1054396416 200741 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284514997 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3033.89
Current children cumulated vsize (KiB) 1029684

[startup+822.301 s]
/proc/loadavg: 8.15 8.14 8.02 9/186 29805
/proc/meminfo: memFree=18519700/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=1060964 CPUtime=3273.29 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 223635 0 0 0 326046 1283 0 0 25 0 5 0 518100655 1086427136 209104 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 265241 209104 176 36 0 263146 0
[pid=29715/tid=29717] ppid=29713 vsize=1060964 CPUtime=815.84 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 17608 0 0 0 81230 354 0 0 25 0 5 0 518100930 1086427136 209104 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=1060964 CPUtime=818.32 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 24554 0 0 0 81471 361 0 0 25 0 5 0 518100930 1086427136 209104 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=1060964 CPUtime=819.26 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 66205 0 0 0 81603 323 0 0 25 0 5 0 518100930 1086427136 209104 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=1060964 CPUtime=817.1 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 75344 0 0 0 81472 238 0 0 18 0 5 0 518100930 1086427136 209104 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254254 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3273.29
Current children cumulated vsize (KiB) 1060964

[startup+882.301 s]
/proc/loadavg: 8.17 8.14 8.02 9/186 29807
/proc/meminfo: memFree=18382916/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=1085988 CPUtime=3512.78 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 230000 0 0 0 349941 1337 0 0 25 0 5 0 518100655 1112051712 215469 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 271497 215469 176 36 0 269402 0
[pid=29715/tid=29717] ppid=29713 vsize=1085988 CPUtime=875.52 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 18171 0 0 0 87181 371 0 0 18 0 5 0 518100930 1112051712 215469 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=1085988 CPUtime=878.31 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 25236 0 0 0 87455 376 0 0 25 0 5 0 518100930 1112051712 215469 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=1085988 CPUtime=879.26 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 68670 0 0 0 87586 340 0 0 25 0 5 0 518100930 1112051712 215469 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284514997 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=1085988 CPUtime=876.9 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 77999 0 0 0 87447 243 0 0 23 0 5 0 518100930 1112051712 215469 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284514997 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3512.78
Current children cumulated vsize (KiB) 1085988

[startup+942.3 s]
/proc/loadavg: 8.10 8.13 8.02 9/186 29808
/proc/meminfo: memFree=18354004/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=1104756 CPUtime=3752.24 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 235674 0 0 0 373831 1393 0 0 25 0 5 0 518100655 1131270144 221143 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 276189 221143 176 36 0 274094 0
[pid=29715/tid=29717] ppid=29713 vsize=1104756 CPUtime=935.2 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 18509 0 0 0 93132 388 0 0 25 0 5 0 518100930 1131270144 221143 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=1104756 CPUtime=938.31 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 25236 0 0 0 93437 394 0 0 25 0 5 0 518100930 1131270144 221143 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254362 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=1104756 CPUtime=939.26 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 71095 0 0 0 93571 355 0 0 25 0 5 0 518100930 1131270144 221143 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=1104756 CPUtime=936.7 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 80910 0 0 0 93421 249 0 0 19 0 5 0 518100930 1131270144 221143 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254429 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3752.24
Current children cumulated vsize (KiB) 1104756

[startup+1002.3 s]
/proc/loadavg: 8.15 8.13 8.03 9/186 29810
/proc/meminfo: memFree=18310588/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=1126652 CPUtime=3991.72 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 240577 0 0 0 397720 1452 0 0 25 0 5 0 518100655 1153691648 226046 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 281663 226046 176 36 0 279568 0
[pid=29715/tid=29717] ppid=29713 vsize=1126652 CPUtime=994.86 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 18613 0 0 0 99081 405 0 0 25 0 5 0 518100930 1153691648 226046 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=1126652 CPUtime=998.3 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 25250 0 0 0 99419 411 0 0 19 0 5 0 518100930 1153691648 226046 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=1126652 CPUtime=999.26 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 73280 0 0 0 99554 372 0 0 25 0 5 0 518100930 1153691648 226046 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254342 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=1126652 CPUtime=996.51 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 83510 0 0 0 99395 256 0 0 20 0 5 0 518100930 1153691648 226046 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284514997 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3991.72
Current children cumulated vsize (KiB) 1126652

[startup+1062.3 s]
/proc/loadavg: 8.12 8.12 8.03 9/186 29811
/proc/meminfo: memFree=18259728/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=1145420 CPUtime=4231.31 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 246077 0 0 0 421637 1494 0 0 25 0 5 0 518100655 1172910080 231546 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 286355 231546 176 36 0 284260 0
[pid=29715/tid=29717] ppid=29713 vsize=1145420 CPUtime=1054.72 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 19388 0 0 0 105055 417 0 0 25 0 5 0 518100930 1172910080 231546 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=1145420 CPUtime=1058.11 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 25475 0 0 0 105388 423 0 0 25 0 5 0 518100930 1172910080 231546 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254451 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=1145420 CPUtime=1059.27 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 75285 0 0 0 105544 383 0 0 25 0 5 0 518100930 1172910080 231546 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=1145420 CPUtime=1056.44 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 86005 0 0 0 105380 264 0 0 22 0 5 0 518100930 1172910080 231546 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4231.31
Current children cumulated vsize (KiB) 1145420

[startup+1122.3 s]
/proc/loadavg: 8.11 8.11 8.03 9/186 29813
/proc/meminfo: memFree=18157524/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=1174180 CPUtime=4470.83 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 252779 0 0 0 445527 1556 0 0 25 0 5 0 518100655 1202360320 238248 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 293545 238248 176 36 0 291450 0
[pid=29715/tid=29717] ppid=29713 vsize=1174180 CPUtime=1114.71 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 19987 0 0 0 111034 437 0 0 25 0 5 0 518100930 1202360320 238248 33554432000 4194304 4338100 140735648388016 18446744073709551615 268272687163 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=1174180 CPUtime=1117.78 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 26057 0 0 0 111333 445 0 0 20 0 5 0 518100930 1202360320 238248 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254384 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=1174180 CPUtime=1119.27 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 78237 0 0 0 111531 396 0 0 25 0 5 0 518100930 1202360320 238248 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=1174180 CPUtime=1116.3 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 88574 0 0 0 111359 271 0 0 18 0 5 0 518100930 1202360320 238248 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284514997 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4470.83
Current children cumulated vsize (KiB) 1174180

[startup+1182.3 s]
/proc/loadavg: 8.04 8.09 8.02 9/186 29815
/proc/meminfo: memFree=17975352/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=1205592 CPUtime=4710.29 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) S 29713 29715 28847 0 -1 4202496 261259 0 0 0 469401 1628 0 0 25 0 5 0 518100655 1234526208 246728 33554432000 4194304 4338100 140735648388016 18446744073709551615 268284491749 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 301398 246728 176 36 0 299303 0
[pid=29715/tid=29717] ppid=29713 vsize=1205592 CPUtime=1174.68 cores=0,2,4,6
/proc/29715/task/29717/stat : 29717 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 20031 0 0 0 117008 460 0 0 20 0 5 0 518100930 1234526208 246728 33554432000 4194304 4338100 140735648388016 18446744073709551615 4206915 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=29715/tid=29718] ppid=29713 vsize=1205592 CPUtime=1177.45 cores=0,2,4,6
/proc/29715/task/29718/stat : 29718 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 26932 0 0 0 117277 468 0 0 18 0 5 0 518100930 1234526208 246728 33554432000 4194304 4338100 140735648388016 18446744073709551615 268272084237 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=1205592 CPUtime=1179.26 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 81645 0 0 0 117514 412 0 0 25 0 5 0 518100930 1234526208 246728 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=29715/tid=29720] ppid=29713 vsize=1205592 CPUtime=1176.1 cores=0,2,4,6
/proc/29715/task/29720/stat : 29720 (ttsth-5-4) R 29713 29715 28847 0 -1 4202560 92727 0 0 0 117330 280 0 0 18 0 5 0 518100930 1234526208 246728 33554432000 4194304 4338100 140735648388016 18446744073709551615 4254421 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4710.29
Current children cumulated vsize (KiB) 1205592



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.8 s]
/proc/loadavg: 8.02 8.08 8.02 6/183 29815
/proc/meminfo: memFree=18225336/32950928 swapFree=67111524/67111528
[pid=29715] ppid=29713 vsize=0 CPUtime=4800.08 cores=0,2,4,6
/proc/29715/stat : 29715 (ttsth-5-4) Z 29713 29715 28847 0 -1 4203548 263716 0 0 0 478356 1652 0 0 18 0 2 0 518100655 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/29715/statm: 0 0 0 0 0 0 0
[pid=29715/tid=29719] ppid=29713 vsize=0 CPUtime=1201.77 cores=0,2,4,6
/proc/29715/task/29719/stat : 29719 (ttsth-5-4) R 29713 29715 28847 0 -1 4203588 82728 0 0 0 119756 421 0 0 25 0 2 0 518100930 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.08
Current children cumulated vsize (KiB) 0

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1204.84
CPU time (s): 4800.12
CPU user time (s): 4783.57
CPU system time (s): 16.5535
CPU usage (%): 398.405
Max. virtual memory (cumulated for all children) (KiB): 1211980

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4783.57
system time used= 16.5535
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 263716
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 48205
involuntary context switches= 19011

runsolver used 1.9907 second user time and 4.40133 second system time

The end

Launcher Data 

Begin job on node122 at 2011-04-29 10:16:59
IDJOB=3249680
IDBENCH=83180
IDSOLVER=1654
FILE ID=node122/3249680-1304065018
RUNJOBID= node122-1304063811-29553
PBS_JOBID= 13170447
Free space on /tmp= 71656 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-14x38.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3249680-1304065018/watcher-3249680-1304065018 -o /tmp/evaluation-result-3249680-1304065018/solver-3249680-1304065018 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3249680-1304065018.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 56980124bab6f1dbe07ec523b7d59019
RANDOM SEED=125594612

node122.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.97
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17798840 kB
Buffers:       1625572 kB
Cached:        8548824 kB
SwapCached:          4 kB
Active:        5357768 kB
Inactive:      9236996 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17798840 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            6276 kB
Writeback:           0 kB
AnonPages:     4419968 kB
Mapped:          15408 kB
Slab:           485860 kB
PageTables:      13296 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  4629868 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71656 MiB
End job on node122 at 2011-04-29 10:37:05