Trace number 3257602

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.26 1202.34

General information on the benchmark

NameCRAFTED/modcircuits/
mod4block_2vars_8gates_u2.cnf
MD5SUMa5bb71bc1d85a401ce9f42ed1404d63e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark238.524
Satisfiable
(Un)Satisfiability was proved
Number of variables387
Number of clauses62656
Sum of the clauses size362132
Maximum clause length24
Minimum clause length1
Number of clauses of size 164
Number of clauses of size 21453
Number of clauses of size 30
Number of clauses of size 41977
Number of clauses of size 53842
Number of clauses of size over 555320

Solver Data 

0.01/0.09	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3257602-1304046751.cnf 
0.01/0.09	c Using SATTIMEOUT of 4800
0.01/0.09	c Using SATRAM of 15500
0.01/0.09	c Size of subset node = 32
0.01/0.09	c Variables = 387
0.01/0.09	c Clauses = 62656
0.01/0.09	c Literals = 362132
0.01/0.09	c Reduced size:
0.01/0.09	c Variables = 387
0.01/0.09	c Clauses = 37691
0.01/0.09	c Literals = 192764
0.01/0.09	c a2
0.19/0.22	c a1
0.39/0.44	c Independent sub-problems = 1
0.39/0.44	c Sub-problem with 296 variables and 37691 clauses
0.39/0.44	c using permutation method 4
0.39/0.44	c count = 1
0.39/0.44	c Ordering finished 0.420 seconds
0.39/0.44	c mapped 0.430 seconds
0.39/0.44	c permuted 0.430 seconds
0.39/0.44	c about to sort
0.39/0.45	c sorted
0.49/0.51	c clauses now 37691
0.49/0.51	c init finished 0.450 seconds
0.49/0.51	c tree built 0.500 seconds
0.49/0.51	c 
0.49/0.51	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
0.49/0.51	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
0.49/0.51	c ................................ | ..........                    |                                  0.5         0.0             
0.49/0.51	c ................................ | ..........                  1 |                                  0.5         2.0             
0.49/0.51	c ................................ | ..........                  2 |                                  0.5         4.0             
0.49/0.51	c ................................ | ..........                  3 |                                  0.5         6.0             
0.49/0.51	c ................................ | ..........                  4 |                                  0.5         8.0             
0.49/0.51	c ................................ | ..........                  5 |                                  0.5        10.0             
0.49/0.52	c ................................ | ..........               1000 | 1            914                 0.5      1886.8         4458
95.90/24.43	c ................................ | ..........            1407000 | 105470       889630             96.1     14647.1     11799560
191.76/48.48	c ................................ | ..........            2372000 | 185974       1445563           192.1     12348.4     18007524
288.02/72.50	c ................................ | ..........            3139000 | 254819       1864798           288.0     10898.2     23902633
383.88/96.54	c ................................ | ..........            3908000 | 318163       2298540           384.1     10175.5     29513421
479.74/120.57	c ................................ | *.........            4610000 | 384695       2678085           480.0      9603.4     34052802
576.03/144.61	c ................................ | *.........            5190000 | 441255       3013817           576.0      9009.8     38919368
671.88/168.64	c ................................ | *.........            5780000 | 494979       3336772           672.0      8600.6     42960704
768.14/192.72	c ................................ | *.........            6329000 | 546254       3635223           768.2      8238.5     47553154
864.00/216.71	c ................................ | *.........            6859000 | 603383       3894935           864.1      7937.9     51728597
959.86/240.75	c ................................ | **........            7348000 | 653753       4162955           960.1      7653.4     55769058
1055.73/264.78	c ................................ | **........            7883000 | 702634       4419255          1056.1      7464.4     59699327
1151.99/288.86	c ................................ | **........            8342000 | 746230       4654215          1152.3      7239.6     62887791
1247.84/312.87	c ................................ | **........            8858000 | 801178       4905870          1248.1      7097.1     65925727
1344.08/336.90	c ................................ | **........            9333000 | 850175       5152729          1344.1      6943.6     67537814
1439.93/360.98	c ................................ | ***.......            9611000 | 879832       5339079          1440.3      6673.0     70582499
1535.81/384.99	c ................................ | ***.......            9977000 | 917340       5548779          1536.2      6494.7     74048792
1632.06/409.02	c ................................ | ***.......           10238000 | 946082       5709927          1632.2      6272.7     76411674
1727.93/433.04	c ................................ | ***.......           10610000 | 983864       5881464          1728.1      6139.8     78074841
1824.17/457.13	c ................................ | ***.......           10957000 | 1024602      6050610          1824.3      6006.1     80560786
1920.05/481.17	c ................................ | ****......           11311000 | 1064274      6206468          1920.3      5890.1     82241734
2015.90/505.17	c ................................ | ****......           11633000 | 1097540      6388255          2016.2      5769.8     85090535
2112.17/529.28	c ................................ | ****......           11999000 | 1134634      6568005          2112.5      5680.0     87086650
2208.04/553.24	c ................................ | ****......           12305000 | 1166939      6716169          2208.2      5572.4     89597062
2303.91/577.25	c ................................ | ****......           12642000 | 1205036      6868561          2304.1      5486.7     92181285
2399.78/601.26	c ................................ | *****.....           13007000 | 1244704      7052047          2400.0      5419.5     95242611
2496.04/625.32	c ................................ | *****.....           13266000 | 1272523      7211962          2496.1      5314.6     97483175
2591.87/649.38	c ................................ | *****.....           13535000 | 1300933      7366996          2592.2      5221.4     98680291
2689.27/673.70	c ................................ | *****.....           13832000 | 1334335      7529096          2689.3      5143.4     99219556
2783.91/697.44	c ................................ | *****.....           14078000 | 1360905      7674014          2784.1      5056.6     99616969
2880.18/721.50	c ................................ | ******....           14379000 | 1391690      7819220          2880.2      4992.4    100059903
2976.05/745.51	c ................................ | ******....           14741000 | 1436364      7971168          2976.1      4953.1    102496692
3071.92/769.53	c ................................ | ******....           15072000 | 1473319      8107382          3072.1      4906.2    104348148
3167.76/793.58	c ................................ | ******....           15354000 | 1505311      8258057          3168.1      4846.4    105515863
3264.00/817.62	c ................................ | ******....           15715000 | 1542476      8436672          3264.1      4814.5    105515863
3359.87/841.66	c ................................ | *******...           16015000 | 1572395      8579199          3360.1      4766.2    105515863
3456.10/865.74	c ................................ | *******...           16312000 | 1606373      8723483          3456.3      4719.6    105684557
3551.97/889.72	c ................................ | *******...           16645000 | 1643946      8886310          3552.1      4686.0    106429932
3647.84/913.76	c ................................ | *******...           16936000 | 1678220      9031502          3648.1      4642.4    107505893
3744.10/937.80	c ................................ | *******...           17201000 | 1704079      9158090          3744.1      4594.1    108834841
3840.40/961.92	c ................................ | ********..           17440000 | 1728381      9288770          3840.5      4541.1    111083773
3935.85/985.89	c ................................ | ********..           17705000 | 1755280      9427741          3936.2      4498.0    113234042
4032.12/1009.97	c ................................ | ********..           18001000 | 1791473      9546224          4032.4      4464.1    114282972
4127.99/1033.91	c ................................ | ********..           18208000 | 1814298      9651215          4128.0      4410.8    115655961
4224.26/1058.00	c ................................ | ********..           18476000 | 1842694      9770341          4224.3      4373.8    116909146
4319.73/1081.96	c ................................ | *********.           18742000 | 1875486      9880676          4320.0      4338.4    117778631
4416.01/1106.06	c ................................ | *********.           19041000 | 1911467      9988060          4416.2      4311.6    118062995
4512.28/1130.13	c ................................ | *********.           19283000 | 1942632      10099311         4512.4      4273.3    119501428
4608.13/1154.12	c ................................ | *********.           19542000 | 1975786      10206146         4608.2      4240.7    120099069
4704.40/1178.22	c ................................ | *********.           19759000 | 2004009      10306925         4704.5      4200.0    122036752
4799.81/1202.17	c CPU limit (4800) reached
4799.81/1202.17	c Time = 4800.09 seconds
4799.81/1202.17	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3257602-1304046751/watcher-3257602-1304046751 -o /tmp/evaluation-result-3257602-1304046751/solver-3257602-1304046751 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3257602-1304046751.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.30 3.60 3.59 2/174 4055
/proc/meminfo: memFree=22210820/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=9244 CPUtime=0 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) R 4053 4055 1895 0 -1 4202496 381 0 0 0 0 0 0 0 23 0 1 0 497090461 9465856 323 33554432000 4194304 4338100 140733257981568 18446744073709551615 254261277381 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/4055/statm: 2311 324 147 36 0 216 0

[startup+0.016715 s]
/proc/loadavg: 3.30 3.60 3.59 2/174 4055
/proc/meminfo: memFree=22210820/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=10164 CPUtime=0.01 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) R 4053 4055 1895 0 -1 4202496 618 0 0 0 1 0 0 0 23 0 1 0 497090461 10407936 560 33554432000 4194304 4338100 140733257981568 18446744073709551615 254261277381 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/4055/statm: 2574 561 147 36 0 479 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 10164

[startup+0.100703 s]
/proc/loadavg: 3.30 3.60 3.59 2/174 4055
/proc/meminfo: memFree=22210820/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=19360 CPUtime=0.09 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) R 4053 4055 1895 0 -1 4202496 2722 0 0 0 9 0 0 0 23 0 1 0 497090461 19824640 2663 33554432000 4194304 4338100 140733257981568 18446744073709551615 254261313291 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/4055/statm: 4840 2669 185 36 0 2745 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 19360

[startup+0.300668 s]
/proc/loadavg: 3.30 3.60 3.59 2/174 4055
/proc/meminfo: memFree=22210820/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=18656 CPUtime=0.29 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) R 4053 4055 1895 0 -1 4202496 4903 0 0 0 29 0 0 0 25 0 1 0 497090461 19103744 2684 33554432000 4194304 4338100 140733257981568 18446744073709551615 4245205 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/4055/statm: 4664 2685 155 36 0 2569 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 18656

[startup+1.29245 s]
/proc/loadavg: 3.30 3.60 3.59 2/174 4055
/proc/meminfo: memFree=22210820/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=230724 CPUtime=3.62 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 13356 0 0 0 359 3 0 0 25 0 5 0 497090461 236261376 11062 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 57681 11062 176 36 0 55586 0
Current children cumulated CPU time (s) 3.62
Current children cumulated vsize (KiB) 230724

[startup+1.50042 s]
/proc/loadavg: 3.30 3.60 3.59 6/182 4066
/proc/meminfo: memFree=22130116/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=233984 CPUtime=4.46 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 14668 0 0 0 442 4 0 0 25 0 5 0 497090461 239599616 12374 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 58496 12374 176 36 0 56401 0
[pid=4055/tid=4063] ppid=4053 vsize=233984 CPUtime=0.98 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 2401 0 0 0 97 1 0 0 18 0 5 0 497090512 239599616 12377 33554432000 4194304 4338100 140733257981568 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=233984 CPUtime=0.98 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 1390 0 0 0 98 0 0 0 19 0 5 0 497090512 239599616 12378 33554432000 4194304 4338100 140733257981568 18446744073709551615 4206915 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=233984 CPUtime=0.98 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 1296 0 0 0 97 1 0 0 25 0 5 0 497090512 239599616 12378 33554432000 4194304 4338100 140733257981568 18446744073709551615 254261012206 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=233984 CPUtime=0.97 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 1995 0 0 0 97 0 0 0 19 0 5 0 497090512 239599616 12379 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273429286 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.46
Current children cumulated vsize (KiB) 233984

[startup+3.10114 s]
/proc/loadavg: 3.30 3.60 3.59 9/186 4070
/proc/meminfo: memFree=22042716/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=337848 CPUtime=10.83 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 24112 0 0 0 1071 12 0 0 25 0 5 0 497090461 345956352 21818 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 84462 21818 176 36 0 82367 0
[pid=4055/tid=4063] ppid=4053 vsize=337848 CPUtime=2.58 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 5238 0 0 0 255 3 0 0 20 0 5 0 497090512 345956352 21818 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=337848 CPUtime=2.58 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 3709 0 0 0 256 2 0 0 22 0 5 0 497090512 345956352 21818 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254407 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=337848 CPUtime=2.58 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 3068 0 0 0 255 3 0 0 25 0 5 0 497090512 345956352 21818 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=337848 CPUtime=2.56 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 4508 0 0 0 254 2 0 0 22 0 5 0 497090512 345956352 21818 33554432000 4194304 4338100 140733257981568 18446744073709551615 4198872 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 10.83
Current children cumulated vsize (KiB) 337848

[startup+6.30057 s]
/proc/loadavg: 3.68 3.68 3.62 9/186 4070
/proc/meminfo: memFree=21832684/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=401068 CPUtime=23.61 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 39890 0 0 0 2326 35 0 0 25 0 5 0 497090461 410693632 37596 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 100267 37596 176 36 0 98172 0
[pid=4055/tid=4063] ppid=4053 vsize=401068 CPUtime=5.77 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 10324 0 0 0 568 9 0 0 25 0 5 0 497090512 410693632 37596 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=401068 CPUtime=5.78 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 6721 0 0 0 571 7 0 0 25 0 5 0 497090512 410693632 37597 33554432000 4194304 4338100 140733257981568 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=401068 CPUtime=5.77 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 7004 0 0 0 568 9 0 0 25 0 5 0 497090512 410693632 37597 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=401068 CPUtime=5.74 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 8253 0 0 0 567 7 0 0 25 0 5 0 497090512 410693632 37597 33554432000 4194304 4338100 140733257981568 18446744073709551615 254261011847 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.61
Current children cumulated vsize (KiB) 401068

[startup+12.7004 s]
/proc/loadavg: 4.02 3.75 3.64 9/186 4071
/proc/meminfo: memFree=21524732/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=505692 CPUtime=49.17 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 66642 0 0 0 4828 89 0 0 25 0 5 0 497090461 517828608 64348 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 126423 64348 176 36 0 124328 0
[pid=4055/tid=4063] ppid=4053 vsize=505692 CPUtime=12.17 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 18124 0 0 0 1193 24 0 0 25 0 5 0 497090512 517828608 64348 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=505692 CPUtime=12.18 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 12671 0 0 0 1199 19 0 0 25 0 5 0 497090512 517828608 64348 33554432000 4194304 4338100 140733257981568 18446744073709551615 4240537 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=505692 CPUtime=12.17 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 13285 0 0 0 1195 22 0 0 18 0 5 0 497090512 517828608 64348 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=505692 CPUtime=12.11 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 14973 0 0 0 1190 21 0 0 25 0 5 0 497090512 517828608 64348 33554432000 4194304 4338100 140733257981568 18446744073709551615 4288180 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 49.17
Current children cumulated vsize (KiB) 505692

[startup+25.5012 s]
/proc/loadavg: 4.90 3.95 3.71 9/186 4071
/proc/meminfo: memFree=21121104/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=665072 CPUtime=100.31 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 106513 0 0 0 9840 191 0 0 25 0 5 0 497090461 681033728 104219 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 166268 104219 176 36 0 164173 0
[pid=4055/tid=4063] ppid=4053 vsize=665072 CPUtime=24.97 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 30228 0 0 0 2443 54 0 0 25 0 5 0 497090512 681033728 104219 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=665072 CPUtime=24.94 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 20601 0 0 0 2453 41 0 0 25 0 5 0 497090512 681033728 104219 33554432000 4194304 4338100 140733257981568 18446744073709551615 4255947 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=665072 CPUtime=24.97 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 23041 0 0 0 2448 49 0 0 25 0 5 0 497090512 681033728 104219 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=665072 CPUtime=24.87 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 25054 0 0 0 2444 43 0 0 25 0 5 0 497090512 681033728 104219 33554432000 4194304 4338100 140733257981568 18446744073709551615 4255938 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 100.31
Current children cumulated vsize (KiB) 665072

[startup+51.1066 s]
/proc/loadavg: 5.96 4.28 3.82 9/186 4072
/proc/meminfo: memFree=20377420/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=868788 CPUtime=202.56 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 159626 0 0 0 19861 395 0 0 25 0 5 0 497090461 889638912 157332 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 217197 157332 176 36 0 215102 0
[pid=4055/tid=4063] ppid=4053 vsize=868788 CPUtime=50.56 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 44766 0 0 0 4946 110 0 0 25 0 5 0 497090512 889638912 157332 33554432000 4194304 4338100 140733257981568 18446744073709551615 4253954 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=868788 CPUtime=50.43 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 32327 0 0 0 4956 87 0 0 25 0 5 0 497090512 889638912 157332 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=868788 CPUtime=50.58 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 37185 0 0 0 4955 103 0 0 19 0 5 0 497090512 889638912 157332 33554432000 4194304 4338100 140733257981568 18446744073709551615 4253954 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=868788 CPUtime=50.46 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 37759 0 0 0 4952 94 0 0 25 0 5 0 497090512 889638912 157332 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 202.56
Current children cumulated vsize (KiB) 868788

[startup+102.301 s]
/proc/loadavg: 7.19 4.87 4.04 9/186 4073
/proc/meminfo: memFree=19113232/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=1242476 CPUtime=407.05 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 255982 0 0 0 39928 777 0 0 25 0 5 0 497090461 1272295424 253688 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 310619 253688 176 36 0 308524 0
[pid=4055/tid=4063] ppid=4053 vsize=1242476 CPUtime=101.6 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 72605 0 0 0 9948 212 0 0 25 0 5 0 497090512 1272295424 253688 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=1242476 CPUtime=101.62 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 53333 0 0 0 9991 171 0 0 25 0 5 0 497090512 1272295424 253688 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=1242476 CPUtime=101.64 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 62412 0 0 0 9958 206 0 0 25 0 5 0 497090512 1272295424 253688 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254429 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=1242476 CPUtime=101.64 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 60043 0 0 0 9979 185 0 0 25 0 5 0 497090512 1272295424 253688 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 407.05
Current children cumulated vsize (KiB) 1242476

[startup+162.301 s]
/proc/loadavg: 7.80 5.46 4.30 9/186 4075
/proc/meminfo: memFree=17982096/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=1605852 CPUtime=646.71 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 347803 0 0 0 63444 1227 0 0 25 0 5 0 497090461 1644392448 345509 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 401463 345509 176 36 0 399368 0
[pid=4055/tid=4063] ppid=4053 vsize=1605852 CPUtime=161.59 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 100254 0 0 0 15831 328 0 0 25 0 5 0 497090512 1644392448 345509 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=1605852 CPUtime=161.62 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 71869 0 0 0 15885 277 0 0 25 0 5 0 497090512 1644392448 345509 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=1605852 CPUtime=161.31 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 87840 0 0 0 15808 323 0 0 25 0 5 0 497090512 1644392448 345509 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=1605852 CPUtime=161.64 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 80251 0 0 0 15867 297 0 0 25 0 5 0 497090512 1644392448 345509 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 646.71
Current children cumulated vsize (KiB) 1605852


################
# More data... #
################

/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 193748 0 0 0 69116 1043 0 0 25 0 5 0 497090512 3550998528 816511 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2803.5
Current children cumulated vsize (KiB) 3467772

[startup+762.301 s]
/proc/loadavg: 8.21 7.82 6.13 11/187 4094
/proc/meminfo: memFree=12035136/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=3604188 CPUtime=3043.16 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 853078 0 0 0 299818 4498 0 0 25 0 5 0 497090461 3690688512 850784 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 901047 850784 176 36 0 898952 0
[pid=4055/tid=4063] ppid=4053 vsize=3604188 CPUtime=761.37 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 261882 0 0 0 74966 1171 0 0 25 0 5 0 497090512 3690688512 850784 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=3604188 CPUtime=761.05 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 182820 0 0 0 75000 1105 0 0 25 0 5 0 497090512 3690688512 850784 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=3604188 CPUtime=758.61 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 199870 0 0 0 74742 1119 0 0 25 0 5 0 497090512 3690688512 850784 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=3604188 CPUtime=761.57 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 200917 0 0 0 75057 1100 0 0 25 0 5 0 497090512 3690688512 850784 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3043.16
Current children cumulated vsize (KiB) 3604188

[startup+822.301 s]
/proc/loadavg: 8.33 7.94 6.28 9/186 4095
/proc/meminfo: memFree=11689836/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=3684020 CPUtime=3282.77 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 875258 0 0 0 323486 4791 0 0 25 0 5 0 497090461 3772436480 872964 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 921005 872964 176 36 0 918910 0
[pid=4055/tid=4063] ppid=4053 vsize=3684020 CPUtime=821.36 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 270891 0 0 0 80882 1254 0 0 25 0 5 0 497090512 3772436480 872964 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=3684020 CPUtime=820.72 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 188830 0 0 0 80900 1172 0 0 25 0 5 0 497090512 3772436480 872964 33554432000 4194304 4338100 140733257981568 18446744073709551615 4206896 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=3684020 CPUtime=818.59 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 206408 0 0 0 80657 1202 0 0 25 0 5 0 497090512 3772436480 872964 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=3684020 CPUtime=821.55 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 201540 0 0 0 80995 1160 0 0 25 0 5 0 497090512 3772436480 872964 33554432000 4194304 4338100 140733257981568 18446744073709551615 4263499 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3282.77
Current children cumulated vsize (KiB) 3684020

[startup+882.3 s]
/proc/loadavg: 8.23 7.98 6.39 9/186 4097
/proc/meminfo: memFree=11570284/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=3706972 CPUtime=3522.41 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 881063 0 0 0 347170 5071 0 0 25 0 5 0 497090461 3795939328 878769 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 926743 878769 176 36 0 924648 0
[pid=4055/tid=4063] ppid=4053 vsize=3706972 CPUtime=881.36 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 276022 0 0 0 86804 1332 0 0 25 0 5 0 497090512 3795939328 878769 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=3706972 CPUtime=880.36 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 189030 0 0 0 86802 1234 0 0 25 0 5 0 497090512 3795939328 878769 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=3706972 CPUtime=878.59 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 206677 0 0 0 86583 1276 0 0 25 0 5 0 497090512 3795939328 878769 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=3706972 CPUtime=881.55 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 201745 0 0 0 86928 1227 0 0 25 0 5 0 497090512 3795939328 878769 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3522.41
Current children cumulated vsize (KiB) 3706972

[startup+942.301 s]
/proc/loadavg: 8.16 8.00 6.50 9/186 4098
/proc/meminfo: memFree=11325992/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=3804732 CPUtime=3762.08 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 906295 0 0 0 370849 5359 0 0 25 0 5 0 497090461 3896045568 904001 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 951183 904001 176 36 0 949088 0
[pid=4055/tid=4063] ppid=4053 vsize=3804732 CPUtime=941.36 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 286721 0 0 0 92728 1408 0 0 25 0 5 0 497090512 3896045568 904001 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=3804732 CPUtime=940.04 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 191996 0 0 0 92700 1304 0 0 25 0 5 0 497090512 3896045568 904001 33554432000 4194304 4338100 140733257981568 18446744073709551615 4286355 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=3804732 CPUtime=938.59 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 206900 0 0 0 92514 1345 0 0 25 0 5 0 497090512 3896045568 904001 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=3804732 CPUtime=941.55 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 213089 0 0 0 92855 1300 0 0 25 0 5 0 497090512 3896045568 904001 33554432000 4194304 4338100 140733257981568 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3762.08
Current children cumulated vsize (KiB) 3804732

[startup+1002.3 s]
/proc/loadavg: 8.06 8.00 6.59 9/186 4100
/proc/meminfo: memFree=11000960/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=3952672 CPUtime=4001.76 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 944356 0 0 0 394549 5627 0 0 25 0 5 0 497090461 4047536128 942062 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 988168 942062 176 36 0 986073 0
[pid=4055/tid=4063] ppid=4053 vsize=3952672 CPUtime=1001.37 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 296529 0 0 0 98661 1476 0 0 25 0 5 0 497090512 4047536128 942062 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254285 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=3952672 CPUtime=999.72 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 200640 0 0 0 98604 1368 0 0 25 0 5 0 497090512 4047536128 942062 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=3952672 CPUtime=998.59 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 216816 0 0 0 98443 1416 0 0 25 0 5 0 497090512 4047536128 942062 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=3952672 CPUtime=1001.55 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 222782 0 0 0 98790 1365 0 0 25 0 5 0 497090512 4047536128 942062 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4001.76
Current children cumulated vsize (KiB) 3952672

[startup+1062.3 s]
/proc/loadavg: 8.12 8.02 6.68 9/186 4102
/proc/meminfo: memFree=10757416/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=4053428 CPUtime=4241.44 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 968574 0 0 0 418279 5865 0 0 25 0 5 0 497090461 4150710272 966280 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 1013357 966280 176 36 0 1011262 0
[pid=4055/tid=4063] ppid=4053 vsize=4053428 CPUtime=1061.37 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 303974 0 0 0 104597 1540 0 0 25 0 5 0 497090512 4150710272 966280 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=4053428 CPUtime=1059.39 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 205036 0 0 0 104516 1423 0 0 25 0 5 0 497090512 4150710272 966280 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=4053428 CPUtime=1058.59 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 222729 0 0 0 104381 1478 0 0 25 0 5 0 497090512 4150710272 966280 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=4053428 CPUtime=1061.55 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 229246 0 0 0 104734 1421 0 0 25 0 5 0 497090512 4150710272 966280 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4241.44
Current children cumulated vsize (KiB) 4053428

[startup+1122.3 s]
/proc/loadavg: 8.22 8.06 6.78 9/186 4103
/proc/meminfo: memFree=10519436/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=4113652 CPUtime=4481.11 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 984960 0 0 0 441986 6125 0 0 25 0 5 0 497090461 4212379648 982666 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 1028413 982666 176 36 0 1026318 0
[pid=4055/tid=4063] ppid=4053 vsize=4113652 CPUtime=1121.36 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 309818 0 0 0 110520 1616 0 0 25 0 5 0 497090512 4212379648 982666 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=4113652 CPUtime=1119.15 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 207543 0 0 0 110433 1482 0 0 25 0 5 0 497090512 4212379648 982666 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=4113652 CPUtime=1118.59 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 227294 0 0 0 110313 1546 0 0 25 0 5 0 497090512 4212379648 982666 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=4113652 CPUtime=1121.46 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 232716 0 0 0 110668 1478 0 0 25 0 5 0 497090512 4212379648 982666 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4481.11
Current children cumulated vsize (KiB) 4113652

[startup+1182.3 s]
/proc/loadavg: 8.21 8.08 6.86 9/186 4105
/proc/meminfo: memFree=10205828/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=4217536 CPUtime=4720.76 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) S 4053 4055 1895 0 -1 4202496 1010662 0 0 0 465710 6366 0 0 25 0 5 0 497090461 4318756864 1008368 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273419237 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 1054384 1008368 176 36 0 1052289 0
[pid=4055/tid=4063] ppid=4053 vsize=4217536 CPUtime=1181.35 cores=1,3,5,7
/proc/4055/task/4063/stat : 4063 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 318489 0 0 0 116456 1679 0 0 25 0 5 0 497090512 4318756864 1008368 33554432000 4194304 4338100 140733257981568 18446744073709551615 254261011482 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=4217536 CPUtime=1179.15 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 212259 0 0 0 116373 1542 0 0 25 0 5 0 497090512 4318756864 1008368 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=4055/tid=4065] ppid=4053 vsize=4217536 CPUtime=1178.58 cores=1,3,5,7
/proc/4055/task/4065/stat : 4065 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 232472 0 0 0 116255 1603 0 0 25 0 5 0 497090512 4318756864 1008368 33554432000 4194304 4338100 140733257981568 18446744073709551615 254273442485 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=4055/tid=4066] ppid=4053 vsize=4217536 CPUtime=1181.13 cores=1,3,5,7
/proc/4055/task/4066/stat : 4066 (ttsth-5-4) R 4053 4055 1895 0 -1 4202560 239853 0 0 0 116573 1540 0 0 25 0 5 0 497090512 4318756864 1008368 33554432000 4194304 4338100 140733257981568 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4720.76
Current children cumulated vsize (KiB) 4217536



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.2 s]
/proc/loadavg: 8.15 8.07 6.89 6/183 4105
/proc/meminfo: memFree=10781064/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=0 CPUtime=4800.12 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) Z 4053 4055 1895 0 -1 4203548 1023376 0 0 0 473546 6466 0 0 18 0 2 0 497090461 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 0 0 0 0 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=0 CPUtime=1199.05 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4203588 215482 0 0 0 118339 1566 0 0 25 0 2 0 497090512 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.12
Current children cumulated vsize (KiB) 0

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.31 s]
/proc/loadavg: 8.15 8.07 6.89 6/183 4105
/proc/meminfo: memFree=10781064/32951124 swapFree=67111528/67111528
[pid=4055] ppid=4053 vsize=0 CPUtime=4800.23 cores=1,3,5,7
/proc/4055/stat : 4055 (ttsth-5-4) Z 4053 4055 1895 0 -1 4203548 1023376 0 0 0 473546 6477 0 0 18 0 2 0 497090461 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 1 0 0 0
/proc/4055/statm: 0 0 0 0 0 0 0
[pid=4055/tid=4064] ppid=4053 vsize=0 CPUtime=1199.16 cores=1,3,5,7
/proc/4055/task/4064/stat : 4064 (ttsth-5-4) R 4053 4055 1895 0 -1 4203588 215482 0 0 0 118339 1577 0 0 25 0 2 0 497090512 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.23
Current children cumulated vsize (KiB) 0

Child status: 0
Real time (s): 1202.34
CPU time (s): 4800.26
CPU user time (s): 4735.47
CPU system time (s): 64.7971
CPU usage (%): 399.244
Max. virtual memory (cumulated for all children) (KiB): 4264720

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4735.47
system time used= 64.7971
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1023376
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5544
involuntary context switches= 30935

runsolver used 1.9677 second user time and 4.6023 second system time

The end

Launcher Data 

Begin job on node140 at 2011-04-29 05:12:31
IDJOB=3257602
IDBENCH=71150
IDSOLVER=1654
FILE ID=node140/3257602-1304046751
RUNJOBID= node140-1304046751-4042
PBS_JOBID= 13170312
Free space on /tmp= 72664 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT09/CRAFTED/modcircuits/mod4block_2vars_8gates_u2.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3257602-1304046751/watcher-3257602-1304046751 -o /tmp/evaluation-result-3257602-1304046751/solver-3257602-1304046751 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3257602-1304046751.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a5bb71bc1d85a401ce9f42ed1404d63e
RANDOM SEED=995998144

node140.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22211720 kB
Buffers:       2295916 kB
Cached:        7810900 kB
SwapCached:          0 kB
Active:        2637728 kB
Inactive:      7534040 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22211720 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            1652 kB
Writeback:           0 kB
AnonPages:       64244 kB
Mapped:          14484 kB
Slab:           504192 kB
PageTables:       4488 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188252 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72656 MiB
End job on node140 at 2011-04-29 05:32:36