Trace number 3274015

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4? (TO) 4800.11 1216.27

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n200-s00813792-unsat.cnf
MD5SUM92046422d2d9595619b29413c0964c9c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables201
Number of clauses412
Sum of the clauses size1236
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3412
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3274015-1304059484.cnf 
0.00/0.00	c Using SATTIMEOUT of 4800
0.00/0.00	c Using SATRAM of 15500
0.00/0.00	c Size of subset node = 32
0.00/0.00	c Variables = 201
0.00/0.00	c Clauses = 412
0.00/0.00	c Literals = 1236
0.00/0.00	c Reduced size:
0.00/0.00	c Variables = 201
0.00/0.00	c Clauses = 412
0.00/0.00	c Literals = 1236
0.00/0.00	c a2
0.00/0.00	c a1
2.69/2.71	c Independent sub-problems = 1
2.69/2.71	c Sub-problem with 201 variables and 412 clauses
2.69/2.71	c using permutation method 3
2.69/2.71	c Ordering finished 2.710 seconds
2.69/2.71	c mapped 2.710 seconds
2.69/2.71	c permuted 2.710 seconds
2.69/2.71	c about to sort
2.69/2.71	c sorted
2.69/2.71	c clauses now 412
2.69/2.71	c init finished 2.710 seconds
2.69/2.71	c tree built 2.710 seconds
2.69/2.71	c 
2.69/2.71	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
2.69/2.71	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
2.69/2.71	c ................................ | ..........                    |                                  2.7         0.0             
2.69/2.71	c ................................ | ..........                  1 |                                  2.7         0.4             
2.69/2.71	c ................................ | ..........                  2 |                                  2.7         0.7             
2.69/2.71	c ................................ | ..........                  3 |                                  2.7         1.1             
2.69/2.71	c ................................ | ..........                  4 |                                  2.7         1.5             
2.69/2.71	c ................................ | ..........                  5 |                                  2.7         1.8             
2.69/2.71	c ................................ | ..........               1000 | 28           168                 2.7       369.0         4639
95.82/26.25	c ................................ | ..........            3177000 | 447317       492283             96.0     33083.4      7098901
191.80/50.56	c ................................ | ..........            5826000 | 803170       785807            192.0     30339.0      9798545
287.94/74.91	c ................................ | ..........            8152000 | 1150356      1033368           288.0     28305.6     11979746
383.94/99.32	c ................................ | ..........           10066000 | 1425878      1219346           384.0     26211.5     13548081
480.01/123.60	c ................................ | *.........           11659000 | 1644396      1425896           480.0     24288.6     14688755
575.67/147.79	c ................................ | *.........           12566000 | 1775770      1632799           576.0     21814.1     15786347
671.75/171.97	c ................................ | *.........           13506000 | 1914956      1794133           672.0     20097.3     16868299
767.75/196.27	c ................................ | *.........           14726000 | 2067829      1973289           768.0     19173.7     18043536
863.94/220.62	c ................................ | *.........           15902000 | 2233073      2114652           864.0     18404.2     19492385
959.62/244.89	c ................................ | **........           16938000 | 2394065      2225531           960.0     17643.8     19969848
1055.88/269.23	c ................................ | **........           18222000 | 2586665      2398005          1056.0     17255.7     20334056
1151.71/293.59	c ................................ | **........           19763000 | 2805418      2610997          1152.1     17154.5     20667874
1247.72/317.87	c ................................ | **........           21359000 | 3061289      2770288          1248.0     17114.6     21423339
1343.99/342.12	c ................................ | **........           22631000 | 3228756      2894917          1344.0     16837.9     22450909
1439.92/366.34	c ................................ | ***.......           23880000 | 3406102      3019265          1440.1     16582.4     23318526
1535.70/390.48	c ................................ | ***.......           24740000 | 3532593      3135105          1536.0     16106.7     23893361
1631.82/414.66	c ................................ | ***.......           25741000 | 3686335      3275029          1632.0     15772.6     23893361
1727.98/438.91	c ................................ | ***.......           26898000 | 3848865      3360173          1728.0     15566.0     24430554
1823.83/463.24	c ................................ | ***.......           28328000 | 4034723      3499907          1824.0     15530.6     25059483
1919.85/487.45	c ................................ | ****......           29441000 | 4194876      3632612          1920.0     15333.8     25125946
2015.93/511.62	c ................................ | ****......           30426000 | 4330551      3730494          2016.0     15091.9     25283407
2112.00/535.80	c ................................ | ****......           31076000 | 4427898      3821281          2112.0     14713.8     25711331
2207.75/559.99	c ................................ | ****......           31636000 | 4524052      3891252          2208.1     14327.2     26874359
2303.68/584.19	c ................................ | ****......           32614000 | 4649129      4011641          2304.0     14155.4     27992927
2399.91/608.43	c ................................ | *****.....           33486000 | 4753349      4152960          2400.0     13952.3     28932123
2495.87/632.63	c ................................ | *****.....           34403000 | 4868998      4295867          2496.0     13783.3     29194145
2591.90/656.83	c ................................ | *****.....           35125000 | 4966305      4390316          2592.0     13551.2     29197845
2687.89/680.95	c ................................ | *****.....           35720000 | 5043442      4460072          2688.1     13288.3     29197845
2784.05/705.14	c ................................ | *****.....           36271000 | 5119721      4549540          2784.2     13027.4     29395368
2880.06/729.33	c ................................ | ******....           36850000 | 5204088      4603746          2880.2     12794.4     30021369
2975.67/753.49	c ................................ | ******....           37724000 | 5334237      4673482          2976.0     12675.9     30619773
3071.95/777.72	c ................................ | ******....           38605000 | 5483930      4745387          3072.0     12566.7     30719469
3168.02/802.01	c ................................ | ******....           39901000 | 5658584      4844312          3168.1     12594.8     31329514
3263.89/826.35	c ................................ | ******....           41086000 | 5812226      4959456          3264.1     12587.3     31712607
3359.74/850.57	c ................................ | *******...           41918000 | 5936952      5033201          3360.0     12475.4     32187261
3455.75/874.86	c ................................ | *******...           43118000 | 6123342      5116975          3456.0     12476.2     32892780
3551.97/899.20	c ................................ | *******...           44848000 | 6386621      5202105          3552.0     12626.1     34186031
3647.63/923.40	c ................................ | *******...           46475000 | 6652579      5268888          3648.0     12739.8     35890891
3743.73/947.77	c ................................ | *******...           48114000 | 6893453      5377156          3744.0     12850.9     36216061
3839.97/972.10	c ................................ | ********..           49415000 | 7087116      5476294          3840.0     12868.5     37117828
3935.71/996.48	c ................................ | ********..           50587000 | 7258760      5579610          3936.0     12852.3     37538363
4031.65/1020.79	c ................................ | ********..           51616000 | 7406019      5695455          4032.0     12801.6     38312696
4127.93/1045.03	c ................................ | ********..           52540000 | 7539975      5789875          4128.1     12727.6     39091240
4223.87/1069.53	c ................................ | ********..           53544000 | 7679927      5923510          4224.0     12676.1     39625248
4320.00/1093.90	c ................................ | *********.           54792000 | 7864868      6023045          4320.0     12683.3     40793040
4415.76/1118.36	c ................................ | *********.           56347000 | 8108138      6122794          4416.0     12759.7     41582038
4511.73/1142.67	c ................................ | *********.           57509000 | 8304021      6219189          4512.0     12745.7     42593450
4607.69/1167.28	c ................................ | *********.           58759000 | 8498756      6334218          4608.0     12751.5     43062192
4703.82/1191.75	c ................................ | *********.           60234000 | 8702946      6423207          4704.0     12804.8     43687543
4799.68/1216.18	c CPU limit (4800) reached
4799.68/1216.18	c Time = 4800.02 seconds
4799.68/1216.18	s UNKNOWN

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: UNKNOWN

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3274015-1304059484/watcher-3274015-1304059484 -o /tmp/evaluation-result-3274015-1304059484/solver-3274015-1304059484 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3274015-1304059484.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.76 7.94 7.97 3/181 22454
/proc/meminfo: memFree=22117804/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=8840 CPUtime=0 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) R 22452 22454 22182 0 -1 4202496 285 0 0 0 0 0 0 0 25 0 1 0 517545512 9052160 228 33554432000 4194304 4338100 140735861858816 18446744073709551615 4290960 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/22454/statm: 2210 228 163 36 0 115 0

[startup+0.011073 s]
/proc/loadavg: 7.76 7.94 7.97 3/181 22454
/proc/meminfo: memFree=22117804/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=8840 CPUtime=0 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) R 22452 22454 22182 0 -1 4202496 285 0 0 0 0 0 0 0 25 0 1 0 517545512 9052160 228 33554432000 4194304 4338100 140735861858816 18446744073709551615 4245830 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/22454/statm: 2210 228 163 36 0 115 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8840

[startup+0.101071 s]
/proc/loadavg: 7.76 7.94 7.97 3/181 22454
/proc/meminfo: memFree=22117804/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=8840 CPUtime=0.09 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) R 22452 22454 22182 0 -1 4202496 286 0 0 0 9 0 0 0 25 0 1 0 517545512 9052160 229 33554432000 4194304 4338100 140735861858816 18446744073709551615 4290866 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/22454/statm: 2210 229 163 36 0 115 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 8840

[startup+0.301023 s]
/proc/loadavg: 7.76 7.94 7.97 3/181 22454
/proc/meminfo: memFree=22117804/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=8840 CPUtime=0.29 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) R 22452 22454 22182 0 -1 4202496 297 0 0 0 29 0 0 0 25 0 1 0 517545512 9052160 240 33554432000 4194304 4338100 140735861858816 18446744073709551615 239476343896 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/22454/statm: 2210 240 173 36 0 115 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 8840

[startup+0.700954 s]
/proc/loadavg: 7.76 7.94 7.97 3/181 22454
/proc/meminfo: memFree=22117804/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=8840 CPUtime=0.69 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) R 22452 22454 22182 0 -1 4202496 297 0 0 0 69 0 0 0 25 0 1 0 517545512 9052160 240 33554432000 4194304 4338100 140735861858816 18446744073709551615 239480133603 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/22454/statm: 2210 240 173 36 0 115 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 8840

[startup+1.5008 s]
/proc/loadavg: 7.54 7.89 7.96 6/182 22455
/proc/meminfo: memFree=22116564/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=8840 CPUtime=1.49 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) R 22452 22454 22182 0 -1 4202496 297 0 0 0 149 0 0 0 25 0 1 0 517545512 9052160 240 33554432000 4194304 4338100 140735861858816 18446744073709551615 4290866 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/22454/statm: 2210 240 173 36 0 115 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 8840

[startup+3.10043 s]
/proc/loadavg: 7.54 7.89 7.96 6/182 22456
/proc/meminfo: memFree=22116196/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=205296 CPUtime=4.23 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 4743 0 0 0 423 0 0 0 25 0 5 0 517545512 210223104 4686 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 51324 4686 196 36 0 49229 0
Current children cumulated CPU time (s) 4.23
Current children cumulated vsize (KiB) 205296

[startup+6.30081 s]
/proc/loadavg: 7.54 7.89 7.96 9/186 22460
/proc/meminfo: memFree=22053036/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=260704 CPUtime=16.97 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 18620 0 0 0 1693 4 0 0 25 0 5 0 517545512 266960896 18563 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 65176 18563 198 36 0 63081 0
[pid=22454/tid=22457] ppid=22452 vsize=260704 CPUtime=3.55 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 5303 0 0 0 354 1 0 0 25 0 5 0 517545784 266960896 18563 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=260704 CPUtime=3.54 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 4881 0 0 0 353 1 0 0 25 0 5 0 517545784 266960896 18563 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=260704 CPUtime=3.55 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 4787 0 0 0 355 0 0 0 18 0 5 0 517545784 266960896 18563 33554432000 4194304 4338100 140735861858816 18446744073709551615 239476090610 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=260704 CPUtime=3.56 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 2768 0 0 0 356 0 0 0 25 0 5 0 517545784 266960896 18563 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 16.97
Current children cumulated vsize (KiB) 260704

[startup+12.7006 s]
/proc/loadavg: 7.61 7.90 7.96 9/186 22460
/proc/meminfo: memFree=21979772/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=321676 CPUtime=42.39 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 34495 0 0 0 4230 9 0 0 25 0 5 0 517545512 329396224 34438 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 80419 34439 198 36 0 78324 0
[pid=22454/tid=22457] ppid=22452 vsize=321676 CPUtime=9.91 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 10997 0 0 0 987 4 0 0 18 0 5 0 517545784 329396224 34439 33554432000 4194304 4338100 140735861858816 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=321676 CPUtime=9.87 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 9681 0 0 0 985 2 0 0 18 0 5 0 517545784 329396224 34439 33554432000 4194304 4338100 140735861858816 18446744073709551615 4263499 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=321676 CPUtime=9.92 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 9216 0 0 0 991 1 0 0 25 0 5 0 517545784 329396224 34439 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=321676 CPUtime=9.93 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 3721 0 0 0 993 0 0 0 25 0 5 0 517545784 329396224 34439 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254384 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 42.39
Current children cumulated vsize (KiB) 321676

[startup+25.5011 s]
/proc/loadavg: 7.67 7.90 7.96 9/186 22460
/proc/meminfo: memFree=21832708/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=422044 CPUtime=93.05 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 58798 0 0 0 9285 20 0 0 25 0 5 0 517545512 432173056 58741 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 105511 58741 198 36 0 103416 0
[pid=22454/tid=22457] ppid=22452 vsize=422044 CPUtime=22.54 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 21808 0 0 0 2245 9 0 0 25 0 5 0 517545784 432173056 58741 33554432000 4194304 4338100 140735861858816 18446744073709551615 239476091386 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=422044 CPUtime=22.55 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 18069 0 0 0 2250 5 0 0 18 0 5 0 517545784 432173056 58741 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254291 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=422044 CPUtime=22.63 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 13513 0 0 0 2260 3 0 0 24 0 5 0 517545784 432173056 58741 33554432000 4194304 4338100 140735861858816 18446744073709551615 4241570 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=422044 CPUtime=22.59 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 4527 0 0 0 2258 1 0 0 24 0 5 0 517545784 432173056 58741 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254429 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 93.05
Current children cumulated vsize (KiB) 422044

[startup+51.1002 s]
/proc/loadavg: 7.62 7.87 7.95 9/186 22461
/proc/meminfo: memFree=21701508/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=528900 CPUtime=194.11 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 84002 0 0 0 19377 34 0 0 25 0 5 0 517545512 541593600 83945 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 132225 83945 198 36 0 130130 0
[pid=22454/tid=22457] ppid=22452 vsize=528900 CPUtime=47.55 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 37109 0 0 0 4738 17 0 0 25 0 5 0 517545784 541593600 83945 33554432000 4194304 4338100 140735861858816 18446744073709551615 239476352765 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=528900 CPUtime=47.91 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 23506 0 0 0 4783 8 0 0 20 0 5 0 517545784 541593600 83945 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254221 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=528900 CPUtime=47.99 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 16828 0 0 0 4794 5 0 0 25 0 5 0 517545784 541593600 83945 33554432000 4194304 4338100 140735861858816 18446744073709551615 4206896 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=528900 CPUtime=47.91 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 5678 0 0 0 4789 2 0 0 19 0 5 0 517545784 541593600 83945 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 194.11
Current children cumulated vsize (KiB) 528900

[startup+102.306 s]
/proc/loadavg: 7.79 7.88 7.94 9/186 22462
/proc/meminfo: memFree=21518728/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=659160 CPUtime=395.85 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 115912 0 0 0 39529 56 0 0 25 0 5 0 517545512 674979840 115855 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 164790 115855 198 36 0 162695 0
[pid=22454/tid=22457] ppid=22452 vsize=659160 CPUtime=97.71 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 63731 0 0 0 9738 33 0 0 23 0 5 0 517545784 674979840 115855 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254462 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=659160 CPUtime=98.46 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 26920 0 0 0 9835 11 0 0 25 0 5 0 517545784 674979840 115855 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=659160 CPUtime=98.63 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 17197 0 0 0 9856 7 0 0 25 0 5 0 517545784 674979840 115855 33554432000 4194304 4338100 140735861858816 18446744073709551615 4284198 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=659160 CPUtime=98.3 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 7183 0 0 0 9826 4 0 0 25 0 5 0 517545784 674979840 115855 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 395.85
Current children cumulated vsize (KiB) 659160

[startup+162.301 s]
/proc/loadavg: 8.02 7.93 7.95 9/186 22464
/proc/meminfo: memFree=21294404/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=760408 CPUtime=633.62 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 143547 0 0 0 63288 74 0 0 25 0 5 0 517545512 778657792 143490 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 190102 143490 198 36 0 188007 0
[pid=22454/tid=22457] ppid=22452 vsize=760408 CPUtime=156.91 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 73302 0 0 0 15651 40 0 0 25 0 5 0 517545784 778657792 143490 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254239 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=760408 CPUtime=158.07 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 35865 0 0 0 15792 15 0 0 18 0 5 0 517545784 778657792 143490 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=760408 CPUtime=158.17 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 24527 0 0 0 15805 12 0 0 25 0 5 0 517545784 778657792 143490 33554432000 4194304 4338100 140735861858816 18446744073709551615 4253901 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=760408 CPUtime=157.73 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 8972 0 0 0 15767 6 0 0 25 0 5 0 517545784 778657792 143490 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 633.62
Current children cumulated vsize (KiB) 760408

[startup+222.3 s]
/proc/loadavg: 7.89 7.91 7.94 9/186 22465
/proc/meminfo: memFree=21100584/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=854136 CPUtime=870.68 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 166979 0 0 0 86978 90 0 0 25 0 5 0 517545512 874635264 166922 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 213534 166922 198 36 0 211439 0
[pid=22454/tid=22457] ppid=22452 vsize=854136 CPUtime=215.89 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 84663 0 0 0 21539 50 0 0 25 0 5 0 517545784 874635264 166922 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=854136 CPUtime=217.35 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 37077 0 0 0 21720 15 0 0 25 0 5 0 517545784 874635264 166922 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254418 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=854136 CPUtime=217.64 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 35209 0 0 0 21748 16 0 0 25 0 5 0 517545784 874635264 166922 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=854136 CPUtime=217.05 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 9149 0 0 0 21698 7 0 0 25 0 5 0 517545784 874635264 166922 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 870.68
Current children cumulated vsize (KiB) 854136

################
# More data... #
################

/proc/meminfo: memFree=20267472/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=1263208 CPUtime=2772.96 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 263757 0 0 0 277114 182 0 0 25 0 5 0 517545512 1293524992 263700 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 315802 263700 198 36 0 313707 0
[pid=22454/tid=22457] ppid=22452 vsize=1263208 CPUtime=690.03 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 139360 0 0 0 68898 105 0 0 25 0 5 0 517545784 1293524992 263700 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=1263208 CPUtime=693.49 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 45584 0 0 0 69326 23 0 0 25 0 5 0 517545784 1293524992 263700 33554432000 4194304 4338100 140735861858816 18446744073709551615 239476391409 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=1263208 CPUtime=694.17 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 60705 0 0 0 69383 34 0 0 25 0 5 0 517545784 1293524992 263700 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254362 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=1263208 CPUtime=692.52 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 17227 0 0 0 69234 18 0 0 25 0 5 0 517545784 1293524992 263700 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2772.96
Current children cumulated vsize (KiB) 1263208

[startup+762.307 s]
/proc/loadavg: 8.09 8.04 7.99 9/186 22480
/proc/meminfo: memFree=20190464/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=1301128 CPUtime=3010.69 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 275199 0 0 0 300879 190 0 0 25 0 5 0 517545512 1332355072 275142 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 325282 275142 198 36 0 323187 0
[pid=22454/tid=22457] ppid=22452 vsize=1301128 CPUtime=749.31 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 144370 0 0 0 74821 110 0 0 25 0 5 0 517545784 1332355072 275142 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=1301128 CPUtime=753 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 45643 0 0 0 75277 23 0 0 25 0 5 0 517545784 1332355072 275142 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254275 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=1301128 CPUtime=753.6 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 65940 0 0 0 75323 37 0 0 25 0 5 0 517545784 1332355072 275142 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254404 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=1301128 CPUtime=752.03 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 18365 0 0 0 75184 19 0 0 25 0 5 0 517545784 1332355072 275142 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3010.69
Current children cumulated vsize (KiB) 1301128

[startup+822.301 s]
/proc/loadavg: 8.08 8.04 7.99 9/186 22481
/proc/meminfo: memFree=20097688/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=1346288 CPUtime=3247.98 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 287424 0 0 0 324596 202 0 0 25 0 5 0 517545512 1378598912 287367 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 336572 287367 198 36 0 334477 0
[pid=22454/tid=22457] ppid=22452 vsize=1346288 CPUtime=808.59 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 153056 0 0 0 80740 119 0 0 25 0 5 0 517545784 1378598912 287367 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=1346288 CPUtime=812.53 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 45700 0 0 0 81229 24 0 0 25 0 5 0 517545784 1378598912 287367 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=1346288 CPUtime=812.94 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 66025 0 0 0 81256 38 0 0 25 0 5 0 517545784 1378598912 287367 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=1346288 CPUtime=811.19 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 21762 0 0 0 81098 21 0 0 25 0 5 0 517545784 1378598912 287367 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3247.98
Current children cumulated vsize (KiB) 1346288

[startup+882.301 s]
/proc/loadavg: 8.07 8.05 8.00 9/186 22483
/proc/meminfo: memFree=19999948/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=1390464 CPUtime=3485.42 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 301372 0 0 0 348328 214 0 0 25 0 5 0 517545512 1423835136 301315 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 347616 301315 198 36 0 345521 0
[pid=22454/tid=22457] ppid=22452 vsize=1390464 CPUtime=867.75 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 164014 0 0 0 86648 127 0 0 25 0 5 0 517545784 1423835136 301315 33554432000 4194304 4338100 140735861858816 18446744073709551615 239476089993 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=1390464 CPUtime=872.03 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 45810 0 0 0 87179 24 0 0 25 0 5 0 517545784 1423835136 301315 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=1390464 CPUtime=872.41 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 66434 0 0 0 87202 39 0 0 25 0 5 0 517545784 1423835136 301315 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=1390464 CPUtime=870.48 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 24233 0 0 0 87026 22 0 0 25 0 5 0 517545784 1423835136 301315 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3485.42
Current children cumulated vsize (KiB) 1390464

[startup+942.301 s]
/proc/loadavg: 8.03 8.04 8.00 9/186 22485
/proc/meminfo: memFree=19813772/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=1649496 CPUtime=3722.52 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 330943 0 0 0 372018 234 0 0 25 0 5 0 517545512 1689083904 330886 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 412374 330886 198 36 0 410279 0
[pid=22454/tid=22457] ppid=22452 vsize=1649496 CPUtime=926.64 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 187024 0 0 0 92524 140 0 0 25 0 5 0 517545784 1689083904 330886 33554432000 4194304 4338100 140735861858816 18446744073709551615 4235746 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=1649496 CPUtime=931.45 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 46442 0 0 0 93119 26 0 0 25 0 5 0 517545784 1689083904 330886 33554432000 4194304 4338100 140735861858816 18446744073709551615 4235746 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=1649496 CPUtime=931.85 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 69088 0 0 0 93144 41 0 0 25 0 5 0 517545784 1689083904 330886 33554432000 4194304 4338100 140735861858816 18446744073709551615 4235746 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=1649496 CPUtime=929.84 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 27508 0 0 0 92958 26 0 0 25 0 5 0 517545784 1689083904 330886 33554432000 4194304 4338100 140735861858816 18446744073709551615 4235674 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3722.52
Current children cumulated vsize (KiB) 1649496

[startup+1002.3 s]
/proc/loadavg: 8.09 8.06 8.00 9/186 22495
/proc/meminfo: memFree=19708668/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=1703056 CPUtime=3958.8 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 347975 0 0 0 395631 249 0 0 25 0 5 0 517545512 1743929344 347918 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 425764 347918 198 36 0 423669 0
[pid=22454/tid=22457] ppid=22452 vsize=1703056 CPUtime=985.21 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 200573 0 0 0 98371 150 0 0 25 0 5 0 517545784 1743929344 347918 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=1703056 CPUtime=990.66 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 46639 0 0 0 99039 27 0 0 25 0 5 0 517545784 1743929344 347918 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=1703056 CPUtime=991.08 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 70339 0 0 0 99066 42 0 0 25 0 5 0 517545784 1743929344 347918 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254208 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=1703056 CPUtime=989.09 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 29543 0 0 0 98882 27 0 0 25 0 5 0 517545784 1743929344 347918 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3958.8
Current children cumulated vsize (KiB) 1703056

[startup+1062.3 s]
/proc/loadavg: 7.62 7.93 7.97 5/177 22514
/proc/meminfo: memFree=21164496/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=1759748 CPUtime=4195.64 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 362584 0 0 0 419301 263 0 0 25 0 5 0 517545512 1801981952 362527 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 439937 362527 198 36 0 437842 0
[pid=22454/tid=22457] ppid=22452 vsize=1759748 CPUtime=1044.09 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 214331 0 0 0 104249 160 0 0 25 0 5 0 517545784 1801981952 362527 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254254 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=1759748 CPUtime=1050.04 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 46973 0 0 0 104976 28 0 0 18 0 5 0 517545784 1801981952 362527 33554432000 4194304 4338100 140735861858816 18446744073709551615 4239459 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=1759748 CPUtime=1050.35 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 70427 0 0 0 104991 44 0 0 18 0 5 0 517545784 1801981952 362527 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254213 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=1759748 CPUtime=1048.41 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 29972 0 0 0 104812 29 0 0 18 0 5 0 517545784 1801981952 362527 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4195.64
Current children cumulated vsize (KiB) 1759748

[startup+1122.3 s]
/proc/loadavg: 5.09 7.16 7.70 5/176 22515
/proc/meminfo: memFree=21076636/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=1829204 CPUtime=4431.57 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 384951 0 0 0 442878 279 0 0 25 0 5 0 517545512 1873104896 384894 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 457301 384894 198 36 0 455206 0
[pid=22454/tid=22457] ppid=22452 vsize=1829204 CPUtime=1102.75 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 231471 0 0 0 110104 171 0 0 18 0 5 0 517545784 1873104896 384894 33554432000 4194304 4338100 140735861858816 18446744073709551615 4240537 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=1829204 CPUtime=1109.11 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 47261 0 0 0 110881 30 0 0 18 0 5 0 517545784 1873104896 384894 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=1829204 CPUtime=1109.63 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 70492 0 0 0 110917 46 0 0 25 0 5 0 517545784 1873104896 384894 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=1829204 CPUtime=1107.34 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 34846 0 0 0 110703 31 0 0 23 0 5 0 517545784 1873104896 384894 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4431.57
Current children cumulated vsize (KiB) 1829204

[startup+1182.3 s]
/proc/loadavg: 4.11 6.50 7.43 5/176 22520
/proc/meminfo: memFree=21021248/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=1876508 CPUtime=4666.98 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) S 22452 22454 22182 0 -1 4202496 398535 0 0 0 466403 295 0 0 25 0 5 0 517545512 1921544192 398478 33554432000 4194304 4338100 140735861858816 18446744073709551615 239488497637 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 469127 398478 198 36 0 467032 0
[pid=22454/tid=22457] ppid=22452 vsize=1876508 CPUtime=1161.09 cores=0,2,4,6
/proc/22454/task/22457/stat : 22457 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 243231 0 0 0 115930 179 0 0 19 0 5 0 517545784 1921544192 398478 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=22454/tid=22458] ppid=22452 vsize=1876508 CPUtime=1168.09 cores=0,2,4,6
/proc/22454/task/22458/stat : 22458 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 47576 0 0 0 116774 35 0 0 19 0 5 0 517545784 1921544192 398478 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=1876508 CPUtime=1168.87 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 70557 0 0 0 116840 47 0 0 25 0 5 0 517545784 1921544192 398478 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=22454/tid=22460] ppid=22452 vsize=1876508 CPUtime=1166.19 cores=0,2,4,6
/proc/22454/task/22460/stat : 22460 (ttsth-5-4) R 22452 22454 22182 0 -1 4202560 36290 0 0 0 116587 32 0 0 19 0 5 0 517545784 1921544192 398478 33554432000 4194304 4338100 140735861858816 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4666.98
Current children cumulated vsize (KiB) 1876508



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1216.2 s]
/proc/loadavg: 4.06 6.22 7.31 2/173 22521
/proc/meminfo: memFree=21242228/32950928 swapFree=67087032/67111528
[pid=22454] ppid=22452 vsize=0 CPUtime=4800.04 cores=0,2,4,6
/proc/22454/stat : 22454 (ttsth-5-4) Z 22452 22454 22182 0 -1 4203548 410561 0 0 0 479696 308 0 0 18 0 2 0 517545512 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/22454/statm: 0 0 0 0 0 0 0
[pid=22454/tid=22459] ppid=22452 vsize=0 CPUtime=1202.37 cores=0,2,4,6
/proc/22454/task/22459/stat : 22459 (ttsth-5-4) R 22452 22454 22182 0 -1 4203588 70598 0 0 0 120187 50 0 0 25 0 2 0 517545784 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.04
Current children cumulated vsize (KiB) 0

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 1216.27
CPU time (s): 4800.11
CPU user time (s): 4796.96
CPU system time (s): 3.14652
CPU usage (%): 394.659
Max. virtual memory (cumulated for all children) (KiB): 1914428

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.96
system time used= 3.14652
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 410561
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 25281
involuntary context switches= 20617

runsolver used 1.9837 second user time and 4.53331 second system time

The end

Launcher Data 

Begin job on node148 at 2011-04-29 08:44:44
IDJOB=3274015
IDBENCH=83151
IDSOLVER=1654
FILE ID=node148/3274015-1304059484
RUNJOBID= node148-1304056916-22200
PBS_JOBID= 13170435
Free space on /tmp= 71436 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n200-s00813792-unsat.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3274015-1304059484/watcher-3274015-1304059484 -o /tmp/evaluation-result-3274015-1304059484/solver-3274015-1304059484 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3274015-1304059484.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 92046422d2d9595619b29413c0964c9c
RANDOM SEED=1506117764

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      22118084 kB
Buffers:       2018184 kB
Cached:        7710040 kB
SwapCached:       3548 kB
Active:        2239220 kB
Inactive:      8031240 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      22118084 kB
SwapTotal:    67111528 kB
SwapFree:     67087032 kB
Dirty:              36 kB
Writeback:           0 kB
AnonPages:      540748 kB
Mapped:          14204 kB
Slab:           498316 kB
PageTables:       5388 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   760164 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71436 MiB
End job on node148 at 2011-04-29 09:05:03