Trace number 3263058

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ttsth 5-4UNSAT 3416.66 890.546

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_15_90_1-log.shuffled-as.sat03-137.cnf
MD5SUM808fa775df860c59a1178e77fc60f410
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark3416.66
Satisfiable
(Un)Satisfiability was proved
Number of variables75
Number of clauses25452
Sum of the clauses size254370
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 530
Number of clauses of size over 525422

Solver Data 

0.00/0.06	c Command: HOME/ttsth-5-4 -num-threads 4 HOME/instance-3263058-1304095304.cnf 
0.00/0.06	c Using SATTIMEOUT of 4800
0.00/0.06	c Using SATRAM of 15500
0.00/0.06	c Size of subset node = 32
0.00/0.06	c Variables = 75
0.00/0.06	c Clauses = 25452
0.00/0.06	c Literals = 254370
0.00/0.06	c Reduced size:
0.00/0.06	c Variables = 75
0.00/0.06	c Clauses = 25452
0.00/0.06	c Literals = 254370
0.00/0.06	c a2
0.39/0.44	c a1
1.09/1.11	c Independent sub-problems = 1
1.09/1.11	c Sub-problem with 75 variables and 25452 clauses
1.09/1.11	c using permutation method 4
1.09/1.11	c count = 1
1.09/1.11	c Ordering finished 1.090 seconds
1.09/1.11	c mapped 1.110 seconds
1.09/1.11	c permuted 1.110 seconds
1.09/1.11	c about to sort
1.09/1.12	c sorted
1.09/1.17	c clauses now 25452
1.09/1.17	c init finished 1.120 seconds
1.09/1.17	c tree built 1.160 seconds
1.09/1.17	c 
1.09/1.17	c PA progress                      | CPU progress Partial assignments | improvements                 ucps  CPU time       PA/sec  nodes
1.09/1.17	c ---------------------------------|----------------------------------|--------------------------------------------------------------------
1.09/1.17	c ................................ | ..........                    |                                  1.2         0.0             
1.09/1.17	c ................................ | ..........                  1 |                                  1.2         0.9             
1.09/1.17	c ................................ | ..........                  2 |                                  1.2         1.7             
1.09/1.17	c ................................ | ..........                  3 |                                  1.2         2.6             
1.09/1.17	c ................................ | ..........                  4 |                                  1.2         3.4             
1.09/1.17	c ................................ | ..........                  5 |                                  1.2         4.3             
1.09/1.18	c ................................ | ..........               1000 | 210          1358                1.2       854.7         9470
11.21/3.76	c *............................... | ..........             478510 | 137548       543107             11.5     41718.4      4538085
83.86/22.19	c **.............................. | ..........            2734626 | 794991       2902130            84.2     32470.0     16536269
83.86/22.19	c **.............................. | ..........            2734627 | 794991       2902134            84.2     32470.0     16536269
95.60/25.20	c **.............................. | ..........            3024000 | 875943       3217195            96.0     31500.0     18222032
191.90/49.73	c **.............................. | ..........            5018000 | 1467142      5496231           192.0     26131.3     25787499
287.79/74.24	c **.............................. | ..........            6805000 | 2003680      7484971           288.0     23628.5     28482521
383.94/99.03	c **.............................. | ..........            8529000 | 2517733      9389534           384.0     22208.6     32197012
479.94/123.81	c **.............................. | *.........           10081000 | 2983517      11160832          480.0     21002.1     35674092
575.70/148.78	c **.............................. | *.........           11722000 | 3486297      12909351          576.0     20350.0     38345095
671.77/173.87	c **.............................. | *.........           13286000 | 3962722      14595265          672.0     19770.5     41032660
767.80/198.85	c **.............................. | *.........           14825000 | 4430632      16278733          768.0     19303.1     42833008
863.86/224.04	c **.............................. | *.........           16408000 | 4902032      18025834          864.0     18989.9     45243824
895.80/232.38	c ***............................. | *.........           16924835 | 5058166      18588353          896.1     18887.0     45964610
959.87/249.13	c ***............................. | **........           17927000 | 5341529      19695978          960.0     18674.0     47041347
1055.75/274.17	c ***............................. | **........           19272000 | 5738431      21254766         1056.1     18249.0     48867466
1151.89/299.03	c ***............................. | **........           20680000 | 6162953      22752656         1152.0     17951.1     50943232
1247.77/324.08	c ***............................. | **........           22145000 | 6588271      24264046         1248.0     17744.1     52792985
1343.64/349.49	c ***............................. | **........           23540000 | 7002239      25778952         1344.0     17514.6     54724511
1439.72/374.67	c ***............................. | ***.......           24922000 | 7406154      27335391         1440.0     17306.8     56709039
1536.03/399.60	c ***............................. | ***.......           26253000 | 7807915      28845777         1536.1     17091.1     58394085
1631.88/424.36	c ***............................. | ***.......           27662000 | 8231169      30364136         1632.0     16949.2     60418423
1727.82/449.54	c ***............................. | ***.......           29076000 | 8662552      31870699         1728.0     16826.3     62517432
1823.62/474.89	c ***............................. | ***.......           30548000 | 9094017      33452284         1824.0     16747.8     64744920
1920.01/500.10	c ***............................. | ****......           31995000 | 9524223      35109526         1920.0     16663.7     66367779
2015.95/525.11	c ***............................. | ****......           33438000 | 9958320      36655511         2016.0     16586.3     69181411
2052.82/534.66	c ****............................ | ****......           33980769 | 10124253     37255216         2053.0     16551.4     69500594
2052.82/534.66	c ****............................ | ****......           33980770 | 10124253     37255216         2053.0     16551.4     69500594
2052.82/534.66	c ****............................ | ****......           33980771 | 10124253     37255216         2053.0     16551.4     69500594
2111.73/549.86	c ****............................ | ****......           34906000 | 10394196     38264995         2112.0     16527.5     70368197
2184.01/568.57	c *****........................... | ****......           36111599 | 10745828     39557186         2184.3     16532.2     71344883
2207.72/574.67	c *****........................... | ****......           36410000 | 10833158     39898997         2208.0     16490.0     71554504
2303.78/599.46	c *****........................... | ****......           37566000 | 11188530     41221858         2304.0     16304.5     71969929
2399.84/624.75	c *****........................... | *****.....           38793000 | 11555091     42657950         2400.0     16163.5     72391203
2495.70/649.69	c *****........................... | *****.....           40076000 | 11943611     44120107         2496.1     16055.7     72837893
2591.82/674.75	c *****........................... | *****.....           41400000 | 12354798     45589506         2592.0     15972.0     73181056
2688.03/700.10	c *****........................... | *****.....           42644000 | 12734103     47020323         2688.0     15864.3     73616081
2783.78/725.05	c *****........................... | *****.....           43905000 | 13121201     48437440         2784.0     15770.5     74392139
2879.95/750.31	c *****........................... | ******....           45342000 | 13558282     49983959         2880.0     15743.7     75040244
2887.70/752.45	c ******.......................... | ******....           45470802 | 13597829     50105704         2887.9     15745.4     75113085
2887.70/752.45	c ******.......................... | ******....           45470803 | 13597829     50105708         2887.9     15745.4     75113085
2958.93/771.11	c *******......................... | ******....           46631743 | 13936080     51295664         2958.9     15759.6     75474098
2975.96/775.61	c *******......................... | ******....           46886000 | 14008291     51565062         2976.0     15754.7     75474098
3071.73/800.67	c *******......................... | ******....           48302000 | 14413974     53057755         3072.0     15723.2     76013655
3136.21/817.87	c ********........................ | ******....           49376161 | 14722883     54205404         3136.5     15742.3     76289975
3136.21/817.87	c ****************................ | ******....           49376162 | 14722884     54205404         3136.5     15742.3     76289975
3136.21/817.87	c ****************................ | ******....           49376163 | 14722884     54205404         3136.5     15742.3     76289975
3136.21/817.87	c ****************................ | ******....           49376164 | 14722884     54205404         3136.5     15742.3     76289975
3136.21/817.87	c ********************............ | ******....           49376165 | 14722885     54205406         3136.5     15742.3     76289975
3136.21/817.87	c ********************............ | ******....           49376166 | 14722885     54205406         3136.5     15742.3     76289975
3136.21/817.87	c **********************.......... | ******....           49376167 | 14722886     54205406         3136.5     15742.3     76289975
3136.21/817.87	c **********************.......... | ******....           49376168 | 14722886     54205406         3136.5     15742.3     76289975
3136.21/817.87	c ***********************......... | ******....           49376169 | 14722887     54205406         3136.5     15742.3     76289975
3167.71/826.08	c ***********************......... | ******....           49870000 | 14874890     54702280         3168.0     15741.6     76456513
3263.98/851.01	c ***********************......... | ******....           51506000 | 15364843     56389139         3264.0     15779.9     77655470
3350.01/873.21	c ************************........ | ******....           52942228 | 15798061     57890099         3350.1     15803.3     78466659
3350.01/873.21	c ************************........ | ******....           52942229 | 15798061     57890101         3350.1     15803.3     78466659
3350.01/873.21	c ****************************.... | ******....           52942230 | 15798062     57890101         3350.1     15803.3     78466659
3350.01/873.21	c ****************************.... | ******....           52942231 | 15798062     57890102         3350.1     15803.3     78466659
3350.01/873.21	c ****************************.... | ******....           52942232 | 15798062     57890102         3350.1     15803.3     78466659
3350.01/873.21	c *****************************... | ******....           52942233 | 15798063     57890102         3350.1     15803.3     78466659
3359.76/875.76	c *****************************... | *******...           53120000 | 15852200     58084567         3360.0     15809.4     78497002
3366.17/877.49	c ******************************.. | *******...           53243753 | 15889083     58228883         3366.6     15815.5     78508177
3366.17/877.49	c ******************************.. | *******...           53243754 | 15889083     58228884         3366.6     15815.5     78508177
3416.21/890.36	c Thread 2 result 0
3416.21/890.36	c Thread 2 found (nil)
3416.21/890.36	c Thread 1 result 0
3416.21/890.36	c Thread 0 result 0
3416.21/890.36	c Thread 3 result 0
3416.21/890.37	c Partial assignments = 54218358, improvements = 16164383  ucps = 59456764 PA/sec = 15869.70, subset nodes = 78589754
3416.21/890.37	s UNSATISFIABLE
3416.21/890.37	c CPU time = 3416.47 seconds
3416.21/890.37	c Elapsed time = 890 seconds

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3263058-1304095304/watcher-3263058-1304095304 -o /tmp/evaluation-result-3263058-1304095304/solver-3263058-1304095304 -C 4800 -W 1300 -M 15500 HOME/ttsth-5-4 -num-threads 4 HOME/instance-3263058-1304095304.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.05 8.16 8.09 5/181 16424
/proc/meminfo: memFree=28544620/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=8972 CPUtime=0 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) R 16422 16424 16318 0 -1 4202496 328 0 0 0 0 0 0 0 25 0 1 0 521129063 9187328 270 33554432000 4194304 4338100 140735398819520 18446744073709551615 4223897 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16424/statm: 2243 270 147 36 0 148 0

[startup+0.0790549 s]
/proc/loadavg: 8.05 8.16 8.09 5/181 16424
/proc/meminfo: memFree=28544620/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=32412 CPUtime=0.07 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) R 16422 16424 16318 0 -1 4202496 3900 0 0 0 7 0 0 0 25 0 1 0 521129063 33189888 3718 33554432000 4194304 4338100 140735398819520 18446744073709551615 251814298026 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16424/statm: 8103 3718 347 36 0 6008 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 32412

[startup+0.101049 s]
/proc/loadavg: 8.05 8.16 8.09 5/181 16424
/proc/meminfo: memFree=28544620/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=50820 CPUtime=0.09 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) R 16422 16424 16318 0 -1 4202496 5416 0 0 0 9 0 0 0 25 0 1 0 521129063 52039680 4966 33554432000 4194304 4338100 140735398819520 18446744073709551615 4206987 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16424/statm: 12705 4966 255 36 0 10610 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 50820

[startup+0.301012 s]
/proc/loadavg: 8.05 8.16 8.09 5/181 16424
/proc/meminfo: memFree=28544620/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=50820 CPUtime=0.29 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) R 16422 16424 16318 0 -1 4202496 5417 0 0 0 29 0 0 0 25 0 1 0 521129063 52039680 4966 33554432000 4194304 4338100 140735398819520 18446744073709551615 251813635321 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16424/statm: 12705 4966 254 36 0 10610 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 50820

[startup+0.700943 s]
/proc/loadavg: 8.05 8.16 8.09 5/181 16424
/proc/meminfo: memFree=28544620/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=15520 CPUtime=0.69 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) R 16422 16424 16318 0 -1 4202496 5523 0 0 0 69 0 0 0 25 0 1 0 521129063 15892480 1881 33554432000 4194304 4338100 140735398819520 18446744073709551615 251813936907 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/16424/statm: 3880 1883 156 36 0 1785 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 15520

[startup+1.50082 s]
/proc/loadavg: 8.05 8.16 8.09 2/176 16426
/proc/meminfo: memFree=30920380/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=224116 CPUtime=2.46 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 12858 0 0 0 244 2 0 0 25 0 5 0 521129063 229494784 9214 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 56029 9214 176 36 0 53934 0
Current children cumulated CPU time (s) 2.46
Current children cumulated vsize (KiB) 224116

[startup+3.10054 s]
/proc/loadavg: 7.73 8.09 8.07 5/180 16430
/proc/meminfo: memFree=30853016/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=378068 CPUtime=8.83 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 36898 0 0 0 874 9 0 0 25 0 5 0 521129063 387141632 33254 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 94517 33254 176 36 0 92422 0
[pid=16424/tid=16427] ppid=16422 vsize=378068 CPUtime=1.9 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 8080 0 0 0 189 1 0 0 25 0 5 0 521129181 387141632 33254 33554432000 4194304 4338100 140735398819520 18446744073709551615 251813635815 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=378068 CPUtime=1.9 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 6970 0 0 0 188 2 0 0 20 0 5 0 521129181 387141632 33254 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=378068 CPUtime=1.9 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 7836 0 0 0 188 2 0 0 25 0 5 0 521129181 387141632 33254 33554432000 4194304 4338100 140735398819520 18446744073709551615 251813936688 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=378068 CPUtime=1.9 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 7911 0 0 0 189 1 0 0 25 0 5 0 521129181 387141632 33256 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254289 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 8.83
Current children cumulated vsize (KiB) 378068

[startup+6.30101 s]
/proc/loadavg: 7.73 8.09 8.07 9/186 16461
/proc/meminfo: memFree=30580616/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=497696 CPUtime=21.53 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 69399 0 0 0 2138 15 0 0 25 0 5 0 521129063 509640704 65755 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 124424 65755 176 36 0 122329 0
[pid=16424/tid=16427] ppid=16422 vsize=497696 CPUtime=5.09 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 18173 0 0 0 506 3 0 0 25 0 5 0 521129181 509640704 65755 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=497696 CPUtime=5.06 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 13747 0 0 0 502 4 0 0 25 0 5 0 521129181 509640704 65755 33554432000 4194304 4338100 140735398819520 18446744073709551615 251813635137 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=497696 CPUtime=5.08 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 16048 0 0 0 504 4 0 0 25 0 5 0 521129181 509640704 65755 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=497696 CPUtime=5.09 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 15330 0 0 0 507 2 0 0 25 0 5 0 521129181 509640704 65756 33554432000 4194304 4338100 140735398819520 18446744073709551615 4234407 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 21.53
Current children cumulated vsize (KiB) 497696

[startup+12.7009 s]
/proc/loadavg: 7.75 8.09 8.06 9/186 16461
/proc/meminfo: memFree=30087688/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=649180 CPUtime=46.89 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 111392 0 0 0 4664 25 0 0 25 0 5 0 521129063 664760320 107748 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 162295 107748 176 36 0 160200 0
[pid=16424/tid=16427] ppid=16422 vsize=649180 CPUtime=11.4 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 35590 0 0 0 1132 8 0 0 25 0 5 0 521129181 664760320 107748 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=649180 CPUtime=11.4 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 19978 0 0 0 1135 5 0 0 25 0 5 0 521129181 664760320 107748 33554432000 4194304 4338100 140735398819520 18446744073709551615 4289176 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=649180 CPUtime=11.45 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 25387 0 0 0 1139 6 0 0 25 0 5 0 521129181 664760320 107748 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=649180 CPUtime=11.44 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 24336 0 0 0 1140 4 0 0 25 0 5 0 521129181 664760320 107748 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 46.89
Current children cumulated vsize (KiB) 649180

[startup+25.5008 s]
/proc/loadavg: 7.95 8.11 8.07 9/186 16462
/proc/meminfo: memFree=29451824/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=860948 CPUtime=97.17 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 172561 0 0 0 9668 49 0 0 25 0 5 0 521129063 881610752 168917 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 215237 168917 176 36 0 213142 0
[pid=16424/tid=16427] ppid=16422 vsize=860948 CPUtime=23.88 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 59907 0 0 0 2370 18 0 0 25 0 5 0 521129181 881610752 168917 33554432000 4194304 4338100 140735398819520 18446744073709551615 4235674 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=860948 CPUtime=24 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 29824 0 0 0 2390 10 0 0 25 0 5 0 521129181 881610752 168917 33554432000 4194304 4338100 140735398819520 18446744073709551615 4235651 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=860948 CPUtime=24.05 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 40273 0 0 0 2393 12 0 0 25 0 5 0 521129181 881610752 168917 33554432000 4194304 4338100 140735398819520 18446744073709551615 4235858 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=860948 CPUtime=24.05 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 36456 0 0 0 2397 8 0 0 25 0 5 0 521129181 881610752 168917 33554432000 4194304 4338100 140735398819520 18446744073709551615 4235651 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 97.17
Current children cumulated vsize (KiB) 860948

[startup+51.1005 s]
/proc/loadavg: 7.96 8.10 8.07 9/186 16463
/proc/meminfo: memFree=28701796/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=1137748 CPUtime=197.28 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 250942 0 0 0 19648 80 0 0 25 0 5 0 521129063 1165053952 247298 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 284437 247298 176 36 0 282342 0
[pid=16424/tid=16427] ppid=16422 vsize=1137748 CPUtime=48.57 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 91547 0 0 0 4826 31 0 0 25 0 5 0 521129181 1165053952 247298 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826052897 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=1137748 CPUtime=49.09 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 42761 0 0 0 4894 15 0 0 25 0 5 0 521129181 1165053952 247298 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=1137748 CPUtime=49.21 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 57302 0 0 0 4903 18 0 0 25 0 5 0 521129181 1165053952 247298 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=1137748 CPUtime=49.2 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) S 16422 16424 16318 0 -1 4202560 53231 0 0 0 4906 14 0 0 25 0 5 0 521129181 1165053952 247298 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826065780 0 0 4096 0 18446604471096567872 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 197.28
Current children cumulated vsize (KiB) 1137748

[startup+102.307 s]
/proc/loadavg: 7.94 8.07 8.06 9/186 16464
/proc/meminfo: memFree=27855344/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=1382236 CPUtime=396.72 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 331870 0 0 0 39549 123 0 0 25 0 5 0 521129063 1415409664 328226 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 345559 328226 176 36 0 343464 0
[pid=16424/tid=16427] ppid=16422 vsize=1382236 CPUtime=97.9 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 137638 0 0 0 9741 49 0 0 25 0 5 0 521129181 1415409664 328226 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=1382236 CPUtime=99.13 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 52375 0 0 0 9892 21 0 0 25 0 5 0 521129181 1415409664 328226 33554432000 4194304 4338100 140735398819520 18446744073709551615 4256051 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=1382236 CPUtime=99.5 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 69822 0 0 0 9922 28 0 0 19 0 5 0 521129181 1415409664 328226 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=1382236 CPUtime=98.98 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 65934 0 0 0 9876 22 0 0 25 0 5 0 521129181 1415409664 328226 33554432000 4194304 4338100 140735398819520 18446744073709551615 251813635101 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 396.72
Current children cumulated vsize (KiB) 1382236

[startup+162.301 s]
/proc/loadavg: 7.94 8.04 8.05 9/186 16465
/proc/meminfo: memFree=27110448/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=1845876 CPUtime=628.05 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 420061 0 0 0 62630 175 0 0 25 0 5 0 521129063 1890177024 416417 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 461469 416417 176 36 0 459374 0
[pid=16424/tid=16427] ppid=16422 vsize=1845876 CPUtime=154.83 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 184477 0 0 0 15409 74 0 0 25 0 5 0 521129181 1890177024 416417 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=1845876 CPUtime=157.37 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 61459 0 0 0 15705 32 0 0 25 0 5 0 521129181 1890177024 416417 33554432000 4194304 4338100 140735398819520 18446744073709551615 251813635088 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=1845876 CPUtime=157.23 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 78489 0 0 0 15688 35 0 0 25 0 5 0 521129181 1890177024 416417 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254388 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=1845876 CPUtime=157.41 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 89535 0 0 0 15709 32 0 0 25 0 5 0 521129181 1890177024 416417 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254321 0 0 4096 0 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 628.05
Current children cumulated vsize (KiB) 1845876

[startup+222.301 s]
/proc/loadavg: 7.80 7.98 8.03 9/186 16467
/proc/meminfo: memFree=26522032/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=2064660 CPUtime=857.52 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 491002 0 0 0 85530 222 0 0 25 0 5 0 521129063 2114211840 487358 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 516165 487358 176 36 0 514070 0
[pid=16424/tid=16427] ppid=16422 vsize=2064660 CPUtime=211.03 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 228751 0 0 0 21010 93 0 0 25 0 5 0 521129181 2114211840 487358 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=16424/tid=16429] ppid=16422 vsize=3955760 CPUtime=619.93 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 140236 0 0 0 61691 302 0 0 25 0 5 0 521129181 4050698240 914226 33554432000 4194304 4338100 140735398819520 18446744073709551615 4287678 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=3955760 CPUtime=620.07 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 158659 0 0 0 61911 96 0 0 25 0 5 0 521129181 4050698240 914226 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2467.55
Current children cumulated vsize (KiB) 3955760

[startup+702.301 s]
/proc/loadavg: 7.77 7.75 7.88 9/186 16480
/proc/meminfo: memFree=22021116/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=4010668 CPUtime=2696.09 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 952057 0 0 0 268478 1131 0 0 25 0 5 0 521129063 4106924032 948413 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 1002667 948413 176 36 0 1000572 0
[pid=16424/tid=16427] ppid=16422 vsize=4010668 CPUtime=661.88 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 503509 0 0 0 65669 519 0 0 25 0 5 0 521129181 4106924032 948413 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=4010668 CPUtime=678.3 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 128444 0 0 0 67730 100 0 0 25 0 5 0 521129181 4106924032 948413 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254321 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=4010668 CPUtime=677.04 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 148954 0 0 0 67299 405 0 0 25 0 5 0 521129181 4106924032 948413 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=4010668 CPUtime=677.66 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 165049 0 0 0 67661 105 0 0 25 0 5 0 521129181 4106924032 948413 33554432000 4194304 4338100 140735398819520 18446744073709551615 4263499 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2696.09
Current children cumulated vsize (KiB) 4010668

[startup+762.306 s]
/proc/loadavg: 7.69 7.72 7.86 9/186 16481
/proc/meminfo: memFree=21590240/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=4279144 CPUtime=2925.59 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 991388 0 0 0 291187 1372 0 0 25 0 5 0 521129063 4381843456 987744 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 1069786 987744 176 36 0 1067691 0
[pid=16424/tid=16427] ppid=16422 vsize=4279144 CPUtime=718.08 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 522072 0 0 0 71171 637 0 0 25 0 5 0 521129181 4381843456 987744 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=4279144 CPUtime=736.24 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 133751 0 0 0 73519 105 0 0 25 0 5 0 521129181 4381843456 987744 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=4279144 CPUtime=734.52 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 157978 0 0 0 72935 517 0 0 25 0 5 0 521129181 4381843456 987744 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=4279144 CPUtime=735.55 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 171486 0 0 0 73444 111 0 0 25 0 5 0 521129181 4381843456 987744 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2925.59
Current children cumulated vsize (KiB) 4279144

[startup+822.301 s]
/proc/loadavg: 7.80 7.75 7.86 9/186 16483
/proc/meminfo: memFree=21142180/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=4415668 CPUtime=3153.4 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 1032196 0 0 0 313722 1618 0 0 25 0 5 0 521129063 4521644032 1028552 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 1103917 1028552 176 36 0 1101822 0
[pid=16424/tid=16427] ppid=16422 vsize=4415668 CPUtime=773.94 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 537865 0 0 0 76644 750 0 0 25 0 5 0 521129181 4521644032 1028552 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=4415668 CPUtime=793.88 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 139824 0 0 0 79270 118 0 0 25 0 5 0 521129181 4521644032 1028552 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 5 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=4415668 CPUtime=791.97 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 169878 0 0 0 78569 628 0 0 25 0 5 0 521129181 4521644032 1028552 33554432000 4194304 4338100 140735398819520 18446744073709551615 4239509 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=4415668 CPUtime=792.41 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 178528 0 0 0 79121 120 0 0 25 0 5 0 521129181 4521644032 1028552 33554432000 4194304 4338100 140735398819520 18446744073709551615 4286223 0 0 4096 0 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3153.4
Current children cumulated vsize (KiB) 4415668

[startup+882.301 s]
/proc/loadavg: 7.66 7.71 7.83 6/186 16485
/proc/meminfo: memFree=20599480/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=4643316 CPUtime=3385.24 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 1084729 0 0 0 336493 2031 0 0 25 0 5 0 521129063 4754755584 1081085 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 1160829 1081086 176 36 0 1158734 0
[pid=16424/tid=16427] ppid=16422 vsize=4643316 CPUtime=830.98 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 562462 0 0 0 82242 856 0 0 18 0 5 0 521129181 4754755584 1081086 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254307 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=4643316 CPUtime=852.17 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 147539 0 0 0 84995 222 0 0 18 0 5 0 521129181 4754755584 1081086 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=4643316 CPUtime=850.29 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 179479 0 0 0 84298 731 0 0 25 0 5 0 521129181 4754755584 1081086 33554432000 4194304 4338100 140735398819520 18446744073709551615 4255938 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=4643316 CPUtime=850.58 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 189149 0 0 0 84839 219 0 0 25 0 5 0 521129181 4754755584 1081086 33554432000 4194304 4338100 140735398819520 18446744073709551615 251813901345 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3385.24
Current children cumulated vsize (KiB) 4643316

Solver just ended. Dumping a history of the last processes samples

[startup+883.101 s]
/proc/loadavg: 7.66 7.71 7.83 6/186 16485
/proc/meminfo: memFree=20599480/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=4643844 CPUtime=3388.43 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 1085301 0 0 0 336802 2041 0 0 25 0 5 0 521129063 4755296256 1081657 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 1160961 1081657 176 36 0 1158866 0
[pid=16424/tid=16427] ppid=16422 vsize=4643844 CPUtime=831.78 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 562605 0 0 0 82319 859 0 0 19 0 5 0 521129181 4755296256 1081657 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254315 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=4643844 CPUtime=852.97 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 147682 0 0 0 85072 225 0 0 20 0 5 0 521129181 4755296256 1081657 33554432000 4194304 4338100 140735398819520 18446744073709551615 4263505 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=4643844 CPUtime=851.09 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 179622 0 0 0 84376 733 0 0 25 0 5 0 521129181 4755296256 1081657 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=4643844 CPUtime=851.38 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 189291 0 0 0 84916 222 0 0 25 0 5 0 521129181 4755296256 1081657 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3388.43
Current children cumulated vsize (KiB) 4643844

[startup+886.3 s]
/proc/loadavg: 7.66 7.71 7.83 9/186 16485
/proc/meminfo: memFree=20567488/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=4645956 CPUtime=3400.75 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 1087482 0 0 0 338000 2075 0 0 25 0 5 0 521129063 4757458944 1083838 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 1161489 1083839 176 36 0 1159394 0
[pid=16424/tid=16427] ppid=16422 vsize=4645956 CPUtime=834.81 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 563124 0 0 0 82614 867 0 0 25 0 5 0 521129181 4757458944 1083839 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254311 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=4645956 CPUtime=856.09 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 148195 0 0 0 85376 233 0 0 25 0 5 0 521129181 4757458944 1083839 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254437 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=4645956 CPUtime=854.14 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 180198 0 0 0 84673 741 0 0 19 0 5 0 521129181 4757458944 1083839 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=4645956 CPUtime=854.49 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 189865 0 0 0 85218 231 0 0 19 0 5 0 521129181 4757458944 1083839 33554432000 4194304 4338100 140735398819520 18446744073709551615 251813901345 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3400.75
Current children cumulated vsize (KiB) 4645956

[startup+887.901 s]
/proc/loadavg: 7.69 7.71 7.83 9/186 16485
/proc/meminfo: memFree=20541328/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=4650272 CPUtime=3407.13 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 1088948 0 0 0 338620 2093 0 0 25 0 5 0 521129063 4761878528 1085304 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 1162568 1085304 176 36 0 1160473 0
[pid=16424/tid=16427] ppid=16422 vsize=4650272 CPUtime=836.41 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 563741 0 0 0 82770 871 0 0 25 0 5 0 521129181 4761878528 1085304 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=4650272 CPUtime=857.68 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 148475 0 0 0 85531 237 0 0 25 0 5 0 521129181 4761878528 1085304 33554432000 4194304 4338100 140735398819520 18446744073709551615 4206909 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=4650272 CPUtime=855.74 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 180482 0 0 0 84828 746 0 0 24 0 5 0 521129181 4761878528 1085304 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254400 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=4650272 CPUtime=856.09 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 190149 0 0 0 85373 236 0 0 25 0 5 0 521129181 4761878528 1085304 33554432000 4194304 4338100 140735398819520 18446744073709551615 4263499 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3407.13
Current children cumulated vsize (KiB) 4650272

[startup+889.501 s]
/proc/loadavg: 7.69 7.71 7.83 9/186 16485
/proc/meminfo: memFree=20527188/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=4651196 CPUtime=3413.07 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 1090537 0 0 0 339198 2109 0 0 25 0 5 0 521129063 4762824704 1086893 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 1162799 1086893 176 36 0 1160704 0
[pid=16424/tid=16427] ppid=16422 vsize=4651196 CPUtime=837.89 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 564301 0 0 0 82913 876 0 0 18 0 5 0 521129181 4762824704 1086893 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=4651196 CPUtime=859.15 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 148728 0 0 0 85674 241 0 0 25 0 5 0 521129181 4762824704 1086893 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=4651196 CPUtime=857.25 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 180853 0 0 0 84975 750 0 0 25 0 5 0 521129181 4762824704 1086893 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=4651196 CPUtime=857.57 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 190554 0 0 0 85517 240 0 0 18 0 5 0 521129181 4762824704 1086893 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3413.07
Current children cumulated vsize (KiB) 4651196

[startup+890.301 s]
/proc/loadavg: 7.69 7.71 7.83 9/186 16485
/proc/meminfo: memFree=20520244/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=4717392 CPUtime=3416.21 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) S 16422 16424 16318 0 -1 4202496 1091351 0 0 0 339503 2118 0 0 25 0 5 0 521129063 4830609408 1087707 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826042853 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 1179348 1087707 176 36 0 1177253 0
[pid=16424/tid=16427] ppid=16422 vsize=4717392 CPUtime=838.68 cores=1,3,5,7
/proc/16424/task/16427/stat : 16427 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 564444 0 0 0 82990 878 0 0 19 0 5 0 521129181 4830609408 1087707 33554432000 4194304 4338100 140735398819520 18446744073709551615 4279533 0 0 4096 0 0 0 0 -1 3 0 0 0
[pid=16424/tid=16428] ppid=16422 vsize=4717392 CPUtime=859.93 cores=1,3,5,7
/proc/16424/task/16428/stat : 16428 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 148869 0 0 0 85750 243 0 0 18 0 5 0 521129181 4830609408 1087707 33554432000 4194304 4338100 140735398819520 18446744073709551615 4254264 0 0 4096 0 0 0 0 -1 7 0 0 0
[pid=16424/tid=16429] ppid=16422 vsize=4717392 CPUtime=858.01 cores=1,3,5,7
/proc/16424/task/16429/stat : 16429 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 181060 0 0 0 85049 752 0 0 25 0 5 0 521129181 4830609408 1087707 33554432000 4194304 4338100 140735398819520 18446744073709551615 251826066101 0 0 4096 0 0 0 0 -1 1 0 0 0
[pid=16424/tid=16430] ppid=16422 vsize=4717392 CPUtime=858.37 cores=1,3,5,7
/proc/16424/task/16430/stat : 16430 (ttsth-5-4) R 16422 16424 16318 0 -1 4202560 190877 0 0 0 85595 242 0 0 19 0 5 0 521129181 4830609408 1087707 33554432000 4194304 4338100 140735398819520 18446744073709551615 251813901345 0 0 4096 0 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3416.21
Current children cumulated vsize (KiB) 4717392

[startup+890.501 s]
/proc/loadavg: 7.69 7.71 7.83 9/186 16485
/proc/meminfo: memFree=20520244/32950928 swapFree=67111448/67111528
[pid=16424] ppid=16422 vsize=0 CPUtime=3416.6 cores=1,3,5,7
/proc/16424/stat : 16424 (ttsth-5-4) R 16422 16424 16318 0 -1 4202500 1091431 0 0 0 339529 2131 0 0 18 0 1 0 521129063 0 0 33554432000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 5 0 0 0
/proc/16424/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 3416.6
Current children cumulated vsize (KiB) 0

Child status: 20
Real time (s): 890.546
CPU time (s): 3416.66
CPU user time (s): 3395.3
CPU system time (s): 21.3628
CPU usage (%): 383.659
Max. virtual memory (cumulated for all children) (KiB): 4717392

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3395.3
system time used= 21.3628
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1091431
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 112357
involuntary context switches= 19942

runsolver used 1.44078 second user time and 3.19451 second system time

The end

Launcher Data 

Begin job on node126 at 2011-04-29 18:41:44
IDJOB=3263058
IDBENCH=83921
IDSOLVER=1654
FILE ID=node126/3263058-1304095304
RUNJOBID= node126-1304094101-16337
PBS_JOBID= 13170590
Free space on /tmp= 71596 MiB

SOLVER NAME= ttsth 5-4
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_15_90_1-log.shuffled-as.sat03-137.cnf
COMMAND LINE= DIR/ttsth-5-4 -num-threads NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3263058-1304095304/watcher-3263058-1304095304 -o /tmp/evaluation-result-3263058-1304095304/solver-3263058-1304095304 -C 4800 -W 1300 -M 15500  HOME/ttsth-5-4 -num-threads 4 HOME/instance-3263058-1304095304.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 808fa775df860c59a1178e77fc60f410
RANDOM SEED=1343102158

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      28544900 kB
Buffers:        246084 kB
Cached:        1398376 kB
SwapCached:         76 kB
Active:        2497488 kB
Inactive:      1593240 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      28544900 kB
SwapTotal:    67111528 kB
SwapFree:     67111448 kB
Dirty:             800 kB
Writeback:           0 kB
AnonPages:     2445712 kB
Mapped:          15316 kB
Slab:           246544 kB
PageTables:       9224 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  2636576 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71596 MiB
End job on node126 at 2011-04-29 18:56:34