Trace number 3729016

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.03 1800.41

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/
prestwich/armies/normalized-army12.21bt.opb
MD5SUMcc11de80c07cf0d445d50327479f6689
Bench CategoryDEC-SMALLINT (no optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark1373.4
Has Objective FunctionNO
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved NO
Number of variables428
Total number of constraints942
Number of constraints which are clauses645
Number of constraints which are cardinality constraints (but not clauses)2
Number of constraints which are nor clauses,nor cardinality constraints295
Minimum length of a constraint1
Maximum length of a constraint144
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 32
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 189
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.06	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.06	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.06	c type "bsolo -h" for help
0.00/0.06	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.06	c Memory Limit set to 15500 MB
0.00/0.06	c Instance file HOME/instance-3729016-1338678626.opb
0.00/0.06	c File size is 47344 bytes.
0.00/0.06	c Highest Coefficient sum: 189
0.00/0.06	c Parsing was ok!!
0.00/0.06	c Total parsing time: 0.004 s
0.00/0.06	c Var: 428 Constr: 942 645/2/295 Lit: 5161 Watch. Lit: 2829
0.00/0.06	c Obj. Vars: 0 (0 % of total variables)
0.00/0.07	c Pre-processing Time: 0.013 s
0.00/0.07	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
0.00/0.07	c        0    387      855     4769    5     2564    4855      0      0 0.01
0.00/0.07	c Switching off LPR mode.
1800.02/1800.40	c      101    387      956    14902   15     2816    5341    101   4809 0.02
1800.02/1800.40	c      254    387     1109    31949   28     3125    5876    254   6864 0.04
1800.02/1800.40	c      480    387     1335    59917   44     3585    6464    480   8135 0.06
1800.02/1800.40	c      818    387     1673   101751   60     4246    7111    818   8180 0.10
1800.02/1800.40	c     1326    387     2181   163124   74     5256    7823   1326   7709 0.17
1800.02/1800.40	c     2089    387     2944   250672   85     6776    8606   2089   7381 0.28
1800.02/1800.40	c     3236    387     4091   385757   94     9074    9467   3236   6798 0.48
1800.02/1800.40	c     4959    387     5814   589077  101    12537   10414   4959   5974 0.83
1800.02/1800.40	c     7545    387     8400   902792  107    17685   11456   7545   4983 1.51
1800.02/1800.40	c    11425    387    12280  1403858  114    25454   12602  11425   3731 3.06
1800.02/1800.40	c    17249    387    11577  1306950  112    24040   13863  10722   3333 5.17
1800.02/1800.40	c    25990    387    13122  1504157  114    27131   15250  12267   2866 9.07
1800.02/1800.40	c    39100    387    10434  1171997  112    21755   16776   9579   2507 15.59
1800.02/1800.40	c    58771    387    12775  1533126  120    26465   18454  11920   2279 25.79
1800.02/1800.40	c    88282    387    13714  1810247  131    28313   20300  12859   2125 41.54
1800.02/1800.40	c   132554    387    16264  2052589  126    33412   22331  15409   1953 67.87
1800.02/1800.40	c   198965    387    13635  1715226  125    28149   24565  12780   1762 112.88
1800.02/1800.40	c   298586    387    18461  2357268  127    37837   27022  17606   1586 188.18
1800.02/1800.40	c   448023    387    26266  3497720  133    53431   29725  25411   1447 309.56
1800.02/1800.40	c   672183    387    14007  1752564  125    28916   32698  13152   1300 516.96
1800.02/1800.40	c  1008429    387    32378  4203431  129    65639   35968  31523   1249 806.99
1800.02/1800.40	c  1512804    387    25066  3400015  135    51011   39565  24211   1165 1298.46
1800.02/1800.40	c Caught signal: 15
1800.02/1800.40	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.02/1800.40	c   22  1944906 168741  2240783    39058  5301582  38203   1080 1800.03
1800.02/1800.40	s UNKNOWN
1800.02/1800.40	c Total time: 1800.03 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3729016-1338678626/watcher-3729016-1338678626 -o /tmp/evaluation-result-3729016-1338678626/solver-3729016-1338678626 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3729016-1338678626.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.29 0.84 3/177 27246
/proc/meminfo: memFree=28212536/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=1532 CPUtime=0 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) D 27241 27246 27204 0 -1 4194304 74 0 0 0 0 0 0 0 20 0 1 0 333987990 1568768 29 33554432000 134512640 135840783 4290981776 4290979868 8250308 0 0 4096 0 18446744072100748580 0 0 17 5 0 0 0 0 0
/proc/27246/statm: 383 29 22 325 0 25 0

[startup+0.068549 s]
/proc/loadavg: 0.00 0.29 0.84 3/177 27246
/proc/meminfo: memFree=28212536/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=4820 CPUtime=0 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 531 0 4 0 0 0 0 0 20 0 1 0 333987990 4935680 460 33554432000 134512640 135840783 4290981776 4290981340 134551888 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 1205 461 344 325 0 141 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 4820

[startup+0.100222 s]
/proc/loadavg: 0.00 0.29 0.84 3/177 27246
/proc/meminfo: memFree=28212536/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=5208 CPUtime=0.03 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 630 0 4 0 3 0 0 0 20 0 1 0 333987990 5332992 559 33554432000 134512640 135840783 4290981776 4290978688 1582375 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 1302 559 349 325 0 238 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 5208

[startup+0.30019 s]
/proc/loadavg: 0.00 0.29 0.84 3/177 27246
/proc/meminfo: memFree=28212536/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=7668 CPUtime=0.23 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 1258 0 4 0 23 0 0 0 20 0 1 0 333987990 7852032 1187 33554432000 134512640 135840783 4290981776 4290978784 1582375 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 1917 1187 349 325 0 853 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 7668

[startup+0.700186 s]
/proc/loadavg: 0.00 0.29 0.84 3/177 27246
/proc/meminfo: memFree=28212536/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=11416 CPUtime=0.63 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 2175 0 4 0 63 0 0 0 20 0 1 0 333987990 11689984 2104 33554432000 134512640 135840783 4290981776 4290979328 1582375 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 2854 2104 349 325 0 1790 0
Current children cumulated CPU time (s) 0.63
Current children cumulated vsize (KiB) 11416

[startup+1.50019 s]
/proc/loadavg: 0.00 0.29 0.84 3/180 27252
/proc/meminfo: memFree=28197296/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=16600 CPUtime=1.42 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 3468 0 4 0 142 0 0 0 20 0 1 0 333987990 16998400 3397 33554432000 134512640 135840783 4290981776 4290979088 1582375 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 4150 3397 349 325 0 3086 0
Current children cumulated CPU time (s) 1.42
Current children cumulated vsize (KiB) 16600

[startup+3.10022 s]
/proc/loadavg: 0.00 0.29 0.84 3/180 27252
/proc/meminfo: memFree=28189608/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=23704 CPUtime=3.03 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 5272 0 4 0 302 1 0 0 20 0 1 0 333987990 24272896 5201 33554432000 134512640 135840783 4290981776 4290981136 134551048 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 5926 5202 349 325 0 4862 0
Current children cumulated CPU time (s) 3.03
Current children cumulated vsize (KiB) 23704

[startup+6.30021 s]
/proc/loadavg: 0.16 0.31 0.85 3/180 27252
/proc/meminfo: memFree=28181796/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=26532 CPUtime=6.23 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 5959 0 4 0 622 1 0 0 20 0 1 0 333987990 27168768 5888 33554432000 134512640 135840783 4290981776 4290978896 1582375 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 6633 5888 349 325 0 5569 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 26532

[startup+12.7002 s]
/proc/loadavg: 0.31 0.34 0.85 3/180 27252
/proc/meminfo: memFree=28174744/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=30708 CPUtime=12.62 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 7008 0 4 0 1261 1 0 0 20 0 1 0 333987990 31444992 6937 33554432000 134512640 135840783 4290981776 4290980964 1577067 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 7677 6937 349 325 0 6613 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 30708

[startup+25.5002 s]
/proc/loadavg: 0.60 0.41 0.86 2/175 27276
/proc/meminfo: memFree=28185896/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=35332 CPUtime=25.42 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 8177 0 4 0 2540 2 0 0 20 0 1 0 333987990 36179968 8101 33554432000 134512640 135840783 4290981776 4290981100 1576896 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 8833 8101 349 325 0 7769 0
Current children cumulated CPU time (s) 25.42
Current children cumulated vsize (KiB) 35332

[startup+51.1003 s]
/proc/loadavg: 1.08 0.53 0.89 3/179 27328
/proc/meminfo: memFree=28168576/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=43120 CPUtime=51 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 10132 0 4 0 5098 2 0 0 20 0 1 0 333987990 44154880 10045 33554432000 134512640 135840783 4290981776 4290981136 134550902 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 10780 10045 349 325 0 9716 0
Current children cumulated CPU time (s) 51
Current children cumulated vsize (KiB) 43120

[startup+102.307 s]
/proc/loadavg: 1.60 0.76 0.95 3/179 27366
/proc/meminfo: memFree=28158768/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=46724 CPUtime=102.2 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 11040 0 4 0 10217 3 0 0 20 0 1 0 333987990 47845376 10951 33554432000 134512640 135840783 4290981776 4290981136 134551104 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 11681 10951 349 325 0 10617 0
Current children cumulated CPU time (s) 102.2
Current children cumulated vsize (KiB) 46724

[startup+162.3 s]
/proc/loadavg: 1.83 0.98 1.01 3/179 27442
/proc/meminfo: memFree=28153988/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=51128 CPUtime=162.18 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 12147 0 4 0 16215 3 0 0 20 0 1 0 333987990 52355072 12054 33554432000 134512640 135840783 4290981776 4290981136 134551330 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 12782 12054 349 325 0 11718 0
Current children cumulated CPU time (s) 162.18
Current children cumulated vsize (KiB) 51128

[startup+222.3 s]
/proc/loadavg: 1.87 1.13 1.06 3/179 27556
/proc/meminfo: memFree=28151624/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=53572 CPUtime=222.17 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 12765 0 4 0 22213 4 0 0 20 0 1 0 333987990 54857728 12670 33554432000 134512640 135840783 4290981776 4290981136 134551052 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 13393 12670 349 325 0 12329 0
Current children cumulated CPU time (s) 222.17
Current children cumulated vsize (KiB) 53572

[startup+282.3 s]
/proc/loadavg: 1.95 1.29 1.12 3/178 27556
/proc/meminfo: memFree=28149832/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=54536 CPUtime=282.16 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 13008 0 4 0 28212 4 0 0 20 0 1 0 333987990 55844864 12906 33554432000 134512640 135840783 4290981776 4290981136 134551318 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 13634 12906 349 325 0 12570 0
Current children cumulated CPU time (s) 282.16
Current children cumulated vsize (KiB) 54536

[startup+342.3 s]
/proc/loadavg: 1.98 1.42 1.17 3/179 27557
/proc/meminfo: memFree=28143308/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=60740 CPUtime=342.14 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 14568 0 4 0 34210 4 0 0 20 0 1 0 333987990 62197760 14462 33554432000 134512640 135840783 4290981776 4290981136 134551084 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 15185 14462 349 325 0 14121 0
Current children cumulated CPU time (s) 342.14
Current children cumulated vsize (KiB) 60740

[startup+402.3 s]
/proc/loadavg: 2.03 1.53 1.22 3/179 27557
/proc/meminfo: memFree=28141756/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=60740 CPUtime=402.14 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 14568 0 4 0 40210 4 0 0 20 0 1 0 333987990 62197760 14462 33554432000 134512640 135840783 4290981776 4290981132 134521208 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 15185 14462 349 325 0 14121 0
Current children cumulated CPU time (s) 402.14
Current children cumulated vsize (KiB) 60740

[startup+462.3 s]
/proc/loadavg: 2.01 1.62 1.27 3/179 27557
/proc/meminfo: memFree=28141508/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=60740 CPUtime=462.12 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 14654 0 4 0 46208 4 0 0 20 0 1 0 333987990 62197760 14462 33554432000 134512640 135840783 4290981776 4290981200 134546112 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 15185 14462 349 325 0 14121 0
Current children cumulated CPU time (s) 462.12
Current children cumulated vsize (KiB) 60740

[startup+522.3 s]
/proc/loadavg: 2.00 1.68 1.31 3/179 27557
/proc/meminfo: memFree=28139212/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=62916 CPUtime=522.12 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 15198 0 4 0 52208 4 0 0 20 0 1 0 333987990 64425984 15005 33554432000 134512640 135840783 4290981776 4290981008 1207039 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 15729 15005 349 325 0 14665 0
Current children cumulated CPU time (s) 522.12
Current children cumulated vsize (KiB) 62916

[startup+582.3 s]
/proc/loadavg: 2.00 1.74 1.35 6/179 27560
/proc/meminfo: memFree=28135448/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=66704 CPUtime=582.11 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 16185 0 4 0 58206 5 0 0 20 0 1 0 333987990 68304896 15953 33554432000 134512640 135840783 4290981776 4290981136 134550764 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 16676 15953 349 325 0 15612 0
Current children cumulated CPU time (s) 582.11
Current children cumulated vsize (KiB) 66704

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.04 1.89 1.49 3/179 27561
/proc/meminfo: memFree=28131084/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=70148 CPUtime=822.07 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 17054 0 4 0 82202 5 0 0 20 0 1 0 333987990 71831552 16786 33554432000 134512640 135840783 4290981776 4290981136 134550779 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 17537 16786 349 325 0 16473 0
Current children cumulated CPU time (s) 822.07
Current children cumulated vsize (KiB) 70148

[startup+882.3 s]
/proc/loadavg: 2.01 1.91 1.52 3/179 27561
/proc/meminfo: memFree=28130832/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=70140 CPUtime=882.06 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 17091 0 4 0 88201 5 0 0 20 0 1 0 333987990 71823360 16812 33554432000 134512640 135840783 4290981776 4290981136 134550804 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 17535 16812 349 325 0 16471 0
Current children cumulated CPU time (s) 882.06
Current children cumulated vsize (KiB) 70140

[startup+942.3 s]
/proc/loadavg: 2.00 1.92 1.55 3/179 27562
/proc/meminfo: memFree=28130460/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=70140 CPUtime=942.05 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 17091 0 4 0 94200 5 0 0 20 0 1 0 333987990 71823360 16812 33554432000 134512640 135840783 4290981776 4290981136 134551186 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 17535 16812 349 325 0 16471 0
Current children cumulated CPU time (s) 942.05
Current children cumulated vsize (KiB) 70140

[startup+1002.3 s]
/proc/loadavg: 2.00 1.93 1.57 3/179 27562
/proc/meminfo: memFree=28130460/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=70140 CPUtime=1002.04 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 17091 0 4 0 100199 5 0 0 20 0 1 0 333987990 71823360 16812 33554432000 134512640 135840783 4290981776 4290981136 134551339 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 17535 16812 349 325 0 16471 0
Current children cumulated CPU time (s) 1002.04
Current children cumulated vsize (KiB) 70140

[startup+1062.3 s]
/proc/loadavg: 2.00 1.94 1.60 3/179 27562
/proc/meminfo: memFree=28127916/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=73068 CPUtime=1062.03 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 17792 0 4 0 106198 5 0 0 20 0 1 0 333987990 74821632 17512 33554432000 134512640 135840783 4290981776 4290981136 134550872 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 18267 17512 349 325 0 17203 0
Current children cumulated CPU time (s) 1062.03
Current children cumulated vsize (KiB) 73068

[startup+1122.3 s]
/proc/loadavg: 2.00 1.95 1.62 3/179 27562
/proc/meminfo: memFree=28126488/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=74672 CPUtime=1122.02 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 18373 0 4 0 112197 5 0 0 20 0 1 0 333987990 76464128 17913 33554432000 134512640 135840783 4290981776 4290981136 134550972 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 18668 17913 349 325 0 17604 0
Current children cumulated CPU time (s) 1122.02
Current children cumulated vsize (KiB) 74672

[startup+1182.3 s]
/proc/loadavg: 2.00 1.95 1.64 3/180 27565
/proc/meminfo: memFree=28126068/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=74512 CPUtime=1182.01 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 18373 0 4 0 118196 5 0 0 20 0 1 0 333987990 76300288 17905 33554432000 134512640 135840783 4290981776 4290981136 134551330 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 18628 17905 349 325 0 17564 0
Current children cumulated CPU time (s) 1182.01
Current children cumulated vsize (KiB) 74512

[startup+1242.3 s]
/proc/loadavg: 2.00 1.96 1.66 3/179 27566
/proc/meminfo: memFree=28126116/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=74512 CPUtime=1242 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 18373 0 4 0 124195 5 0 0 20 0 1 0 333987990 76300288 17905 33554432000 134512640 135840783 4290981776 4290981136 134551048 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 18628 17905 349 325 0 17564 0
Current children cumulated CPU time (s) 1242
Current children cumulated vsize (KiB) 74512

[startup+1302.3 s]
/proc/loadavg: 2.05 1.98 1.68 3/179 27566
/proc/meminfo: memFree=28125992/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=74512 CPUtime=1302 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 18373 0 4 0 130195 5 0 0 20 0 1 0 333987990 76300288 17905 33554432000 134512640 135840783 4290981776 4290981136 134550924 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 18628 17905 349 325 0 17564 0
Current children cumulated CPU time (s) 1302
Current children cumulated vsize (KiB) 74512

[startup+1362.3 s]
/proc/loadavg: 2.02 1.98 1.70 3/179 27566
/proc/meminfo: memFree=28119228/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=79724 CPUtime=1361.98 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 19731 0 4 0 136192 6 0 0 20 0 1 0 333987990 81637376 19208 33554432000 134512640 135840783 4290981776 4290981136 134551084 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 19931 19208 349 325 0 18867 0
Current children cumulated CPU time (s) 1361.98
Current children cumulated vsize (KiB) 79724

[startup+1422.31 s]
/proc/loadavg: 2.00 1.98 1.72 3/179 27642
/proc/meminfo: memFree=28130584/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=79724 CPUtime=1421.98 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 19731 0 4 0 142192 6 0 0 20 0 1 0 333987990 81637376 19208 33554432000 134512640 135840783 4290981776 4290981136 134551048 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 19931 19208 349 325 0 18867 0
Current children cumulated CPU time (s) 1421.98
Current children cumulated vsize (KiB) 79724

[startup+1482.3 s]
/proc/loadavg: 2.00 1.98 1.73 3/179 27642
/proc/meminfo: memFree=28124876/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=79948 CPUtime=1481.96 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 19755 0 4 0 148190 6 0 0 20 0 1 0 333987990 81866752 19232 33554432000 134512640 135840783 4290981776 4290981084 12080231 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 19987 19232 349 325 0 18923 0
Current children cumulated CPU time (s) 1481.96
Current children cumulated vsize (KiB) 79948

[startup+1542.3 s]
/proc/loadavg: 2.00 1.98 1.75 3/179 27643
/proc/meminfo: memFree=28122580/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=81348 CPUtime=1541.95 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 20134 0 4 0 154189 6 0 0 20 0 1 0 333987990 83300352 19582 33554432000 134512640 135840783 4290981776 4290981136 134550896 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 20337 19582 349 325 0 19273 0
Current children cumulated CPU time (s) 1541.95
Current children cumulated vsize (KiB) 81348

[startup+1602.3 s]
/proc/loadavg: 2.00 1.98 1.76 3/179 27643
/proc/meminfo: memFree=28118860/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=84124 CPUtime=1601.95 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 20828 0 4 0 160188 7 0 0 20 0 1 0 333987990 86142976 20276 33554432000 134512640 135840783 4290981776 4290981136 134551175 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 21031 20276 349 325 0 19967 0
Current children cumulated CPU time (s) 1601.95
Current children cumulated vsize (KiB) 84124

[startup+1662.3 s]
/proc/loadavg: 2.00 1.98 1.77 4/179 27643
/proc/meminfo: memFree=28119164/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=84124 CPUtime=1661.94 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 20830 0 4 0 166187 7 0 0 20 0 1 0 333987990 86142976 20276 33554432000 134512640 135840783 4290981776 4290981136 134550939 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 21031 20276 349 325 0 19967 0
Current children cumulated CPU time (s) 1661.94
Current children cumulated vsize (KiB) 84124

[startup+1722.3 s]
/proc/loadavg: 2.00 1.98 1.78 3/179 27643
/proc/meminfo: memFree=28118420/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=83924 CPUtime=1721.93 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 20830 0 4 0 172186 7 0 0 20 0 1 0 333987990 85938176 20258 33554432000 134512640 135840783 4290981776 4290981136 134550893 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 20981 20258 349 325 0 19917 0
Current children cumulated CPU time (s) 1721.93
Current children cumulated vsize (KiB) 83924

[startup+1782.3 s]
/proc/loadavg: 2.00 1.98 1.79 3/180 27646
/proc/meminfo: memFree=28117156/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=84616 CPUtime=1781.92 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 20971 0 4 0 178185 7 0 0 20 0 1 0 333987990 86646784 20399 33554432000 134512640 135840783 4290981776 4290981136 134551084 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 21154 20399 349 325 0 20090 0
Current children cumulated CPU time (s) 1781.92
Current children cumulated vsize (KiB) 84616



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.00 1.98 1.80 3/180 27646
/proc/meminfo: memFree=28117420/32873844 swapFree=7124/7124
[pid=27246] ppid=27241 vsize=84616 CPUtime=1800.02 cores=1,3,5,7
/proc/27246/stat : 27246 (bsolo3.0.17) R 27241 27246 27204 0 -1 4202496 20971 0 4 0 179995 7 0 0 20 0 1 0 333987990 86646784 20399 33554432000 134512640 135840783 4290981776 4290981136 134551175 0 0 4096 16384 0 0 0 17 5 0 0 4 0 0
/proc/27246/statm: 21154 20399 349 325 0 20090 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 84616

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.41
CPU time (s): 1800.03
CPU user time (s): 1799.96
CPU system time (s): 0.074988
CPU usage (%): 99.9791
Max. virtual memory (cumulated for all children) (KiB): 84616

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.96
system time used= 0.074988
maximum resident set size= 81596
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20974
page faults= 4
swaps= 0
block input operations= 2088
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 58
involuntary context switches= 1845

runsolver used 3.40048 second user time and 10.4444 second system time

The end

Launcher Data 

Begin job on node134 at 2012-06-03 01:10:26
IDJOB=3729016
IDBENCH=1161
IDSOLVER=2318
FILE ID=node134/3729016-1338678626
RUNJOBID= node134-1338678625-27224
PBS_JOBID= 14636679
Free space on /tmp= 70360 MiB

SOLVER NAME= bsolo 3.0.17
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/prestwich/armies/normalized-army12.21bt.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3729016-1338678626/watcher-3729016-1338678626 -o /tmp/evaluation-result-3729016-1338678626/solver-3729016-1338678626 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3729016-1338678626.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cc11de80c07cf0d445d50327479f6689
RANDOM SEED=1026612003

node134.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28213808 kB
Buffers:          462348 kB
Cached:          3295252 kB
SwapCached:           76 kB
Active:          1734748 kB
Inactive:        2033252 kB
Active(anon):       2064 kB
Inactive(anon):    10508 kB
Active(file):    1732684 kB
Inactive(file):  2022744 kB
Unevictable:        7124 kB
Mlocked:            7124 kB
SwapTotal:      67108856 kB
SwapFree:       67107756 kB
Dirty:             12324 kB
Writeback:             0 kB
AnonPages:         17268 kB
Mapped:            10492 kB
Shmem:                96 kB
Slab:             754388 kB
SReclaimable:     196060 kB
SUnreclaim:       558328 kB
KernelStack:        1424 kB
PageTables:         3864 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     104456 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70348 MiB
End job on node134 at 2012-06-03 01:40:28