Trace number 3707667

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
bsolo 3.2? 1798.04 1798.57

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K141.opb
MD5SUMe981076bb5354ded6cb9b093a6d1a03e
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables16779
Total number of constraints17063
Number of constraints which are clauses16922
Number of constraints which are cardinality constraints (but not clauses)141
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint141
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 142
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.2 - 23/05/2010 : 1630 GMT
0.00/0.00	c Developed by Vasco Manquinho and José Santos IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Learning Strategy: Cardinality Constraint Learning
0.00/0.00	c Time Limit set to 1800
0.00/0.00	c Instance file HOME/instance-3707667-1338237829.opb
0.00/0.00	c File size is 1144017 bytes.
0.08/0.08	c Highest Coefficient sum: 142
0.08/0.08	c Parsing was ok!!
0.08/0.08	c Total parsing time: 0.086 s
0.08/0.09	c Var: 16779 Constr: 17063 16922/141/0 Lit: 109699 Watch. Lit: 50621
0.08/0.09	c Obj. Vars: 0 (0 % of total variables)
7.38/7.47	c Pre-processing Time: 7.476 s
7.38/7.47	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
7.38/7.47	c        0  15259    15649   103418    6    47373  142602      0      0 7.48
7.38/7.47	c Switching off lower bounding mode.
1797.95/1798.54	c      100  15259    15766   112698    7    49190  156863    117     13 7.55
1797.95/1798.54	c      250  15259    15939   138995    8    50491  172550    290     32 7.79
1797.95/1798.54	c      477  15259    16223   166235   10    53377  189806    574     58 8.15
1797.95/1798.54	c      815  15259    16629   217110   13    57246  208787    980     93 8.71
1797.95/1798.54	c     1323  15259    17258   309721   17    60234  229666   1609    140 9.40
1797.95/1798.54	c     2091  15259    18172   421106   23    66915  252633   2523    192 10.87
1797.95/1798.54	c     3238  15259    19535   617488   31    74522  277897   3886    255 12.68
1797.95/1798.54	c     4959  15259    21481   959480   44    82587  305687   5832    319 15.52
1797.95/1798.54	c     7545  15259    24542  1756019   71    97236  336256   8893    348 21.64
1797.95/1798.54	c    11424  15259    28991  2844876   98   117953  369882  13342    345 33.10
1797.95/1798.54	c    17246  15259    35552  4848748  136   147114  406871  19903    353 48.79
1797.95/1798.54	c    25984  15259    45937 14731712  320   192631  447559  30288    231 112.40
1797.95/1798.54	c    39094  15259    61089 19342564  316   258635  492315  45440    216 180.81
1797.95/1798.54	c    58764  15259    83827 28707679  342   345645  541547  68178    181 323.56
1797.95/1798.54	c    88274  15259   118400 44494890  375   493491  595702 102751    142 618.34
1797.95/1798.54	c Reducing formula size due to memory constraints
1797.95/1798.54	c Memory Limit: 1000.00 MB  Used: 1009.93 MB
1797.95/1798.54	c   132544  15259    42268 18305083  433   145327   46242  26619    112 1174.83
1797.95/1798.54	c   198954  15259    55756 40266080  722   185877   50867  40107    115 1723.49
1797.95/1798.54	c Resources Exceeded
1797.95/1798.54	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1797.95/1798.54	c   17   208026 133924  9397934    66226 45887139  50577    115 1798.00
1797.95/1798.54	s UNKNOWN
1797.95/1798.54	c Total time: 1798 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3707667-1338237829/watcher-3707667-1338237829 -o /tmp/evaluation-result-3707667-1338237829/solver-3707667-1338237829 -C 1800 -W 1900 -M 15500 bsolo -l2 -t1800 HOME/instance-3707667-1338237829.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.06 2.02 1.99 3/174 18758
/proc/meminfo: memFree=28977488/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=20144 CPUtime=0 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 381 0 0 0 0 0 0 0 20 0 1 0 289908804 20627456 335 33554432000 134512640 137138936 4290426624 4290423208 136506715 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 5036 335 179 642 0 4112 0

[startup+0.0877929 s]
/proc/loadavg: 2.06 2.02 1.99 3/174 18758
/proc/meminfo: memFree=28977488/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=15476 CPUtime=0.08 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 1436 0 0 0 8 0 0 0 20 0 1 0 289908804 15847424 1390 33554432000 134512640 137138936 4290426624 4290423480 136506715 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 3869 1390 442 642 0 2945 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 15476

[startup+0.100296 s]
/proc/loadavg: 2.06 2.02 1.99 3/174 18758
/proc/meminfo: memFree=28977488/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=17184 CPUtime=0.09 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 2120 0 0 0 9 0 0 0 20 0 1 0 289908804 17596416 1794 33554432000 134512640 137138936 4290426624 4290223964 136570369 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 4296 1794 184 642 0 3652 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 17184

[startup+0.300233 s]
/proc/loadavg: 2.06 2.02 1.99 3/174 18758
/proc/meminfo: memFree=28977488/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=17184 CPUtime=0.29 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 2125 0 0 0 29 0 0 0 20 0 1 0 289908804 17596416 1799 33554432000 134512640 137138936 4290426624 4290223824 134542716 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 4296 1799 184 642 0 3652 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 17184

[startup+0.70023 s]
/proc/loadavg: 2.06 2.02 1.99 3/174 18758
/proc/meminfo: memFree=28977488/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=17184 CPUtime=0.69 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 2127 0 0 0 69 0 0 0 20 0 1 0 289908804 17596416 1801 33554432000 134512640 137138936 4290426624 4290223560 136504193 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 4296 1801 184 642 0 3652 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 17184

[startup+1.50023 s]
/proc/loadavg: 2.06 2.02 1.99 3/175 18759
/proc/meminfo: memFree=28969892/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=17184 CPUtime=1.49 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 2127 0 0 0 149 0 0 0 20 0 1 0 289908804 17596416 1801 33554432000 134512640 137138936 4290426624 4290223964 136570369 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 4296 1801 184 642 0 3652 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 17184

[startup+3.10023 s]
/proc/loadavg: 2.06 2.02 1.99 3/175 18759
/proc/meminfo: memFree=28969488/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=17184 CPUtime=3.09 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 2128 0 0 0 309 0 0 0 20 0 1 0 289908804 17596416 1802 33554432000 134512640 137138936 4290426624 4290223776 134542351 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 4296 1802 184 642 0 3652 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 17184

[startup+6.30023 s]
/proc/loadavg: 2.06 2.02 1.99 3/175 18759
/proc/meminfo: memFree=28969116/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=17184 CPUtime=6.29 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 2130 0 0 0 629 0 0 0 20 0 1 0 289908804 17596416 1804 33554432000 134512640 137138936 4290426624 4290223776 134542333 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 4296 1804 184 642 0 3652 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 17184

[startup+12.7003 s]
/proc/loadavg: 2.13 2.03 1.99 3/175 18759
/proc/meminfo: memFree=28950760/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=24864 CPUtime=12.68 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 4230 0 0 0 1253 15 0 0 20 0 1 0 289908804 25460736 3736 33554432000 134512640 137138936 4290426624 4290425740 136570369 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 6216 3736 192 642 0 5572 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 24864

[startup+25.5003 s]
/proc/loadavg: 2.11 2.03 1.99 3/175 18759
/proc/meminfo: memFree=28906656/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=43952 CPUtime=25.49 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 9027 0 0 0 2515 34 0 0 20 0 1 0 289908804 45006848 8533 33554432000 134512640 137138936 4290426624 4290425552 134542295 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 10988 8533 192 642 0 10344 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 43952

[startup+51.1003 s]
/proc/loadavg: 2.07 2.03 1.99 3/175 18759
/proc/meminfo: memFree=28820272/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=84096 CPUtime=51.08 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 19044 0 0 0 5053 55 0 0 20 0 1 0 289908804 86114304 18550 33554432000 134512640 137138936 4290426624 4290425552 134542624 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 21024 18550 192 642 0 20380 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 84096

[startup+102.307 s]
/proc/loadavg: 2.14 2.05 2.00 3/175 18759
/proc/meminfo: memFree=28619560/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=195200 CPUtime=102.28 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 46826 0 0 0 10159 69 0 0 20 0 1 0 289908804 199884800 46332 33554432000 134512640 137138936 4290426624 4290425120 134618214 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 48800 46332 192 642 0 48156 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 195200

[startup+162.3 s]
/proc/loadavg: 2.05 2.04 2.00 3/175 18760
/proc/meminfo: memFree=28468440/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=254204 CPUtime=162.26 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 61588 0 0 0 16125 101 0 0 20 0 1 0 289908804 260304896 61094 33554432000 134512640 137138936 4290426624 4290425740 136570369 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 63551 61094 192 642 0 62907 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 254204

[startup+222.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/175 18760
/proc/meminfo: memFree=28331572/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=304592 CPUtime=222.25 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 74174 0 0 0 22108 117 0 0 20 0 1 0 289908804 311902208 73680 33554432000 134512640 137138936 4290426624 4290425552 134542613 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 76148 73680 192 642 0 75504 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 304592

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/175 18760
/proc/meminfo: memFree=28220496/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=354580 CPUtime=282.25 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 86671 0 0 0 28090 135 0 0 20 0 1 0 289908804 363089920 86177 33554432000 134512640 137138936 4290426624 4290425552 134541999 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 88645 86177 192 642 0 88001 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 354580

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/175 18760
/proc/meminfo: memFree=28096304/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=404040 CPUtime=342.24 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 99044 0 0 0 34070 154 0 0 20 0 1 0 289908804 413736960 98547 33554432000 134512640 137138936 4290426624 4290425376 134575390 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 101010 98547 192 642 0 100366 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 404040

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/176 18763
/proc/meminfo: memFree=27975300/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=448968 CPUtime=402.18 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 110315 0 0 0 40048 170 0 0 20 0 1 0 289908804 459743232 109774 33554432000 134512640 137138936 4290426624 4290425740 136570369 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 112242 109774 192 642 0 111598 0
Current children cumulated CPU time (s) 402.18
Current children cumulated vsize (KiB) 448968

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/174 18763
/proc/meminfo: memFree=27824312/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=479864 CPUtime=462.13 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 118078 0 0 0 46026 187 0 0 20 0 1 0 289908804 491380736 117499 33554432000 134512640 137138936 4290426624 4290425552 134542307 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 119966 117499 192 642 0 119322 0
Current children cumulated CPU time (s) 462.13
Current children cumulated vsize (KiB) 479864

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18764
/proc/meminfo: memFree=27702936/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=519156 CPUtime=522.09 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 127944 0 0 0 52004 205 0 0 20 0 1 0 289908804 531615744 127321 33554432000 134512640 137138936 4290426624 4290425740 136570369 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 129789 127321 192 642 0 129145 0
Current children cumulated CPU time (s) 522.09
Current children cumulated vsize (KiB) 519156

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18764
/proc/meminfo: memFree=27608352/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=563816 CPUtime=582.04 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 139154 0 0 0 57989 215 0 0 20 0 1 0 289908804 577347584 138486 33554432000 134512640 137138936 4290426624 4290425440 136504016 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 140954 138486 192 642 0 140310 0
Current children cumulated CPU time (s) 582.04
Current children cumulated vsize (KiB) 563816

[startup+642.3 s]

################
# More data... #
################

/proc/meminfo: memFree=26975432/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=976656 CPUtime=1061.86 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 242487 0 0 0 105891 295 0 0 20 0 1 0 289908804 1000095744 242188 33554432000 134512640 137138936 4290426624 4290425048 134606982 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 244164 242188 192 642 0 243520 0
Current children cumulated CPU time (s) 1061.86
Current children cumulated vsize (KiB) 976656

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18792
/proc/meminfo: memFree=26926364/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1025432 CPUtime=1121.85 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 254675 0 0 0 111881 304 0 0 20 0 1 0 289908804 1050042368 254376 33554432000 134512640 137138936 4290426624 4290425348 136502581 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 256358 254376 192 642 0 255714 0
Current children cumulated CPU time (s) 1121.85
Current children cumulated vsize (KiB) 1025432

[startup+1182.3 s]
/proc/loadavg: 2.08 2.02 2.01 3/174 18792
/proc/meminfo: memFree=26904080/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1181.85 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 117866 319 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425740 136570369 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1181.85
Current children cumulated vsize (KiB) 1047500

[startup+1242.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/175 18793
/proc/meminfo: memFree=26903108/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1241.84 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 123853 331 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425552 134542503 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1241.84
Current children cumulated vsize (KiB) 1047500

[startup+1302.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/175 18793
/proc/meminfo: memFree=26902888/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1301.83 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 129846 337 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425552 134542325 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1301.83
Current children cumulated vsize (KiB) 1047500

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18793
/proc/meminfo: memFree=26903164/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1361.82 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 135830 352 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425336 136504068 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1361.82
Current children cumulated vsize (KiB) 1047500

[startup+1422.31 s]
/proc/loadavg: 2.08 2.02 2.01 3/175 18794
/proc/meminfo: memFree=26903108/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1421.82 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 141807 375 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425552 134542480 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1421.82
Current children cumulated vsize (KiB) 1047500

[startup+1482.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/175 18794
/proc/meminfo: memFree=26903232/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1481.8 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 147792 388 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425552 134542752 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1481.8
Current children cumulated vsize (KiB) 1047500

[startup+1542.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/175 18794
/proc/meminfo: memFree=26902984/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1541.79 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 153787 392 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425048 134606958 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1541.79
Current children cumulated vsize (KiB) 1047500

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 18797
/proc/meminfo: memFree=26902976/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1601.78 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 159781 397 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425740 136570369 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1601.78
Current children cumulated vsize (KiB) 1047500

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18797
/proc/meminfo: memFree=26903108/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1661.77 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 165775 402 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425552 134542770 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1661.77
Current children cumulated vsize (KiB) 1047500

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18798
/proc/meminfo: memFree=26903108/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1721.77 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 171771 406 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425140 134551328 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1721.77
Current children cumulated vsize (KiB) 1047500

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18798
/proc/meminfo: memFree=26902860/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1781.75 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 177754 421 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425552 134542316 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1781.75
Current children cumulated vsize (KiB) 1047500

Solver just ended. Dumping a history of the last processes samples

[startup+1791.91 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18798
/proc/meminfo: memFree=26903108/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1791.36 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 178712 424 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425556 136501736 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1791.36
Current children cumulated vsize (KiB) 1047500

[startup+1795.1 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18798
/proc/meminfo: memFree=26903108/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1794.56 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 179032 424 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425740 136570369 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1794.56
Current children cumulated vsize (KiB) 1047500

[startup+1796.7 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18798
/proc/meminfo: memFree=26903108/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1796.15 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 179191 424 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425168 134607574 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1796.15
Current children cumulated vsize (KiB) 1047500

[startup+1797.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18798
/proc/meminfo: memFree=26903108/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1796.95 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 179271 424 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425140 134551589 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1796.95
Current children cumulated vsize (KiB) 1047500

[startup+1798.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18798
/proc/meminfo: memFree=26903108/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1797.75 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 179351 424 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425120 134618214 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1797.75
Current children cumulated vsize (KiB) 1047500

[startup+1798.51 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 18798
/proc/meminfo: memFree=26903108/32873852 swapFree=6856/6856
[pid=18758] ppid=18756 vsize=1047500 CPUtime=1797.95 cores=1,3,5,7
/proc/18758/stat : 18758 (bsolo) R 18756 18758 18303 0 -1 4202496 260342 0 0 0 179371 424 0 0 20 0 1 0 289908804 1072640000 259895 33554432000 134512640 137138936 4290426624 4290425120 134618214 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18758/statm: 261875 259895 192 642 0 261231 0
Current children cumulated CPU time (s) 1797.95
Current children cumulated vsize (KiB) 1047500

Child status: 0
Real time (s): 1798.57
CPU time (s): 1798.04
CPU user time (s): 1793.76
CPU system time (s): 4.28035
CPU usage (%): 99.97
Max. virtual memory (cumulated for all children) (KiB): 1048092

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.76
system time used= 4.28035
maximum resident set size= 1040172
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 260342
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 294
involuntary context switches= 1863

runsolver used 2.6296 second user time and 7.19191 second system time

The end

Launcher Data 

Begin job on node128 at 2012-05-28 22:43:49
IDJOB=3707667
IDBENCH=90203
IDSOLVER=2286
FILE ID=node128/3707667-1338237829
RUNJOBID= node128-1338230633-18320
PBS_JOBID= 14624653
Free space on /tmp= 71248 MiB

SOLVER NAME= bsolo 3.2
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K141.opb
COMMAND LINE= bsolo -l2 -tTIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3707667-1338237829/watcher-3707667-1338237829 -o /tmp/evaluation-result-3707667-1338237829/solver-3707667-1338237829 -C 1800 -W 1900 -M 15500  bsolo -l2 -t1800 HOME/instance-3707667-1338237829.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e981076bb5354ded6cb9b093a6d1a03e
RANDOM SEED=1031005813

node128.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873852 kB
MemFree:        28977380 kB
Buffers:          503940 kB
Cached:          2509076 kB
SwapCached:          584 kB
Active:          1254456 kB
Inactive:        1777452 kB
Active(anon):       8268 kB
Inactive(anon):    12300 kB
Active(file):    1246188 kB
Inactive(file):  1765152 kB
Unevictable:        6856 kB
Mlocked:            6856 kB
SwapTotal:      67108856 kB
SwapFree:       67107332 kB
Dirty:              9704 kB
Writeback:            16 kB
AnonPages:         83600 kB
Mapped:            15084 kB
Shmem:               200 kB
Slab:             726176 kB
SReclaimable:     168456 kB
SUnreclaim:       557720 kB
KernelStack:        1472 kB
PageTables:         4356 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545780 kB
Committed_AS:     139160 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346360 kB
VmallocChunk:   34341988004 kB
HardwareCorrupted:     0 kB
AnonHugePages:     63488 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71244 MiB
End job on node128 at 2012-05-28 23:13:48