Trace number 3707617

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
bsolo 3.2? 1798.04 1798.64

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-122.opb
MD5SUM45533d52c524a74641c715d4320b890b
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables48411
Total number of constraints1121517
Number of constraints which are clauses1007723
Number of constraints which are cardinality constraints (but not clauses)3523
Number of constraints which are nor clauses,nor cardinality constraints110271
Minimum length of a constraint2
Maximum length of a constraint690
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 691
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.2 - 23/05/2010 : 1630 GMT
0.00/0.00	c Developed by Vasco Manquinho and José Santos IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Learning Strategy: Cardinality Constraint Learning
0.00/0.00	c Time Limit set to 1800
0.00/0.00	c Instance file HOME/instance-3707617-1338216317.opb
0.00/0.00	c File size is 50888182 bytes.
3.58/3.62	c Highest Coefficient sum: 691
3.58/3.62	c Parsing was ok!!
3.58/3.62	c Total parsing time: 3.621 s
3.79/3.82	c Var: 48411 Constr: 1123290 1009495/3524/110271 Lit: 4338973 Watch. Lit: 2266060
3.79/3.82	c Obj. Vars: 0 (0 % of total variables)
182.86/182.98	c Pre-processing Time: 182.954 s
182.96/183.00	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
182.96/183.00	c        0  48411  1123290  4338973    3  2376331  500000      0      0 182.95
182.96/183.00	c Switching off lower bounding mode.
1797.99/1798.62	c      101  48411  1123492  4354407    3  2372121  550001    202      0 183.28
1797.99/1798.62	c      251  48411  1123792  4372203    3  2371363  605002    502      1 183.78
1797.99/1798.62	c      476  48411  1124242  4466509    3  2370836  665503    952      2 184.35
1797.99/1798.62	c      818  48411  1124926  4591005    4  2370898  732054   1636      4 185.55
1797.99/1798.62	c     1326  48411  1125942  4835977    4  2372665  805260   2652      7 187.14
1797.99/1798.62	c     2089  48411  1127465  5041291    4  2364356  885787   4175     10 190.12
1797.99/1798.62	c     3238  48411  1129763  5520125    4  2367548  974366   6473     16 194.24
1797.99/1798.62	c     4961  48411  1133209  6511061    5  2374440  500000   9919     24 202.35
1797.99/1798.62	c     7545  48411  1138377  7712359    6  2384776  550001  15087     35 214.54
1797.99/1798.62	c    11424  48411  1146126  9236484    8  2393806  605002  22836     49 233.10
1797.99/1798.62	c    17247  48411  1157762 11918322   10  2419454  665503  34472     63 270.54
1797.99/1798.62	c    25984  48411  1175235 16696186   14  2454707  732054  51945     71 364.48
1797.99/1798.62	c    39094  48411  1201450 23280122   19  2505982  805260  78160     81 482.13
1797.99/1798.62	c    58767  48411  1240765 32934754   26  2586468  885787 117475     83 707.25
1797.99/1798.62	c    88285  48411  1299801 47973674   36  2697820  974366 176511     85 1029.13
1797.99/1798.62	c Reducing formula size due to memory constraints
1797.99/1798.62	c Memory Limit: 1000.00 MB  Used: 1002.23 MB
1797.99/1798.62	c Resources Exceeded
1797.99/1798.62	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1797.99/1798.62	c   15   128383  27632  2501707  1154022 12039697  30732     71 1798.03
1797.99/1798.62	s UNKNOWN
1797.99/1798.62	c Total time: 1798.03 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3707617-1338216317/watcher-3707617-1338216317 -o /tmp/evaluation-result-3707617-1338216317/solver-3707617-1338216317 -C 1800 -W 1900 -M 15500 bsolo -l2 -t1800 HOME/instance-3707617-1338216317.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 2/176 27192
/proc/meminfo: memFree=30744172/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=60628 CPUtime=0 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 318 0 0 0 0 0 0 0 20 0 1 0 287760395 62083072 271 33554432000 134512640 137138936 4290656688 4290655064 136506715 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/27192/statm: 15157 271 180 642 0 2089 0

[startup+0.0236401 s]
/proc/loadavg: 2.00 2.00 2.00 2/176 27192
/proc/meminfo: memFree=30744172/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=61312 CPUtime=0.02 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 571 0 0 0 2 0 0 0 20 0 1 0 287760395 62783488 524 33554432000 134512640 137138936 4290656688 4290653440 136495608 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/27192/statm: 15328 525 239 642 0 2260 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 61312

[startup+0.10021 s]
/proc/loadavg: 2.00 2.00 2.00 2/176 27192
/proc/meminfo: memFree=30744172/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=64996 CPUtime=0.09 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 1750 0 0 0 9 0 0 0 20 0 1 0 287760395 66555904 1703 33554432000 134512640 137138936 4290656688 4290654952 136506715 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/27192/statm: 16249 1703 524 642 0 3181 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 64996

[startup+0.300194 s]
/proc/loadavg: 2.00 2.00 2.00 2/176 27192
/proc/meminfo: memFree=30744172/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=73596 CPUtime=0.29 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 4649 0 0 0 29 0 0 0 20 0 1 0 287760395 75362304 4602 33554432000 134512640 137138936 4290656688 4290655168 134529659 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/27192/statm: 18399 4603 1246 642 0 5331 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 73596

[startup+0.700192 s]
/proc/loadavg: 2.00 2.00 2.00 2/176 27192
/proc/meminfo: memFree=30744172/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=90852 CPUtime=0.69 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 10378 0 0 0 68 1 0 0 20 0 1 0 287760395 93032448 10331 33554432000 134512640 137138936 4290656688 4290654936 136506715 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/27192/statm: 22713 10331 2678 642 0 9645 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 90852

[startup+1.50019 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27193
/proc/meminfo: memFree=30700864/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=122988 CPUtime=1.49 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 21322 0 0 0 147 2 0 0 20 0 1 0 287760395 125939712 21235 33554432000 134512640 137138936 4290656688 4290655432 136457586 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/27192/statm: 30747 21236 5558 642 0 17679 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 122988

[startup+3.10019 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27193
/proc/meminfo: memFree=30658084/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=182588 CPUtime=3.09 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 41623 0 0 0 304 5 0 0 20 0 1 0 287760395 186970112 41457 33554432000 134512640 137138936 4290656688 4290655216 134517389 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/27192/statm: 45647 41457 10919 642 0 32579 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 182588

[startup+6.30029 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27193
/proc/meminfo: memFree=30471588/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=281616 CPUtime=6.29 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 80406 0 0 0 615 14 0 0 20 0 1 0 287760395 288374784 67721 33554432000 134512640 137138936 4290656688 4290074252 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 70404 67721 184 642 0 69760 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 281616

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27193
/proc/meminfo: memFree=30468884/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=281616 CPUtime=12.68 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 80412 0 0 0 1248 20 0 0 20 0 1 0 287760395 288374784 67727 33554432000 134512640 137138936 4290656688 4290074252 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 70404 67727 184 642 0 69760 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 281616

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27193
/proc/meminfo: memFree=30465288/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=281616 CPUtime=25.48 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 80420 0 0 0 2522 26 0 0 20 0 1 0 287760395 288374784 67735 33554432000 134512640 137138936 4290656688 4290074252 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 70404 67735 184 642 0 69760 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 281616

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27193
/proc/meminfo: memFree=30455740/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=281616 CPUtime=51.08 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 80430 0 0 0 5073 35 0 0 20 0 1 0 287760395 288374784 67745 33554432000 134512640 137138936 4290656688 4290074252 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 70404 67745 184 642 0 69760 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 281616

[startup+102.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27193
/proc/meminfo: memFree=30436024/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=281748 CPUtime=102.28 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 80444 0 0 0 10177 51 0 0 20 0 1 0 287760395 288509952 67759 33554432000 134512640 137138936 4290656688 4290074252 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 70437 67759 184 642 0 69793 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 281748

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27193
/proc/meminfo: memFree=30418788/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=281748 CPUtime=162.26 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 80457 0 0 0 16160 66 0 0 20 0 1 0 287760395 288509952 67772 33554432000 134512640 137138936 4290656688 4290074252 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 70437 67772 184 642 0 69793 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 281748

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27194
/proc/meminfo: memFree=30407504/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=279204 CPUtime=222.26 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 80493 0 0 0 22139 87 0 0 20 0 1 0 287760395 285904896 67153 33554432000 134512640 137138936 4290656688 4290655440 134578144 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 69801 67153 192 642 0 69157 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 279204

[startup+282.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 27194
/proc/meminfo: memFree=30349016/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=321732 CPUtime=282.24 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 91097 0 0 0 28114 110 0 0 20 0 1 0 287760395 329453568 77757 33554432000 134512640 137138936 4290656688 4290655616 134542199 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 80433 77757 192 642 0 79789 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 321732

[startup+342.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/178 27197
/proc/meminfo: memFree=30288028/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=362124 CPUtime=342.23 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 101195 0 0 0 34111 112 0 0 20 0 1 0 287760395 370814976 87855 33554432000 134512640 137138936 4290656688 4290655616 134542233 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 90531 87855 192 642 0 89887 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 362124

[startup+402.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 27197
/proc/meminfo: memFree=30233876/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=401484 CPUtime=402.23 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 111035 0 0 0 40093 130 0 0 20 0 1 0 287760395 411119616 97695 33554432000 134512640 137138936 4290656688 4290655804 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 100371 97695 192 642 0 99727 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 401484

[startup+462.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 27197
/proc/meminfo: memFree=30164216/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=450840 CPUtime=462.22 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 123374 0 0 0 46089 133 0 0 20 0 1 0 287760395 461660160 110034 33554432000 134512640 137138936 4290656688 4290655616 134542480 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 112710 110034 192 642 0 112066 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 450840

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27198
/proc/meminfo: memFree=30110812/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=481276 CPUtime=522.19 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 131001 0 0 0 52071 148 0 0 20 0 1 0 287760395 492826624 117643 33554432000 134512640 137138936 4290656688 4290655804 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 120319 117643 192 642 0 119675 0
Current children cumulated CPU time (s) 522.19
Current children cumulated vsize (KiB) 481276

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27198
/proc/meminfo: memFree=30054420/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=516828 CPUtime=582.14 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 139931 0 0 0 58057 157 0 0 20 0 1 0 287760395 529231872 126531 33554432000 134512640 137138936 4290656688 4290655616 134542770 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 129207 126531 192 642 0 128563 0
Current children cumulated CPU time (s) 582.14
Current children cumulated vsize (KiB) 516828

[startup+642.3 s]

################
# More data... #
################

/proc/meminfo: memFree=30637924/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=822160 CPUtime=1121.88 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 216514 0 0 0 111992 196 0 0 20 0 1 0 287760395 841891840 203136 33554432000 134512640 137138936 4290656688 4290655616 134542525 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 205540 203136 192 642 0 204896 0
Current children cumulated CPU time (s) 1121.88
Current children cumulated vsize (KiB) 822160

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27264
/proc/meminfo: memFree=30609404/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=850748 CPUtime=1181.86 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 223663 0 0 0 117988 198 0 0 20 0 1 0 287760395 871165952 210285 33554432000 134512640 137138936 4290656688 4290655804 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 212687 210285 192 642 0 212043 0
Current children cumulated CPU time (s) 1181.86
Current children cumulated vsize (KiB) 850748

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27264
/proc/meminfo: memFree=30584232/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=875332 CPUtime=1241.85 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 229807 0 0 0 123985 200 0 0 20 0 1 0 287760395 896339968 216429 33554432000 134512640 137138936 4290656688 4290655616 134542316 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 218833 216429 192 642 0 218189 0
Current children cumulated CPU time (s) 1241.85
Current children cumulated vsize (KiB) 875332

[startup+1302.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 27264
/proc/meminfo: memFree=30561416/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=898264 CPUtime=1301.85 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 235540 0 0 0 129983 202 0 0 20 0 1 0 287760395 919822336 222162 33554432000 134512640 137138936 4290656688 4290655616 134542316 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 224566 222162 192 642 0 223922 0
Current children cumulated CPU time (s) 1301.85
Current children cumulated vsize (KiB) 898264

[startup+1362.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 27264
/proc/meminfo: memFree=30535624/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=924680 CPUtime=1361.84 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 242144 0 0 0 135979 205 0 0 20 0 1 0 287760395 946872320 228766 33554432000 134512640 137138936 4290656688 4290655616 134542516 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 231170 228766 192 642 0 230526 0
Current children cumulated CPU time (s) 1361.84
Current children cumulated vsize (KiB) 924680

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27264
/proc/meminfo: memFree=30511096/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=947848 CPUtime=1421.83 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 247955 0 0 0 141976 207 0 0 20 0 1 0 287760395 970596352 234558 33554432000 134512640 137138936 4290656688 4290655440 134575387 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 236962 234558 192 642 0 236318 0
Current children cumulated CPU time (s) 1421.83
Current children cumulated vsize (KiB) 947848

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27265
/proc/meminfo: memFree=30488680/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=969768 CPUtime=1481.79 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 253480 0 0 0 147971 208 0 0 20 0 1 0 287760395 993042432 240038 33554432000 134512640 137138936 4290656688 4290655440 134575204 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 242442 240038 192 642 0 241798 0
Current children cumulated CPU time (s) 1481.79
Current children cumulated vsize (KiB) 969768

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 27268
/proc/meminfo: memFree=30470472/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=987084 CPUtime=1541.74 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 257876 0 0 0 153965 209 0 0 20 0 1 0 287760395 1010774016 244386 33554432000 134512640 137138936 4290656688 4290655616 134542339 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 246771 244386 192 642 0 246127 0
Current children cumulated CPU time (s) 1541.74
Current children cumulated vsize (KiB) 987084

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27268
/proc/meminfo: memFree=30450008/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1007572 CPUtime=1601.72 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 262982 0 0 0 159962 210 0 0 20 0 1 0 287760395 1031753728 249489 33554432000 134512640 137138936 4290656688 4290655616 134542233 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 251893 249489 192 642 0 251249 0
Current children cumulated CPU time (s) 1601.72
Current children cumulated vsize (KiB) 1007572

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27268
/proc/meminfo: memFree=30430416/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1026652 CPUtime=1661.72 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 267752 0 0 0 165960 212 0 0 20 0 1 0 287760395 1051291648 254259 33554432000 134512640 137138936 4290656688 4290655616 134542513 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 256663 254259 192 642 0 256019 0
Current children cumulated CPU time (s) 1661.72
Current children cumulated vsize (KiB) 1026652

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 27268
/proc/meminfo: memFree=30412932/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1043952 CPUtime=1721.71 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 272077 0 0 0 171958 213 0 0 20 0 1 0 287760395 1069006848 258584 33554432000 134512640 137138936 4290656688 4290655804 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 260988 258584 192 642 0 260344 0
Current children cumulated CPU time (s) 1721.71
Current children cumulated vsize (KiB) 1043952

[startup+1782.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 27269
/proc/meminfo: memFree=30406732/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1048776 CPUtime=1781.69 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 273530 0 0 0 177956 213 0 0 20 0 1 0 287760395 1073946624 259790 33554432000 134512640 137138936 4290656688 4290655280 134539684 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 262194 259790 192 642 0 261550 0
Current children cumulated CPU time (s) 1781.69
Current children cumulated vsize (KiB) 1048776

Solver just ended. Dumping a history of the last processes samples

[startup+1791.91 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 27269
/proc/meminfo: memFree=30406856/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1048776 CPUtime=1791.3 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 273530 0 0 0 178917 213 0 0 20 0 1 0 287760395 1073946624 259790 33554432000 134512640 137138936 4290656688 4290655440 134572775 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 262194 259790 192 642 0 261550 0
Current children cumulated CPU time (s) 1791.3
Current children cumulated vsize (KiB) 1048776

[startup+1795.1 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 27269
/proc/meminfo: memFree=30406856/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1048776 CPUtime=1794.5 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 273530 0 0 0 179237 213 0 0 20 0 1 0 287760395 1073946624 259790 33554432000 134512640 137138936 4290656688 4290655616 134542199 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 262194 259790 192 642 0 261550 0
Current children cumulated CPU time (s) 1794.5
Current children cumulated vsize (KiB) 1048776

[startup+1796.7 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 27269
/proc/meminfo: memFree=30406856/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1048776 CPUtime=1796.09 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 273530 0 0 0 179396 213 0 0 20 0 1 0 287760395 1073946624 259790 33554432000 134512640 137138936 4290656688 4290655616 134542525 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 262194 259790 192 642 0 261550 0
Current children cumulated CPU time (s) 1796.09
Current children cumulated vsize (KiB) 1048776

[startup+1797.5 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 27269
/proc/meminfo: memFree=30406856/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1048776 CPUtime=1796.89 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 273530 0 0 0 179476 213 0 0 20 0 1 0 287760395 1073946624 259790 33554432000 134512640 137138936 4290656688 4290655000 136504370 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 262194 259790 192 642 0 261550 0
Current children cumulated CPU time (s) 1796.89
Current children cumulated vsize (KiB) 1048776

[startup+1798.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 27269
/proc/meminfo: memFree=30406856/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1048776 CPUtime=1797.69 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 273530 0 0 0 179556 213 0 0 20 0 1 0 287760395 1073946624 259790 33554432000 134512640 137138936 4290656688 4290655616 134542233 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 262194 259790 192 642 0 261550 0
Current children cumulated CPU time (s) 1797.69
Current children cumulated vsize (KiB) 1048776

[startup+1798.51 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 27269
/proc/meminfo: memFree=30406856/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1048776 CPUtime=1797.9 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 273530 0 0 0 179577 213 0 0 20 0 1 0 287760395 1073946624 259790 33554432000 134512640 137138936 4290656688 4290655804 136570369 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 262194 259790 192 642 0 261550 0
Current children cumulated CPU time (s) 1797.9
Current children cumulated vsize (KiB) 1048776

[startup+1798.6 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 27269
/proc/meminfo: memFree=30406856/32873844 swapFree=7372/7372
[pid=27192] ppid=27190 vsize=1048776 CPUtime=1797.99 cores=0,2,4,6
/proc/27192/stat : 27192 (bsolo) R 27190 27192 24082 0 -1 4202496 273530 0 0 0 179586 213 0 0 20 0 1 0 287760395 1073946624 259790 33554432000 134512640 137138936 4290656688 4290655616 134542325 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/27192/statm: 262194 259790 192 642 0 261550 0
Current children cumulated CPU time (s) 1797.99
Current children cumulated vsize (KiB) 1048776

Child status: 0
Real time (s): 1798.64
CPU time (s): 1798.04
CPU user time (s): 1795.9
CPU system time (s): 2.14767
CPU usage (%): 99.967
Max. virtual memory (cumulated for all children) (KiB): 1049764

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1795.9
system time used= 2.14767
maximum resident set size= 1040148
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 273530
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 458
involuntary context switches= 2031

runsolver used 2.68959 second user time and 7.14991 second system time

The end

Launcher Data 

Begin job on node109 at 2012-05-28 16:45:18
IDJOB=3707617
IDBENCH=89800
IDSOLVER=2286
FILE ID=node109/3707617-1338216317
RUNJOBID= node109-1338195882-24098
PBS_JOBID= 14624611
Free space on /tmp= 71144 MiB

SOLVER NAME= bsolo 3.2
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-122.opb
COMMAND LINE= bsolo -l2 -tTIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3707617-1338216317/watcher-3707617-1338216317 -o /tmp/evaluation-result-3707617-1338216317/solver-3707617-1338216317 -C 1800 -W 1900 -M 15500  bsolo -l2 -t1800 HOME/instance-3707617-1338216317.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 45533d52c524a74641c715d4320b890b
RANDOM SEED=1384395769

node109.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30744172 kB
Buffers:          205664 kB
Cached:           432768 kB
SwapCached:          588 kB
Active:          1056720 kB
Inactive:         262584 kB
Active(anon):     675284 kB
Inactive(anon):     7668 kB
Active(file):     381436 kB
Inactive(file):   254916 kB
Unevictable:        7372 kB
Mlocked:            7372 kB
SwapTotal:      67108856 kB
SwapFree:       67106292 kB
Dirty:             53440 kB
Writeback:             0 kB
AnonPages:        689496 kB
Mapped:            11132 kB
Shmem:                 8 kB
Slab:             666272 kB
SReclaimable:     108492 kB
SUnreclaim:       557780 kB
KernelStack:        1448 kB
PageTables:         5248 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     804408 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    389120 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71188 MiB
End job on node109 at 2012-05-28 17:15:17