Trace number 3707706

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
bsolo 3.2? 1798.06 1798.64

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/
normalized-TateBritain_K89.opb
MD5SUM30c9df0e6d94fba856558f98ad1383d9
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6052
Total number of constraints6232
Number of constraints which are clauses6143
Number of constraints which are cardinality constraints (but not clauses)89
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint89
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 90
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.2 - 23/05/2010 : 1630 GMT
0.00/0.00	c Developed by Vasco Manquinho and José Santos IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Learning Strategy: Cardinality Constraint Learning
0.00/0.00	c Time Limit set to 1800
0.00/0.00	c Instance file HOME/instance-3707706-1338229034.opb
0.00/0.00	c File size is 386966 bytes.
0.00/0.02	c Highest Coefficient sum: 90
0.00/0.02	c Parsing was ok!!
0.00/0.02	c Total parsing time: 0.028 s
0.00/0.03	c Var: 6052 Constr: 6232 6143/89/0 Lit: 38838 Watch. Lit: 18336
0.00/0.03	c Obj. Vars: 0 (0 % of total variables)
1.09/1.16	c Pre-processing Time: 1.164 s
1.09/1.16	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1.09/1.16	c        0   5313     5549    35814    6    16741   87056      0      0 1.16
1.09/1.16	c Switching off lower bounding mode.
1798.01/1798.63	c      100   5313     5671    51488    9    17569   95762    122     82 1.21
1798.01/1798.63	c      252   5313     5839    73940   12    18195  105339    290    190 1.32
1798.01/1798.63	c      478   5313     6110   107245   17    19814  115873    561    310 1.54
1798.01/1798.63	c      816   5313     6494   157055   24    21143  127461    945    461 1.77
1798.01/1798.63	c     1324   5313     7073   265735   37    23759  140208   1524    565 2.34
1798.01/1798.63	c     2087   5313     7924   361460   45    27333  154229   2375    708 2.94
1798.01/1798.63	c     3233   5313     9228   641474   69    32439  169652   3679    726 4.45
1798.01/1798.63	c     4954   5313    11153  1324636  118    38405  186618   5604    707 7.00
1798.01/1798.63	c     7538   5313    14238  3378100  237    48041  205280   8689    516 14.60
1798.01/1798.63	c    11417   5313    18788  5748880  305    60746  225809  13239    433 26.32
1798.01/1798.63	c    17242   5313    25637 10845696  423    83512  248390  20088    321 53.57
1798.01/1798.63	c    25979   5313    35746 17863369  499   116293  273230  30197    232 111.80
1798.01/1798.63	c    39092   5313    51848 42231340  814   165602  300554  46299    128 303.72
1798.01/1798.63	c    58764   5313    75379 70977998  941   234055  330610  69830     95 614.88
1798.01/1798.63	c Reducing formula size due to memory constraints
1798.01/1798.63	c Memory Limit: 1000.00 MB  Used: 1001.84 MB
1798.01/1798.63	c    88274   5313    20635 15245288  738    57688   29934  15086     99 891.38
1798.01/1798.63	c   132544   5313    30030 22223889  740    87357   32928  24481    104 1268.00
1798.01/1798.63	c   198954   5313    25094  7869001  313    67301   36221  19545    123 1608.49
1798.01/1798.63	c Resources Exceeded
1798.01/1798.63	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1798.01/1798.63	c   17   229430 122509  3532905    43519 26670274  37970    127 1798.06
1798.01/1798.63	s UNKNOWN
1798.01/1798.63	c Total time: 1798.06 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3707706-1338229034/watcher-3707706-1338229034 -o /tmp/evaluation-result-3707706-1338229034/solver-3707706-1338229034 -C 1800 -W 1900 -M 15500 bsolo -l2 -t1800 HOME/instance-3707706-1338229034.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.04 2.07 1.97 3/176 4214
/proc/meminfo: memFree=30308852/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=11460 CPUtime=0 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 368 0 0 0 0 0 0 0 20 0 1 0 289028843 11735040 322 33554432000 134512640 137138936 4291555040 4291553304 136506715 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 2865 322 180 642 0 2126 0

[startup+0.100567 s]
/proc/loadavg: 2.04 2.07 1.97 3/176 4214
/proc/meminfo: memFree=30308852/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=12976 CPUtime=0.09 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 923 0 0 0 9 0 0 0 20 0 1 0 289028843 13287424 782 33554432000 134512640 137138936 4291555040 4291481116 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 3244 782 184 642 0 2600 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12976

[startup+0.200261 s]
/proc/loadavg: 2.04 2.07 1.97 3/176 4214
/proc/meminfo: memFree=30308852/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=12976 CPUtime=0.19 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 923 0 0 0 19 0 0 0 20 0 1 0 289028843 13287424 782 33554432000 134512640 137138936 4291555040 4291481116 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 3244 782 184 642 0 2600 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 12976

[startup+0.300148 s]
/proc/loadavg: 2.04 2.07 1.97 3/176 4214
/proc/meminfo: memFree=30308852/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=12976 CPUtime=0.29 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 924 0 0 0 29 0 0 0 20 0 1 0 289028843 13287424 783 33554432000 134512640 137138936 4291555040 4291481116 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 3244 783 184 642 0 2600 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 12976

[startup+0.700182 s]
/proc/loadavg: 2.04 2.07 1.97 3/176 4214
/proc/meminfo: memFree=30308852/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=12976 CPUtime=0.69 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 924 0 0 0 69 0 0 0 20 0 1 0 289028843 13287424 783 33554432000 134512640 137138936 4291555040 4291481116 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 3244 783 184 642 0 2600 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 12976

[startup+1.50018 s]
/proc/loadavg: 2.04 2.07 1.97 3/177 4215
/proc/meminfo: memFree=30306224/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=13876 CPUtime=1.48 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 1265 0 0 0 147 1 0 0 20 0 1 0 289028843 14209024 1029 33554432000 134512640 137138936 4291555040 4291554156 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 3469 1029 192 642 0 2825 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 13876

[startup+3.10019 s]
/proc/loadavg: 2.04 2.07 1.97 3/177 4215
/proc/meminfo: memFree=30303240/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=18028 CPUtime=3.09 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 2318 0 0 0 305 4 0 0 20 0 1 0 289028843 18460672 2082 33554432000 134512640 137138936 4291555040 4291553584 134607581 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 4507 2082 192 642 0 3863 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 18028

[startup+6.3002 s]
/proc/loadavg: 2.04 2.07 1.97 3/177 4215
/proc/meminfo: memFree=30293816/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=27916 CPUtime=6.29 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 4780 0 0 0 623 6 0 0 20 0 1 0 289028843 28585984 4544 33554432000 134512640 137138936 4291555040 4291554156 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 6979 4544 192 642 0 6335 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 27916

[startup+12.7002 s]
/proc/loadavg: 2.03 2.06 1.97 3/177 4215
/proc/meminfo: memFree=30269412/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=51248 CPUtime=12.69 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 10766 0 0 0 1260 9 0 0 20 0 1 0 289028843 52477952 10381 33554432000 134512640 137138936 4291555040 4291544944 136577166 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 12812 10381 192 642 0 12168 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 51248

[startup+25.5003 s]
/proc/loadavg: 2.03 2.06 1.97 3/177 4215
/proc/meminfo: memFree=30232716/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=86128 CPUtime=25.48 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 19726 0 0 0 2536 12 0 0 20 0 1 0 289028843 88195072 19101 33554432000 134512640 137138936 4291555040 4291553464 134606982 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 21532 19101 192 642 0 20888 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 86128

[startup+51.1003 s]
/proc/loadavg: 2.02 2.05 1.97 3/177 4215
/proc/meminfo: memFree=30172576/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=147252 CPUtime=51.08 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 36135 0 0 0 5088 20 0 0 20 0 1 0 289028843 150786048 34370 33554432000 134512640 137138936 4291555040 4291553968 134542325 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 36813 34370 192 642 0 36169 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 147252

[startup+102.3 s]
/proc/loadavg: 2.15 2.08 1.98 3/177 4215
/proc/meminfo: memFree=30084164/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=234044 CPUtime=102.28 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 59700 0 0 0 10196 32 0 0 20 0 1 0 289028843 239661056 56082 33554432000 134512640 137138936 4291555040 4291553968 134542316 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 58511 56082 192 642 0 57867 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 234044

[startup+162.3 s]
/proc/loadavg: 2.17 2.09 1.99 3/177 4216
/proc/meminfo: memFree=29980252/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=338752 CPUtime=162.26 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 96058 0 0 0 16184 42 0 0 20 0 1 0 289028843 346882048 82270 33554432000 134512640 137138936 4291555040 4291553968 134542342 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 84688 82270 192 642 0 84044 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 338752

[startup+222.306 s]
/proc/loadavg: 2.18 2.10 2.00 3/178 4219
/proc/meminfo: memFree=29879192/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=439016 CPUtime=222.26 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 128932 0 0 0 22176 50 0 0 20 0 1 0 289028843 449552384 107334 33554432000 134512640 137138936 4291555040 4291553556 134551170 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 109754 107334 192 642 0 109110 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 439016

[startup+282.3 s]
/proc/loadavg: 2.18 2.11 2.01 3/177 4219
/proc/meminfo: memFree=29794756/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=523644 CPUtime=282.24 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 158374 0 0 0 28166 58 0 0 20 0 1 0 289028843 536211456 128484 33554432000 134512640 137138936 4291555040 4291553968 134542770 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 130911 128484 192 642 0 130267 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 523644

[startup+342.3 s]
/proc/loadavg: 2.14 2.11 2.01 3/177 4219
/proc/meminfo: memFree=29715728/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=601216 CPUtime=342.23 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 186466 0 0 0 34158 65 0 0 20 0 1 0 289028843 615645184 147886 33554432000 134512640 137138936 4291555040 4291553968 134542202 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 150304 147886 192 642 0 149660 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 601216

[startup+402.3 s]
/proc/loadavg: 2.09 2.10 2.01 3/177 4219
/proc/meminfo: memFree=29651016/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=666648 CPUtime=402.22 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 206498 0 0 0 40153 69 0 0 20 0 1 0 289028843 682647552 164219 33554432000 134512640 137138936 4291555040 4291553968 134542325 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 166662 164219 192 642 0 166018 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 666648

[startup+462.3 s]
/proc/loadavg: 2.11 2.11 2.01 3/177 4258
/proc/meminfo: memFree=30522780/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=737888 CPUtime=462.19 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 227985 0 0 0 46143 76 0 0 20 0 1 0 289028843 755597312 182062 33554432000 134512640 137138936 4291555040 4291553968 134542770 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 184472 182062 192 642 0 183828 0
Current children cumulated CPU time (s) 462.19
Current children cumulated vsize (KiB) 737888

[startup+522.3 s]
/proc/loadavg: 2.08 2.10 2.01 3/177 4258
/proc/meminfo: memFree=30347100/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=806976 CPUtime=522.15 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 250597 0 0 0 52132 83 0 0 20 0 1 0 289028843 826343424 199324 33554432000 134512640 137138936 4291555040 4291553568 134603105 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 201744 199324 192 642 0 201100 0
Current children cumulated CPU time (s) 522.15
Current children cumulated vsize (KiB) 806976

[startup+582.3 s]
/proc/loadavg: 2.06 2.09 2.01 3/177 4258
/proc/meminfo: memFree=30196344/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=888124 CPUtime=582.1 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 274257 0 0 0 58119 91 0 0 20 0 1 0 289028843 909438976 219605 33554432000 134512640 137138936 4291555040 4291553936 134542316 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 222031 219605 192 642 0 221387 0
Current children cumulated CPU time (s) 582.1
Current children cumulated vsize (KiB) 888124

[startup+642.3 s]

################
# More data... #
################

/proc/meminfo: memFree=29599588/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1061.82 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 106050 132 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553968 134542480 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1061.82
Current children cumulated vsize (KiB) 1037068

[startup+1122.3 s]
/proc/loadavg: 2.06 2.06 2.00 3/177 4264
/proc/meminfo: memFree=29565512/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1121.82 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 112044 138 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553936 134542316 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1121.82
Current children cumulated vsize (KiB) 1037068

[startup+1182.3 s]
/proc/loadavg: 2.06 2.06 2.00 3/177 4264
/proc/meminfo: memFree=29522200/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1181.8 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 118039 141 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553968 134542333 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1181.8
Current children cumulated vsize (KiB) 1037068

[startup+1242.3 s]
/proc/loadavg: 2.02 2.05 2.00 3/177 4264
/proc/meminfo: memFree=29471644/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1241.8 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 124037 143 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291554156 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1241.8
Current children cumulated vsize (KiB) 1037068

[startup+1302.3 s]
/proc/loadavg: 2.04 2.05 2.00 3/177 4264
/proc/meminfo: memFree=29435340/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1301.79 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 130024 155 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553584 134607594 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1301.79
Current children cumulated vsize (KiB) 1037068

[startup+1362.3 s]
/proc/loadavg: 2.05 2.05 2.00 3/177 4265
/proc/meminfo: memFree=29384100/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1361.77 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 136020 157 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553708 136504019 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1361.77
Current children cumulated vsize (KiB) 1037068

[startup+1422.3 s]
/proc/loadavg: 2.02 2.04 2.00 3/178 4268
/proc/meminfo: memFree=29326960/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1421.77 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 142017 160 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553936 134542480 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1421.77
Current children cumulated vsize (KiB) 1037068

[startup+1482.3 s]
/proc/loadavg: 2.09 2.06 2.01 3/177 4268
/proc/meminfo: memFree=29286696/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1481.75 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 148012 163 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291554156 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1481.75
Current children cumulated vsize (KiB) 1037068

[startup+1542.31 s]
/proc/loadavg: 2.03 2.05 2.00 3/177 4268
/proc/meminfo: memFree=29287468/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1541.75 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 154001 174 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553536 134618214 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1541.75
Current children cumulated vsize (KiB) 1037068

[startup+1602.3 s]
/proc/loadavg: 2.05 2.05 2.00 3/177 4268
/proc/meminfo: memFree=29287632/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1601.74 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 159978 196 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553968 134542752 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1601.74
Current children cumulated vsize (KiB) 1037068

[startup+1662.3 s]
/proc/loadavg: 2.02 2.04 2.00 3/177 4269
/proc/meminfo: memFree=29286924/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1661.73 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 165968 205 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553968 134542412 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1661.73
Current children cumulated vsize (KiB) 1037068

[startup+1722.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/177 4269
/proc/meminfo: memFree=29287656/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1721.71 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 171958 213 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553968 134542233 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1721.71
Current children cumulated vsize (KiB) 1037068

[startup+1782.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/176 4269
/proc/meminfo: memFree=29288496/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1781.71 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 177954 217 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553536 134618214 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1781.71
Current children cumulated vsize (KiB) 1037068

Solver just ended. Dumping a history of the last processes samples

[startup+1792.01 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 4270
/proc/meminfo: memFree=29287744/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1791.42 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 178925 217 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553268 136500388 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1791.42
Current children cumulated vsize (KiB) 1037068

[startup+1795.2 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 4270
/proc/meminfo: memFree=29287620/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1794.62 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 179245 217 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553968 134542307 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1794.62
Current children cumulated vsize (KiB) 1037068

[startup+1796.8 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 4270
/proc/meminfo: memFree=29287620/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1796.21 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 179404 217 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553968 134542295 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1796.21
Current children cumulated vsize (KiB) 1037068

[startup+1797.6 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 4270
/proc/meminfo: memFree=29287624/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1797.01 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 179484 217 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553576 136504029 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1797.01
Current children cumulated vsize (KiB) 1037068

[startup+1798.4 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 4270
/proc/meminfo: memFree=29287624/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1797.81 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 179564 217 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553968 134542295 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1797.81
Current children cumulated vsize (KiB) 1037068

[startup+1798.61 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 4270
/proc/meminfo: memFree=29287624/32873648 swapFree=7116/7116
[pid=4214] ppid=4212 vsize=1037068 CPUtime=1798.01 cores=0,2,4,6
/proc/4214/stat : 4214 (bsolo) R 4212 4214 4099 0 -1 4202496 316747 0 0 0 179584 217 0 0 20 0 1 0 289028843 1061957632 256848 33554432000 134512640 137138936 4291555040 4291553536 134618214 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4214/statm: 259267 256848 192 642 0 258623 0
Current children cumulated CPU time (s) 1798.01
Current children cumulated vsize (KiB) 1037068

Child status: 0
Real time (s): 1798.64
CPU time (s): 1798.06
CPU user time (s): 1795.88
CPU system time (s): 2.17767
CPU usage (%): 99.9676
Max. virtual memory (cumulated for all children) (KiB): 1037068

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1795.88
system time used= 2.17767
maximum resident set size= 1027704
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 316747
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 442
involuntary context switches= 1909

runsolver used 6.34204 second user time and 12.8191 second system time

The end

Launcher Data 

Begin job on node123 at 2012-05-28 20:17:14
IDJOB=3707706
IDBENCH=90128
IDSOLVER=2286
FILE ID=node123/3707706-1338229034
RUNJOBID= node123-1338227645-4115
PBS_JOBID= 14624628
Free space on /tmp= 71676 MiB

SOLVER NAME= bsolo 3.2
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/normalized-TateBritain_K89.opb
COMMAND LINE= bsolo -l2 -tTIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3707706-1338229034/watcher-3707706-1338229034 -o /tmp/evaluation-result-3707706-1338229034/solver-3707706-1338229034 -C 1800 -W 1900 -M 15500  bsolo -l2 -t1800 HOME/instance-3707706-1338229034.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 30c9df0e6d94fba856558f98ad1383d9
RANDOM SEED=2075476173

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30309232 kB
Buffers:          366300 kB
Cached:           295172 kB
SwapCached:          972 kB
Active:          1401500 kB
Inactive:         321000 kB
Active(anon):    1053052 kB
Inactive(anon):     8356 kB
Active(file):     348448 kB
Inactive(file):   312644 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67102960 kB
Dirty:              4296 kB
Writeback:             0 kB
AnonPages:       1102676 kB
Mapped:            10976 kB
Shmem:                 0 kB
Slab:             703304 kB
SReclaimable:     146928 kB
SUnreclaim:       556376 kB
KernelStack:        1472 kB
PageTables:         6152 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    1181928 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    882688 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71672 MiB
End job on node123 at 2012-05-28 20:47:12