Trace number 3707678

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
bsolo 3.2? 1798.01 1798.59

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K176.opb
MD5SUM3f678424628fecb2a53891618f9bde8f
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables20944
Total number of constraints21298
Number of constraints which are clauses21122
Number of constraints which are cardinality constraints (but not clauses)176
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint176
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 177
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.2 - 23/05/2010 : 1630 GMT
0.00/0.00	c Developed by Vasco Manquinho and José Santos IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Learning Strategy: Cardinality Constraint Learning
0.00/0.00	c Time Limit set to 1800
0.00/0.00	c Instance file HOME/instance-3707678-1338232631.opb
0.00/0.00	c File size is 1446426 bytes.
0.09/0.11	c Highest Coefficient sum: 177
0.09/0.11	c Parsing was ok!!
0.09/0.11	c Total parsing time: 0.111 s
0.09/0.12	c Var: 20944 Constr: 21298 21122/176/0 Lit: 137034 Watch. Lit: 63186
0.09/0.12	c Obj. Vars: 0 (0 % of total variables)
10.09/10.12	c Pre-processing Time: 10.117 s
10.09/10.12	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
10.09/10.12	c        0  19389    19849   130508    6    59868  178990      0      0 10.12
10.09/10.12	c Switching off lower bounding mode.
1797.91/1798.58	c      101  19389    19962   144406    7    60929  196890    113      9 10.23
1797.91/1798.58	c      251  19389    20143   173494    8    62388  216580    294     23 10.47
1797.91/1798.58	c      477  19389    20440   196404    9    65069  238239    591     43 10.91
1797.91/1798.58	c      815  19389    20857   260295   12    67963  262063   1008     71 11.36
1797.91/1798.58	c     1323  19389    21497   371104   17    72514  288270   1648    108 12.21
1797.91/1798.58	c     2086  19389    22406   515391   23    77256  317098   2557    155 13.45
1797.91/1798.58	c     3232  19389    23751   702641   29    83744  348808   3902    212 15.24
1797.91/1798.58	c     4953  19389    25830  1019413   39    95991  383689   5981    264 18.73
1797.91/1798.58	c     7537  19389    28813  1613262   55   110695  422058   8964    313 24.01
1797.91/1798.58	c    11416  19389    33355  2529025   75   131692  464264  13506    311 36.65
1797.91/1798.58	c    17238  19389    40124  4743798  118   159712  510691  20275    318 54.18
1797.91/1798.58	c    25975  19389    50317  7654368  152   207360  561761  30468    301 86.20
1797.91/1798.58	c    39085  19389    65550 12299908  187   277331  617938  45701    271 143.98
1797.91/1798.58	c    58755  19389    88150 19592071  222   375029  679732  68301    231 253.86
1797.91/1798.58	c    88265  19389   122004 30378274  248   519016  747706 102155    188 467.87
1797.91/1798.58	c   132535  19389   174034 53490054  307   730188  822477 154185    153 863.95
1797.91/1798.58	c Reducing formula size due to memory constraints
1797.91/1798.58	c Memory Limit: 1000.00 MB  Used: 1001.24 MB
1797.91/1798.58	c   198945  19389    65695 16368046  249   225240   58474  45846    124 1597.89
1797.91/1798.58	c Resources Exceeded
1797.91/1798.58	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1797.91/1798.58	c   17   230686 153749 16792453    64027 16718340  44178    128 1798.00
1797.91/1798.58	s UNKNOWN
1797.91/1798.58	c Total time: 1798 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3707678-1338232631/watcher-3707678-1338232631 -o /tmp/evaluation-result-3707678-1338232631/solver-3707678-1338232631 -C 1800 -W 1900 -M 15500 bsolo -l2 -t1800 HOME/instance-3707678-1338232631.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 4459
/proc/meminfo: memFree=31156720/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=20432 CPUtime=0 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 381 0 0 0 0 0 0 0 20 0 1 0 289388605 20922368 334 33554432000 134512640 137138936 4290757632 4290755984 136577166 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 5108 334 179 642 0 4110 0

[startup+0.0158069 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 4459
/proc/meminfo: memFree=31156720/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=13488 CPUtime=0.01 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 650 0 0 0 1 0 0 0 20 0 1 0 289388605 13811712 603 33554432000 134512640 137138936 4290757632 4290755984 136577166 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 3372 604 210 642 0 2374 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 13488

[startup+0.100141 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 4459
/proc/meminfo: memFree=31156720/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=16500 CPUtime=0.09 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 1700 0 0 0 9 0 0 0 20 0 1 0 289388605 16896000 1613 33554432000 134512640 137138936 4290757632 4290754488 136506715 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 4125 1613 480 642 0 3127 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 16500

[startup+0.300141 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 4459
/proc/meminfo: memFree=31156720/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=18928 CPUtime=0.29 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 2635 0 0 0 29 0 0 0 20 0 1 0 289388605 19382272 2194 33554432000 134512640 137138936 4290757632 4290504816 134543071 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 4732 2194 184 642 0 4088 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 18928

[startup+0.700113 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 4459
/proc/meminfo: memFree=31156720/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=18928 CPUtime=0.69 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 2636 0 0 0 69 0 0 0 20 0 1 0 289388605 19382272 2195 33554432000 134512640 137138936 4290757632 4290504740 136511143 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 4732 2195 184 642 0 4088 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 18928

[startup+1.50011 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4460
/proc/meminfo: memFree=31146524/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=18928 CPUtime=1.49 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 2637 0 0 0 149 0 0 0 20 0 1 0 289388605 19382272 2196 33554432000 134512640 137138936 4290757632 4290504600 136504449 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 4732 2196 184 642 0 4088 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 18928

[startup+3.10019 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4460
/proc/meminfo: memFree=31145136/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=18928 CPUtime=3.09 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 2638 0 0 0 309 0 0 0 20 0 1 0 289388605 19382272 2197 33554432000 134512640 137138936 4290757632 4290504804 136297620 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 4732 2197 184 642 0 4088 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 18928

[startup+6.30019 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4460
/proc/meminfo: memFree=31143552/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=18928 CPUtime=6.29 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 2639 0 0 0 629 0 0 0 20 0 1 0 289388605 19382272 2198 33554432000 134512640 137138936 4290757632 4290505004 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 4732 2198 184 642 0 4088 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 18928

[startup+12.7002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4460
/proc/meminfo: memFree=31136136/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=23344 CPUtime=12.69 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 3984 0 0 0 1260 9 0 0 20 0 1 0 289388605 23904256 3338 33554432000 134512640 137138936 4290757632 4290755912 136506715 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 5836 3338 192 642 0 5192 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 23344

[startup+25.5002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4460
/proc/meminfo: memFree=31103144/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=42396 CPUtime=25.49 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 8738 0 0 0 2514 35 0 0 20 0 1 0 289388605 43413504 8092 33554432000 134512640 137138936 4290757632 4290756384 134578481 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 10599 8092 192 642 0 9955 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 42396

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4460
/proc/meminfo: memFree=31049092/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=74952 CPUtime=51.08 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 16877 0 0 0 5043 65 0 0 20 0 1 0 289388605 76750848 16231 33554432000 134512640 137138936 4290757632 4290756748 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 18738 16231 192 642 0 18094 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 74952

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4460
/proc/meminfo: memFree=30943148/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=135824 CPUtime=102.28 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 32095 0 0 0 10116 112 0 0 20 0 1 0 289388605 139083776 31449 33554432000 134512640 137138936 4290757632 4290756160 134610714 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 33956 31449 192 642 0 33312 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 135824

[startup+162.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 4460
/proc/meminfo: memFree=30851432/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=195216 CPUtime=162.26 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 46952 0 0 0 16070 156 0 0 20 0 1 0 289388605 199901184 46306 33554432000 134512640 137138936 4290757632 4290756056 134606666 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 48804 46306 192 642 0 48160 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 195216

[startup+222.3 s]
/proc/loadavg: 2.04 2.02 2.00 3/178 4464
/proc/meminfo: memFree=30754572/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=249136 CPUtime=222.24 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 60454 0 0 0 22037 187 0 0 20 0 1 0 289388605 255115264 59800 33554432000 134512640 137138936 4290757632 4290756056 134606663 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 62284 59800 192 642 0 61640 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 249136

[startup+282.3 s]
/proc/loadavg: 2.05 2.03 2.00 3/177 4464
/proc/meminfo: memFree=30671548/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=296712 CPUtime=282.21 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 72387 0 0 0 28002 219 0 0 20 0 1 0 289388605 303833088 71692 33554432000 134512640 137138936 4290757632 4290756560 134542199 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 74178 71692 192 642 0 73534 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 296712

[startup+342.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 4464
/proc/meminfo: memFree=30578080/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=353216 CPUtime=342.16 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 86540 0 0 0 33966 250 0 0 20 0 1 0 289388605 361693184 85798 33554432000 134512640 137138936 4290757632 4290756528 134542770 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 88304 85798 192 642 0 87660 0
Current children cumulated CPU time (s) 342.16
Current children cumulated vsize (KiB) 353216

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 4464
/proc/meminfo: memFree=30508916/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=383452 CPUtime=402.12 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 94144 0 0 0 39933 279 0 0 20 0 1 0 289388605 392654848 93358 33554432000 134512640 137138936 4290757632 4290756560 134542770 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 95863 93358 192 642 0 95219 0
Current children cumulated CPU time (s) 402.12
Current children cumulated vsize (KiB) 383452

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 4464
/proc/meminfo: memFree=30424820/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=419412 CPUtime=462.08 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 103177 0 0 0 45905 303 0 0 20 0 1 0 289388605 429477888 102347 33554432000 134512640 137138936 4290757632 4290756560 134542525 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 104853 102347 192 642 0 104209 0
Current children cumulated CPU time (s) 462.08
Current children cumulated vsize (KiB) 419412

[startup+522.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 4465
/proc/meminfo: memFree=30348312/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=447112 CPUtime=522.07 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 110102 0 0 0 51883 324 0 0 20 0 1 0 289388605 457842688 109272 33554432000 134512640 137138936 4290757632 4290756748 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 111778 109272 192 642 0 111134 0
Current children cumulated CPU time (s) 522.07
Current children cumulated vsize (KiB) 447112

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4465
/proc/meminfo: memFree=30232868/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=500420 CPUtime=582.06 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 123429 0 0 0 57862 344 0 0 20 0 1 0 289388605 512430080 122599 33554432000 134512640 137138936 4290757632 4290756168 136504225 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 125105 122599 192 642 0 124461 0
Current children cumulated CPU time (s) 582.06
Current children cumulated vsize (KiB) 500420

[startup+642.3 s]

################
# More data... #
################

/proc/meminfo: memFree=29656884/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=821212 CPUtime=1061.98 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 203668 0 0 0 105727 471 0 0 20 0 1 0 289388605 840921088 202838 33554432000 134512640 137138936 4290757632 4290749824 134573839 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 205303 202838 192 642 0 204659 0
Current children cumulated CPU time (s) 1061.98
Current children cumulated vsize (KiB) 821212

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4471
/proc/meminfo: memFree=29608276/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=848524 CPUtime=1121.98 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 210479 0 0 0 111711 487 0 0 20 0 1 0 289388605 868888576 209649 33554432000 134512640 137138936 4290757632 4290756384 134578144 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 212131 209649 192 642 0 211487 0
Current children cumulated CPU time (s) 1121.98
Current children cumulated vsize (KiB) 848524

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4471
/proc/meminfo: memFree=29560164/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=868796 CPUtime=1181.97 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 215534 0 0 0 117698 499 0 0 20 0 1 0 289388605 889647104 214704 33554432000 134512640 137138936 4290757632 4290756560 134542516 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 217199 214704 192 642 0 216555 0
Current children cumulated CPU time (s) 1181.97
Current children cumulated vsize (KiB) 868796

[startup+1242.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 4471
/proc/meminfo: memFree=29487128/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=900484 CPUtime=1241.96 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 223456 0 0 0 123683 513 0 0 20 0 1 0 289388605 922095616 222626 33554432000 134512640 137138936 4290757632 4290756560 134542357 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 225121 222626 192 642 0 224477 0
Current children cumulated CPU time (s) 1241.96
Current children cumulated vsize (KiB) 900484

[startup+1302.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 4471
/proc/meminfo: memFree=29425572/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=927004 CPUtime=1301.94 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 230109 0 0 0 129667 527 0 0 20 0 1 0 289388605 949252096 229256 33554432000 134512640 137138936 4290757632 4290756528 134542770 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 231751 229256 192 642 0 231107 0
Current children cumulated CPU time (s) 1301.94
Current children cumulated vsize (KiB) 927004

[startup+1362.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 4471
/proc/meminfo: memFree=29370300/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=964292 CPUtime=1361.9 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 239469 0 0 0 135652 538 0 0 20 0 1 0 289388605 987435008 238578 33554432000 134512640 137138936 4290757632 4290756560 134542325 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 241073 238578 192 642 0 240429 0
Current children cumulated CPU time (s) 1361.9
Current children cumulated vsize (KiB) 964292

[startup+1422.31 s]
/proc/loadavg: 2.07 2.02 2.00 3/178 4475
/proc/meminfo: memFree=29333004/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=995544 CPUtime=1421.88 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 247320 0 0 0 141638 550 0 0 20 0 1 0 289388605 1019437056 246391 33554432000 134512640 137138936 4290757632 4290756056 134606964 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 248886 246391 192 642 0 248242 0
Current children cumulated CPU time (s) 1421.88
Current children cumulated vsize (KiB) 995544

[startup+1482.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 4475
/proc/meminfo: memFree=29304644/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1023776 CPUtime=1481.83 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 254434 0 0 0 147622 561 0 0 20 0 1 0 289388605 1048346624 253465 33554432000 134512640 137138936 4290757632 4290756056 134607134 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 255944 253465 192 642 0 255300 0
Current children cumulated CPU time (s) 1481.83
Current children cumulated vsize (KiB) 1023776

[startup+1542.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 4475
/proc/meminfo: memFree=29288552/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1541.8 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258514 0 0 0 153599 581 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290756560 134542199 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1541.8
Current children cumulated vsize (KiB) 1039144

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4475
/proc/meminfo: memFree=29288348/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1601.76 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258548 0 0 0 159576 600 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290756560 134542480 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1601.76
Current children cumulated vsize (KiB) 1039144

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4513
/proc/meminfo: memFree=30256556/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1661.73 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258582 0 0 0 165542 631 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290756528 134542316 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1661.73
Current children cumulated vsize (KiB) 1039144

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4514
/proc/meminfo: memFree=30191004/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1721.72 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258582 0 0 0 171517 655 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290756560 134542525 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1721.72
Current children cumulated vsize (KiB) 1039144

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4514
/proc/meminfo: memFree=30127472/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1781.71 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258582 0 0 0 177495 676 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290756748 136570369 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1781.71
Current children cumulated vsize (KiB) 1039144

Solver just ended. Dumping a history of the last processes samples

[startup+1791.91 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4514
/proc/meminfo: memFree=30122772/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1791.31 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258582 0 0 0 178450 681 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290756560 134542187 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1791.31
Current children cumulated vsize (KiB) 1039144

[startup+1795.1 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4514
/proc/meminfo: memFree=30119920/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1794.51 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258582 0 0 0 178769 682 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290742552 134601114 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1794.51
Current children cumulated vsize (KiB) 1039144

[startup+1796.7 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4514
/proc/meminfo: memFree=30118804/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1796.11 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258582 0 0 0 178928 683 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290756560 134542187 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1796.11
Current children cumulated vsize (KiB) 1039144

[startup+1797.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4514
/proc/meminfo: memFree=30117936/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1796.91 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258582 0 0 0 179008 683 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290756736 134543405 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1796.91
Current children cumulated vsize (KiB) 1039144

[startup+1798.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4514
/proc/meminfo: memFree=30117936/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1797.7 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258582 0 0 0 179087 683 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290756560 134542480 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1797.7
Current children cumulated vsize (KiB) 1039144

[startup+1798.51 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4514
/proc/meminfo: memFree=30115828/32873648 swapFree=7116/7116
[pid=4459] ppid=4457 vsize=1039144 CPUtime=1797.91 cores=0,2,4,6
/proc/4459/stat : 4459 (bsolo) R 4457 4459 4099 0 -1 4202496 258582 0 0 0 179108 683 0 0 20 0 1 0 289388605 1064083456 257297 33554432000 134512640 137138936 4290757632 4290756528 134542316 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/4459/statm: 259786 257297 192 642 0 259142 0
Current children cumulated CPU time (s) 1797.91
Current children cumulated vsize (KiB) 1039144

Child status: 0
Real time (s): 1798.59
CPU time (s): 1798.01
CPU user time (s): 1791.16
CPU system time (s): 6.84196
CPU usage (%): 99.9676
Max. virtual memory (cumulated for all children) (KiB): 1039984

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1791.16
system time used= 6.84196
maximum resident set size= 1030028
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 258582
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 433
involuntary context switches= 1883

runsolver used 2.6056 second user time and 7.28589 second system time

The end

Launcher Data 

Begin job on node123 at 2012-05-28 21:17:11
IDJOB=3707678
IDBENCH=90147
IDSOLVER=2286
FILE ID=node123/3707678-1338232631
RUNJOBID= node123-1338227645-4115
PBS_JOBID= 14624628
Free space on /tmp= 71676 MiB

SOLVER NAME= bsolo 3.2
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K176.opb
COMMAND LINE= bsolo -l2 -tTIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3707678-1338232631/watcher-3707678-1338232631 -o /tmp/evaluation-result-3707678-1338232631/solver-3707678-1338232631 -C 1800 -W 1900 -M 15500  bsolo -l2 -t1800 HOME/instance-3707678-1338232631.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3f678424628fecb2a53891618f9bde8f
RANDOM SEED=612531159

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31157696 kB
Buffers:          367600 kB
Cached:           298144 kB
SwapCached:          972 kB
Active:           554444 kB
Inactive:         322696 kB
Active(anon):     203276 kB
Inactive(anon):     8356 kB
Active(file):     351168 kB
Inactive(file):   314340 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67102960 kB
Dirty:              5456 kB
Writeback:             0 kB
AnonPages:        264368 kB
Mapped:            11024 kB
Shmem:                 0 kB
Slab:             702824 kB
SReclaimable:     146920 kB
SUnreclaim:       555904 kB
KernelStack:        1472 kB
PageTables:         4112 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     333736 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     55296 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71672 MiB
End job on node123 at 2012-05-28 21:47:10