Trace number 3741892

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.21 1800.71

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/
normalized-TateBritain_K91.opb
MD5SUM8c2203c9ba90488459f210b4f3d3e3ed
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6188
Total number of constraints6372
Number of constraints which are clauses6281
Number of constraints which are cardinality constraints (but not clauses)91
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint91
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 92
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3741892-1338764836.opb
0.00/0.00	c File size is 395845 bytes.
0.00/0.04	c Highest Coefficient sum: 92
0.00/0.04	c Parsing was ok!!
0.00/0.04	c Total parsing time: 0.033 s
0.00/0.04	c Var: 6188 Constr: 6372 6281/91/0 Lit: 39716 Watch. Lit: 18748
0.00/0.04	c Obj. Vars: 0 (0 % of total variables)
1.09/1.12	c Pre-processing Time: 1.121 s
1.09/1.12	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
1.09/1.12	c        0   5447     5687    36680    6    17149   89102      0      0 1.12
1.09/1.12	c Switching off LPR mode.
1800.10/1800.61	c      100   5447     5787    48475    8    17349   98013    100     86 1.15
1800.10/1800.61	c      254   5447     5941    63822   10    17657  107815    254    213 1.19
1800.10/1800.61	c      480   5447     6167    79212   12    18109  118597    480    379 1.26
1800.10/1800.61	c      818   5447     6505   125418   19    18785  130457    818    589 1.39
1800.10/1800.61	c     1326   5447     7013   233575   33    19801  143503   1326    845 1.57
1800.10/1800.61	c     2089   5447     7776   380673   48    21327  157854   2089   1129 1.85
1800.10/1800.61	c     3235   5447     8922   760591   85    23619  173640   3235   1313 2.46
1800.10/1800.61	c     4957   5447    10644  1380757  129    27063  191005   4957   1397 3.55
1800.10/1800.61	c     7542   5447    13229  2867923  216    32233  210106   7542   1262 5.97
1800.10/1800.61	c    11421   5447    17108  4944681  289    39991  231117  11421   1039 10.99
1800.10/1800.61	c    17243   5447    22930  8280721  361    51635  254229  17243    839 20.53
1800.10/1800.61	c    25982   5447    31669 17445345  550    69113  279652  25982    483 53.70
1800.10/1800.61	c    39092   5447    44779 35987630  803    95333  307618  39092    232 168.18
1800.10/1800.61	c    58764   5447    64451 63881790  991   134677  338380  58764    175 334.81
1800.10/1800.61	c    88275   5447    93962 88831512  945   193699  372219  88275    137 642.15
1800.10/1800.61	c   132546   5447   138233 127380930  921   282241  409441 132546    125 1053.27
1800.10/1800.61	c Caught signal: 15
1800.10/1800.61	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.10/1800.61	c   16   191976  94861  2005215   197663 176675633 191976    106 1800.11
1800.10/1800.61	s UNKNOWN
1800.10/1800.61	c Total time: 1800.11 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741892-1338764836/watcher-3741892-1338764836 -o /tmp/evaluation-result-3741892-1338764836/solver-3741892-1338764836 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3741892-1338764836.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.93 1.97 1.99 3/176 7776
/proc/meminfo: memFree=25963108/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=4476 CPUtime=0 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4194304 164 0 0 0 0 0 0 0 20 0 1 0 342609028 4583424 116 33554432000 134512640 135840783 4290081392 4290080312 6944065 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 1119 130 111 325 0 39 0

[startup+0.0186629 s]
/proc/loadavg: 1.93 1.97 1.99 3/176 7776
/proc/meminfo: memFree=25963108/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=5632 CPUtime=0 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 638 0 0 0 0 0 0 0 20 0 1 0 342609028 5767168 575 33554432000 134512640 135840783 4290081392 4290080208 7513383 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 1408 576 354 325 0 247 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 5632

[startup+0.100259 s]
/proc/loadavg: 1.93 1.97 1.99 3/176 7776
/proc/meminfo: memFree=25963108/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=6892 CPUtime=0.09 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 1124 0 0 0 9 0 0 0 20 0 1 0 342609028 7057408 964 33554432000 134512640 135840783 4290081392 4290006252 13595696 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 1723 964 342 325 0 659 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 6892

[startup+0.300223 s]
/proc/loadavg: 1.93 1.97 1.99 3/176 7776
/proc/meminfo: memFree=25963108/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=6892 CPUtime=0.29 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 1125 0 0 0 29 0 0 0 20 0 1 0 342609028 7057408 965 33554432000 134512640 135840783 4290081392 4290006252 13595696 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 1723 965 342 325 0 659 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 6892

[startup+0.700219 s]
/proc/loadavg: 1.93 1.97 1.99 3/176 7776
/proc/meminfo: memFree=25963108/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=6892 CPUtime=0.68 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 1125 0 0 0 68 0 0 0 20 0 1 0 342609028 7057408 965 33554432000 134512640 135840783 4290081392 4290006252 13595696 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 1723 965 342 325 0 659 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 6892

[startup+1.50023 s]
/proc/loadavg: 1.93 1.97 1.99 3/177 7777
/proc/meminfo: memFree=25958952/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=8860 CPUtime=1.49 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 1727 0 0 0 148 1 0 0 20 0 1 0 342609028 9072640 1468 33554432000 134512640 135840783 4290081392 4290076304 7513383 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 2215 1468 347 325 0 1151 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 8860

[startup+3.10026 s]
/proc/loadavg: 1.93 1.97 1.99 3/177 7777
/proc/meminfo: memFree=25950024/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=21992 CPUtime=3.08 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 5008 0 0 0 307 1 0 0 20 0 1 0 342609028 22519808 4749 33554432000 134512640 135840783 4290081392 4290080752 134551081 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 5498 4749 347 325 0 4434 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 21992

[startup+6.3003 s]
/proc/loadavg: 1.93 1.97 1.99 3/177 7777
/proc/meminfo: memFree=25918140/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=45500 CPUtime=6.29 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 10888 0 0 0 627 2 0 0 20 0 1 0 342609028 46592000 10629 33554432000 134512640 135840783 4290081392 4290080752 134551093 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 11375 10629 347 325 0 10311 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 45500

[startup+12.7003 s]
/proc/loadavg: 1.94 1.97 1.99 3/177 7777
/proc/meminfo: memFree=25868168/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=77660 CPUtime=12.68 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 18955 0 0 0 1265 3 0 0 20 0 1 0 342609028 79523840 18696 33554432000 134512640 135840783 4290081392 4290080752 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 19415 18696 347 325 0 18351 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 77660

[startup+25.5003 s]
/proc/loadavg: 1.95 1.97 1.99 3/177 7777
/proc/meminfo: memFree=25788916/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=134288 CPUtime=25.48 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 33113 0 0 0 2543 5 0 0 20 0 1 0 342609028 137510912 32854 33554432000 134512640 135840783 4290081392 4290080752 134551175 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 33572 32854 347 325 0 32508 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 134288

[startup+51.1003 s]
/proc/loadavg: 1.97 1.97 1.99 3/177 7778
/proc/meminfo: memFree=25648996/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=222188 CPUtime=51.08 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 55082 0 0 0 5097 11 0 0 20 0 1 0 342609028 227520512 54823 33554432000 134512640 135840783 4290081392 4290080752 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 55547 54823 347 325 0 54483 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 222188

[startup+102.307 s]
/proc/loadavg: 2.03 1.99 1.99 3/177 7778
/proc/meminfo: memFree=25478168/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=333492 CPUtime=102.28 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 82897 0 0 0 10210 18 0 0 20 0 1 0 342609028 341495808 82638 33554432000 134512640 135840783 4290081392 4290080752 134550948 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 83373 82638 347 325 0 82309 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 333492

[startup+162.3 s]
/proc/loadavg: 2.01 1.99 1.99 3/177 7778
/proc/meminfo: memFree=25286864/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=456620 CPUtime=162.26 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 113669 0 0 0 16200 26 0 0 20 0 1 0 342609028 467578880 113410 33554432000 134512640 135840783 4290081392 4290080752 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 114155 113410 347 325 0 113091 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 456620

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/178 7781
/proc/meminfo: memFree=25065544/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=588904 CPUtime=222.25 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 146754 0 0 0 22189 36 0 0 20 0 1 0 342609028 603037696 146495 33554432000 134512640 135840783 4290081392 4290080744 14592208 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 147226 146495 347 325 0 146162 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 588904

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 7781
/proc/meminfo: memFree=24843000/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=726752 CPUtime=282.25 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 181214 0 0 0 28180 45 0 0 20 0 1 0 342609028 744194048 180955 33554432000 134512640 135840783 4290081392 4290080752 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 181688 180955 347 325 0 180624 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 726752

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 7781
/proc/meminfo: memFree=24662732/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=833852 CPUtime=342.23 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 207995 0 0 0 34171 52 0 0 20 0 1 0 342609028 853864448 207736 33554432000 134512640 135840783 4290081392 4290080696 14592185 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 208463 207736 347 325 0 207399 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 833852

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 7782
/proc/meminfo: memFree=24503544/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=911356 CPUtime=402.22 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 227350 0 0 0 40165 57 0 0 20 0 1 0 342609028 933228544 227091 33554432000 134512640 135840783 4290081392 4290080752 134551093 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 227839 227091 347 325 0 226775 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 911356

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 1.99 3/177 7782
/proc/meminfo: memFree=24359360/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=972948 CPUtime=462.21 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 242773 0 0 0 46158 63 0 0 20 0 1 0 342609028 996298752 242514 33554432000 134512640 135840783 4290081392 4290080752 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 243237 242514 347 325 0 242173 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 972948

[startup+522.3 s]
/proc/loadavg: 2.05 2.00 2.00 3/177 7782
/proc/meminfo: memFree=24208480/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1037808 CPUtime=522.21 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 258965 0 0 0 52153 68 0 0 20 0 1 0 342609028 1062715392 258706 33554432000 134512640 135840783 4290081392 4290080752 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 259452 258706 347 325 0 258388 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 1037808

[startup+582.3 s]
/proc/loadavg: 2.06 2.01 2.00 3/177 7782
/proc/meminfo: memFree=24072976/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1089860 CPUtime=582.2 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 271980 0 0 0 58148 72 0 0 20 0 1 0 342609028 1116016640 271721 33554432000 134512640 135840783 4290081392 4290080752 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 272465 271721 347 325 0 271401 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 1089860

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 7787
/proc/meminfo: memFree=23552652/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1412088 CPUtime=822.16 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 352540 0 0 0 82121 95 0 0 20 0 1 0 342609028 1445978112 352281 33554432000 134512640 135840783 4290081392 4290080752 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 353022 352281 347 325 0 351958 0
Current children cumulated CPU time (s) 822.16
Current children cumulated vsize (KiB) 1412088

[startup+882.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7787
/proc/meminfo: memFree=23450636/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1473212 CPUtime=882.15 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 367815 0 0 0 88116 99 0 0 20 0 1 0 342609028 1508569088 367556 33554432000 134512640 135840783 4290081392 4290080752 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 368303 367556 347 325 0 367239 0
Current children cumulated CPU time (s) 882.15
Current children cumulated vsize (KiB) 1473212

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7787
/proc/meminfo: memFree=23374280/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1515972 CPUtime=942.14 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 378531 0 0 0 94112 102 0 0 20 0 1 0 342609028 1552355328 378272 33554432000 134512640 135840783 4290081392 4290080752 134551312 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 378993 378272 347 325 0 377929 0
Current children cumulated CPU time (s) 942.14
Current children cumulated vsize (KiB) 1515972

[startup+1002.3 s]
/proc/loadavg: 2.06 2.01 2.00 3/177 7788
/proc/meminfo: memFree=23260848/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1565180 CPUtime=1002.13 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 390826 0 0 0 100107 106 0 0 20 0 1 0 342609028 1602744320 390567 33554432000 134512640 135840783 4290081392 4290080704 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 391295 390567 347 325 0 390231 0
Current children cumulated CPU time (s) 1002.13
Current children cumulated vsize (KiB) 1565180

[startup+1062.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 7788
/proc/meminfo: memFree=23137496/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1644084 CPUtime=1062.12 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 410541 0 0 0 106101 111 0 0 20 0 1 0 342609028 1683542016 410282 33554432000 134512640 135840783 4290081392 4290080752 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 411021 410282 347 325 0 409957 0
Current children cumulated CPU time (s) 1062.12
Current children cumulated vsize (KiB) 1644084

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7788
/proc/meminfo: memFree=23045764/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1687252 CPUtime=1122.11 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 421340 0 0 0 112096 115 0 0 20 0 1 0 342609028 1727746048 421081 33554432000 134512640 135840783 4290081392 4290080752 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 421813 421081 347 325 0 420749 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 1687252

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7788
/proc/meminfo: memFree=22919932/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1752236 CPUtime=1182.1 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 437593 0 0 0 118090 120 0 0 20 0 1 0 342609028 1794289664 437334 33554432000 134512640 135840783 4290081392 4290080752 134550902 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 438059 437334 347 325 0 436995 0
Current children cumulated CPU time (s) 1182.1
Current children cumulated vsize (KiB) 1752236

[startup+1242.3 s]
/proc/loadavg: 1.96 1.98 1.99 3/177 7827
/proc/meminfo: memFree=25075332/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1822668 CPUtime=1242.07 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 455231 0 0 0 124082 125 0 0 20 0 1 0 342609028 1866412032 454949 33554432000 134512640 135840783 4290081392 4290080752 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 455667 454949 347 325 0 454603 0
Current children cumulated CPU time (s) 1242.07
Current children cumulated vsize (KiB) 1822668

[startup+1302.3 s]
/proc/loadavg: 1.98 1.98 1.99 3/177 7828
/proc/meminfo: memFree=24862204/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1886336 CPUtime=1302.05 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 471173 0 0 0 130075 130 0 0 20 0 1 0 342609028 1931608064 470851 33554432000 134512640 135840783 4290081392 4290080752 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 471584 470851 347 325 0 470520 0
Current children cumulated CPU time (s) 1302.05
Current children cumulated vsize (KiB) 1886336

[startup+1362.3 s]
/proc/loadavg: 1.99 1.98 1.99 3/177 7828
/proc/meminfo: memFree=24667180/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=1943864 CPUtime=1362.01 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 485582 0 0 0 136067 134 0 0 20 0 1 0 342609028 1990516736 485230 33554432000 134512640 135840783 4290081392 4290080752 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 485966 485230 347 325 0 484902 0
Current children cumulated CPU time (s) 1362.01
Current children cumulated vsize (KiB) 1943864

[startup+1422.31 s]
/proc/loadavg: 2.06 2.00 2.00 3/178 7831
/proc/meminfo: memFree=24488020/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=2012420 CPUtime=1421.99 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 502749 0 0 0 142060 139 0 0 20 0 1 0 342609028 2060718080 502372 33554432000 134512640 135840783 4290081392 4290080752 134550804 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 503105 502372 347 325 0 502041 0
Current children cumulated CPU time (s) 1421.99
Current children cumulated vsize (KiB) 2012420

[startup+1482.3 s]
/proc/loadavg: 2.02 2.00 2.00 3/177 7831
/proc/meminfo: memFree=24313092/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=2076296 CPUtime=1481.96 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 518747 0 0 0 148052 144 0 0 20 0 1 0 342609028 2126127104 518341 33554432000 134512640 135840783 4290081392 4290080752 134550887 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 519074 518341 347 325 0 518010 0
Current children cumulated CPU time (s) 1481.96
Current children cumulated vsize (KiB) 2076296

[startup+1542.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 7831
/proc/meminfo: memFree=24177960/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=2126404 CPUtime=1541.93 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 531304 0 0 0 154045 148 0 0 20 0 1 0 342609028 2177437696 530863 33554432000 134512640 135840783 4290081392 4290080672 7515718 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 531601 530863 347 325 0 530537 0
Current children cumulated CPU time (s) 1541.93
Current children cumulated vsize (KiB) 2126404

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7832
/proc/meminfo: memFree=24058824/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=2164456 CPUtime=1601.9 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 540863 0 0 0 160039 151 0 0 20 0 1 0 342609028 2216402944 540392 33554432000 134512640 135840783 4290081392 4290080752 134550893 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 541114 540392 347 325 0 540050 0
Current children cumulated CPU time (s) 1601.9
Current children cumulated vsize (KiB) 2164456

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7832
/proc/meminfo: memFree=23947252/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=2190392 CPUtime=1661.88 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 547360 0 0 0 166034 154 0 0 20 0 1 0 342609028 2242961408 546866 33554432000 134512640 135840783 4290081392 4290080752 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 547598 546866 347 325 0 546534 0
Current children cumulated CPU time (s) 1661.88
Current children cumulated vsize (KiB) 2190392

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7832
/proc/meminfo: memFree=23833448/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=2226468 CPUtime=1721.84 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 556425 0 0 0 172027 157 0 0 20 0 1 0 342609028 2279903232 555899 33554432000 134512640 135840783 4290081392 4290080752 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 556617 555899 347 325 0 555553 0
Current children cumulated CPU time (s) 1721.84
Current children cumulated vsize (KiB) 2226468

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7832
/proc/meminfo: memFree=23716916/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=2261624 CPUtime=1781.81 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 565246 0 0 0 178020 161 0 0 20 0 1 0 342609028 2315902976 564681 33554432000 134512640 135840783 4290081392 4290080672 7515744 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 565406 564681 347 325 0 564342 0
Current children cumulated CPU time (s) 1781.81
Current children cumulated vsize (KiB) 2261624



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 7832
/proc/meminfo: memFree=23688116/32873844 swapFree=7384/7384
[pid=7776] ppid=7774 vsize=2271440 CPUtime=1800.1 cores=1,3,5,7
/proc/7776/stat : 7776 (bsolo3.0.17) R 7774 7776 5940 0 -1 4202496 567714 0 0 0 179849 161 0 0 20 0 1 0 342609028 2325954560 567135 33554432000 134512640 135840783 4290081392 4290080752 134550878 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/7776/statm: 567860 567135 347 325 0 566796 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 2271440

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.71
CPU time (s): 1800.21
CPU user time (s): 1798.5
CPU system time (s): 1.71774
CPU usage (%): 99.9723
Max. virtual memory (cumulated for all children) (KiB): 2271440

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.5
system time used= 1.71774
maximum resident set size= 2268540
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 567717
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 353
involuntary context switches= 1839

runsolver used 4.01139 second user time and 9.83351 second system time

The end

Launcher Data 

Begin job on node136 at 2012-06-04 01:07:16
IDJOB=3741892
IDBENCH=90116
IDSOLVER=2318
FILE ID=node136/3741892-1338764836
RUNJOBID= node136-1338749655-5957
PBS_JOBID= 14636804
Free space on /tmp= 69812 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathTate/normalized-TateBritain_K91.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741892-1338764836/watcher-3741892-1338764836 -o /tmp/evaluation-result-3741892-1338764836/solver-3741892-1338764836 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3741892-1338764836.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8c2203c9ba90488459f210b4f3d3e3ed
RANDOM SEED=301475690

node136.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.94
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.247
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        25963752 kB
Buffers:         1274280 kB
Cached:          3610224 kB
SwapCached:        20316 kB
Active:          3823004 kB
Inactive:        2182528 kB
Active(anon):    1093396 kB
Inactive(anon):    22308 kB
Active(file):    2729608 kB
Inactive(file):  2160220 kB
Unevictable:        7384 kB
Mlocked:            7384 kB
SwapTotal:      67108856 kB
SwapFree:       67083208 kB
Dirty:              6784 kB
Writeback:             0 kB
AnonPages:       1101140 kB
Mapped:            10992 kB
Shmem:                 0 kB
Slab:             763136 kB
SReclaimable:     204584 kB
SUnreclaim:       558552 kB
KernelStack:        1456 kB
PageTables:         5804 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1216168 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:     53248 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 69804 MiB
End job on node136 at 2012-06-04 01:37:18