Trace number 3742399

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.19 1800.71

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K156.opb
MD5SUMb01d5fef61cfdf78caaec08ee0d21bae
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables18564
Total number of constraints18878
Number of constraints which are clauses18722
Number of constraints which are cardinality constraints (but not clauses)156
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint156
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 157
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3742399-1338770390.opb
0.00/0.00	c File size is 1273911 bytes.
0.09/0.11	c Highest Coefficient sum: 157
0.09/0.11	c Parsing was ok!!
0.09/0.11	c Total parsing time: 0.109 s
0.09/0.12	c Var: 18564 Constr: 18878 18722/156/0 Lit: 121414 Watch. Lit: 56006
0.09/0.12	c Obj. Vars: 0 (0 % of total variables)
7.78/7.89	c Pre-processing Time: 7.883 s
7.78/7.89	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
7.78/7.89	c        0  17029    17449   115028    6    52728  158197      0      0 7.88
7.78/7.89	c Switching off LPR mode.
1800.08/1800.61	c      100  17029    17549   121901    6    52928  174017    100     12 7.92
1800.08/1800.61	c      250  17029    17699   139746    7    53228  191419    250     30 8.11
1800.08/1800.61	c      475  17029    17924   156665    8    53678  210561    475     56 8.39
1800.08/1800.61	c      813  17029    18262   189030   10    54354  231618    813     93 8.69
1800.08/1800.61	c     1321  17029    18770   238280   12    55370  254780   1321    143 9.19
1800.08/1800.61	c     2084  17029    19533   333043   17    56896  280259   2084    211 9.86
1800.08/1800.61	c     3231  17029    20680   579892   28    59190  308285   3231    302 10.67
1800.08/1800.61	c     4952  17029    22401   847731   37    62632  339114   4952    395 12.51
1800.08/1800.61	c     7537  17029    24986  1255442   50    67802  373026   7537    490 15.37
1800.08/1800.61	c    11416  17029    28865  1757528   60    75560  410329  11416    575 19.85
1800.08/1800.61	c    17238  17029    34687  2722178   78    87204  451362  17238    610 28.25
1800.08/1800.61	c    25975  17029    43424  4100601   94   104678  496499  25975    579 44.86
1800.08/1800.61	c    39085  17029    56534  7157871  126   130898  546149  39085    540 72.30
1800.08/1800.61	c    58755  17029    76204 14645141  192   170238  600764  58755    450 130.38
1800.08/1800.61	c    88266  17029   105715 25442654  240   229260  660841  88266    368 239.37
1800.08/1800.61	c   132536  17029   149985 58578642  390   317800  726926 132536    276 479.10
1800.08/1800.61	c   198947  17029   216396 112945082  521   450622  799619 198947    205 967.10
1800.08/1800.61	c Caught signal: 15
1800.08/1800.61	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.08/1800.61	c   17   280896 172188 11291543   298345 190137666 280896    156 1800.09
1800.08/1800.61	s UNKNOWN
1800.08/1800.61	c Total time: 1800.09 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742399-1338770390/watcher-3742399-1338770390 -o /tmp/evaluation-result-3742399-1338770390/solver-3742399-1338770390 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3742399-1338770390.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14298
/proc/meminfo: memFree=26578336/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=4476 CPUtime=0 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 343163385 4583424 155 33554432000 134512640 135840783 4286812640 4286811980 10769752 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 1119 155 134 325 0 39 0

[startup+0.0891291 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14298
/proc/meminfo: memFree=26578336/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=9400 CPUtime=0.08 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 1587 0 0 0 8 0 0 0 20 0 1 0 343163385 9625600 1523 33554432000 134512640 135840783 4286812640 4286809936 11330855 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 2350 1523 563 325 0 974 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 9400

[startup+0.10028 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14298
/proc/meminfo: memFree=26578336/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=9656 CPUtime=0.09 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 1660 0 0 0 9 0 0 0 20 0 1 0 343163385 9887744 1596 33554432000 134512640 135840783 4286812640 4286811632 134525046 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 2414 1596 593 325 0 1038 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9656

[startup+0.300247 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14298
/proc/meminfo: memFree=26578336/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=11628 CPUtime=0.29 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 2477 0 0 0 29 0 0 0 20 0 1 0 343163385 11907072 2101 33554432000 134512640 135840783 4286812640 4286588988 6038576 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 2907 2101 342 325 0 1843 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 11628

[startup+0.700227 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14298
/proc/meminfo: memFree=26578336/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=11628 CPUtime=0.68 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 2478 0 0 0 68 0 0 0 20 0 1 0 343163385 11907072 2102 33554432000 134512640 135840783 4286812640 4286588988 6038576 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 2907 2102 342 325 0 1843 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 11628

[startup+1.50023 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14299
/proc/meminfo: memFree=26570640/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=11628 CPUtime=1.48 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 2479 0 0 0 148 0 0 0 20 0 1 0 343163385 11907072 2103 33554432000 134512640 135840783 4286812640 4286588988 6038576 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 2907 2103 342 325 0 1843 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 11628

[startup+3.10023 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14299
/proc/meminfo: memFree=26569896/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=11628 CPUtime=3.08 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 2480 0 0 0 308 0 0 0 20 0 1 0 343163385 11907072 2104 33554432000 134512640 135840783 4286812640 4286588988 6038576 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 2907 2104 342 325 0 1843 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 11628

[startup+6.30023 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14299
/proc/meminfo: memFree=26563448/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=11628 CPUtime=6.29 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 2482 0 0 0 628 1 0 0 20 0 1 0 343163385 11907072 2106 33554432000 134512640 135840783 4286812640 4286588988 6038576 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 2907 2106 342 325 0 1843 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 11628

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14302
/proc/meminfo: memFree=26552444/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=21716 CPUtime=12.68 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 5212 0 0 0 1266 2 0 0 20 0 1 0 343163385 22237184 4653 33554432000 134512640 135840783 4286812640 4286808112 134574669 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 5429 4653 347 325 0 4365 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 21716

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14302
/proc/meminfo: memFree=26516972/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=42904 CPUtime=25.48 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 10521 0 0 0 2545 3 0 0 20 0 1 0 343163385 43933696 9962 33554432000 134512640 135840783 4286812640 4286812000 134551368 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 10726 9962 347 325 0 9662 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 42904

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14302
/proc/meminfo: memFree=26460900/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=74304 CPUtime=51.08 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 18373 0 0 0 5103 5 0 0 20 0 1 0 343163385 76087296 17814 33554432000 134512640 135840783 4286812640 4286812000 134551755 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 18576 17814 347 325 0 17512 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 74304

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14302
/proc/meminfo: memFree=26331372/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=152952 CPUtime=102.28 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 38040 0 0 0 10217 11 0 0 20 0 1 0 343163385 156622848 37481 33554432000 134512640 135840783 4286812640 4286811952 134550902 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 38238 37481 347 325 0 37174 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 152952

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14302
/proc/meminfo: memFree=26162636/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=243844 CPUtime=162.26 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 60759 0 0 0 16210 16 0 0 20 0 1 0 343163385 249696256 60200 33554432000 134512640 135840783 4286812640 4286812000 134551063 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 60961 60200 347 325 0 59897 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 243844

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14303
/proc/meminfo: memFree=26026140/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=320824 CPUtime=222.26 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 80012 0 0 0 22206 20 0 0 20 0 1 0 343163385 328523776 79453 33554432000 134512640 135840783 4286812640 4286812000 134551312 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 80206 79453 347 325 0 79142 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 320824

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14303
/proc/meminfo: memFree=25848476/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=429388 CPUtime=282.24 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 107141 0 0 0 28199 25 0 0 20 0 1 0 343163385 439693312 106582 33554432000 134512640 135840783 4286812640 4286796864 134586540 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 107347 106582 347 325 0 106283 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 429388

[startup+342.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 14303
/proc/meminfo: memFree=25613152/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=613604 CPUtime=342.23 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 153187 0 0 0 34190 33 0 0 20 0 1 0 343163385 628330496 152628 33554432000 134512640 135840783 4286812640 4286812000 134551330 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 153401 152628 347 325 0 152337 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 613604

[startup+402.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 14303
/proc/meminfo: memFree=25478640/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=669736 CPUtime=402.22 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 167240 0 0 0 40185 37 0 0 20 0 1 0 343163385 685809664 166681 33554432000 134512640 135840783 4286812640 4286811952 134551093 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 167434 166681 347 325 0 166370 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 669736

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 14303
/proc/meminfo: memFree=25329008/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=746416 CPUtime=462.21 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 186388 0 0 0 46179 42 0 0 20 0 1 0 343163385 764329984 185829 33554432000 134512640 135840783 4286812640 4286812000 134551324 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 186604 185829 347 325 0 185540 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 746416

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14305
/proc/meminfo: memFree=25159644/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=826612 CPUtime=522.21 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 206468 0 0 0 52173 48 0 0 20 0 1 0 343163385 846450688 205909 33554432000 134512640 135840783 4286812640 4286812000 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 206653 205909 347 325 0 205589 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 826612

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14305
/proc/meminfo: memFree=24979872/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=939236 CPUtime=582.2 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 234602 0 0 0 58166 54 0 0 20 0 1 0 343163385 961777664 234043 33554432000 134512640 135840783 4286812640 4286811776 11328414 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 234809 234043 347 325 0 233745 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 939236

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 14309
/proc/meminfo: memFree=24460176/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1278140 CPUtime=822.16 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 319333 0 0 0 82142 74 0 0 20 0 1 0 343163385 1308815360 318774 33554432000 134512640 135840783 4286812640 4286812000 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 319535 318774 347 325 0 318471 0
Current children cumulated CPU time (s) 822.16
Current children cumulated vsize (KiB) 1278140

[startup+882.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 14309
/proc/meminfo: memFree=24318720/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1362824 CPUtime=882.15 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 340512 0 0 0 88138 77 0 0 20 0 1 0 343163385 1395531776 339953 33554432000 134512640 135840783 4286812640 4286812000 134551081 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 340706 339953 347 325 0 339642 0
Current children cumulated CPU time (s) 882.15
Current children cumulated vsize (KiB) 1362824

[startup+942.3 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 14309
/proc/meminfo: memFree=24198592/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1444912 CPUtime=942.14 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 361030 0 0 0 94132 82 0 0 20 0 1 0 343163385 1479589888 360471 33554432000 134512640 135840783 4286812640 4286812000 134551084 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 361228 360471 347 325 0 360164 0
Current children cumulated CPU time (s) 942.14
Current children cumulated vsize (KiB) 1444912

[startup+1002.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 14309
/proc/meminfo: memFree=24113928/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1487976 CPUtime=1002.14 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 371797 0 0 0 100129 85 0 0 20 0 1 0 343163385 1523687424 371238 33554432000 134512640 135840783 4286812640 4286811996 14438352 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 371994 371238 347 325 0 370930 0
Current children cumulated CPU time (s) 1002.14
Current children cumulated vsize (KiB) 1487976

[startup+1062.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 14309
/proc/meminfo: memFree=24018600/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1545716 CPUtime=1062.13 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 386245 0 0 0 106124 89 0 0 20 0 1 0 343163385 1582813184 385686 33554432000 134512640 135840783 4286812640 4286812000 134550872 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 386429 385686 347 325 0 385365 0
Current children cumulated CPU time (s) 1062.13
Current children cumulated vsize (KiB) 1545716

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14349
/proc/meminfo: memFree=25801416/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1584552 CPUtime=1122.11 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 395939 0 0 0 112119 92 0 0 20 0 1 0 343163385 1622581248 395380 33554432000 134512640 135840783 4286812640 4286812000 134551058 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 396138 395380 347 325 0 395074 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 1584552

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 14349
/proc/meminfo: memFree=25662580/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1645864 CPUtime=1182.05 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 411320 0 0 0 118109 96 0 0 20 0 1 0 343163385 1685364736 410715 33554432000 134512640 135840783 4286812640 4286812000 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 411466 410715 347 325 0 410402 0
Current children cumulated CPU time (s) 1182.05
Current children cumulated vsize (KiB) 1645864

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14352
/proc/meminfo: memFree=25472756/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1716340 CPUtime=1242.01 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 428980 0 0 0 124099 102 0 0 20 0 1 0 343163385 1757532160 428340 33554432000 134512640 135840783 4286812640 4286812000 134551058 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 429085 428340 347 325 0 428021 0
Current children cumulated CPU time (s) 1242.01
Current children cumulated vsize (KiB) 1716340

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 14374
/proc/meminfo: memFree=25334268/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1790200 CPUtime=1301.97 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 447465 0 0 0 130090 107 0 0 20 0 1 0 343163385 1833164800 446784 33554432000 134512640 135840783 4286812640 4286812000 134551063 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 447550 446784 347 325 0 446486 0
Current children cumulated CPU time (s) 1301.97
Current children cumulated vsize (KiB) 1790200

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14374
/proc/meminfo: memFree=25232376/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1856188 CPUtime=1361.92 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 463993 0 0 0 136081 111 0 0 20 0 1 0 343163385 1900736512 463282 33554432000 134512640 135840783 4286812640 4286806784 134551058 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 464047 463282 347 325 0 462983 0
Current children cumulated CPU time (s) 1361.92
Current children cumulated vsize (KiB) 1856188

[startup+1422.31 s]
/proc/loadavg: 2.05 2.01 2.00 3/178 14375
/proc/meminfo: memFree=25104436/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=1931688 CPUtime=1421.91 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 482893 0 0 0 142075 116 0 0 20 0 1 0 343163385 1978048512 482165 33554432000 134512640 135840783 4286812640 4286812000 134550820 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 482922 482165 347 325 0 481858 0
Current children cumulated CPU time (s) 1421.91
Current children cumulated vsize (KiB) 1931688

[startup+1482.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/178 14375
/proc/meminfo: memFree=24973644/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=2011968 CPUtime=1481.88 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 502955 0 0 0 148069 119 0 0 20 0 1 0 343163385 2060255232 502217 33554432000 134512640 135840783 4286812640 4286812000 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 502992 502217 347 325 0 501928 0
Current children cumulated CPU time (s) 1481.88
Current children cumulated vsize (KiB) 2011968

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14375
/proc/meminfo: memFree=24802924/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=2110268 CPUtime=1541.86 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 527594 0 0 0 154061 125 0 0 20 0 1 0 343163385 2160914432 526822 33554432000 134512640 135840783 4286812640 4286812000 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 527567 526822 347 325 0 526503 0
Current children cumulated CPU time (s) 1541.86
Current children cumulated vsize (KiB) 2110268

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14375
/proc/meminfo: memFree=24663452/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=2168616 CPUtime=1601.83 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 542207 0 0 0 160055 128 0 0 20 0 1 0 343163385 2220662784 541401 33554432000 134512640 135840783 4286812640 4286812000 134550893 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 542154 541401 347 325 0 541090 0
Current children cumulated CPU time (s) 1601.83
Current children cumulated vsize (KiB) 2168616

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14375
/proc/meminfo: memFree=24562916/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=2241636 CPUtime=1661.81 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 560498 0 0 0 166048 133 0 0 20 0 1 0 343163385 2295435264 559662 33554432000 134512640 135840783 4286812640 4286812000 134550893 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 560409 559662 347 325 0 559345 0
Current children cumulated CPU time (s) 1661.81
Current children cumulated vsize (KiB) 2241636

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14376
/proc/meminfo: memFree=24460148/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=2304652 CPUtime=1721.79 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 576249 0 0 0 172042 137 0 0 20 0 1 0 343163385 2359963648 575397 33554432000 134512640 135840783 4286812640 4286811992 14051500 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 576163 575397 347 325 0 575099 0
Current children cumulated CPU time (s) 1721.79
Current children cumulated vsize (KiB) 2304652

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14376
/proc/meminfo: memFree=24307160/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=2427460 CPUtime=1781.77 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 606967 0 0 0 178034 143 0 0 20 0 1 0 343163385 2485719040 606091 33554432000 134512640 135840783 4286812640 4286812000 134551093 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 606865 606091 347 325 0 605801 0
Current children cumulated CPU time (s) 1781.77
Current children cumulated vsize (KiB) 2427460



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 14376
/proc/meminfo: memFree=24263992/32873844 swapFree=6608/6608
[pid=14298] ppid=14296 vsize=2456588 CPUtime=1800.08 cores=0,2,4,6
/proc/14298/stat : 14298 (bsolo3.0.17) R 14296 14298 12501 0 -1 4202496 614258 0 0 0 179864 144 0 0 20 0 1 0 343163385 2515546112 613381 33554432000 134512640 135840783 4286812640 4286812000 134550893 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/14298/statm: 614147 613381 347 325 0 613083 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 2456588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.71
CPU time (s): 1800.19
CPU user time (s): 1798.64
CPU system time (s): 1.54277
CPU usage (%): 99.9708
Max. virtual memory (cumulated for all children) (KiB): 2456588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.64
system time used= 1.54276
maximum resident set size= 2453524
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 614261
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 365
involuntary context switches= 2057

runsolver used 3.9304 second user time and 8.61669 second system time

The end

Launcher Data 

Begin job on node140 at 2012-06-04 02:39:50
IDJOB=3742399
IDBENCH=90181
IDSOLVER=2318
FILE ID=node140/3742399-1338770390
RUNJOBID= node140-1338749243-12517
PBS_JOBID= 14636796
Free space on /tmp= 70608 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K156.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742399-1338770390/watcher-3742399-1338770390 -o /tmp/evaluation-result-3742399-1338770390/solver-3742399-1338770390 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3742399-1338770390.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b01d5fef61cfdf78caaec08ee0d21bae
RANDOM SEED=1526773786

node140.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.094
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        26578864 kB
Buffers:          518956 kB
Cached:          4017372 kB
SwapCached:         1620 kB
Active:          2359460 kB
Inactive:        3000516 kB
Active(anon):     816064 kB
Inactive(anon):     9476 kB
Active(file):    1543396 kB
Inactive(file):  2991040 kB
Unevictable:        6608 kB
Mlocked:            6608 kB
SwapTotal:      67108856 kB
SwapFree:       67105264 kB
Dirty:              7788 kB
Writeback:             8 kB
AnonPages:        828204 kB
Mapped:            11872 kB
Shmem:                 8 kB
Slab:             791592 kB
SReclaimable:     233632 kB
SUnreclaim:       557960 kB
KernelStack:        1464 kB
PageTables:         5364 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     938632 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70600 MiB
End job on node140 at 2012-06-04 03:09:52