Trace number 3742425

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.13 1800.75

General information on the benchmark

Name/DEC-SMALLINT-LIN/sroussel/
ShortestPathNG/normalized-NG_K181.opb
MD5SUM786bb841dd145412a2aec0a596e79174
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables21539
Total number of constraints21903
Number of constraints which are clauses21722
Number of constraints which are cardinality constraints (but not clauses)181
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint181
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 182
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3742425-1338770794.opb
0.00/0.00	c File size is 1490066 bytes.
0.09/0.13	c Highest Coefficient sum: 182
0.09/0.13	c Parsing was ok!!
0.09/0.13	c Total parsing time: 0.133 s
0.09/0.14	c Var: 21539 Constr: 21903 21722/181/0 Lit: 140939 Watch. Lit: 64981
0.09/0.14	c Obj. Vars: 0 (0 % of total variables)
9.49/9.51	c Pre-processing Time: 9.504 s
9.49/9.51	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
9.49/9.51	c        0  19979    20449   134378    6    61653  184189      0      0 9.50
9.49/9.51	c Switching off LPR mode.
1800.07/1800.71	c      100  19979    20549   141451    6    61853  202608    100     10 9.54
1800.07/1800.71	c      250  19979    20699   161445    7    62153  222869    250     25 9.69
1800.07/1800.71	c      477  19979    20926   171716    8    62607  245156    477     47 9.97
1800.07/1800.71	c      815  19979    21264   206018    9    63283  269672    815     79 10.28
1800.07/1800.71	c     1327  19979    21776   249025   11    64307  296640   1327    122 10.84
1800.07/1800.71	c     2092  19979    22541   583699   25    65837  326305   2092    185 11.26
1800.07/1800.71	c     3238  19979    23687   715517   30    68129  358936   3238    256 12.64
1800.07/1800.71	c     4959  19979    25408   968193   38    71571  394830   4959    342 14.50
1800.07/1800.71	c     7543  19979    27992  1250706   44    76739  434314   7543    419 17.99
1800.07/1800.71	c    11422  19979    31871  1815694   56    84497  477746  11422    513 22.26
1800.07/1800.71	c    17244  19979    37693  3055632   81    96141  525521  17244    558 30.88
1800.07/1800.71	c    25981  19979    46430  5133534  110   113615  578074  25981    572 45.35
1800.07/1800.71	c    39091  19979    59540  8400310  141   139835  635882  39091    546 71.53
1800.07/1800.71	c    58761  19979    79210 12742745  160   179175  699471  58761    477 122.96
1800.07/1800.71	c    88274  19979   108723 22501169  206   238201  769419  88274    394 223.64
1800.07/1800.71	c   132544  19979   152993 42556854  278   326741  846361 132544    339 390.70
1800.07/1800.71	c   198954  19979   219403 71970067  328   459561  930998 198954    278 714.09
1800.07/1800.71	c   298575  19979   319024 116570278  365   658803  500000 298575    195 1526.98
1800.07/1800.71	c Caught signal: 15
1800.07/1800.71	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.07/1800.71	c   18   325360 208110 22616109   345809 127712212 325360    180 1800.09
1800.07/1800.71	s UNKNOWN
1800.07/1800.71	c Total time: 1800.09 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3742425-1338770794/watcher-3742425-1338770794 -o /tmp/evaluation-result-3742425-1338770794/solver-3742425-1338770794 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3742425-1338770794.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 10839
/proc/meminfo: memFree=30142392/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=4476 CPUtime=0 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4194304 205 0 0 0 0 0 0 0 20 0 1 0 343207904 4583424 155 33554432000 134512640 135840783 4286616448 4286615788 1541464 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 1119 155 133 325 0 39 0

[startup+0.081676 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 10839
/proc/meminfo: memFree=30142392/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=9724 CPUtime=0.07 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 1585 0 0 0 7 0 0 0 20 0 1 0 343207904 9957376 1481 33554432000 134512640 135840783 4286616448 4286614208 1833907 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 2431 1482 535 325 0 1003 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 9724

[startup+0.100276 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 10839
/proc/meminfo: memFree=30142392/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=10272 CPUtime=0.09 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 1789 0 0 0 9 0 0 0 20 0 1 0 343207904 10518528 1685 33554432000 134512640 135840783 4286616448 4286613744 2102567 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 2568 1686 588 325 0 1140 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 10272

[startup+0.300251 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 10839
/proc/meminfo: memFree=30142392/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=12856 CPUtime=0.28 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 2855 0 0 0 28 0 0 0 20 0 1 0 343207904 13164544 2387 33554432000 134512640 135840783 4286616448 4286357084 7357488 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 3214 2387 342 325 0 2150 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 12856

[startup+0.700235 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 10839
/proc/meminfo: memFree=30142392/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=12856 CPUtime=0.68 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 2856 0 0 0 68 0 0 0 20 0 1 0 343207904 13164544 2388 33554432000 134512640 135840783 4286616448 4286357084 7357488 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 3214 2388 342 325 0 2150 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 12856

[startup+1.50023 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10840
/proc/meminfo: memFree=30133704/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=12856 CPUtime=1.48 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 2857 0 0 0 148 0 0 0 20 0 1 0 343207904 13164544 2389 33554432000 134512640 135840783 4286616448 4286357084 7357488 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 3214 2389 342 325 0 2150 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 12856

[startup+3.10024 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10840
/proc/meminfo: memFree=30133060/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=12856 CPUtime=3.08 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 2857 0 0 0 308 0 0 0 20 0 1 0 343207904 13164544 2389 33554432000 134512640 135840783 4286616448 4286357084 7357488 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 3214 2389 342 325 0 2150 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 12856

[startup+6.30023 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10840
/proc/meminfo: memFree=30131324/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=12856 CPUtime=6.29 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 2858 0 0 0 628 1 0 0 20 0 1 0 343207904 13164544 2390 33554432000 134512640 135840783 4286616448 4286357084 7357488 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 3214 2390 342 325 0 2150 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 12856

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10840
/proc/meminfo: memFree=30118568/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=20712 CPUtime=12.68 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 5053 0 0 0 1266 2 0 0 20 0 1 0 343207904 21209088 4372 33554432000 134512640 135840783 4286616448 4286615760 134551330 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 5178 4372 347 325 0 4114 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 20712

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10840
/proc/meminfo: memFree=30066704/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=39660 CPUtime=25.49 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 9788 0 0 0 2545 4 0 0 20 0 1 0 343207904 40611840 9107 33554432000 134512640 135840783 4286616448 4286615728 2104910 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 9915 9107 347 325 0 8851 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 39660

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10840
/proc/meminfo: memFree=29992520/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=86268 CPUtime=51.08 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 21445 0 0 0 5101 7 0 0 20 0 1 0 343207904 88338432 20764 33554432000 134512640 135840783 4286616448 4286615808 134551048 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 21567 20764 347 325 0 20503 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 86268

[startup+102.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10840
/proc/meminfo: memFree=29887908/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=151424 CPUtime=102.28 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 37745 0 0 0 10217 11 0 0 20 0 1 0 343207904 155058176 37064 33554432000 134512640 135840783 4286616448 4286611200 134574700 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 37856 37064 347 325 0 36792 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 151424

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10840
/proc/meminfo: memFree=29804484/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=209772 CPUtime=162.26 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 52331 0 0 0 16212 14 0 0 20 0 1 0 343207904 214806528 51650 33554432000 134512640 135840783 4286616448 4286615584 2100126 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 52443 51650 347 325 0 51379 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 209772

[startup+222.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/178 10843
/proc/meminfo: memFree=29653472/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=306044 CPUtime=222.25 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 76410 0 0 0 22205 20 0 0 20 0 1 0 343207904 313389056 75729 33554432000 134512640 135840783 4286616448 4286615808 134550764 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 76511 75729 347 325 0 75447 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 306044

[startup+282.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 10844
/proc/meminfo: memFree=29560136/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=361288 CPUtime=282.24 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 90198 0 0 0 28201 23 0 0 20 0 1 0 343207904 369958912 89517 33554432000 134512640 135840783 4286616448 4286615808 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 90322 89517 347 325 0 89258 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 361288

[startup+342.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 10883
/proc/meminfo: memFree=30712464/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=457592 CPUtime=342.21 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 114321 0 0 0 34192 29 0 0 20 0 1 0 343207904 468574208 113612 33554432000 134512640 135840783 4286616448 4286615748 2107979 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 114398 113612 347 325 0 113334 0
Current children cumulated CPU time (s) 342.21
Current children cumulated vsize (KiB) 457592

[startup+402.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 10883
/proc/meminfo: memFree=30526616/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=576024 CPUtime=402.17 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 143965 0 0 0 40181 36 0 0 20 0 1 0 343207904 589848576 143214 33554432000 134512640 135840783 4286616448 4286609284 2108023 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 144006 143214 347 325 0 142942 0
Current children cumulated CPU time (s) 402.17
Current children cumulated vsize (KiB) 576024

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/176 10883
/proc/meminfo: memFree=30441960/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=606912 CPUtime=462.12 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 151739 0 0 0 46174 38 0 0 20 0 1 0 343207904 621477888 150945 33554432000 134512640 135840783 4286616448 4286615808 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 151728 150945 347 325 0 150664 0
Current children cumulated CPU time (s) 462.12
Current children cumulated vsize (KiB) 606912

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10884
/proc/meminfo: memFree=30327032/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=668420 CPUtime=522.07 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 167153 0 0 0 52166 41 0 0 20 0 1 0 343207904 684462080 166318 33554432000 134512640 135840783 4286616448 4286615808 134551324 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 167105 166318 347 325 0 166041 0
Current children cumulated CPU time (s) 522.07
Current children cumulated vsize (KiB) 668420

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 10885
/proc/meminfo: memFree=30190412/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=756172 CPUtime=582.04 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 189121 0 0 0 58157 47 0 0 20 0 1 0 343207904 774320128 188257 33554432000 134512640 135840783 4286616448 4286615808 134550863 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 189043 188257 347 325 0 187979 0
Current children cumulated CPU time (s) 582.04
Current children cumulated vsize (KiB) 756172

[startup+642.3 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 10912
/proc/meminfo: memFree=29619392/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1082788 CPUtime=881.88 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 270943 0 0 0 88118 70 0 0 20 0 1 0 343207904 1108774912 269897 33554432000 134512640 135840783 4286616448 4286615760 134550910 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 270697 269897 347 325 0 269633 0
Current children cumulated CPU time (s) 881.88
Current children cumulated vsize (KiB) 1082788

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10912
/proc/meminfo: memFree=29520848/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1137696 CPUtime=941.83 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 284708 0 0 0 94111 72 0 0 20 0 1 0 343207904 1165000704 283620 33554432000 134512640 135840783 4286616448 4286615808 134550863 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 284424 283620 347 325 0 283360 0
Current children cumulated CPU time (s) 941.83
Current children cumulated vsize (KiB) 1137696

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10912
/proc/meminfo: memFree=29425644/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1175112 CPUtime=1001.79 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 294106 0 0 0 100104 75 0 0 20 0 1 0 343207904 1203314688 292974 33554432000 134512640 135840783 4286616448 4286615760 134551175 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 293778 292974 347 325 0 292714 0
Current children cumulated CPU time (s) 1001.79
Current children cumulated vsize (KiB) 1175112

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10912
/proc/meminfo: memFree=29363068/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1205496 CPUtime=1061.78 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 301738 0 0 0 106101 77 0 0 20 0 1 0 343207904 1234427904 300596 33554432000 134512640 135840783 4286616448 4286615760 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 301374 300596 347 325 0 300310 0
Current children cumulated CPU time (s) 1061.78
Current children cumulated vsize (KiB) 1205496

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10912
/proc/meminfo: memFree=29288944/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1237784 CPUtime=1121.77 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 309791 0 0 0 112098 79 0 0 20 0 1 0 343207904 1267490816 308649 33554432000 134512640 135840783 4286616448 4286615808 134550902 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 309446 308649 347 325 0 308382 0
Current children cumulated CPU time (s) 1121.77
Current children cumulated vsize (KiB) 1237784

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10913
/proc/meminfo: memFree=29191260/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1273984 CPUtime=1181.76 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 318834 0 0 0 118093 83 0 0 20 0 1 0 343207904 1304559616 317692 33554432000 134512640 135840783 4286616448 4286611888 2102449 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 318496 317692 347 325 0 317432 0
Current children cumulated CPU time (s) 1181.76
Current children cumulated vsize (KiB) 1273984

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10913
/proc/meminfo: memFree=29108952/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1311856 CPUtime=1241.75 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 328328 0 0 0 124089 86 0 0 20 0 1 0 343207904 1343340544 327186 33554432000 134512640 135840783 4286616448 4286615808 134551071 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 327964 327186 347 325 0 326900 0
Current children cumulated CPU time (s) 1241.75
Current children cumulated vsize (KiB) 1311856

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10913
/proc/meminfo: memFree=29023048/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1340864 CPUtime=1301.74 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 335586 0 0 0 130086 88 0 0 20 0 1 0 343207904 1373044736 334444 33554432000 134512640 135840783 4286616448 4286615808 134551414 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 335216 334444 347 325 0 334152 0
Current children cumulated CPU time (s) 1301.74
Current children cumulated vsize (KiB) 1340864

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10913
/proc/meminfo: memFree=28970128/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1369160 CPUtime=1361.73 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 342643 0 0 0 136083 90 0 0 20 0 1 0 343207904 1402019840 341501 33554432000 134512640 135840783 4286616448 4286615808 134550863 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 342290 341501 347 325 0 341226 0
Current children cumulated CPU time (s) 1361.73
Current children cumulated vsize (KiB) 1369160

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 10916
/proc/meminfo: memFree=28887936/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1415784 CPUtime=1421.73 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 354297 0 0 0 142081 92 0 0 20 0 1 0 343207904 1449762816 353155 33554432000 134512640 135840783 4286616448 4286615808 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 353946 353155 347 325 0 352882 0
Current children cumulated CPU time (s) 1421.73
Current children cumulated vsize (KiB) 1415784

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10917
/proc/meminfo: memFree=28776496/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1496392 CPUtime=1481.71 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 374437 0 0 0 148074 97 0 0 20 0 1 0 343207904 1532305408 373295 33554432000 134512640 135840783 4286616448 4286615760 134550893 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 374098 373295 347 325 0 373034 0
Current children cumulated CPU time (s) 1481.71
Current children cumulated vsize (KiB) 1496392

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10917
/proc/meminfo: memFree=28707952/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1535524 CPUtime=1541.71 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 384242 0 0 0 154070 101 0 0 20 0 1 0 343207904 1572376576 383100 33554432000 134512640 135840783 4286616448 4286615808 134550779 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 383881 383100 347 325 0 382817 0
Current children cumulated CPU time (s) 1541.71
Current children cumulated vsize (KiB) 1535524

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10917
/proc/meminfo: memFree=28653296/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1566200 CPUtime=1601.7 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 391895 0 0 0 160066 104 0 0 20 0 1 0 343207904 1603788800 390753 33554432000 134512640 135840783 4286616448 4286615808 134551048 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 391550 390753 347 325 0 390486 0
Current children cumulated CPU time (s) 1601.7
Current children cumulated vsize (KiB) 1566200

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10917
/proc/meminfo: memFree=28580492/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1594728 CPUtime=1661.68 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 399041 0 0 0 166062 106 0 0 20 0 1 0 343207904 1633001472 397899 33554432000 134512640 135840783 4286616448 4286615808 134551104 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 398682 397899 347 325 0 397618 0
Current children cumulated CPU time (s) 1661.68
Current children cumulated vsize (KiB) 1594728

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10917
/proc/meminfo: memFree=28507332/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1640372 CPUtime=1721.67 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 410441 0 0 0 172059 108 0 0 20 0 1 0 343207904 1679740928 409299 33554432000 134512640 135840783 4286616448 4286615808 134550921 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 410093 409299 347 325 0 409029 0
Current children cumulated CPU time (s) 1721.67
Current children cumulated vsize (KiB) 1640372

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10918
/proc/meminfo: memFree=28458104/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1665100 CPUtime=1781.66 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 416616 0 0 0 178056 110 0 0 20 0 1 0 343207904 1705062400 415474 33554432000 134512640 135840783 4286616448 4286615808 134550804 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 416275 415474 347 325 0 415211 0
Current children cumulated CPU time (s) 1781.66
Current children cumulated vsize (KiB) 1665100



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.71 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10918
/proc/meminfo: memFree=28435784/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1670268 CPUtime=1800.07 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 417937 0 0 0 179897 110 0 0 20 0 1 0 343207904 1710354432 416795 33554432000 134512640 135840783 4286616448 4286615760 134550893 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 417567 416795 347 325 0 416503 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 1670268

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.71 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 10918
/proc/meminfo: memFree=28435784/32873844 swapFree=8656/8656
[pid=10839] ppid=10837 vsize=1670268 CPUtime=1800.07 cores=0,2,4,6
/proc/10839/stat : 10839 (bsolo3.0.17) R 10837 10839 9396 0 -1 4202496 417937 0 0 0 179897 110 0 0 20 0 1 0 343207904 1710354432 416795 33554432000 134512640 135840783 4286616448 4286615760 134550893 0 0 4096 16384 0 0 0 17 4 0 0 0 0 0
/proc/10839/statm: 417567 416795 347 325 0 416503 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 1670268

Child status: 15
Real time (s): 1800.75
CPU time (s): 1800.13
CPU user time (s): 1798.98
CPU system time (s): 1.14582
CPU usage (%): 99.9653
Max. virtual memory (cumulated for all children) (KiB): 1670268

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.98
system time used= 1.14582
maximum resident set size= 1667180
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 417940
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 492
involuntary context switches= 1932

runsolver used 3.23151 second user time and 8.95364 second system time

The end

Launcher Data 

Begin job on node102 at 2012-06-04 02:46:34
IDJOB=3742425
IDBENCH=90184
IDSOLVER=2318
FILE ID=node102/3742425-1338770794
RUNJOBID= node102-1338747648-9412
PBS_JOBID= 14636781
Free space on /tmp= 71168 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB12/normalized-PB12/DEC-SMALLINT-LIN/sroussel/ShortestPathNG/normalized-NG_K181.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3742425-1338770794/watcher-3742425-1338770794 -o /tmp/evaluation-result-3742425-1338770794/solver-3742425-1338770794 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3742425-1338770794.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 786bb841dd145412a2aec0a596e79174
RANDOM SEED=984835105

node102.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30142400 kB
Buffers:          211368 kB
Cached:           652744 kB
SwapCached:         5520 kB
Active:          1342992 kB
Inactive:         615552 kB
Active(anon):    1091056 kB
Inactive(anon):     5604 kB
Active(file):     251936 kB
Inactive(file):   609948 kB
Unevictable:        8656 kB
Mlocked:            8656 kB
SwapTotal:      67108856 kB
SwapFree:       67097276 kB
Dirty:              8180 kB
Writeback:             0 kB
AnonPages:       1097776 kB
Mapped:            10368 kB
Shmem:                 0 kB
Slab:             629432 kB
SReclaimable:      70664 kB
SUnreclaim:       558768 kB
KernelStack:        1456 kB
PageTables:         5768 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1212716 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71160 MiB
End job on node102 at 2012-06-04 03:16:36