Trace number 3737852

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.08 1800.51

General information on the benchmark

Namenormalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/
manquinho/dbsg/normalized-dbsg_200_10_2_40.opb
MD5SUMae994079f65819ac107e4a3e259224ff
Bench CategoryDEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark0.084986
Has Objective FunctionNO
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved NO
Number of variables400
Total number of constraints602
Number of constraints which are clauses200
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints401
Minimum length of a constraint2
Maximum length of a constraint400
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 40
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 400
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)4984
Sum of products size (including duplicates)9968
Number of different products2492
Sum of products size4984

Solver Data 

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3737852-1338728296.opb
0.00/0.00	c File size is 74490 bytes.
0.00/0.02	c Highest Coefficient sum: 400
0.00/0.02	c Parsing was ok!!
0.00/0.02	c Total parsing time: 0.014 s
0.00/0.02	c Var: 5384 Constr: 10571 5184/403/4984 Lit: 36288 Watch. Lit: 30747
0.00/0.02	c Obj. Vars: 0 (0 % of total variables)
0.89/0.99	c Pre-processing Time: 0.99 s
0.89/0.99	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
0.89/0.99	c        0   5384    10571    36288    3    30747   54330      0      0 0.99
0.89/0.99	c Switching off LPR mode.
1800.06/1800.50	c      148   5384    10719    78530    7    31043   59764    148    137 1.08
1800.06/1800.50	c      303   5384    10874   122337   11    31353   65741    303    249 1.21
1800.06/1800.50	c      532   5384    11103   203198   18    31811   72316    532    414 1.28
1800.06/1800.50	c      889   5384    11460   326601   28    32525   79548    889    593 1.50
1800.06/1800.50	c     1417   5384    11988   505849   42    33581   87503   1417    706 2.00
1800.06/1800.50	c     2180   5384    12751   775462   60    35107   96254   2180    913 2.39
1800.06/1800.50	c     3340   5384    13911  1185744   85    37427  105880   3340    949 3.52
1800.06/1800.50	c     5061   5384    15632  1790844  114    40869  116469   5061    706 7.16
1800.06/1800.50	c     7650   5384    18221  2696411  147    46047  128116   7650    481 15.88
1800.06/1800.50	c    11530   5384    22101  4044400  182    53807  140928  11530    310 37.13
1800.06/1800.50	c    17352   5384    27923  6052065  216    65451  155021  17352    197 87.86
1800.06/1800.50	c    26094   5384    36665  9089911  247    82935  170524  26094    139 187.10
1800.06/1800.50	c    39221   5384    49792 13747367  276   109189  187577  39221    139 282.06
1800.06/1800.50	c    58894   5384    69465 20705980  298   148535  206335  58894    116 504.61
1800.06/1800.50	c    88404   5384    98975 31179989  315   207555  226969  88404     83 1057.60
1800.06/1800.50	c Caught signal: 15
1800.06/1800.50	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.06/1800.50	c   15   115352     46   125723   125923 40766004 115352     64 1800.07
1800.06/1800.50	s UNKNOWN
1800.06/1800.50	c Total time: 1800.07 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3737852-1338728296/watcher-3737852-1338728296 -o /tmp/evaluation-result-3737852-1338728296/solver-3737852-1338728296 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3737852-1338728296.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.08 2.02 2.01 3/176 19616
/proc/meminfo: memFree=30420212/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=4476 CPUtime=0 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4194304 167 0 0 0 0 0 0 0 20 0 1 0 338955479 4583424 118 33554432000 134512640 135840783 4287369152 4287368072 5760321 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 1119 128 110 325 0 39 0

[startup+0.0470129 s]
/proc/loadavg: 2.08 2.02 2.01 3/176 19616
/proc/meminfo: memFree=30420212/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=7340 CPUtime=0.03 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 1158 0 0 0 3 0 0 0 20 0 1 0 338955479 7516160 1075 33554432000 134512640 135840783 4287369152 4287303660 16520240 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 1835 1075 343 325 0 771 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 7340

[startup+0.100223 s]
/proc/loadavg: 2.08 2.02 2.01 3/176 19616
/proc/meminfo: memFree=30420212/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=7340 CPUtime=0.09 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 1158 0 0 0 9 0 0 0 20 0 1 0 338955479 7516160 1075 33554432000 134512640 135840783 4287369152 4287303484 6334992 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 1835 1075 343 325 0 771 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 7340

[startup+0.300198 s]
/proc/loadavg: 2.08 2.02 2.01 3/176 19616
/proc/meminfo: memFree=30420212/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=7340 CPUtime=0.29 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 1158 0 0 0 29 0 0 0 20 0 1 0 338955479 7516160 1075 33554432000 134512640 135840783 4287369152 4287303632 134583111 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 1835 1075 343 325 0 771 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 7340

[startup+0.700198 s]
/proc/loadavg: 2.08 2.02 2.01 3/176 19616
/proc/meminfo: memFree=30420212/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=7340 CPUtime=0.69 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 1158 0 0 0 69 0 0 0 20 0 1 0 338955479 7516160 1075 33554432000 134512640 135840783 4287369152 4287303440 6332000 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 1835 1075 343 325 0 771 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 7340

[startup+1.5002 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 19617
/proc/meminfo: memFree=30415864/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=11212 CPUtime=1.49 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 2375 0 0 0 148 1 0 0 20 0 1 0 338955479 11481088 2057 33554432000 134512640 135840783 4287369152 4287368448 134572675 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 2803 2057 347 325 0 1739 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 11212

[startup+3.1002 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 19617
/proc/meminfo: memFree=30404952/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=20832 CPUtime=3.09 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 4783 0 0 0 308 1 0 0 20 0 1 0 338955479 21331968 4465 33554432000 134512640 135840783 4287369152 4287368512 134551081 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 5208 4465 347 325 0 4144 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 20832

[startup+6.30022 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 19617
/proc/meminfo: memFree=30387484/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=28796 CPUtime=6.28 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 6791 0 0 0 627 1 0 0 20 0 1 0 338955479 29487104 6473 33554432000 134512640 135840783 4287369152 4287368512 134550913 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 7199 6473 347 325 0 6135 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 28796

[startup+12.7011 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 19617
/proc/meminfo: memFree=30364684/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=38680 CPUtime=12.68 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 9258 0 0 0 1266 2 0 0 20 0 1 0 338955479 39608320 8940 33554432000 134512640 135840783 4287369152 4287368512 134551478 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 9670 8940 347 325 0 8606 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 38680

[startup+25.5011 s]
/proc/loadavg: 2.12 2.03 2.01 3/177 19618
/proc/meminfo: memFree=30340908/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=49716 CPUtime=25.48 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 12015 0 0 0 2544 4 0 0 20 0 1 0 338955479 50909184 11697 33554432000 134512640 135840783 4287369152 4287368512 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 12429 11697 347 325 0 11365 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 49716

[startup+51.1003 s]
/proc/loadavg: 2.08 2.03 2.01 3/177 19618
/proc/meminfo: memFree=30299816/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=67448 CPUtime=51.08 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 16442 0 0 0 5102 6 0 0 20 0 1 0 338955479 69066752 16124 33554432000 134512640 135840783 4287369152 4287368512 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 16862 16124 347 325 0 15798 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 67448

[startup+102.307 s]
/proc/loadavg: 2.03 2.02 2.00 3/177 19618
/proc/meminfo: memFree=30229552/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=92480 CPUtime=102.28 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 22706 0 0 0 10219 9 0 0 20 0 1 0 338955479 94699520 22388 33554432000 134512640 135840783 4287369152 4287368512 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 23120 22388 347 325 0 22056 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 92480

[startup+162.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/178 19621
/proc/meminfo: memFree=30169196/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=111884 CPUtime=162.26 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 27579 0 0 0 16214 12 0 0 20 0 1 0 338955479 114569216 27252 33554432000 134512640 135840783 4287369152 4287368512 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 27971 27252 347 325 0 26907 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 111884

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 19644
/proc/meminfo: memFree=30095600/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=158108 CPUtime=222.21 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 39181 0 0 0 22204 17 0 0 20 0 1 0 338955479 161902592 38808 33554432000 134512640 135840783 4287369152 4287368512 134551312 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 39527 38808 347 325 0 38463 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 158108

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19644
/proc/meminfo: memFree=30039864/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=186104 CPUtime=282.18 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 46182 0 0 0 28197 21 0 0 20 0 1 0 338955479 190570496 45784 33554432000 134512640 135840783 4287369152 4287368512 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 46526 45784 347 325 0 45462 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 186104

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19645
/proc/meminfo: memFree=29976376/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=219596 CPUtime=342.18 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 54573 0 0 0 34192 26 0 0 20 0 1 0 338955479 224866304 54175 33554432000 134512640 135840783 4287369152 4287368512 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 54899 54175 347 325 0 53835 0
Current children cumulated CPU time (s) 342.18
Current children cumulated vsize (KiB) 219596

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19645
/proc/meminfo: memFree=29926528/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=243996 CPUtime=402.16 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 60669 0 0 0 40187 29 0 0 20 0 1 0 338955479 249851904 60271 33554432000 134512640 135840783 4287369152 4287368512 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 60999 60271 347 325 0 59935 0
Current children cumulated CPU time (s) 402.16
Current children cumulated vsize (KiB) 243996

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19645
/proc/meminfo: memFree=29872068/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=262364 CPUtime=462.16 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 65254 0 0 0 46184 32 0 0 20 0 1 0 338955479 268660736 64856 33554432000 134512640 135840783 4287369152 4287368512 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 65591 64856 347 325 0 64527 0
Current children cumulated CPU time (s) 462.16
Current children cumulated vsize (KiB) 262364

[startup+522.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19645
/proc/meminfo: memFree=29821752/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=281340 CPUtime=522.14 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 70007 0 0 0 52179 35 0 0 20 0 1 0 338955479 288092160 69609 33554432000 134512640 135840783 4287369152 4287368512 134551104 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 70335 69609 347 325 0 69271 0
Current children cumulated CPU time (s) 522.14
Current children cumulated vsize (KiB) 281340

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19645
/proc/meminfo: memFree=29789116/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=289676 CPUtime=582.13 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 72089 0 0 0 58176 37 0 0 20 0 1 0 338955479 296628224 71691 33554432000 134512640 135840783 4287369152 4287368464 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 72419 71691 347 325 0 71355 0
Current children cumulated CPU time (s) 582.13
Current children cumulated vsize (KiB) 289676

[startup+642.301 s]

################
# More data... #
################

[startup+882.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 19649
/proc/meminfo: memFree=29508240/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=323568 CPUtime=882.05 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 80616 0 0 0 88162 43 0 0 20 0 1 0 338955479 331333632 80160 33554432000 134512640 135840783 4287369152 4287368512 134550878 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 80892 80160 347 325 0 79828 0
Current children cumulated CPU time (s) 882.05
Current children cumulated vsize (KiB) 323568

[startup+942.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19651
/proc/meminfo: memFree=29441776/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=358240 CPUtime=942.04 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 89292 0 0 0 94156 48 0 0 20 0 1 0 338955479 366837760 88836 33554432000 134512640 135840783 4287369152 4287368512 134550764 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 89560 88836 347 325 0 88496 0
Current children cumulated CPU time (s) 942.04
Current children cumulated vsize (KiB) 358240

[startup+1002.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19651
/proc/meminfo: memFree=29343752/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=390616 CPUtime=1002.03 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 97386 0 0 0 100150 53 0 0 20 0 1 0 338955479 399990784 96930 33554432000 134512640 135840783 4287369152 4287368512 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 97654 96930 347 325 0 96590 0
Current children cumulated CPU time (s) 1002.03
Current children cumulated vsize (KiB) 390616

[startup+1062.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19651
/proc/meminfo: memFree=29252640/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=414640 CPUtime=1062.02 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 103384 0 0 0 106144 58 0 0 20 0 1 0 338955479 424591360 102928 33554432000 134512640 135840783 4287369152 4287368512 134550779 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 103660 102928 347 325 0 102596 0
Current children cumulated CPU time (s) 1062.02
Current children cumulated vsize (KiB) 414640

[startup+1122.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 19651
/proc/meminfo: memFree=29179388/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=431968 CPUtime=1122.02 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 107701 0 0 0 112140 62 0 0 20 0 1 0 338955479 442335232 107245 33554432000 134512640 135840783 4287369152 4287368464 134551084 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 107992 107245 347 325 0 106928 0
Current children cumulated CPU time (s) 1122.02
Current children cumulated vsize (KiB) 431968

[startup+1182.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 19651
/proc/meminfo: memFree=29127460/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=447756 CPUtime=1182 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 111675 0 0 0 118136 64 0 0 20 0 1 0 338955479 458502144 111219 33554432000 134512640 135840783 4287369152 4287368512 134550913 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 111939 111219 347 325 0 110875 0
Current children cumulated CPU time (s) 1182
Current children cumulated vsize (KiB) 447756

[startup+1242.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 19652
/proc/meminfo: memFree=29083220/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=459824 CPUtime=1241.99 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 114674 0 0 0 124133 66 0 0 20 0 1 0 338955479 470859776 114218 33554432000 134512640 135840783 4287369152 4287368512 134550863 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 114956 114218 347 325 0 113892 0
Current children cumulated CPU time (s) 1241.99
Current children cumulated vsize (KiB) 459824

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 19652
/proc/meminfo: memFree=29050512/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=464820 CPUtime=1301.99 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 115921 0 0 0 130131 68 0 0 20 0 1 0 338955479 475975680 115465 33554432000 134512640 135840783 4287369152 4287368512 134551093 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 116205 115465 347 325 0 115141 0
Current children cumulated CPU time (s) 1301.99
Current children cumulated vsize (KiB) 464820

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 19655
/proc/meminfo: memFree=29010748/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=469192 CPUtime=1361.97 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 117014 0 0 0 136128 69 0 0 20 0 1 0 338955479 480452608 116558 33554432000 134512640 135840783 4287369152 4287368512 134550872 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 117298 116558 347 325 0 116234 0
Current children cumulated CPU time (s) 1361.97
Current children cumulated vsize (KiB) 469192

[startup+1422.31 s]
/proc/loadavg: 2.06 2.01 2.00 3/177 19655
/proc/meminfo: memFree=28978920/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=475740 CPUtime=1421.97 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 118661 0 0 0 142127 70 0 0 20 0 1 0 338955479 487157760 118205 33554432000 134512640 135840783 4287369152 4287368512 134551048 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 118935 118205 347 325 0 117871 0
Current children cumulated CPU time (s) 1421.97
Current children cumulated vsize (KiB) 475740

[startup+1482.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 19655
/proc/meminfo: memFree=28945812/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=481648 CPUtime=1481.96 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 120145 0 0 0 148124 72 0 0 20 0 1 0 338955479 493207552 119689 33554432000 134512640 135840783 4287369152 4287368512 134551071 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 120412 119689 347 325 0 119348 0
Current children cumulated CPU time (s) 1481.96
Current children cumulated vsize (KiB) 481648

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 19655
/proc/meminfo: memFree=28886800/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=494064 CPUtime=1541.95 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 123237 0 0 0 154121 74 0 0 20 0 1 0 338955479 505921536 122781 33554432000 134512640 135840783 4287369152 4287368512 134551071 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 123516 122783 347 325 0 122452 0
Current children cumulated CPU time (s) 1541.95
Current children cumulated vsize (KiB) 494064

[startup+1602.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 19656
/proc/meminfo: memFree=28808856/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=506004 CPUtime=1601.92 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 126244 0 0 0 160116 76 0 0 20 0 1 0 338955479 518148096 125764 33554432000 134512640 135840783 4287369152 4287368464 134551093 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 126501 125764 347 325 0 125437 0
Current children cumulated CPU time (s) 1601.92
Current children cumulated vsize (KiB) 506004

[startup+1662.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 19656
/proc/meminfo: memFree=28776248/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=514484 CPUtime=1661.89 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 128389 0 0 0 166111 78 0 0 20 0 1 0 338955479 526831616 127876 33554432000 134512640 135840783 4287369152 4287368464 134550913 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 128621 127876 347 325 0 127557 0
Current children cumulated CPU time (s) 1661.89
Current children cumulated vsize (KiB) 514484

[startup+1722.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/178 19657
/proc/meminfo: memFree=28737808/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=525640 CPUtime=1721.87 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 131211 0 0 0 172106 81 0 0 20 0 1 0 338955479 538255360 130680 33554432000 134512640 135840783 4287369152 4287368512 134550878 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 131410 130680 347 325 0 130346 0
Current children cumulated CPU time (s) 1721.87
Current children cumulated vsize (KiB) 525640

[startup+1782.3 s]
/proc/loadavg: 1.92 1.98 1.99 3/177 19696
/proc/meminfo: memFree=29979200/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=532584 CPUtime=1781.86 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 132946 0 0 0 178104 82 0 0 20 0 1 0 338955479 545366016 132415 33554432000 134512640 135840783 4287369152 4287368512 134550902 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 133146 132415 347 325 0 132082 0
Current children cumulated CPU time (s) 1781.86
Current children cumulated vsize (KiB) 532584



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 1.94 1.98 1.99 3/177 19696
/proc/meminfo: memFree=29955828/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=538000 CPUtime=1800.06 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 134310 0 0 0 179924 82 0 0 20 0 1 0 338955479 550912000 133779 33554432000 134512640 135840783 4287369152 4287368512 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 134500 133779 347 325 0 133436 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 538000

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 1.94 1.98 1.99 3/177 19696
/proc/meminfo: memFree=29955828/32873648 swapFree=6860/6860
[pid=19616] ppid=19614 vsize=538000 CPUtime=1800.06 cores=1,3,5,7
/proc/19616/stat : 19616 (bsolo3.0.17) R 19614 19616 18429 0 -1 4202496 134310 0 0 0 179924 82 0 0 20 0 1 0 338955479 550912000 133779 33554432000 134512640 135840783 4287369152 4287368512 134551330 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/19616/statm: 134500 133779 347 325 0 133436 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 538000

Child status: 15
Real time (s): 1800.51
CPU time (s): 1800.08
CPU user time (s): 1799.25
CPU system time (s): 0.829873
CPU usage (%): 99.9759
Max. virtual memory (cumulated for all children) (KiB): 538000

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.25
system time used= 0.829873
maximum resident set size= 535116
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 134313
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 221
involuntary context switches= 1847

runsolver used 4.90925 second user time and 7.9148 second system time

The end

Launcher Data 

Begin job on node124 at 2012-06-03 14:58:16
IDJOB=3737852
IDBENCH=48331
IDSOLVER=2318
FILE ID=node124/3737852-1338728296
RUNJOBID= node124-1338713740-18446
PBS_JOBID= 14636741
Free space on /tmp= 70704 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB07/normalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/manquinho/dbsg/normalized-dbsg_200_10_2_40.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3737852-1338728296/watcher-3737852-1338728296 -o /tmp/evaluation-result-3737852-1338728296/solver-3737852-1338728296 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3737852-1338728296.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ae994079f65819ac107e4a3e259224ff
RANDOM SEED=2075616578

node124.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5357.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.325
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5385.03
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30420856 kB
Buffers:          200024 kB
Cached:          1377960 kB
SwapCached:         8268 kB
Active:           499064 kB
Inactive:        1183108 kB
Active(anon):      98436 kB
Inactive(anon):     8240 kB
Active(file):     400628 kB
Inactive(file):  1174868 kB
Unevictable:        6860 kB
Mlocked:            6860 kB
SwapTotal:      67108856 kB
SwapFree:       67091596 kB
Dirty:             13448 kB
Writeback:             8 kB
AnonPages:        103288 kB
Mapped:            10448 kB
Shmem:                 0 kB
Slab:             630156 kB
SReclaimable:      74472 kB
SUnreclaim:       555684 kB
KernelStack:        1456 kB
PageTables:         4260 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     219148 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70696 MiB
End job on node124 at 2012-06-03 15:28:19