Trace number 3730550

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.04 1802.42

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/
normalized-ooo.ex.mem.LsqHdStrong.ucl.opb
MD5SUM3764cf8f4e2d3654f46ab0ec56ea8581
Bench CategoryDEC-SMALLINT (no optimisation, small integers)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark369.578
Has Objective FunctionNO
SatisfiableNO
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved
Number of variables168111
Total number of constraints487525
Number of constraints which are clauses468727
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints18798
Minimum length of a constraint1
Maximum length of a constraint15
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 130
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 512
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.00	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.00	c type "bsolo -h" for help
0.00/0.00	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.00	c Memory Limit set to 15500 MB
0.00/0.00	c Instance file HOME/instance-3730550-1338681008.opb
0.00/0.00	c File size is 17269096 bytes.
1.39/1.42	c Highest Coefficient sum: 512
1.39/1.42	c Parsing was ok!!
1.39/1.42	c Total parsing time: 1.419 s
1.48/1.55	c Var: 168111 Constr: 487525 468727/0/18798 Lit: 1357905 Watch. Lit: 993882
1.48/1.55	c Obj. Vars: 0 (0 % of total variables)
180.56/180.69	c Pre-processing Time: 180.661 s
180.66/180.70	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
180.66/180.70	c        0 154745   442500  1254728    2   999751  671853      0      0 180.66
180.66/180.70	c Switching off LPR mode.
1800.01/1800.40	c      101 154745   442601  1255618    2  1006148  739039    101      0 181.81
1800.01/1800.40	c      251 154745   442751  1257370    2  1033212  812943    251      1 183.13
1800.01/1800.40	c      477 154745   442977  1264569    2  1031783  894238    477      2 183.76
1800.01/1800.40	c      816 154744   443316  1270307    2  1022469  983662    816      4 186.34
1800.01/1800.40	c     1325 154744   443825  1281664    2  1021326  500000   1325      6 190.83
1800.01/1800.40	c     2088 154744   444588  1301907    2  1018922  550001   2088     10 193.97
1800.01/1800.40	c     3235 154744   445735  1343512    3  1021004  605002   3235     16 200.95
1800.01/1800.40	c     4957 154744   447457  1369839    3  1022955  665503   4957     24 206.13
1800.01/1800.40	c     7541 154744   450041  1456121    3  1028492  732054   7541     35 212.79
1800.01/1800.40	c    11420 154744   453920  1624522    3  1037937  805260  11420     42 271.86
1800.01/1800.40	c    17242 154744   459742  1833625    3  1046070  885787  17242     61 282.42
1800.01/1800.40	c    25979 154744   468479  2359014    5  1063672  974366  25979     83 309.79
1800.01/1800.40	c    39090 154744   481590  3778411    7  1088479  500000  39090     95 410.06
1800.01/1800.40	c    58761 154744   501261  5682928   11  1128489  550001  58761    121 485.14
1800.01/1800.40	c    88272 154744   530772  9025455   17  1187453  605002  88272    137 642.31
1800.01/1800.40	c   132542 154515   575042 15394394   26  1274546  665503 132542    141 935.10
1800.01/1800.40	c Caught signal: 15
1800.01/1800.40	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.01/1800.40	c   16   196948  73603   725968   639448 31180536 196948    109 1800.03
1800.01/1800.40	s UNKNOWN
1800.01/1800.40	c Total time: 1800.03 s

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3730550-1338681008/watcher-3730550-1338681008 -o /tmp/evaluation-result-3730550-1338681008/solver-3730550-1338681008 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3730550-1338681008.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 1.97 3/177 9936
/proc/meminfo: memFree=26384140/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=21560 CPUtime=0 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 485 0 0 0 0 0 0 0 20 0 1 0 334226862 22077440 421 33554432000 134512640 135840783 4287990384 4287989088 1582375 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/9936/statm: 5390 421 333 325 0 109 0

[startup+0.0371161 s]
/proc/loadavg: 2.00 2.00 1.97 3/177 9936
/proc/meminfo: memFree=26384140/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=23216 CPUtime=0.03 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 994 0 0 0 3 0 0 0 20 0 1 0 334226862 23773184 930 33554432000 134512640 135840783 4287990384 4287989072 1582375 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/9936/statm: 5804 930 431 325 0 523 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 23216

[startup+0.100153 s]
/proc/loadavg: 2.00 2.00 1.97 3/177 9936
/proc/meminfo: memFree=26384140/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=26456 CPUtime=0.09 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 1998 0 0 0 9 0 0 0 20 0 1 0 334226862 27090944 1934 33554432000 134512640 135840783 4287990384 4287989088 1582375 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/9936/statm: 6615 1934 620 325 0 1334 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 26456

[startup+0.300158 s]
/proc/loadavg: 2.00 2.00 1.97 3/177 9936
/proc/meminfo: memFree=26384140/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=36784 CPUtime=0.28 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 5215 0 0 0 28 0 0 0 20 0 1 0 334226862 37666816 5032 33554432000 134512640 135840783 4287990384 4287989072 1582375 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/9936/statm: 9196 5033 1213 325 0 3915 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 36784

[startup+0.700155 s]
/proc/loadavg: 2.00 2.00 1.97 3/177 9936
/proc/meminfo: memFree=26384140/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=56872 CPUtime=0.69 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 11532 0 0 0 67 2 0 0 20 0 1 0 334226862 58236928 11143 33554432000 134512640 135840783 4287990384 4287989408 134538926 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/9936/statm: 14218 11143 2360 325 0 8937 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 56872

[startup+1.5002 s]
/proc/loadavg: 2.00 2.00 1.97 3/178 9937
/proc/meminfo: memFree=26333200/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=91456 CPUtime=1.48 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 26516 0 0 0 144 4 0 0 20 0 1 0 334226862 93650944 21500 33554432000 134512640 135840783 4287990384 4287989472 1582375 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/9936/statm: 22864 21504 340 325 0 21800 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 91456

[startup+3.10019 s]
/proc/loadavg: 2.00 2.00 1.97 3/178 9937
/proc/meminfo: memFree=26278144/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=109024 CPUtime=3.09 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 30650 0 0 0 303 6 0 0 20 0 1 0 334226862 111640576 25634 33554432000 134512640 135840783 4287990384 4285972156 2761776 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/9936/statm: 27256 25634 344 325 0 26192 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 109024

[startup+6.30024 s]
/proc/loadavg: 2.00 2.00 1.97 3/178 9937
/proc/meminfo: memFree=26268520/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=109156 CPUtime=6.29 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 30682 0 0 0 623 6 0 0 20 0 1 0 334226862 111775744 25666 33554432000 134512640 135840783 4287990384 4285972016 134550705 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/9936/statm: 27289 25666 344 325 0 26225 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 109156

[startup+12.7002 s]
/proc/loadavg: 2.00 2.00 1.97 3/178 9937
/proc/meminfo: memFree=26249636/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=110080 CPUtime=12.69 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 30920 0 0 0 1263 6 0 0 20 0 1 0 334226862 112721920 25904 33554432000 134512640 135840783 4287990384 4285971792 1579934 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/9936/statm: 27520 25904 344 325 0 26456 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 110080

[startup+25.5066 s]
/proc/loadavg: 2.00 2.00 1.97 3/178 9937
/proc/meminfo: memFree=26220188/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=110080 CPUtime=25.49 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 30920 0 0 0 2543 6 0 0 20 0 1 0 334226862 112721920 25904 33554432000 134512640 135840783 4287990384 4285972156 2761776 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/9936/statm: 27520 25904 344 325 0 26456 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 110080

[startup+51.1002 s]
/proc/loadavg: 2.00 2.00 1.97 3/178 9938
/proc/meminfo: memFree=26152948/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=110080 CPUtime=51.08 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 30921 0 0 0 5101 7 0 0 20 0 1 0 334226862 112721920 25905 33554432000 134512640 135840783 4287990384 4285972128 134583076 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 27520 25905 344 325 0 26456 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 110080

[startup+102.3 s]
/proc/loadavg: 2.04 2.01 1.98 3/177 9938
/proc/meminfo: memFree=26044624/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=111136 CPUtime=102.27 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 31210 0 0 0 10219 8 0 0 20 0 1 0 334226862 113803264 26194 33554432000 134512640 135840783 4287990384 4285972016 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 27784 26194 344 325 0 26720 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 111136

[startup+162.3 s]
/proc/loadavg: 2.01 2.01 1.98 3/177 9938
/proc/meminfo: memFree=25887792/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=111532 CPUtime=162.26 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 31303 0 0 0 16216 10 0 0 20 0 1 0 334226862 114208768 26287 33554432000 134512640 135840783 4287990384 4285972016 134550872 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 27883 26287 344 325 0 26819 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 111532

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9938
/proc/meminfo: memFree=25750056/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=112324 CPUtime=222.26 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 31842 0 0 0 22215 11 0 0 20 0 1 0 334226862 115019776 26497 33554432000 134512640 135840783 4287990384 4287989680 134571866 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 28081 26497 348 325 0 27017 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 112324

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9938
/proc/meminfo: memFree=25625340/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=115888 CPUtime=282.24 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 32720 0 0 0 28213 11 0 0 20 0 1 0 334226862 118669312 27375 33554432000 134512640 135840783 4287990384 4287989884 134551682 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 28972 27375 348 325 0 27908 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 115888

[startup+342.307 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9939
/proc/meminfo: memFree=25515008/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=130540 CPUtime=342.24 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 36387 0 0 0 34211 13 0 0 20 0 1 0 334226862 133672960 31042 33554432000 134512640 135840783 4287990384 4287989744 134550872 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 32635 31042 348 325 0 31571 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 130540

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9939
/proc/meminfo: memFree=25428856/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=142156 CPUtime=402.23 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 39290 0 0 0 40208 15 0 0 20 0 1 0 334226862 145567744 33945 33554432000 134512640 135840783 4287990384 4287989680 134571875 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 35539 33945 348 325 0 34475 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 142156

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9939
/proc/meminfo: memFree=25334896/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=163068 CPUtime=462.21 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 44525 0 0 0 46205 16 0 0 20 0 1 0 334226862 166981632 39180 33554432000 134512640 135840783 4287990384 4287989744 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 40767 39180 348 325 0 39703 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 163068

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9939
/proc/meminfo: memFree=25234608/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=178320 CPUtime=522.2 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 48351 0 0 0 52202 18 0 0 20 0 1 0 334226862 182599680 43006 33554432000 134512640 135840783 4287990384 4287988464 1580352 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 44580 43006 348 325 0 43516 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 178320

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9939
/proc/meminfo: memFree=25143496/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=197124 CPUtime=582.19 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 53048 0 0 0 58198 21 0 0 20 0 1 0 334226862 201854976 47703 33554432000 134512640 135840783 4287990384 4287989736 6170832 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 49281 47703 348 325 0 48217 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 197124

[startup+642.3 s]

################
# More data... #
################

/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 80647 0 0 0 100179 35 0 0 20 0 1 0 334226862 314994688 75302 33554432000 134512640 135840783 4287990384 4287989744 134550779 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 76903 75302 348 325 0 75839 0
Current children cumulated CPU time (s) 1002.14
Current children cumulated vsize (KiB) 307612

[startup+1062.3 s]
/proc/loadavg: 2.03 2.01 1.98 3/177 9967
/proc/meminfo: memFree=24465620/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=313576 CPUtime=1062.12 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 82155 0 0 0 106177 35 0 0 20 0 1 0 334226862 321101824 76810 33554432000 134512640 135840783 4287990384 4287989744 134551646 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 78394 76810 348 325 0 77330 0
Current children cumulated CPU time (s) 1062.12
Current children cumulated vsize (KiB) 313576

[startup+1122.3 s]
/proc/loadavg: 2.01 2.01 1.98 3/177 9967
/proc/meminfo: memFree=24386784/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=329344 CPUtime=1122.11 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 86088 0 0 0 112174 37 0 0 20 0 1 0 334226862 337248256 80743 33554432000 134512640 135840783 4287990384 4287989744 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 82336 80743 348 325 0 81272 0
Current children cumulated CPU time (s) 1122.11
Current children cumulated vsize (KiB) 329344

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9967
/proc/meminfo: memFree=24316132/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=345004 CPUtime=1182.11 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 90017 0 0 0 118172 39 0 0 20 0 1 0 334226862 353284096 84672 33554432000 134512640 135840783 4287990384 4287989744 134550804 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 86251 84672 348 325 0 85187 0
Current children cumulated CPU time (s) 1182.11
Current children cumulated vsize (KiB) 345004

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/178 9970
/proc/meminfo: memFree=24226988/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=367420 CPUtime=1242.1 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 95605 0 0 0 124169 41 0 0 20 0 1 0 334226862 376238080 90260 33554432000 134512640 135840783 4287990384 4287989744 134551048 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 91855 90260 348 325 0 90791 0
Current children cumulated CPU time (s) 1242.1
Current children cumulated vsize (KiB) 367420

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9971
/proc/meminfo: memFree=24139480/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=390240 CPUtime=1302.09 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 101310 0 0 0 130166 43 0 0 20 0 1 0 334226862 399605760 95965 33554432000 134512640 135840783 4287990384 4287989520 1582375 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 97560 95965 348 325 0 96496 0
Current children cumulated CPU time (s) 1302.09
Current children cumulated vsize (KiB) 390240

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9971
/proc/meminfo: memFree=24061888/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=405772 CPUtime=1362.08 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 105198 0 0 0 136164 44 0 0 20 0 1 0 334226862 415510528 99853 33554432000 134512640 135840783 4287990384 4287989520 1579934 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 101443 99853 348 325 0 100379 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 405772

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9971
/proc/meminfo: memFree=23994460/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=415976 CPUtime=1422.07 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 107769 0 0 0 142162 45 0 0 20 0 1 0 334226862 425959424 102424 33554432000 134512640 135840783 4287990384 4287989680 134571853 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 103994 102424 348 325 0 102930 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 415976

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9971
/proc/meminfo: memFree=23926412/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=432188 CPUtime=1482.06 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 111803 0 0 0 148160 46 0 0 20 0 1 0 334226862 442560512 106458 33554432000 134512640 135840783 4287990384 4287988452 1569122 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 108047 106458 348 325 0 106983 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 432188

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 1.98 3/177 9971
/proc/meminfo: memFree=23859108/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=448796 CPUtime=1542.06 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 115967 0 0 0 154157 49 0 0 20 0 1 0 334226862 459567104 110622 33554432000 134512640 135840783 4287990384 4287989744 134551081 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 112199 110622 348 325 0 111135 0
Current children cumulated CPU time (s) 1542.06
Current children cumulated vsize (KiB) 448796

[startup+1602.3 s]
/proc/loadavg: 1.98 2.00 1.98 3/177 10011
/proc/meminfo: memFree=26907524/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=464180 CPUtime=1602.03 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 119822 0 0 0 160153 50 0 0 20 0 1 0 334226862 475320320 114469 33554432000 134512640 135840783 4287990384 4287988116 1568956 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 116045 114469 348 325 0 114981 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 464180

[startup+1662.31 s]
/proc/loadavg: 1.99 2.00 1.98 3/177 10011
/proc/meminfo: memFree=26799084/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=478388 CPUtime=1662 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 123422 0 0 0 166148 52 0 0 20 0 1 0 334226862 489869312 118025 33554432000 134512640 135840783 4287990384 4287988400 1580352 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 119597 118025 348 325 0 118533 0
Current children cumulated CPU time (s) 1662
Current children cumulated vsize (KiB) 478388

[startup+1722.3 s]
/proc/loadavg: 1.99 2.00 1.98 3/177 10011
/proc/meminfo: memFree=26726200/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=489932 CPUtime=1721.96 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 126339 0 0 0 172143 53 0 0 20 0 1 0 334226862 501690368 120902 33554432000 134512640 135840783 4287990384 4287989872 6557676 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 122483 120902 348 325 0 121419 0
Current children cumulated CPU time (s) 1721.96
Current children cumulated vsize (KiB) 489932

[startup+1782.3 s]
/proc/loadavg: 1.99 2.00 1.98 3/177 10011
/proc/meminfo: memFree=26644388/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=504580 CPUtime=1781.93 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 130039 0 0 0 178139 54 0 0 20 0 1 0 334226862 516689920 124563 33554432000 134512640 135840783 4287990384 4287989736 6170796 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 126145 124563 348 325 0 125081 0
Current children cumulated CPU time (s) 1781.93
Current children cumulated vsize (KiB) 504580



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 1.99 2.00 1.98 3/178 10014
/proc/meminfo: memFree=26630536/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=509484 CPUtime=1800.01 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) R 9934 9936 9030 0 -1 4202496 131273 0 0 0 179947 54 0 0 20 0 1 0 334226862 521711616 125783 33554432000 134512640 135840783 4287990384 4287989744 134550764 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 127371 125783 348 325 0 126307 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 509484

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -9936

Solver just ended. Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 1.99 2.00 1.98 2/179 10015
/proc/meminfo: memFree=26630536/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=509484 CPUtime=1800.02 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) S 9934 9936 9030 0 -1 4202496 131274 0 0 0 179948 54 0 0 20 0 1 0 334226862 521711616 125784 33554432000 134512640 135840783 4287990384 4287987812 2761776 0 16384 4096 16384 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 127371 125784 349 325 0 126307 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 509484

[startup+1802.01 s]
/proc/loadavg: 1.99 2.00 1.98 2/179 10015
/proc/meminfo: memFree=26630404/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=509484 CPUtime=1800.02 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) S 9934 9936 9030 0 -1 4202496 131274 0 0 0 179948 54 0 0 20 0 1 0 334226862 521711616 125784 33554432000 134512640 135840783 4287990384 4287987812 2761776 0 16384 4096 16384 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 127371 125784 349 325 0 126307 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 509484

[startup+1802.4 s]
/proc/loadavg: 1.99 2.00 1.98 2/179 10015
/proc/meminfo: memFree=26630404/32873648 swapFree=6860/6860
[pid=9936] ppid=9934 vsize=509484 CPUtime=1800.02 cores=0,2,4,6
/proc/9936/stat : 9936 (bsolo3.0.17) S 9934 9936 9030 0 -1 4202496 131274 0 0 0 179948 54 0 0 20 0 1 0 334226862 521711616 125784 33554432000 134512640 135840783 4287990384 4287987812 2761776 0 16384 4096 16384 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/9936/statm: 127371 125784 349 325 0 126307 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 509484

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.42
CPU time (s): 1800.04
CPU user time (s): 1799.48
CPU system time (s): 0.558915
CPU usage (%): 99.868
Max. virtual memory (cumulated for all children) (KiB): 509484

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.48
system time used= 0.558915
maximum resident set size= 503136
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 131274
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 154
involuntary context switches= 1941

runsolver used 2.52562 second user time and 7.31989 second system time

The end

Launcher Data

Begin job on node116 at 2012-06-03 01:50:08
IDJOB=3730550
IDBENCH=1447
IDSOLVER=2318
FILE ID=node116/3730550-1338681008
RUNJOBID= node116-1338678620-9049
PBS_JOBID= 14636697
Free space on /tmp= 71016 MiB

SOLVER NAME= PB07: bsolo 3.0.17
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/normalized-ooo.ex.mem.LsqHdStrong.ucl.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3730550-1338681008/watcher-3730550-1338681008 -o /tmp/evaluation-result-3730550-1338681008/solver-3730550-1338681008 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3730550-1338681008.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3764cf8f4e2d3654f46ab0ec56ea8581
RANDOM SEED=156892450

node116.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        26384940 kB
Buffers:          511360 kB
Cached:          4084828 kB
SwapCached:         3028 kB
Active:          3160376 kB
Inactive:        2435460 kB
Active(anon):     989352 kB
Inactive(anon):     8512 kB
Active(file):    2171024 kB
Inactive(file):  2426948 kB
Unevictable:        6860 kB
Mlocked:            6860 kB
SwapTotal:      67108856 kB
SwapFree:       67103480 kB
Dirty:             23352 kB
Writeback:             0 kB
AnonPages:       1000380 kB
Mapped:            13168 kB
Shmem:                68 kB
Slab:             754008 kB
SReclaimable:     198064 kB
SUnreclaim:       555944 kB
KernelStack:        1480 kB
PageTables:         5620 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    1111024 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    342016 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71008 MiB
End job on node116 at 2012-06-03 02:20:11