Trace number 3729094

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB07: bsolo 3.0.17? (TO) 1800.04 1800.41

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/
prestwich/armies/normalized-army13.24ls.opb
MD5SUM1a4510076d9024b805728ffe22c0d108
Bench CategoryDEC-SMALLINT (no optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark48.1337
Has Objective FunctionNO
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved NO
Number of variables490
Total number of constraints737
Number of constraints which are clauses397
Number of constraints which are cardinality constraints (but not clauses)2
Number of constraints which are nor clauses,nor cardinality constraints338
Minimum length of a constraint2
Maximum length of a constraint169
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 24
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 193
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.04	c bsolo beta version 3.0.17 - 27/04/2007 : 1600 GMT
0.00/0.04	c Developed by Vasco Manquinho IST/UTL - INESC-ID
0.00/0.04	c type "bsolo -h" for help
0.00/0.04	c Time Limit set via environment variable PBTIMEOUT to 1800
0.00/0.04	c Memory Limit set to 15500 MB
0.00/0.04	c Instance file HOME/instance-3729094-1338678628.opb
0.00/0.04	c File size is 37027 bytes.
0.00/0.04	c Highest Coefficient sum: 193
0.00/0.04	c Parsing was ok!!
0.00/0.04	c Total parsing time: 0.004 s
0.00/0.04	c Var: 490 Constr: 737 397/2/338 Lit: 4022 Watch. Lit: 2534
0.00/0.04	c Obj. Vars: 0 (0 % of total variables)
0.00/0.05	c Pre-processing Time: 0.012 s
0.00/0.05	c    Confl   Vars     Ctrs     Lits  LPC   W.Lits     Max Learnt Conf/s Time
0.00/0.05	c        0    482      725     3990    5     2502    5492      0      0 0.01
0.00/0.05	c Switching off LPR mode.
1800.04/1800.40	c      102    482      827    30536   36     2706    6042    102   4434 0.02
1800.04/1800.40	c      257    482      982    69223   70     3016    6647    257   5976 0.04
1800.04/1800.40	c      491    482     1216   130678  107     3484    7312    491   5845 0.08
1800.04/1800.40	c      830    482     1555   219068  140     4162    8044    830   5724 0.14
1800.04/1800.40	c     1338    482     2063   343363  166     5178    8849   1338   5920 0.23
1800.04/1800.40	c     2108    482     2833   540721  190     6718    9734   2108   5791 0.36
1800.04/1800.40	c     3254    482     3979   821575  206     9010   10708   3254   5273 0.62
1800.04/1800.40	c     4979    482     5704  1220939  214    12460   11779   4979   3740 1.33
1800.04/1800.40	c     7563    482     8288  1852768  223    17628   12957   7563   2564 2.95
1800.04/1800.40	c    11443    482    12168  2847428  234    25388   14253  11443   2111 5.42
1800.04/1800.40	c    17267    482    10631  2410021  226    22314   15679   9906   1567 11.01
1800.04/1800.40	c    26004    482    11218  2563434  228    23488   17247  10493   1147 22.66
1800.04/1800.40	c    39115    482    15358  3542534  230    31768   18972  14633    929 42.09
1800.04/1800.40	c    58786    482    15383  3540038  230    31818   20870  14658    802 73.27
1800.04/1800.40	c    88296    482    12520  2906569  232    26092   22958  11795    708 124.59
1800.04/1800.40	c   132567    482    19359  4663428  240    39770   25254  18634    620 213.82
1800.04/1800.40	c   198979    482    12522  2970772  237    26096   27780  11797    563 353.16
1800.04/1800.40	c   298602    482    26617  6603378  248    54286   30559  25892    509 585.94
1800.04/1800.40	c   448042    482    18073  4337469  239    37198   33615  17348    447 1001.76
1800.04/1800.40	c   672207    482    14606  3506855  240    30264   36977  13881    422 1589.39
1800.04/1800.40	c Caught signal: 15
1800.04/1800.40	c  Rst    Confl    NCB      Dec     Ctrs     Lits Learnt Conf/s Time
1800.04/1800.40	c   20   758459 126686  1656989    23311  5483475  22586    421 1800.04
1800.04/1800.40	s UNKNOWN
1800.04/1800.40	c Total time: 1800.04 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3729094-1338678628/watcher-3729094-1338678628 -o /tmp/evaluation-result-3729094-1338678628/solver-3729094-1338678628 -C 1800 -W 1900 -M 15500 bsolo3.0.17 -m15500 HOME/instance-3729094-1338678628.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.07 0.30 1.00 4/175 24703
/proc/meminfo: memFree=28215412/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=2428 CPUtime=0 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) D 24701 24703 24661 0 -1 4194304 77 0 0 0 0 0 0 0 20 0 1 0 333991464 2486272 31 33554432000 134512640 135840783 4289095264 4289093256 9740535 0 0 4096 0 18446744071579943789 0 0 17 5 0 0 0 0 0
/proc/24703/statm: 607 31 24 325 0 25 0

[startup+0.012887 s]
/proc/loadavg: 0.07 0.30 1.00 4/175 24703
/proc/meminfo: memFree=28215412/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=2660 CPUtime=0 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) D 24701 24703 24661 0 -1 4194304 94 0 2 0 0 0 0 0 20 0 1 0 333991464 2723840 48 33554432000 134512640 135840783 4289095264 4289093300 9737156 0 0 4096 0 18446744072100588836 0 0 17 5 0 0 0 0 0
/proc/24703/statm: 665 48 37 325 0 32 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 2660

[startup+0.100199 s]
/proc/loadavg: 0.07 0.30 1.00 4/175 24703
/proc/meminfo: memFree=28215412/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=5996 CPUtime=0.06 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 842 0 3 0 6 0 0 0 20 0 1 0 333991464 6139904 771 33554432000 134512640 135840783 4289095264 4289090944 10249511 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 1499 771 347 325 0 435 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 5996

[startup+0.300181 s]
/proc/loadavg: 0.07 0.30 1.00 4/175 24703
/proc/meminfo: memFree=28215412/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=9984 CPUtime=0.25 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 1817 0 3 0 25 0 0 0 20 0 1 0 333991464 10223616 1746 33554432000 134512640 135840783 4289095264 4289090976 10249511 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 2496 1746 347 325 0 1432 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 9984

[startup+0.700186 s]
/proc/loadavg: 0.07 0.30 1.00 4/175 24703
/proc/meminfo: memFree=28215412/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=15904 CPUtime=0.65 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 3292 0 3 0 65 0 0 0 20 0 1 0 333991464 16285696 3221 33554432000 134512640 135840783 4289095264 4289094624 134551106 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 3976 3221 347 325 0 2912 0
Current children cumulated CPU time (s) 0.65
Current children cumulated vsize (KiB) 15904

[startup+1.5002 s]
/proc/loadavg: 0.07 0.30 1.00 3/178 24709
/proc/meminfo: memFree=28188604/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=21700 CPUtime=1.45 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 4768 0 3 0 145 0 0 0 20 0 1 0 333991464 22220800 4697 33554432000 134512640 135840783 4289095264 4289094624 134551084 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 5425 4697 347 325 0 4361 0
Current children cumulated CPU time (s) 1.45
Current children cumulated vsize (KiB) 21700

[startup+3.10022 s]
/proc/loadavg: 0.07 0.30 1.00 3/178 24709
/proc/meminfo: memFree=28173344/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=29832 CPUtime=3.06 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 6779 0 3 0 305 1 0 0 20 0 1 0 333991464 30547968 6708 33554432000 134512640 135840783 4289095264 4289094624 134550779 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 7458 6708 347 325 0 6394 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 29832

[startup+6.30029 s]
/proc/loadavg: 0.30 0.35 1.01 3/178 24709
/proc/meminfo: memFree=28142468/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=45668 CPUtime=6.26 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 10757 0 3 0 624 2 0 0 20 0 1 0 333991464 46764032 10686 33554432000 134512640 135840783 4289095264 4289094624 134551048 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 11417 10686 347 325 0 10353 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 45668

[startup+12.7003 s]
/proc/loadavg: 0.44 0.37 1.02 3/178 24709
/proc/meminfo: memFree=28124736/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=51680 CPUtime=12.65 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 12247 0 3 0 1263 2 0 0 20 0 1 0 333991464 52920320 12176 33554432000 134512640 135840783 4289095264 4289094576 134550902 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 12920 12176 347 325 0 11856 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 51680

[startup+25.5003 s]
/proc/loadavg: 0.78 0.45 1.03 3/178 24709
/proc/meminfo: memFree=28113948/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=56276 CPUtime=25.45 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 13398 0 3 0 2543 2 0 0 20 0 1 0 333991464 57626624 13327 33554432000 134512640 135840783 4289095264 4289094624 134551324 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 14069 13327 347 325 0 13005 0
Current children cumulated CPU time (s) 25.45
Current children cumulated vsize (KiB) 56276

[startup+51.1003 s]
/proc/loadavg: 1.20 0.58 1.06 3/177 24709
/proc/meminfo: memFree=28096176/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=67004 CPUtime=51.03 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 16101 0 3 0 5100 3 0 0 20 0 1 0 333991464 68612096 16012 33554432000 134512640 135840783 4289095264 4289094576 134551330 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 16751 16012 347 325 0 15687 0
Current children cumulated CPU time (s) 51.03
Current children cumulated vsize (KiB) 67004

[startup+102.307 s]
/proc/loadavg: 1.65 0.79 1.10 3/177 24709
/proc/meminfo: memFree=28081148/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=72660 CPUtime=102.21 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 17534 0 3 0 10217 4 0 0 20 0 1 0 333991464 74403840 17433 33554432000 134512640 135840783 4289095264 4289094624 134550893 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 18165 17433 347 325 0 17101 0
Current children cumulated CPU time (s) 102.21
Current children cumulated vsize (KiB) 72660

[startup+162.3 s]
/proc/loadavg: 1.87 1.01 1.16 3/177 24709
/proc/meminfo: memFree=28066556/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=80792 CPUtime=162.2 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 19566 0 3 0 16215 5 0 0 20 0 1 0 333991464 82731008 19462 33554432000 134512640 135840783 4289095264 4289094576 134550893 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 20198 19462 347 325 0 19134 0
Current children cumulated CPU time (s) 162.2
Current children cumulated vsize (KiB) 80792

[startup+222.3 s]
/proc/loadavg: 1.95 1.19 1.21 3/177 24709
/proc/meminfo: memFree=28059044/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=81428 CPUtime=222.18 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 19729 0 3 0 22213 5 0 0 20 0 1 0 333991464 83382272 19622 33554432000 134512640 135840783 4289095264 4289094616 15534278 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 20357 19622 347 325 0 19293 0
Current children cumulated CPU time (s) 222.18
Current children cumulated vsize (KiB) 81428

[startup+282.3 s]
/proc/loadavg: 1.98 1.33 1.25 3/177 24710
/proc/meminfo: memFree=28051720/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=88640 CPUtime=282.17 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 21542 0 3 0 28211 6 0 0 20 0 1 0 333991464 90767360 21432 33554432000 134512640 135840783 4289095264 4289094624 134551084 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 22160 21432 347 325 0 21096 0
Current children cumulated CPU time (s) 282.17
Current children cumulated vsize (KiB) 88640

[startup+342.3 s]
/proc/loadavg: 1.99 1.45 1.30 3/177 24710
/proc/meminfo: memFree=28051340/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=89000 CPUtime=342.16 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 21627 0 3 0 34210 6 0 0 20 0 1 0 333991464 91136000 21517 33554432000 134512640 135840783 4289095264 4289094624 134550878 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 22250 21517 347 325 0 21186 0
Current children cumulated CPU time (s) 342.16
Current children cumulated vsize (KiB) 89000

[startup+402.3 s]
/proc/loadavg: 1.99 1.55 1.34 3/177 24710
/proc/meminfo: memFree=28042464/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=97588 CPUtime=402.15 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 23784 0 3 0 40208 7 0 0 20 0 1 0 333991464 99930112 23669 33554432000 134512640 135840783 4289095264 4289094624 134550893 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 24397 23669 347 325 0 23333 0
Current children cumulated CPU time (s) 402.15
Current children cumulated vsize (KiB) 97588

[startup+462.3 s]
/proc/loadavg: 2.05 1.64 1.38 3/177 24710
/proc/meminfo: memFree=28038616/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=98952 CPUtime=462.14 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 24122 0 3 0 46207 7 0 0 20 0 1 0 333991464 101326848 24007 33554432000 134512640 135840783 4289095264 4289094624 134551538 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 24738 24007 347 325 0 23674 0
Current children cumulated CPU time (s) 462.14
Current children cumulated vsize (KiB) 98952

[startup+522.3 s]
/proc/loadavg: 2.06 1.72 1.42 3/177 24710
/proc/meminfo: memFree=28038120/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=97584 CPUtime=522.13 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 24122 0 3 0 52206 7 0 0 20 0 1 0 333991464 99926016 23670 33554432000 134512640 135840783 4289095264 4289094624 134550764 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 24396 23670 347 325 0 23332 0
Current children cumulated CPU time (s) 522.13
Current children cumulated vsize (KiB) 97584

[startup+582.3 s]
/proc/loadavg: 2.02 1.77 1.46 3/177 24713
/proc/meminfo: memFree=28033952/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=98348 CPUtime=582.12 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 24308 0 3 0 58205 7 0 0 20 0 1 0 333991464 100708352 23856 33554432000 134512640 135840783 4289095264 4289094624 134550878 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 24587 23856 347 325 0 23523 0
Current children cumulated CPU time (s) 582.12
Current children cumulated vsize (KiB) 98348

[startup+642.3 s]

################
# More data... #
################

[startup+822.3 s]
/proc/loadavg: 2.00 1.89 1.57 3/177 24714
/proc/meminfo: memFree=28020308/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=108180 CPUtime=822.09 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 26806 0 3 0 82200 9 0 0 20 0 1 0 333991464 110776320 26319 33554432000 134512640 135840783 4289095264 4289094624 134551058 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 27045 26319 347 325 0 25981 0
Current children cumulated CPU time (s) 822.09
Current children cumulated vsize (KiB) 108180

[startup+882.3 s]
/proc/loadavg: 2.00 1.91 1.59 3/177 24714
/proc/meminfo: memFree=28020556/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=108180 CPUtime=882.08 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 26806 0 3 0 88199 9 0 0 20 0 1 0 333991464 110776320 26319 33554432000 134512640 135840783 4289095264 4289094624 134550910 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 27045 26319 347 325 0 25981 0
Current children cumulated CPU time (s) 882.08
Current children cumulated vsize (KiB) 108180

[startup+942.3 s]
/proc/loadavg: 2.00 1.92 1.62 3/177 24715
/proc/meminfo: memFree=28012620/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=108176 CPUtime=942.07 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 26806 0 3 0 94198 9 0 0 20 0 1 0 333991464 110772224 26318 33554432000 134512640 135840783 4289095264 4289094572 134520568 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 27044 26318 347 325 0 25980 0
Current children cumulated CPU time (s) 942.07
Current children cumulated vsize (KiB) 108176

[startup+1002.3 s]
/proc/loadavg: 2.00 1.93 1.64 3/177 24715
/proc/meminfo: memFree=28012736/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=108148 CPUtime=1002.06 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 26806 0 3 0 100197 9 0 0 20 0 1 0 333991464 110743552 26311 33554432000 134512640 135840783 4289095264 4289094624 134550902 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 27037 26311 347 325 0 25973 0
Current children cumulated CPU time (s) 1002.06
Current children cumulated vsize (KiB) 108148

[startup+1062.3 s]
/proc/loadavg: 2.00 1.94 1.66 3/177 24715
/proc/meminfo: memFree=28004052/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=116912 CPUtime=1062.05 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 29019 0 3 0 106195 10 0 0 20 0 1 0 333991464 119717888 28488 33554432000 134512640 135840783 4289095264 4289094624 134551330 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 29228 28488 347 325 0 28164 0
Current children cumulated CPU time (s) 1062.05
Current children cumulated vsize (KiB) 116912

[startup+1122.3 s]
/proc/loadavg: 2.00 1.95 1.67 3/177 24715
/proc/meminfo: memFree=28004176/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=116912 CPUtime=1122.04 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 29019 0 3 0 112194 10 0 0 20 0 1 0 333991464 119717888 28488 33554432000 134512640 135840783 4289095264 4289094576 134550761 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 29228 28488 347 325 0 28164 0
Current children cumulated CPU time (s) 1122.04
Current children cumulated vsize (KiB) 116912

[startup+1182.3 s]
/proc/loadavg: 2.00 1.95 1.69 3/178 24718
/proc/meminfo: memFree=28002424/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=118932 CPUtime=1182.03 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 29506 0 3 0 118193 10 0 0 20 0 1 0 333991464 121786368 28975 33554432000 134512640 135840783 4289095264 4289094624 134551330 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 29733 28975 347 325 0 28669 0
Current children cumulated CPU time (s) 1182.03
Current children cumulated vsize (KiB) 118932

[startup+1242.3 s]
/proc/loadavg: 2.00 1.96 1.71 3/177 24719
/proc/meminfo: memFree=28003056/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=117064 CPUtime=1242.02 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 29508 0 3 0 124192 10 0 0 20 0 1 0 333991464 119873536 28540 33554432000 134512640 135840783 4289095264 4289094576 134550804 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 29266 28540 347 325 0 28202 0
Current children cumulated CPU time (s) 1242.02
Current children cumulated vsize (KiB) 117064

[startup+1302.3 s]
/proc/loadavg: 2.00 1.97 1.73 3/177 24719
/proc/meminfo: memFree=28003056/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=117064 CPUtime=1302.01 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 29508 0 3 0 130191 10 0 0 20 0 1 0 333991464 119873536 28540 33554432000 134512640 135840783 4289095264 4289094624 134550804 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 29266 28540 347 325 0 28202 0
Current children cumulated CPU time (s) 1302.01
Current children cumulated vsize (KiB) 117064

[startup+1362.3 s]
/proc/loadavg: 2.00 1.97 1.74 3/177 24719
/proc/meminfo: memFree=27999024/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=121424 CPUtime=1361.99 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 30567 0 3 0 136189 10 0 0 20 0 1 0 333991464 124338176 29598 33554432000 134512640 135840783 4289095264 4289094624 134551104 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 30356 29598 347 325 0 29292 0
Current children cumulated CPU time (s) 1361.99
Current children cumulated vsize (KiB) 121424

[startup+1422.31 s]
/proc/loadavg: 2.00 1.97 1.75 3/177 24719
/proc/meminfo: memFree=27999644/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=121036 CPUtime=1421.99 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 30567 0 3 0 142189 10 0 0 20 0 1 0 333991464 123940864 29533 33554432000 134512640 135840783 4289095264 4289094624 134551646 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 30259 29533 347 325 0 29195 0
Current children cumulated CPU time (s) 1421.99
Current children cumulated vsize (KiB) 121036

[startup+1482.3 s]
/proc/loadavg: 2.00 1.97 1.76 3/177 24719
/proc/meminfo: memFree=27999580/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=121036 CPUtime=1481.97 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 30568 0 3 0 148187 10 0 0 20 0 1 0 333991464 123940864 29533 33554432000 134512640 135840783 4289095264 4289094624 134550764 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 30259 29533 347 325 0 29195 0
Current children cumulated CPU time (s) 1481.97
Current children cumulated vsize (KiB) 121036

[startup+1542.3 s]
/proc/loadavg: 2.00 1.97 1.77 3/177 24720
/proc/meminfo: memFree=27999952/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=121036 CPUtime=1541.96 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 30568 0 3 0 154186 10 0 0 20 0 1 0 333991464 123940864 29533 33554432000 134512640 135840783 4289095264 4289094624 134551104 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 30259 29533 347 325 0 29195 0
Current children cumulated CPU time (s) 1541.96
Current children cumulated vsize (KiB) 121036

[startup+1602.3 s]
/proc/loadavg: 2.00 1.97 1.79 3/177 24720
/proc/meminfo: memFree=27989904/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=121036 CPUtime=1601.95 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 30568 0 3 0 160185 10 0 0 20 0 1 0 333991464 123940864 29533 33554432000 134512640 135840783 4289095264 4289094624 134551175 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 30259 29533 347 325 0 29195 0
Current children cumulated CPU time (s) 1601.95
Current children cumulated vsize (KiB) 121036

[startup+1662.3 s]
/proc/loadavg: 2.00 1.97 1.80 3/177 24720
/proc/meminfo: memFree=27982340/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=128708 CPUtime=1661.95 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 32498 0 3 0 166183 12 0 0 20 0 1 0 333991464 131796992 31426 33554432000 134512640 135840783 4289095264 4289094624 134550910 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 32177 31426 347 325 0 31113 0
Current children cumulated CPU time (s) 1661.95
Current children cumulated vsize (KiB) 128708

[startup+1722.3 s]
/proc/loadavg: 2.00 1.97 1.81 3/177 24720
/proc/meminfo: memFree=27982396/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=128880 CPUtime=1721.94 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 32534 0 3 0 172182 12 0 0 20 0 1 0 333991464 131973120 31462 33554432000 134512640 135840783 4289095264 4289094688 134546112 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 32220 31462 347 325 0 31156 0
Current children cumulated CPU time (s) 1721.94
Current children cumulated vsize (KiB) 128880

[startup+1782.3 s]
/proc/loadavg: 2.00 1.97 1.82 3/178 24723
/proc/meminfo: memFree=27982100/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=128640 CPUtime=1781.93 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 32538 0 3 0 178181 12 0 0 20 0 1 0 333991464 131727360 31434 33554432000 134512640 135840783 4289095264 4289094624 134551104 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 32160 31434 347 325 0 31096 0
Current children cumulated CPU time (s) 1781.93
Current children cumulated vsize (KiB) 128640



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.00 1.97 1.82 3/178 24723
/proc/meminfo: memFree=27982504/32873844 swapFree=7116/7116
[pid=24703] ppid=24701 vsize=128640 CPUtime=1800.04 cores=1,3,5,7
/proc/24703/stat : 24703 (bsolo3.0.17) R 24701 24703 24661 0 -1 4202496 32538 0 3 0 179992 12 0 0 20 0 1 0 333991464 131727360 31434 33554432000 134512640 135840783 4289095264 4289094576 134550779 0 0 4096 16384 0 0 0 17 5 0 0 3 0 0
/proc/24703/statm: 32160 31434 347 325 0 31096 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 128640

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 15
Real time (s): 1800.41
CPU time (s): 1800.04
CPU user time (s): 1799.92
CPU system time (s): 0.121981
CPU usage (%): 99.9797
Max. virtual memory (cumulated for all children) (KiB): 128880

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.92
system time used= 0.121981
maximum resident set size= 125852
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 32541
page faults= 3
swaps= 0
block input operations= 2376
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 77
involuntary context switches= 1848

runsolver used 3.63045 second user time and 9.75652 second system time

The end

Launcher Data 

Begin job on node108 at 2012-06-03 01:10:29
IDJOB=3729094
IDBENCH=1167
IDSOLVER=2318
FILE ID=node108/3729094-1338678628
RUNJOBID= node108-1338678627-24681
PBS_JOBID= 14636705
Free space on /tmp= 71472 MiB

SOLVER NAME= bsolo 3.0.17
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/prestwich/armies/normalized-army13.24ls.opb
COMMAND LINE= bsolo3.0.17 -mMEMLIMIT BENCHNAME            
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3729094-1338678628/watcher-3729094-1338678628 -o /tmp/evaluation-result-3729094-1338678628/solver-3729094-1338678628 -C 1800 -W 1900 -M 15500  bsolo3.0.17 -m15500 HOME/instance-3729094-1338678628.opb            

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1a4510076d9024b805728ffe22c0d108
RANDOM SEED=415870421

node108.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.273
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.273
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.273
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.273
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.273
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.273
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.273
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.273
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28216204 kB
Buffers:          318384 kB
Cached:          3524516 kB
SwapCached:           80 kB
Active:          1888416 kB
Inactive:        1968772 kB
Active(anon):       2160 kB
Inactive(anon):    13064 kB
Active(file):    1886256 kB
Inactive(file):  1955708 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67108548 kB
Dirty:             13228 kB
Writeback:             0 kB
AnonPages:         19544 kB
Mapped:            13512 kB
Shmem:               172 kB
Slab:             662660 kB
SReclaimable:     105000 kB
SUnreclaim:       557660 kB
KernelStack:        1400 kB
PageTables:         3816 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     104276 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71460 MiB
End job on node108 at 2012-06-03 01:40:31