Trace number 1724372

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
VARSAT-industrial 2009-03-22UNSAT 77.1013 77.129

General information on the benchmark

Namemanol-pipe-c9.cnf
MD5SUM7f47eb2c5986b40772da3e38cf0759b1
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2.54061
Satisfiable
(Un)Satisfiability was proved
Number of variables15214
Number of clauses45082
Sum of the clauses size105190
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 230054
Number of clauses of size 315027
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Number of variables:  15214                                                |
0.00/0.00	c |  Number of clauses:    45082                                                |
0.00/0.06	c |  Parsing time:         0.05         s                                       |
0.00/0.06	c |  Timeout:              43200 s
0.00/0.06	c |  Random Seed:          287990455.000000
0.00/0.06	c |  Heuristic:            EMBP-G, threshold 0.950                              |
0.00/0.06	c |  Branching Rule:       default (solution-guided)                            |
0.00/0.06	c |  Learned clauses in surveys?  Using NO learned clauses.                     |
0.00/0.06	c |                                                                             |
0.29/0.35	c ============================[ Search Statistics ]==============================
0.29/0.35	c | Conflicts |          ORIGINAL         |          LEARNT          | Progress |
0.29/0.35	c |           |    Vars  Clauses Literals |    Limit  Clauses Lit/Cl |          |
0.29/0.35	c ===============================================================================
0.29/0.35	c |         0 |    3049    18773    72635 |     6257        0    nan |  0.000 % |
0.39/0.44	c |       100 |    3048    18773    72635 |     6883       99     10 |  0.039 % |
0.49/0.52	c |       250 |    3043    18773    72635 |     7571      248      9 |  0.204 % |
0.59/0.61	c |       475 |    2556    18773    72635 |     8328      470     11 |  3.806 % |
0.79/0.81	c |       813 |    2556    18773    72635 |     9161      808     12 |  3.806 % |
0.99/1.06	c |      1320 |    2468    13610    53452 |    10078     1287     13 |  3.825 % |
1.29/1.31	c |      2079 |    2467    13610    53452 |    11085     2045     15 |  3.832 % |
1.49/1.58	c |      3220 |    2467    13598    53402 |    12194     3183     19 |  3.832 % |
1.99/2.01	c |      4929 |    2467    13598    53402 |    13413     4892     25 |  3.832 % |
2.49/2.52	c |      7495 |    2467    13598    53402 |    14755     7458     31 |  3.832 % |
3.19/3.23	c |     11339 |    2467    13598    53402 |    16230    11302     37 |  3.832 % |
4.39/4.46	c |     17106 |    2467    13598    53402 |    17853    17069     41 |  3.832 % |
6.39/6.45	c |     25755 |    2466    13588    53340 |    19639    16143     42 |  3.839 % |
9.18/9.29	c |     38729 |    2456    13457    52802 |    21603    18770     39 |  3.904 % |
12.49/12.52	c |     58191 |    2456    13457    52802 |    23763    15262     25 |  3.904 % |
18.99/19.01	c |     87383 |    2447    13422    52699 |    26139    19574     30 |  3.963 % |
30.79/30.89	c |    131172 |    2446    13415    52679 |    28753    21900     22 |  3.970 % |
45.77/45.87	c |    196856 |    2443    13394    52603 |    31629    22575     27 |  3.990 % |
66.66/66.76	c |    295382 |    2359    12680    49941 |    34792    17514     22 |  4.542 % |
77.07/77.12	c ===============================================================================
77.07/77.12	c surveys--CPU time (sec)   : 3.0775         (3.99 % of total)
77.07/77.12	c surveys--attempted        : 101            (33 /sec)
77.07/77.12	c surveys--converged        : 101            (100.00 % successful)
77.07/77.12	c restarts              : 19
77.07/77.12	c conflicts             : 343213         (4639 /sec)
77.07/77.12	c decisions             : 758418         (1.27 % random) (10252 /sec)
77.07/77.12	c propagations          : 44928397       (607331 /sec)
77.07/77.12	c conflict literals     : 9671353        (42.75 % deleted)
77.07/77.12	c Memory used           : 22.89 MB
77.07/77.12	c Total CPU time (sec)      : 77.0543     
77.07/77.12	c 
77.07/77.12	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1724372-1240694649/watcher-1724372-1240694649 -o /tmp/evaluation-result-1724372-1240694649/solver-1724372-1240694649 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/varsat-industrial_static -seed=287990455 HOME/instance-1724372-1240694649.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 29651
/proc/meminfo: memFree=1672064/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=3152 CPUtime=0
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 564 0 0 0 0 0 0 0 18 0 1 0 97493341 3227648 549 1992294400 4194304 5102648 548682068784 18446744073709551615 4516103 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 788 549 87 221 0 564 0

[startup+0.0979719 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 29651
/proc/meminfo: memFree=1672064/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=12100 CPUtime=0.09
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 2668 0 0 0 8 1 0 0 18 0 1 0 97493341 12390400 2653 1992294400 4194304 5102648 548682068784 18446744073709551615 4491703 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 3025 2654 100 221 0 2801 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12100

[startup+0.101972 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 29651
/proc/meminfo: memFree=1672064/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=12232 CPUtime=0.09
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 2714 0 0 0 8 1 0 0 18 0 1 0 97493341 12525568 2699 1992294400 4194304 5102648 548682068784 18446744073709551615 4491703 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 3058 2699 100 221 0 2834 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12232

[startup+0.30201 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 29651
/proc/meminfo: memFree=1672064/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=18352 CPUtime=0.29
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 4194 0 0 0 27 2 0 0 19 0 1 0 97493341 18792448 4179 1992294400 4194304 5102648 548682068784 18446744073709551615 4266490 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 4588 4179 100 221 0 4364 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 18352

[startup+0.701086 s]
/proc/loadavg: 1.00 1.00 1.00 3/64 29651
/proc/meminfo: memFree=1672064/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=16896 CPUtime=0.69
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 4241 0 0 0 67 2 0 0 23 0 1 0 97493341 17301504 3918 1992294400 4194304 5102648 548682068784 18446744073709551615 4215200 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 4224 3918 115 221 0 4000 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 16896

[startup+1.50124 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1656568/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=16896 CPUtime=1.49
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 4241 0 0 0 147 2 0 0 25 0 1 0 97493341 17301504 3918 1992294400 4194304 5102648 548682068784 18446744073709551615 4249797 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 4224 3918 115 221 0 4000 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 16896

[startup+3.10154 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1656440/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=16896 CPUtime=3.09
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 4246 0 0 0 307 2 0 0 25 0 1 0 97493341 17301504 3923 1992294400 4194304 5102648 548682068784 18446744073709551615 4249732 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 4224 3923 115 221 0 4000 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 16896

[startup+6.30116 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1655096/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=18624 CPUtime=6.29
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 4664 0 0 0 627 2 0 0 25 0 1 0 97493341 19070976 4341 1992294400 4194304 5102648 548682068784 18446744073709551615 4249744 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 4656 4341 115 221 0 4432 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 18624

[startup+12.7014 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1653880/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=19572 CPUtime=12.69
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 4906 0 0 0 1266 3 0 0 25 0 1 0 97493341 20041728 4583 1992294400 4194304 5102648 548682068784 18446744073709551615 4215244 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 4893 4583 115 221 0 4669 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 19572

[startup+25.5018 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1652600/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=21056 CPUtime=25.48
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 5224 0 0 0 2545 3 0 0 25 0 1 0 97493341 21561344 4901 1992294400 4194304 5102648 548682068784 18446744073709551615 4250370 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 5264 4901 115 221 0 5040 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 21056

[startup+51.1017 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1651384/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=22404 CPUtime=51.07
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 5552 0 0 0 5104 3 0 0 25 0 1 0 97493341 22941696 5229 1992294400 4194304 5102648 548682068784 18446744073709551615 4249744 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 5601 5229 115 221 0 5377 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 22404

Solver just ended. Dumping a history of the last processes samples

[startup+63.9011 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1650616/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=23108 CPUtime=63.86
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 5716 0 0 0 6383 3 0 0 25 0 1 0 97493341 23662592 5393 1992294400 4194304 5102648 548682068784 18446744073709551615 4249744 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 5777 5393 115 221 0 5553 0
Current children cumulated CPU time (s) 63.86
Current children cumulated vsize (KiB) 23108

[startup+70.3014 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1650616/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=23108 CPUtime=70.27
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 5721 0 0 0 7023 4 0 0 25 0 1 0 97493341 23662592 5398 1992294400 4194304 5102648 548682068784 18446744073709551615 4249783 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 5777 5398 115 221 0 5553 0
Current children cumulated CPU time (s) 70.27
Current children cumulated vsize (KiB) 23108

[startup+73.502 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1650552/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=23108 CPUtime=73.47
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 5725 0 0 0 7343 4 0 0 25 0 1 0 97493341 23662592 5402 1992294400 4194304 5102648 548682068784 18446744073709551615 4249884 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 5777 5402 115 221 0 5553 0
Current children cumulated CPU time (s) 73.47
Current children cumulated vsize (KiB) 23108

[startup+75.1013 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1650552/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=23108 CPUtime=75.07
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 5739 0 0 0 7503 4 0 0 25 0 1 0 97493341 23662592 5416 1992294400 4194304 5102648 548682068784 18446744073709551615 4249744 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 5777 5416 115 221 0 5553 0
Current children cumulated CPU time (s) 75.07
Current children cumulated vsize (KiB) 23108

[startup+75.9054 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1650360/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=23272 CPUtime=75.87
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 5782 0 0 0 7583 4 0 0 25 0 1 0 97493341 23830528 5459 1992294400 4194304 5102648 548682068784 18446744073709551615 4249744 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 5818 5459 115 221 0 5594 0
Current children cumulated CPU time (s) 75.87
Current children cumulated vsize (KiB) 23272

[startup+76.7016 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1650360/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=23440 CPUtime=76.67
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 5795 0 0 0 7663 4 0 0 25 0 1 0 97493341 24002560 5472 1992294400 4194304 5102648 548682068784 18446744073709551615 4250291 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 5860 5472 115 221 0 5636 0
Current children cumulated CPU time (s) 76.67
Current children cumulated vsize (KiB) 23440

[startup+77.1017 s]
/proc/loadavg: 1.00 1.00 1.00 2/65 29652
/proc/meminfo: memFree=1650296/2055920 swapFree=4192812/4192956
[pid=29651] ppid=29649 vsize=23440 CPUtime=77.07
/proc/29651/stat : 29651 (varsat-industri) R 29649 29651 29495 0 -1 4194304 5795 0 0 0 7703 4 0 0 25 0 1 0 97493341 24002560 5472 1992294400 4194304 5102648 548682068784 18446744073709551615 4249744 0 0 4096 3 0 0 0 17 1 0 0
/proc/29651/statm: 5860 5472 115 221 0 5636 0
Current children cumulated CPU time (s) 77.07
Current children cumulated vsize (KiB) 23440

Child status: 20
Real time (s): 77.129
CPU time (s): 77.1013
CPU user time (s): 77.0543
CPU system time (s): 0.046992
CPU usage (%): 99.9641
Max. virtual memory (cumulated for all children) (KiB): 23440

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 77.0543
system time used= 0.046992
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5800
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 153

runsolver used 0.050992 second user time and 0.186971 second system time

The end

Launcher Data 

Begin job on node38 at 2009-04-25 23:24:09
IDJOB=1724372
IDBENCH=71771
IDSOLVER=538
FILE ID=node38/1724372-1240694649
PBS_JOBID= 9186774
Free space on /tmp= 66360 MiB

SOLVER NAME= VARSAT-industrial 2009-03-22
BENCH NAME= SAT_RACE06/manol-pipe-c9.cnf
COMMAND LINE= HOME/varsat-industrial_static -seed=RANDOMSEED BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1724372-1240694649/watcher-1724372-1240694649 -o /tmp/evaluation-result-1724372-1240694649/solver-1724372-1240694649 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/varsat-industrial_static -seed=287990455 HOME/instance-1724372-1240694649.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 7f47eb2c5986b40772da3e38cf0759b1
RANDOM SEED=287990455

node38.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.265
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1672480 kB
Buffers:         37412 kB
Cached:         268656 kB
SwapCached:          0 kB
Active:          90668 kB
Inactive:       229316 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1672480 kB
SwapTotal:     4192956 kB
SwapFree:      4192812 kB
Dirty:            1688 kB
Writeback:           0 kB
Mapped:          23636 kB
Slab:            49420 kB
Committed_AS:   474876 kB
PageTables:       1456 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66356 MiB
End job on node38 at 2009-04-25 23:25:26