Trace number 3321941

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-random? (TO) 35783.7 5100.17

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v650-c2769-S1298256564-085.UNKNOWN.cnf
MD5SUMcf48efaad74dd9e258ebbccf8ec047e7
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables650
Number of clauses2769
Sum of the clauses size8307
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32769
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.random.pickle
0.32/0.47	c INFO: solving HOME/instance-3321941-1304369799.cnf
0.32/0.47	c INFO: computing task features
0.32/0.48	c INFO: computed variable-clause graph statistics
0.32/0.48	c INFO: computed clause balance statistics
0.41/0.53	c INFO: computed variable balance statistics
0.41/0.57	c INFO: computed small-clause counts
0.41/0.57	c INFO: computed Horn-clause counts
0.41/0.57	c INFO: computed variable graph statistics
0.41/0.57	c INFO: collected features for HOME/instance-3321941-1304369799.cnf in 0.10 s
0.51/0.61	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.58)
0.51/0.64	c INFO: running march_hi@0 for 194 with 39999 remaining (b = 0.15)
0.51/0.68	c INFO: running gnovelty+2@0 for 97 with 39999 remaining (b = 0.07)
0.60/0.72	c INFO: running march_hi@0 for 679 with 39999 remaining (b = 0.36)
0.60/0.76	c INFO: running march_hi@0 for 679 with 39999 remaining (b = 0.32)
0.71/0.80	c INFO: running march_hi@0 for 679 with 39999 remaining (b = 0.28)
0.71/0.84	c INFO: running march_hi@0 for 485 with 39999 remaining (b = 0.21)
0.71/0.88	c INFO: running kcnfs-2006@0 for 582 with 39999 remaining (b = 0.21)
700.78/100.94	c INFO: running kcnfs-2006@0 for 582 with 39899 remaining (b = 0.19)
1365.47/196.06	c INFO: running march_hi@0 for 485 with 39804 remaining (b = 0.15)
1410.83/202.58	c INFO: running march_hi@0 for 291 with 39797 remaining (b = 0.10)
3486.27/499.87	c INFO: running march_hi@288 for 194 with 39500 remaining (b = 0.07)
4438.39/636.22	c INFO: running adaptg2wsat2009++@0 for 97 with 39364 remaining (b = 0.03)
4756.68/681.81	c INFO: running kcnfs-2006@0 for 582 with 39318 remaining (b = 0.16)
4787.36/686.23	c INFO: running kcnfs-2006@0 for 582 with 39314 remaining (b = 0.14)
4797.11/687.62	c INFO: running march_hi@199 for 194 with 39312 remaining (b = 0.06)
4862.02/696.90	c INFO: running march_hi@776 for 1358 with 39303 remaining (b = 0.44)
5138.41/736.51	c INFO: running march_hi@0 for 291 with 39264 remaining (b = 0.09)
5446.92/780.72	c INFO: running march_hi@0 for 291 with 39219 remaining (b = 0.09)
5707.25/818.02	c INFO: running march_hi@0 for 97 with 39182 remaining (b = 0.03)
5837.13/836.64	c INFO: running march_hi@0 for 291 with 39163 remaining (b = 0.12)
6461.16/926.09	c INFO: running march_hi@584 for 97 with 39074 remaining (b = 0.07)
6752.89/967.90	c INFO: running march_hi@391 for 97 with 39032 remaining (b = 0.05)
7175.95/1028.49	c INFO: running march_hi@584 for 97 with 38972 remaining (b = 0.05)
7639.22/1093.51	c INFO: running march_hi@778 for 582 with 38907 remaining (b = 0.18)
7653.98/1095.67	c INFO: running march_hi@0 for 485 with 38904 remaining (b = 0.14)
7665.93/1097.20	c INFO: running kcnfs-2006@100 for 485 with 38903 remaining (b = 0.12)
8191.06/1170.46	c INFO: running march_hi@98 for 291 with 38830 remaining (b = 0.09)
8291.22/1183.88	c INFO: running kcnfs-2006@97 for 485 with 38816 remaining (b = 0.12)
9093.35/1297.64	c INFO: running kcnfs-2006@487 for 97 with 38702 remaining (b = 0.07)
9643.54/1376.42	c INFO: running kcnfs-2006@682 for 97 with 38624 remaining (b = 0.03)
9751.78/1391.92	c INFO: running march_hi@0 for 388 with 38608 remaining (b = 0.10)
10306.87/1471.49	c INFO: running march_hi@198 for 194 with 38529 remaining (b = 0.06)
10646.36/1519.79	c INFO: running kcnfs-2006@1071 for 291 with 38480 remaining (b = 0.07)
11356.05/1621.40	c INFO: running kcnfs-2006@388 for 194 with 38379 remaining (b = 0.08)
11753.41/1678.02	c INFO: running kcnfs-2006@683 for 97 with 38322 remaining (b = 0.03)
11898.01/1698.71	c INFO: running march_hi@294 for 97 with 38301 remaining (b = 0.04)
11918.34/1701.67	c INFO: running march_hi@1073 for 1067 with 38298 remaining (b = 0.37)
12104.12/1728.20	c INFO: running march_hi@98 for 291 with 38272 remaining (b = 0.08)
12503.15/1785.32	c INFO: running march_hi@677 for 97 with 38215 remaining (b = 0.03)
12883.07/1839.77	c INFO: running march_hi@290 for 194 with 38160 remaining (b = 0.07)
12947.30/1848.96	c INFO: running march_hi@0 for 388 with 38151 remaining (b = 0.09)
13049.94/1863.64	c INFO: running march_hi@684 for 1455 with 38136 remaining (b = 0.38)
13052.04/1863.95	c INFO: running march_hi@878 for 1261 with 38136 remaining (b = 0.33)
13155.43/1878.73	c INFO: running kcnfs-2006@879 for 97 with 38121 remaining (b = 0.03)
13967.22/1994.06	c INFO: running kcnfs-2006@873 for 97 with 38006 remaining (b = 0.03)
14583.89/2082.50	c INFO: running kcnfs-2006@1559 for 388 with 37918 remaining (b = 0.13)
14856.14/2121.42	c INFO: running kcnfs-2006@1072 for 291 with 37879 remaining (b = 0.07)
15059.96/2150.65	c INFO: running march_hi@193 for 194 with 37849 remaining (b = 0.06)
15181.46/2168.06	c INFO: running kcnfs-2006@0 for 582 with 37832 remaining (b = 0.15)
15756.70/2250.53	c INFO: running march_hi@293 for 97 with 37749 remaining (b = 0.04)
16409.98/2344.29	c INFO: running march_hi@387 for 97 with 37656 remaining (b = 0.04)
16450.43/2350.05	c INFO: running march_hi@1556 for 582 with 37650 remaining (b = 0.26)
17029.90/2433.20	c INFO: running kcnfs-2006@0 for 582 with 37567 remaining (b = 0.14)
17098.92/2443.10	c INFO: running march_hi@0 for 388 with 37557 remaining (b = 0.08)
17374.25/2482.56	c INFO: running adaptg2wsat2009++@0 for 97 with 37517 remaining (b = 0.02)
18073.66/2582.88	c INFO: running kcnfs-2006@1657 for 1164 with 37417 remaining (b = 0.26)
20817.21/2976.30	c INFO: running march_hi@1844 for 97 with 37024 remaining (b = 0.08)
20948.35/2995.02	c INFO: running march_hi@1563 for 582 with 37005 remaining (b = 0.25)
21300.79/3042.23	c INFO: running march_hi@1066 for 1164 with 36958 remaining (b = 0.27)
21357.31/3050.32	c INFO: running kcnfs-2006@393 for 194 with 36950 remaining (b = 0.08)
21586.62/3083.30	c INFO: running march_hi@386 for 97 with 36917 remaining (b = 0.02)
21905.10/3128.94	c INFO: running kcnfs-2006@98 for 485 with 36871 remaining (b = 0.11)
22424.37/3203.42	c INFO: running kcnfs-2006@0 for 582 with 36797 remaining (b = 0.12)
22441.15/3205.89	c INFO: running kcnfs-2006@1361 for 1358 with 36794 remaining (b = 0.25)
23178.47/3308.00	c INFO: running kcnfs-2006@490 for 97 with 36692 remaining (b = 0.06)
23718.39/3385.13	c INFO: running march_hi@972 for 1164 with 36615 remaining (b = 0.21)
24139.97/3445.40	c INFO: running kcnfs-2006@1941 for 776 with 36555 remaining (b = 0.16)
25371.09/3621.15	c INFO: running kcnfs-2006@195 for 388 with 36379 remaining (b = 0.11)
25982.36/3705.77	c INFO: running march_hi@1955 for 194 with 36294 remaining (b = 0.06)
26498.86/3779.88	c INFO: running kcnfs-2006@2239 for 485 with 36220 remaining (b = 0.12)
27036.94/3857.02	c INFO: running kcnfs-2006@0 for 582 with 36143 remaining (b = 0.13)
27988.66/3993.28	c INFO: running march_hi@3119 for 1649 with 36007 remaining (b = 0.28)
28490.68/4065.26	c INFO: running kcnfs-2006@773 for 97 with 35935 remaining (b = 0.02)
29574.29/4220.70	c INFO: running kcnfs-2006@0 for 582 with 35779 remaining (b = 0.10)
30022.66/4284.91	c INFO: running march_hi@1649 for 485 with 35715 remaining (b = 0.13)
30093.80/4295.16	c INFO: running adaptg2wsat2009++@99 for 97 with 35705 remaining (b = 0.02)
30620.42/4370.62	c INFO: running kcnfs-2006@2425 for 388 with 35629 remaining (b = 0.13)
30902.76/4410.53	c INFO: running gnovelty+2@0 for 97 with 35590 remaining (b = 0.02)
31643.66/4516.88	c INFO: running kcnfs-2006@0 for 582 with 35483 remaining (b = 0.08)
31866.78/4546.73	c INFO: running kcnfs-2006@196 for 388 with 35453 remaining (b = 0.06)
32726.72/4667.40	c INFO: running march_hi@0 for 388 with 35333 remaining (b = 0.06)
33096.30/4720.56	c INFO: running hybridGM3@0 for 97 with 35279 remaining (b = 0.01)
33767.95/4817.04	c INFO: running kcnfs-2006@2823 for 3007 with 35183 remaining (b = 0.40)
33877.20/4832.79	c INFO: running kcnfs-2006@2521 for 291 with 35167 remaining (b = 0.15)
34297.59/4893.13	c INFO: running kcnfs-2006@1556 for 1164 with 35107 remaining (b = 0.20)
34333.86/4898.40	c INFO: running march_hi@1071 for 1067 with 35102 remaining (b = 0.18)
35023.00/4990.86	c INFO: running kcnfs-2006@1555 for 1164 with 35009 remaining (b = 0.20)
35783.71/5100.15	c INFO: running march_hi@972 for 1164 with 34900 remaining (b = 0.17)
35783.71/5100.15	Traceback (most recent call last):
35783.71/5100.15	  File "HOME/solve", line 33, in <module>
35783.71/5100.15	    plac.call(main)
35783.71/5100.15	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
35783.71/5100.15	    cmd, result = parser_from(obj).consume(arglist)
35783.71/5100.15	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
35783.71/5100.15	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
35783.71/5100.15	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
35783.71/5100.15	    (_, answer, _) = solver(input_path, budget, cores)
35783.71/5100.15	  File "HOME/borg/build/lib/borg/bilevel.py", line 202, in __call__
35783.71/5100.15	    solver.go(max_cost * borg.defaults.machine_speed)
35783.71/5100.15	  File "HOME/borg/build/lib/borg/solvers.py", line 179, in go
35783.71/5100.15	    self._process.start()
35783.71/5100.15	  File "/home/evaluation/evaluation/tools64/lib/python2.7/multiprocessing/process.py", line 94, in start
35783.71/5100.15	    assert self._popen is None, 'cannot start a process twice'
35783.71/5100.15	AssertionError: cannot start a process twice

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

Sorry, but this trace is too large and cannot be obtained.

Launcher Data 

Begin job on node115 at 2011-05-02 22:56:39
IDJOB=3321941
IDBENCH=82719
IDSOLVER=1712
FILE ID=node115/3321941-1304369799
RUNJOBID= node115-1304367627-19013
PBS_JOBID= 13181769
Free space on /tmp= 73492 MiB

SOLVER NAME= borg-sat 11.03.02-random
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v650-c2769-S1298256564-085.UNKNOWN.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.random.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3321941-1304369799/watcher-3321941-1304369799 -o /tmp/evaluation-result-3321941-1304369799/solver-3321941-1304369799 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.random.pickle HOME/instance-3321941-1304369799.cnf -seed 367768468 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= cf48efaad74dd9e258ebbccf8ec047e7
RANDOM SEED=367768468

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23350648 kB
Buffers:        902808 kB
Cached:        2628228 kB
SwapCached:          0 kB
Active:        6092292 kB
Inactive:      3037604 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23350648 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           32244 kB
Writeback:           0 kB
AnonPages:     5599760 kB
Mapped:          24600 kB
Slab:           373632 kB
PageTables:      30196 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 54455128 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73460 MiB
End job on node115 at 2011-05-03 00:21:42