Trace number 3322341

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg-sat 11.03.02-industrial? (TO) 40000.3 5024.56

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top21.cnf
MD5SUM9fab5edd49fb904ff76ff7abf98e0d14
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark18199.9
Satisfiable
(Un)Satisfiability was proved
Number of variables51138
Number of clauses162526
Sum of the clauses size397144
Maximum clause length2101
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 299113
Number of clauses of size 362300
Number of clauses of size 4230
Number of clauses of size 519
Number of clauses of size over 5863

Solver Data 

0.35/0.67	c INFO: loaded portfolio from HOME/etc/borg-mix+class.industrial.pickle
0.35/0.67	c INFO: solving HOME/instance-3322341-1304349557.cnf
0.35/0.67	c INFO: computing task features
0.83/1.15	c INFO: computed variable-clause graph statistics
0.83/1.16	c INFO: computed clause balance statistics
3.62/3.91	c INFO: computed variable balance statistics
5.62/5.96	c INFO: computed small-clause counts
5.62/5.98	c INFO: computed Horn-clause counts
8.92/9.23	c INFO: computed variable graph statistics
8.92/9.23	c INFO: collected features for HOME/instance-3322341-1304349557.cnf in 8.53 s
8.92/9.25	c INFO: running lingeling-276@0 for 97 with 39991 remaining (b = 0.35)
8.92/9.28	c INFO: running cryptominisat-2.9.0@0 for 485 with 39991 remaining (b = 0.33)
9.02/9.32	c INFO: running lingeling-276@0 for 1261 with 39991 remaining (b = 0.47)
9.02/9.35	c INFO: running cryptominisat-2.9.0@0 for 1649 with 39991 remaining (b = 0.50)
9.02/9.38	c INFO: running lingeling-276@0 for 1261 with 39991 remaining (b = 0.40)
9.12/9.41	c INFO: running SApperloT@0 for 97 with 39991 remaining (b = 0.03)
9.12/9.44	c INFO: running precosat-570@0 for 388 with 39991 remaining (b = 0.19)
9.12/9.48	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39991 remaining (b = 0.45)
808.50/109.43	c INFO: running lingeling-276@0 for 1164 with 39891 remaining (b = 0.29)
809.28/109.60	c INFO: running lingeling-276@0 for 97 with 39891 remaining (b = 0.09)
1609.30/209.77	c INFO: running cryptominisat-2.9.0@0 for 1940 with 39790 remaining (b = 0.39)
3152.54/403.08	c INFO: running precosat-570@0 for 2134 with 39597 remaining (b = 0.37)
3938.13/501.49	c INFO: running precosat-570@0 for 388 with 39499 remaining (b = 0.16)
7088.34/896.06	c INFO: running precosat-570@392 for 388 with 39104 remaining (b = 0.14)
10106.16/1274.01	c INFO: running lingeling-276@99 for 97 with 38726 remaining (b = 0.04)
10114.15/1275.06	c INFO: running precosat-570@0 for 97 with 38725 remaining (b = 0.06)
10190.78/1284.65	c INFO: running lingeling-276@100 for 194 with 38716 remaining (b = 0.06)
10258.62/1293.14	c INFO: running lingeling-276@0 for 1164 with 38707 remaining (b = 0.21)
10874.16/1370.22	c INFO: running lingeling-276@0 for 1164 with 38630 remaining (b = 0.22)
10906.07/1374.25	c INFO: running lingeling-276@0 for 1261 with 38626 remaining (b = 0.23)
11733.95/1477.97	c INFO: running precosat-570@386 for 97 with 38522 remaining (b = 0.03)
12510.03/1575.15	c INFO: running cryptominisat-2.9.0@0 for 97 with 38425 remaining (b = 0.03)
13216.45/1663.70	c INFO: running cryptominisat-2.9.0@0 for 388 with 38337 remaining (b = 0.07)
13306.64/1674.93	c INFO: running cryptominisat-2.9.0@1650 for 291 with 38325 remaining (b = 0.09)
15529.88/1953.49	c INFO: running precosat-570@0 for 97 with 38047 remaining (b = 0.03)
15641.49/1967.47	c INFO: running precosat-570@483 for 388 with 38033 remaining (b = 0.08)
16281.81/2047.76	c INFO: running precosat-570@1557 for 97 with 37952 remaining (b = 0.02)
16314.51/2051.83	c INFO: running precosat-570@290 for 97 with 37948 remaining (b = 0.02)
17048.92/2143.96	c INFO: running SApperloT@0 for 97 with 37856 remaining (b = 0.01)
17121.43/2153.06	c INFO: running cryptominisat-2.9.0@0 for 97 with 37847 remaining (b = 0.02)
17187.56/2161.31	c INFO: running cryptominisat-2.9.0@390 for 1552 with 37839 remaining (b = 0.21)
17847.78/2244.20	c INFO: running precosat-570@1655 for 582 with 37756 remaining (b = 0.08)
17909.18/2251.82	c INFO: running precosat-570@387 for 97 with 37748 remaining (b = 0.02)
18684.16/2349.06	c INFO: running lingeling-276@0 for 1261 with 37651 remaining (b = 0.16)
18779.85/2361.09	c INFO: running cryptominisat-2.9.0@1940 for 291 with 37639 remaining (b = 0.04)
19553.32/2458.02	c INFO: running lingeling-276@95 for 1164 with 37542 remaining (b = 0.13)
20207.10/2540.08	c INFO: running lingeling-276@0 for 1261 with 37460 remaining (b = 0.14)
20373.73/2560.96	c INFO: running cryptominisat-2.9.0@0 for 97 with 37439 remaining (b = 0.01)
20990.02/2638.21	c INFO: running cryptominisat-2.9.0@0 for 1843 with 37362 remaining (b = 0.18)
21143.95/2657.60	c INFO: running cryptominisat-2.9.0@3105 for 194 with 37343 remaining (b = 0.03)
21159.86/2659.58	c INFO: running cryptominisat-2.9.0@1263 for 97 with 37341 remaining (b = 0.02)
21933.32/2756.63	c INFO: running cryptominisat-2.9.0@1359 for 97 with 37244 remaining (b = 0.02)
22502.63/2828.11	c INFO: running precosat-570@491 for 291 with 37172 remaining (b = 0.05)
22648.47/2846.34	c INFO: running cryptominisat-2.9.0@3203 for 97 with 37154 remaining (b = 0.02)
22721.83/2855.59	c INFO: running precosat-570@0 for 97 with 37145 remaining (b = 0.01)
23432.84/2944.80	c INFO: running precosat-570@866 for 485 with 37055 remaining (b = 0.07)
23513.29/2954.86	c INFO: running precosat-570@484 for 388 with 37045 remaining (b = 0.05)
24859.12/3123.63	c INFO: running precosat-570@679 for 97 with 36877 remaining (b = 0.02)
25618.06/3218.85	c INFO: running precosat-570@774 for 97 with 36781 remaining (b = 0.02)
26424.77/3320.08	c INFO: running precosat-570@875 for 388 with 36680 remaining (b = 0.05)
26589.04/3340.64	c INFO: running precosat-570@98 for 194 with 36660 remaining (b = 0.03)
27314.52/3431.69	c INFO: running precosat-570@965 for 388 with 36569 remaining (b = 0.05)
28130.98/3534.01	c INFO: running precosat-570@583 for 97 with 36466 remaining (b = 0.01)
28753.64/3612.14	c INFO: running glucose@0 for 194 with 36388 remaining (b = 0.03)
28830.95/3621.89	c INFO: running precosat-570@0 for 97 with 36378 remaining (b = 0.01)
28937.64/3635.25	c INFO: running precosat-570@1845 for 388 with 36365 remaining (b = 0.05)
29530.89/3709.74	c INFO: running precosat-570@1259 for 97 with 36291 remaining (b = 0.01)
29611.33/3719.89	c INFO: running precosat-570@1753 for 485 with 36280 remaining (b = 0.05)
29621.65/3721.16	c INFO: running lingeling-276@393 for 873 with 36279 remaining (b = 0.08)
30289.06/3804.97	c INFO: running precosat-570@2815 for 194 with 36195 remaining (b = 0.02)
30302.55/3806.68	c INFO: running glucose@1162 for 97 with 36194 remaining (b = 0.03)
30411.71/3820.40	c INFO: running precosat-570@1158 for 97 with 36180 remaining (b = 0.02)
30562.13/3839.26	c INFO: running lingeling-276@1164 for 97 with 36161 remaining (b = 0.01)
31109.25/3907.91	c INFO: running glucose@1550 for 97 with 36092 remaining (b = 0.02)
31170.53/3915.62	c INFO: running precosat-570@100 for 97 with 36085 remaining (b = 0.01)
31368.06/3940.50	c INFO: running SApperloT@0 for 485 with 36060 remaining (b = 0.05)
31867.35/4003.14	c INFO: running glucose@1644 for 97 with 35997 remaining (b = 0.02)
31908.76/4008.36	c INFO: running precosat-570@3009 for 97 with 35992 remaining (b = 0.01)
31944.61/4012.85	c INFO: running cryptominisat-2.9.0@491 for 1455 with 35987 remaining (b = 0.13)
32033.71/4024.06	c INFO: running lingeling-276@97 for 1164 with 35976 remaining (b = 0.10)
32666.81/4103.59	c INFO: running glucose@0 for 194 with 35897 remaining (b = 0.02)
32673.18/4104.38	c INFO: running glucose@1840 for 97 with 35896 remaining (b = 0.01)
33432.07/4199.61	c INFO: running glucose@1935 for 291 with 35801 remaining (b = 0.03)
33488.61/4206.75	c INFO: running precosat-570@201 for 194 with 35794 remaining (b = 0.02)
34230.89/4299.99	c INFO: running glucose@99 for 97 with 35700 remaining (b = 0.01)
35028.78/4400.13	c INFO: running precosat-570@0 for 97 with 35600 remaining (b = 0.01)
35037.53/4401.23	c INFO: running precosat-570@3106 for 97 with 35599 remaining (b = 0.01)
35253.32/4428.34	c INFO: running precosat-570@1852 for 388 with 35572 remaining (b = 0.04)
35688.15/4482.92	c INFO: running cryptominisat-2.9.0@295 for 1649 with 35517 remaining (b = 0.14)
35769.32/4493.13	c INFO: running cryptominisat-2.9.0@100 for 1843 with 35507 remaining (b = 0.14)
35811.55/4498.47	c INFO: running cryptominisat-2.9.0@98 for 1843 with 35502 remaining (b = 0.14)
35826.65/4500.38	c INFO: running cryptominisat-2.9.0@0 for 97 with 35500 remaining (b = 0.01)
36616.61/4599.57	c INFO: running lingeling-276@488 for 776 with 35401 remaining (b = 0.07)
36651.63/4603.99	c INFO: running cryptominisat-2.9.0@877 for 1067 with 35396 remaining (b = 0.10)
38372.51/4820.04	c INFO: running glucose@2421 for 97 with 35180 remaining (b = 0.01)
39146.57/4917.30	c INFO: running lingeling-276@1365 for 97 with 35083 remaining (b = 0.01)
39921.38/5014.55	c INFO: running glucose@292 for 388 with 34986 remaining (b = 0.04)
40000.32/5024.53	c INFO: running precosat-570@3694 for 291 with 34976 remaining (b = 0.03)
40000.32/5024.53	Traceback (most recent call last):
40000.32/5024.53	  File "HOME/solve", line 33, in <module>
40000.32/5024.53	    plac.call(main)
40000.32/5024.53	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 311, in call
40000.32/5024.53	    cmd, result = parser_from(obj).consume(arglist)
40000.32/5024.53	  File "/home/evaluation/evaluation/tools64/lib/python2.7/site-packages/plac-0.8.1-py2.7.egg/plac_core.py", line 192, in consume
40000.32/5024.53	    return cmd, self.func(*(args + varargs + extraopts), **kwargs)
40000.32/5024.53	  File "HOME/borg/build/lib/borg/tools/solve.py", line 84, in main
40000.32/5024.53	    (_, answer, _) = solver(input_path, budget, cores)
40000.32/5024.53	  File "HOME/borg/build/lib/borg/bilevel.py", line 202, in __call__
40000.32/5024.53	    solver.go(max_cost * borg.defaults.machine_speed)
40000.32/5024.53	  File "HOME/borg/build/lib/borg/solvers.py", line 179, in go
40000.32/5024.53	    self._process.start()
40000.32/5024.53	  File "/home/evaluation/evaluation/tools64/lib/python2.7/multiprocessing/process.py", line 94, in start
40000.32/5024.53	    assert self._popen is None, 'cannot start a process twice'
40000.32/5024.53	AssertionError: cannot start a process twice

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

Sorry, but this trace is too large and cannot be obtained.

Launcher Data 

Begin job on node123 at 2011-05-02 17:19:18
IDJOB=3322341
IDBENCH=83115
IDSOLVER=1710
FILE ID=node123/3322341-1304349557
RUNJOBID= node123-1304349154-10314
PBS_JOBID= 13178671
Free space on /tmp= 73696 MiB

SOLVER NAME= borg-sat 11.03.02-industrial
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top21.cnf
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.industrial.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT -cores NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322341-1304349557/watcher-3322341-1304349557 -o /tmp/evaluation-result-3322341-1304349557/solver-3322341-1304349557 -C 40000 -W 5100 -M 31000  python HOME/solve HOME/etc/borg-mix+class.industrial.pickle HOME/instance-3322341-1304349557.cnf -seed 1786410091 -budget 40000 -cores 8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 9fab5edd49fb904ff76ff7abf98e0d14
RANDOM SEED=1786410091

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29885756 kB
Buffers:         73036 kB
Cached:         774144 kB
SwapCached:      16212 kB
Active:         222572 kB
Inactive:      2625116 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29885756 kB
SwapTotal:    67111528 kB
SwapFree:     66698988 kB
Dirty:           34572 kB
Writeback:           0 kB
AnonPages:     1992108 kB
Mapped:          16360 kB
Slab:           144816 kB
PageTables:      10580 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  2690252 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73664 MiB
End job on node123 at 2011-05-02 18:43:04