Trace number 1726883

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
tts tts-5-0? (MO) 383.398 383.689

General information on the benchmark

Namecrafted/Hard/contest04/others/
equilarge_l2.sat05-519.reshuffled-07.cnf
MD5SUM5344c68d1511d70cde59fef7dc46c3a5
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4487
Number of clauses18555
Sum of the clauses size54310
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21355
Number of clauses of size 317200
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.01/0.03	c Command: HOME/tts-5-0 HOME/instance-1726883-1240718079.cnf 
0.01/0.03	c Using SATTIMEOUT of 1200
0.01/0.03	c Using SATRAM of 1800
0.01/0.03	c Size of subset node = 16
0.01/0.03	c Variables = 4487
0.01/0.03	c Clauses = 18555
0.01/0.03	c Literals = 54310
0.01/0.03	c Reduced size:
0.01/0.03	c Variables = 4487
0.01/0.03	c Clauses = 18555
0.01/0.03	c Literals = 54310
0.01/0.03	c a2
0.09/0.10	c a1
0.29/0.40	c Independent sub-problems = 1
0.29/0.40	c Sub-problem with 4487 variables and 18555 clauses
0.29/0.40	c using permutation method 4
0.29/0.40	c count = 1
0.29/0.40	c Ordering finished 0.380 seconds
0.29/0.40	c mapped 0.390 seconds
0.29/0.40	c permuted 0.390 seconds
0.29/0.40	c about to sort
0.39/0.40	c sorted
0.49/0.56	c clauses now 18555
0.49/0.56	c init finished 0.410 seconds
0.49/0.56	c tree built 0.560 seconds
0.49/0.56	c 
0.49/0.56	c PA progress                      | CPU progress Partial assignments | improvements      CPU time        PA/sec        nodes
0.49/0.56	c ---------------------------------|----------------------------------|------------------------------------------------------
0.49/0.56	c ................................ | ..........                       |                        0.6           0.0             
0.49/0.56	c ................................ | ..........                     1 |                        0.6           1.8             
0.49/0.56	c ................................ | ..........                     2 |                        0.6           3.6             
0.49/0.56	c ................................ | ..........                     3 |                        0.6           5.4             
0.49/0.56	c ................................ | ..........                     4 |                        0.6           7.1             
0.49/0.56	c ................................ | ..........                     5 |                        0.6           8.9             
0.49/0.56	c ................................ | ..........                  1000 | 5                      0.6        1785.7          850
23.98/24.06	c ................................ | ..........                681000 | 78771                 24.1       28304.2     11319503
47.98/48.01	c ................................ | ..........                970000 | 113520                48.0       20208.3     18498486
71.97/72.04	c ................................ | ..........               1290000 | 154258                72.0       17909.2     27377213
95.97/96.08	c ................................ | ..........               1564000 | 186921                96.1       16281.5     34852559
119.96/120.07	c ................................ | *.........               1806000 | 217726               120.0       15043.7     42230357
144.05/144.10	c ................................ | *.........               2048000 | 250041               144.1       14215.3     50548575
167.94/168.09	c ................................ | *.........               2327000 | 285812               168.1       13846.2     59281897
192.03/192.11	c ................................ | *.........               2553000 | 314273               192.1       13292.0     66169656
216.02/216.12	c ................................ | *.........               2713000 | 331874               216.1       12555.0     70895376
240.02/240.19	c ................................ | **........               2900000 | 355778               240.2       12075.8     76831558
264.02/264.14	c ................................ | **........               3064000 | 376710               264.1       11601.7     82349882
287.90/288.07	c ................................ | **........               3225000 | 397517               288.0       11197.1     87795330
311.97/312.12	c ................................ | **........               3400000 | 419992               312.0       10896.0     93908193
335.97/336.23	c ................................ | **........               3611000 | 446626               336.1       10745.4    100955386
359.91/360.25	c ................................ | ***.......               3830000 | 472292               360.0       10638.0    107959242

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-1726883-1240718079/watcher-1726883-1240718079 -o /tmp/evaluation-result-1726883-1240718079/solver-1726883-1240718079 -C 1200 -W 1800 -M 1800 --output-limit 1,15 HOME/tts-5-0 HOME/instance-1726883-1240718079.cnf 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 20720
/proc/meminfo: memFree=1499008/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=1008 CPUtime=0
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 126 0 0 0 0 0 0 0 18 0 1 0 99840745 1032192 110 1992294400 134512640 135191068 4294956224 18446744073709551615 134693975 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 252 110 67 165 0 85 0

[startup+0.0189319 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 20720
/proc/meminfo: memFree=1499008/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=1404 CPUtime=0.01
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 248 0 0 0 1 0 0 0 18 0 1 0 99840745 1437696 232 1992294400 134512640 135191068 4294956224 18446744073709551615 134694054 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 351 232 68 165 0 184 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 1404

[startup+0.101944 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 20720
/proc/meminfo: memFree=1499008/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=3408 CPUtime=0.09
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 740 0 0 0 9 0 0 0 18 0 1 0 99840745 3489792 723 1992294400 134512640 135191068 4294956224 18446744073709551615 134641816 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 852 723 69 165 0 685 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 3408

[startup+0.301972 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 20720
/proc/meminfo: memFree=1499008/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=4116 CPUtime=0.29
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 925 0 0 0 29 0 0 0 19 0 1 0 99840745 4214784 908 1992294400 134512640 135191068 4294956224 18446744073709551615 134694054 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 1029 908 71 165 0 862 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 4116

[startup+0.701029 s]
/proc/loadavg: 0.92 0.98 0.99 3/64 20720
/proc/meminfo: memFree=1499008/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=11688 CPUtime=0.69
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 2818 0 0 0 68 1 0 0 22 0 1 0 99840745 11968512 2801 1992294400 134512640 135191068 4294956224 18446744073709551615 134546224 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 2922 2801 89 165 0 2755 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 11688

[startup+1.50114 s]
/proc/loadavg: 0.92 0.98 0.99 2/65 20721
/proc/meminfo: memFree=1485176/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=20948 CPUtime=1.49
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 5129 0 0 0 148 1 0 0 25 0 1 0 99840745 21450752 5112 1992294400 134512640 135191068 4294956224 18446744073709551615 134546224 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 5237 5112 89 165 0 5070 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 20948

[startup+3.10137 s]
/proc/loadavg: 0.92 0.98 0.99 2/65 20721
/proc/meminfo: memFree=1471800/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=35672 CPUtime=3.08
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 8812 0 0 0 306 2 0 0 25 0 1 0 99840745 36528128 8795 1992294400 134512640 135191068 4294956224 18446744073709551615 134546224 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 8918 8795 89 165 0 8751 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 35672

[startup+6.30183 s]
/proc/loadavg: 0.93 0.98 0.99 2/65 20721
/proc/meminfo: memFree=1443128/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=63644 CPUtime=6.29
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 15801 0 0 0 623 6 0 0 25 0 1 0 99840745 65171456 15784 1992294400 134512640 135191068 4294956224 18446744073709551615 134562386 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 15911 15784 89 165 0 15744 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 63644

[startup+12.7017 s]
/proc/loadavg: 0.93 0.98 0.99 2/65 20721
/proc/meminfo: memFree=1390968/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=112456 CPUtime=12.69
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 27983 0 0 0 1258 11 0 0 25 0 1 0 99840745 115154944 27966 1992294400 134512640 135191068 4294956224 18446744073709551615 134562386 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 28114 27966 89 165 0 27947 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 112456

[startup+25.5016 s]
/proc/loadavg: 0.95 0.98 0.99 2/65 20721
/proc/meminfo: memFree=1302136/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=197896 CPUtime=25.48
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 49384 0 0 0 2528 20 0 0 25 0 1 0 99840745 202645504 49367 1992294400 134512640 135191068 4294956224 18446744073709551615 134562386 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 49474 49367 89 165 0 49307 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 197896

[startup+51.1012 s]
/proc/loadavg: 0.96 0.98 0.99 2/65 20721
/proc/meminfo: memFree=1175928/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=326028 CPUtime=51.08
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 81375 0 0 0 5077 31 0 0 25 0 1 0 99840745 333852672 81358 1992294400 134512640 135191068 4294956224 18446744073709551615 134562386 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 81507 81358 89 165 0 81340 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 326028

[startup+102.306 s]
/proc/loadavg: 0.98 0.98 0.99 2/65 20721
/proc/meminfo: memFree=902008/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=596908 CPUtime=102.27
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 149137 0 0 0 10167 60 0 0 25 0 1 0 99840745 611233792 149120 1992294400 134512640 135191068 4294956224 18446744073709551615 134546224 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 149227 149120 89 165 0 149060 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 596908

[startup+162.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 20721
/proc/meminfo: memFree=569976/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=931784 CPUtime=162.24
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 232806 0 0 0 16132 92 0 0 25 0 1 0 99840745 954146816 232789 1992294400 134512640 135191068 4294956224 18446744073709551615 134562399 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 232946 232789 89 165 0 232779 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 931784

[startup+222.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 20721
/proc/meminfo: memFree=328440/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=1169544 CPUtime=222.22
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 292268 0 0 0 22106 116 0 0 25 0 1 0 99840745 1197613056 292251 1992294400 134512640 135191068 4294956224 18446744073709551615 134546224 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 292386 292251 89 165 0 292219 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 1169544

[startup+282.301 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 20721
/proc/meminfo: memFree=105144/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=1394504 CPUtime=282.21
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 348502 0 0 0 28081 140 0 0 25 0 1 0 99840745 1427972096 348485 1992294400 134512640 135191068 4294956224 18446744073709551615 134562386 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 348626 348485 89 165 0 348459 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 1394504

[startup+342.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 20721
/proc/meminfo: memFree=14840/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=1658156 CPUtime=342.04
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 414423 0 0 0 34034 170 0 0 25 0 1 0 99840745 1697951744 414406 1992294400 134512640 135191068 4294956224 18446744073709551615 134562399 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 414539 414406 89 165 0 414372 0
Current children cumulated CPU time (s) 342.04
Current children cumulated vsize (KiB) 1658156



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+383.402 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 20727
/proc/meminfo: memFree=14888/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=1843436 CPUtime=383.1
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4194304 460706 0 0 0 38119 191 0 0 25 0 1 0 99840745 1887678464 460689 1992294400 134512640 135191068 4294956224 18446744073709551615 134694768 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 460859 460689 89 165 0 460692 0
Current children cumulated CPU time (s) 383.1
Current children cumulated vsize (KiB) 1843436

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+383.602 s]
/proc/loadavg: 0.99 0.98 0.99 2/65 20727
/proc/meminfo: memFree=14888/2055920 swapFree=4181336/4192956
[pid=20720] ppid=20718 vsize=0 CPUtime=383.3
/proc/20720/stat : 20720 (tts-5-0) R 20718 20720 15745 0 -1 4195332 460706 0 0 0 38119 211 0 0 25 0 1 0 99840745 0 0 1992294400 0 0 0 0 0 0 0 4096 0 0 0 0 17 1 0 0
/proc/20720/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 383.3
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 383.689
CPU time (s): 383.398
CPU user time (s): 381.197
CPU system time (s): 2.20067
CPU usage (%): 99.9241
Max. virtual memory (cumulated for all children) (KiB): 1843436

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 381.197
system time used= 2.20066
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 460706
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 996

runsolver used 0.32295 second user time and 0.814876 second system time

The end

Launcher Data 

Begin job on node29 at 2009-04-26 05:54:39
IDJOB=1726883
IDBENCH=24625
IDSOLVER=505
FILE ID=node29/1726883-1240718079
PBS_JOBID= 9186857
Free space on /tmp= 66420 MiB

SOLVER NAME= tts tts-5-0
BENCH NAME= SAT07/crafted/Hard/contest04/others/equilarge_l2.sat05-519.reshuffled-07.cnf
COMMAND LINE= HOME/tts-5-0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-1726883-1240718079/watcher-1726883-1240718079 -o /tmp/evaluation-result-1726883-1240718079/solver-1726883-1240718079 -C 1200 -W 1800 -M 1800 --output-limit 1,15  HOME/tts-5-0 HOME/instance-1726883-1240718079.cnf

TIME LIMIT= 1200 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 5344c68d1511d70cde59fef7dc46c3a5
RANDOM SEED=960500697

node29.alineos.net Linux 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.281
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.281
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1499432 kB
Buffers:         58532 kB
Cached:         417716 kB
SwapCached:       5940 kB
Active:         216304 kB
Inactive:       268348 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1499432 kB
SwapTotal:     4192956 kB
SwapFree:      4181336 kB
Dirty:            1080 kB
Writeback:           0 kB
Mapped:          13576 kB
Slab:            57800 kB
Committed_AS:   408348 kB
PageTables:       1468 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66420 MiB
End job on node29 at 2009-04-26 06:01:04