Trace number 3387547

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: minisat_psm 2011-04-01? (TO) 5000.03 4999.93

General information on the benchmark

NameSAT04/industrial/vangelder/
cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf
MD5SUM65c5a1442ec07e466934f093e50229c2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark17.0374
Satisfiable
(Un)Satisfiability was proved
Number of variables6228
Number of clauses484871
Sum of the clauses size3850952
Maximum clause length8
Minimum clause length1
Number of clauses of size 115
Number of clauses of size 24651
Number of clauses of size 31
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5480204

Solver Data 

0.00/0.02	c Parsing...
0.00/0.32	c ==============================================================================
0.00/0.32	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.32	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.32	c ==============================================================================
0.00/0.32	c |         0 |  482594  3828193 |  144778       0        0     nan |  0.000 % |
0.00/0.48	c |         0 |  479096  3790745 |      --       0       --      -- |     --   | -1544/-21985
0.00/0.48	c ==============================================================================
0.00/0.48	c Result  :   #vars: 6212   #clauses: 479096   #literals: 3790745
0.00/0.48	c CPU time:   0.425935 s
0.00/0.48	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3387547-1305605848/watcher-3387547-1305605848 -o /tmp/evaluation-result-3387547-1305605848/solver-3387547-1305605848 -C 5000 -W 5100 -M 15500 ./esg_static.sh HOME/instance-3387547-1305605848.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.93 5.03 5.00 6/558 11342
/proc/meminfo: memFree=20230456/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 328 0 0 0 0 0 0 0 24 0 1 0 672181923 8908800 250 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 250 209 178 0 68 0

[startup+0.0271529 s]
/proc/loadavg: 4.93 5.03 5.00 6/558 11342
/proc/meminfo: memFree=20230456/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 328 0 0 0 0 0 0 0 24 0 1 0 672181923 8908800 250 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101161 s]
/proc/loadavg: 4.93 5.03 5.00 6/558 11342
/proc/meminfo: memFree=20230456/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 328 0 0 0 0 0 0 0 24 0 1 0 672181923 8908800 250 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.301126 s]
/proc/loadavg: 4.93 5.03 5.00 6/558 11342
/proc/meminfo: memFree=20230456/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 328 0 0 0 0 0 0 0 24 0 1 0 672181923 8908800 250 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701047 s]
/proc/loadavg: 4.93 5.03 5.00 6/558 11342
/proc/meminfo: memFree=20230456/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=0 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 328 0 0 0 0 0 0 0 24 0 1 0 672181923 8908800 250 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50084 s]
/proc/loadavg: 4.94 5.03 5.00 6/560 11344
/proc/meminfo: memFree=20158012/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
Current children cumulated CPU time (s) 1.05
Current children cumulated vsize (KiB) 8700

[startup+3.10053 s]
/proc/loadavg: 4.94 5.03 5.00 6/560 11345
/proc/meminfo: memFree=20162972/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=61792 CPUtime=2.01 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 14011 0 0 0 199 2 0 0 25 0 1 0 672182029 63275008 12066 33554432000 4194304 4256717 140736985594896 18446744073709551615 4219127 0 0 4096 8388610 0 0 0 17 7 0 0 0
/proc/11345/statm: 15448 12066 253 16 0 12090 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 70492

[startup+6.30097 s]
/proc/loadavg: 4.94 5.03 5.00 6/560 11345
/proc/meminfo: memFree=20153368/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=93680 CPUtime=5.18 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 49755 0 0 0 512 6 0 0 25 0 1 0 672182029 95928320 18898 33554432000 4194304 4256717 140736985594896 18446744073709551615 4209909 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 23420 18898 253 16 0 20062 0
Current children cumulated CPU time (s) 6.23
Current children cumulated vsize (KiB) 102380

[startup+12.7008 s]
/proc/loadavg: 4.95 5.03 5.00 6/560 11345
/proc/meminfo: memFree=20093504/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=94080 CPUtime=11.57 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 78317 0 0 0 1148 9 0 0 25 0 1 0 672182029 96337920 20172 33554432000 4194304 4256717 140736985594896 18446744073709551615 4242226 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 23520 20172 253 16 0 20162 0
Current children cumulated CPU time (s) 12.62
Current children cumulated vsize (KiB) 102780

[startup+25.5003 s]
/proc/loadavg: 4.96 5.03 5.00 6/560 11345
/proc/meminfo: memFree=20095740/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=143760 CPUtime=24.38 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 136346 0 0 0 2420 18 0 0 25 0 1 0 672182029 147210240 29634 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213416 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 35940 29634 253 16 0 32582 0
Current children cumulated CPU time (s) 25.43
Current children cumulated vsize (KiB) 152460

[startup+51.1004 s]
/proc/loadavg: 5.08 5.05 5.00 6/560 11346
/proc/meminfo: memFree=20083308/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=143760 CPUtime=49.97 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 222184 0 0 0 4968 29 0 0 25 0 1 0 672182029 147210240 31813 33554432000 4194304 4256717 140736985594896 18446744073709551615 4211020 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 35940 31813 253 16 0 32582 0
Current children cumulated CPU time (s) 51.02
Current children cumulated vsize (KiB) 152460

[startup+102.322 s]
/proc/loadavg: 5.09 5.06 5.00 6/560 11347
/proc/meminfo: memFree=20079252/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=175120 CPUtime=101.2 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 398822 0 0 0 10066 54 0 0 25 0 1 0 672182029 179322880 32913 33554432000 4194304 4256717 140736985594896 18446744073709551615 4233419 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 43780 32913 253 16 0 40422 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 183820

[startup+162.301 s]
/proc/loadavg: 5.03 5.05 5.00 6/560 11349
/proc/meminfo: memFree=20062980/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=144300 CPUtime=161.18 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 605206 0 0 0 16034 84 0 0 25 0 1 0 672182029 147763200 30209 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213928 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 36075 30209 253 16 0 32717 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 153000

[startup+222.301 s]
/proc/loadavg: 5.01 5.04 5.00 6/560 11351
/proc/meminfo: memFree=20064212/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=175120 CPUtime=221.18 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 802588 0 0 0 22007 111 0 0 25 0 1 0 672182029 179322880 34450 33554432000 4194304 4256717 140736985594896 18446744073709551615 4233419 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 43780 34450 253 16 0 40422 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 183820

[startup+282.301 s]
/proc/loadavg: 5.00 5.03 5.00 6/560 11352
/proc/meminfo: memFree=20053652/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=175928 CPUtime=281.19 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 958351 0 0 0 27985 134 0 0 25 0 1 0 672182029 180150272 36314 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213652 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 43982 36314 253 16 0 40624 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 184628

[startup+342.301 s]
/proc/loadavg: 5.00 5.02 5.00 6/560 11354
/proc/meminfo: memFree=20045196/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=175928 CPUtime=341.19 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 1132903 0 0 0 33958 161 0 0 25 0 1 0 672182029 180150272 37139 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213692 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 43982 37139 253 16 0 40624 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 184628

[startup+402.301 s]
/proc/loadavg: 5.14 5.06 5.01 6/560 11355
/proc/meminfo: memFree=20064644/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=175928 CPUtime=401.19 cores=1,3,5,7

################
# More data... #
################

/proc/11345/statm: 111036 97919 253 16 0 107678 0
Current children cumulated CPU time (s) 4362.39
Current children cumulated vsize (KiB) 452844

[startup+4422.3 s]
/proc/loadavg: 4.16 4.42 4.73 5/559 11505
/proc/meminfo: memFree=19802880/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=450016 CPUtime=4421.35 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 10291741 0 0 0 440551 1584 0 0 25 0 1 0 672182029 460816384 93445 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213652 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 112504 93445 253 16 0 109146 0
Current children cumulated CPU time (s) 4422.4
Current children cumulated vsize (KiB) 458716

[startup+4482.3 s]
/proc/loadavg: 4.12 4.36 4.69 5/559 11506
/proc/meminfo: memFree=19786220/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=457992 CPUtime=4481.35 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 10328494 0 0 0 446545 1590 0 0 25 0 1 0 672182029 468983808 97431 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213652 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 114498 97431 253 16 0 111140 0
Current children cumulated CPU time (s) 4482.4
Current children cumulated vsize (KiB) 466692

[startup+4542.3 s]
/proc/loadavg: 4.04 4.29 4.64 5/559 11508
/proc/meminfo: memFree=19771276/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=460944 CPUtime=4541.35 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 10360635 0 0 0 452540 1595 0 0 25 0 1 0 672182029 472006656 98088 33554432000 4194304 4256717 140736985594896 18446744073709551615 4211768 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 115236 98088 253 16 0 111878 0
Current children cumulated CPU time (s) 4542.4
Current children cumulated vsize (KiB) 469644

[startup+4602.3 s]
/proc/loadavg: 4.01 4.23 4.60 5/559 11509
/proc/meminfo: memFree=19775204/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=463236 CPUtime=4601.37 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 10391199 0 0 0 458536 1601 0 0 25 0 1 0 672182029 474353664 99946 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213733 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 115809 99946 253 16 0 112451 0
Current children cumulated CPU time (s) 4602.42
Current children cumulated vsize (KiB) 471936

[startup+4662.3 s]
/proc/loadavg: 4.00 4.19 4.56 5/559 11511
/proc/meminfo: memFree=19806308/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=465156 CPUtime=4661.36 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 10427935 0 0 0 464529 1607 0 0 25 0 1 0 672182029 476319744 102586 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 116289 102586 253 16 0 112931 0
Current children cumulated CPU time (s) 4662.41
Current children cumulated vsize (KiB) 473856

[startup+4722.32 s]
/proc/loadavg: 4.00 4.15 4.52 5/559 11513
/proc/meminfo: memFree=19762616/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=468500 CPUtime=4721.38 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 10537430 0 0 0 470516 1622 0 0 25 0 1 0 672182029 479744000 101652 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 117125 101652 253 16 0 113767 0
Current children cumulated CPU time (s) 4722.43
Current children cumulated vsize (KiB) 477200

[startup+4782.3 s]
/proc/loadavg: 4.07 4.15 4.50 5/559 11514
/proc/meminfo: memFree=19786020/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=468500 CPUtime=4781.36 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 10691022 0 0 0 476491 1645 0 0 25 0 1 0 672182029 479744000 96216 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213977 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 117125 96216 253 16 0 113767 0
Current children cumulated CPU time (s) 4782.41
Current children cumulated vsize (KiB) 477200

[startup+4842.3 s]
/proc/loadavg: 3.78 4.07 4.45 4/558 11516
/proc/meminfo: memFree=19776740/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=468500 CPUtime=4841.36 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 10798832 0 0 0 482473 1663 0 0 25 0 1 0 672182029 479744000 100827 33554432000 4194304 4256717 140736985594896 18446744073709551615 4209111 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 117125 100827 253 16 0 113767 0
Current children cumulated CPU time (s) 4842.41
Current children cumulated vsize (KiB) 477200

[startup+4902.3 s]
/proc/loadavg: 3.28 3.87 4.35 4/558 11517
/proc/meminfo: memFree=19786152/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=468500 CPUtime=4901.37 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 10902612 0 0 0 488459 1678 0 0 25 0 1 0 672182029 479744000 98690 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 117125 98690 253 16 0 113767 0
Current children cumulated CPU time (s) 4902.42
Current children cumulated vsize (KiB) 477200

[startup+4962.3 s]
/proc/loadavg: 3.18 3.74 4.28 4/558 11519
/proc/meminfo: memFree=19762204/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=468500 CPUtime=4961.37 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 11011099 0 0 0 494441 1696 0 0 25 0 1 0 672182029 479744000 104547 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213994 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 117125 104547 253 16 0 113767 0
Current children cumulated CPU time (s) 4962.42
Current children cumulated vsize (KiB) 477200



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+4999.9 s]
/proc/loadavg: 3.20 3.68 4.23 4/558 11520
/proc/meminfo: memFree=19812900/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=468752 CPUtime=4998.98 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 11078413 0 0 0 498194 1704 0 0 25 0 1 0 672182029 480002048 101565 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213702 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 117188 101565 253 16 0 113830 0
Current children cumulated CPU time (s) 5000.03
Current children cumulated vsize (KiB) 477452

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+4999.9 s]
/proc/loadavg: 3.20 3.68 4.23 4/558 11520
/proc/meminfo: memFree=19812900/32950928 swapFree=67056568/67111528
[pid=11342] ppid=11340 vsize=8700 CPUtime=1.05 cores=1,3,5,7
/proc/11342/stat : 11342 (esg_static.sh) S 11340 11342 9113 0 -1 4202496 352 13738 0 0 0 0 97 8 18 0 1 0 672181923 8908800 252 33554432000 4194304 4922060 140737297491104 18446744073709551615 239476513925 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/11342/statm: 2175 252 209 178 0 68 0
[pid=11345] ppid=11342 vsize=468752 CPUtime=4998.98 cores=1,3,5,7
/proc/11345/stat : 11345 (minisat_static) R 11342 11342 9113 0 -1 4202496 11078413 0 0 0 498194 1704 0 0 25 0 1 0 672182029 480002048 101565 33554432000 4194304 4256717 140736985594896 18446744073709551615 4213702 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/11345/statm: 117188 101565 253 16 0 113830 0
Current children cumulated CPU time (s) 5000.03
Current children cumulated vsize (KiB) 477452

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11342 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=976851
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=85986
# CPU time returned by wait4() is 1.06284
# while last known CPU time is 5000.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 4999.93
CPU time (s): 5000.03
CPU user time (s): 4982.91
CPU system time (s): 17.12
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 688816

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.976851
system time used= 0.085986
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14090
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 7

runsolver used 25.4361 second user time and 65.712 second system time

The end

Launcher Data 

Begin job on node148 at 2011-05-17 06:17:29
IDJOB=3387547
IDBENCH=84806
IDSOLVER=1874
FILE ID=node148/3387547-1305605848
RUNJOBID= node148-1305600808-10914
PBS_JOBID= 13350330
Free space on /tmp= 72952 MiB

SOLVER NAME= minisat hack: minisat_psm 2011-04-01
BENCH NAME= SAT04/industrial/vangelder/cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3387547-1305605848/watcher-3387547-1305605848 -o /tmp/evaluation-result-3387547-1305605848/solver-3387547-1305605848 -C 5000 -W 5100 -M 15500  ./esg_static.sh HOME/instance-3387547-1305605848.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 65c5a1442ec07e466934f093e50229c2
RANDOM SEED=1257687727

node148.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.854
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20230852 kB
Buffers:        361260 kB
Cached:        4960764 kB
SwapCached:       8488 kB
Active:        9188788 kB
Inactive:      3152692 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20230852 kB
SwapTotal:    67111528 kB
SwapFree:     67056568 kB
Dirty:           21752 kB
Writeback:           0 kB
AnonPages:     7016904 kB
Mapped:          44284 kB
Slab:           249248 kB
PageTables:      58860 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 171699988 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72944 MiB
End job on node148 at 2011-05-17 07:40:51