Trace number 3349023

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
minisat hack: minisat_psm 2011-04-01? (TO) 1300.03 1300.02

General information on the benchmark

Nameapplication/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-countbits128-tseitin.cnf
MD5SUM47da9e46b00ffd3e0b0f453a6c3c9f38
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2179.95
Satisfiable
(Un)Satisfiability was proved
Number of variables95810
Number of clauses287045
Sum of the clauses size669769
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2191362
Number of clauses of size 395681
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Parsing...
0.00/0.11	c ==============================================================================
0.00/0.11	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.11	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.11	c ==============================================================================
0.00/0.11	c |         0 |  287043   669767 |   86112       0        0     nan |  0.000 % |
1.69/1.73	c |         0 |  165084   471456 |      --       0       --      -- |     --   | -121957/-198306
1.69/1.73	c ==============================================================================
1.69/1.73	c Result  :   #vars: 35680   #clauses: 165084   #literals: 471456
1.69/1.73	c CPU time:   1.69474 s
1.69/1.73	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3349023-1304971053/watcher-3349023-1304971053 -o /tmp/evaluation-result-3349023-1304971053/solver-3349023-1304971053 -C 2400 -W 1300 -M 7680 ./esg_static.sh HOME/instance-3349023-1304971053.cnf 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.93 1.98 2.91 4/245 28700
/proc/meminfo: memFree=19019280/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=0 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 328 0 0 0 0 0 0 0 23 0 1 0 608706083 8908800 250 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 250 209 178 0 68 0

[startup+0.0877199 s]
/proc/loadavg: 0.93 1.98 2.91 4/245 28700
/proc/meminfo: memFree=19019280/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=0 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 328 0 0 0 0 0 0 0 23 0 1 0 608706083 8908800 250 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100705 s]
/proc/loadavg: 0.93 1.98 2.91 4/245 28700
/proc/meminfo: memFree=19019280/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=0 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 328 0 0 0 0 0 0 0 23 0 1 0 608706083 8908800 250 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300679 s]
/proc/loadavg: 0.93 1.98 2.91 4/245 28700
/proc/meminfo: memFree=19019280/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=0 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 328 0 0 0 0 0 0 0 23 0 1 0 608706083 8908800 250 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700593 s]
/proc/loadavg: 0.93 1.98 2.91 4/245 28700
/proc/meminfo: memFree=19019280/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=0 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 328 0 0 0 0 0 0 0 23 0 1 0 608706083 8908800 250 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50045 s]
/proc/loadavg: 0.93 1.98 2.91 5/255 28745
/proc/meminfo: memFree=18758584/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=0 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 328 0 0 0 0 0 0 0 23 0 1 0 608706083 8908800 250 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 250 209 178 0 68 0
[pid=28701] ppid=28700 vsize=51732 CPUtime=1.49 cores=1,3
/proc/28701/stat : 28701 (SatELite_releas) R 28700 28700 28048 0 -1 4202496 12794 0 0 0 146 3 0 0 25 0 1 0 608706084 52973568 11482 33554432000 134512640 135144242 4288693008 18446744073709551615 134585739 0 0 4096 3 0 0 0 17 1 0 0 0
/proc/28701/statm: 12933 11482 77 155 0 12776 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 60432

[startup+3.10116 s]
/proc/loadavg: 0.93 1.98 2.91 5/255 28747
/proc/meminfo: memFree=18763792/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=28804 CPUtime=1.27 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 6040 0 0 0 126 1 0 0 22 0 1 0 608706266 29495296 3862 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209058 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 7201 3862 253 16 0 3843 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 37504

[startup+6.30057 s]
/proc/loadavg: 1.18 2.01 2.91 5/251 28804
/proc/meminfo: memFree=18913064/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=40504 CPUtime=4.47 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 10629 0 0 0 446 1 0 0 25 0 1 0 608706266 41476096 6403 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209212 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 10126 6404 253 16 0 6768 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 49204

[startup+12.7004 s]
/proc/loadavg: 1.40 2.04 2.92 5/255 28843
/proc/meminfo: memFree=18848608/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=47644 CPUtime=10.86 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 13390 0 0 0 1085 1 0 0 25 0 1 0 608706266 48787456 8685 33554432000 4194304 4256717 140735885894592 18446744073709551615 4213723 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 11911 8685 253 16 0 8553 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 56344

[startup+25.5011 s]
/proc/loadavg: 1.98 2.14 2.93 5/255 28844
/proc/meminfo: memFree=18783064/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=52064 CPUtime=23.67 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 21869 0 0 0 2364 3 0 0 25 0 1 0 608706266 53313536 9052 33554432000 4194304 4256717 140735885894592 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 13016 9052 253 16 0 9658 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 60764

[startup+51.1004 s]
/proc/loadavg: 2.67 2.29 2.96 5/255 28844
/proc/meminfo: memFree=18689592/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=70880 CPUtime=49.27 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 42068 0 0 0 4921 6 0 0 25 0 1 0 608706266 72581120 14085 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209198 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 17720 14085 253 16 0 14362 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 79580

[startup+102.309 s]
/proc/loadavg: 3.42 2.55 3.01 5/255 28846
/proc/meminfo: memFree=18567236/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=139056 CPUtime=100.47 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 61493 0 0 0 10038 9 0 0 25 0 1 0 608706266 142393344 28196 33554432000 4194304 4256717 140735885894592 18446744073709551615 4213452 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 34764 28196 253 16 0 31406 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 147756

[startup+162.301 s]
/proc/loadavg: 3.87 2.84 3.08 5/255 28847
/proc/meminfo: memFree=18567088/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=89736 CPUtime=160.47 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 72391 0 0 0 16036 11 0 0 25 0 1 0 608706266 91889664 19224 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209264 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 22434 19224 253 16 0 19076 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 98436

[startup+222.301 s]
/proc/loadavg: 3.95 3.05 3.14 5/255 28858
/proc/meminfo: memFree=18561804/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=89736 CPUtime=220.47 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 122921 0 0 0 22027 20 0 0 25 0 1 0 608706266 91889664 19224 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209126 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 22434 19224 253 16 0 19076 0
Current children cumulated CPU time (s) 222.28
Current children cumulated vsize (KiB) 98436

[startup+282.301 s]
/proc/loadavg: 4.02 3.23 3.19 5/255 28859
/proc/meminfo: memFree=18519632/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=101408 CPUtime=280.47 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 179516 0 0 0 28019 28 0 0 25 0 1 0 608706266 103841792 20706 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209105 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 25352 20706 253 16 0 21994 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 110108

[startup+342.301 s]
/proc/loadavg: 4.00 3.37 3.24 5/255 28861
/proc/meminfo: memFree=18441592/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=150960 CPUtime=340.48 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 255527 0 0 0 34006 42 0 0 25 0 1 0 608706266 154583040 34530 33554432000 4194304 4256717 140735885894592 18446744073709551615 4213501 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 37740 34530 253 16 0 34382 0
Current children cumulated CPU time (s) 342.29
Current children cumulated vsize (KiB) 159660

[startup+402.301 s]
/proc/loadavg: 4.00 3.48 3.29 5/255 28866
/proc/meminfo: memFree=18451072/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3

################
# More data... #
################

/proc/28747/statm: 37741 33345 253 16 0 34383 0
Current children cumulated CPU time (s) 582.3
Current children cumulated vsize (KiB) 159664

[startup+642.301 s]
/proc/loadavg: 4.00 3.77 3.44 5/255 28872
/proc/meminfo: memFree=18440188/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=150964 CPUtime=640.49 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 661911 0 0 0 63934 115 0 0 25 0 1 0 608706266 154587136 31871 33554432000 4194304 4256717 140735885894592 18446744073709551615 4213416 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 37741 31871 253 16 0 34383 0
Current children cumulated CPU time (s) 642.3
Current children cumulated vsize (KiB) 159664

[startup+702.301 s]
/proc/loadavg: 4.04 3.82 3.48 5/255 28874
/proc/meminfo: memFree=18434332/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=150964 CPUtime=700.49 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 759301 0 0 0 69917 132 0 0 25 0 1 0 608706266 154587136 31884 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209023 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 37741 31884 253 16 0 34383 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 159664

[startup+762.309 s]
/proc/loadavg: 4.01 3.85 3.51 5/255 28875
/proc/meminfo: memFree=18428084/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=150964 CPUtime=760.5 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 874932 0 0 0 75898 152 0 0 25 0 1 0 608706266 154587136 32113 33554432000 4194304 4256717 140735885894592 18446744073709551615 4213369 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 37741 32113 253 16 0 34383 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 159664

[startup+822.301 s]
/proc/loadavg: 4.05 3.89 3.54 5/255 28877
/proc/meminfo: memFree=18417620/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=150964 CPUtime=820.5 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 976374 0 0 0 81880 170 0 0 25 0 1 0 608706266 154587136 30991 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209347 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 37741 30991 253 16 0 34383 0
Current children cumulated CPU time (s) 822.31
Current children cumulated vsize (KiB) 159664

[startup+882.301 s]
/proc/loadavg: 4.02 3.91 3.57 5/255 28878
/proc/meminfo: memFree=18388556/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=181784 CPUtime=880.5 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 1058685 0 0 0 87865 185 0 0 25 0 1 0 608706266 186146816 39297 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209392 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 45446 39297 253 16 0 42088 0
Current children cumulated CPU time (s) 882.31
Current children cumulated vsize (KiB) 190484

[startup+942.301 s]
/proc/loadavg: 4.00 3.92 3.59 5/255 28880
/proc/meminfo: memFree=18408596/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=181784 CPUtime=940.5 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 1164847 0 0 0 93847 203 0 0 25 0 1 0 608706266 186146816 37048 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209048 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 45446 37048 253 16 0 42088 0
Current children cumulated CPU time (s) 942.31
Current children cumulated vsize (KiB) 190484

[startup+1002.3 s]
/proc/loadavg: 4.00 3.93 3.61 5/255 28882
/proc/meminfo: memFree=18380652/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=231872 CPUtime=1000.5 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 1253206 0 0 0 99833 217 0 0 25 0 1 0 608706266 237436928 43175 33554432000 4194304 4256717 140735885894592 18446744073709551615 4213430 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 57968 43175 253 16 0 54610 0
Current children cumulated CPU time (s) 1002.31
Current children cumulated vsize (KiB) 240572

[startup+1062.3 s]
/proc/loadavg: 4.00 3.94 3.64 5/255 28883
/proc/meminfo: memFree=18352588/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=181784 CPUtime=1060.5 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 1346320 0 0 0 105817 233 0 0 25 0 1 0 608706266 186146816 39830 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209204 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 45446 39830 253 16 0 42088 0
Current children cumulated CPU time (s) 1062.31
Current children cumulated vsize (KiB) 190484

[startup+1122.3 s]
/proc/loadavg: 4.00 3.95 3.66 5/255 28885
/proc/meminfo: memFree=18411196/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=181784 CPUtime=1120.5 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 1436817 0 0 0 111800 250 0 0 25 0 1 0 608706266 186146816 35273 33554432000 4194304 4256717 140735885894592 18446744073709551615 4209126 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 45446 35273 253 16 0 42088 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 190484

[startup+1182.3 s]
/proc/loadavg: 4.00 3.95 3.67 5/255 28886
/proc/meminfo: memFree=18412624/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=181784 CPUtime=1180.5 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 1554028 0 0 0 117779 271 0 0 25 0 1 0 608706266 186146816 35954 33554432000 4194304 4256717 140735885894592 18446744073709551615 4233419 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 45446 35954 253 16 0 42088 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 190484

[startup+1242.3 s]
/proc/loadavg: 4.11 3.99 3.70 5/255 28888
/proc/meminfo: memFree=18401660/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=150964 CPUtime=1240.5 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 1629722 0 0 0 123765 285 0 0 25 0 1 0 608706266 154587136 31851 33554432000 4194304 4256717 140735885894592 18446744073709551615 4213356 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 37741 31851 253 16 0 34383 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 159664



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 4.11 4.01 3.72 5/255 28890
/proc/meminfo: memFree=18355612/32951124 swapFree=66522184/67111528
[pid=28700] ppid=28698 vsize=8700 CPUtime=1.81 cores=1,3
/proc/28700/stat : 28700 (esg_static.sh) S 28698 28700 28048 0 -1 4202496 353 13483 0 0 0 0 177 4 18 0 1 0 608706083 8908800 252 33554432000 4194304 4922060 140733224892384 18446744073709551615 222921596037 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28700/statm: 2175 252 209 178 0 68 0
[pid=28747] ppid=28700 vsize=181784 CPUtime=1298.22 cores=1,3
/proc/28747/stat : 28747 (minisat_static) R 28700 28700 28048 0 -1 4202496 1702079 0 0 0 129523 299 0 0 25 0 1 0 608706266 186146816 39632 33554432000 4194304 4256717 140735885894592 18446744073709551615 4211160 0 0 4096 8388610 0 0 0 17 1 0 0 0
/proc/28747/statm: 45446 39632 253 16 0 42088 0
Current children cumulated CPU time (s) 1300.03
Current children cumulated vsize (KiB) 190484

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28700 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=775730
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=47992
# CPU time returned by wait4() is 1.82372
# while last known CPU time is 1300.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.02
CPU time (s): 1300.03
CPU user time (s): 1297
CPU system time (s): 3.03
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 320712

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.77573
system time used= 0.047992
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 13836
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 20

runsolver used 2.79157 second user time and 6.68398 second system time

The end

Launcher Data 

Begin job on node109 at 2011-05-09 21:57:33
IDJOB=3349023
IDBENCH=82462
IDSOLVER=1811
FILE ID=node109/3349023-1304971053
RUNJOBID= node109-1304971053-28671
PBS_JOBID= 13285641
Free space on /tmp= 36896 MiB

SOLVER NAME= minisat hack: minisat_psm 2011-04-01
BENCH NAME= SAT11/application/jarvisalo/smtqfbv-aigs/smtlib-qfbv-aigs-countbits128-tseitin.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3349023-1304971053/watcher-3349023-1304971053 -o /tmp/evaluation-result-3349023-1304971053/solver-3349023-1304971053 -C 2400 -W 1300 -M 7680  ./esg_static.sh HOME/instance-3349023-1304971053.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 47da9e46b00ffd3e0b0f453a6c3c9f38
RANDOM SEED=1180938907

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19019808 kB
Buffers:        157872 kB
Cached:        2642112 kB
SwapCached:      18800 kB
Active:        5916896 kB
Inactive:      7788616 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19019808 kB
SwapTotal:    67111528 kB
SwapFree:     66522184 kB
Dirty:           15564 kB
Writeback:           0 kB
AnonPages:    10892924 kB
Mapped:          18480 kB
Slab:           134280 kB
PageTables:      31540 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 17894088 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 36828 MiB
End job on node109 at 2011-05-09 22:19:15