Trace number 3288291

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
rcl 2011-04-01? (TO) 1300.01 1300.01

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf
MD5SUM7886cd26d6e0801ea382a1ffd6224023
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables192503
Number of clauses564953
Sum of the clauses size1318221
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2376634
Number of clauses of size 3188317
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	c Parsing...
0.00/0.23	c ==============================================================================
0.00/0.23	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.23	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.23	c ==============================================================================
0.00/0.23	c |         0 |  564951  1318219 |  169485       0        0     nan |  0.000 % |
1.29/1.39	c |         0 |  279680   895605 |      --       0       --      -- |     --   | -285269/-422609
1.29/1.39	c ==============================================================================
1.29/1.39	c Result  :   #vars: 57963   #clauses: 279680   #literals: 895605
1.29/1.39	c CPU time:   1.34479 s
1.29/1.39	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3288291-1303768120/watcher-3288291-1303768120 -o /tmp/evaluation-result-3288291-1303768120/solver-3288291-1303768120 -C 2400 -W 1300 -M 7680 ./esg_static.sh HOME/instance-3288291-1303768120.cnf 

running on 2 cores: 4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.81 3.95 4.03 4/188 28103
/proc/meminfo: memFree=13452868/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=0 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) R 28101 28103 27771 0 -1 4202496 312 0 0 0 0 0 0 0 25 0 1 0 469228348 8908800 250 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039475605 0 65538 4100 65536 0 0 0 17 4 0 0 0
/proc/28103/statm: 2175 250 209 178 0 68 0

[startup+0.0894881 s]
/proc/loadavg: 3.81 3.95 4.03 4/188 28103
/proc/meminfo: memFree=13452868/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=0 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 329 0 0 0 0 0 0 0 25 0 1 0 469228348 8908800 250 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/28103/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.10049 s]
/proc/loadavg: 3.81 3.95 4.03 4/188 28103
/proc/meminfo: memFree=13452868/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=0 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 329 0 0 0 0 0 0 0 25 0 1 0 469228348 8908800 250 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/28103/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300465 s]
/proc/loadavg: 3.81 3.95 4.03 4/188 28103
/proc/meminfo: memFree=13452868/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=0 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 329 0 0 0 0 0 0 0 25 0 1 0 469228348 8908800 250 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/28103/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700386 s]
/proc/loadavg: 3.81 3.95 4.03 4/188 28103
/proc/meminfo: memFree=13452868/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=0 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 329 0 0 0 0 0 0 0 25 0 1 0 469228348 8908800 250 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/28103/statm: 2175 250 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50022 s]
/proc/loadavg: 3.81 3.95 4.03 5/194 28112
/proc/meminfo: memFree=13272384/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=0 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 329 0 0 0 0 0 0 0 25 0 1 0 469228348 8908800 250 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/28103/statm: 2175 250 209 178 0 68 0
[pid=28104] ppid=28103 vsize=98600 CPUtime=1.49 cores=4,6
/proc/28104/stat : 28104 (SatELite_releas) R 28103 28103 27771 0 -1 4202496 25314 0 0 0 144 5 0 0 18 0 1 0 469228348 100966400 21663 33554432000 134512640 135144242 4294089728 18446744073709551615 134745630 0 0 4096 3 0 0 0 17 4 0 0 0
/proc/28104/statm: 24650 21663 77 155 0 24493 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 107300

[startup+3.10095 s]
/proc/loadavg: 3.81 3.95 4.03 5/194 28114
/proc/meminfo: memFree=13331280/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=34224 CPUtime=1.52 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 6764 0 0 0 151 1 0 0 24 0 1 0 469228505 35045376 6673 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208549 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 8556 6673 131 6 0 7026 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 42924

[startup+6.30037 s]
/proc/loadavg: 3.90 3.97 4.04 5/194 28114
/proc/meminfo: memFree=13318268/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=35988 CPUtime=4.72 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 7203 0 0 0 471 1 0 0 25 0 1 0 469228505 36851712 7111 33554432000 4194304 4218580 140737249262256 18446744073709551615 4213838 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 8997 7111 131 6 0 7467 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 44688

[startup+12.7012 s]
/proc/loadavg: 3.91 3.97 4.04 5/194 28114
/proc/meminfo: memFree=13309620/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=38856 CPUtime=11.12 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 7943 0 0 0 1111 1 0 0 25 0 1 0 469228505 39788544 7849 33554432000 4194304 4218580 140737249262256 18446744073709551615 4213659 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 9714 7849 131 6 0 8184 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 47556

[startup+25.501 s]
/proc/loadavg: 3.93 3.97 4.04 5/194 28114
/proc/meminfo: memFree=13294016/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=43788 CPUtime=23.92 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 9170 0 0 0 2391 1 0 0 25 0 1 0 469228505 44838912 9073 33554432000 4194304 4218580 140737249262256 18446744073709551615 4213825 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 10947 9073 131 6 0 9417 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 52488

[startup+51.1004 s]
/proc/loadavg: 4.02 3.99 4.04 5/194 28115
/proc/meminfo: memFree=13275652/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=50132 CPUtime=49.52 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 10802 0 0 0 4951 1 0 0 25 0 1 0 469228505 51335168 10654 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208475 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 12533 10654 131 6 0 11003 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 58832

[startup+102.307 s]
/proc/loadavg: 4.01 3.99 4.03 5/194 28116
/proc/meminfo: memFree=13246676/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=64744 CPUtime=100.73 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 14834 0 0 0 10071 2 0 0 25 0 1 0 469228505 66297856 14335 33554432000 4194304 4218580 140737249262256 18446744073709551615 4214068 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 16186 14335 131 6 0 14656 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 73444

[startup+162.3 s]
/proc/loadavg: 4.05 4.00 4.03 5/194 28118
/proc/meminfo: memFree=13223564/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=75828 CPUtime=160.73 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 18155 0 0 0 16070 3 0 0 25 0 1 0 469228505 77647872 17091 33554432000 4194304 4218580 140737249262256 18446744073709551615 4207043 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 18957 17091 131 6 0 17427 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 84528

[startup+222.301 s]
/proc/loadavg: 4.02 4.00 4.03 5/194 28150
/proc/meminfo: memFree=12644976/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=84008 CPUtime=220.73 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 20904 0 0 0 22066 7 0 0 25 0 1 0 469228505 86024192 19144 33554432000 4194304 4218580 140737249262256 18446744073709551615 4213922 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 21002 19144 131 6 0 19472 0
Current children cumulated CPU time (s) 222.28
Current children cumulated vsize (KiB) 92708

[startup+282.301 s]
/proc/loadavg: 4.00 4.00 4.02 5/194 28151
/proc/meminfo: memFree=12618824/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=97408 CPUtime=280.73 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 25193 0 0 0 28064 9 0 0 25 0 1 0 469228505 99745792 22473 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 24352 22473 131 6 0 22822 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 106108

[startup+342.3 s]
/proc/loadavg: 3.92 3.98 4.01 6/194 28190
/proc/meminfo: memFree=13124568/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=105052 CPUtime=340.73 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 27941 0 0 0 34063 10 0 0 25 0 1 0 469228505 107573248 24396 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 26263 24396 131 6 0 24733 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 113752

[startup+402.301 s]
/proc/loadavg: 3.97 3.98 4.00 6/194 28191
/proc/meminfo: memFree=13107036/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6

################
# More data... #
################

/proc/28114/statm: 35670 33808 131 6 0 34140 0
Current children cumulated CPU time (s) 582.29
Current children cumulated vsize (KiB) 151380

[startup+642.301 s]
/proc/loadavg: 4.09 4.03 4.01 6/194 28228
/proc/meminfo: memFree=13077936/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=143564 CPUtime=640.75 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 41926 0 0 0 64060 15 0 0 25 0 1 0 469228505 147009536 34041 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208205 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 35891 34041 131 6 0 34361 0
Current children cumulated CPU time (s) 642.3
Current children cumulated vsize (KiB) 152264

[startup+702.301 s]
/proc/loadavg: 4.03 4.03 4.00 6/194 28229
/proc/meminfo: memFree=13056864/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=153404 CPUtime=700.74 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 45348 0 0 0 70058 16 0 0 25 0 1 0 469228505 157085696 36473 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208761 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 38351 36473 131 6 0 36821 0
Current children cumulated CPU time (s) 702.29
Current children cumulated vsize (KiB) 162104

[startup+762.307 s]
/proc/loadavg: 4.01 4.02 4.00 5/194 28240
/proc/meminfo: memFree=13050976/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=153680 CPUtime=760.75 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 46502 0 0 0 76059 16 0 0 25 0 1 0 469228505 157368320 36567 33554432000 4194304 4218580 140737249262256 18446744073709551615 4213825 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 38420 36567 131 6 0 36890 0
Current children cumulated CPU time (s) 762.3
Current children cumulated vsize (KiB) 162380

[startup+822.301 s]
/proc/loadavg: 4.00 4.01 4.00 6/194 28242
/proc/meminfo: memFree=13038828/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=162284 CPUtime=820.74 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 49607 0 0 0 82057 17 0 0 25 0 1 0 469228505 166178816 38720 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 40571 38720 131 6 0 39041 0
Current children cumulated CPU time (s) 822.29
Current children cumulated vsize (KiB) 170984

[startup+882.301 s]
/proc/loadavg: 4.00 4.01 4.00 6/194 28243
/proc/meminfo: memFree=13031352/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=164216 CPUtime=880.75 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 51017 0 0 0 88057 18 0 0 25 0 1 0 469228505 168157184 39171 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 41054 39171 131 6 0 39524 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 172916

[startup+942.301 s]
/proc/loadavg: 3.47 3.86 3.95 4/187 28263
/proc/meminfo: memFree=13120324/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=178804 CPUtime=940.75 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 55573 0 0 0 94056 19 0 0 25 0 1 0 469228505 183095296 42837 33554432000 4194304 4218580 140737249262256 18446744073709551615 4211709 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 44701 42837 131 6 0 43171 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 187504

[startup+1002.3 s]
/proc/loadavg: 3.17 3.70 3.89 4/187 28264
/proc/meminfo: memFree=13118540/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=178912 CPUtime=1000.75 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 56720 0 0 0 100055 20 0 0 25 0 1 0 469228505 183205888 42860 33554432000 4194304 4218580 140737249262256 18446744073709551615 4213904 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 44728 42860 131 6 0 43198 0
Current children cumulated CPU time (s) 1002.3
Current children cumulated vsize (KiB) 187612

[startup+1062.3 s]
/proc/loadavg: 3.06 3.57 3.83 4/187 28266
/proc/meminfo: memFree=13117156/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=179044 CPUtime=1060.75 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 57650 0 0 0 106054 21 0 0 25 0 1 0 469228505 183341056 42892 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 44761 42892 131 6 0 43231 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 187744

[startup+1122.3 s]
/proc/loadavg: 3.06 3.48 3.78 4/187 28268
/proc/meminfo: memFree=13102616/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=191868 CPUtime=1120.75 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 61828 0 0 0 112053 22 0 0 25 0 1 0 469228505 196472832 46111 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 47967 46111 131 6 0 46437 0
Current children cumulated CPU time (s) 1122.3
Current children cumulated vsize (KiB) 200568

[startup+1182.3 s]
/proc/loadavg: 3.08 3.41 3.73 4/187 28269
/proc/meminfo: memFree=13101968/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=191740 CPUtime=1180.75 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 62843 0 0 0 118052 23 0 0 25 0 1 0 469228505 196341760 46073 33554432000 4194304 4218580 140737249262256 18446744073709551615 4210079 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 47935 46073 131 6 0 46405 0
Current children cumulated CPU time (s) 1182.3
Current children cumulated vsize (KiB) 200440

[startup+1242.3 s]
/proc/loadavg: 3.03 3.33 3.69 4/187 28301
/proc/meminfo: memFree=13167280/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=191740 CPUtime=1240.76 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 63933 0 0 0 124052 24 0 0 25 0 1 0 469228505 196341760 46073 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 47935 46073 131 6 0 46405 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 200440



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 3.01 3.27 3.64 4/187 28332
/proc/meminfo: memFree=13221832/32951124 swapFree=67111528/67111528
[pid=28103] ppid=28101 vsize=8700 CPUtime=1.55 cores=4,6
/proc/28103/stat : 28103 (esg_static.sh) S 28101 28103 27771 0 -1 4202496 354 25315 0 0 0 0 150 5 18 0 1 0 469228348 8908800 253 33554432000 4194304 4922060 140735803339232 18446744073709551615 212039474309 0 65536 4100 65538 18446744071562232103 0 0 17 4 0 0 0
/proc/28103/statm: 2175 253 209 178 0 68 0
[pid=28114] ppid=28103 vsize=197412 CPUtime=1298.46 cores=4,6
/proc/28114/stat : 28114 (cdcl) R 28103 28103 27771 0 -1 4202496 66414 0 0 0 129821 25 0 0 25 0 1 0 469228505 202149888 47504 33554432000 4194304 4218580 140737249262256 18446744073709551615 4208408 0 0 4096 24578 0 0 0 17 4 0 0 0
/proc/28114/statm: 49353 47504 131 6 0 47823 0
Current children cumulated CPU time (s) 1300.01
Current children cumulated vsize (KiB) 206112

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28103 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=503771
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=60990
# CPU time returned by wait4() is 1.56476
# while last known CPU time is 1300.01
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1300.01
CPU user time (s): 1299.71
CPU system time (s): 0.3
CPU usage (%): 99.9998
Max. virtual memory (cumulated for all children) (KiB): 206336

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.50377
system time used= 0.06099
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25669
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 40

runsolver used 2.23466 second user time and 4.87026 second system time

The end

Launcher Data 

Begin job on node146 at 2011-04-25 23:48:41
IDJOB=3288291
IDBENCH=82493
IDSOLVER=1609
FILE ID=node146/3288291-1303768120
RUNJOBID= node146-1303766812-27790
PBS_JOBID= 13157158
Free space on /tmp= 72748 MiB

SOLVER NAME= rcl 2011-04-01
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-eijkbs6669-tseitin.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3288291-1303768120/watcher-3288291-1303768120 -o /tmp/evaluation-result-3288291-1303768120/solver-3288291-1303768120 -C 2400 -W 1300 -M 7680  ./esg_static.sh HOME/instance-3288291-1303768120.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 7886cd26d6e0801ea382a1ffd6224023
RANDOM SEED=1734296108

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      13452900 kB
Buffers:       2075836 kB
Cached:       16778396 kB
SwapCached:          0 kB
Active:        9686568 kB
Inactive:      9276472 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      13452900 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           68944 kB
Writeback:           8 kB
AnonPages:      107264 kB
Mapped:          15168 kB
Slab:           470184 kB
PageTables:       5004 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   267560 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72744 MiB
End job on node146 at 2011-04-26 00:10:23