Trace number 3251520

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
rcl 2011-04-01? (TO) 1300.02 1300.01

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m42-q585-n40-p15-s54275047.cnf
MD5SUM67948a6aed9ea09317abe3c8a9a27a03
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark2.77358
Satisfiable
(Un)Satisfiability was proved
Number of variables1590
Number of clauses272291
Sum of the clauses size546092
Maximum clause length42
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2272251
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 540

Solver Data 

0.00/0.00	c Parsing...
0.00/0.07	c ==============================================================================
0.00/0.07	c |           |     ORIGINAL     |              LEARNT              |          |
0.00/0.07	c | Conflicts | Clauses Literals |   Limit Clauses Literals  Lit/Cl | Progress |
0.00/0.07	c ==============================================================================
0.00/0.07	c |         0 |  272291   546092 |   81687       0        0     nan |  0.000 % |
0.00/0.79	c |         0 |  270701   813703 |      --       0       --      -- |     --   | -1590/267611
0.00/0.79	c ==============================================================================
0.00/0.79	c Result  :   #vars: 1550   #clauses: 270701   #literals: 813703
0.00/0.79	c CPU time:   0.78588 s
0.00/0.79	c ==============================================================================

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3251520-1303585502/watcher-3251520-1303585502 -o /tmp/evaluation-result-3251520-1303585502/solver-3251520-1303585502 -C 2400 -W 1300 -M 7680 ./esg_static.sh HOME/instance-3251520-1303585502.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.80 3.07 3.46 3/184 22924
/proc/meminfo: memFree=14490972/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 327 0 0 0 0 0 0 0 22 0 1 0 470148091 8908800 249 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 249 209 178 0 68 0

[startup+0.0767551 s]
/proc/loadavg: 2.80 3.07 3.46 3/184 22924
/proc/meminfo: memFree=14490972/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 327 0 0 0 0 0 0 0 22 0 1 0 470148091 8908800 249 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100745 s]
/proc/loadavg: 2.80 3.07 3.46 3/184 22924
/proc/meminfo: memFree=14490972/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 327 0 0 0 0 0 0 0 22 0 1 0 470148091 8908800 249 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.30071 s]
/proc/loadavg: 2.80 3.07 3.46 3/184 22924
/proc/meminfo: memFree=14490972/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 327 0 0 0 0 0 0 0 22 0 1 0 470148091 8908800 249 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700633 s]
/proc/loadavg: 2.80 3.07 3.46 3/184 22924
/proc/meminfo: memFree=14490972/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 327 0 0 0 0 0 0 0 22 0 1 0 470148091 8908800 249 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 249 209 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50049 s]
/proc/loadavg: 2.80 3.07 3.46 5/198 22951
/proc/meminfo: memFree=14430824/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=12516 CPUtime=0.56 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 1604 0 0 0 56 0 0 0 20 0 1 0 470148183 12816384 1515 33554432000 4194304 4218580 140735387652064 18446744073709551615 4210517 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 3129 1515 130 6 0 1599 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 21216

[startup+3.10019 s]
/proc/loadavg: 2.80 3.07 3.46 5/198 22952
/proc/meminfo: memFree=14448680/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=13572 CPUtime=2.16 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 1881 0 0 0 216 0 0 0 25 0 1 0 470148183 13897728 1792 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 3393 1792 130 6 0 1863 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 22272

[startup+6.3006 s]
/proc/loadavg: 2.97 3.10 3.47 5/198 22952
/proc/meminfo: memFree=14434460/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=15876 CPUtime=5.36 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 2445 0 0 0 536 0 0 0 25 0 1 0 470148183 16257024 2356 33554432000 4194304 4218580 140735387652064 18446744073709551615 4211929 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 3969 2356 130 6 0 2439 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 24576

[startup+12.7004 s]
/proc/loadavg: 3.06 3.12 3.47 5/198 22952
/proc/meminfo: memFree=14425956/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=18056 CPUtime=11.76 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 2988 0 0 0 1176 0 0 0 25 0 1 0 470148183 18489344 2899 33554432000 4194304 4218580 140735387652064 18446744073709551615 4210496 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 4514 2899 131 6 0 2984 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 26756

[startup+25.501 s]
/proc/loadavg: 3.27 3.16 3.48 5/198 22952
/proc/meminfo: memFree=14412468/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=20736 CPUtime=24.56 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 3656 0 0 0 2456 0 0 0 25 0 1 0 470148183 21233664 3567 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208576 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 5184 3567 131 6 0 3654 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 29436

[startup+51.1003 s]
/proc/loadavg: 3.51 3.22 3.49 5/198 22953
/proc/meminfo: memFree=14395068/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=24924 CPUtime=50.16 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 4731 0 0 0 5016 0 0 0 25 0 1 0 470148183 25522176 4641 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 6231 4641 131 6 0 4701 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 33624

[startup+102.307 s]
/proc/loadavg: 3.79 3.34 3.52 5/198 22954
/proc/meminfo: memFree=14369992/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=30356 CPUtime=101.37 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 6195 0 0 0 10136 1 0 0 25 0 1 0 470148183 31084544 5991 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208512 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 7589 5991 131 6 0 6059 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 39056

[startup+162.301 s]
/proc/loadavg: 4.00 3.49 3.56 5/198 22956
/proc/meminfo: memFree=14349772/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=37472 CPUtime=161.36 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 8049 0 0 0 16135 1 0 0 25 0 1 0 470148183 38371328 7773 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208521 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 9368 7773 131 6 0 7838 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 46172

[startup+222.301 s]
/proc/loadavg: 4.10 3.61 3.59 5/198 22958
/proc/meminfo: memFree=14337468/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=41164 CPUtime=221.36 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 9134 0 0 0 22135 1 0 0 25 0 1 0 470148183 42151936 8679 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 10291 8679 131 6 0 8761 0
Current children cumulated CPU time (s) 222.27
Current children cumulated vsize (KiB) 49864

[startup+282.3 s]
/proc/loadavg: 4.13 3.71 3.62 5/198 22959
/proc/meminfo: memFree=14326164/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=44276 CPUtime=281.37 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 10006 0 0 0 28135 2 0 0 25 0 1 0 470148183 45338624 9476 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208164 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 11069 9476 131 6 0 9539 0
Current children cumulated CPU time (s) 282.28
Current children cumulated vsize (KiB) 52976

[startup+342.3 s]
/proc/loadavg: 3.65 3.66 3.62 4/191 22986
/proc/meminfo: memFree=14356724/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=46944 CPUtime=341.37 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 10730 0 0 0 34135 2 0 0 25 0 1 0 470148183 48070656 10120 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 11736 10120 131 6 0 10206 0
Current children cumulated CPU time (s) 342.28
Current children cumulated vsize (KiB) 55644

[startup+402.3 s]
/proc/loadavg: 3.24 3.54 3.57 5/191 22987
/proc/meminfo: memFree=14339956/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7

################
# More data... #
################

/proc/22951/statm: 15691 14073 131 6 0 14161 0
Current children cumulated CPU time (s) 582.29
Current children cumulated vsize (KiB) 71464

[startup+642.301 s]
/proc/loadavg: 3.00 3.24 3.44 4/191 22994
/proc/meminfo: memFree=14321512/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=63604 CPUtime=641.38 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 15509 0 0 0 64134 4 0 0 25 0 1 0 470148183 65130496 14286 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208521 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 15901 14286 131 6 0 14371 0
Current children cumulated CPU time (s) 642.29
Current children cumulated vsize (KiB) 72304

[startup+702.301 s]
/proc/loadavg: 3.00 3.20 3.41 4/191 22995
/proc/meminfo: memFree=14318384/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=63700 CPUtime=701.39 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 15607 0 0 0 70134 5 0 0 25 0 1 0 470148183 65228800 14309 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 15925 14309 131 6 0 14395 0
Current children cumulated CPU time (s) 702.3
Current children cumulated vsize (KiB) 72400

[startup+762.307 s]
/proc/loadavg: 3.00 3.16 3.38 4/191 22997
/proc/meminfo: memFree=14316752/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=64016 CPUtime=761.4 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 15781 0 0 0 76135 5 0 0 25 0 1 0 470148183 65552384 14396 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208512 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 16004 14396 131 6 0 14474 0
Current children cumulated CPU time (s) 762.31
Current children cumulated vsize (KiB) 72716

[startup+822.3 s]
/proc/loadavg: 3.00 3.13 3.35 4/191 22998
/proc/meminfo: memFree=14314000/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=64840 CPUtime=821.39 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 16136 0 0 0 82134 5 0 0 25 0 1 0 470148183 66396160 14615 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208288 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 16210 14615 131 6 0 14680 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 73540

[startup+882.3 s]
/proc/loadavg: 3.00 3.10 3.33 4/191 23000
/proc/meminfo: memFree=14309644/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=65656 CPUtime=881.39 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 16421 0 0 0 88134 5 0 0 25 0 1 0 470148183 67231744 14801 33554432000 4194304 4218580 140735387652064 18446744073709551615 4210496 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 16414 14801 131 6 0 14884 0
Current children cumulated CPU time (s) 882.3
Current children cumulated vsize (KiB) 74356

[startup+942.3 s]
/proc/loadavg: 3.07 3.10 3.31 4/191 23002
/proc/meminfo: memFree=14307148/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=65752 CPUtime=941.39 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 16535 0 0 0 94134 5 0 0 25 0 1 0 470148183 67330048 14822 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208521 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 16438 14822 131 6 0 14908 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 74452

[startup+1002.3 s]
/proc/loadavg: 3.02 3.08 3.29 4/191 23003
/proc/meminfo: memFree=14304272/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=65908 CPUtime=1001.39 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 16720 0 0 0 100134 5 0 0 25 0 1 0 470148183 67489792 14881 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 16477 14881 131 6 0 14947 0
Current children cumulated CPU time (s) 1002.3
Current children cumulated vsize (KiB) 74608

[startup+1062.3 s]
/proc/loadavg: 3.01 3.06 3.27 4/191 23005
/proc/meminfo: memFree=14296180/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=68656 CPUtime=1061.39 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 17488 0 0 0 106134 5 0 0 25 0 1 0 470148183 70303744 15571 33554432000 4194304 4218580 140735387652064 18446744073709551615 4210077 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 17164 15571 131 6 0 15634 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 77356

[startup+1122.3 s]
/proc/loadavg: 3.05 3.06 3.25 4/191 23006
/proc/meminfo: memFree=14289580/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=72588 CPUtime=1121.4 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 18517 0 0 0 112134 6 0 0 25 0 1 0 470148183 74330112 16530 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208532 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 18147 16530 131 6 0 16617 0
Current children cumulated CPU time (s) 1122.31
Current children cumulated vsize (KiB) 81288

[startup+1182.3 s]
/proc/loadavg: 3.07 3.06 3.24 4/191 23008
/proc/meminfo: memFree=14286836/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=73532 CPUtime=1181.4 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 18831 0 0 0 118134 6 0 0 25 0 1 0 470148183 75296768 16770 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208442 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 18383 16770 131 6 0 16853 0
Current children cumulated CPU time (s) 1182.31
Current children cumulated vsize (KiB) 82232

[startup+1242.3 s]
/proc/loadavg: 3.10 3.07 3.23 4/191 23010
/proc/meminfo: memFree=14283604/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=74656 CPUtime=1241.4 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 19197 0 0 0 124134 6 0 0 25 0 1 0 470148183 76447744 17056 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208446 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 18664 17056 131 6 0 17134 0
Current children cumulated CPU time (s) 1242.31
Current children cumulated vsize (KiB) 83356



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 3.11 3.07 3.22 4/191 23011
/proc/meminfo: memFree=14281112/32951124 swapFree=67111528/67111528
[pid=22924] ppid=22922 vsize=8700 CPUtime=0.91 cores=5,7
/proc/22924/stat : 22924 (esg_static.sh) S 22922 22924 21784 0 -1 4202496 352 5164 0 0 0 0 90 1 18 0 1 0 470148091 8908800 252 33554432000 4194304 4922060 140736261030032 18446744073709551615 255377120389 0 65536 4100 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/22924/statm: 2175 252 209 178 0 68 0
[pid=22951] ppid=22924 vsize=75916 CPUtime=1299.11 cores=5,7
/proc/22951/stat : 22951 (cdcl) R 22924 22924 21784 0 -1 4202496 19668 0 0 0 129905 6 0 0 25 0 1 0 470148183 77737984 17374 33554432000 4194304 4218580 140735387652064 18446744073709551615 4208532 0 0 4096 24578 0 0 0 17 5 0 0 0
/proc/22951/statm: 18979 17374 131 6 0 17449 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 84616

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22924 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=908861
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=11998
# CPU time returned by wait4() is 0.920859
# while last known CPU time is 1300.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1300.02
CPU user time (s): 1299.95
CPU system time (s): 0.07
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 84680

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.908861
system time used= 0.011998
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5516
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9
involuntary context switches= 4

runsolver used 2.00569 second user time and 5.09822 second system time

The end

Launcher Data 

Begin job on node135 at 2011-04-23 21:05:02
IDJOB=3251520
IDBENCH=88225
IDSOLVER=1609
FILE ID=node135/3251520-1303585502
RUNJOBID= node135-1303585502-22904
PBS_JOBID= 13150331
Free space on /tmp= 71372 MiB

SOLVER NAME= rcl 2011-04-01
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m42-q585-n40-p15-s54275047.cnf
COMMAND LINE= ./esg_static.sh BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3251520-1303585502/watcher-3251520-1303585502 -o /tmp/evaluation-result-3251520-1303585502/solver-3251520-1303585502 -C 2400 -W 1300 -M 7680  ./esg_static.sh HOME/instance-3251520-1303585502.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 67948a6aed9ea09317abe3c8a9a27a03
RANDOM SEED=392894032

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      14491128 kB
Buffers:       2058524 kB
Cached:       15733396 kB
SwapCached:          0 kB
Active:        7329436 kB
Inactive:     10534608 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      14491128 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:            6240 kB
Writeback:           0 kB
AnonPages:       71564 kB
Mapped:          15272 kB
Slab:           531468 kB
PageTables:       5160 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   216816 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71348 MiB
End job on node135 at 2011-04-23 21:26:44