runsolver Copyright (C) 2010-2011 Olivier ROUSSEL
This is runsolver version 3.3.0 (svn: 977)
This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.
command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3448891-1307052499/watcher-3448891-1307052499 -o /tmp/evaluation-result-3448891-1307052499/solver-3448891-1307052499 -C 1200 -W 1300 -M 7680 python portfolio_solver.py -t 1200 -s 1835646393 HOME/instance-3448891-1307052499.cnf
running on 2 cores: 0,2
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1200 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1230 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB
[startup+0 s]
/proc/loadavg: 0.68 0.16 0.05 6/278 30687
/proc/meminfo: memFree=27969220/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=1840 CPUtime=0 cores=0,2
/proc/30687/stat : 30687 (python) D 30681 30687 30633 0 -1 4194304 46 0 0 0 0 0 0 0 20 0 1 0 816852411 1884160 1 33554432000 0 0 140736607082245 18446744073709551615 5055479 0 0 4096 0 18446744071562234166 0 0 17 0 0 0 0
/proc/30687/statm: 460 1 0 0 0 36 0
[startup+0.0624899 s]
/proc/loadavg: 0.68 0.16 0.05 6/278 30687
/proc/meminfo: memFree=27969220/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=15380 CPUtime=0 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 813 0 6 0 0 0 0 0 17 0 1 0 816852411 15749120 704 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921775104 0 2147483391 16781312 2 18446744071699199166 0 0 17 0 0 0 1
/proc/30687/statm: 3845 704 334 364 0 332 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15380
[startup+0.100486 s]
/proc/loadavg: 0.68 0.16 0.05 6/278 30687
/proc/meminfo: memFree=27969220/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=16236 CPUtime=0.01 cores=0,2
/proc/30687/stat : 30687 (python) R 30681 30687 30633 0 -1 4202496 1031 0 6 0 0 1 0 0 17 0 1 0 816852411 16625664 909 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921462082 0 0 16781312 2 0 0 0 17 0 0 0 1
/proc/30687/statm: 4059 909 380 364 0 546 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16236
[startup+0.30045 s]
/proc/loadavg: 0.68 0.16 0.05 6/278 30687
/proc/meminfo: memFree=27969220/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=21892 CPUtime=0.04 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 1508 0 7 0 2 2 0 0 17 0 1 0 816852411 22417408 1349 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 2
/proc/30687/statm: 5473 1349 443 364 0 928 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 21892
[startup+0.700373 s]
/proc/loadavg: 0.68 0.16 0.05 6/278 30687
/proc/meminfo: memFree=27969220/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=21892 CPUtime=0.04 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 1508 0 7 0 2 2 0 0 17 0 1 0 816852411 22417408 1349 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 2
/proc/30687/statm: 5473 1349 443 364 0 928 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 21892
[startup+1.50025 s]
/proc/loadavg: 0.68 0.16 0.05 6/290 30699
/proc/meminfo: memFree=27918104/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=21892 CPUtime=0.04 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 1508 0 7 0 2 2 0 0 17 0 1 0 816852411 22417408 1349 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 2
/proc/30687/statm: 5473 1349 443 364 0 928 0
[pid=30698] ppid=30687 vsize=8364 CPUtime=1.31 cores=0,2
/proc/30698/stat : 30698 (features) R 30687 30687 30633 0 -1 4202496 2594 0 0 0 130 1 0 0 19 0 1 0 816852428 8564736 1478 33554432000 134512640 135907751 4294470432 18446744073709551615 135392733 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30698/statm: 2091 1478 111 341 0 1747 0
Current children cumulated CPU time (s) 1.35
Current children cumulated vsize (KiB) 30256
[startup+3.10095 s]
/proc/loadavg: 0.68 0.16 0.05 8/290 30699
/proc/meminfo: memFree=27926132/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=21892 CPUtime=0.04 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 1508 0 7 0 2 2 0 0 17 0 1 0 816852411 22417408 1349 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 2
/proc/30687/statm: 5473 1349 443 364 0 928 0
[pid=30698] ppid=30687 vsize=106072 CPUtime=2.91 cores=0,2
/proc/30698/stat : 30698 (features) R 30687 30687 30633 0 -1 4202496 13372 0 0 0 287 4 0 0 25 0 1 0 816852428 108617728 11351 33554432000 134512640 135907751 4294470432 18446744073709551615 135340715 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30698/statm: 26518 11351 112 341 0 26174 0
Current children cumulated CPU time (s) 2.95
Current children cumulated vsize (KiB) 127964
[startup+6.30039 s]
/proc/loadavg: 0.95 0.22 0.07 6/290 30699
/proc/meminfo: memFree=27400008/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=21892 CPUtime=0.04 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 1508 0 7 0 2 2 0 0 17 0 1 0 816852411 22417408 1349 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 2
/proc/30687/statm: 5473 1349 443 364 0 928 0
[pid=30698] ppid=30687 vsize=210504 CPUtime=6.11 cores=0,2
/proc/30698/stat : 30698 (features) R 30687 30687 30633 0 -1 4202496 48577 0 0 0 601 10 0 0 25 0 1 0 816852428 215556096 46556 33554432000 134512640 135907751 4294470432 18446744073709551615 135340715 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30698/statm: 52626 46556 112 341 0 52282 0
Current children cumulated CPU time (s) 6.15
Current children cumulated vsize (KiB) 232396
[startup+12.7002 s]
/proc/loadavg: 1.19 0.29 0.09 6/290 30699
/proc/meminfo: memFree=27105164/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=21892 CPUtime=0.04 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 1508 0 7 0 2 2 0 0 17 0 1 0 816852411 22417408 1349 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 2
/proc/30687/statm: 5473 1349 443 364 0 928 0
[pid=30698] ppid=30687 vsize=463856 CPUtime=12.51 cores=0,2
/proc/30698/stat : 30698 (features) R 30687 30687 30633 0 -1 4202496 112193 0 0 0 1232 19 0 0 25 0 1 0 816852428 474988544 110171 33554432000 134512640 135907751 4294470432 18446744073709551615 134534779 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30698/statm: 115964 110171 112 341 0 115620 0
Current children cumulated CPU time (s) 12.55
Current children cumulated vsize (KiB) 485748
[startup+25.5009 s]
/proc/loadavg: 1.81 0.47 0.16 7/290 30699
/proc/meminfo: memFree=27103804/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=21892 CPUtime=0.04 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 1508 0 7 0 2 2 0 0 17 0 1 0 816852411 22417408 1349 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 2
/proc/30687/statm: 5473 1349 443 364 0 928 0
[pid=30698] ppid=30687 vsize=463856 CPUtime=25.32 cores=0,2
/proc/30698/stat : 30698 (features) R 30687 30687 30633 0 -1 4202496 112215 0 0 0 2512 20 0 0 25 0 1 0 816852428 474988544 110193 33554432000 134512640 135907751 4294470432 18446744073709551615 134534342 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30698/statm: 115964 110193 112 341 0 115620 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 485748
[startup+51.1012 s]
/proc/loadavg: 3.00 0.85 0.29 6/290 30700
/proc/meminfo: memFree=27176524/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=21892 CPUtime=0.04 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 1508 0 7 0 2 2 0 0 17 0 1 0 816852411 22417408 1349 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 2
/proc/30687/statm: 5473 1349 443 364 0 928 0
[pid=30698] ppid=30687 vsize=463856 CPUtime=50.92 cores=0,2
/proc/30698/stat : 30698 (features) R 30687 30687 30633 0 -1 4202496 112340 0 0 0 5072 20 0 0 25 0 1 0 816852428 474988544 110318 33554432000 134512640 135907751 4294470432 18446744073709551615 135392733 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30698/statm: 115964 110318 112 341 0 115620 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 485748
[startup+102.312 s]
/proc/loadavg: 3.56 1.33 0.48 7/302 30764
/proc/meminfo: memFree=27617244/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=34392 CPUtime=8.08 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 2598 206564 7 0 3 2 770 33 18 0 1 0 816852411 35217408 1406 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 0 0 0 2
/proc/30687/statm: 8598 1406 468 364 0 932 0
[pid=30698] ppid=30687 vsize=0 CPUtime=91.97 cores=0,2
/proc/30698/stat : 30698 (features) Z 30687 30687 30633 0 -1 4202524 140260 0 0 0 9169 28 0 0 25 0 1 0 816852428 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/30698/statm: 0 0 0 0 0 0 0
[pid=30737] ppid=30687 vsize=0 CPUtime=0.32 cores=0,2
/proc/30737/stat : 30737 (coach) Z 30687 30687 30633 0 -1 4202524 3736 0 0 0 32 0 0 0 18 0 1 0 816861625 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30737/statm: 0 0 0 0 0 0 0
[pid=30761] ppid=30687 vsize=8700 CPUtime=0 cores=0,2
/proc/30761/stat : 30761 (timerun) S 30687 30687 30633 0 -1 4202496 745 0 0 0 0 0 0 0 18 0 1 0 816862467 8908800 248 33554432000 4194304 4922060 140734930867888 18446744073709551615 222921596037 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/30761/statm: 2175 248 208 178 0 68 0
[pid=30762] ppid=30761 vsize=151952 CPUtime=1.71 cores=0,2
/proc/30762/stat : 30762 (march_hi) R 30761 30687 30633 0 -1 4194304 33891 0 0 0 167 4 0 0 25 0 1 0 816862467 155598848 33835 33554432000 134512640 134628092 4290710800 18446744073709551615 11667711 0 0 16781312 0 0 0 0 17 2 0 0 0
/proc/30762/statm: 37988 33835 103 29 0 37569 0
Current children cumulated CPU time (s) 102.08
Current children cumulated vsize (KiB) 195044
[startup+162.301 s]
/proc/loadavg: 3.87 1.83 0.70 7/299 30822
/proc/meminfo: memFree=26221600/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=34392 CPUtime=24.36 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 3631 445682 7 0 3 2 2355 76 18 0 1 0 816852411 35217408 1407 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 2
/proc/30687/statm: 8598 1407 468 364 0 932 0
[pid=30698] ppid=30687 vsize=0 CPUtime=91.97 cores=0,2
/proc/30698/stat : 30698 (features) Z 30687 30687 30633 0 -1 4202524 140260 0 0 0 9169 28 0 0 25 0 1 0 816852428 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/30698/statm: 0 0 0 0 0 0 0
[pid=30737] ppid=30687 vsize=0 CPUtime=0.32 cores=0,2
/proc/30737/stat : 30737 (coach) Z 30687 30687 30633 0 -1 4202524 3736 0 0 0 32 0 0 0 18 0 1 0 816861625 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30737/statm: 0 0 0 0 0 0 0
[pid=30811] ppid=30687 vsize=8700 CPUtime=0 cores=0,2
/proc/30811/stat : 30811 (timerun) S 30687 30687 30633 0 -1 4202496 744 0 0 0 0 0 0 0 19 0 1 0 816864108 8908800 247 33554432000 4194304 4922060 140735291949168 18446744073709551615 222921596037 0 65536 16781316 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/30811/statm: 2175 247 208 178 0 68 0
[pid=30812] ppid=30811 vsize=962052 CPUtime=45.31 cores=0,2
/proc/30812/stat : 30812 (cryptominisat) R 30811 30687 30633 0 -1 4202496 226964 0 0 0 4503 28 0 0 25 0 1 0 816864109 985141248 198581 33554432000 134512640 134994940 4287076624 18446744073709551615 134658461 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/30812/statm: 240513 198581 355 118 0 239698 0
Current children cumulated CPU time (s) 161.96
Current children cumulated vsize (KiB) 1005144
[startup+222.301 s]
/proc/loadavg: 3.95 2.22 0.91 7/302 30836
/proc/meminfo: memFree=26083060/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=34392 CPUtime=24.36 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 3631 445682 7 0 3 2 2355 76 18 0 1 0 816852411 35217408 1407 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 2
/proc/30687/statm: 8598 1407 468 364 0 932 0
[pid=30698] ppid=30687 vsize=0 CPUtime=91.97 cores=0,2
/proc/30698/stat : 30698 (features) Z 30687 30687 30633 0 -1 4202524 140260 0 0 0 9169 28 0 0 25 0 1 0 816852428 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/30698/statm: 0 0 0 0 0 0 0
[pid=30737] ppid=30687 vsize=0 CPUtime=0.32 cores=0,2
/proc/30737/stat : 30737 (coach) Z 30687 30687 30633 0 -1 4202524 3736 0 0 0 32 0 0 0 18 0 1 0 816861625 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30737/statm: 0 0 0 0 0 0 0
[pid=30811] ppid=30687 vsize=8700 CPUtime=0 cores=0,2
/proc/30811/stat : 30811 (timerun) S 30687 30687 30633 0 -1 4202496 744 0 0 0 0 0 0 0 19 0 1 0 816864108 8908800 247 33554432000 4194304 4922060 140735291949168 18446744073709551615 222921596037 0 65536 16781316 65538 18446744071562232103 0 0 17 2 0 0 0
/proc/30811/statm: 2175 247 208 178 0 68 0
[pid=30812] ppid=30811 vsize=1065904 CPUtime=105.3 cores=0,2
/proc/30812/stat : 30812 (cryptominisat) R 30811 30687 30633 0 -1 4202496 251858 0 0 0 10498 32 0 0 25 0 1 0 816864109 1091485696 209776 33554432000 134512640 134994940 4287076624 18446744073709551615 134658432 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/30812/statm: 266476 209776 356 118 0 265661 0
Current children cumulated CPU time (s) 221.95
Current children cumulated vsize (KiB) 1108996
[startup+282.301 s]
################
# More data... #
################
[startup+942.301 s]
/proc/loadavg: 4.01 4.08 2.79 6/302 30926
/proc/meminfo: memFree=22539784/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=34912 CPUtime=288.08 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 4369 10972330 7 0 4 2 26796 2006 19 0 1 0 816852411 35749888 1520 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 2
/proc/30687/statm: 8728 1520 468 364 0 1062 0
[pid=30698] ppid=30687 vsize=0 CPUtime=91.97 cores=0,2
/proc/30698/stat : 30698 (features) Z 30687 30687 30633 0 -1 4202524 140260 0 0 0 9169 28 0 0 25 0 1 0 816852428 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/30698/statm: 0 0 0 0 0 0 0
[pid=30737] ppid=30687 vsize=0 CPUtime=0.32 cores=0,2
/proc/30737/stat : 30737 (coach) Z 30687 30687 30633 0 -1 4202524 3736 0 0 0 32 0 0 0 18 0 1 0 816861625 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30737/statm: 0 0 0 0 0 0 0
[pid=30852] ppid=30687 vsize=8700 CPUtime=0 cores=0,2
/proc/30852/stat : 30852 (timerun) S 30687 30687 30633 0 -1 4202496 745 0 0 0 0 0 0 0 19 0 1 0 816891113 8908800 247 33554432000 4194304 4922060 140735028882720 18446744073709551615 222921596037 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/30852/statm: 2175 247 208 178 0 68 0
[pid=30853] ppid=30852 vsize=378316 CPUtime=555.27 cores=0,2
/proc/30853/stat : 30853 (mxc-sat09) R 30852 30687 30633 0 -1 4202496 114727 0 0 0 55509 18 0 0 25 0 1 0 816891114 387395584 90165 33554432000 134512640 134581694 4292920320 18446744073709551615 134530724 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30853/statm: 94579 90165 205 17 0 93926 0
Current children cumulated CPU time (s) 935.64
Current children cumulated vsize (KiB) 421928
[startup+1002.3 s]
/proc/loadavg: 4.00 4.06 2.86 6/302 30927
/proc/meminfo: memFree=22452672/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=34912 CPUtime=288.08 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 4369 10972330 7 0 4 2 26796 2006 19 0 1 0 816852411 35749888 1520 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 2
/proc/30687/statm: 8728 1520 468 364 0 1062 0
[pid=30698] ppid=30687 vsize=0 CPUtime=91.97 cores=0,2
/proc/30698/stat : 30698 (features) Z 30687 30687 30633 0 -1 4202524 140260 0 0 0 9169 28 0 0 25 0 1 0 816852428 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/30698/statm: 0 0 0 0 0 0 0
[pid=30737] ppid=30687 vsize=0 CPUtime=0.32 cores=0,2
/proc/30737/stat : 30737 (coach) Z 30687 30687 30633 0 -1 4202524 3736 0 0 0 32 0 0 0 18 0 1 0 816861625 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30737/statm: 0 0 0 0 0 0 0
[pid=30852] ppid=30687 vsize=8700 CPUtime=0 cores=0,2
/proc/30852/stat : 30852 (timerun) S 30687 30687 30633 0 -1 4202496 745 0 0 0 0 0 0 0 19 0 1 0 816891113 8908800 247 33554432000 4194304 4922060 140735028882720 18446744073709551615 222921596037 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/30852/statm: 2175 247 208 178 0 68 0
[pid=30853] ppid=30852 vsize=378316 CPUtime=615.27 cores=0,2
/proc/30853/stat : 30853 (mxc-sat09) R 30852 30687 30633 0 -1 4202496 114727 0 0 0 61509 18 0 0 25 0 1 0 816891114 387395584 90165 33554432000 134512640 134581694 4292920320 18446744073709551615 134534662 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30853/statm: 94579 90165 205 17 0 93926 0
Current children cumulated CPU time (s) 995.64
Current children cumulated vsize (KiB) 421928
[startup+1062.3 s]
/proc/loadavg: 4.07 4.07 2.94 6/302 30929
/proc/meminfo: memFree=22375004/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=34912 CPUtime=288.08 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 4369 10972330 7 0 4 2 26796 2006 19 0 1 0 816852411 35749888 1520 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 2
/proc/30687/statm: 8728 1520 468 364 0 1062 0
[pid=30698] ppid=30687 vsize=0 CPUtime=91.97 cores=0,2
/proc/30698/stat : 30698 (features) Z 30687 30687 30633 0 -1 4202524 140260 0 0 0 9169 28 0 0 25 0 1 0 816852428 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/30698/statm: 0 0 0 0 0 0 0
[pid=30737] ppid=30687 vsize=0 CPUtime=0.32 cores=0,2
/proc/30737/stat : 30737 (coach) Z 30687 30687 30633 0 -1 4202524 3736 0 0 0 32 0 0 0 18 0 1 0 816861625 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30737/statm: 0 0 0 0 0 0 0
[pid=30852] ppid=30687 vsize=8700 CPUtime=0 cores=0,2
/proc/30852/stat : 30852 (timerun) S 30687 30687 30633 0 -1 4202496 745 0 0 0 0 0 0 0 19 0 1 0 816891113 8908800 247 33554432000 4194304 4922060 140735028882720 18446744073709551615 222921596037 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/30852/statm: 2175 247 208 178 0 68 0
[pid=30853] ppid=30852 vsize=379996 CPUtime=675.28 cores=0,2
/proc/30853/stat : 30853 (mxc-sat09) R 30852 30687 30633 0 -1 4202496 115124 0 0 0 67509 19 0 0 25 0 1 0 816891114 389115904 90562 33554432000 134512640 134581694 4292920320 18446744073709551615 134530881 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30853/statm: 94999 90562 205 17 0 94346 0
Current children cumulated CPU time (s) 1055.65
Current children cumulated vsize (KiB) 423608
[startup+1122.3 s]
/proc/loadavg: 4.02 4.05 3.00 6/302 30930
/proc/meminfo: memFree=22278992/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=34912 CPUtime=288.08 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 4369 10972330 7 0 4 2 26796 2006 19 0 1 0 816852411 35749888 1520 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 2
/proc/30687/statm: 8728 1520 468 364 0 1062 0
[pid=30698] ppid=30687 vsize=0 CPUtime=91.97 cores=0,2
/proc/30698/stat : 30698 (features) Z 30687 30687 30633 0 -1 4202524 140260 0 0 0 9169 28 0 0 25 0 1 0 816852428 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/30698/statm: 0 0 0 0 0 0 0
[pid=30737] ppid=30687 vsize=0 CPUtime=0.32 cores=0,2
/proc/30737/stat : 30737 (coach) Z 30687 30687 30633 0 -1 4202524 3736 0 0 0 32 0 0 0 18 0 1 0 816861625 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30737/statm: 0 0 0 0 0 0 0
[pid=30852] ppid=30687 vsize=8700 CPUtime=0 cores=0,2
/proc/30852/stat : 30852 (timerun) S 30687 30687 30633 0 -1 4202496 745 0 0 0 0 0 0 0 19 0 1 0 816891113 8908800 247 33554432000 4194304 4922060 140735028882720 18446744073709551615 222921596037 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/30852/statm: 2175 247 208 178 0 68 0
[pid=30853] ppid=30852 vsize=403652 CPUtime=735.28 cores=0,2
/proc/30853/stat : 30853 (mxc-sat09) R 30852 30687 30633 0 -1 4202496 121043 0 0 0 73509 19 0 0 25 0 1 0 816891114 413339648 96481 33554432000 134512640 134581694 4292920320 18446744073709551615 134530478 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30853/statm: 100913 96481 205 17 0 100260 0
Current children cumulated CPU time (s) 1115.65
Current children cumulated vsize (KiB) 447264
[startup+1182.3 s]
/proc/loadavg: 4.13 4.07 3.07 6/302 30932
/proc/meminfo: memFree=22187316/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=34912 CPUtime=288.08 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 4369 10972330 7 0 4 2 26796 2006 19 0 1 0 816852411 35749888 1520 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 2
/proc/30687/statm: 8728 1520 468 364 0 1062 0
[pid=30698] ppid=30687 vsize=0 CPUtime=91.97 cores=0,2
/proc/30698/stat : 30698 (features) Z 30687 30687 30633 0 -1 4202524 140260 0 0 0 9169 28 0 0 25 0 1 0 816852428 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/30698/statm: 0 0 0 0 0 0 0
[pid=30737] ppid=30687 vsize=0 CPUtime=0.32 cores=0,2
/proc/30737/stat : 30737 (coach) Z 30687 30687 30633 0 -1 4202524 3736 0 0 0 32 0 0 0 18 0 1 0 816861625 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30737/statm: 0 0 0 0 0 0 0
[pid=30852] ppid=30687 vsize=8700 CPUtime=0 cores=0,2
/proc/30852/stat : 30852 (timerun) S 30687 30687 30633 0 -1 4202496 745 0 0 0 0 0 0 0 19 0 1 0 816891113 8908800 247 33554432000 4194304 4922060 140735028882720 18446744073709551615 222921596037 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/30852/statm: 2175 247 208 178 0 68 0
[pid=30853] ppid=30852 vsize=417204 CPUtime=795.28 cores=0,2
/proc/30853/stat : 30853 (mxc-sat09) R 30852 30687 30633 0 -1 4202496 124416 0 0 0 79508 20 0 0 25 0 1 0 816891114 427216896 99854 33554432000 134512640 134581694 4292920320 18446744073709551615 134530607 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30853/statm: 104301 99854 205 17 0 103648 0
Current children cumulated CPU time (s) 1175.65
Current children cumulated vsize (KiB) 460816
Maximum CPU time exceeded: sending SIGTERM then SIGKILL
[startup+1206.71 s]
/proc/loadavg: 4.08 4.06 3.10 5/302 30965
/proc/meminfo: memFree=23981148/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=34912 CPUtime=288.08 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 4369 10972330 7 0 4 2 26796 2006 19 0 1 0 816852411 35749888 1520 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 2
/proc/30687/statm: 8728 1520 468 364 0 1062 0
[pid=30698] ppid=30687 vsize=0 CPUtime=91.97 cores=0,2
/proc/30698/stat : 30698 (features) Z 30687 30687 30633 0 -1 4202524 140260 0 0 0 9169 28 0 0 25 0 1 0 816852428 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/30698/statm: 0 0 0 0 0 0 0
[pid=30737] ppid=30687 vsize=0 CPUtime=0.32 cores=0,2
/proc/30737/stat : 30737 (coach) Z 30687 30687 30633 0 -1 4202524 3736 0 0 0 32 0 0 0 18 0 1 0 816861625 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30737/statm: 0 0 0 0 0 0 0
[pid=30852] ppid=30687 vsize=8700 CPUtime=0 cores=0,2
/proc/30852/stat : 30852 (timerun) S 30687 30687 30633 0 -1 4202496 745 0 0 0 0 0 0 0 19 0 1 0 816891113 8908800 247 33554432000 4194304 4922060 140735028882720 18446744073709551615 222921596037 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/30852/statm: 2175 247 208 178 0 68 0
[pid=30853] ppid=30852 vsize=424352 CPUtime=819.7 cores=0,2
/proc/30853/stat : 30853 (mxc-sat09) R 30852 30687 30633 0 -1 4202496 126197 0 0 0 81950 20 0 0 25 0 1 0 816891114 434536448 101635 33554432000 134512640 134581694 4292920320 18446744073709551615 134530816 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30853/statm: 106088 101635 205 17 0 105435 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 467964
Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds
Solver just ended. Dumping a history of the last processes samples
[startup+1206.71 s]
/proc/loadavg: 4.08 4.06 3.10 5/302 30965
/proc/meminfo: memFree=23981148/32951124 swapFree=55664332/67111528
[pid=30687] ppid=30681 vsize=34912 CPUtime=288.08 cores=0,2
/proc/30687/stat : 30687 (python) S 30681 30687 30633 0 -1 4202496 4369 10972330 7 0 4 2 26796 2006 19 0 1 0 816852411 35749888 1520 33554432000 4194304 5683644 140736607080128 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 2 0 0 2
/proc/30687/statm: 8728 1520 468 364 0 1062 0
[pid=30698] ppid=30687 vsize=0 CPUtime=91.97 cores=0,2
/proc/30698/stat : 30698 (features) Z 30687 30687 30633 0 -1 4202524 140260 0 0 0 9169 28 0 0 25 0 1 0 816852428 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 0 0 0 0
/proc/30698/statm: 0 0 0 0 0 0 0
[pid=30737] ppid=30687 vsize=0 CPUtime=0.32 cores=0,2
/proc/30737/stat : 30737 (coach) Z 30687 30687 30633 0 -1 4202524 3736 0 0 0 32 0 0 0 18 0 1 0 816861625 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 2 0 0 0
/proc/30737/statm: 0 0 0 0 0 0 0
[pid=30852] ppid=30687 vsize=8700 CPUtime=0 cores=0,2
/proc/30852/stat : 30852 (timerun) S 30687 30687 30633 0 -1 4202496 745 0 0 0 0 0 0 0 19 0 1 0 816891113 8908800 247 33554432000 4194304 4922060 140735028882720 18446744073709551615 222921596037 0 65536 16781316 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/30852/statm: 2175 247 208 178 0 68 0
[pid=30853] ppid=30852 vsize=424352 CPUtime=819.7 cores=0,2
/proc/30853/stat : 30853 (mxc-sat09) R 30852 30687 30633 0 -1 4202496 126197 0 0 0 81950 20 0 0 25 0 1 0 816891114 434536448 101635 33554432000 134512640 134581694 4292920320 18446744073709551615 134530816 0 0 16781312 0 0 0 0 17 0 0 0 0
/proc/30853/statm: 106088 101635 205 17 0 105435 0
Current children cumulated CPU time (s) 1200.07
Current children cumulated vsize (KiB) 467964
Child ended because it received signal 15 (SIGTERM)
# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30687 and gives
# childrusage.ru_utime.tv_sec=268
# childrusage.ru_utime.tv_usec=9256
# childrusage.ru_stime.tv_sec=20
# childrusage.ru_stime.tv_usec=90945
# CPU time returned by wait4() is 288.1
# while last known CPU time is 1200.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...
Real time (s): 1206.73
CPU time (s): 1200.07
CPU user time (s): 1179.51
CPU system time (s): 20.56
CPU usage (%): 99.4479
Max. virtual memory (cumulated for all children) (KiB): 3985476
getrusage(RUSAGE_CHILDREN,...) data:
user time used= 268.009
system time used= 20.0909
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10976699
page faults= 7
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7330
involuntary context switches= 4185
runsolver used 3.51846 second user time and 7.79481 second system time
The end
Begin job on node109 at 2011-06-03 00:08:31
IDJOB=3448891
IDBENCH=82367
IDSOLVER=1947
FILE ID=node109/3448891-1307052499
RUNJOBID= node109-1307052497-30651
PBS_JOBID= 13497823
Free space on /tmp= 73496 MiB
SOLVER NAME= Coach 2011-03-18
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.030-NOTKNOWN.cnf
COMMAND LINE= python portfolio_solver.py -t TIMELIMIT -s RANDOMSEED BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3448891-1307052499/watcher-3448891-1307052499 -o /tmp/evaluation-result-3448891-1307052499/solver-3448891-1307052499 -C 1200 -W 1300 -M 7680 python portfolio_solver.py -t 1200 -s 1835646393 HOME/instance-3448891-1307052499.cnf
TIME LIMIT= 1200 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2
MD5SUM BENCH= fce318b20c1a474ab81b77594d3f6f99
RANDOM SEED=1835646393
node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009
/proc/cpuinfo:
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.809
cache size : 8192 KB
physical id : 0
siblings : 4
core id : 0
cpu cores : 4
apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5333.61
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.809
cache size : 8192 KB
physical id : 1
siblings : 4
core id : 0
cpu cores : 4
apicid : 16
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.75
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 2
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.809
cache size : 8192 KB
physical id : 0
siblings : 4
core id : 1
cpu cores : 4
apicid : 2
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.74
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 3
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.809
cache size : 8192 KB
physical id : 1
siblings : 4
core id : 1
cpu cores : 4
apicid : 18
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.75
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 4
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.809
cache size : 8192 KB
physical id : 0
siblings : 4
core id : 2
cpu cores : 4
apicid : 4
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.82
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 5
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.809
cache size : 8192 KB
physical id : 1
siblings : 4
core id : 2
cpu cores : 4
apicid : 20
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.75
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 6
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.809
cache size : 8192 KB
physical id : 0
siblings : 4
core id : 3
cpu cores : 4
apicid : 6
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.82
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 7
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.809
cache size : 8192 KB
physical id : 1
siblings : 4
core id : 3
cpu cores : 4
apicid : 22
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.74
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
/proc/meminfo:
MemTotal: 32951124 kB
MemFree: 27970356 kB
Buffers: 281636 kB
Cached: 2723068 kB
SwapCached: 10360 kB
Active: 1297292 kB
Inactive: 3433900 kB
HighTotal: 0 kB
HighFree: 0 kB
LowTotal: 32951124 kB
LowFree: 27970356 kB
SwapTotal: 67111528 kB
SwapFree: 55664332 kB
Dirty: 328412 kB
Writeback: 0 kB
AnonPages: 1723400 kB
Mapped: 15824 kB
Slab: 149124 kB
PageTables: 37800 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
CommitLimit: 83587088 kB
Committed_AS: 30869808 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
Hugepagesize: 2048 kB
Free space on /tmp at the end= 70072 MiB
End job on node109 at 2011-06-03 00:28:45