runsolver Copyright (C) 2010-2011 Olivier ROUSSEL
This is runsolver version 3.3.0 (svn: 935)
This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
GNU General Public License for more details.
command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3285536-1303763442/watcher-3285536-1303763442 -o /tmp/evaluation-result-3285536-1303763442/solver-3285536-1303763442 -C 2400 -W 1300 -M 7680 python portfolio_solver.py -t 2400 -s 685425533 HOME/instance-3285536-1303763442.cnf
running on 2 cores: 5,7
Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB
[startup+0 s]
/proc/loadavg: 4.00 4.09 3.60 5/200 21022
/proc/meminfo: memFree=7545076/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=15244 CPUtime=0 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 732 0 0 0 0 0 0 0 22 0 1 0 487944534 15609856 625 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089696256 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/21022/statm: 3811 625 333 379 0 284 0
[startup+0.104523 s]
/proc/loadavg: 4.00 4.09 3.60 5/200 21022
/proc/meminfo: memFree=7545076/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=21960 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 1530 0 0 0 1 0 0 0 22 0 1 0 487944534 22487040 1367 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 5490 1367 463 379 0 931 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 21960
[startup+0.200503 s]
/proc/loadavg: 4.00 4.09 3.60 5/200 21022
/proc/meminfo: memFree=7545076/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=21960 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 1530 0 0 0 1 0 0 0 22 0 1 0 487944534 22487040 1367 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 5490 1367 463 379 0 931 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 21960
[startup+0.300485 s]
/proc/loadavg: 4.00 4.09 3.60 5/200 21022
/proc/meminfo: memFree=7545076/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=21960 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 1530 0 0 0 1 0 0 0 22 0 1 0 487944534 22487040 1367 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 5490 1367 463 379 0 931 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 21960
[startup+0.700414 s]
/proc/loadavg: 4.00 4.09 3.60 5/200 21022
/proc/meminfo: memFree=7545076/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=21960 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 1530 0 0 0 1 0 0 0 22 0 1 0 487944534 22487040 1367 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 5490 1367 463 379 0 931 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 21960
[startup+1.50027 s]
/proc/loadavg: 4.00 4.09 3.60 5/202 21024
/proc/meminfo: memFree=7528028/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=21960 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 1530 0 0 0 1 0 0 0 22 0 1 0 487944534 22487040 1367 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 5490 1367 463 379 0 931 0
[pid=21024] ppid=21022 vsize=8364 CPUtime=1.45 cores=5,7
/proc/21024/stat : 21024 (features) R 21022 21022 20116 0 -1 4202496 2637 0 0 0 142 3 0 0 25 0 1 0 487944538 8564736 1520 33554432000 134512640 135907751 4291907616 18446744073709551615 135392733 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21024/statm: 2091 1520 111 341 0 1747 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 30324
[startup+3.10099 s]
/proc/loadavg: 4.16 4.12 3.61 5/202 21024
/proc/meminfo: memFree=7463424/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=21960 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 1530 0 0 0 1 0 0 0 22 0 1 0 487944534 22487040 1367 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 5490 1367 463 379 0 931 0
[pid=21024] ppid=21022 vsize=176732 CPUtime=3.05 cores=5,7
/proc/21024/stat : 21024 (features) R 21022 21022 20116 0 -1 4202496 21329 0 0 0 295 10 0 0 25 0 1 0 487944538 180973568 19307 33554432000 134512640 135907751 4291907616 18446744073709551615 134549302 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21024/statm: 44183 19307 112 341 0 43839 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 198692
[startup+6.30743 s]
/proc/loadavg: 4.16 4.12 3.61 5/202 21024
/proc/meminfo: memFree=7306248/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=21960 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 1530 0 0 0 1 0 0 0 22 0 1 0 487944534 22487040 1367 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 5490 1367 463 379 0 931 0
[pid=21024] ppid=21022 vsize=289608 CPUtime=6.25 cores=5,7
/proc/21024/stat : 21024 (features) R 21022 21022 20116 0 -1 4202496 59361 0 0 0 608 17 0 0 25 0 1 0 487944538 296558592 57339 33554432000 134512640 135907751 4291907616 18446744073709551615 135396606 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21024/statm: 72402 57340 112 341 0 72058 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 311568
[startup+12.7003 s]
/proc/loadavg: 4.15 4.12 3.61 5/202 21025
/proc/meminfo: memFree=6826628/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=21960 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 1530 0 0 0 1 0 0 0 22 0 1 0 487944534 22487040 1367 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 5490 1367 463 379 0 931 0
[pid=21024] ppid=21022 vsize=767612 CPUtime=12.65 cores=5,7
/proc/21024/stat : 21024 (features) R 21022 21022 20116 0 -1 4202496 184435 0 0 0 1229 36 0 0 25 0 1 0 487944538 786034688 182412 33554432000 134512640 135907751 4291907616 18446744073709551615 134534342 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21024/statm: 191903 182412 112 341 0 191559 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 789572
[startup+25.501 s]
/proc/loadavg: 4.12 4.11 3.62 5/202 21025
/proc/meminfo: memFree=6818080/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=21960 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 1530 0 0 0 1 0 0 0 22 0 1 0 487944534 22487040 1367 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 5490 1367 463 379 0 931 0
[pid=21024] ppid=21022 vsize=767612 CPUtime=25.44 cores=5,7
/proc/21024/stat : 21024 (features) R 21022 21022 20116 0 -1 4202496 184450 0 0 0 2508 36 0 0 25 0 1 0 487944538 786034688 182427 33554432000 134512640 135907751 4291907616 18446744073709551615 134534779 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21024/statm: 191903 182427 112 341 0 191559 0
Current children cumulated CPU time (s) 25.45
Current children cumulated vsize (KiB) 789572
[startup+51.1005 s]
/proc/loadavg: 4.16 4.12 3.63 5/202 21026
/proc/meminfo: memFree=6803532/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=21960 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 1530 0 0 0 1 0 0 0 22 0 1 0 487944534 22487040 1367 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 5490 1367 463 379 0 931 0
[pid=21024] ppid=21022 vsize=767612 CPUtime=51.05 cores=5,7
/proc/21024/stat : 21024 (features) R 21022 21022 20116 0 -1 4202496 184480 0 0 0 5068 37 0 0 25 0 1 0 487944538 786034688 182457 33554432000 134512640 135907751 4291907616 18446744073709551615 134534804 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21024/statm: 191903 182457 112 341 0 191559 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 789572
[startup+102.3 s]
/proc/loadavg: 4.07 4.10 3.65 5/205 21030
/proc/meminfo: memFree=6962140/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=34460 CPUtime=0.01 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 2175 0 0 0 1 0 0 0 18 0 1 0 487944534 35287040 1426 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 8615 1426 488 379 0 935 0
[pid=21024] ppid=21022 vsize=0 CPUtime=94.42 cores=5,7
/proc/21024/stat : 21024 (features) Z 21022 21022 20116 0 -1 4202524 235414 0 0 0 9391 51 0 0 25 0 1 0 487944538 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21024/statm: 0 0 0 0 0 0 0
[pid=21028] ppid=21022 vsize=0 CPUtime=0.33 cores=5,7
/proc/21028/stat : 21028 (coach) Z 21022 21022 20116 0 -1 4202524 3927 0 0 0 32 1 0 0 20 0 1 0 487953980 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/21028/statm: 0 0 0 0 0 0 0
[pid=21029] ppid=21022 vsize=8700 CPUtime=0 cores=5,7
/proc/21029/stat : 21029 (timerun) S 21022 21022 20116 0 -1 4202496 754 0 0 0 0 0 0 0 17 0 1 0 487954015 8908800 248 33554432000 4194304 4922060 140735743968368 18446744073709551615 248089517189 0 65536 16781316 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/21029/statm: 2175 248 208 178 0 68 0
[pid=21030] ppid=21029 vsize=708800 CPUtime=7.48 cores=5,7
/proc/21030/stat : 21030 (cryptominisat) R 21029 21022 20116 0 -1 4202496 177145 0 0 0 724 24 0 0 25 0 1 0 487954015 725811200 142174 33554432000 134512640 134994940 4291381936 18446744073709551615 134641904 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/21030/statm: 177200 142174 321 118 0 176385 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 751960
[startup+162.301 s]
/proc/loadavg: 4.02 4.08 3.67 5/205 21036
/proc/meminfo: memFree=6638484/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=34460 CPUtime=21.05 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 2467 281890 0 0 1 1 2061 42 18 0 1 0 487944534 35287040 1426 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 8615 1426 488 379 0 935 0
[pid=21024] ppid=21022 vsize=0 CPUtime=94.42 cores=5,7
/proc/21024/stat : 21024 (features) Z 21022 21022 20116 0 -1 4202524 235414 0 0 0 9391 51 0 0 25 0 1 0 487944538 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21024/statm: 0 0 0 0 0 0 0
[pid=21028] ppid=21022 vsize=0 CPUtime=0.33 cores=5,7
/proc/21028/stat : 21028 (coach) Z 21022 21022 20116 0 -1 4202524 3927 0 0 0 32 1 0 0 20 0 1 0 487953980 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/21028/statm: 0 0 0 0 0 0 0
[pid=21033] ppid=21022 vsize=8700 CPUtime=0 cores=5,7
/proc/21033/stat : 21033 (timerun) S 21022 21022 20116 0 -1 4202496 749 0 0 0 0 0 0 0 20 0 1 0 487956120 8908800 247 33554432000 4194304 4922060 140735767501888 18446744073709551615 248089517189 0 65536 16781316 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/21033/statm: 2175 247 208 178 0 68 0
[pid=21034] ppid=21033 vsize=863640 CPUtime=46.43 cores=5,7
/proc/21034/stat : 21034 (precosat) R 21033 21022 20116 0 -1 4202496 227125 0 0 0 4607 36 0 0 25 0 1 0 487956120 884367360 208619 33554432000 134512640 135142049 4294225728 18446744073709551615 134609855 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/21034/statm: 215910 208619 77 154 0 215754 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 906800
[startup+222.301 s]
/proc/loadavg: 4.07 4.08 3.69 5/205 21037
/proc/meminfo: memFree=6551156/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=34460 CPUtime=21.05 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 2467 281890 0 0 1 1 2061 42 18 0 1 0 487944534 35287040 1426 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/21022/statm: 8615 1426 488 379 0 935 0
[pid=21024] ppid=21022 vsize=0 CPUtime=94.42 cores=5,7
/proc/21024/stat : 21024 (features) Z 21022 21022 20116 0 -1 4202524 235414 0 0 0 9391 51 0 0 25 0 1 0 487944538 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21024/statm: 0 0 0 0 0 0 0
[pid=21028] ppid=21022 vsize=0 CPUtime=0.33 cores=5,7
/proc/21028/stat : 21028 (coach) Z 21022 21022 20116 0 -1 4202524 3927 0 0 0 32 1 0 0 20 0 1 0 487953980 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/21028/statm: 0 0 0 0 0 0 0
[pid=21033] ppid=21022 vsize=8700 CPUtime=0 cores=5,7
/proc/21033/stat : 21033 (timerun) S 21022 21022 20116 0 -1 4202496 749 0 0 0 0 0 0 0 20 0 1 0 487956120 8908800 247 33554432000 4194304 4922060 140735767501888 18446744073709551615 248089517189 0 65536 16781316 65538 18446744071562232103 0 0 17 5 0 0 0
/proc/21033/statm: 2175 247 208 178 0 68 0
[pid=21034] ppid=21033 vsize=937180 CPUtime=106.43 cores=5,7
/proc/21034/stat : 21034 (precosat) R 21033 21022 20116 0 -1 4202496 289013 0 0 0 10598 45 0 0 25 0 1 0 487956120 959672320 224189 33554432000 134512640 135142049 4294225728 18446744073709551615 134550034 0 0 16781312 17442 0 0 0 17 5 0 0 0
/proc/21034/statm: 234295 224189 82 154 0 234139 0
Current children cumulated CPU time (s) 222.23
Current children cumulated vsize (KiB) 980340
[startup+282.301 s]
################
# More data... #
################
[startup+942.301 s]
/proc/loadavg: 5.15 4.55 4.07 6/205 21226
/proc/meminfo: memFree=6991400/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=34468 CPUtime=578.37 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 4298 14924809 0 0 2 2 55337 2496 19 0 1 0 487944534 35295232 1478 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 0
/proc/21022/statm: 8617 1478 488 379 0 937 0
[pid=21024] ppid=21022 vsize=0 CPUtime=94.42 cores=5,7
/proc/21024/stat : 21024 (features) Z 21022 21022 20116 0 -1 4202524 235414 0 0 0 9391 51 0 0 25 0 1 0 487944538 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21024/statm: 0 0 0 0 0 0 0
[pid=21028] ppid=21022 vsize=0 CPUtime=0.33 cores=5,7
/proc/21028/stat : 21028 (coach) Z 21022 21022 20116 0 -1 4202524 3927 0 0 0 32 1 0 0 20 0 1 0 487953980 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/21028/statm: 0 0 0 0 0 0 0
[pid=21195] ppid=21022 vsize=8700 CPUtime=0 cores=5,7
/proc/21195/stat : 21195 (timerun) S 21022 21022 20116 0 -1 4202496 749 0 0 0 0 0 0 0 19 0 1 0 488011854 8908800 247 33554432000 4194304 4922060 140734734872864 18446744073709551615 248089517189 0 65536 16781316 65538 18446744071562232103 0 0 17 7 0 0 0
/proc/21195/statm: 2175 247 208 178 0 68 0
[pid=21196] ppid=21195 vsize=518732 CPUtime=269.09 cores=5,7
/proc/21196/stat : 21196 (mxc-sat09) R 21195 21022 20116 0 -1 4202496 156009 0 0 0 26885 24 0 0 25 0 1 0 488011854 531181568 113224 33554432000 134512640 134581694 4291842240 18446744073709551615 134530712 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21196/statm: 129683 113224 205 17 0 129030 0
Current children cumulated CPU time (s) 942.21
Current children cumulated vsize (KiB) 561900
[startup+1002.3 s]
/proc/loadavg: 4.56 4.49 4.07 6/205 21234
/proc/meminfo: memFree=7222732/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=34468 CPUtime=578.37 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 4298 14924809 0 0 2 2 55337 2496 19 0 1 0 487944534 35295232 1478 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 0
/proc/21022/statm: 8617 1478 488 379 0 937 0
[pid=21024] ppid=21022 vsize=0 CPUtime=94.42 cores=5,7
/proc/21024/stat : 21024 (features) Z 21022 21022 20116 0 -1 4202524 235414 0 0 0 9391 51 0 0 25 0 1 0 487944538 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21024/statm: 0 0 0 0 0 0 0
[pid=21028] ppid=21022 vsize=0 CPUtime=0.33 cores=5,7
/proc/21028/stat : 21028 (coach) Z 21022 21022 20116 0 -1 4202524 3927 0 0 0 32 1 0 0 20 0 1 0 487953980 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/21028/statm: 0 0 0 0 0 0 0
[pid=21195] ppid=21022 vsize=8700 CPUtime=0 cores=5,7
/proc/21195/stat : 21195 (timerun) S 21022 21022 20116 0 -1 4202496 749 0 0 0 0 0 0 0 19 0 1 0 488011854 8908800 247 33554432000 4194304 4922060 140734734872864 18446744073709551615 248089517189 0 65536 16781316 65538 18446744071562232103 0 0 17 7 0 0 0
/proc/21195/statm: 2175 247 208 178 0 68 0
[pid=21196] ppid=21195 vsize=525708 CPUtime=329.09 cores=5,7
/proc/21196/stat : 21196 (mxc-sat09) R 21195 21022 20116 0 -1 4202496 158008 0 0 0 32885 24 0 0 25 0 1 0 488011854 538324992 115223 33554432000 134512640 134581694 4291842240 18446744073709551615 134530758 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21196/statm: 131427 115223 205 17 0 130774 0
Current children cumulated CPU time (s) 1002.21
Current children cumulated vsize (KiB) 568876
[startup+1062.31 s]
/proc/loadavg: 4.19 4.39 4.06 6/205 21236
/proc/meminfo: memFree=7004372/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=34468 CPUtime=578.37 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 4298 14924809 0 0 2 2 55337 2496 19 0 1 0 487944534 35295232 1478 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 0
/proc/21022/statm: 8617 1478 488 379 0 937 0
[pid=21024] ppid=21022 vsize=0 CPUtime=94.42 cores=5,7
/proc/21024/stat : 21024 (features) Z 21022 21022 20116 0 -1 4202524 235414 0 0 0 9391 51 0 0 25 0 1 0 487944538 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21024/statm: 0 0 0 0 0 0 0
[pid=21028] ppid=21022 vsize=0 CPUtime=0.33 cores=5,7
/proc/21028/stat : 21028 (coach) Z 21022 21022 20116 0 -1 4202524 3927 0 0 0 32 1 0 0 20 0 1 0 487953980 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/21028/statm: 0 0 0 0 0 0 0
[pid=21195] ppid=21022 vsize=8700 CPUtime=0 cores=5,7
/proc/21195/stat : 21195 (timerun) S 21022 21022 20116 0 -1 4202496 749 0 0 0 0 0 0 0 19 0 1 0 488011854 8908800 247 33554432000 4194304 4922060 140734734872864 18446744073709551615 248089517189 0 65536 16781316 65538 18446744071562232103 0 0 17 7 0 0 0
/proc/21195/statm: 2175 247 208 178 0 68 0
[pid=21196] ppid=21195 vsize=557816 CPUtime=389.1 cores=5,7
/proc/21196/stat : 21196 (mxc-sat09) R 21195 21022 20116 0 -1 4202496 166049 0 0 0 38884 26 0 0 25 0 1 0 488011854 571203584 123264 33554432000 134512640 134581694 4291842240 18446744073709551615 134530601 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21196/statm: 139454 123264 205 17 0 138801 0
Current children cumulated CPU time (s) 1062.22
Current children cumulated vsize (KiB) 600984
[startup+1122.3 s]
/proc/loadavg: 4.07 4.32 4.06 6/205 21237
/proc/meminfo: memFree=6902432/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=34468 CPUtime=578.37 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 4298 14924809 0 0 2 2 55337 2496 19 0 1 0 487944534 35295232 1478 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 0
/proc/21022/statm: 8617 1478 488 379 0 937 0
[pid=21024] ppid=21022 vsize=0 CPUtime=94.42 cores=5,7
/proc/21024/stat : 21024 (features) Z 21022 21022 20116 0 -1 4202524 235414 0 0 0 9391 51 0 0 25 0 1 0 487944538 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21024/statm: 0 0 0 0 0 0 0
[pid=21028] ppid=21022 vsize=0 CPUtime=0.33 cores=5,7
/proc/21028/stat : 21028 (coach) Z 21022 21022 20116 0 -1 4202524 3927 0 0 0 32 1 0 0 20 0 1 0 487953980 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/21028/statm: 0 0 0 0 0 0 0
[pid=21195] ppid=21022 vsize=8700 CPUtime=0 cores=5,7
/proc/21195/stat : 21195 (timerun) S 21022 21022 20116 0 -1 4202496 749 0 0 0 0 0 0 0 19 0 1 0 488011854 8908800 247 33554432000 4194304 4922060 140734734872864 18446744073709551615 248089517189 0 65536 16781316 65538 18446744071562232103 0 0 17 7 0 0 0
/proc/21195/statm: 2175 247 208 178 0 68 0
[pid=21196] ppid=21195 vsize=574680 CPUtime=449.09 cores=5,7
/proc/21196/stat : 21196 (mxc-sat09) R 21195 21022 20116 0 -1 4202496 170265 0 0 0 44882 27 0 0 25 0 1 0 488011854 588472320 127480 33554432000 134512640 134581694 4291842240 18446744073709551615 134530724 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21196/statm: 143670 127480 205 17 0 143017 0
Current children cumulated CPU time (s) 1122.21
Current children cumulated vsize (KiB) 617848
[startup+1182.3 s]
/proc/loadavg: 4.02 4.26 4.05 6/205 21239
/proc/meminfo: memFree=6796880/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=34468 CPUtime=578.37 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 4298 14924809 0 0 2 2 55337 2496 19 0 1 0 487944534 35295232 1478 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 0
/proc/21022/statm: 8617 1478 488 379 0 937 0
[pid=21024] ppid=21022 vsize=0 CPUtime=94.42 cores=5,7
/proc/21024/stat : 21024 (features) Z 21022 21022 20116 0 -1 4202524 235414 0 0 0 9391 51 0 0 25 0 1 0 487944538 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21024/statm: 0 0 0 0 0 0 0
[pid=21028] ppid=21022 vsize=0 CPUtime=0.33 cores=5,7
/proc/21028/stat : 21028 (coach) Z 21022 21022 20116 0 -1 4202524 3927 0 0 0 32 1 0 0 20 0 1 0 487953980 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/21028/statm: 0 0 0 0 0 0 0
[pid=21195] ppid=21022 vsize=8700 CPUtime=0 cores=5,7
/proc/21195/stat : 21195 (timerun) S 21022 21022 20116 0 -1 4202496 749 0 0 0 0 0 0 0 19 0 1 0 488011854 8908800 247 33554432000 4194304 4922060 140734734872864 18446744073709551615 248089517189 0 65536 16781316 65538 18446744071562232103 0 0 17 7 0 0 0
/proc/21195/statm: 2175 247 208 178 0 68 0
[pid=21196] ppid=21195 vsize=574680 CPUtime=509.09 cores=5,7
/proc/21196/stat : 21196 (mxc-sat09) R 21195 21022 20116 0 -1 4202496 170265 0 0 0 50882 27 0 0 25 0 1 0 488011854 588472320 127480 33554432000 134512640 134581694 4291842240 18446744073709551615 134530724 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21196/statm: 143670 127480 205 17 0 143017 0
Current children cumulated CPU time (s) 1182.21
Current children cumulated vsize (KiB) 617848
[startup+1242.3 s]
/proc/loadavg: 4.01 4.21 4.05 6/205 21240
/proc/meminfo: memFree=6681044/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=34468 CPUtime=578.37 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 4298 14924809 0 0 2 2 55337 2496 19 0 1 0 487944534 35295232 1478 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 0
/proc/21022/statm: 8617 1478 488 379 0 937 0
[pid=21024] ppid=21022 vsize=0 CPUtime=94.42 cores=5,7
/proc/21024/stat : 21024 (features) Z 21022 21022 20116 0 -1 4202524 235414 0 0 0 9391 51 0 0 25 0 1 0 487944538 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21024/statm: 0 0 0 0 0 0 0
[pid=21028] ppid=21022 vsize=0 CPUtime=0.33 cores=5,7
/proc/21028/stat : 21028 (coach) Z 21022 21022 20116 0 -1 4202524 3927 0 0 0 32 1 0 0 20 0 1 0 487953980 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/21028/statm: 0 0 0 0 0 0 0
[pid=21195] ppid=21022 vsize=8700 CPUtime=0 cores=5,7
/proc/21195/stat : 21195 (timerun) S 21022 21022 20116 0 -1 4202496 749 0 0 0 0 0 0 0 19 0 1 0 488011854 8908800 247 33554432000 4194304 4922060 140734734872864 18446744073709551615 248089517189 0 65536 16781316 65538 18446744071562232103 0 0 17 7 0 0 0
/proc/21195/statm: 2175 247 208 178 0 68 0
[pid=21196] ppid=21195 vsize=593576 CPUtime=569.09 cores=5,7
/proc/21196/stat : 21196 (mxc-sat09) R 21195 21022 20116 0 -1 4202496 174982 0 0 0 56881 28 0 0 25 0 1 0 488011854 607821824 132197 33554432000 134512640 134581694 4291842240 18446744073709551615 134530881 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21196/statm: 148394 132197 205 17 0 147741 0
Current children cumulated CPU time (s) 1242.21
Current children cumulated vsize (KiB) 636744
Maximum wall clock time exceeded: sending SIGTERM then SIGKILL
[startup+1300 s]
/proc/loadavg: 4.00 4.17 4.04 6/205 21242
/proc/meminfo: memFree=6547352/32950928 swapFree=67111528/67111528
[pid=21022] ppid=21020 vsize=34468 CPUtime=578.37 cores=5,7
/proc/21022/stat : 21022 (python) S 21020 21022 20116 0 -1 4202496 4298 14924809 0 0 2 2 55337 2496 19 0 1 0 487944534 35295232 1478 33554432000 4194304 5745468 140734014281312 18446744073709551615 248089698048 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 0
/proc/21022/statm: 8617 1478 488 379 0 937 0
[pid=21024] ppid=21022 vsize=0 CPUtime=94.42 cores=5,7
/proc/21024/stat : 21024 (features) Z 21022 21022 20116 0 -1 4202524 235414 0 0 0 9391 51 0 0 25 0 1 0 487944538 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 5 0 0 0
/proc/21024/statm: 0 0 0 0 0 0 0
[pid=21028] ppid=21022 vsize=0 CPUtime=0.33 cores=5,7
/proc/21028/stat : 21028 (coach) Z 21022 21022 20116 0 -1 4202524 3927 0 0 0 32 1 0 0 20 0 1 0 487953980 0 0 33554432000 0 0 0 0 0 0 0 16781312 0 18446744073709551615 0 0 17 7 0 0 0
/proc/21028/statm: 0 0 0 0 0 0 0
[pid=21195] ppid=21022 vsize=8700 CPUtime=0 cores=5,7
/proc/21195/stat : 21195 (timerun) S 21022 21022 20116 0 -1 4202496 749 0 0 0 0 0 0 0 19 0 1 0 488011854 8908800 247 33554432000 4194304 4922060 140734734872864 18446744073709551615 248089517189 0 65536 16781316 65538 18446744071562232103 0 0 17 7 0 0 0
/proc/21195/statm: 2175 247 208 178 0 68 0
[pid=21196] ppid=21195 vsize=620044 CPUtime=626.79 cores=5,7
/proc/21196/stat : 21196 (mxc-sat09) R 21195 21022 20116 0 -1 4202496 181629 0 0 0 62650 29 0 0 25 0 1 0 488011854 634925056 138844 33554432000 134512640 134581694 4291842240 18446744073709551615 134530465 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/21196/statm: 155011 138844 205 17 0 154358 0
Current children cumulated CPU time (s) 1299.91
Current children cumulated vsize (KiB) 663212
Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds
Solver just ended. Dumping a history of the last processes samples
Child ended because it received signal 15 (SIGTERM)
# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21022 and gives
# childrusage.ru_utime.tv_sec=553
# childrusage.ru_utime.tv_usec=407869
# childrusage.ru_stime.tv_sec=24
# childrusage.ru_stime.tv_usec=997199
# CPU time returned by wait4() is 578.405
# while last known CPU time is 1299.91
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...
Real time (s): 1300.02
CPU time (s): 1299.91
CPU user time (s): 1274.12
CPU system time (s): 25.79
CPU usage (%): 99.9917
Max. virtual memory (cumulated for all children) (KiB): 3940876
getrusage(RUSAGE_CHILDREN,...) data:
user time used= 553.408
system time used= 24.9972
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 14929107
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5381
involuntary context switches= 4273
runsolver used 2.16167 second user time and 4.94125 second system time
The end
Begin job on node123 at 2011-04-25 22:30:47
IDJOB=3285536
IDBENCH=82388
IDSOLVER=1618
FILE ID=node123/3285536-1303763442
RUNJOBID= node123-1303762425-20795
PBS_JOBID= 13157133
Free space on /tmp= 65812 MiB
SOLVER NAME= Coach 2011-03-18
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
COMMAND LINE= python portfolio_solver.py -t TIMELIMIT -s RANDOMSEED BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3285536-1303763442/watcher-3285536-1303763442 -o /tmp/evaluation-result-3285536-1303763442/solver-3285536-1303763442 -C 2400 -W 1300 -M 7680 python portfolio_solver.py -t 2400 -s 685425533 HOME/instance-3285536-1303763442.cnf
TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2
MD5SUM BENCH= 48f03e5fbe31fc85b9a464480fc8aa5a
RANDOM SEED=685425533
node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009
/proc/cpuinfo:
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.838
cache size : 8192 KB
physical id : 0
siblings : 4
core id : 0
cpu cores : 4
apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5333.67
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.838
cache size : 8192 KB
physical id : 1
siblings : 4
core id : 0
cpu cores : 4
apicid : 16
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5226.15
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 2
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.838
cache size : 8192 KB
physical id : 0
siblings : 4
core id : 1
cpu cores : 4
apicid : 2
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.75
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 3
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.838
cache size : 8192 KB
physical id : 1
siblings : 4
core id : 1
cpu cores : 4
apicid : 18
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.82
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 4
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.838
cache size : 8192 KB
physical id : 0
siblings : 4
core id : 2
cpu cores : 4
apicid : 4
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.74
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 5
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.838
cache size : 8192 KB
physical id : 1
siblings : 4
core id : 2
cpu cores : 4
apicid : 20
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.80
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 6
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.838
cache size : 8192 KB
physical id : 0
siblings : 4
core id : 3
cpu cores : 4
apicid : 6
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.74
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
processor : 7
vendor_id : GenuineIntel
cpu family : 6
model : 26
model name : Intel(R) Xeon(R) CPU X5550 @ 2.67GHz
stepping : 5
cpu MHz : 2666.838
cache size : 8192 KB
physical id : 1
siblings : 4
core id : 3
cpu cores : 4
apicid : 22
fpu : yes
fpu_exception : yes
cpuid level : 11
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips : 5332.83
clflush size : 64
cache_alignment : 64
address sizes : 40 bits physical, 48 bits virtual
power management: [8]
/proc/meminfo:
MemTotal: 32950928 kB
MemFree: 7545232 kB
Buffers: 2155272 kB
Cached: 21990120 kB
SwapCached: 0 kB
Active: 9417560 kB
Inactive: 15432112 kB
HighTotal: 0 kB
HighFree: 0 kB
LowTotal: 32950928 kB
LowFree: 7545232 kB
SwapTotal: 67111528 kB
SwapFree: 67111528 kB
Dirty: 206544 kB
Writeback: 0 kB
AnonPages: 703508 kB
Mapped: 17744 kB
Slab: 487788 kB
PageTables: 6964 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
CommitLimit: 83586992 kB
Committed_AS: 994616 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total: 0
HugePages_Free: 0
HugePages_Rsvd: 0
Hugepagesize: 2048 kB
Free space on /tmp at the end= 65636 MiB
End job on node123 at 2011-04-25 22:52:29