Trace number 3743174

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB11: SCIP spx E_2 2011-06-10 (fixed)? (TO) 1802.27 1802.57

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_10null20mast_rapportOE1.0_TMAX300_K192_cod2.opb
MD5SUM8d651cc878ba5f8db7c83d3bfed1cb1c
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-98026
Best CPU time to get the best result obtained on this benchmark1800.85
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400896
Total number of constraints402763
Number of constraints which are clauses400785
Number of constraints which are cardinality constraints (but not clauses)194
Number of constraints which are nor clauses,nor cardinality constraints1784
Minimum length of a constraint2
Maximum length of a constraint58023
Number of terms in the objective function 1605
Biggest coefficient in the objective function 1000
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 987807
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 1000
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 987807
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c SCIP version 2.0.1.5 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.5.0.5]
0.00/0.00	c Copyright (c) 2002-2011 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3743174-1338795493.opb>
3.58/3.63	c original problem has 400896 variables (400896 bin, 0 int, 0 impl, 0 cont) and 402763 constraints
3.58/3.63	c problem read
3.58/3.63	c presolving settings loaded
5.49/5.57	c presolving:
8.28/8.36	c (round 1) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 398809 upgd conss, 67806 impls, 1977 clqs
9.09/9.13	c (round 2) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 67806 impls, 1977 clqs
82.07/82.12	c (round 3) 679 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12261460 impls, 1977 clqs
82.27/82.32	c (round 4) 679 del vars, 2653 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12265462 impls, 1977 clqs
83.47/83.52	c (round 5) 2683 del vars, 2653 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12300072 impls, 1977 clqs
83.67/83.71	c (round 6) 2683 del vars, 4657 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12300084 impls, 1977 clqs
268.24/268.37	c (round 7) 3353 del vars, 4657 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 19086958 impls, 1977 clqs
268.44/268.56	c (round 8) 3353 del vars, 5324 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 19086966 impls, 1977 clqs

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3743174-1338795493/watcher-3743174-1338795493 -o /tmp/evaluation-result-3743174-1338795493/solver-3743174-1338795493 -C 1800 -W 1900 -M 15500 HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3743174-1338795493.opb -t 1800 -m 15500 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.04 2.02 2.00 2/176 13215
/proc/meminfo: memFree=29426256/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=9456 CPUtime=0 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1489 0 0 0 0 0 0 0 20 0 1 0 345673923 9682944 1443 33554432000 4194304 9016284 140735067604896 140733269848184 5705070 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/13215/statm: 2364 1444 311 1178 0 1182 0

[startup+0.099144 s]
/proc/loadavg: 2.04 2.02 2.00 2/176 13215
/proc/meminfo: memFree=29426256/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=34688 CPUtime=0.09 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 7679 0 0 0 8 1 0 0 20 0 1 0 345673923 35520512 7633 33554432000 4194304 9016284 140735067604896 140733269848184 7749104 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/13215/statm: 8672 7633 360 1178 0 7490 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 34688

[startup+0.100295 s]
/proc/loadavg: 2.04 2.02 2.00 2/176 13215
/proc/meminfo: memFree=29426256/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=35712 CPUtime=0.09 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 7827 0 0 0 8 1 0 0 20 0 1 0 345673923 36569088 7781 33554432000 4194304 9016284 140735067604896 140733269848184 6813403 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/13215/statm: 8928 7802 360 1178 0 7746 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 35712

[startup+0.30026 s]
/proc/loadavg: 2.04 2.02 2.00 2/176 13215
/proc/meminfo: memFree=29426256/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=61612 CPUtime=0.29 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 14397 0 0 0 27 2 0 0 20 0 1 0 345673923 63090688 14351 33554432000 4194304 9016284 140735067604896 140733269848184 7870448 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/13215/statm: 15403 14351 360 1178 0 14221 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 61612

[startup+0.700266 s]
/proc/loadavg: 2.04 2.02 2.00 2/176 13215
/proc/meminfo: memFree=29426256/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=113088 CPUtime=0.69 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 27084 0 0 0 65 4 0 0 20 0 1 0 345673923 115802112 27039 33554432000 4194304 9016284 140735067604896 140735067468792 6813403 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/13215/statm: 28272 27076 360 1178 0 27090 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 113088

[startup+1.50017 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 13216
/proc/meminfo: memFree=29276076/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=228372 CPUtime=1.49 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 55950 0 0 0 140 9 0 0 20 0 1 0 345673923 233852928 55904 33554432000 4194304 9016284 140735067604896 140735067468760 7842249 0 0 4096 0 0 0 0 17 6 0 0 0 0 0
/proc/13215/statm: 57093 55904 360 1178 0 55911 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 228372

[startup+3.10028 s]
/proc/loadavg: 2.11 2.03 2.01 3/177 13216
/proc/meminfo: memFree=29055860/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=451460 CPUtime=3.08 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 111824 0 0 0 291 17 0 0 20 0 1 0 345673923 462295040 111778 33554432000 4194304 9016284 140735067604896 140735067468792 4992855 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/13215/statm: 112865 111778 360 1178 0 111683 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 451460

[startup+6.30027 s]
/proc/loadavg: 2.11 2.03 2.01 3/177 13216
/proc/meminfo: memFree=28261332/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=1197580 CPUtime=6.28 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 295580 0 0 0 583 45 0 0 20 0 1 0 345673923 1226321920 296996 33554432000 4194304 9016284 140735067604896 140735067600536 5230839 0 0 4096 16384 0 0 0 17 0 0 0 0 0 0
/proc/13215/statm: 299395 296996 474 1178 0 298213 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 1197580

[startup+12.7003 s]
/proc/loadavg: 2.10 2.03 2.01 3/177 13216
/proc/meminfo: memFree=27933028/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=1508032 CPUtime=12.68 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 407625 0 0 0 1203 65 0 0 20 0 1 0 345673923 1544224768 373185 33554432000 4194304 9016284 140735067604896 140735067600488 6480376 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 377008 373185 529 1178 0 375826 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1508032

[startup+25.5003 s]
/proc/loadavg: 2.08 2.03 2.00 3/177 13216
/proc/meminfo: memFree=27845592/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=1608552 CPUtime=25.47 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 432020 0 0 0 2479 68 0 0 20 0 1 0 345673923 1647157248 397580 33554432000 4194304 9016284 140735067604896 140735067600488 4937441 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 402138 397580 529 1178 0 400956 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 1608552

[startup+51.1003 s]
/proc/loadavg: 2.05 2.03 2.00 3/177 13216
/proc/meminfo: memFree=27646964/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=1804684 CPUtime=51.07 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 480822 0 0 0 5032 75 0 0 20 0 1 0 345673923 1847996416 446382 33554432000 4194304 9016284 140735067604896 140735067600488 6480403 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 451171 446382 529 1178 0 449989 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 1804684

[startup+102.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 13216
/proc/meminfo: memFree=27414136/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=2041788 CPUtime=102.27 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 539953 0 0 0 10143 84 0 0 20 0 1 0 345673923 2090790912 504488 33554432000 4194304 9016284 140735067604896 140735067600488 6480403 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 510447 504488 529 1178 0 509265 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 2041788

[startup+162.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/178 13219
/proc/meminfo: memFree=27143576/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=2309704 CPUtime=162.26 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 586713 0 0 0 16133 93 0 0 20 0 1 0 345673923 2365136896 570155 33554432000 4194304 9016284 140735067604896 140735067600488 6480403 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 577426 570155 529 1178 0 576244 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 2309704

[startup+222.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 13220
/proc/meminfo: memFree=27125004/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=2323848 CPUtime=222.25 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 590121 0 0 0 22132 93 0 0 20 0 1 0 345673923 2379620352 573563 33554432000 4194304 9016284 140735067604896 140735067600488 6480425 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 580962 573563 529 1178 0 579780 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 2323848

[startup+282.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 13220
/proc/meminfo: memFree=26950748/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=2502748 CPUtime=282.24 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 632724 0 0 0 28123 101 0 0 20 0 1 0 345673923 2562813952 616286 33554432000 4194304 9016284 140735067604896 140735067600280 6480389 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 625687 616286 529 1178 0 624505 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 2502748

[startup+342.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/177 13220
/proc/meminfo: memFree=26673448/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=2777132 CPUtime=342.23 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 700373 0 0 0 34111 112 0 0 20 0 1 0 345673923 2843783168 683935 33554432000 4194304 9016284 140735067604896 140735067600280 6480421 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 694283 683935 529 1178 0 693101 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 2777132

[startup+402.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 13220
/proc/meminfo: memFree=26489452/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=2973104 CPUtime=402.22 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 747687 0 0 0 40101 121 0 0 20 0 1 0 345673923 3044458496 731249 33554432000 4194304 9016284 140735067604896 140735067600280 6480393 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 743276 731249 529 1178 0 742094 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 2973104

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 13220
/proc/meminfo: memFree=26216560/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=3248364 CPUtime=462.22 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 813322 0 0 0 46090 132 0 0 20 0 1 0 345673923 3326324736 796884 33554432000 4194304 9016284 140735067604896 140735067600280 6480403 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 812091 796884 529 1178 0 810909 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 3248364

[startup+522.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 13221
/proc/meminfo: memFree=26189516/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=3264064 CPUtime=522.2 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 819929 0 0 0 52086 134 0 0 20 0 1 0 345673923 3342401536 803491 33554432000 4194304 9016284 140735067604896 140735067600280 6480421 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 816016 803491 529 1178 0 814834 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 3264064

[startup+582.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13221
/proc/meminfo: memFree=26023348/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=3438288 CPUtime=582.2 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 860979 0 0 0 58078 142 0 0 20 0 1 0 345673923 3520806912 844541 33554432000 4194304 9016284 140735067604896 140735067600280 6480372 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 859572 844541 529 1178 0 858390 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 3438288

[startup+642.3 s]

################
# More data... #
################

/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 990967 0 0 0 106039 172 0 0 20 0 1 0 345673923 4041744384 977758 33554432000 4194304 9016284 140735067604896 140735067600280 6480425 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 986754 977758 529 1178 0 985572 0
Current children cumulated CPU time (s) 1062.11
Current children cumulated vsize (KiB) 3947016

[startup+1122.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 13264
/proc/meminfo: memFree=23874852/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4221608 CPUtime=1122.1 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1050905 0 0 0 112029 181 0 0 20 0 1 0 345673923 4322926592 1038916 33554432000 4194304 9016284 140735067604896 140735067600280 6480360 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1055402 1038916 529 1178 0 1054220 0
Current children cumulated CPU time (s) 1122.1
Current children cumulated vsize (KiB) 4221608

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13264
/proc/meminfo: memFree=23838856/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4233896 CPUtime=1182.09 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1056309 0 0 0 118025 184 0 0 20 0 1 0 345673923 4335509504 1045457 33554432000 4194304 9016284 140735067604896 140735067600280 6480389 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1058474 1045457 529 1178 0 1057292 0
Current children cumulated CPU time (s) 1182.09
Current children cumulated vsize (KiB) 4233896

[startup+1242.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13264
/proc/meminfo: memFree=23570732/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4245156 CPUtime=1242.09 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1061091 0 0 0 124024 185 0 0 20 0 1 0 345673923 4347039744 1050566 33554432000 4194304 9016284 140735067604896 140735067600280 6480389 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1061289 1050566 529 1178 0 1060107 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 4245156

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13264
/proc/meminfo: memFree=23366160/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4254372 CPUtime=1302.07 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1064904 0 0 0 130020 187 0 0 20 0 1 0 345673923 4356476928 1054994 33554432000 4194304 9016284 140735067604896 140735067600280 6480407 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1063593 1054994 529 1178 0 1062411 0
Current children cumulated CPU time (s) 1302.07
Current children cumulated vsize (KiB) 4254372

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 13267
/proc/meminfo: memFree=23248256/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4260516 CPUtime=1362.06 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1067451 0 0 0 136018 188 0 0 20 0 1 0 345673923 4362768384 1057765 33554432000 4194304 9016284 140735067604896 140735067600280 6480416 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1065129 1057765 529 1178 0 1063947 0
Current children cumulated CPU time (s) 1362.06
Current children cumulated vsize (KiB) 4260516

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 13291
/proc/meminfo: memFree=23131476/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4261540 CPUtime=1422.05 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1068291 0 0 0 142016 189 0 0 20 0 1 0 345673923 4363816960 1058994 33554432000 4194304 9016284 140735067604896 140735067600280 6480407 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1065385 1058994 529 1178 0 1064203 0
Current children cumulated CPU time (s) 1422.05
Current children cumulated vsize (KiB) 4261540

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 13291
/proc/meminfo: memFree=23004908/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4265636 CPUtime=1482.05 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1069914 0 0 0 148015 190 0 0 20 0 1 0 345673923 4368011264 1060869 33554432000 4194304 9016284 140735067604896 140735067600280 6480372 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1066409 1060869 529 1178 0 1065227 0
Current children cumulated CPU time (s) 1482.05
Current children cumulated vsize (KiB) 4265636

[startup+1542.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 13291
/proc/meminfo: memFree=22857376/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4270752 CPUtime=1542.03 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1072038 0 0 0 154013 190 0 0 20 0 1 0 345673923 4373250048 1063167 33554432000 4194304 9016284 140735067604896 140735067600280 6480389 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1067688 1063167 529 1178 0 1066506 0
Current children cumulated CPU time (s) 1542.03
Current children cumulated vsize (KiB) 4270752

[startup+1602.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 13291
/proc/meminfo: memFree=22820328/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4275760 CPUtime=1602.02 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1074245 0 0 0 160011 191 0 0 20 0 1 0 345673923 4378378240 1065374 33554432000 4194304 9016284 140735067604896 140735067600280 6480372 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1068940 1065374 529 1178 0 1067758 0
Current children cumulated CPU time (s) 1602.02
Current children cumulated vsize (KiB) 4275760

[startup+1662.3 s]
/proc/loadavg: 2.05 2.02 2.00 3/177 13291
/proc/meminfo: memFree=22393796/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4601692 CPUtime=1662.01 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1143937 0 0 0 165999 202 0 0 20 0 1 0 345673923 4712132608 1135327 33554432000 4194304 9016284 140735067604896 140735067600280 6480389 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1150423 1135327 529 1178 0 1149241 0
Current children cumulated CPU time (s) 1662.01
Current children cumulated vsize (KiB) 4601692

[startup+1722.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 13292
/proc/meminfo: memFree=22368404/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4607836 CPUtime=1722 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1146575 0 0 0 171996 204 0 0 20 0 1 0 345673923 4718424064 1137965 33554432000 4194304 9016284 140735067604896 140735067600280 6480425 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1151959 1137965 529 1178 0 1150777 0
Current children cumulated CPU time (s) 1722
Current children cumulated vsize (KiB) 4607836

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 13292
/proc/meminfo: memFree=22339044/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4616028 CPUtime=1782 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1150017 0 0 0 177995 205 0 0 20 0 1 0 345673923 4726812672 1141720 33554432000 4194304 9016284 140735067604896 140735067600280 6480372 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1154007 1141720 529 1178 0 1152825 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 4616028



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 13292
/proc/meminfo: memFree=22331448/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4617052 CPUtime=1800.1 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1150673 0 0 0 179804 206 0 0 20 0 1 0 345673923 4727861248 1142376 33554432000 4194304 9016284 140735067604896 140735067600280 6480372 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1154263 1142376 529 1178 0 1153081 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 4617052

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -13215

Solver just ended. Dumping a history of the last processes samples

[startup+1801.8 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 13293
/proc/meminfo: memFree=22330944/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4617052 CPUtime=1801.49 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1150705 0 0 0 179943 206 0 0 20 0 1 0 345673923 4727861248 1142408 33554432000 4194304 9016284 140735067604896 140735067599744 6480372 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1154263 1142408 529 1178 0 1153081 0
Current children cumulated CPU time (s) 1801.49
Current children cumulated vsize (KiB) 4617052

[startup+1802.21 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 13293
/proc/meminfo: memFree=22329580/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4617052 CPUtime=1801.9 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1150711 0 0 0 179984 206 0 0 20 0 1 0 345673923 4727861248 1142414 33554432000 4194304 9016284 140735067604896 140735067599744 6480403 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1154263 1142414 529 1178 0 1153081 0
Current children cumulated CPU time (s) 1801.9
Current children cumulated vsize (KiB) 4617052

[startup+1802.4 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 13293
/proc/meminfo: memFree=22329580/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=4617052 CPUtime=1802.09 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4202496 1150715 0 0 0 180003 206 0 0 20 0 1 0 345673923 4727861248 1142418 33554432000 4194304 9016284 140735067604896 140735067599744 6480360 0 0 4096 16384 0 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 1154263 1142418 529 1178 0 1153081 0
Current children cumulated CPU time (s) 1802.09
Current children cumulated vsize (KiB) 4617052

[startup+1802.5 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 13293
/proc/meminfo: memFree=22329580/32873844 swapFree=7900/7900
[pid=13215] ppid=13213 vsize=0 CPUtime=1802.19 cores=0,2,4,6
/proc/13215/stat : 13215 (scip-2.0.1.4b_2) R 13213 13215 12511 0 -1 4203524 1150715 0 0 0 180004 215 0 0 20 0 1 0 345673923 0 0 33554432000 0 0 0 0 0 0 0 4096 16384 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/13215/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1802.19
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.57
CPU time (s): 1802.27
CPU user time (s): 1800.04
CPU system time (s): 2.22366
CPU usage (%): 99.9834
Max. virtual memory (cumulated for all children) (KiB): 4617052

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.04
system time used= 2.22366
maximum resident set size= 4569672
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1150715
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 38
involuntary context switches= 2029

runsolver used 4.53731 second user time and 12.5541 second system time

The end

Launcher Data

Begin job on node137 at 2012-06-04 09:38:14
IDJOB=3743174
IDBENCH=90877
IDSOLVER=2329
FILE ID=node137/3743174-1338795493
RUNJOBID= node137-1338783823-12527
PBS_JOBID= 14636842
Free space on /tmp= 70280 MiB

SOLVER NAME= PB11: SCIP spx E_2 2011-06-10 (fixed)
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/NG/normalized-NG.dot_unif_10null20mast_rapportOE1.0_TMAX300_K192_cod2.opb
COMMAND LINE= HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3743174-1338795493/watcher-3743174-1338795493 -o /tmp/evaluation-result-3743174-1338795493/solver-3743174-1338795493 -C 1800 -W 1900 -M 15500  HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3743174-1338795493.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8d651cc878ba5f8db7c83d3bfed1cb1c
RANDOM SEED=2033016384

node137.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29426900 kB
Buffers:          291628 kB
Cached:          1346680 kB
SwapCached:         5796 kB
Active:          1872304 kB
Inactive:         747372 kB
Active(anon):     976436 kB
Inactive(anon):     7168 kB
Active(file):     895868 kB
Inactive(file):   740204 kB
Unevictable:        7900 kB
Mlocked:            7900 kB
SwapTotal:      67108856 kB
SwapFree:       67097500 kB
Dirty:             44340 kB
Writeback:            40 kB
AnonPages:        985336 kB
Mapped:            12000 kB
Shmem:                 0 kB
Slab:             686216 kB
SReclaimable:     127100 kB
SUnreclaim:       559116 kB
KernelStack:        1440 kB
PageTables:         5724 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1122808 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:     36864 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70240 MiB
End job on node137 at 2012-06-04 10:08:17