Trace number 3743185

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB11: SCIP spx E_2 2011-06-10 (fixed)? (TO) 1802.31 1802.61

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null20mast_rapportOE1.0_TMAX300_K192_cod2.opb
MD5SUMecfb37e57149da15322fff965cafdd0d
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark-60544
Best CPU time to get the best result obtained on this benchmark1010.68
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400896
Total number of constraints402763
Number of constraints which are clauses400785
Number of constraints which are cardinality constraints (but not clauses)194
Number of constraints which are nor clauses,nor cardinality constraints1784
Minimum length of a constraint2
Maximum length of a constraint58023
Number of terms in the objective function 1605
Biggest coefficient in the objective function 1024
Number of bits for the biggest coefficient in the objective function 11
Sum of the numbers in the objective function 370126
Number of bits of the sum of numbers in the objective function 19
Biggest number in a constraint 1024
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 370126
Number of bits of the biggest sum of numbers19
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c SCIP version 2.0.1.5 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.5.0.5]
0.00/0.00	c Copyright (c) 2002-2011 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3743185-1338795721.opb>
3.39/3.45	c original problem has 400896 variables (400896 bin, 0 int, 0 impl, 0 cont) and 402763 constraints
3.39/3.45	c problem read
3.39/3.46	c presolving settings loaded
5.18/5.25	c presolving:
7.88/7.91	c (round 1) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 398809 upgd conss, 67806 impls, 1977 clqs
8.58/8.68	c (round 2) 0 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 67806 impls, 1977 clqs
80.87/80.91	c (round 3) 679 del vars, 1977 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12261460 impls, 1977 clqs
81.07/81.11	c (round 4) 679 del vars, 2653 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12265462 impls, 1977 clqs
82.27/82.30	c (round 5) 2683 del vars, 2653 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12300072 impls, 1977 clqs
82.37/82.50	c (round 6) 2683 del vars, 4657 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 12300084 impls, 1977 clqs
267.85/267.96	c (round 7) 3353 del vars, 4657 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 19086958 impls, 1977 clqs
268.05/268.15	c (round 8) 3353 del vars, 5324 del conss, 0 add conss, 0 chg bounds, 0 chg sides, 0 chg coeffs, 400786 upgd conss, 19086966 impls, 1977 clqs

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3743185-1338795721/watcher-3743185-1338795721 -o /tmp/evaluation-result-3743185-1338795721/solver-3743185-1338795721 -C 1800 -W 1900 -M 15500 HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3743185-1338795721.opb -t 1800 -m 15500 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 12408
/proc/meminfo: memFree=26287908/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=7628 CPUtime=0 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 628 0 0 0 0 0 0 0 20 0 1 0 345698214 7811072 582 33554432000 4194304 9016284 140734820407840 140734617369672 7870589 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1907 592 189 1178 0 725 0

[startup+0.059218 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 12408
/proc/meminfo: memFree=26287908/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=29152 CPUtime=0.04 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 6257 0 0 0 4 0 0 0 20 0 1 0 345698214 29851648 6211 33554432000 4194304 9016284 140734820407840 140734617369672 6813403 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 7288 6211 360 1178 0 6106 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 29152

[startup+0.100243 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 12408
/proc/meminfo: memFree=26287908/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=35940 CPUtime=0.09 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 7952 0 0 0 8 1 0 0 20 0 1 0 345698214 36802560 7906 33554432000 4194304 9016284 140734820407840 140734617369672 6813403 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 8985 7906 360 1178 0 7803 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 35940

[startup+0.300167 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 12408
/proc/meminfo: memFree=26287908/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=63100 CPUtime=0.29 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 14756 0 0 0 27 2 0 0 20 0 1 0 345698214 64614400 14710 33554432000 4194304 9016284 140734820407840 140734617369672 7937002 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 15775 14710 360 1178 0 14593 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 63100

[startup+0.700164 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 12408
/proc/meminfo: memFree=26287908/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=118496 CPUtime=0.68 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 28590 0 0 0 64 4 0 0 20 0 1 0 345698214 121339904 28544 33554432000 4194304 9016284 140734820407840 140734820271736 7875262 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 29624 28544 360 1178 0 28442 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 118496

[startup+1.50017 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12409
/proc/meminfo: memFree=26126460/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=242820 CPUtime=1.49 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 59609 0 0 0 140 9 0 0 20 0 1 0 345698214 248647680 59563 33554432000 4194304 9016284 140734820407840 140734820271736 7749204 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 60705 59563 360 1178 0 59523 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 242820

[startup+3.10017 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 12409
/proc/meminfo: memFree=25956664/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=454536 CPUtime=3.09 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 112595 0 0 0 295 14 0 0 20 0 1 0 345698214 465444864 112549 33554432000 4194304 9016284 140734820407840 140734820271736 7928096 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 113634 112549 360 1178 0 112452 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 454536

[startup+6.3003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12410
/proc/meminfo: memFree=25114072/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=1252132 CPUtime=6.29 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 308841 0 0 0 587 42 0 0 20 0 1 0 345698214 1282183168 310541 33554432000 4194304 9016284 140734820407840 140734820403928 6813442 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 313033 310541 487 1178 0 311851 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1252132

[startup+12.7002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12410
/proc/meminfo: memFree=24778308/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=1509596 CPUtime=12.69 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 406086 0 0 0 1210 59 0 0 20 0 1 0 345698214 1545826304 373179 33554432000 4194304 9016284 140734820407840 140734820403432 6480376 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 377399 373179 529 1178 0 376217 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1509596

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12410
/proc/meminfo: memFree=24651684/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=1613132 CPUtime=25.49 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 431475 0 0 0 2486 63 0 0 20 0 1 0 345698214 1651847168 398568 33554432000 4194304 9016284 140734820407840 140734820403288 6469453 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 403283 398568 529 1178 0 402101 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1613132

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12410
/proc/meminfo: memFree=24427196/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=1809776 CPUtime=51.07 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 480587 0 0 0 5038 69 0 0 20 0 1 0 345698214 1853210624 447680 33554432000 4194304 9016284 140734820407840 140734820403224 4460361 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 452444 447680 529 1178 0 451262 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 1809776

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12410
/proc/meminfo: memFree=24103848/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=2046568 CPUtime=102.28 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 539160 0 0 0 10150 78 0 0 20 0 1 0 345698214 2095685632 505228 33554432000 4194304 9016284 140734820407840 140734820403432 6480364 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 511642 505228 529 1178 0 510460 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 2046568

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12410
/proc/meminfo: memFree=23766332/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=2311612 CPUtime=162.26 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 584260 0 0 0 16141 85 0 0 20 0 1 0 345698214 2367090688 570257 33554432000 4194304 9016284 140734820407840 140734820403432 6480376 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 577903 570257 529 1178 0 576721 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 2311612

[startup+222.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12410
/proc/meminfo: memFree=23675348/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=2323852 CPUtime=222.25 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 587258 0 0 0 22140 85 0 0 20 0 1 0 345698214 2379624448 573255 33554432000 4194304 9016284 140734820407840 140734820403432 6480393 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 580963 573255 529 1178 0 579781 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 2323852

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12410
/proc/meminfo: memFree=23402884/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=2502752 CPUtime=282.24 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 629794 0 0 0 28131 93 0 0 20 0 1 0 345698214 2562818048 615911 33554432000 4194304 9016284 140734820407840 140734820403224 6480360 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 625688 615911 529 1178 0 624506 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 2502752

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12411
/proc/meminfo: memFree=23056460/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=2777136 CPUtime=342.23 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 697443 0 0 0 34116 107 0 0 20 0 1 0 345698214 2843787264 683560 33554432000 4194304 9016284 140734820407840 140734820403224 6480389 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 694284 683560 529 1178 0 693102 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 2777136

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12411
/proc/meminfo: memFree=22771536/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=2973108 CPUtime=402.22 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 744782 0 0 0 40107 115 0 0 20 0 1 0 345698214 3044462592 730899 33554432000 4194304 9016284 140734820407840 140734820403224 6480372 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 743277 730899 529 1178 0 742095 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 2973108

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12411
/proc/meminfo: memFree=22441476/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=3248368 CPUtime=462.21 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 810385 0 0 0 46094 127 0 0 20 0 1 0 345698214 3326328832 796502 33554432000 4194304 9016284 140734820407840 140734820403224 6480407 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 812092 796502 529 1178 0 810910 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 3248368

[startup+522.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12414
/proc/meminfo: memFree=22335856/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=3264068 CPUtime=522.2 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 817000 0 0 0 52089 131 0 0 20 0 1 0 345698214 3342405632 803117 33554432000 4194304 9016284 140734820407840 140734820403224 6480389 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 816017 803117 529 1178 0 814835 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 3264068

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12414
/proc/meminfo: memFree=22088512/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=3438292 CPUtime=582.19 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 858044 0 0 0 58080 139 0 0 20 0 1 0 345698214 3520811008 844161 33554432000 4194304 9016284 140734820407840 140734820403224 6480376 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 859573 844161 529 1178 0 858391 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 3438292

[startup+642.3 s]

################
# More data... #
################

/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 987941 0 0 0 106041 170 0 0 20 0 1 0 345698214 4041748480 974058 33554432000 4194304 9016284 140734820407840 140734820403224 6480398 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 986755 974058 529 1178 0 985573 0
Current children cumulated CPU time (s) 1062.11
Current children cumulated vsize (KiB) 3947020

[startup+1122.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 12419
/proc/meminfo: memFree=20686248/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4220588 CPUtime=1122.1 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1047682 0 0 0 112031 179 0 0 20 0 1 0 345698214 4321882112 1033799 33554432000 4194304 9016284 140734820407840 140734820403224 6480407 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1055147 1033799 529 1178 0 1053965 0
Current children cumulated CPU time (s) 1122.1
Current children cumulated vsize (KiB) 4220588

[startup+1182.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 12480
/proc/meminfo: memFree=23753908/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4233900 CPUtime=1182.09 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1053300 0 0 0 118028 181 0 0 20 0 1 0 345698214 4335513600 1039417 33554432000 4194304 9016284 140734820407840 140734820403224 6480403 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1058475 1039417 529 1178 0 1057293 0
Current children cumulated CPU time (s) 1182.09
Current children cumulated vsize (KiB) 4233900

[startup+1242.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12481
/proc/meminfo: memFree=22038108/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4245160 CPUtime=1242.08 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1058197 0 0 0 124024 184 0 0 20 0 1 0 345698214 4347043840 1044536 33554432000 4194304 9016284 140734820407840 140734820403224 6480376 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1061290 1044536 529 1178 0 1060108 0
Current children cumulated CPU time (s) 1242.08
Current children cumulated vsize (KiB) 4245160

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12481
/proc/meminfo: memFree=21690688/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4255400 CPUtime=1302.07 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1062632 0 0 0 130022 185 0 0 20 0 1 0 345698214 4357529600 1049401 33554432000 4194304 9016284 140734820407840 140734820403224 6480393 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1063850 1049401 529 1178 0 1062668 0
Current children cumulated CPU time (s) 1302.07
Current children cumulated vsize (KiB) 4255400

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12481
/proc/meminfo: memFree=21514872/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4260520 CPUtime=1362.06 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1064832 0 0 0 136020 186 0 0 20 0 1 0 345698214 4362772480 1051877 33554432000 4194304 9016284 140734820407840 140734820403224 6480372 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1065130 1051877 529 1178 0 1063948 0
Current children cumulated CPU time (s) 1362.06
Current children cumulated vsize (KiB) 4260520

[startup+1422.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 12481
/proc/meminfo: memFree=21403484/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4264616 CPUtime=1422.06 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1066597 0 0 0 142018 188 0 0 20 0 1 0 345698214 4366966784 1054100 33554432000 4194304 9016284 140734820407840 140734820403224 6480421 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1066154 1054100 529 1178 0 1064972 0
Current children cumulated CPU time (s) 1422.06
Current children cumulated vsize (KiB) 4264616

[startup+1482.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 12481
/proc/meminfo: memFree=21055944/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4269732 CPUtime=1482.04 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1068833 0 0 0 148015 189 0 0 20 0 1 0 345698214 4372205568 1056906 33554432000 4194304 9016284 140734820407840 140734820403224 6480389 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1067433 1056906 529 1178 0 1066251 0
Current children cumulated CPU time (s) 1482.04
Current children cumulated vsize (KiB) 4269732

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12482
/proc/meminfo: memFree=20832368/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4277812 CPUtime=1542.03 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1072035 0 0 0 154013 190 0 0 20 0 1 0 345698214 4380479488 1060553 33554432000 4194304 9016284 140734820407840 140734820403224 6480403 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1069453 1060553 529 1178 0 1068271 0
Current children cumulated CPU time (s) 1542.03
Current children cumulated vsize (KiB) 4277812

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12482
/proc/meminfo: memFree=20420964/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4603744 CPUtime=1602.02 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1141995 0 0 0 160001 201 0 0 20 0 1 0 345698214 4714233856 1130990 33554432000 4194304 9016284 140734820407840 140734820403224 6480389 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1150936 1130990 529 1178 0 1149754 0
Current children cumulated CPU time (s) 1602.02
Current children cumulated vsize (KiB) 4603744

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12482
/proc/meminfo: memFree=20252480/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4610912 CPUtime=1662.01 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1145282 0 0 0 165998 203 0 0 20 0 1 0 345698214 4721573888 1134481 33554432000 4194304 9016284 140734820407840 140734820403224 6480376 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1152728 1134481 529 1178 0 1151546 0
Current children cumulated CPU time (s) 1662.01
Current children cumulated vsize (KiB) 4610912

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12485
/proc/meminfo: memFree=20068608/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4622176 CPUtime=1722 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1149807 0 0 0 171995 205 0 0 20 0 1 0 345698214 4733108224 1140616 33554432000 4194304 9016284 140734820407840 140734820403224 6480364 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1155544 1140616 529 1178 0 1154362 0
Current children cumulated CPU time (s) 1722
Current children cumulated vsize (KiB) 4622176

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12485
/proc/meminfo: memFree=20027972/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4631388 CPUtime=1782 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1153781 0 0 0 177993 207 0 0 20 0 1 0 345698214 4742541312 1145337 33554432000 4194304 9016284 140734820407840 140734820403224 6480376 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1157847 1145337 529 1178 0 1156665 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 4631388



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 12485
/proc/meminfo: memFree=20015788/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4634460 CPUtime=1800.09 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1155080 0 0 0 179802 207 0 0 20 0 1 0 345698214 4745687040 1146879 33554432000 4194304 9016284 140734820407840 140734820403224 6480425 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1158615 1146879 529 1178 0 1157433 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 4634460

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -12408

Solver just ended. Dumping a history of the last processes samples

[startup+1801.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12486
/proc/meminfo: memFree=20015780/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4634460 CPUtime=1801.18 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1155099 0 0 0 179911 207 0 0 20 0 1 0 345698214 4745687040 1146898 33554432000 4194304 9016284 140734820407840 140734820402688 6480421 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1158615 1146898 529 1178 0 1157433 0
Current children cumulated CPU time (s) 1801.18
Current children cumulated vsize (KiB) 4634460

[startup+1802.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12486
/proc/meminfo: memFree=20015408/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=4634460 CPUtime=1801.98 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4202496 1155121 0 0 0 179991 207 0 0 20 0 1 0 345698214 4745687040 1146920 33554432000 4194304 9016284 140734820407840 140734820402688 6480407 0 0 4096 16384 0 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 1158615 1146920 529 1178 0 1157433 0
Current children cumulated CPU time (s) 1801.98
Current children cumulated vsize (KiB) 4634460

[startup+1802.5 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12486
/proc/meminfo: memFree=20015408/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=0 CPUtime=1802.19 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4203524 1155122 0 0 0 180002 217 0 0 20 0 1 0 345698214 0 0 33554432000 0 0 0 0 0 0 0 4096 16384 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1802.19
Current children cumulated vsize (KiB) 0

[startup+1802.6 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 12486
/proc/meminfo: memFree=20015408/32873648 swapFree=6864/6864
[pid=12408] ppid=12406 vsize=0 CPUtime=1802.29 cores=1,3,5,7
/proc/12408/stat : 12408 (scip-2.0.1.4b_2) R 12406 12408 9205 0 -1 4203524 1155122 0 0 0 180002 227 0 0 20 0 1 0 345698214 0 0 33554432000 0 0 0 0 0 0 0 4096 16384 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/12408/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1802.29
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.61
CPU time (s): 1802.31
CPU user time (s): 1800.03
CPU system time (s): 2.28365
CPU usage (%): 99.9833
Max. virtual memory (cumulated for all children) (KiB): 4634460

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1800.03
system time used= 2.28365
maximum resident set size= 4587684
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1155122
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 2917

runsolver used 2.77458 second user time and 8.76467 second system time

The end

Launcher Data 

Begin job on node120 at 2012-06-04 09:42:02
IDJOB=3743185
IDBENCH=90887
IDSOLVER=2329
FILE ID=node120/3743185-1338795721
RUNJOBID= node120-1338771707-9222
PBS_JOBID= 14636816
Free space on /tmp= 70732 MiB

SOLVER NAME= PB11: SCIP spx E_2 2011-06-10 (fixed)
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/NG/normalized-NG.dot_luby_10null20mast_rapportOE1.0_TMAX300_K192_cod2.opb
COMMAND LINE= HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3743185-1338795721/watcher-3743185-1338795721 -o /tmp/evaluation-result-3743185-1338795721/solver-3743185-1338795721 -C 1800 -W 1900 -M 15500  HOME/scip-2.0.1.4b_2.linux.x86_64.gnu.opt.spx -f HOME/instance-3743185-1338795721.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ecfb37e57149da15322fff965cafdd0d
RANDOM SEED=1129160970

node120.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        26288628 kB
Buffers:          586676 kB
Cached:          3246404 kB
SwapCached:         1580 kB
Active:          3634736 kB
Inactive:        2013520 kB
Active(anon):    1807408 kB
Inactive(anon):     9224 kB
Active(file):    1827328 kB
Inactive(file):  2004296 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67103516 kB
Dirty:             44132 kB
Writeback:             0 kB
AnonPages:       1819716 kB
Mapped:            12956 kB
Shmem:                32 kB
Slab:             797092 kB
SReclaimable:     241036 kB
SUnreclaim:       556056 kB
KernelStack:        1456 kB
PageTables:         7568 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    1955460 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     20480 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70688 MiB
End job on node120 at 2012-06-04 10:12:05