Trace number 3744773

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver? (TO) 1802.19 1802.48

General information on the benchmark

NameOPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb1-0.20-15.opb
MD5SUM69d93578371ff5d961cf9c2ed676d21d
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark7604
Best CPU time to get the best result obtained on this benchmark1800.07
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables214438
Total number of constraints4086528
Number of constraints which are clauses4086528
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint579
Number of terms in the objective function 18980
Biggest coefficient in the objective function 581
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 10690980
Number of bits of the sum of numbers in the objective function 24
Biggest number in a constraint 581
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 10690980
Number of bits of the biggest sum of numbers24
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c SCIP version 1.2.1.3 [precision: 8 byte] [memory: block] [mode: optimized] [LP solver: SoPlex 1.4.2]
0.00/0.00	c Copyright (c) 2002-2010 Konrad-Zuse-Zentrum fuer Informationstechnik Berlin (ZIB)
0.00/0.00	c 
0.00/0.00	c user parameter file <scip.set> not found - using default parameters
0.00/0.00	c reading problem <HOME/instance-3744773-1338810389.opb>
25.69/25.78	c original problem has 214438 variables (214438 bin, 0 int, 0 impl, 0 cont) and 4086528 constraints
25.69/25.78	c problem read
25.69/25.79	c presolving settings loaded
31.29/31.30	c presolving:
56.68/56.71	c (round 1) 128413 del vars, 2694784 del conss, 126816 chg bounds, 205 chg sides, 266 chg coeffs, 0 upgd conss, 17669307 impls, 0 clqs
61.08/61.20	c (round 2) 129707 del vars, 3089465 del conss, 127427 chg bounds, 205 chg sides, 266 chg coeffs, 0 upgd conss, 17718385 impls, 0 clqs
62.38/62.49	c (round 3) 130964 del vars, 3105426 del conss, 127874 chg bounds, 207 chg sides, 268 chg coeffs, 0 upgd conss, 17734871 impls, 0 clqs
63.28/63.33	c (round 4) 131105 del vars, 3108612 del conss, 127882 chg bounds, 207 chg sides, 268 chg coeffs, 0 upgd conss, 17737487 impls, 0 clqs
64.08/64.12	c (round 5) 131176 del vars, 3109371 del conss, 127882 chg bounds, 207 chg sides, 268 chg coeffs, 0 upgd conss, 17737487 impls, 0 clqs
71.09/71.17	c (round 6) 131177 del vars, 3109371 del conss, 127882 chg bounds, 207 chg sides, 268 chg coeffs, 975198 upgd conss, 17737487 impls, 0 clqs
73.48/73.59	c (round 7) 131177 del vars, 3109371 del conss, 127882 chg bounds, 207 chg sides, 268 chg coeffs, 977157 upgd conss, 17737487 impls, 0 clqs
84.19/84.26	c    (58.5s) probing: 101/83261 (0.1%) - 0 fixings, 0 aggregations, 0 implications, 0 bound changes
84.19/84.26	c    (58.5s) probing aborted: 100/100 successive totally useless probings
84.19/84.27	c presolving (8 rounds):
84.19/84.27	c  131177 deleted vars, 3109371 deleted constraints, 127882 tightened bounds, 0 added holes, 207 changed sides, 268 changed coefficients
84.19/84.27	c  17737487 implications, 0 cliques
84.19/84.27	c presolved problem has 83261 variables (83261 bin, 0 int, 0 impl, 0 cont) and 977157 constraints
84.19/84.27	c  668605 constraints of type <setppc>
84.19/84.27	c  308552 constraints of type <logicor>
84.19/84.27	c transformed objective value is always integral (scale: 1)
84.19/84.27	c Presolving Time: 53.57
84.19/84.27	c - non default parameters ----------------------------------------------------------------------
84.19/84.27	c # SCIP version 1.2.1.3
84.19/84.27	c 
84.19/84.27	c # frequency for displaying node information lines
84.19/84.27	c # [type: int, range: [-1,2147483647], default: 100]
84.19/84.27	c display/freq = 10000
84.19/84.27	c 
84.19/84.27	c # maximal time in seconds to run
84.19/84.27	c # [type: real, range: [0,1.79769313486232e+308], default: 1e+20]
84.19/84.27	c limits/time = 1764.22
84.19/84.27	c 
84.19/84.27	c # maximal memory usage in MB; reported memory usage is lower than real memory usage!
84.19/84.27	c # [type: real, range: [0,1.79769313486232e+308], default: 1e+20]
84.19/84.27	c limits/memory = 13950
84.19/84.27	c 
84.19/84.27	c # default clock type (1: CPU user seconds, 2: wall clock time)
84.19/84.27	c # [type: int, range: [1,2], default: 1]
84.19/84.27	c timing/clocktype = 2
84.19/84.27	c 
84.19/84.27	c # should presolving try to simplify inequalities
84.19/84.27	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
84.19/84.27	c constraints/linear/simplifyinequalities = TRUE
84.19/84.27	c 
84.19/84.27	c # add initial coupling inequalities as linear constraints, if 'addCoupling' is true
84.19/84.27	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
84.19/84.27	c constraints/indicator/addCouplingCons = TRUE
84.19/84.27	c 
84.19/84.27	c # should presolving try to simplify knapsacks
84.19/84.27	c # [type: bool, range: {TRUE,FALSE}, default: FALSE]
84.19/84.27	c constraints/knapsack/simplifyinequalities = TRUE
84.19/84.27	c 
84.19/84.27	c # frequency for calling separator <rapidlearning> (-1: never, 0: only in root node)
84.19/84.27	c # [type: int, range: [-1,2147483647], default: -1]
84.19/84.27	c separating/rapidlearning/freq = 0
84.19/84.27	c 
84.19/84.27	c -----------------------------------------------------------------------------------------------
84.19/84.27	c start solving
84.29/84.33	c 
1800.02/1800.31	c pressed CTRL-C 1 times (5 times for forcing termination)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3744773-1338810389/watcher-3744773-1338810389 -o /tmp/evaluation-result-3744773-1338810389/solver-3744773-1338810389 -C 1800 -W 1900 -M 15500 HOME/pbscip.linux.x86_64.gnu.opt.spx -f HOME/instance-3744773-1338810389.opb -t 1800 -m 15500 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.16 1.04 1.23 3/176 18732
/proc/meminfo: memFree=26219988/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=7916 CPUtime=0 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1252 0 0 0 0 0 0 0 20 0 1 0 347163682 8105984 1198 33554432000 4194304 8395647 140735445092752 140735159314408 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1979 1198 370 1026 0 949 0

[startup+0.0846959 s]
/proc/loadavg: 1.16 1.04 1.23 3/176 18732
/proc/meminfo: memFree=26219988/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=30700 CPUtime=0.07 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 6923 0 0 0 7 0 0 0 20 0 1 0 347163682 31436800 6863 33554432000 4194304 8395647 140735445092752 140735159314408 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 7675 6863 394 1026 0 6645 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 30700

[startup+0.100335 s]
/proc/loadavg: 1.16 1.04 1.23 3/176 18732
/proc/meminfo: memFree=26219988/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=31920 CPUtime=0.09 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 7200 0 0 0 8 1 0 0 20 0 1 0 347163682 32686080 7140 33554432000 4194304 8395647 140735445092752 140735159314408 4685157 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 7980 7140 394 1026 0 6950 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31920

[startup+0.300283 s]
/proc/loadavg: 1.16 1.04 1.23 3/176 18732
/proc/meminfo: memFree=26219988/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=53012 CPUtime=0.29 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 12464 0 0 0 27 2 0 0 20 0 1 0 347163682 54284288 12404 33554432000 4194304 8395647 140735445092752 140735159314408 7382016 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 13253 12404 394 1026 0 12223 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 53012

[startup+0.700264 s]
/proc/loadavg: 1.16 1.04 1.23 3/176 18732
/proc/meminfo: memFree=26219988/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=81048 CPUtime=0.69 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 19448 0 0 0 67 2 0 0 20 0 1 0 347163682 82993152 19388 33554432000 4194304 8395647 140735445092752 140735159314408 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 20262 19388 394 1026 0 19232 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 81048

[startup+1.50027 s]
/proc/loadavg: 1.16 1.04 1.23 3/177 18733
/proc/meminfo: memFree=26062144/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=129188 CPUtime=1.49 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 31512 0 0 0 145 4 0 0 20 0 1 0 347163682 132288512 31452 33554432000 4194304 8395647 140735445092752 140735444957960 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 32297 31452 394 1026 0 31267 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 129188

[startup+3.1003 s]
/proc/loadavg: 1.16 1.04 1.23 3/177 18733
/proc/meminfo: memFree=25921512/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=228564 CPUtime=3.09 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 56165 0 0 0 301 8 0 0 20 0 1 0 347163682 234049536 56105 33554432000 4194304 8395647 140735445092752 140735444957960 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 57141 56105 394 1026 0 56111 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 228564

[startup+6.30036 s]
/proc/loadavg: 1.23 1.06 1.23 3/177 18733
/proc/meminfo: memFree=25087620/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=419312 CPUtime=6.29 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 103651 0 0 0 613 16 0 0 20 0 1 0 347163682 429375488 103591 33554432000 4194304 8395647 140735445092752 140735444957960 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 104828 103591 394 1026 0 103798 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 419312

[startup+12.7003 s]
/proc/loadavg: 1.35 1.09 1.24 3/177 18733
/proc/meminfo: memFree=24558220/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=804736 CPUtime=12.69 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 200324 0 0 0 1235 34 0 0 20 0 1 0 347163682 824049664 200264 33554432000 4194304 8395647 140735445092752 140735444957960 7430272 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 201184 200264 394 1026 0 200154 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 804736

[startup+25.5003 s]
/proc/loadavg: 1.45 1.12 1.25 3/177 18733
/proc/meminfo: memFree=23625484/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=1564396 CPUtime=25.49 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 387367 0 0 0 2484 65 0 0 20 0 1 0 347163682 1601941504 389862 33554432000 4194304 8395647 140735445092752 140735444957960 4222702 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 391099 389862 394 1026 0 390069 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1564396

[startup+51.1004 s]
/proc/loadavg: 1.63 1.19 1.27 3/177 18733
/proc/meminfo: memFree=20925176/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4186292 CPUtime=51.09 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1021681 0 0 0 4950 159 0 0 20 0 1 0 347163682 4286763008 1041196 33554432000 4194304 8395647 140735445092752 140735445088504 6345370 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1046573 1041196 476 1026 0 1045543 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 4186292

[startup+102.3 s]
/proc/loadavg: 1.84 1.31 1.30 3/177 18733
/proc/meminfo: memFree=20592404/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4477784 CPUtime=102.27 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1094572 0 0 0 10054 173 0 0 20 0 1 0 347163682 4585250816 1113456 33554432000 4194304 8395647 140735445092752 140735445087880 6697790 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1119446 1113456 575 1026 0 1118416 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 4477784

[startup+162.3 s]
/proc/loadavg: 2.01 1.45 1.35 3/177 18733
/proc/meminfo: memFree=20581196/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4536308 CPUtime=162.27 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1098108 0 0 0 16048 179 0 0 20 0 1 0 347163682 4645179392 1115720 33554432000 4194304 8395647 140735445092752 140735445086920 7382137 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1134077 1115720 576 1026 0 1133047 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 4536308

[startup+222.3 s]
/proc/loadavg: 2.00 1.55 1.39 3/178 18736
/proc/meminfo: memFree=20560116/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4570736 CPUtime=222.26 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1102916 0 0 0 22039 187 0 0 20 0 1 0 347163682 4680433664 1121013 33554432000 4194304 8395647 140735445092752 140735445087880 6723581 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1142684 1121013 576 1026 0 1141654 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 4570736

[startup+282.307 s]
/proc/loadavg: 2.00 1.63 1.42 3/177 18737
/proc/meminfo: memFree=20532912/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4605696 CPUtime=282.25 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1112194 0 0 0 28027 198 0 0 20 0 1 0 347163682 4716232704 1127760 33554432000 4194304 8395647 140735445092752 140735445088312 7382157 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1151424 1127760 576 1026 0 1150394 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 4605696

[startup+342.3 s]
/proc/loadavg: 2.00 1.69 1.46 3/177 18737
/proc/meminfo: memFree=20518608/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4620144 CPUtime=342.24 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1121674 0 0 0 34013 211 0 0 20 0 1 0 347163682 4731027456 1129656 33554432000 4194304 8395647 140735445092752 140735445088216 6697790 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1155036 1129656 576 1026 0 1154006 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 4620144

[startup+402.3 s]
/proc/loadavg: 2.00 1.75 1.49 3/177 18737
/proc/meminfo: memFree=20408424/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4769492 CPUtime=402.23 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1128923 0 0 0 40002 221 0 0 20 0 1 0 347163682 4883959808 1157216 33554432000 4194304 8395647 140735445092752 140735445088312 6723489 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1192373 1157216 577 1026 0 1191343 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 4769492

[startup+462.3 s]
/proc/loadavg: 2.00 1.79 1.52 3/177 18737
/proc/meminfo: memFree=20402984/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4777772 CPUtime=462.22 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1133801 0 0 0 45991 231 0 0 20 0 1 0 347163682 4892438528 1157972 33554432000 4194304 8395647 140735445092752 140735445088216 6752753 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1194443 1157972 577 1026 0 1193413 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 4777772

[startup+522.3 s]
/proc/loadavg: 2.00 1.83 1.55 3/177 18737
/proc/meminfo: memFree=20394548/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4786896 CPUtime=522.21 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1139387 0 0 0 51982 239 0 0 20 0 1 0 347163682 4901781504 1158890 33554432000 4194304 8395647 140735445092752 140735445087880 6723581 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1196724 1158890 577 1026 0 1195694 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 4786896

[startup+582.3 s]
/proc/loadavg: 2.00 1.85 1.57 3/177 18738
/proc/meminfo: memFree=20385400/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4826328 CPUtime=582.2 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1144463 0 0 0 57971 249 0 0 20 0 1 0 347163682 4942159872 1161358 33554432000 4194304 8395647 140735445092752 140735445088312 7382152 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1206582 1161358 577 1026 0 1205552 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 4826328

[startup+642.3 s]

################
# More data... #
################

/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1181936 0 0 0 111891 321 0 0 20 0 1 0 347163682 4977766400 1169559 33554432000 4194304 8395647 140735445092752 140735445087880 7382137 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1215275 1169559 577 1026 0 1214245 0
Current children cumulated CPU time (s) 1122.12
Current children cumulated vsize (KiB) 4861100

[startup+1182.3 s]
/proc/loadavg: 2.00 1.97 1.76 3/176 18765
/proc/meminfo: memFree=20349884/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4861888 CPUtime=1182.11 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1185797 0 0 0 117883 328 0 0 20 0 1 0 347163682 4978573312 1169791 33554432000 4194304 8395647 140735445092752 140735445088216 6636363 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1215472 1169791 577 1026 0 1214442 0
Current children cumulated CPU time (s) 1182.11
Current children cumulated vsize (KiB) 4861888

[startup+1242.3 s]
/proc/loadavg: 2.00 1.97 1.77 3/177 18766
/proc/meminfo: memFree=20349036/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4862432 CPUtime=1242.1 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1190445 0 0 0 123876 334 0 0 20 0 1 0 347163682 4979130368 1169965 33554432000 4194304 8395647 140735445092752 140735445087880 6698214 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1215608 1169965 577 1026 0 1214578 0
Current children cumulated CPU time (s) 1242.1
Current children cumulated vsize (KiB) 4862432

[startup+1302.3 s]
/proc/loadavg: 2.00 1.97 1.78 3/177 18766
/proc/meminfo: memFree=20348196/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4862976 CPUtime=1302.08 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1196069 0 0 0 129868 340 0 0 20 0 1 0 347163682 4979687424 1170122 33554432000 4194304 8395647 140735445092752 140735445087880 7382137 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1215744 1170122 577 1026 0 1214714 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 4862976

[startup+1362.3 s]
/proc/loadavg: 2.00 1.97 1.79 3/177 18766
/proc/meminfo: memFree=20347168/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4863256 CPUtime=1362.08 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1200146 0 0 0 135861 347 0 0 20 0 1 0 347163682 4979974144 1170249 33554432000 4194304 8395647 140735445092752 140735445087880 7382137 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1215814 1170249 577 1026 0 1214784 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 4863256

[startup+1422.3 s]
/proc/loadavg: 2.00 1.97 1.80 3/178 18769
/proc/meminfo: memFree=20347064/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4863692 CPUtime=1422.07 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1200619 0 0 0 141853 354 0 0 20 0 1 0 347163682 4980420608 1170355 33554432000 4194304 8395647 140735445092752 140735445088312 6697938 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1215923 1170355 577 1026 0 1214893 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 4863692

[startup+1482.3 s]
/proc/loadavg: 2.07 1.99 1.82 3/177 18769
/proc/meminfo: memFree=20346852/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4863956 CPUtime=1482.06 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1201466 0 0 0 147845 361 0 0 20 0 1 0 347163682 4980690944 1170434 33554432000 4194304 8395647 140735445092752 140735445087880 6752536 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1215989 1170434 577 1026 0 1214959 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 4863956

[startup+1542.3 s]
/proc/loadavg: 2.02 1.99 1.83 3/177 18770
/proc/meminfo: memFree=20346384/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4864172 CPUtime=1542.04 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1202729 0 0 0 153836 368 0 0 20 0 1 0 347163682 4980912128 1170501 33554432000 4194304 8395647 140735445092752 140735445087880 7382157 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1216043 1170501 577 1026 0 1215013 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 4864172

[startup+1602.31 s]
/proc/loadavg: 2.01 1.99 1.83 3/177 18770
/proc/meminfo: memFree=20346412/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4864528 CPUtime=1602.03 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1204383 0 0 0 159828 375 0 0 20 0 1 0 347163682 4981276672 1170555 33554432000 4194304 8395647 140735445092752 140735445087880 6697688 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1216132 1170555 577 1026 0 1215102 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 4864528

[startup+1662.3 s]
/proc/loadavg: 2.00 1.99 1.84 3/177 18770
/proc/meminfo: memFree=20346068/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4864720 CPUtime=1662.02 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1206026 0 0 0 165821 381 0 0 20 0 1 0 347163682 4981473280 1170597 33554432000 4194304 8395647 140735445092752 140735445086920 6438888 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1216180 1170597 577 1026 0 1215150 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 4864720

[startup+1722.3 s]
/proc/loadavg: 2.00 1.99 1.84 3/177 18770
/proc/meminfo: memFree=20346096/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4865004 CPUtime=1722.01 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1207595 0 0 0 171816 385 0 0 20 0 1 0 347163682 4981764096 1170636 33554432000 4194304 8395647 140735445092752 140735445087880 6752542 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1216251 1170636 577 1026 0 1215221 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 4865004

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 1.85 3/177 18770
/proc/meminfo: memFree=20345752/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4865036 CPUtime=1782 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1209266 0 0 0 177810 390 0 0 20 0 1 0 347163682 4981796864 1170657 33554432000 4194304 8395647 140735445092752 140735445088216 6698214 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1216259 1170657 577 1026 0 1215229 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 4865036



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.31 s]
/proc/loadavg: 2.00 1.99 1.85 3/177 18809
/proc/meminfo: memFree=20599284/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4865036 CPUtime=1800.02 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1209637 0 0 0 179610 392 0 0 20 0 1 0 347163682 4981796864 1170657 33554432000 4194304 8395647 140735445092752 140735445088216 6697955 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1216259 1170657 577 1026 0 1215229 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 4865036

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -18732

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 2.00 1.99 1.85 3/177 18809
/proc/meminfo: memFree=20599284/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4865036 CPUtime=1800.2 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1209637 0 0 0 179628 392 0 0 20 0 1 0 347163682 4981796864 1170657 33554432000 4194304 8395647 140735445092752 140735445088216 6698030 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1216259 1170657 577 1026 0 1215229 0
Current children cumulated CPU time (s) 1800.2
Current children cumulated vsize (KiB) 4865036

[startup+1801.3 s]
/proc/loadavg: 2.00 1.99 1.85 3/178 18810
/proc/meminfo: memFree=20595308/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4865036 CPUtime=1801.01 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1209637 0 0 0 179709 392 0 0 20 0 1 0 347163682 4981796864 1170657 33554432000 4194304 8395647 140735445092752 140735445087880 6752542 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1216259 1170657 577 1026 0 1215229 0
Current children cumulated CPU time (s) 1801.01
Current children cumulated vsize (KiB) 4865036

[startup+1802.1 s]
/proc/loadavg: 2.00 1.99 1.85 3/178 18810
/proc/meminfo: memFree=20595308/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4865036 CPUtime=1801.8 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1209637 0 0 0 179788 392 0 0 20 0 1 0 347163682 4981796864 1170657 33554432000 4194304 8395647 140735445092752 140735445087880 6698375 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1216259 1170657 577 1026 0 1215229 0
Current children cumulated CPU time (s) 1801.8
Current children cumulated vsize (KiB) 4865036

[startup+1802.3 s]
/proc/loadavg: 2.00 1.99 1.85 3/178 18810
/proc/meminfo: memFree=20595308/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=4865036 CPUtime=1802 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4202496 1209637 0 0 0 179808 392 0 0 20 0 1 0 347163682 4981796864 1170657 33554432000 4194304 8395647 140735445092752 140735445087880 6723543 0 0 4096 16384 0 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 1216259 1170657 577 1026 0 1215229 0
Current children cumulated CPU time (s) 1802
Current children cumulated vsize (KiB) 4865036

[startup+1802.4 s]
/proc/loadavg: 2.00 1.99 1.85 3/177 18810
/proc/meminfo: memFree=23848352/32873844 swapFree=7628/7628
[pid=18732] ppid=18730 vsize=0 CPUtime=1802.11 cores=1,3,5,7
/proc/18732/stat : 18732 (pbscip.linux.x8) R 18730 18732 17511 0 -1 4203524 1209637 0 0 0 179810 401 0 0 20 0 1 0 347163682 0 0 33554432000 0 0 0 0 0 0 0 4096 16384 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/18732/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 1802.11
Current children cumulated vsize (KiB) 0

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.48
CPU time (s): 1802.19
CPU user time (s): 1798.1
CPU system time (s): 4.08838
CPU usage (%): 99.9838
Max. virtual memory (cumulated for all children) (KiB): 4865036

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.1
system time used= 4.08838
maximum resident set size= 4682628
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1209637
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 25
involuntary context switches= 1870

runsolver used 3.32649 second user time and 8.28974 second system time

The end

Launcher Data 

Begin job on node145 at 2012-06-04 13:46:33
IDJOB=3744773
IDBENCH=92840
IDSOLVER=2326
FILE ID=node145/3744773-1338810389
RUNJOBID= node145-1338810389-18705
PBS_JOBID= 14636861
Free space on /tmp= 70768 MiB

SOLVER NAME= PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/graca/normalized-ped2.G.recomb1-0.20-15.opb
COMMAND LINE= HOME/pbscip.linux.x86_64.gnu.opt.spx -f BENCHNAME -t TIMEOUT -m MEMLIMIT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3744773-1338810389/watcher-3744773-1338810389 -o /tmp/evaluation-result-3744773-1338810389/solver-3744773-1338810389 -C 1800 -W 1900 -M 15500  HOME/pbscip.linux.x86_64.gnu.opt.spx -f HOME/instance-3744773-1338810389.opb -t 1800 -m 15500

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 69d93578371ff5d961cf9c2ed676d21d
RANDOM SEED=1131938472

node145.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5313.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        26221748 kB
Buffers:          457464 kB
Cached:          5168444 kB
SwapCached:            0 kB
Active:          2094764 kB
Inactive:        3686760 kB
Active(anon):     146828 kB
Inactive(anon):    10916 kB
Active(file):    1947936 kB
Inactive(file):  3675844 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:            173464 kB
Writeback:             0 kB
AnonPages:        163072 kB
Mapped:            15596 kB
Shmem:               200 kB
Slab:             731064 kB
SReclaimable:     171364 kB
SUnreclaim:       559700 kB
KernelStack:        1440 kB
PageTables:         4248 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     270052 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70760 MiB
End job on node145 at 2012-06-04 14:16:36