Trace number 3699254

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
npSolver inc? (TO) 1800.08 1800.62

General information on the benchmark

Name/OPT-BIGINT-LIN/
heinz/normalized-sp97ar.opb
MD5SUM346508ea645695d9f01013e13e92c545
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark2193774424000000011
Best CPU time to get the best result obtained on this benchmark1800.1
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables14101
Total number of constraints1739
Number of constraints which are clauses181
Number of constraints which are cardinality constraints (but not clauses)1140
Number of constraints which are nor clauses,nor cardinality constraints418
Minimum length of a constraint2
Maximum length of a constraint2463
Number of terms in the objective function 14101
Biggest coefficient in the objective function 234302934400000000
Number of bits for the biggest coefficient in the objective function 58
Sum of the numbers in the objective function 780311080232800000100
Number of bits of the sum of numbers in the objective function 70
Biggest number in a constraint 234302934400000000
Number of bits of the biggest number in a constraint 58
Biggest sum of numbers in a constraint 780311080232800000100
Number of bits of the biggest sum of numbers70
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

1.98/2.08	c run inc solver
1.98/2.08	c [INC SYSTEM] run initial solver
1.98/2.08	c [INC SYSTEM] preprocess with white file
10.26/10.44	c [INC SYSTEM] finished preprocessing in 8 s
10.26/10.44	c [INC SYSTEM] execute solver
22.17/22.37	c [INC SEARCH] formula is SAT
22.28/22.43	c [INC SYSTEM] solved the initial formula
22.38/22.54	c model valid
22.38/22.54	c current solution ok
25.96/26.17	o -2633749229819103308
25.96/26.17	c execute binary inc search
25.96/26.17	c [INC SEARCH] current bound: 7906497421945224192
25.96/26.17	c [INC SEARCH] iteration: 0
25.96/26.17	c [INC SEARCH] lower bound: 0 upperbound 15812994843890448308 current bound: 7906497421945224192 best value:-2633749229819103308
25.96/26.17	c [INC SYSTEM] there exists a inc, kill it!
25.96/26.17	c write failed with 2
26.07/26.20	c [INC SYSTEM] create new solver instance
26.07/26.20	c [INC] encode full formula
26.07/26.20	c fallback to adder encoding
31.08/31.25	c set iterative enc to: adder
31.08/31.25	c set iterative enc to: none
31.76/31.97	c [INC SEARCH] isOptimum variable: 0

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3699254-1338119844/watcher-3699254-1338119844 -o /tmp/evaluation-result-3699254-1338119844/solver-3699254-1338119844 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo-I.sh HOME/instance-3699254-1338119844.opb 445017054 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.01 1.16 1.53 2/175 12346
/proc/meminfo: memFree=31538040/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0

[startup+0.0897749 s]
/proc/loadavg: 1.01 1.16 1.53 2/175 12346
/proc/meminfo: memFree=31538040/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100279 s]
/proc/loadavg: 1.01 1.16 1.53 2/175 12346
/proc/meminfo: memFree=31538040/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300272 s]
/proc/loadavg: 1.01 1.16 1.53 2/175 12346
/proc/meminfo: memFree=31538040/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700284 s]
/proc/loadavg: 1.01 1.16 1.53 2/175 12346
/proc/meminfo: memFree=31538040/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50033 s]
/proc/loadavg: 1.01 1.16 1.53 3/177 12348
/proc/meminfo: memFree=31367924/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=158736 CPUtime=1.48 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) R 12346 12346 12301 0 -1 4202496 23366 0 0 0 143 5 0 0 20 0 1 0 278112827 162545664 38141 33554432000 4194304 5992684 140735703248160 140735703217704 5045116 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12347/statm: 39684 38151 160 440 0 39240 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 167884

[startup+3.10033 s]
/proc/loadavg: 1.01 1.16 1.53 3/177 12348
/proc/meminfo: memFree=31081840/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=243612 CPUtime=2.09 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 29351 0 0 0 188 21 0 0 20 0 1 0 278112827 249458688 49531 33554432000 4194304 5992684 140735703248160 140735703242608 5175646 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/12347/statm: 60903 49531 167 440 0 60459 0
Current children cumulated CPU time (s) 2.09
Current children cumulated vsize (KiB) 252760
heavy processes:

[startup+6.30041 s]
/proc/loadavg: 1.25 1.21 1.55 3/181 12352
/proc/meminfo: memFree=30206572/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=243612 CPUtime=2.09 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 29351 0 0 0 188 21 0 0 20 0 1 0 278112827 249458688 49531 33554432000 4194304 5992684 140735703248160 140735703242608 5175646 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/12347/statm: 60903 49531 167 440 0 60459 0
[pid=12349] ppid=12347 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12349/stat : 12349 (cp2_pre.sh) S 12347 12346 12301 0 -1 4202496 608 0 0 0 0 0 0 0 20 0 1 0 278113037 9367552 276 33554432000 4194304 5064252 140735861648240 140735861646944 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/12349/statm: 2287 276 234 213 0 72 0
[pid=12350] ppid=12349 vsize=651868 CPUtime=4.18 cores=0,2,4,6
/proc/12350/stat : 12350 (coprocessor) R 12349 12346 12301 0 -1 4202496 57753 0 0 0 401 17 0 0 20 0 1 0 278113038 667512832 157477 33554432000 4194304 6586260 140735838195632 140735838191832 4774851 0 0 4096 8404994 0 0 0 17 4 0 0 0 0 0
/proc/12350/statm: 162967 157477 180 584 0 162379 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 913776

[startup+12.7004 s]
/proc/loadavg: 1.31 1.22 1.55 3/179 12356
/proc/meminfo: memFree=30620688/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=243612 CPUtime=10.32 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 29366 72687 0 0 188 21 787 36 20 0 1 0 278112827 249458688 49533 33554432000 4194304 5992684 140735703248160 140735703234424 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/12347/statm: 60903 49533 169 440 0 60459 0
[pid=12356] ppid=12347 vsize=326944 CPUtime=2.24 cores=0,2,4,6
/proc/12356/stat : 12356 (glucosInc) R 12347 12346 12301 0 -1 4202496 52845 0 0 0 213 11 0 0 20 0 1 0 278113872 334790656 74369 33554432000 4194304 5654031 140737114838560 140737114836456 4232775 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/12356/statm: 81736 74369 131 357 0 81376 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 579704

[startup+25.5003 s]
/proc/loadavg: 1.46 1.26 1.55 3/179 12356
/proc/meminfo: memFree=30515436/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=275644 CPUtime=13.48 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) R 12346 12346 12301 0 -1 4202496 31773 72687 0 0 261 264 787 36 20 0 1 0 278112827 282259456 56902 33554432000 4194304 5992684 140735703248160 140735703242344 5179696 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12347/statm: 68911 56902 176 440 0 68467 0
[pid=12356] ppid=12347 vsize=336068 CPUtime=11.89 cores=0,2,4,6
/proc/12356/stat : 12356 (glucosInc) S 12347 12346 12301 0 -1 4202496 54198 0 0 0 1177 12 0 0 20 0 1 0 278113872 344133632 76744 33554432000 4194304 5654031 140737114838560 140737114836872 4976656 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 0 0 0
/proc/12356/statm: 84017 76744 146 357 0 83657 0
Current children cumulated CPU time (s) 25.37
Current children cumulated vsize (KiB) 620860

[startup+51.1005 s]
/proc/loadavg: 1.99 1.40 1.59 3/179 12362
/proc/meminfo: memFree=29239000/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1248984 CPUtime=19.11 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 153692 0 0 0 1860 51 0 0 20 0 1 0 278116024 1278959616 263108 33554432000 4194304 5654031 140736038015536 140736038013320 4209217 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 312246 263108 142 357 0 311886 0
Current children cumulated CPU time (s) 50.94
Current children cumulated vsize (KiB) 1546028

[startup+102.3 s]
/proc/loadavg: 1.99 1.49 1.61 3/179 12362
/proc/meminfo: memFree=29188928/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1253704 CPUtime=70.31 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 154856 0 0 0 6979 52 0 0 20 0 1 0 278116024 1283792896 266316 33554432000 4194304 5654031 140736038015536 140736038003352 4232775 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 313426 266316 142 357 0 313066 0
Current children cumulated CPU time (s) 102.14
Current children cumulated vsize (KiB) 1550748

[startup+162.3 s]
/proc/loadavg: 2.07 1.59 1.64 3/180 12365
/proc/meminfo: memFree=29142168/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1258068 CPUtime=130.29 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 155939 0 0 0 12977 52 0 0 20 0 1 0 278116024 1288261632 269954 33554432000 4194304 5654031 140736038015536 140736038013320 4232453 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 314517 269954 142 357 0 314157 0
Current children cumulated CPU time (s) 162.12
Current children cumulated vsize (KiB) 1555112

[startup+222.306 s]
/proc/loadavg: 2.02 1.67 1.66 3/180 12389
/proc/meminfo: memFree=29133124/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1260452 CPUtime=190.3 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 156564 0 0 0 18977 53 0 0 20 0 1 0 278116024 1290702848 271090 33554432000 4194304 5654031 140736038015536 140736038003352 4208621 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 315113 271090 142 357 0 314753 0
Current children cumulated CPU time (s) 222.13
Current children cumulated vsize (KiB) 1557496

[startup+282.3 s]
/proc/loadavg: 2.07 1.74 1.68 3/179 12389
/proc/meminfo: memFree=29122960/32873844 swapFree=6088/6088

################
# More data... #
################

/proc/meminfo: memFree=29100416/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1320156 CPUtime=1330.01 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 173496 0 0 0 132919 82 0 0 20 0 1 0 278116024 1351839744 300456 33554432000 4194304 5654031 140736038015536 140736038003352 4232775 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 330039 300456 142 357 0 329679 0
Current children cumulated CPU time (s) 1361.84
Current children cumulated vsize (KiB) 1617200

[startup+1422.3 s]
/proc/loadavg: 2.00 1.97 1.87 3/179 12402
/proc/meminfo: memFree=29102264/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1322820 CPUtime=1390.01 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 174388 0 0 0 138914 87 0 0 20 0 1 0 278116024 1354567680 290968 33554432000 4194304 5654031 140736038015536 140736038003352 4232874 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 330705 290968 142 357 0 330345 0
Current children cumulated CPU time (s) 1421.84
Current children cumulated vsize (KiB) 1619864

[startup+1482.3 s]
/proc/loadavg: 2.00 1.97 1.88 3/179 12403
/proc/meminfo: memFree=29064844/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1325248 CPUtime=1449.99 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 175048 0 0 0 144912 87 0 0 20 0 1 0 278116024 1357053952 300315 33554432000 4194304 5654031 140736038015536 140736038003352 4797458 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 331312 300315 142 357 0 330952 0
Current children cumulated CPU time (s) 1481.82
Current children cumulated vsize (KiB) 1622292

[startup+1542.31 s]
/proc/loadavg: 2.00 1.97 1.88 3/179 12403
/proc/meminfo: memFree=28990436/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1327908 CPUtime=1510 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 175756 0 0 0 150911 89 0 0 20 0 1 0 278116024 1359777792 310221 33554432000 4194304 5654031 140736038015536 140736038003352 4232473 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 331977 310221 142 357 0 331617 0
Current children cumulated CPU time (s) 1541.83
Current children cumulated vsize (KiB) 1624952

[startup+1602.3 s]
/proc/loadavg: 2.00 1.97 1.89 3/179 12403
/proc/meminfo: memFree=29040524/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1329928 CPUtime=1569.98 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 177046 0 0 0 156905 93 0 0 20 0 1 0 278116024 1361846272 297928 33554432000 4194304 5654031 140736038015536 140736038003352 4232477 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 332482 297928 142 357 0 332122 0
Current children cumulated CPU time (s) 1601.81
Current children cumulated vsize (KiB) 1626972

[startup+1662.3 s]
/proc/loadavg: 2.00 1.97 1.89 3/179 12403
/proc/meminfo: memFree=28986908/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1337684 CPUtime=1629.97 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 178144 0 0 0 162903 94 0 0 20 0 1 0 278116024 1369788416 309246 33554432000 4194304 5654031 140736038015536 140736038003352 4244536 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 334421 309246 142 357 0 334061 0
Current children cumulated CPU time (s) 1661.8
Current children cumulated vsize (KiB) 1634728

[startup+1722.3 s]
/proc/loadavg: 2.03 1.99 1.90 3/179 12403
/proc/meminfo: memFree=29013344/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1337684 CPUtime=1689.96 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 178333 0 0 0 168898 98 0 0 20 0 1 0 278116024 1369788416 301102 33554432000 4194304 5654031 140736038015536 140736038003352 4208659 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 334421 301102 142 357 0 334061 0
Current children cumulated CPU time (s) 1721.79
Current children cumulated vsize (KiB) 1634728

[startup+1782.3 s]
/proc/loadavg: 2.08 2.00 1.91 3/179 12404
/proc/meminfo: memFree=28977656/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1337684 CPUtime=1749.95 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 178355 0 0 0 174897 98 0 0 20 0 1 0 278116024 1369788416 309809 33554432000 4194304 5654031 140736038015536 140736038003352 4232752 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 334421 309809 142 357 0 334061 0
Current children cumulated CPU time (s) 1781.78
Current children cumulated vsize (KiB) 1634728



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.06 2.00 1.91 2/176 12405
/proc/meminfo: memFree=29582472/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1338088 CPUtime=1768.25 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 179196 0 0 0 176723 102 0 0 20 0 1 0 278116024 1370202112 294522 33554432000 4194304 5654031 140736038015536 140736038003352 4232929 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 334522 294522 142 357 0 334162 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 1635132

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.06 2.00 1.91 2/176 12405
/proc/meminfo: memFree=29582472/32873844 swapFree=6088/6088
[pid=12346] ppid=12344 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/12346/stat : 12346 (npSolver-pbo-I.) S 12344 12346 12301 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 278112827 9367552 274 33554432000 4194304 5064252 140736195527568 140736195526480 226329519694 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/12346/statm: 2287 274 233 213 0 72 0
[pid=12347] ppid=12346 vsize=287896 CPUtime=31.83 cores=0,2,4,6
/proc/12347/stat : 12347 (npSolver-pbo) S 12346 12346 12301 0 -1 4202496 41950 127925 0 0 764 386 1965 68 20 0 1 0 278112827 294805504 60713 33554432000 4194304 5992684 140735703248160 140735703233064 5179600 0 0 4096 0 18446744071580380219 0 0 17 0 0 0 2 0 0
/proc/12347/statm: 71974 60713 187 440 0 71530 0
[pid=12362] ppid=12347 vsize=1338088 CPUtime=1768.25 cores=0,2,4,6
/proc/12362/stat : 12362 (glucosInc) R 12347 12346 12301 0 -1 4202496 179196 0 0 0 176723 102 0 0 20 0 1 0 278116024 1370202112 294522 33554432000 4194304 5654031 140736038015536 140736038003352 4232929 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/12362/statm: 334522 294522 142 357 0 334162 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 1635132

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 12346 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.08
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.62
CPU time (s): 1800.08
CPU user time (s): 1794.52
CPU system time (s): 5.56
CPU usage (%): 99.9703
Max. virtual memory (cumulated for all children) (KiB): 1978876

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 1096
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 358
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 1

runsolver used 3.63145 second user time and 9.62354 second system time

The end

Launcher Data

Begin job on node110 at 2012-05-27 13:57:24
IDJOB=3699254
IDBENCH=89902
IDSOLVER=2276
FILE ID=node110/3699254-1338119844
RUNJOBID= node110-1338119844-12317
PBS_JOBID= 14624477
Free space on /tmp= 71672 MiB

SOLVER NAME= npSolver inc
BENCH NAME= PB11/normalized-PB11/OPT-BIGINT-LIN/heinz/normalized-sp97ar.opb
COMMAND LINE= DIR/npSolver-pbo-I.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3699254-1338119844/watcher-3699254-1338119844 -o /tmp/evaluation-result-3699254-1338119844/solver-3699254-1338119844 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo-I.sh HOME/instance-3699254-1338119844.opb 445017054 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 346508ea645695d9f01013e13e92c545
RANDOM SEED=445017054

node110.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31542024 kB
Buffers:          231784 kB
Cached:           302176 kB
SwapCached:          148 kB
Active:           463304 kB
Inactive:          82780 kB
Active(anon):       2520 kB
Inactive(anon):    12496 kB
Active(file):     460784 kB
Inactive(file):    70284 kB
Unevictable:        6088 kB
Mlocked:            6088 kB
SwapTotal:      67108856 kB
SwapFree:       67108004 kB
Dirty:             19440 kB
Writeback:             0 kB
AnonPages:         18304 kB
Mapped:            14232 kB
Shmem:               196 kB
Slab:             645412 kB
SReclaimable:      87480 kB
SUnreclaim:       557932 kB
KernelStack:        1368 kB
PageTables:         3856 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     114868 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71200 MiB
End job on node110 at 2012-05-27 14:27:27