Trace number 3700084

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
npSolver inc? (TO) 1800.07 1800.42

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_20null0mast_rapportOE1.0_TMAX180_K67_cod2.opb
MD5SUM30f336dd624b9f7763c8bbeed1369f76
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-31135
Best CPU time to get the best result obtained on this benchmark1800.71
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables40937
Total number of constraints41436
Number of constraints which are clauses40882
Number of constraints which are cardinality constraints (but not clauses)67
Number of constraints which are nor clauses,nor cardinality constraints487
Minimum length of a constraint1
Maximum length of a constraint8416
Number of terms in the objective function 389
Biggest coefficient in the objective function 998
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 185532
Number of bits of the sum of numbers in the objective function 18
Biggest number in a constraint 998
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 185532
Number of bits of the biggest sum of numbers18
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.48	c fallback to adder encoding
0.00/0.91	c run inc solver
0.00/0.91	c [INC SYSTEM] run initial solver
0.00/0.91	c [INC SYSTEM] preprocess with white file
3.77/3.83	c [INC SYSTEM] finished preprocessing in 2 s
3.77/3.83	c [INC SYSTEM] execute solver
6.27/6.36	c [INC SEARCH] formula is SAT
6.27/6.37	c [INC SYSTEM] solved the initial formula
6.37/6.46	c model valid
6.37/6.46	c current solution ok
7.38/7.43	o -9267
7.38/7.43	c execute binary inc search
7.38/7.43	c [INC SEARCH] current bound: 88132
7.38/7.43	c [INC SEARCH] iteration: 0
7.38/7.43	c [INC SEARCH] lower bound: 0 upperbound 176265 current bound: 88132 best value:176265
7.38/7.43	c [INC SYSTEM] there exists a inc, kill it!
7.38/7.43	c write failed with 2
7.38/7.44	c [INC SYSTEM] create new solver instance
7.38/7.44	c [INC] encode full formula
7.38/7.44	c fallback to adder encoding
7.38/7.47	c set iterative enc to: adder
7.38/7.47	c set iterative enc to: none
7.46/7.50	c [INC SEARCH] isOptimum variable: 0
1800.07/1800.41	HOME/npSolver-pbo-I.sh: line 18: 14973 Terminated              ./npSolver-pbo $file $tmp -rnd_seed=$seed -useQuickBound=0 -useBinSearch=1 -useCP2=1 -useInc=1

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3700084-1338122430/watcher-3700084-1338122430 -o /tmp/evaluation-result-3700084-1338122430/solver-3700084-1338122430 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo-I.sh HOME/instance-3700084-1338122430.opb 1024059603 HOME HOME 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.28 1.66 3/174 14970
/proc/meminfo: memFree=30489084/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0

[startup+0.00998111 s]
/proc/loadavg: 1.00 1.28 1.66 3/174 14970
/proc/meminfo: memFree=30489084/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100249 s]
/proc/loadavg: 1.00 1.28 1.66 3/174 14970
/proc/meminfo: memFree=30489084/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300235 s]
/proc/loadavg: 1.00 1.28 1.66 3/174 14970
/proc/meminfo: memFree=30489084/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700278 s]
/proc/loadavg: 1.00 1.28 1.66 3/174 14970
/proc/meminfo: memFree=30489084/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50038 s]
/proc/loadavg: 1.00 1.28 1.66 3/184 14980
/proc/meminfo: memFree=30277364/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=63936 CPUtime=0.9 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 10925 0 0 0 83 7 0 0 20 0 1 0 278371517 65470464 15193 33554432000 4194304 5992684 140736106457888 140736106452336 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 15984 15193 174 440 0 15540 0
[pid=14977] ppid=14973 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14977/stat : 14977 (cp2_pre.sh) S 14973 14970 14929 0 -1 4202496 607 0 0 0 0 0 0 0 20 0 1 0 278371609 9367552 276 33554432000 4194304 5064252 140736476974240 140736476972944 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/14977/statm: 2287 276 234 213 0 72 0
[pid=14978] ppid=14977 vsize=131384 CPUtime=0.57 cores=1,3,5,7
/proc/14978/stat : 14978 (coprocessor) R 14977 14970 14929 0 -1 4202496 21060 0 0 0 52 5 0 0 20 0 1 0 278371609 134537216 29028 33554432000 4194304 6586260 140736093701200 140736093698360 5511711 0 0 4096 8404994 0 0 0 17 5 0 0 0 0 0
/proc/14978/statm: 32846 29029 166 584 0 32258 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 213616

[startup+3.10039 s]
/proc/loadavg: 1.08 1.30 1.66 3/184 14980
/proc/meminfo: memFree=29998560/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=63936 CPUtime=0.9 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 10925 0 0 0 83 7 0 0 20 0 1 0 278371517 65470464 15193 33554432000 4194304 5992684 140736106457888 140736106452336 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 15984 15193 174 440 0 15540 0
[pid=14977] ppid=14973 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14977/stat : 14977 (cp2_pre.sh) S 14973 14970 14929 0 -1 4202496 607 0 0 0 0 0 0 0 20 0 1 0 278371609 9367552 276 33554432000 4194304 5064252 140736476974240 140736476972944 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/14977/statm: 2287 276 234 213 0 72 0
[pid=14978] ppid=14977 vsize=191160 CPUtime=2.17 cores=1,3,5,7
/proc/14978/stat : 14978 (coprocessor) R 14977 14970 14929 0 -1 4202496 33112 0 0 0 210 7 0 0 20 0 1 0 278371609 195747840 45679 33554432000 4194304 6586260 140736093701200 140736093697128 4683467 0 0 4096 8404994 0 0 0 17 5 0 0 0 0 0
/proc/14978/statm: 47790 45679 191 584 0 47202 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 273392

[startup+6.30036 s]
/proc/loadavg: 1.08 1.30 1.66 3/182 14984
/proc/meminfo: memFree=30194068/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=63936 CPUtime=3.81 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 10941 34337 0 0 83 7 276 15 20 0 1 0 278371517 65470464 15195 33554432000 4194304 5992684 140736106457888 140736106444152 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 15984 15195 176 440 0 15540 0
[pid=14982] ppid=14973 vsize=81476 CPUtime=2.46 cores=1,3,5,7
/proc/14982/stat : 14982 (glucosInc) R 14973 14970 14929 0 -1 4202496 15729 0 0 0 243 3 0 0 20 0 1 0 278371901 83431424 17728 33554432000 4194304 5654031 140735879002432 140735878990248 4209096 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/14982/statm: 20369 17728 140 357 0 20009 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 154560

[startup+12.7004 s]
/proc/loadavg: 1.22 1.32 1.67 3/182 14987
/proc/meminfo: memFree=30159868/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=86564 CPUtime=5.18 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 16629 0 0 0 515 3 0 0 20 0 1 0 278372268 88641536 19603 33554432000 4194304 5654031 140733982151808 140733982139624 4215079 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 21641 19603 141 357 0 21281 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 167404

[startup+25.5005 s]
/proc/loadavg: 1.34 1.34 1.67 3/181 15031
/proc/meminfo: memFree=30174976/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=136868 CPUtime=17.98 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 19340 0 0 0 1793 5 0 0 20 0 1 0 278372268 140152832 29365 33554432000 4194304 5654031 140733982151808 140733982139624 4232707 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 34217 29365 142 357 0 33857 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 217708

[startup+51.1004 s]
/proc/loadavg: 1.56 1.39 1.68 3/182 15035
/proc/meminfo: memFree=30135364/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=136868 CPUtime=43.57 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 20278 0 0 0 4351 6 0 0 20 0 1 0 278372268 140152832 32310 33554432000 4194304 5654031 140733982151808 140733982139624 4232477 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 34217 32310 142 357 0 33857 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 217708

[startup+102.3 s]
/proc/loadavg: 1.82 1.49 1.69 3/181 15035
/proc/meminfo: memFree=30095432/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=186188 CPUtime=94.77 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 21149 0 0 0 9468 9 0 0 20 0 1 0 278372268 190656512 41724 33554432000 4194304 5654031 140733982151808 140733982139624 4215009 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 46547 41724 142 357 0 46187 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 267028

[startup+162.3 s]
/proc/loadavg: 1.93 1.58 1.71 3/181 15037
/proc/meminfo: memFree=30101432/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=186188 CPUtime=154.75 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 22035 0 0 0 15463 12 0 0 20 0 1 0 278372268 190656512 41731 33554432000 4194304 5654031 140733982151808 140733982139624 4215040 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 46547 41731 142 357 0 46187 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 267028

[startup+222.307 s]
/proc/loadavg: 2.01 1.67 1.73 3/181 15037
/proc/meminfo: memFree=30091360/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=186188 CPUtime=214.75 cores=1,3,5,7

################
# More data... #
################

/proc/loadavg: 2.00 2.00 1.91 3/181 15077
/proc/meminfo: memFree=30033568/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=267096 CPUtime=1354.54 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 63672 0 0 0 135353 101 0 0 20 0 1 0 278372268 273506304 56908 33554432000 4194304 5654031 140733982151808 140733982139624 4232821 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 66774 56908 142 357 0 66414 0
Current children cumulated CPU time (s) 1362.03
Current children cumulated vsize (KiB) 347936

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/181 15077
/proc/meminfo: memFree=30014180/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=267096 CPUtime=1414.54 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 64821 0 0 0 141350 104 0 0 20 0 1 0 278372268 273506304 59468 33554432000 4194304 5654031 140733982151808 140733982139624 4232803 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 66774 59468 142 357 0 66414 0
Current children cumulated CPU time (s) 1422.03
Current children cumulated vsize (KiB) 347936

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/181 15077
/proc/meminfo: memFree=29999240/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=267096 CPUtime=1474.53 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 65984 0 0 0 147345 108 0 0 20 0 1 0 278372268 273506304 58956 33554432000 4194304 5654031 140733982151808 140733982139624 4232821 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 66774 58956 142 357 0 66414 0
Current children cumulated CPU time (s) 1482.02
Current children cumulated vsize (KiB) 347936

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 1.91 3/181 15077
/proc/meminfo: memFree=30001324/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=267096 CPUtime=1534.52 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 67146 0 0 0 153340 112 0 0 20 0 1 0 278372268 273506304 57932 33554432000 4194304 5654031 140733982151808 140733982139624 4214944 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 66774 57932 142 357 0 66414 0
Current children cumulated CPU time (s) 1542.01
Current children cumulated vsize (KiB) 347936

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/181 15078
/proc/meminfo: memFree=29989084/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=267096 CPUtime=1594.51 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 68304 0 0 0 159335 116 0 0 20 0 1 0 278372268 273506304 56396 33554432000 4194304 5654031 140733982151808 140733982139624 4232821 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 66774 56396 142 357 0 66414 0
Current children cumulated CPU time (s) 1602
Current children cumulated vsize (KiB) 347936

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/181 15078
/proc/meminfo: memFree=29995152/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=267096 CPUtime=1654.49 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 69503 0 0 0 165330 119 0 0 20 0 1 0 278372268 273506304 54860 33554432000 4194304 5654031 140733982151808 140733982139624 4232821 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 66774 54860 142 357 0 66414 0
Current children cumulated CPU time (s) 1661.98
Current children cumulated vsize (KiB) 347936

[startup+1722.3 s]
/proc/loadavg: 2.05 2.01 1.91 3/181 15078
/proc/meminfo: memFree=30006492/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=217008 CPUtime=1714.48 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 69840 0 0 0 171326 122 0 0 20 0 1 0 278372268 222216192 51999 33554432000 4194304 5654031 140733982151808 140733982139624 4215353 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 54252 51999 142 357 0 53892 0
Current children cumulated CPU time (s) 1721.97
Current children cumulated vsize (KiB) 297848

[startup+1782.3 s]
/proc/loadavg: 2.02 2.01 1.91 3/182 15081
/proc/meminfo: memFree=30011992/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=217008 CPUtime=1774.47 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 71332 0 0 0 177320 127 0 0 20 0 1 0 278372268 222216192 49439 33554432000 4194304 5654031 140733982151808 140733982139624 4215290 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 54252 49439 142 357 0 53892 0
Current children cumulated CPU time (s) 1781.96
Current children cumulated vsize (KiB) 297848



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.01 2.01 1.91 3/182 15081
/proc/meminfo: memFree=29990724/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=267096 CPUtime=1792.58 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 72163 0 0 0 179130 128 0 0 20 0 1 0 278372268 273506304 54348 33554432000 4194304 5654031 140733982151808 140733982139624 4232821 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 66774 54348 142 357 0 66414 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 347936

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.01 2.01 1.91 3/182 15081
/proc/meminfo: memFree=29990724/32873844 swapFree=7108/7108
[pid=14970] ppid=14967 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/14970/stat : 14970 (npSolver-pbo-I.) S 14967 14970 14929 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 278371517 9367552 275 33554432000 4194304 5064252 140733720573904 140733720572816 249649849934 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/14970/statm: 2287 275 233 213 0 72 0
[pid=14973] ppid=14970 vsize=71692 CPUtime=7.49 cores=1,3,5,7
/proc/14973/stat : 14973 (npSolver-pbo) S 14970 14970 14929 0 -1 4202496 14471 51112 0 0 114 87 525 23 20 0 1 0 278371517 73412608 16829 33554432000 4194304 5992684 140736106457888 140736106442792 5179600 0 0 4096 0 18446744071580380219 0 0 17 3 0 0 0 0 0
/proc/14973/statm: 17923 16829 186 440 0 17479 0
[pid=14987] ppid=14973 vsize=267096 CPUtime=1792.58 cores=1,3,5,7
/proc/14987/stat : 14987 (glucosInc) R 14973 14970 14929 0 -1 4202496 72163 0 0 0 179130 128 0 0 20 0 1 0 278372268 273506304 54348 33554432000 4194304 5654031 140733982151808 140733982139624 4232821 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/14987/statm: 66774 54348 142 357 0 66414 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 347936

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 14970 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=402026
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=114830
# CPU time returned by wait4() is 7.51686
# while last known CPU time is 1800.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.42
CPU time (s): 1800.07
CPU user time (s): 1797.69
CPU system time (s): 2.38
CPU usage (%): 99.9808
Max. virtual memory (cumulated for all children) (KiB): 509464

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.40203
system time used= 1.11483
maximum resident set size= 188088
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 65957
page faults= 0
swaps= 0
block input operations= 0
block output operations= 162856
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 416
involuntary context switches= 36

runsolver used 3.3215 second user time and 9.12261 second system time

The end

Launcher Data 

Begin job on node102 at 2012-05-27 14:40:30
IDJOB=3700084
IDBENCH=90546
IDSOLVER=2276
FILE ID=node102/3700084-1338122430
RUNJOBID= node102-1338122430-14946
PBS_JOBID= 14624485
Free space on /tmp= 71532 MiB

SOLVER NAME= npSolver inc
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/BA/normalized-BA_RDC4.dot_unif_20null0mast_rapportOE1.0_TMAX180_K67_cod2.opb
COMMAND LINE= DIR/npSolver-pbo-I.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3700084-1338122430/watcher-3700084-1338122430 -o /tmp/evaluation-result-3700084-1338122430/solver-3700084-1338122430 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo-I.sh HOME/instance-3700084-1338122430.opb 1024059603 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 30f336dd624b9f7763c8bbeed1369f76
RANDOM SEED=1024059603

node102.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30489604 kB
Buffers:          351780 kB
Cached:          1187192 kB
SwapCached:            0 kB
Active:           889764 kB
Inactive:         659048 kB
Active(anon):       1956 kB
Inactive(anon):    11040 kB
Active(file):     887808 kB
Inactive(file):   648008 kB
Unevictable:        7108 kB
Mlocked:            7108 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             21012 kB
Writeback:             0 kB
AnonPages:         17536 kB
Mapped:            13540 kB
Shmem:               200 kB
Slab:             695420 kB
SReclaimable:     137516 kB
SUnreclaim:       557904 kB
KernelStack:        1376 kB
PageTables:         4240 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     102808 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71472 MiB
End job on node102 at 2012-05-27 15:10:30