Trace number 3715425

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver inc-topdown-quickBound? (TO) 1800 1800.31

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/wcsp/driver/
normalized-driverlog05c_wcsp.wbo
MD5SUM4a9698a367fd536b10c2caf05e789011
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1278
Best CPU time to get the best result obtained on this benchmark9.71152
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables1359
Total number of constraints37158
Number of soft constraints36807
Number of constraints which are clauses36807
Number of constraints which are cardinality constraints (but not clauses)351
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint11
Top cost 66052
Min constraint cost 1
Max constraint cost 66052
Sum of constraints costs 2387909283
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 12
Number of bits of the biggest sum of numbers4
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.21	c run usual solver
0.98/1.02	o 1399369
0.98/1.02	c starting approximation
0.98/1.02	c factor = 2
0.98/1.02	c factor still to low - shrinking to 154520
0.98/1.02	c approx number of clauses: 1e+06
0.98/1.02	c current bound: 699684
6.17/6.25	c leaving approximation
6.17/6.25	c finished approximation
6.17/6.25	c fallback to adder encoding
1800.00/1800.31	c error: unexpected solver exit code
1800.00/1800.31	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3715425-1338246066/watcher-3715425-1338246066 -o /tmp/evaluation-result-3715425-1338246066/solver-3715425-1338246066 -C 1800 -W 1900 -M 15500 HOME/npSolver-wbo-Itdqb.sh HOME/instance-3715425-1338246066.wbo 672468075 HOME HOME 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 1.92 3/180 28323
/proc/meminfo: memFree=30309704/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0

[startup+0.0241129 s]
/proc/loadavg: 2.00 2.00 1.92 3/180 28323
/proc/meminfo: memFree=30309704/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100155 s]
/proc/loadavg: 2.00 2.00 1.92 3/180 28323
/proc/meminfo: memFree=30309704/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.30012 s]
/proc/loadavg: 2.00 2.00 1.92 3/180 28323
/proc/meminfo: memFree=30309704/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.70019 s]
/proc/loadavg: 2.00 2.00 1.92 3/180 28323
/proc/meminfo: memFree=30309704/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.5003 s]
/proc/loadavg: 2.00 2.00 1.92 3/182 28334
/proc/meminfo: memFree=30299628/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=21880 CPUtime=1.1 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 6047 12654 0 0 30 11 65 4 20 0 1 0 290732681 22405120 4275 33554432000 4194304 5990268 140733770344656 140733770336064 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 5470 4275 174 439 0 5027 0
Current children cumulated CPU time (s) 1.1
Current children cumulated vsize (KiB) 31028

[startup+3.10042 s]
/proc/loadavg: 2.00 2.00 1.92 3/184 28337
/proc/meminfo: memFree=30233860/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=21880 CPUtime=1.1 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 6047 12654 0 0 30 11 65 4 20 0 1 0 290732681 22405120 4275 33554432000 4194304 5990268 140733770344656 140733770336064 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 5470 4275 174 439 0 5027 0
[pid=28336] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28336/stat : 28336 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 290732793 9367552 267 33554432000 4194304 5064252 140735075939280 140735075938192 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28336/statm: 2287 267 226 213 0 72 0
[pid=28337] ppid=28336 vsize=55176 CPUtime=1.97 cores=1,3,5,7
/proc/28337/stat : 28337 (glucose) R 28336 28323 22749 0 -1 4202496 11592 0 0 0 195 2 0 0 20 0 1 0 290732793 56500224 12245 33554432000 4194304 5208918 140734544702096 140734544699928 4213234 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28337/statm: 13794 12245 101 248 0 13543 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 95352

[startup+6.30038 s]
/proc/loadavg: 2.00 2.00 1.92 3/184 28389
/proc/meminfo: memFree=30196204/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=16328 CPUtime=6.29 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) R 28323 28323 22749 0 -1 4202496 8117 27552 0 0 35 12 575 7 20 0 1 0 290732681 16719872 3255 33554432000 4194304 5990268 140733770344656 140733770336640 4955679 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 4082 3256 181 439 0 3639 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 25476

[startup+12.7004 s]
/proc/loadavg: 2.00 2.00 1.92 3/184 28396
/proc/meminfo: memFree=29439616/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=396244 CPUtime=1.69 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 52782 0 0 0 154 15 0 0 20 0 1 0 290733781 405753856 91629 33554432000 4194304 5208918 140737368836832 140737367786232 4465602 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 99061 91629 70 248 0 98810 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 946820

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 1.92 3/184 28396
/proc/meminfo: memFree=29004708/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=775332 CPUtime=14.49 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 104959 0 0 0 1416 33 0 0 20 0 1 0 290733781 793939968 165614 33554432000 4194304 5208918 140737368836832 140737368834792 4228997 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 193833 165614 103 248 0 193582 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 1325908

[startup+51.1004 s]
/proc/loadavg: 2.00 2.00 1.92 3/184 28396
/proc/meminfo: memFree=29004120/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=775332 CPUtime=40.08 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 104959 0 0 0 3975 33 0 0 20 0 1 0 290733781 793939968 165614 33554432000 4194304 5208918 140737368836832 140737368834792 4229365 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 193833 165614 103 248 0 193582 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 1325908

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 1.92 3/183 28396
/proc/meminfo: memFree=29003012/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=775544 CPUtime=91.28 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 104998 0 0 0 9095 33 0 0 20 0 1 0 290733781 794157056 165653 33554432000 4194304 5208918 140737368836832 140737368834792 4229319 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 193886 165653 103 248 0 193635 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 1326120

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/183 28396
/proc/meminfo: memFree=29000092/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=775544 CPUtime=151.27 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 105002 0 0 0 15094 33 0 0 20 0 1 0 290733781 794157056 165657 33554432000 4194304 5208918 140737368836832 140737368834792 4229319 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 193886 165657 103 248 0 193635 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 1326120

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/183 28396
/proc/meminfo: memFree=28994756/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 105565 0 0 0 141074 34 0 0 20 0 1 0 290733781 796532736 168254 33554432000 4194304 5208918 140737368836832 140737368834792 4205672 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 194466 168254 104 248 0 194215 0
Current children cumulated CPU time (s) 1422.06
Current children cumulated vsize (KiB) 1328440

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/183 28413
/proc/meminfo: memFree=28155888/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=777864 CPUtime=1471.06 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 105566 0 0 0 147072 34 0 0 20 0 1 0 290733781 796532736 168255 33554432000 4194304 5208918 140737368836832 140737368834792 4229319 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 194466 168255 104 248 0 194215 0
Current children cumulated CPU time (s) 1482.04
Current children cumulated vsize (KiB) 1328440

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/183 28414
/proc/meminfo: memFree=28152292/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=777864 CPUtime=1531.05 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 105567 0 0 0 153071 34 0 0 20 0 1 0 290733781 796532736 168256 33554432000 4194304 5208918 140737368836832 140737368834792 4229365 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 194466 168256 104 248 0 194215 0
Current children cumulated CPU time (s) 1542.03
Current children cumulated vsize (KiB) 1328440

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/184 28415
/proc/meminfo: memFree=28156516/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=777864 CPUtime=1591.05 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 105569 0 0 0 159071 34 0 0 20 0 1 0 290733781 796532736 168258 33554432000 4194304 5208918 140737368836832 140737368834792 4229365 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 194466 168258 104 248 0 194215 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 1328440

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/183 28415
/proc/meminfo: memFree=28136736/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=777864 CPUtime=1651.04 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 105570 0 0 0 165070 34 0 0 20 0 1 0 290733781 796532736 168259 33554432000 4194304 5208918 140737368836832 140737368834792 4229365 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 194466 168259 104 248 0 194215 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 1328440

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/183 28415
/proc/meminfo: memFree=28136736/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=777864 CPUtime=1711.03 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 105571 0 0 0 171069 34 0 0 20 0 1 0 290733781 796532736 168260 33554432000 4194304 5208918 140737368836832 140737368834792 4211019 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 194466 168260 104 248 0 194215 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 1328440

[startup+1782.3 s]
/proc/loadavg: 2.05 2.01 1.95 3/184 28418
/proc/meminfo: memFree=28136244/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=777864 CPUtime=1771.02 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 105572 0 0 0 177068 34 0 0 20 0 1 0 290733781 796532736 168261 33554432000 4194304 5208918 140737368836832 140737368834792 4229365 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 194466 168261 104 248 0 194215 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 1328440



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.04 2.01 1.95 3/183 28419
/proc/meminfo: memFree=28136376/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=777864 CPUtime=1789.02 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 105572 0 0 0 178868 34 0 0 20 0 1 0 290733781 796532736 168261 33554432000 4194304 5208918 140737368836832 140737368834792 4228997 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 194466 168261 104 248 0 194215 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 1328440

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.3 s]
/proc/loadavg: 2.04 2.01 1.95 3/183 28419
/proc/meminfo: memFree=28136376/32873648 swapFree=6860/6860
[pid=28323] ppid=28321 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28323/stat : 28323 (npSolver-wbo-It) S 28321 28323 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 290732681 9367552 275 33554432000 4194304 5064252 140736049382160 140736049381072 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/28323/statm: 2287 275 233 213 0 72 0
[pid=28324] ppid=28323 vsize=532280 CPUtime=10.98 cores=1,3,5,7
/proc/28324/stat : 28324 (npSolver-wbo) S 28323 28323 22749 0 -1 4202496 20572 27552 0 0 449 67 575 7 20 0 1 0 290732681 545054720 75195 33554432000 4194304 5990268 140733770344656 140733770336080 5173822 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/28324/statm: 133070 75195 182 439 0 132627 0
[pid=28395] ppid=28324 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/28395/stat : 28395 (satsolver.sh) S 28324 28323 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 290733781 9367552 267 33554432000 4194304 5064252 140736758823488 140736758822400 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/28395/statm: 2287 267 226 213 0 72 0
[pid=28396] ppid=28395 vsize=777864 CPUtime=1789.02 cores=1,3,5,7
/proc/28396/stat : 28396 (glucose) R 28395 28323 22749 0 -1 4202496 105572 0 0 0 178868 34 0 0 20 0 1 0 290733781 796532736 168261 33554432000 4194304 5208918 140737368836832 140737368834792 4228997 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/28396/statm: 194466 168261 104 248 0 194215 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 1328440

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28323 and gives
#  childrusage.ru_utime.tv_sec=10
#  childrusage.ru_utime.tv_usec=247442
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=754885
# CPU time returned by wait4() is 11.0023
# while last known CPU time is 1800
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.31
CPU time (s): 1800
CPU user time (s): 1798.92
CPU system time (s): 1.08
CPU usage (%): 99.9826
Max. virtual memory (cumulated for all children) (KiB): 1658012

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 10.2474
system time used= 0.754885
maximum resident set size= 596496
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 49100
page faults= 0
swaps= 0
block input operations= 0
block output operations= 611864
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 87
involuntary context switches= 40

runsolver used 3.55546 second user time and 9.15961 second system time

The end

Launcher Data 

Begin job on node116 at 2012-05-29 01:01:06
IDJOB=3715425
IDBENCH=79462
IDSOLVER=2297
FILE ID=node116/3715425-1338246066
RUNJOBID= node116-1338233401-24069
PBS_JOBID= 14624642
Free space on /tmp= 71460 MiB

SOLVER NAME= npSolver inc-topdown-quickBound
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/wcsp/driver/normalized-driverlog05c_wcsp.wbo
COMMAND LINE= DIR/npSolver-wbo-Itdqb.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3715425-1338246066/watcher-3715425-1338246066 -o /tmp/evaluation-result-3715425-1338246066/solver-3715425-1338246066 -C 1800 -W 1900 -M 15500  HOME/npSolver-wbo-Itdqb.sh HOME/instance-3715425-1338246066.wbo 672468075 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4a9698a367fd536b10c2caf05e789011
RANDOM SEED=672468075

node116.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30310612 kB
Buffers:          449232 kB
Cached:          1220988 kB
SwapCached:         3232 kB
Active:           959400 kB
Inactive:         748912 kB
Active(anon):      27364 kB
Inactive(anon):     8956 kB
Active(file):     932036 kB
Inactive(file):   739956 kB
Unevictable:        6860 kB
Mlocked:            6860 kB
SwapTotal:      67108856 kB
SwapFree:       67103672 kB
Dirty:             11808 kB
Writeback:             0 kB
AnonPages:         33988 kB
Mapped:            13736 kB
Shmem:                96 kB
Slab:             716936 kB
SReclaimable:     160528 kB
SUnreclaim:       556408 kB
KernelStack:        1512 kB
PageTables:         4140 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     151092 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70980 MiB
End job on node116 at 2012-05-29 01:31:07