Solved

SQL Backup times in new ESXi cluster

Posted on 2012-03-12
9
504 Views
Last Modified: 2012-03-13
I'm not sure if SQL backups would be a good way to gauge performance, but this warrants some concern.

We recently finished a project where we stood up a new virtual environment. Our old system was ESX 4 with a Clariion SAN serving FC LUNs. The FC connections were rated at 4GBs.

The new system is ESXi 5 with a NetApp NAS serving NFS datastores (IP storage is 4x 1GiGe).

As we migrated all of our applications and utility servers, we noticed a performance increase with the response times. We left our file server and main SQL server for last.

Our SQL(2008 R2) backups were taking about an hour each night to run. This is SQL's native backup process. We expected this time to change once we moved the VM over to the new system. It hasn't. If anything, it increased by a few minutes. With the new hardware on the new hosts we expected to see some decrease in time.

Am I missing something here?

Old ESX Specs:
HP DL380 G7
X5650 2.67GHz CPUs

New ESX specs:
Cisco C260 M2
E7-2870 2.4GHz CPUs

Memory contention was never an issue here.
0
Comment
Question by:MMRNLA
  • 4
  • 3
  • 2
9 Comments
 
LVL 119

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 300 total points
ID: 37709758
4GB Fibre Channel to NFS.

I suspect NFS could be the bottleneck and slower.

Have you enabled Jumbo Frames. Test with and without Jumbo Frames enabled.

HOW TO: Enable Jumbo Frames on a VMware vSphere Hypervisor (ESXi 5.0) host server using the VMware vSphere Client

and see this recent Closed Question, on a similar NFS High Latency performance issue.

http://www.experts-exchange.com/Software/VMWare/Q_27625388.html
0
 
LVL 1

Author Comment

by:MMRNLA
ID: 37709935
our average read latency is 4.51, write is 1.5 Milliseconds. When looking at the history of the datastore log, we see a spike of 28/67 milliseconds during the backup window.

I've attached a screenshot.

Looking at this graph, the numbers look good until we hit our backup window (10PM). Would'nt this be normal given the amount of I/O that is involved during a SQL backup?

Is enabling jumbo frames going to make that much of a difference? Reason I am asking is this will require an outage on the network side all the way to the core.

Thanks
SQL.jpg
0
 
LVL 119
ID: 37709948
Jumbo Frames can make an improvement, but it could make it worse.

It's usually a recommended option when use NFS.

Enabling jumbo frames, needs to be be enabled, on the ESX server, network switch and NetApp filer. So it's not a quick change, and will require planning before implementation.
0
What is SQL Server and how does it work?

The purpose of this paper is to provide you background on SQL Server. It’s your self-study guide for learning fundamentals. It includes both the history of SQL and its technical basics. Concepts and definitions will form the solid foundation of your future DBA expertise.

 
LVL 21

Assisted Solution

by:robocat
robocat earned 200 total points
ID: 37710238
You may suffer from fragmentation. This usually shows when running backups.

You can check this by running the command

wafl scan measure_layout volumename

This will tell you if you need to defrag the LUN. A one time defrag can be done with a command like this:

reallocate start -f [-p] pathname

This can also be scheduled on a regular basis, see the man page for the reallocate command.
0
 
LVL 1

Author Comment

by:MMRNLA
ID: 37710285
Robocat, when I attempt this command from a SSH session on the filer it comes back with "wafl not found". This is 8.0.2P4 7-Mode.

Any ideas?
0
 
LVL 21

Expert Comment

by:robocat
ID: 37711276
Try if it works in advanced mode

priv set advanced
wafl ...
priv set


Or you could try this command instead:

reallocate measure volname
0
 
LVL 1

Author Comment

by:MMRNLA
ID: 37714484
Quick question Hanccocka, when you said
"Jumbo Frames can make an improvement, but it could make it worse."

How could this possibly make things worse? We are discussing this change inhouse now..

thanks
0
 
LVL 119
ID: 37714514
We have tried Jumbo Frames, on many installations, and although recommended, it really is a matter of test after enabling, and checking it performance is better or worse.

for some of our clients, performance was no better, and some worse.

It depends on your network infrastrcucture, switches, Im told that some switches do not have adequate buffers, although do support Jumbo Frames.

So, test, test,testband test again, and see if JF works for your site.
0
 
LVL 1

Author Comment

by:MMRNLA
ID: 37714697
thanks!
0

Featured Post

Optimizing Cloud Backup for Low Bandwidth

With cloud storage prices going down a growing number of SMBs start to use it for backup storage. Unfortunately, business data volume rarely fits the average Internet speed. This article provides an overview of main Internet speed challenges and reveals backup best practices.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

HOW TO: Upload an ISO image to a VMware datastore for use with VMware vSphere Hypervisor 6.5 (ESXi 6.5) using the vSphere Host Client, and checking its MD5 checksum signature is correct.  It's a good idea to compare checksums, because many installat…
In this article, I will show you HOW TO: Install VMware Tools for Windows on a VMware Windows virtual machine on a VMware vSphere Hypervisor 6.5 (ESXi 6.5) Host Server, using the VMware Host Client. The virtual machine has Windows Server 2016 instal…
Teach the user how to configure vSphere clusters to support the VMware FT feature Open vSphere Web Client: Verify vSphere HA is enabled: Verify netowrking for vMotion and FT Logging is in place or create it: Turn On FT for a virtual machine: Verify …
This video shows you how to use a vSphere client to connect to your ESX host as the root user. Demonstrates the basic connection of bypassing certification set up. Demonstrates how to access the traditional view to begin managing your virtual mac…

809 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question