Solved

Veeam Backup (VSS Enabled) Snapshot Causes Server to go Offline

Posted on 2013-12-10
10
3,508 Views
Last Modified: 2014-01-24
Hi,

We are running a Veeam backup of one of our most important VMware guests. This VM Guest must stay on-line 24/7 and therefore we do not have a designated backup window, we must do it on the "fly".

The VM Guest has Sysbase SQL Anywhere 11 installed with a 17+GB database. The VM Guest is backed up using Veeam with "Enable application-aware image processing" set as true.

The problem we have is that when the VM Guest is being snapshot or the snapshot is being released we will lose pings to the server (network connection drops for a second or so a few times), which then causes the ODBC connection from the client's PC to the database to error.

I have contacted VMware and they have responded by saying that this is a known problem for VM Guests that have heave I/O loads.VMWare KB Their solutions were not helpful... System downtime during backup windows is not an option and we need to find a solution.

Should I be using "application-aware" image processing (VSS) in Veeam? As far as I understand this is a must to get consistent backups (e.g. OS files that are not corrupted).

I have had a browse through the Veeam Task logs and noticed a line VSSControl: Frozen in 12sec, could this be causing a problem?

I would be grateful of any help on this issue or information from people who have also experienced this type of problem with VMWare and how it was worked around.

Thanks, Greg
0
Comment
Question by:spen_lang
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
10 Comments
 
LVL 28

Expert Comment

by:jhyiesla
ID: 39708309
We use VEEAM to back up all of our VM's and we do them all while totally live. Mostly we don't have issues with this approach. A couple of questions.  

Are you using the latest version of VEEAM?  

Does the VM in question have adequate resources such as CPU, memory, and is it normally struggling with disk IOPs?  

What are you trying to back up to? Is it fast enough to take care of the issue?

Can you move the backup to another time of the day when the DB may be less busy?

We back up a MS SQL VM that is way larger than your without issue.  We did have some slowness issues with another very very busy VM and solved that by giving it more resources.
0
 
LVL 120
ID: 39708366
1. Complete the backup at a quite time.

2. Your storage maybe too slow, for Veeam Backup (and Snapshot based backups).

So what is your storage?
0
 
LVL 16

Expert Comment

by:Dirk Mare
ID: 39708436
Have you contacted Veeam about this issue, Veeam support is excellent ask them to look at your backup job, they know exactly how to fine tune the job for optimal performance and reliability.

Send them the job logs and veaam server logs for them to analyze.

They disabled application aware processing on my backups to improve performance and replication reliability on my server not to long ago.

Something you can also consider is to take a snapshot of the VM and start that. Then you can at least play with the duplicate (snapshot) server and then it wont effect your production environment. Until you can get it fixed.

DirkMare
0
Windows Server 2016: All you need to know

Learn about Hyper-V features that increase functionality and usability of Microsoft Windows Server 2016. Also, throughout this eBook, you’ll find some basic PowerShell examples that will help you leverage the scripts in your environments!

 

Author Comment

by:spen_lang
ID: 39716027
I have contacted Veeam and I agree their support is excellent, however, I have been told that this is a problem with VMware and snapshotting heavy I/O guests.

I have now managed a work around. The guests main vmdk files (C and D) are located on very quick SAS disks (HP left SAN), there are 4 additional vmdk disks that I backup the database too and the vmdk files are located on SATA disks. I have converted the vmdk files that are on the SATA disks to independent persistent disks so that they are not affected by Snapshots. I have also changed the timing of the backup. THe combination of the two seem to have fixed the issue.

However, I am now stuck with the problem of, how can I backup an independent disk using Veeam when the disk is not in the snapshot of the server?

Thanks, Greg
0
 
LVL 5

Expert Comment

by:MaximVeeam
ID: 39716073
However, I am now stuck with the problem of, how can I backup an independent disk using Veeam when the disk is not in the snapshot of the server?
Veeam doesn't support independent-persistent disks for backup and replication jobs, because they were designed by VMware to provide an easy way of excluding a disk from a snapshot ("independent from shapshots").
0
 
LVL 120
ID: 39716136
This is to be expected as per @MaximVeeam post, http:#a39716073.

It's by design.

Why not move ALL the VMDKs to SAS disks, rather than SATA?
0
 

Author Comment

by:spen_lang
ID: 39716412
The reason we have some vmdk files on SATA is because we have limited SAN\SAS storage. So the only approach to copy the database backup files on the SATA disk is by scripting a copy of the file?
0
 
LVL 120
ID: 39716463
You could use SQL Manager to copy the databases, or Stop DB, copy flat databases, and restart the DB.

Faster storage is recommended.
0
 

Author Comment

by:spen_lang
ID: 39716677
The problem I have with any tools is that it is a Sybase database. I am using Sybase Central to backup the database to the SATA disk, which is working fine. I now need a solution to copy the backup files to a remote location. I was hoping Veeam could do this, but I guess I may have to revert back to Symantec BackupExec...
0
 
LVL 120

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE^2) earned 500 total points
ID: 39716718
It's you hardware which has the issue - really!
0

Featured Post

Free Tool: IP Lookup

Get more info about an IP address or domain name, such as organization, abuse contacts and geolocation.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Citrix XenDesktop 5.6 6 64
Server details to procure Microsoft volume licensing 3 72
VM backup 1 85
Point DNS (IP) to Azure VM not working 23 32
In this article, I will show you HOW TO: Install VMware Tools for Windows on a VMware Windows virtual machine on a VMware vSphere Hypervisor 6.5 (ESXi 6.5) Host Server, using the VMware Host Client. The virtual machine has Windows Server 2016 instal…
Ransomware is a malware that is again in the list of security  concerns. Not only for companies, but also for Government security and  even at personal use. IT departments should be aware and have the right  knowledge to how to fight it.
This tutorial will walk an individual through the process of installing the necessary services and then configuring a Windows Server 2012 system as an iSCSI target. To install the necessary roles, go to Server Manager, and select Add Roles and Featu…
How to Install VMware Tools in Red Hat Enterprise Linux 6.4 (RHEL 6.4) Step-by-Step Tutorial

738 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question