Backup throughput dropping off dramatically

I have a server attached to an emc SAN  that is backed up to a Quantum, ATL library. This is attached w/2GB fibre.  I used to get 1500MB to 1700MB p/min throughput on my backup but lately it has dropped off to 65mb per minute and then that drops off to 45-35 mb after awhile. So far I have moved data off of luns that where filling up and i have defraged the drives on the server. Is there anything else I can do?  How can I tell if the HBA is going bad? Backup software used in Brightstor Enterprise 10.5
Who is Participating?
I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

There is a utility called RawRead which measures the throughput of harddrives. This is to help find out if the problem is at the drive end.

Another thing to do is enable logging on the switch during a backup. A lot of times this is an easy way to see on which side the problem is. For example  the port going to the server has little to know errors but the port going to the library has lots. At that point the problem has been cut in half.

I have not used EMC stuff but it probably has it's own logging that can be enabled.

To test to see if the bottleneck is at the tape drive end run the command "simulate -ca". This lets you create an imaginary tape device. So data is read from the source and is processed in the normal way up to the point of being written to tape where it is just dumped since there is not a physical drive. In this case it might be a pain to test. Any BEB Distributed servers will have to have BrightStor shut down and only the Primary running. Simulate will replace the current configuration so after removing the simulated device it will be necessary to run Device Confguration again to setup the library. That's why it is a bit of a pain.

That brings up a good point, if there are Distributed servers check to see if they have the same problem.

Does the BEB server have just one HBA?
blee5Author Commented:
Actually the Brightstor Server that is having the issue is a distributed server with one HBA that connects to the SAN and another HBA that connects to to the Library.
That helps. Since the BEB Primary server does not have this problem you know it is somewhere between the switch and this system. Question is if it is the system or the SAN.

To test the system Performance Monitor or Task Manager can be used to check system resources. Look for a steady decline in available resources.

At the SAN end good old swapping might be the easiest way of testing. Since this server has two HBAs, how about swapping the cables. If LUN Masking is not setup then all there is to worry about is the zoning. If the zoning was setup via the port then it should not be a problem at all. If zoning is setup for the HBAs world wide name then it will have to be modified. Another test would be swapping ports at the switch. Between the two tests you will have tested the HBA, cable, GBIC, and port.


Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today
Storage Software

From novice to tech pro — start learning today.

Question has a verified solution.

Are you are experiencing a similar issue? Get a personalized answer when you ask a related question.

Have a better answer? Share it in a comment.