Solved

NetApp shelf stacks and disk rpm

Posted on 2011-09-09
19
2,262 Views
Last Modified: 2012-05-12
EE,

I guess this is two questions in one, illegal I know.

What is the point of haveing two stacks of disk shelfs instead of say one stack with two disk shelfs?

We also have a disk shelf that has 7k RPM and another that is 10k RPM, without slowing down all disks in the shelf to the slowest disk, would we just create a new AGGR for the slower shelf?

Thanks
0
Comment
Question by:snyderkv
  • 11
  • 8
19 Comments
 
LVL 42

Expert Comment

by:paulsolov
ID: 36512308
two stacks of shelves, depending on configuration will give you Multipath HA vs Singlepath HA.  Think of multipath as parallel vs single path which is serial


Create an aggr for teh slower drives, otherwise you'll slow down the entire aggr
0
 

Author Comment

by:snyderkv
ID: 36516067
Thanks Paul,

But you can multi-path HA one stack daisy chained with 4 shelfs as well. This is our setup, three 2246 15krpm shelfs and one DS4243 7krpm shelf. I'm pretty sure this was intended to be one stack which can easily be multipathed as well correct? I have the SAS and ACP cabling diagrams and it seems that way as far as I can remember.
0
 
LVL 42

Expert Comment

by:paulsolov
ID: 36516323
If you have 3 shelves I would probably make it a single stack, otherwise I typically make it a dual stack and spread the aggregates.  You're correct on the multipathing but since you have an odd number of disk single stack makes sense but even a dual stack I don't see any issues with it.
0
 

Author Comment

by:snyderkv
ID: 36516615
Sorry for the bad info, here is from our package

3 2246 shelfs 15k rpm
1 DS4243 7k rpm

So we do have 4 shelfs. One shelf in the single stack even if we made another AGGR would bring the entire stack down to 7k rpm correct or incorrect? Nowhere in my netapp docs does it describe this.

I ask because the cabling diagram for two stakcs increases in complexity and I'm already confused just looking at the docs for examples.
0
 

Author Comment

by:snyderkv
ID: 36516650
Ok so I'm thinking three 15k rpm shelfs in one stack and stack 2 with just the DS4243 and new AGGR?

Or does the stacks require an even number of shelfs for multi-ha? I'm assuming the multi HA will work for stack 1 and not required for stack #2 since it's most likely just being used for backup data?
0
 
LVL 42

Expert Comment

by:paulsolov
ID: 36517729
It depends.   If you have two controllers you will need at least 2 Aggregates.  Which filers are you running?
0
 

Author Comment

by:snyderkv
ID: 36518099
Here is the setup

Single 3240 Chassis with 2 controllers built in (HA) iSCSI with two slots per controller I think
x2 Nexus 5020
x1 FEX (fabric extender)
x3 2246 15k rpm
x1 4243 7k rpm

I know I need an AGGR per controller. And a third AGGR for the slower disk shelf?
0
 

Author Comment

by:snyderkv
ID: 36518114
And that slower disk shelf will be in another stack, by itself.
0
 
LVL 42

Expert Comment

by:paulsolov
ID: 36518132
I typically move the aggregate for each controller to a different shelf to ensure SPOF design is adequate.  You can make the slower disks part of the same stack, I don't think it will make much difference, just ensure that your aggr stays on the shelf, keep it simple.

Depending on what you're using it for you can put the second controller's vol0 onto the AGGR on the slow drives.

What are you going to be running on the filers?
0
How to improve team productivity

Quip adds documents, spreadsheets, and tasklists to your Slack experience
- Elevate ideas to Quip docs
- Share Quip docs in Slack
- Get notified of changes to your docs
- Available on iOS/Android/Desktop/Web
- Online/Offline

 

Author Comment

by:snyderkv
ID: 36518157
I think the first three 15k rpm shelfs are production data including exchange and stuff. All virtual with 4 ESX servers.

The 4243 I'm assuming will be for backups. I'm kinda making it up as I go along.
0
 
LVL 42

Accepted Solution

by:
paulsolov earned 500 total points
ID: 36518169
the 2423 aggregates can be per shelf or accross shelves, just ensure that your datastores are sized right so that you can get dedupe working (typically 30-80 percent).

I'm running vSphere 5 right now, no more 2TB limit which is nice.  Running NFS but FC works well too.  

I would also install DFM/OpsManager/Protection Manager as well
0
 

Author Comment

by:snyderkv
ID: 36518186
I'm a little confused since I haven't worked with more than one shelf before.

What is SPOF?

Each controller normally has one AGGR and one operating system vol0 that will be divided up between all three 15k rpm disks shelfs? So AGGR1A on controller 1 will own 18 disks and AGGR1B will own 18 disks.

Now for the 7k rpm 24 disk 4243 shelf, I would create another AGGR-C on which controller or can I create two to split them up as well? and have this in the same stack without reducing the stacks performance to 7k rpm?

Also, you said move the vol0 to the 4243. I'm lost, I only have two vol0, one for each controller. So I move one of them to the slow disk shelf in it's own AGGR-C or AGGR-D?
0
 
LVL 42

Expert Comment

by:paulsolov
ID: 36518210
What is SPOF?

--SINGLE POINT OF FAILURE

Each controller normally has one AGGR and one operating system vol0 that will be divided up between all three 15k rpm disks shelfs? So AGGR1A on controller 1 will own 18 disks and AGGR1B will own 18 disks.

--That's correct but sometimes I move the second vol0 (controller 2) to a SATA shelf to free up at least 4 drives on a fast shelf

Now for the 7k rpm 24 disk 4243 shelf, I would create another AGGR-C on which controller or can I create two to split them up as well? and have this in the same stack without reducing the stacks performance to 7k rpm?

You can create a single aggr or one on each controller (single aggregate is fine).  Since you have multipath HA is will work just fine.

Also, you said move the vol0 to the 4243. I'm lost, I only have two vol0, one for each controller. So I move one of them to the slow disk shelf in it's own AGGR-C or AGGR-D?

--As mentioned earlier you can move to SATA shelf to free up some of the faster drives, I can provide process if needed.
0
 

Author Comment

by:snyderkv
ID: 36518224
actually if you have a quick command to move the vol to a new shelf, let me know. Normally out of the box on a 2040 the o/s is already on the native shelf. I once blew the OS away and assigned the new OS to selected disks, but if you have a way to move it without blowing anything away that would be nice.

Thanks
0
 
LVL 42

Expert Comment

by:paulsolov
ID: 36518229
These two links I use as referrence


http://www.unitek.com/training/netapp/blog/2008/07/moving-root/

 
http://now.netapp.com/NOW/knowledge/docs/ontap/rel732_vs/html/v-series/ig_disk/moveroot.htm

If you're using snapmirror I would recommend setting up vfilers, been using them and it's soooo much easier then snapmirroring individaul volumes.
0
 

Author Comment

by:snyderkv
ID: 36518248
Thanks again
0
 

Author Comment

by:snyderkv
ID: 36518629
For my reference on SAS/Shelf cabling rules for 2246 and 4243 that I dug up.

http://communities.netapp.com/docs/DOC-9216

Configuring SAS Stacks

NetApp uses the term "stack" to refer to a collection of correctly wired and interconnected SAS shelves and adapters. The following guidelines apply:
 
Up to 10 shelves are supported per stack, except in the FAS2040 and FAS2050, which support up to 4 shelves per stack.

The DS4243 and DS2246 cannot be mixed in the same stack. They can be mixed in the same system by connecting them to different SAS ports. If you connect them to different ports on the same adapter, the adapter will automatically use the correct link speed for each stack.
When using the DS4243, SAS and SATA drives can be mixed in the same stack but not in the same shelf.

You should not mix 15k and 10k RPM SAS drives in the same aggregate. While it is possible, this will very likely limit the performance you’ll see from the faster drives.
NetApp extensively qualifies SAS cables for use with our SAS shelf family. SAS cables are a high-performance and critical component of the SAS architecture. Only official NetApp SAS cables are supported for use in SAS data path connections.

0
 
LVL 42

Expert Comment

by:paulsolov
ID: 36519178
My mistake, I thought  the shelves were the same but drives were different
0
 

Author Comment

by:snyderkv
ID: 36519318
My fault for not making it clear from the begining.
0

Featured Post

Top 6 Sources for Identifying Threat Actor TTPs

Understanding your enemy is essential. These six sources will help you identify the most popular threat actor tactics, techniques, and procedures (TTPs).

Join & Write a Comment

Hyper-convergence systems have taken the IT world by storm and have quickly started to change our point of view of how the data center should and could be architected. In this article, I’ll explain the benefits of employing a hyper-converged system …
The article will include the best Data Recovery Tools along with their Features, Capabilities, and their Download Links. Hope you’ll enjoy it and will choose the one as required by you.
This video teaches viewers how to encrypt an external drive that requires a password to read and edit the drive. All tasks are done in Disk Utility. Plug in the external drive you wish to encrypt: Make sure all previous data on the drive has been …
This Micro Tutorial will teach you how to reformat your flash drive. Sometimes your flash drive may have issues carrying files so this will completely restore it to manufacturing settings. Make sure to backup all files before reformatting. This w…

743 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

17 Experts available now in Live!

Get 1:1 Help Now