Solved

ZFS Nexenta on hp NL 40, from hardware to vm

Posted on 2014-01-15
34
906 Views
Last Modified: 2014-01-21
Hi,

I have this great zfs nexenta on HP NL 40 microserver, 16 GB RAM.
Back on time hanccocka (Andrew Hancock now apparently :-)) helped me out greatly to fully configure the system (A post -from multiple- http://www.experts-exchange.com/Software/VMWare/Q_27962816.html).


Now it turns out my config (3 hp NL 40, 1 for zfs, 2 for esxi) ware using way to much power. So I m looking for ways to lower power consumption.

I thought of getting rid of 2 esxi and running nexenta as a vm. Mostly only a dc is running anyhow (I'm barely using my environment these days). That would mean: ZFS + vm's, 1 ESXi host in standby, 1 to be sold.

However this would mean I'd have to boot my ZFS NAS (hp microserver) from it's usb stick again and then make a vm with Nexenta, then reconfigure it to use the disks internally (from ZFS).

No idea howto do this, please advise.

Just curoious, therefore one more thing: can I upgrade the HP Microserver NL40 in any way to add more ram/cpu (probably not, just asking: new motherboard maybe ...?). Or maybe built it into another chassis ...?

J.
0
Comment
Question by:janhoedt
  • 20
  • 14
34 Comments
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
I've always been Andrew Hancock!

The biggest issue with the N40L is it's processor, which is quite low powered, in terms of performance.

You can use Nexenta as a VM, and present the disks to the VM, as RAW, to achieve maximum performance.

My Article here shows to you how:-

HOW TO: Add Local Storage (e.g. a SATA disk) as a Raw Disk Mapping (RDM) or Mapped RAW LUN to a virtual machine hosted on ESXi

So, create a basic VM, add all the disks as Local RDM, download the Nexenta CDROM/ISO, BOOT it and Install.

Just curoious, therefore one more thing: can I upgrade the HP Microserver NL40 in any way to add more ram/cpu (probably not, just asking: new motherboard maybe ...?). Or maybe built it into another chassis ...?

Unfortunately, not you are limited by hardware to 16GB RAM (works but not supported).

Here you go the All-One-One!

Follow this Great PDF Article How to Do it
0
 

Author Comment

by:janhoedt
Comment Utility
Thanks for  fast your feedback Andrew!
As I want to do some pre-flight checks … I checked the “enable pass-through” … but my esxi doesn’t seem to support it (host does not support pass through configuration, googled screenshot, this is what I also got.

Probably a showstopper …?

J.
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
In that article for "super performance" they are adding the SCSI controller as a passthrough device to the VM.

You can use just pass the disks through to the VM, as per my EE Article above, with a reduction in performance, bu still obtain good figures.

I know you are trying to use what you have....but the MicroServerr GEN8 is now very good...

http://www.virten.net/2013/11/vsphere-5-homelab-esxi-on-hp-microserver-gen8/
0
 

Author Comment

by:janhoedt
Comment Utility
Hi Andrew,

Thansk. I got version 5.1.0 799733, could it help upgrading to latest version or is it really hardware related?
About the new HP Microserver: is is also low power, can I go beyond 16GB ram ... and most important, can I build in the config of my current ZFS (sharkoon, lsi ...) without to much hassle? Then I might consider it indeed (and sell my HP microservers).

J.
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
It's hardware related, very few Servers support VM Direct Path I/O.

It still has a maximum supported memory of 16GB. As for low power, it's similar to the low power current MicroServers.

Power Supply: 150 Watt

You will need to change processor for  VM Direct Path I/O support on the Gen8.
0
 

Author Comment

by:janhoedt
Comment Utility
Thanks, ok. My last questions, then I'll close this ticket. Will create a new one for other questions:

*the NL 40 has also 8 GB maximum supported but can do 16 GB. Won't 32 GB or even 64 GB work (It's a shame of the upgrade/effort if I have the same amount of RAM)?

*Any idea if I can order the gen8 modified with different specs (no disks, different processor ...)?

*What I also ask myself: the BIOS tweak I had to do on my NL40 (to see all the disks in , is it needed on gen8 also?

*Can I build in the config of my current ZFS (sharkoon, lsi ...) without to much hassle?
0
 
LVL 117

Accepted Solution

by:
Andrew Hancock (VMware vExpert / EE MVE) earned 500 total points
Comment Utility
*the NL 40 has also 8 GB maximum supported but can do 16 GB. Won't 32 GB or even 64 GB work (It's a shame of the upgrade/effort if I have the same amount of RAM)?

Not that has currently been tested or reported.

*Any idea if I can order the gen8 modified with different specs (no disks, different processor ...)?

No, it's not supported and is a *hack* as found by the Community testing, change at your own risk!

*What I also ask myself: the BIOS tweak I had to do on my NL40 (to see all the disks in , is it needed on gen8 also?

there is no eSATA port on the back, so the hack is not applicable, because there is no port to enable!

*Can I build in the config of my current ZFS (sharkoon, lsi ...) without to much hassle?

It has a 5.25" slot, should you should be able to relocate sharkoon!

BUT, please research before you purchase!
0
 

Author Closing Comment

by:janhoedt
Comment Utility
Thanks. So HP G8 is not an option for me (yet).
I could configure my current NL40 with ESXi and zfs but then I will throw away my LSI storage controller (which costed me about 200 Euro) so not an option either.
To bad.
0
 

Author Comment

by:janhoedt
Comment Utility
What would be the next level ... machine HP NL 60 ...?

Iow which machine could I buy which I can make a dedicated ESXi with ZFS machine which can hold more ram and still has acceptable power usage ...?
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
if you want to use VM Direct Path I/O, the cheapest lower power model is the Microserver Gen8, which users are experimenting with.

Servers with VM Direct Path I/O, are few, and those that do have it, will require  larger power supplies.

What is acceptable power usage?
0
 

Author Comment

by:janhoedt
Comment Utility
Thanks, I m just looking for optimal performance for as little electricity usage in my lab.
Current config: zfs NL 40, 1 esx running, 1 standby. I was hoping to build 1 esx with zfs vm which has about 32 or 64 gb ram and fast cpu. Since all storage is local, speed should be really fast. Power usage: 250, 300 wattt?
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
that's the issue

performance versus power versus function.

MicroServer Gen8 ticks a box with all those. If you select a larger server, more electricity, more performance, and more cost to run.

Is noise an issue ?

these are tower servers, capable of 32GB, a lot more noise, and power 300Watts

HP ProLiant ML310e Gen8
DELL PowerEdge T110 II
IBM x3100 M4

none of the above support VM Direct Path I/O still, you've got to purchase an expensive Enterprise server for that option, unless you build your own whitebox, out of bits.

e.g. processor and motherboard etc and then you can pick your own supported motherboard, processor, case, memory etc

here's a homebox, whiteboard build with VM Direct Path I/O

http://thehomeserverblog.com/esxi/esxi-5-0-amd-whitebox-server-for-500-with-passthrough-iommu-build-2/

http://wahlnetwork.com/2013/12/02/new-haswell-fueled-esxi-5-5-home-lab-build/
0
 

Author Comment

by:janhoedt
Comment Utility
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
Again in this article, what he built does not support VM Direct Path I/O, so had to pass the disks through RDM, and lose some performance for his NAS.

The NUC are low power, we have them here, but they are limited to 32GB, and you cannot use any devices in them.
0
 

Author Comment

by:janhoedt
Comment Utility
32 gb on 25 watt?! That would mean I can sell my 2 NL 40 and run 1 nuc on 25 watt instead now 1 esx now powered on, 1 standby .... Or even 2 nucs for ha on 50 w .... Sounds really good to me.
0
 

Author Comment

by:janhoedt
Comment Utility
Actually my main concerns are power usage and performance, 2 opposities I know ....
0
 

Author Comment

by:janhoedt
Comment Utility
What if I would configure the lsi raid on my sharkoon, I d have 6 disks of 120 gb ssd in raid 5 as lun, then no need for zfs and about 16 gb for my vm s. Then again my 3 sata disks of 2tb are lost in space (can t do anything with it). It would make my esxi really fast though. I could forget about vcenter too just connect to 1 esx. Good enough for me.
0
Free Gift Card with Acronis Backup Purchase!

Backup any data in any location: local and remote systems, physical and virtual servers, private and public clouds, Macs and PCs, tablets and mobile devices, & more! For limited time only, buy any Acronis backup products and get a FREE Amazon/Best Buy gift card worth up to $200!

 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
Have you measured the power consumption of a N40L with zero disks, USB install because the power consumption is similar.

But it's of no surprise because the NUC are low power, designed for Desktop PCs, and have no expansion!

Again a compromise.

Your final solution would work.
0
 

Author Comment

by:janhoedt
Comment Utility
Thanks, my config could work indeed. Just wonder if I could have some kind of raid on my sata too ( extra raid controller), software raid ...? Then I could put all my offline vm s and data on that lun.
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
software RAID will not work with ESXi.

You will need a supported RAID controller for ESXi RAID.
0
 

Author Comment

by:janhoedt
Comment Utility
Thanks. Not sure I understand, I configure my lsi raid controller to raid 5 on the sharkoon ssd s. I boot from esxi usb then create a lun on this raid 5 ssd volume. Esx I just sees the one ssd raid 5 volume, right?
The 3 sata disks will be seen as 3 seperate volumes. No soft raid ok, so no raid possible on sata s then since I think there s no possibility to add extra raid controller to NL 40(?)
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
Thanks. Not sure I understand, I configure my lsi raid controller to raid 5 on the sharkoon ssd s. I boot from esxi usb then create a lun on this raid 5 ssd volume. Esx I just sees the one ssd raid 5 volume, right?

Correct.

The SATA controller in the N40L only supports software RAID, this is not supported in ESXi as RAID.

if you want three SATA disks, 3 separate datastores, that will work okay.
0
 

Author Comment

by:janhoedt
Comment Utility
Thanks!  
I m considering 3 options now:
1.install esxi on local raid5 ssd, removing 3 local sata disks (2 TB)
2.installing windows 2012 core on raid 1 ssd 50 gb, lun of 4x 120 gb
3.buying this Intell NUC of 32 GB, no idea if that is a good option though(?)
0
 

Author Comment

by:janhoedt
Comment Utility
Fyi: option 1. = lun on 4 ssd of 120 gb
In all cases I d sell 2 of my 3 NL 40 s.
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
1,2,3 all good options.
0
 

Author Comment

by:janhoedt
Comment Utility
A thought: with zfs a a vm, can t I offer my 3 sata disks as 1 disk in raid 5 hardware? This way I can still use my lsi raid and maybe have performance gain?
0
 

Author Comment

by:janhoedt
Comment Utility
A thought: with zfs a a vm, can t I offer my 3 sata disks as 1 disk in raid 5 hardware? This way I can still use my lsi raid and maybe have performance gain?

OR make a raid 5 from 3 ssd s for running the nexenta zfs vm and maybe another vm. Then 2 ssd for cache 1 for log ...? (I have 4 ssd of 60 gb, 4 of 120 gb, 2 laptop disks).
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
You can present your three SATA disks to a VM, using RAW mode.

and then use ZRAID, to create a ZFS RAID of 3 disks, this is the preferred way of using ZFS, because it's faster than "hardware RAID."
0
 

Author Comment

by:janhoedt
Comment Utility
And maybe overclock the cpu a bit ...
0
 

Author Comment

by:janhoedt
Comment Utility
Thanks, I know, by I run my esxi from usb. Then have 6 ssd in sharkoon, 3 sata disks. The idea: present raid 5 3 ssd as 1 disk to esxi, then nexenta vm on this disk. Present 3 other ssd raw for cache and log. 3 sata indeed as raw in raidz then.
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
Yes, that would work.
0
 

Author Comment

by:janhoedt
Comment Utility
Thanks, great! Only question left: what ssd size where: 3 ssd of 120 gb for nexenta vm AND other vm s, 3 ssd of 60 gb for only nexenta vm.
0
 
LVL 117

Expert Comment

by:Andrew Hancock (VMware vExpert / EE MVE)
Comment Utility
Thanks, great! Only question left: what ssd size where: 3 ssd of 120 gb for nexenta vm AND other vm s, 3 ssd of 60 gb for only nexenta vm.

I don't understand? what's the question?
0
 

Author Comment

by:janhoedt
Comment Utility
The Q is if the raid 5 I wil create for running my vm should only be used for my nexenta (then I would use ssd s of 60 gb). If I can add more vm s on this raid (performancewise), I d use ssd s of 60 gb. It s a performance q I ask myself.
0

Featured Post

How to run any project with ease

Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
- Combine task lists, docs, spreadsheets, and chat in one
- View and edit from mobile/offline
- Cut down on emails

Join & Write a Comment

David Varnum recently wrote up his impressions of PRTG, based on a presentation by my colleague Christian at Tech Field Day at VMworld in Barcelona. Thanks David, for your detailed and honest evaluation!
HOW TO: Upload an ISO image to a VMware datastore for use with VMware vSphere Hypervisor 6.5 (ESXi 6.5) using the vSphere Host Client, and checking its MD5 checksum signature is correct.  It's a good idea to compare checksums, because many installat…
Teach the user how to edit .vmx files to add advanced configuration options Open vSphere Web Client: Edit Settings for a VM: Choose VM Options -> Advanced: Add Configuration Parameters:
Teach the user how to configure vSphere clusters to support the VMware FT feature Open vSphere Web Client: Verify vSphere HA is enabled: Verify netowrking for vMotion and FT Logging is in place or create it: Turn On FT for a virtual machine: Verify …

762 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

8 Experts available now in Live!

Get 1:1 Help Now