Deploy Ceph on one physical machine

Hi Experts, I am trying to plan for deplying Ceph on single physical machine with possibility to scale.

1 Server
HP ProLiant DL120 G7
4 Haddrives
 HDD1: 3tb
 HDD2: 3tb
 HDD3: 4tb
 HDD4: 4tb
2 Network ports
 Network: 1gb (Connected)
 Network: 1gb (Will activate later)

I need help with guide/deployment from scratch to fully working Ceph storage solution. I am thinking of maybe using Esxi as hypervisor or skipp it?, for me its not inportant if its CentOS or Ubuntu. Tried to read this but but my head is not working
"". I dont want single point of faulure and not sure if I should use Esxi or not?, its more easier to make backup. I am also getting confused what is OSD, monitor, where to put that and what is the minum setup :S

I need help to deploy this on production level, thanks, please ask if I am unclear with my questions. Thanks
Who is Participating?

[Product update] Infrastructure Analysis Tool is now available with Business Accounts.Learn More

I wear a lot of hats...

"The solutions and answers provided on Experts Exchange have been extremely helpful to me over the last few years. I wear a lot of hats - Developer, Database Administrator, Help Desk, etc., so I know a lot of things but not a lot about one thing. Experts Exchange gives me answers from people who do know a lot about one thing, in a easy to use platform." -Todd S.

Dan CraciunIT ConsultantCommented:
Why would you use Ceph on a single server in production???
Ceph is used for distributed storage so you eliminate single points of failure.
If your single server is down then your cluster is down, so the only thing you achieved is slightly worse IO.

IMO, in production you'll need at least 3 distinct physical machines for Ceph to be worth implementing.

chugarahAuthor Commented:
Hi Dan Craciun.

My plan was to start somewhere and this is what I got at home for the moment. I have been thinking about "single points of failure. " and came up with using vmware and bound every node to single disk. So using 3 disk as nodes and monitors and the last one where Esxi resides plus journal drive. Not sure if I am correct but the worse case senario is esxi will go down (single point of faulure) but data is still intact, that is if not to many osds goes down aswell.

I have read using ceph its easy later to exapnd..

Thanks for the answer Dan Craciun. Do you have any suggestion how I can achive with the current hardware. I am not able either to install raid 5 becouse of no controller and different size on the hard drives.
Dan CraciunIT ConsultantCommented:
If you bound a node to a disk, then that disk is a single point of failure for that node.

You don't need a RAID controller, just configure software RAID using mdadm. Guaranteed less overhead than with Ceph.

I would recommend RAID 10, but you can go with RAID5 if you don't care about the speed increase of RAID 10 and you have a good backup strategy so 2 failed drives are not a catastrophe.

Experts Exchange Solution brought to you by

Your issues matter to us.

Facing a tech roadblock? Get the help and guidance you need from experienced professionals who care. Ask your question anytime, anywhere, with no hassle.

Start your 7-day free trial
SolarWinds® Network Configuration Manager (NCM)

SolarWinds® Network Configuration Manager brings structure and peace of mind to configuration management. Bulk config deployment, automatic backups, change detection, vulnerability assessments, and config change templates reduce the time needed for repetitive tasks.

chugarahAuthor Commented:
Okay that sounds good, you have solved my file (home) backup :). I wanted to use Ceph for serveral reasons one them is for object storage using REST HTTP API to access objects. Do you have an idea how
I can implement that without using Ceph?

Can you explain also "then that disk is a single point of failure for that node.",? I thougt from my knowledge that Cephs take cares that, if one nodes fail it can rebuild/heal it again (install new OSD node)?
Dan CraciunIT ConsultantCommented:
>>came up with using vmware and bound every node to single disk

What I understood from this: you have 3VMs, each of them tied to a disk.

On a home server you could install FreeNAS or, better yet, Synology DSM and use the web interface.

Or, if you're feeling adventurous, install Samba and configure it so your Windows machines can access your data.
chugarahAuthor Commented:
Hmm Sorry Dan, the solution you provided will not work for me. I need more then just storage, I also need object storage becouse of the aplication I am working with. I will contuine my research/building and will post it here the result. I think Ceph is still the right solution my needed and its ease to scale out.

Thanks for your time
It's more than this solution.Get answers and train to solve all your tech problems - anytime, anywhere.Try it for free Edge Out The Competitionfor your dream job with proven skills and certifications.Get started today Stand Outas the employee with proven skills.Start learning today for free Move Your Career Forwardwith certification training in the latest technologies.Start your trial today

From novice to tech pro — start learning today.