Avatar of Indyrb
Indyrb
Flag for United States of America asked on

ESXi provisioning and customization have hundreds to do

I am looking on the best way to setup a provisioning network and install hundreds of ESXi installs.

I have iDRAC which I complete all my installs.

I am building 50 ESXi Servers or more a week, and its getting old.

Is there a way to plug and play and let it provision on its own.

Either script or cfg file or etc. and best way to make a provisioning network.

Perhaps with PXE/DHCP
Also I have a custom iDRACK.ISO that we configure the servers with - Can this be automated..
However the ESXi Install is my main concern on automation..

So during install I need these configured as well.

Management interface --
      IP
      Netmask
      Gateway
      VLAN

IPV6 disabled

DNS settings

NTP settings

Change root password

Change vSwitch settings
      a.      General > Ports: Default of 120
      b.      General > MTU: 1500
      c.      Security > Promiscuous Mode: Reject
      d.      Security > MAC Address Changes: Accept
      e.      Security > Forged Transmits: Accept
      f.      Traffic Shaping: Status to Disabled
      g.      NIC Teaming: Leave Policy Exceptions to default, ensure that both of the vmnic's are set to active


dvSWITCH configuration other VLANS
      Create Folder - Label xxx-xxx(x)     xxx- Site   -xxx - Group
      Create dvSWITCH using above for each - Label above = xxx-xxx(x)-DVS1
      Greate port group for each
            iSCSI x2
                        a.      ISCSI1: Uplink1 Active, Uplink2 Unused
                        b.      ISCSI2: Uplink2 Active, Uplink1 Unused
            vMOTION x2  (is it best to have 2 vmotion ports) one active one standby and visa versa
                        c.      vMotion1: Uplink1 Active, Uplink2 Unused
                        d.      vMotion2: Uplink2 Active, Uplink1 Unused


            Port group naming sheme i.e
                  Storageheart-beat-VLANxxx-10.xx.x.0/24
                  vMOTION-VLANxxx-10.xx.x.0/24

SETUP/ADD to DVSWITCH /VMKERNEL
      a.      Storage Heartbeat - vmk1
      b.      ISCSI1 - vmk2
      c.      ISCSI2 - vmk3
      d.      vMotion1 - vmk4 , check Use this virtual adapter for vMotion
      e.      vMotion2 – vmk5 , check Use this virtual adapter for vMotion

Set properties
      i.      MTU: 9000
      ii.      Discovery Protocol Status: Enabled
      iii.      Discovery Protocol Type: Link Layer Discovery Protocol
      iv.      Discovery Protocol Operation: Both
      v.      Admin Contact Information: Virtualization Support

Enable Network I/O control
Set as follows:
      a.      Fault Tolerance: Shares - Custom, value of 1 -- QOS priority 7
      b.      ISCSI Traffic: Custom, value of 60 -- QOS priority 1
      c.      Management Traffic: Custom, value of 10 -- QOS priority 2
      d.      NFS Traffic: Custom, value of 1 -- QOS priority 7
      e.      Virtual Machine Traffic: Shares - Custom, value of 100 -- QOS priority 1
      f.      vMotion Traffic: Shares: Custom, value of 20 -- QOS priority 3
      g.      vSphere Replication Traffic: Shares - Custom, value of 10 -- QOS priority 4
      h.      Virtual SAN traffic: Shares - Custom, value of 1 -- QOS priority 7

Disable AD Validation

Set EVC mode to Intel Bridge

Setup CHAP advance
LoginTimeout and change the value to 60
uncheck the box for “Delayed ack”

ENABLE SSH/
VMwareVirtualizationServer HardwareNetworking

Avatar of undefined
Last Comment
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

8/22/2022 - Mon
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

Use Auto Deploy and Host Profiles.
Indyrb

ASKER
Cant use host profiles due to license... Not sure about Auto-depoly -- Is there another way. scripts and etc. config files?
Indyrb

ASKER
And if auto deploy -- Is there a setup guide
All of life is about relationships, and EE has made a viirtual community a real community. It lifts everyone's boat
William Peck
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

Yes, there is a setup guide to using Auto Deploy and Host Profiles.

What VMware vSphere license do you have, or take a look at AutoLab, and how hosts are deployed quickly using PXE and scripting...

HOW TO: Set up a lab environment for vSAN using VMware Workstation

You will have to reply on PXE, Kickstart scripts.
Indyrb

ASKER
Looks like this is for esxi 5... All my builds are 6.
Do you personally have any scripts and etc?
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

If you are referring to the document I linked to, it is based on 5.x, but the skills and setup is exactly the same for 6.0.

So you have 100 of servers to build and not Auto Deploy or Host Profiles ?

What licenses do you have ?

If you do not have any of the advanced features for the quick deployment of servers, you will need to use a scripted installation.
⚡ FREE TRIAL OFFER
Try out a week of full access for free.
Find out why thousands trust the EE community with their toughest problems.
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

I have suggested your question either be broken down into many questions, on how to complete the activities, or it's a Gig or Live for an EE Member.
Aaron Street

If you have licence for distributed switch then you have licence for host profiles?
Indyrb

ASKER
We have Enterprise plus -- But as a service provided. So we dont have storage DRS, i/o or host profiles.  Those are alla carte.   Not sure if we are licensed for Auto deply either.
Experts Exchange is like having an extremely knowledgeable team sitting and waiting for your call. Couldn't do my job half as well as I do without it!
James Murphy
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

So these are individual ESXi host servers for clients and not a single site ?

Enterprise Plus includes vSphere Host Profiles and Auto Deploy, and also includes Storage DRS
Indyrb

ASKER
Also is there a way to script / install VCSA applainces too... I am building out ton of these too.
Indyrb

ASKER
our Enterprise + does not have host profiles...  Wierd how its setup..

Yes there are main vcenters... Then for each customer there is a new VCSA -- then the esxi installs are attached to the new VCSA...  tons of them..

Does that make sense?
⚡ FREE TRIAL OFFER
Try out a week of full access for free.
Find out why thousands trust the EE community with their toughest problems.
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

You will need to script them, using PXE and Kickstarter.

But to be honest with you the number of hours you spend researching and developing, you could have finished the installations!

or just have a handful of ESXi installations on SD cards/USB flash drives.
Indyrb

ASKER
I was looking at one of our host, and looks like this is what were are typically licensed for.

Unlimited virtual SMP
H.264 for Remote Console Connections
vCenter agent for VMware host
vSphere API
Content Library
Storage APIs
VMsafe
vSphere vMotion
X-Switch vMotion
vSphere HA
vSphere Data Protection
vShield Endpoint
vSphere Replication
vShield Zones
Hot-Pluggable virtual HW
vSphere Storage vMotion
Shared Smart Card Reader
vSphere FT (up to 2 virtual CPUs)
Virtual Volumes
APIs for Storage Awareness
Storage-Policy Based Management
vSphere Storage APIs for Array Integration
vSphere DRS
Remote virtual Serial Port Concentrator
MPIO / Third-Party Multi-Pathing
Big Data Extensions
Reliable Memory
vSphere Distributed Switch
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

if you are building for clients I do not think Auto Deploy and Host Profiles would not help you, it's designed to deploy 100 servers quickly in the same cluster.

Kickstart and scripted installations, if you've go the time to research and develop.
This is the best money I have ever spent. I cannot not tell you how many times these folks have saved my bacon. I learn so much from the contributors.
rwheeler23
Indyrb

ASKER
Anything that you have that I can modify?  and/or anyone?
Indyrb

ASKER
Much appreciated
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

look at Autolab, how its put together and deploys ESXi hosts with ease.
⚡ FREE TRIAL OFFER
Try out a week of full access for free.
Find out why thousands trust the EE community with their toughest problems.
ASKER CERTIFIED SOLUTION
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

THIS SOLUTION ONLY AVAILABLE TO MEMBERS.
View this solution by signing up for a free trial.
Members can start a 7-Day free trial and enjoy unlimited access to the platform.
See Pricing Options
Start Free Trial
GET A PERSONALIZED SOLUTION
Ask your own question & get feedback from real experts
Find out why thousands trust the EE community with their toughest problems.
Indyrb

ASKER
ty
Albert Widjaja

Hi Indyrb,

Please share the script here once you've found it or test it.
Andrew Hancock (VMware vExpert PRO / EE Fellow/British Beekeeper)

All documented in AutoLab.

Download AutoLab, and look at how the deployment of AutoLab, deploys ESXi Hosts, easy!

Its open source and in the public domain.
Experts Exchange has (a) saved my job multiple times, (b) saved me hours, days, and even weeks of work, and often (c) makes me look like a superhero! This place is MAGIC!
Walt Forbes