Link to home
Create AccountLog in
Avatar of Wayne Barron
Wayne BarronFlag for United States of America

asked on

Assigning Static IP or DHCP Addresses within an IIS Server Farm with different VLans per Server Group.

In large infrastructures like Facebook, which typically have 1,000 VM Servers brought in daily, according to a Server Biography I watched on Facebook a while back on Youtube.  

(View the video at the timeline here)  


How do they set up the IP Configuration on an infrastructure such as that?  

I know many of the servers are simply data storage, but they also need a name and IP Address assigned to them.  


Do they assign each VM its IP Address, or do they set up DHCP and only reference that machine with its ServerName?  

(Example:  

In all Microsoft Server Services I use, I only reference the Server name, NOT the IP Address)  


My current setup will be growing relatively fast soon.  

The Physical Dell Server has a 4x1gb Network adapter; all ports are used.  

Each one of the VMs has 4 Virtual NICs.  

The four NICs are set up as a TEAM and are assigned a single IP Address for redundancy.  

(As stated above, I only reference the Servers by their assigned Server Name, not their IP Address.)  


Now, if I bring in 100 VM servers a week. (Just an example)  


Would I leave the Team to obtain its IP Address, or would I need to assign each their IP Address as I have been doing?  


I am getting everything ready to install PFSense on a dedicated machine. With this, I will have better control over my network and VLans, where I will assign several different VLans.  


Webserver-VLan    

 Dataserver-VLan     

 Workstation-VLan    

 Linux-VLan

 (The Linux infrastructure will grow rapidly by the end of this year.)


In some cases, I will duplicate the VM, copy it to another Folder in ESXi, launch it, and change the 


Net Team name   

 Server name   

 Domain user account   

 IP Address (Unless

 I am advised to use DHCP instead)


If I use DHCP, the DC DNS will update with the new IP Address.   

I just found a screenshot of the PFSense for the DHCP Release time.   


Default lease time (default is 7200 seconds (2 hours))   

Maximum lease time (*default is 86400 (24 Hours)).


In a web server infrastructure, not for outside use, I thought that this would be set to 


Default lease time (default is 2592000 seconds (30 Days)) Maximum  

lease time (*default is 31104000  (360 Days)).


In IIS, you can add servers by their IP or Server-name.  

I chose Server-name. This way, if the IP Address has to be changed, I don't have to go back and change anything in IIS, as all ARR Servers have what they need to connect, which is the Server-name.  

Avatar of David Johnson, CD
David Johnson, CD
Flag of Canada image

They use load balancers. one external ip address can be assigned going to several local ip addresses. 

They also use several external ip addresses in round robin i.e.

www 31.13.80.36

www 31.13.80.37

www 31.13.80.38


Avatar of Wayne Barron

ASKER

Hey, David.
Yes, I already know all that.
I need to know how they assign everything.
Do they allow a DHCP Server to assign the IP Addresses, or do they assign each VM a Static?

Everything else I have done already.
I need to find out this part before I get too deep into the infrastructure to turn around and change everything.

Also, in IIS, you can add servers by their IP or Server-name.
I chose Server-name. This way, if the IP Address has to be changed, I don't have to go back and change anything in IIS, as all ARR Servers have what they need to connect, which is the Server-name.
They use automation tools like Ansible to provision these servers automatically, using pre-defined parameters.
Hey, Craig.
I know they are all pre-configured Servers.
I would like to know which is being used, DHCP or Static IPs.

If it is a DHCP, then it is most likely on a pool
example
192.168.2.1 = = 8 (255.0.0.0) (So that will be 16,777,216 IP Addresses to assign out.)
Then after that is filled up.
Then they will have to jump over to another pool and use it.
And considering someone as giant as Facebook with 85 Data Centers.
So around 50,000 physical servers (Or maybe Virtual, this I could not find)
If it is 50,000 physical servers, and about 10 VMs per server, that is 1 million VMs per data center.

So, the question is.
Are they using DHCP to dish out the IP Addresses, or are they assigning each VM a static?
SOLUTION
Avatar of Craig Beck
Craig Beck
Flag of United Kingdom of Great Britain and Northern Ireland image

Link to home
membership
Create an account to see this answer
Signing up is free. No credit card required.
Create Account
ASKER CERTIFIED SOLUTION
Link to home
membership
Create an account to see this answer
Signing up is free. No credit card required.
Create Account