high traffic web sites and online scalability

Posted on 2014-04-03
Medium Priority
Last Modified: 2014-04-10

As a business system analyst what you need to consider to handle a high traffic website and massive online scalability?

Thanks in advance
Question by:shmz
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 5
  • 5
LVL 53

Expert Comment

by:Scott Fell, EE MVE
ID: 39975597
What do you consider high traffic?

Author Comment

ID: 39976209
that is a question I would like explanation too. :)
LVL 53

Expert Comment

by:Scott Fell, EE MVE
ID: 39976394
What kind of traffic did you get last year?  What kind of traffic are you getting now?  What do you project in 2015, 2016, 2020?  

How many unique visitors?  How many pages are they visiting?

Do you require a lot of data required to server your pages?  What type? CMS or are there extensive queries and calculations?

Is your data 1000 rows, 10,000 rows, 100,000 rows or millions?

Is your traffic steady 24hrs a day or do you get slammed at 7am?

What is the peak usage?  

> what you need to consider to handle a high traffic website
The questions above will work.

When you say "massive", I know a little store down the street what feels like 3,000 visitors to their site is massive while google may get over 30,000 searches per second.  What you mean by massive is relative.  

If you have a static website vs heavy data needs plays into this.

We will be discussing what Azure Stack is, how does it fit into the suit of offerings that Azure has currently, and where can it fit into your organizations technology stack. We will also be discussing limitations of the platform while covering various applicable scenarios.


Author Comment

ID: 39978867
And what technologies/tools/software a would help in managing high traffic website?
LVL 53

Expert Comment

by:Scott Fell, EE MVE
ID: 39979361
What kind of project is this for?

Author Comment

ID: 39979525
I need to prepare myself for a project with high traffic and massive scalability. That's all I know and hence need some brain storming here to figure if I can take it. :)
LVL 53

Expert Comment

by:Scott Fell, EE MVE
ID: 39979586
shmz, I have asked you some leading questions in order to get a handle on what you want and you are just returning vague answers.  I have no idea if massive to you means what can your $9.99 monthly hosting handle or do you expect 200 million monthly visitors.  Is your site static or a web app, data requirements etc.   All of this goes into your mix.  Do you expect instant "massive" or a ramp up.

I think step one should be to better define what this is and what a high/low estimate is for years 1,2,3,4,5...  Is budget a factor?  What is that budget?  Is the content static, updated regularly or updated by the second.

If it helps you to visualize what potential traffic could be, here is a list starting with google https://www.quantcast.com/top-sites that includes imagr and windows.com https://www.quantcast.com/top-sites/US?jump-to=100 to skype and cbs.com https://www.quantcast.com/top-sites/US?jump-to=500 to are you nba.com size? https://www.quantcast.com/top-sites/US?jump-to=1000 or maybe the size of apartments.com https://www.quantcast.com/top-sites/US?jump-to=5000

The more info you can detail, the better info you can get back.

Author Comment

ID: 39982002
Hi Scott,

Thanks for your response.

Lets say I have a online gaming web application, with 3000 unique visitors per week.

would this be helpful to answer my question?

Thanks in advance
LVL 53

Accepted Solution

Scott Fell,  EE MVE earned 2000 total points
ID: 39982491
shmz, many times things that are very clear in my mind are just the opposite to others.  That may be the case here.  I'm sure you have a clear vision in your head of what you are trying to accomplish, but it is not coming off like that.

I said early on, a term like, "massive" is relative and means different things to different people.  Knowing you are talking about A) a game and B) 3,000 unique weekly visitors is a lot more helpful than not knowing this and gives us some perspective.  

Getting back to your question, "what you need to consider to handle a high traffic website and massive online scalability?"

All of the items I have asked of you here http:#a39976394 are things to consider.  You will also want to consider actual usage.  Knowing unique users is what I want to know for marketing reason.  Also in marketing, the last thing we care about are 'hits'.  But that does not help in determining what you need under the hood.  Your considerations will be just the opposite.  

Do those 3,000 people come once a week? or do they actually play every day for hours at a time?

When they play, do they just need to hit the server a few times?  Or are they pressing buttons that send a request to a server 60 times a minute?

Are 3,000 people on at one time?  Or is the average just a fraction of that?

When they are on, is it steady 24hrs a day?  Or are there peak times and days you need to watch for?

Each time they send a request to the server, is processing done in real time or are you taking requests throughout the day and at pre determined times are you compiling all the data and then updating  players dashboard?

I am not asking you to directly answer these questions, but these are things you need to consider. It comes down to how many times per second are you hitting the server and database.

Another consideration is budget.  Do you have a Lamborghini budget or can you only afford a shared bus ride?  

Is it better to buy or rent?  If it were me, I would probably not bother trying to manage all the server infrastructure and just worry about my game/app.  There are plenty of sources for app/game hosting like https://cloud.google.com/developers/articles/dedicated-server-gaming-solution.

Overall, working with 3,000 gamers does not sound like a lot of users to me.  Especially if only a fraction of that are on at any one time.

Some interesting reading for you.




Best of luck on your project.

Author Closing Comment

ID: 39992199
Thanks Scott.
Very detailed and knowledgeable.
The provided links were are also great.

Featured Post

Simplify Your Workload with One Tool

How do you combat today’s intelligent hacker while managing multiple domains and platforms? By simplifying your workload with one tool. With Lunarpages hosting through Plesk Onyx, you can:

Automate SSL generation and installation with two clicks
Experience total server control

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

There’s a good reason for why it’s called a homepage – it closely resembles that of a physical house and the only real difference is that it’s online. Your website’s homepage is where people come to visit you. It’s the family room of your website wh…
Q&A with Course Creator, Mark Lassoff, on the importance of HTML5 in the career of a modern-day developer.
This tutorial will teach you the core code needed to finalize the addition of a watermark to your image. The viewer will use a small PHP class to learn and create a watermark.
Video by: Mark
This lesson goes over how to construct ordered and unordered lists and how to create hyperlinks.

718 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question