We help IT Professionals succeed at work.

Best practices for Uploading large files

869 Views
Last Modified: 2014-12-05
Hi all,

I'm looking for best practices for uploading large files (in the order of Gb).
The application user base is in the order of the thousands and I don't want to block the servers if 100 users need to upload one huge video file.

I have some options already available on my plate from Akamai, Azure blob storage to simple hosted solutions with Nginx or even IIS.

There's no need to act upon the upload and the users are distributed all over the world so the cloud solution is the most logic. The main requirement is to get the files from the users as fast and reliable as possible.

Do you have any experience to share? Pitfalls? Edge-cases to be aware? Successful architectures?

Thanks!
Comment
Watch Question

Rich RumbleSecurity Samurai
CERTIFIED EXPERT
Top Expert 2006
Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION
Exec Consultant
CERTIFIED EXPERT
Distinguished Expert 2019
Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION
David Johnson, CDSimple Geek from the '70s
CERTIFIED EXPERT
Distinguished Expert 2019
Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION
btanExec Consultant
CERTIFIED EXPERT
Distinguished Expert 2019
Commented:
This one is on us!
(Get your first solution completely free - no credit card required)
UNLOCK SOLUTION
Alexandre SimõesSoftware Architect
CERTIFIED EXPERT

Author

Commented:
Hi guys, sorry for the delay.

Currently we're dealing with a lot of constraints, most of them more political than technical.
The solution we found will use chunk upload whenever allowed by the browser and directly into the file share.
Streaming these files back to the client is a requirement that we'll have to deal later as one of the requirements is to be able to tag the media files (pictures and videos).

For now direct upload to the CDN is not possible because of security constraints... we'll have to revisit this later, specially for the streaming part.

Thank you very much for your inputs,
Cheers!
Unlock the solution to this question.
Join our community and discover your potential

Experts Exchange is the only place where you can interact directly with leading experts in the technology field. Become a member today and access the collective knowledge of thousands of technology experts.

*This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

OR

Please enter a first name

Please enter a last name

8+ characters (letters, numbers, and a symbol)

By clicking, you agree to the Terms of Use and Privacy Policy.