Question

how do i transfer a large .avi file over the internet

Asked by: SanPrabhu

I have some files which are the size of 60-80 GB  I need to transfer them across the internet.  Is ther a way i can do a fast ftp. what is the best way. also, is there a way to compress the avi files

This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

  • Plus...
  • 30 Day FREE access, no risk, no obligation
  • Collaborate with the world's top tech experts
  • Unlimited access to our exclusive solution database
  • Never be left without tech help again

Subscribe Now

Asked On
2005-07-23 at 13:10:57ID21502041
Tags

large

Topic

Web Graphics Software

Participating Experts
14
Points
500
Comments
24

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

  • "The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
  • "Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
  • "Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Screenshot of Experts Exchange Knowledgebase

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Screenshot of an Article

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Screenshot of Experts Exchange Knowledgebase

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Related Solutions

  1. mpeg to avi convertor?
    is that a convertor that convert mpeg to avi format? hopefully it has a shareware version
  2. Uncompressed .avi
    Hi, I've got an uncompressed .avi and here is the properties of this file: http://www23.brinkster.com/sigurr/video.JPG Whenever I access this program with Windows Media Player, all I see is a blank screen with no audio. I'm currently using Windows XP Pro and Windows Media ...
  3. Weird AVI playback on 200 GB HD
    I just swapped a maxtor 120 GB HD to a western digital 200 GB HD in my video edit system. So here is the weird behavior: Avi's will not play back from this drive. All I see is colorful pixilated snow. No matter whether I capture direct to the drive (via Matrox RT.X100) or si...
  4. Compression of AVI files
    Does windows xp have a program in it to compress AVI files into MPEG files?
  5. avi to mpeg-4 converter
    is it possible to convert the raw avi video into mpeg-4 format.. if yes what are all the companies which provide hardware compression boards.. regards

Free Tech Articles

  1. WARNING: 5 Reasons why you should NEVER fix a computer for free.
    It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
  2. SCCM OSD Basic troubleshooting
    SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
  3. Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
    This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
  4. Create a Win7 Gadget
    This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
  5. Outlook continually prompting for username and password
    There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
  6. Backup Exchange 2010 Information Store using Windows Backup
    There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

  1. Avoiding Bugs in Microsoft Access
    Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
  2. Top 10 Best New Features in Visio 2010
    Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
  3. IT Consultant Business Secrets Revealed
    Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
  4. Disaster Recovery and Business Continuity
    Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
  5. Organize Your Visio Diagrams with Containers and Lists
    Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
  6. How to Us Objects, Properties, Events and Methods in Microsoft Access
    Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

 

by: lherrouPosted on 2005-07-23 at 18:17:27ID: 14512025

SanPrabhu,

60-80 GB isn't large by internet standards, it's GARGANTUAN!

There are a number of file splitter/joiners out there. If you need a free one, which does not require software at the users end, take a look at http://www.deepcom.com/index.html. Otherwise, I would recommend using yEnc, which encodes the file in a non-binary format, splits it, and generates additional files which can be used to rebuild any pieces which get lost or damaged in transit - it's also free: http://www.yenc32.com/

I've sent up to 2GB with yEncoded files, which is pretty large by most standards. You can also use either of these tools to span CDs or DVDs, which may be preferable to internet transfer.

Cheers,
LHerrou

 

by: shamstarPosted on 2005-07-24 at 03:25:09ID: 14513000

By my calculations, downloading a 70GB file on my 3Mb connection would take over just 55 hours going at a continuous rate of 360Kpbs.  Of course when you factor in network congestion and the route the traffic takes over the internet then this can increase by quite a lot.  But the most likely reason for slower times would be your upload rate - i.e. how fast you can send the files long their way and the speed of other links in the chain to the destination.  Again this will really depend on the type of Internet connection you are using.

Also, don't forget that if I've spend 50 hours downloading the file and there are some corruptions, then it means the file is generally unusable to me unless I download the whole thing again, this is protected against to some degree but can still happen.  For these reasons I would support the comments by lherrou above and suggest you split the files ideally with yenc.
Also something to consider is that maybe you could just split/burn them to DVD and then mail them to the recipient?

 

by: nannePosted on 2005-07-24 at 06:37:48ID: 14513400

though its extremely huge, you probably would put it on several computers in a university lab, and seed it with some torrent progs.. because it will take a long time to send them you really want something that will resume ;)

but what are these files? raw data from a camcorder? then you would want to make it a divx, xvid or something like that and you can easily cut it down to a couple of hundred meg (depends on the resolution // quality you want)

 

by: o_0Posted on 2005-07-24 at 08:54:14ID: 14513892

try to 7zip it, but it costs so much time
yeh~ bittorrent as nanne said

 

by: servidsPosted on 2005-07-24 at 08:57:13ID: 14513898

For files of such large size the best option would be to use winRAR to compress and split the file into smaller manageable units.
Then you can use a program called quickpar which will create recover blocks for your files, so that in the event that someone downloading your split files encounters an error in one or more of the individual split up files, if he/she has quickpar they can do a repair on the file using recovery blocks which are also downloaded along with the main files. This method of compressing and using a recovery utility is used alot by newsgroups which post files of very large size, such as video and binary executables.

 

by: jaime_olivaresPosted on 2005-07-24 at 11:04:14ID: 14514298

A 60-80 GB AVI appears to be an uncompressed clip (how much minutes is it?)
I don't suggest you to use some kind of winzip or winrar, you won't obtain a better compression than 20-50%.
You can compress video with an encoder and still maintain AVI format, with at least 90% compression.
Even you can use standard Windows Movie Maker to do it.

 

by: billmercerPosted on 2005-07-24 at 18:31:11ID: 14515550

Put the files on a backup tape or an external hard drive and ship that to the destination. You don't have to mess around with burning a bunch of disks, and the files will probably still get there faster than if you try to use the internet.

 

by: shariatiPosted on 2005-07-25 at 06:08:42ID: 14517521

I agree with Jaime Olivares.. check your data may be they are in RAW Format...

so first try to convert them....

 

by: SanPrabhuPosted on 2005-07-25 at 09:52:29ID: 14519470

hi,
i belive if i encode it in any manner i will suffer a loss of quality.   Is a  a lossless compression possible on a AVI file.

 

by: lherrouPosted on 2005-07-25 at 09:57:21ID: 14519509

SanPrabhu,

Can you tell us more about what it is (filming and file details, not content) and what needs to happen with it? We might be able to make better recommendations with that information.

LHerrou

 

by: SanPrabhuPosted on 2005-07-25 at 10:11:22ID: 14519672

its a video .avi file  basically  raw footage of videos. I need to send these files periodically to an editing firm which is across the state. i was wondering if i can speed up the delivery by using the internet. i heard there were some fast ftp programs. and if i can compress it somehow without loss of quality, there might be a possible way to transfer it.

 

by: spiderfixPosted on 2005-07-25 at 15:46:07ID: 14522549

>>i belive if i encode it in any manner i will suffer a loss of quality<<
If you use WinRAR you can select the compression method as "Store" which will not compress the files
within the archive. From there you can either split the *.rar
http://www.win-rar.com

In WinZIP you can select the compression as "None".
http://www.winzip.com

 

by: billmercerPosted on 2005-07-25 at 16:16:30ID: 14522677

There's no special FTP software that will let you transfer a huge file extremely quickly. The limiting factor is not the software, but the speed of your internet connection.

Also, FTP is not made to handle files this big, and you're pretty much guaranteed to get errors in the transfer, if it works at all. You should not try to use FTP. As others have already mentioned, for transferring large files over the internet, something like BitTorrent is much more reliable, because it will break the file into pieces and do extensive error checking during the transfer. However it is not going to transfer more quickly.

If you cannot accept any loss of quality at all, then you will have to accept that you will have large files.

You can use a lossless file compression program such as gzip or 7zip to compress the files.
o_0 mentioned 7Zip, which is available free from www.7zip.org. PKZip from www.pkware.com is another utility that can do lossless compression of huge files. There are many others. But even if you compress the files by 50%, you will still be looking at 30 to 40 gigabytes. Even with a fast connection, it would take more than a full day to transfer one file.

Also, the time it takes to create the compressed file needs to be factored into the process. If you reduce the upload time by 8 hours, but it takes 6 hours to create the compressed file, you're not saving much time.

There's no way to know for sure how much the file will be reduced other than by trying it. Do a test compression of one file to see how much it will shrink, and how long it takes. Be prepared for the compression to take hours.

And don't forget that there is a cost associated with bandwidth. If you suddenly start transferring many gigabytes of data, you will probably have to pay much higher fees for your internet service. You should contact your internet service provider to find out what their policy on this is. Some ISPs will simply disconnect you if you exceed your allowed bandwidth.

If speed is important, you will almost certainly get the files there faster by overnight shipping, and if it's within the same state, you may be able to find a same-day courier service.

 

by: billmercerPosted on 2005-07-25 at 16:19:56ID: 14522695

spiderfix, RAR and ZIP provide lossless compression. There's no reason to avoid using compression in this case, as the original file will not be changed by the compression. Only use of lossy compression such as MPEG will affect the quality of the files.

 

by: skadlooriPosted on 2005-07-25 at 21:14:55ID: 14523939

hi

how ever big the file size might be...you can just transfer the file using "Serv-U FTP" program.
you can download the software for free from http://www.serv-u.com/customer/record.asp

this software needs to be installed on atleast one PC...either the PC on which the file exists....or the PC on to which you want to send the file.

1. if you set up the software on your system, then just create a username/password for the other person so that he logs onto your system using his IP (ex : ftp://xxx.xxx.xxx.xxx) and copies the file.

or

2. if your friend sets this software on his system, then ask him to provide you with a username/password and also ask him to enable "write" features for this username. then you can just log on to his system and just copy the file onto his system.

this should help you out.....

...and if you are using a router for your internet, then don't forget to foward the ports...

 

by: skadlooriPosted on 2005-07-25 at 21:18:52ID: 14523950


just correcting the mistake on my previous comment

1. if you set up the software on your system, then just create a username/password for the other person so that he logs onto your system using "YOUR" IP (ex : ftp://xxx.xxx.xxx.xxx) and copies the file.

or

2. if your friend sets this software on his system, then ask him to provide you with a username/password and also ask him to enable "write" features for this username. then you can just log on to his system using "HIS" IP (ex : ftp://xxx.xxx.xxx.xxx) and just copy the file onto his system.

 

by: nannePosted on 2005-07-26 at 01:47:33ID: 14525003

serving a file that size is madness. Even if you could get a stable connection for that long, it's gonna take a LOT of time, i can send a harddisk, or burn some dvd's and send them in maybe a tenth of the time involved.. (well, depends on your connection ofcourse)

bottomline is: no, there is no fast way to do this. this file is just too big. period.

you can
a) send the complete file on a harddisk via snailmail
b) split the file using winrar, burn it on dvd's / cd's and send it by snailmail
c) compress the file before sending it through the internet

if you want lossles compression you will not get  the results needed to send via internet, so the only option voor real compression is that you take some quality loss.
read this for understanding of compression:
http://www.deskshare.com/Resources/articles/dmc_Compression_AVI.aspx

google can easily help you with compression software, just a quick search gave me
http://www.triltech.com/avi_file_compressors.htm
http://www.deskshare.com/dmc.aspx
http://www.swiftsoft.de/mmavi.html

 

by: LRI41Posted on 2005-07-26 at 19:04:05ID: 14533195

U can see if they really mean it???

WHALE MAIL

SEND ANY SIZE FILE - ANY TIME

Don't waste dollars and valuable time by compressing your files and shipping them via an express courier service. WhaleMail allows you to distribute large files - in INTERNET TIME - with nothing more than a browser. It’s easy - Here’s what you do.

Sign Up

Log-in

Upload your files and store them in your file directory (files are stored for 14 days from upload).

Create a list of recipient email addresses and hit "SEND."

Let WhaleMail do the rest!

It's that easy. Once you hit "Send," WhaleMail forwards an email message to your recipients including a unique URL, routing them to the location of your file. The recipient can then download your file via their browser - with no ISP or FTP headaches or constraints.

http://www.whalemail.com/

 

by: LRI41Posted on 2005-07-26 at 19:12:29ID: 14533231

Streamload offers Free 10Gb Net Storage For MultiMedia Files

What is Streamload?
Streamload is a service that enables you to send, receive, store and access Megafiles™ to any person and from any Internet connected device.

What is Streamload?
Streamload is a service that enables you to send, receive, store and access Megafiles™ to any person and from any Internet connected device.




http://www.streamload.com/

 

by: yukelePosted on 2005-07-26 at 22:08:07ID: 14533753

There is a lossless AVI codec, called Huffyuv (get it here http://www.afterdawn.com/software/video_software/codecs_and_filters/huffyuv.cfm), but even with the compression the files will still be huge (say 30 or 40 gigs)

As a video editor, I would not want to use the internet to download the raw footage. It would take to much time, hog bandwidth, and the chance of corrupt files is very large. (I'm repeating what was suggested by everone else...)

When I do a project, I prefer the client to ship the original tapes -- this is the least likely to get damaged during shipping. If there is no tapes then I will ask for the footage on a hard drive.

 

by: billmercerPosted on 2005-07-27 at 07:25:26ID: 14537038

LRI41,  nanne's comment was way out of line, but I don't think your suggestions are at all helpful. Even if these services can handle 80gig files, they are plain HTTP transfers, which does not include the sort of error checking necessary in handling files this big. Odds of a successful and error-free transfer are slim.

Also, because it must first be uploaded to an intermediate server, probably in a distant location, and then downloaded to the recipient, using a service like this will effectively double both the transfer time and the potential for errors to accumulate. In other words, the asker would be better off doing a standard file transfer directly to the recipient's server, which is still slower than using a courier or overnight service. Unless you're sitting on an Abilene connection, the internet option's just not practical.

 

by: MahmoudAbdElSattarPosted on 2005-07-28 at 07:00:29ID: 14545687

Of course the AVI file used contains RAW data "which is highly compressable"
try to compress your AVI using WINRAR or WINACE and divide the result compressed file "there is option WINRAR and WINACE for doing that automatically".
the result divided compress file will have suitable size.

 

by: stuartindigoPosted on 2005-07-30 at 05:20:00ID: 14561092

I suppose part of the question here is "what will your editing firm accept". Also of equal importance is "what is the intended output".

They may be able to deal with mpeg-2, in which case this may be your best option (use something like TMPGEnc). This will still leave you with large files, but significantly smaller than raw dv avi's.

Stuart

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...