Solved

How do I download the files from about 400 urls (without doing them individually)

Posted on 2016-08-11
11
105 Views
Last Modified: 2016-08-15
Have a text file of URLs. How do I download them all automatically? Thank you :-)
MSFTFreeEbooks.txt
0
Comment
Question by:agwalsh
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 3
  • 3
  • 2
  • +2
11 Comments
 
LVL 3

Assisted Solution

by:Ganga Sagar
Ganga Sagar earned 83 total points
ID: 41751843
you can use batch for the same.

download the attached txt file and rename it with .bat extension and run. i hope it will work for you.
0
 

Author Comment

by:agwalsh
ID: 41751854
Rename my file MSFTFreeEbooks.txt to MSFTFreeEbooks.bat and then run it? Because if you have attached a file - can't see it :-0. Thanks though
0
 
LVL 12

Assisted Solution

by:Benjamin Voglar
Benjamin Voglar earned 83 total points
ID: 41751857
Hi. Here is you script:

Use poweshell ISE. Paste the code and edit the path's:

Get-Content "c:\it\powershell\urls.txt" | Foreach {
    Start-Job {
        function Save-TinyUrlFile
        {
            PARAM (
                $TinyUrl,
                $DestinationFolder
            )

            $response = Invoke-WebRequest -Uri $TinyUrl
            $filename = [System.IO.Path]::GetFileName($response.BaseResponse.ResponseUri.OriginalString)
            $filepath = [System.IO.Path]::Combine($DestinationFolder, $filename)
            try
            {
                $filestream = [System.IO.File]::Create($filepath)
                $response.RawContentStream.WriteTo($filestream)
                $filestream.Close()
            }
            finally
            {
                if ($filestream)
                {
                    $filestream.Dispose();
                }
            }
        }

        Save-TinyUrlFile -TinyUrl $args[0] -DestinationFolder $args[1]
    } -ArgumentList $_, "c:\t"
}

Open in new window

0
Microsoft Certification Exam 74-409

Veeam® is happy to provide the Microsoft community with a study guide prepared by MVP and MCT, Orin Thomas. This guide will take you through each of the exam objectives, helping you to prepare for and pass the examination.

 
LVL 3

Assisted Solution

by:Ganga Sagar
Ganga Sagar earned 83 total points
ID: 41751861
sorry , here is the file. rename it with .bat extension.

or if you have IDM then you can make batch file for the same . like
C:\Program Files (x86)\Internet Download Manager>IDMan.exe /d url
download.txt
0
 
LVL 5

Assisted Solution

by:Jambon316
Jambon316 earned 251 total points
ID: 41751982
LOL go back to the page got that where you got that text file...scroll down through comments...there's a bunch of scripts you can copy and paste powershell or bash or if you really need to download a gui based application, flashget , downthemall , there's also a load of chrome extensions that will do it ... but really, if you had read that page all the way to the bottom, you would have answered this yourself...
0
 
LVL 5

Accepted Solution

by:
Jambon316 earned 251 total points
ID: 41752021
literally this was one comment on that page:

1) Save the list of the book locations provided by Eric Ligman (many thanks Eric!) in a file (default msftebooks.txt) by right clicking the icon he provided in the article and use the 'Save' dialog.

2) Download (the free) Wget.exe v1.11.4 (google it) [Warning: Later versions are not compiled correctly for Windows].

3) Place both files in same directory (it was happy with general Download folder but you might prefer them to be in a New Folder e.g. Microsoft eBooks; the downloaded files will also be in that directory folder).

4) Open Command Prompt and use 'cd' command (without the quote marks) to move the prompt to the location of the files.

5) Type wget -i mstfebooks.txt
0
 
LVL 30

Assisted Solution

by:serialband
serialband earned 83 total points
ID: 41752699
If you're going to cut and paste instructions from the site, you should also quote the content and provide the link. https://blogs.msdn.microsoft.com/mssmallbiz/2016/07/10/how-to-download-all-of-the-free-ebooks-and-resources-in-my-free-ebooks-giveaway/
0
 
LVL 5

Assisted Solution

by:Jambon316
Jambon316 earned 251 total points
ID: 41753353
I did that. the page I copied and pasted from was the same page that the poster obtained the text file from.
so he already had the link...my point was that a really easy solution was already there on the same page
0
 
LVL 30

Expert Comment

by:serialband
ID: 41753379
I meant to post it for everyone else, so they don't have to search for it.
0
 

Author Comment

by:agwalsh
ID: 41755981
Thanks to all of you but what I ended up doing was getting someone on Fiverr to do it. :-) Much appreciated though.
0
 

Author Closing Comment

by:agwalsh
ID: 41755982
Got lots of help and suggestions but ended up outsourcing it :-)
0

Featured Post

Free Tool: IP Lookup

Get more info about an IP address or domain name, such as organization, abuse contacts and geolocation.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Auditing domain password hashes is a commonly overlooked but critical requirement to ensuring secure passwords practices are followed. Methods exist to extract hashes directly for a live domain however this article describes a process to extract u…
Recently we ran in to an issue while running some SQL jobs where we were trying to process the cubes.  We got an error saying failure stating 'NT SERVICE\SQLSERVERAGENT does not have access to Analysis Services. So this is a way to automate that wit…
Learn several ways to interact with files and get file information from the bash shell. ls lists the contents of a directory: Using the -a flag displays hidden files: Using the -l flag formats the output in a long list: The file command gives us mor…
The viewer will learn how to look for a specific file type in a local or remote server directory using PHP.

627 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question