Solved

How to download files automatically from https website?

Posted on 2009-05-12
8
424 Views
Last Modified: 2013-11-14
I get Zip file (containing 4 to 5 txt files) daily from a https secure website. I need to double click that zip file and save in my local disk and unzip to get the files. I want to make it automate as this is a daily process. How can I achieve this?
0
Comment
Question by:GouthamAnand
  • 4
  • 3
8 Comments
 
LVL 57

Expert Comment

by:giltjr
ID: 24370974
under Unix you should be able to schedule a task using cron to execute the command wget https://hostname/location-of-file/file.name
0
 
LVL 48

Expert Comment

by:Tintin
ID: 24371085
Assuming your version of wget or curl has SSL support, you can do something like
#!/bin/sh
cd /download/dir
wget https://example.com/file.zip
unzip file.zip

Open in new window

0
 

Author Comment

by:GouthamAnand
ID: 24371308
The website has username and password. I need to pass those. How can I do that?  Do I need to do anything to execute the command wget  or will it be executed(in korn shell). Once the shell script is ready successfull in downloading then I make it to run daily by scheduling.
0
Free Tool: Port Scanner

Check which ports are open to the outside world. Helps make sure that your firewall rules are working as intended.

One of a set of tools we are providing to everyone as a way of saying thank you for being a part of the community.

 
LVL 48

Expert Comment

by:Tintin
ID: 24371348
I've updated the script to specify username/password and added some error checking.


#!/bin/sh
cd /download/dir
wget --user=username --password=yourpassword https://example.com/file.zip
 
if [ $? -eq 0 ]
then
   unzip file.zip
else
   echo "wget failed"
fi

Open in new window

0
 

Author Comment

by:GouthamAnand
ID: 24371468
But it is giving error "wget: not found. wget failed"
0
 
LVL 48

Expert Comment

by:Tintin
ID: 24371538
What Unix/Linux flavour are you on?  

Can you install additional software if needed?

What is the result of:

which curl


0
 

Author Comment

by:GouthamAnand
ID: 24371619
I am using HP-UX

I can install additional software if needed.

result fo which curl is
no curl in /u1010/...(some long path is here)


.
0
 
LVL 48

Accepted Solution

by:
Tintin earned 500 total points
ID: 24371846
0

Featured Post

Announcing the Most Valuable Experts of 2016

MVEs are more concerned with the satisfaction of those they help than with the considerable points they can earn. They are the types of people you feel privileged to call colleagues. Join us in honoring this amazing group of Experts.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

In a recent article here at Experts Exchange (http://www.experts-exchange.com/articles/18880/PaperPort-14-in-Windows-10-A-First-Look.html), I discussed my nine-month sandbox testing of the Windows 10 Technical Preview, specifically with respect to r…
I. Introduction There's an interesting discussion going on now in an Experts Exchange Group — Attachments with no extension (http://www.experts-exchange.com/discussions/210281/Attachments-with-no-extension.html). This reminded me of questions tha…
Learn several ways to interact with files and get file information from the bash shell. ls lists the contents of a directory: Using the -a flag displays hidden files: Using the -l flag formats the output in a long list: The file command gives us mor…
Hi friends,  in this video  I'll show you how new windows 10 user can learn the using of windows 10. Thank you.

821 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question