Solved

How to download files automatically from https website?

Posted on 2009-05-12
8
414 Views
Last Modified: 2013-11-14
I get Zip file (containing 4 to 5 txt files) daily from a https secure website. I need to double click that zip file and save in my local disk and unzip to get the files. I want to make it automate as this is a daily process. How can I achieve this?
0
Comment
Question by:GouthamAnand
  • 4
  • 3
8 Comments
 
LVL 57

Expert Comment

by:giltjr
ID: 24370974
under Unix you should be able to schedule a task using cron to execute the command wget https://hostname/location-of-file/file.name
0
 
LVL 48

Expert Comment

by:Tintin
ID: 24371085
Assuming your version of wget or curl has SSL support, you can do something like
#!/bin/sh

cd /download/dir

wget https://example.com/file.zip

unzip file.zip

Open in new window

0
 

Author Comment

by:GouthamAnand
ID: 24371308
The website has username and password. I need to pass those. How can I do that?  Do I need to do anything to execute the command wget  or will it be executed(in korn shell). Once the shell script is ready successfull in downloading then I make it to run daily by scheduling.
0
 
LVL 48

Expert Comment

by:Tintin
ID: 24371348
I've updated the script to specify username/password and added some error checking.


#!/bin/sh

cd /download/dir

wget --user=username --password=yourpassword https://example.com/file.zip
 

if [ $? -eq 0 ]

then

   unzip file.zip

else

   echo "wget failed"

fi

Open in new window

0
Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

 

Author Comment

by:GouthamAnand
ID: 24371468
But it is giving error "wget: not found. wget failed"
0
 
LVL 48

Expert Comment

by:Tintin
ID: 24371538
What Unix/Linux flavour are you on?  

Can you install additional software if needed?

What is the result of:

which curl


0
 

Author Comment

by:GouthamAnand
ID: 24371619
I am using HP-UX

I can install additional software if needed.

result fo which curl is
no curl in /u1010/...(some long path is here)


.
0
 
LVL 48

Accepted Solution

by:
Tintin earned 500 total points
ID: 24371846
0

Featured Post

Is Your Active Directory as Secure as You Think?

More than 75% of all records are compromised because of the loss or theft of a privileged credential. Experts have been exploring Active Directory infrastructure to identify key threats and establish best practices for keeping data safe. Attend this month’s webinar to learn more.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

I. Introduction There's an interesting discussion going on now in an Experts Exchange Group — Attachments with no extension (http://www.experts-exchange.com/discussions/210281/Attachments-with-no-extension.html). This reminded me of questions tha…
In this article we will discuss all things related to StageFright bug, the most vulnerable bug of android devices.
Learn several ways to interact with files and get file information from the bash shell. ls lists the contents of a directory: Using the -a flag displays hidden files: Using the -l flag formats the output in a long list: The file command gives us mor…
Learn how to navigate the file tree with the shell. Use pwd to print the current working directory: Use ls to list a directory's contents: Use cd to change to a new directory: Use wildcards instead of typing out long directory names: Use ../ to move…

932 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question

Need Help in Real-Time?

Connect with top rated Experts

12 Experts available now in Live!

Get 1:1 Help Now