Solved

Need to scrape images from website

Posted on 2014-02-10
3
443 Views
Last Modified: 2014-02-10
I have a client with an existing website.  He is unhappy with his current designer and would like to use me.  I have access to his product database, but he was never given website access (FTP) credentials, so I cannot directly access the 10,000+ images he has for his site.
The database gives me the relative paths to all images.

Is there some script I can write that will:
1. parse through rows of a file
2. navigate to the image
3. save the image with the same relative path structure

...so that I can quickly get all the images I need for a site demo?

Thanks!
0
Comment
Question by:dimmergeek
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
3 Comments
 
LVL 53

Accepted Solution

by:
Scott Fell,  EE MVE earned 500 total points
ID: 39848127
Try using httrack. You can download the images in the same folder structure they currently are in.  http://www.httrack.com/
0
 
LVL 110

Expert Comment

by:Ray Paseur
ID: 39848147
+1 for httrack.  I've used it for exactly the kind of thing you need.  IIRC it is Windows-only.  Runs on your laptop.  Much easier than trying to do this with a server-to-server PHP script!
0
 
LVL 83

Expert Comment

by:Dave Baldwin
ID: 39848386
There is a Linux version of HTTrack.  http://www.httrack.com/   WinHTTrack is the Windows version and is available on the same page.
0

Featured Post

Free Tool: Path Explorer

An intuitive utility to help find the CSS path to UI elements on a webpage. These paths are used frequently in a variety of front-end development and QA automation tasks.

One of a set of tools we're offering as a way of saying thank you for being a part of the community.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Introduction This article is intended for those who are new to PHP error handling (https://www.experts-exchange.com/articles/11769/And-by-the-way-I-am-New-to-PHP.html).  It addresses one of the most common problems that plague beginning PHP develop…
Many old projects have bad code, but the budget doesn't exist to rewrite the codebase. You can update this code to be safer by introducing contemporary input validation, sanitation, and safer database queries.
The goal of the tutorial is to teach the user how to edit a basic portrait of someone. This tutorial shows how to edit two basic photographs, one of a car and one of a person.
It is a freely distributed piece of software for such tasks as photo retouching, image composition and image authoring. It works on many operating systems, in many languages.

732 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question