nmokhayesh
asked on
extract data from web
Hi,
collecting data from websites manually is very hard and time consuming, I'm looking for free application to extract data from web and put it in database or file. for example: I need to get the university information (faculties, department, members, contact information .. etc )
I found different application, but it is not free and hard to learn and customized. can you please guide me to find easy, free and powerful application that do the example mentioned above in a short time.
thanks
collecting data from websites manually is very hard and time consuming, I'm looking for free application to extract data from web and put it in database or file. for example: I need to get the university information (faculties, department, members, contact information .. etc )
I found different application, but it is not free and hard to learn and customized. can you please guide me to find easy, free and powerful application that do the example mentioned above in a short time.
thanks
Do you want to search the contents of web sites, or do you want to copy the web sites?
ASKER
I need to copy selected contents
for instance
list of all professors names and their contacts (email , tel, website, research interests)
list of all departments and contact information
list of schools and programs discription in each one
thank
for instance
list of all professors names and their contacts (email , tel, website, research interests)
list of all departments and contact information
list of schools and programs discription in each one
thank
I have used httrack and it worked fairly well to make a copy of the web site onto my hard drive. Selection of the contents was still the major issue. Although the local web site was faster than using the internet, you would still have to manually or programmatically isolate the information you wanted to keep.
It might be possible to get a copy of Wrensoft Zoom Indexer and use that to spider the site. Caveat: I have never tried that on a site that I did not control.
One other possibility might be to contact the site owners and ask if they can isolate this information for you. Educational institutions are often willing to help with requests like this.
It might be possible to get a copy of Wrensoft Zoom Indexer and use that to spider the site. Caveat: I have never tried that on a site that I did not control.
One other possibility might be to contact the site owners and ask if they can isolate this information for you. Educational institutions are often willing to help with requests like this.
ASKER
OK I need to extract selected data from some university web pages to XML or excel sheet file using web scraping software
can you please tell me which free web scraping application can do this job in easy way. I search it but i got a lot of application but I do not know which one is useful/efficient
Thanks
Naif
can you please tell me which free web scraping application can do this job in easy way. I search it but i got a lot of application but I do not know which one is useful/efficient
Thanks
Naif
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
still not solved 100%
No, it will never get solved 100%, full stop. Here is what you asked for back in March (how many months ago was that?)
...find easy, free and powerful application that do the example mentioned above in a short time.
It would surprise me if you find easy, free and powerful all in the same package. Those things are like Ohm's law. Fix any two variables and the third is determined.
...find easy, free and powerful application that do the example mentioned above in a short time.
It would surprise me if you find easy, free and powerful all in the same package. Those things are like Ohm's law. Fix any two variables and the third is determined.
http://www.httrack.com/