Screen scrape using ColdFusion

Posted on 2011-05-11
Medium Priority
Last Modified: 2012-05-11

I need to check an associate's web  site(have permission) for updates that appear in the same DIV tag on his homepage.  

Can someone please get me started in the right direction with regards to what ColdFusion tags I would use?  What CF should I research for this task?

Thank you!
Question by:IRHusker
  • 2
LVL 52

Accepted Solution

_agx_ earned 2000 total points
ID: 35742507
use cfhttp to grab the html of the page.

<cfhttp url="http://somesite.com" method="GET" resolveurl="Yes" throwOnError="Yes" > 

Depending on your needs either use a regex or string functions on the result (#cfhttp.fileContent#) to find the DIV tag(s) you want to check.
LVL 52

Expert Comment

ID: 35742526
... Keep in mind screen scraping is notoriously error prone. Because the format can change w/o warning breaking your code.  A data feed or web service with a standard format is better (if at all possible)

Featured Post

Vote for the Most Valuable Expert

It’s time to recognize experts that go above and beyond with helpful solutions and engagement on site. Choose from the top experts in the Hall of Fame or on the right rail of your favorite topic page. Look for the blue “Nominate” button on their profile to vote.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

PROBLEM: How to add your own buttons to the bottom toolbar with paging info ( result count ). While creating a cfgrid, I ran into an issue where I wanted to embed my own custom buttons where the default ones ( insert / delete / etc… ) are for aes…
Sometimes databases have MILLIONS of records and we need a way to quickly query that table to return the results me need. Sure you could use CFQUERY but it takes too long when there are millions of records. That is why SOLR was invented. Please …
This Micro Tutorial will teach you how to add a cinematic look to any film or video out there. There are very few simple steps that you will follow to do so. This will be demonstrated using Adobe Premiere Pro CS6.
Whether it be Exchange Server Crash Issues, Dirty Shutdown Errors or Failed to mount error, Stellar Phoenix Mailbox Exchange Recovery has always got your back. With the help of its easy to understand user interface and 3 simple steps recovery proced…
Suggested Courses

840 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question