Screen scrape using ColdFusion

Posted on 2011-05-11
Last Modified: 2012-05-11

I need to check an associate's web  site(have permission) for updates that appear in the same DIV tag on his homepage.  

Can someone please get me started in the right direction with regards to what ColdFusion tags I would use?  What CF should I research for this task?

Thank you!
Question by:IRHusker
    LVL 51

    Accepted Solution

    use cfhttp to grab the html of the page.

    <cfhttp url="" method="GET" resolveurl="Yes" throwOnError="Yes" >

    Depending on your needs either use a regex or string functions on the result (#cfhttp.fileContent#) to find the DIV tag(s) you want to check.
    LVL 51

    Expert Comment

    ... Keep in mind screen scraping is notoriously error prone. Because the format can change w/o warning breaking your code.  A data feed or web service with a standard format is better (if at all possible)

    Featured Post

    How to run any project with ease

    Manage projects of all sizes how you want. Great for personal to-do lists, project milestones, team priorities and launch plans.
    - Combine task lists, docs, spreadsheets, and chat in one
    - View and edit from mobile/offline
    - Cut down on emails

    Join & Write a Comment

    CFGRID Custom Functionality Series -  Part 1 Hi Guys, I was once asked how it is possible to to add a hyperlink in the cfgrid and open the window to show the data. Now this is quite simple, I have to use the EXT JS library for this and I achiev…
    Recently while working on a project I got a very annoying cfdocument has no body error message. I had never seen this error before. So I checked the code. The code was pretty simple; it was Just showing me the cfdocumnt tag and inside that tag a …
    It is a freely distributed piece of software for such tasks as photo retouching, image composition and image authoring. It works on many operating systems, in many languages.
    In this tutorial you'll learn about bandwidth monitoring with flows and packet sniffing with our network monitoring solution PRTG Network Monitor ( If you're interested in additional methods for monitoring bandwidt…

    754 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    20 Experts available now in Live!

    Get 1:1 Help Now