Crawler DLL?

Does anyone know of a DLL/OCX that gives an API for crawling the Web, retrieving pages and the like?
Thanks,
Simon
simonffAsked:
Who is Participating?

[Webinar] Streamline your web hosting managementRegister Today

x
 
Tommy HuiConnect With a Mentor EngineerCommented:
Your best bet is to use WinINet which comes with InternetOpen() and InternetClose(). You can also use InternetReadFile() and InternetWriteFile() once you have opened an Internet session.
0
 
simonffAuthor Commented:
Does it give the information about the file modification date that is contained in the HTTP headers?
0
All Courses

From novice to tech pro — start learning today.