Question

Handle redirect in xmlhttp response

Asked by: bruintje

Dear All,

I try to download an excel file from a website and i only get it back after going through a redirect page that contains a wait in javascript.

I use the xmlhttp object for this as it turned out the result is the same using

- msinet control
- excel's workbooks.open
- inet dll

My code is like

Dim oXMLHTTP As object ' MSXML2.XMLHTTP26

On Error GoTo errhandle
 
  Set oXMLHTTP = CreateObject("Microsoft.XMLHTTP")
  oXMLHTTP.Open "GET", myUrl, False
  oXMLHTTP.send
 
  ' return bytearray
  strhtml = oXMLHTTP.responseText

  Set oXMLHTTP = Nothing
  Exit Function
 
errhandle:
  ' do something here  
  Set oXMLHTTP = Nothing

the strhtml returns a page with the redirect to itself i do not know how to wait for the timeout or get the file in another way

tried to catch the download file dialog from IE, but couldn't get that working either with the findwindow API

hope someone can help me to get this working.

Thanks for your time
Brian

This Question has been solved and asker verified All Experts Exchange premium technology solutions are available to subscription members.

Subscribe now for full access to Experts Exchange and get

Instant Access to this Solution

  • Plus...
  • 30 Day FREE access, no risk, no obligation
  • Collaborate with the world's top tech experts
  • Unlimited access to our exclusive solution database
  • Never be left without tech help again

Subscribe Now

Asked On
2007-12-11 at 06:10:05ID23015426
Tags

redirect

,

xmlhttp

Topics

Visual Basic Programming

,

VB Controls

Participating Experts
1
Points
500
Comments
10

Trusted by hundreds of thousands everyday for fast, accurate and reliable tech support.

  • "The time we save is the biggest benefit of Experts Exchange to Warner Bros. What could take multiple guys 2 hours or more each to find is accessed in around 15 minutes on Experts Exchange." Mike Kapnisakis, Warner Bros.
  • "Our team likes having a resource that is more secure than just using Google and most experts using this service really know their stuff. It's nice to look here first versus using Google." Dayna Sellner, Lockheed Martin
  • "Anytime that I've been stumped with a problem, 9 out of 10 times Experts Exchange has either the accepted solution or an open discussion of the potential solution to the problem." Kenny Red, eBay Inc.

See what Experts Exchange can do for you.

Got a question?

We've got the answer.

Experts Exchange has been collecting answers to technology questions since 1996…3 million and counting! If you have a question, chances are we already have your answer.

Screenshot of Experts Exchange Knowledgebase

Need individual assistance?

Our experts are ready to help.

If you can't find the exact answer you're looking for, ask our exclusive community of 50,000 experts. You’ll get a personalized answer from a trusted professional.

Screenshot of Experts Exchange Knowledgebase

Want to learn from the best?

Read articles from industry experts.

Thousands of free tech tips, tricks, how-to’s and tutorials are available in our peer reviewed articles section. See for yourself how smart our experts are, no login required.

Screenshot of an Article

Working on a long term project?

Store your work and research.

Save solutions to your questions, answers you’ve discovered through searching plus helpful articles in your personal knowledgebase for easy future access.

Screenshot of Experts Exchange Knowledgebase

Access the answers to your technology questions today.

Subscribe Now

30-day free trial. Register in 60 seconds.

What Makes Experts Exchange Unique?

Members of the expert community talk about why the experience at Experts Exchange is different than what you will find anywhere else.

Trusted by the world's most respected brands.

image of each brand's logo

Faithfully serving IT professionals since 1996.

Experts Exchange Logo

Try it out and discover for yourself.

Subscribe Now

30-day free trial. Register in 60 seconds.

Related Solutions

  1. XMLHttp and Redirection
    Hi I I'm using XMLHttp to get the contents of a list of URLs. Some of the URLs are redirection scripts (the scripts that are usually used to count the clicks of a link), but I want to find the real URL (the URL after redirection). Is there any way to find the real URL using ...

Free Tech Articles

  1. WARNING: 5 Reasons why you should NEVER fix a computer for free.
    It is in our nature to love the puzzle. We are obsessed. The lot of us. We love puzzles. We love the challenge. We thrive on finding the answer. We hate disarray. It bothers us deep in our soul. W...
  2. SCCM OSD Basic troubleshooting
    SCCM 2007 OSD is a fantastic way to deploy operating systems, however, like most things SCCM issues can sometimes be difficult to resolve due to the sheer volume of logs to sift through and the dispe...
  3. Migrate Small Business Server 2003 to Exchange 2010 and Windows 2008 R2
    This guide is intended to provide step by step instructions on how to migrate from Small Business Server 2003 to Windows 2008 R2 with Exchange 2010. For this migration to work you will need the fo...
  4. Create a Win7 Gadget
    This article shows you how to create a simple "Gadget" -- a sort of mini-application supported by Windows 7 and Vista. Gadgets can be dropped anywhere on the desktop to provide instant information, ...
  5. Outlook continually prompting for username and password
    There have been a lot of questions recently regarding Outlook prompting for a username and password whilst using Exchange 2007. There are a few reasons why this would happen and I will try to cover t...
  6. Backup Exchange 2010 Information Store using Windows Backup
    There seems to be quite a lot of confusion around the ability to backup Exchange 2010 using the built in Windows Backup feature. This stems from the omission of this feature prior to Exchange 2007 s...

Cloud Class Webinars

  1. Avoiding Bugs in Microsoft Access
    Alison Balter takes and in-depth look at avoiding bugs in Access. In this webinar you will learn about using the immediate window to debug your applications, invoking the debugger, using breakpoints to troubleshoot, stepping through code, setting the next statement to execute, ...
  2. Top 10 Best New Features in Visio 2010
    Scott Helmers gives live demonstrations of the top 10 new features in Visio 2010. This webinar will teach you how to create compelling diagrams by adding shapes to the page with a single click, linking the shapes in a diagram to data in Excel (or SQL Server, or SharePoint), ...
  3. IT Consultant Business Secrets Revealed
    Michael Munger, Experts Exchange tech pro and IT consultant, pulls back the curtain on his very successful businesses and answers question on every IT consultant and business owner should know about. He shares secrets on what he did to solve the 5 most common problems in IT, ...
  4. Disaster Recovery and Business Continuity
    Quest CTO, Mike Billon, gives an overview of the steps involved in building a dunamic disaster recovery plan. Through case studies and an examination of software/hardware tooles for monitoring and testing, you'll gain a better understandin of where you are, where you want ...
  5. Organize Your Visio Diagrams with Containers and Lists
    Scott Helmers uses cross functional flowcharts, wireframe diagrams, data graphic legends and seating charts to teach you: how to ustilize all three new structured diagram components in Visio 2010, the best practices for organizeing shapes in previous version of Visio, how to organize ...
  6. How to Us Objects, Properties, Events and Methods in Microsoft Access
    Alison Dalter gives an in-depbth look at objects, properties, events and methods in Microsoft Access. In this webinar you will learn about using the object browser, referring to objects, working with properties and methods, working with object variables, understanding the ...

Join the Community

Give a Little. Get a Lot.

Join the community of experts here and help other tech pros by answering question in your area of expertise. You can earn FREE access to all Experts Exchange's premium features and resources.

Join the Community

Answers

 

by: PaulHewsPosted on 2007-12-11 at 06:27:01ID: 20449488

The redirect page must have a string you can test for, so that you can tell you don't have the right content.

Option Explicit
Private Declare Sub Sleep Lib "kernel32.dll" (ByVal dwMilliseconds As Long)
 
 
...
    Dim bContentIsOk As Boolean
    Dim oXMLHTTP As Object ' MSXML2.XMLHTTP26
 
On Error GoTo errhandle
 
    Set oXMLHTTP = CreateObject("Microsoft.XMLHTTP")
    bContentIsOk = False
    Do Until bContentIsOk
        
        oXMLHTTP.Open "GET", myUrl, False
        oXMLHTTP.send
        
        ' return bytearray
        strhtml = oXMLHTTP.responseText
        If InStr(1, strhtml, "this is a string I know is in the redirect page") = 0 Then
            bContentIsOk = True
        Else
            Sleep 10000  'However long the javascript wait is
        End If
        
    Loop
    
    Set oXMLHTTP = Nothing
    Exit Function
    
errhandle:
    ' do something here
    Set oXMLHTTP = Nothing
                                              
1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:

Select allOpen in new window

 

by: bruintjePosted on 2007-12-11 at 08:34:20ID: 20450429

thanks Paul,

that certainly looked like the trick but it does not work

i give you the url i'm trying to download

http://excel2.smarthouse.de/ExcelWriter.aspx?xls_cu=vontobel&xls_co=productlist&xls_s=derinet-chDE&pageid=40&xls_file=1e52be0f18ce644960f852fa59628cd8

i encounter on machines that have not downloaded that file through the browser the problem of not being able to download the xls but the timeout page instead

of course on each request the key at the end is different so it works at times but i suspect not when the file is not yet cached from a previous request

regards
Brian

 

by: PaulHewsPosted on 2007-12-11 at 08:57:54ID: 20450644

Try this method:

Option Explicit
Private Declare Function URLDownloadToFile Lib "urlmon" _
        Alias "URLDownloadToFileA" (ByVal pCaller As Long, _
        ByVal szURL As String, ByVal szFileName As String, _
        ByVal dwReserved As Long, ByVal lpfnCB As Long) As Long

Private Sub Command1_Click()
    Dim myURL As String
    myURL = "http://excel2.smarthouse.de/ExcelWriter.aspx?xls_cu=vontobel&xls_co=productlist&xls_s=derinet-chDE&pageid=40&xls_file=1e52be0f18ce644960f852fa59628cd8"
    URLDownloadToFile 0, myURL, "C:\temp\test.xls", 0, 0
   
End Sub

 

by: bruintjePosted on 2007-12-11 at 11:23:04ID: 20451819

no success, either i got the xls back that if you change extension to htm it shows the empty redirect page

this is a frustrating one, but i can't imagine that it is not possible to solve

 

by: PaulHewsPosted on 2007-12-11 at 11:57:31ID: 20452137

I can't get the javascript wait... All I ever see is the excel file.  Can you post the content of the redirect page?

 

by: bruintjePosted on 2007-12-11 at 12:04:39ID: 20452205

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<html>
<head>
      <title>Vontobel Excel Writer</title>
</head>
<body onload="window.setTimeout('redirect()', 3000);">
<table border="0" width="100%" height="100%">
      <tr>
            <td valign="middle" align="center"><img src="images/derinet_de_prepare.gif" border="0" width="472" height="85"></td>
      </tr>
</table>
</body>
<script language="javascript">
<!--
function redirect() {
      location.href = location.href;
}
// -->
</script>
</html>

at first it worked for me too, but after i emptied the ie downloaded files and cache and it started to go against me

it started working again but when it tried it on a different pc it left me in the cold

 

by: bruintjePosted on 2007-12-11 at 13:40:48ID: 20453080

Hi Paul,

Thanks for the idea of the loop. I also looked further on the net and found the winhttp dll that contains a request object with a redirect property. however, its not working as i expected and still needed the loop and pause (this is a sleep function that convert to seconds). After 3 days on this problem i still hold my breath to see if it still works on a different machine but it looks that it finally is solved. This is my code for anyone interested (needs a reference to the mentioned dll)

Private Function DownloadFile(ByVal myURL As String) As Variant
Dim myReq As WinHttpRequest, hFile, bContentIsOK As Boolean

On Error GoTo errhandle

  bContentIsOK = False
  Do Until bContentIsOK
     
      Set myReq = CreateObject("WinHttp.WinHttpRequest.5.1") 'New WinHttpRequest
      myReq.Option(WinHttpRequestOption_EnableRedirects) = True
      myReq.setTimeouts 30000, 30000, 30000, 30000
      myReq.Open "GET", myURL, True
      myReq.send
      myReq.waitForResponse (100000)
     
      ' return bytearray
      If Len(myReq.responseBody) <> 245 Then
          bContentIsOK = True
      Else
          DoEvents
          Sleep 5000  'However long the javascript wait is
      End If
     
  Loop

  DownloadFile = myReq.responseBody
     
  Set myReq = Nothing
  Exit Function
   
errhandle:
  ' do something here
  Set myReq = Nothing
  errCount = 1
  ErrMsgAdd "xml http part", "Error in getting file from the web." & myURL, Err.Number, Err.Description, errdata
  Err.Clear
  Set myReq = Nothing
End Function

Brian

 

by: bruintjePosted on 2007-12-11 at 13:44:27ID: 31414150

i put in partially accurate, because it did not work with the same dll as in the final solution but Paul did go a long way to provide me with the alternatives to look for a complete solution in other directions Thanks!!!

 

by: PaulHewsPosted on 2007-12-11 at 14:04:23ID: 20453288

I did this with Microsoft WinHTTP Services reference, but it's probably doable with the xmlhttp component as well (I just wanted to see the headers and such.)

It takes awhile and has to loop a few times before the Excel file is served up... But it's been working here.

Option Explicit
Private Declare Sub Sleep Lib "kernel32.dll" (ByVal dwMilliseconds As Long)
 
Private WithEvents http As WinHttpRequest
 
Private Sub Command1_Click()
    Dim myURL As String
    Dim strKey As String
    Dim Count As Integer
    
    
    myURL = "http://excel2.smarthouse.de/ExcelWriter.aspx?xls_cu=vontobel&xls_co=productlist&xls_s=derinet-chDE&pageid=40"
    Set http = New WinHttpRequest
    http.Open "GET", myURL, False
    http.Send
    
    
    myURL = myURL & "&xls_file="
    
    strKey = fParseBetween(http.ResponseText, "location.href = location.href + '&xls_file=", "';")
    myURL = myURL & strKey
    
    
    Do While InStr(1, http.ResponseText, "function redirect()")
        Sleep 3000
        Count = Count + 1
        http.Open "GET", myURL, False
        http.Send
        Debug.Print Count
    Loop
    
    sPutBytesToFile http.ResponseBody, "C:\temp\test2.xls"
    
    MsgBox "Done"
    
    MsgBox FileLen("C:\temp\test2.xls")
    
    
    
    
End Sub
 
Public Function fParseBetween(ByVal strChk As String, ByVal strFirst As String, ByVal strLast As String, Optional lngStart As Long = 1) As String
    Dim lngPos As Long, lngLen As Long
    
    lngPos = InStr(lngStart, strChk, strFirst, vbTextCompare) + Len(strFirst)
    lngLen = InStr(lngPos, strChk, strLast, vbTextCompare) - lngPos
    
    If lngPos > 0 And lngLen > 0 Then
        fParseBetween = Mid$(strChk, lngPos, lngLen)
        If Len(fParseBetween) > 0 Then
            lngStart = lngStart + Len(fParseBetween)
        End If
    End If
    
End Function
 
Public Sub sPutBytesToFile(byt() As Byte, strPath As String)
    Dim i As Integer
    Dim hFile  As Integer
    If Dir(strPath) <> "" Then
        Kill strPath
    End If
    
    hFile = FreeFile
    Open strPath For Binary As #hFile
    Put #hFile, , byt
    Close #hFile
    
End Sub
                                              
1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:
42:
43:
44:
45:
46:
47:
48:
49:
50:
51:
52:
53:
54:
55:
56:
57:
58:
59:
60:
61:
62:
63:
64:
65:
66:
67:
68:
69:
70:

Select allOpen in new window

 

by: bruintjePosted on 2007-12-11 at 14:17:32ID: 20453388

Thanks a lot Paul for your hard work,

that is cleaner than my last post as i was already glad that i got something in line with expectations

Always a good thing to be around the Experts :-))))

20120131-EE-VQP-002

3 Ways to Join

30-Day Free Trial

The Experts

98% positive feedback on 31,087 answers since March 2000. angeliii is a Microsoft Most Valuable Professional for his work with MS SQL Server & Develoment.

He has also proven his knowledge of Visual Basic Programming, PHP Scripting and Oracle Databases.

The Experts

97% positive feedback on 10,752 answers since July 2000. lrmoore has more than 18 years experience in the networking industry.

The six-time Mircosoft MVPs specialties include firewalls, virtual private networking, and network management.

Testimonials

"...and excellent source for support... Kind of like having your very own IT dept." Electriciansnet

Testimonials

"I was apprehensive at signing up at first. However... it has already made my life as an IT administrator much easier." JaCrews

Testimonials

"WOW! You guys have great, active, and knowledgeable people on here." moore50

Business Clients

Business Clients

In the Press

"If you’ve got a question... Experts Exchange can supply an answer.”

In the Press

"...an invaluable aid for both IT professionals and those who require tech support."

In the Press

"where IT professionals provide quick answers on just about any topic"

Business Account Plans

Loading Advertisement...