Solved

HttpWebRequest Form Authentication Not Getting Past Login Page

Posted on 2010-09-03
3
671 Views
Last Modified: 2012-08-13
Hey Guys,

I am trying to use HTTPWebRequest to login to a site and then retrieve the page after login. However, it seems as if I can't get past the login. I also investigated with Fiddler and tried mimicking Fiddler almost completely and still no luck.

Any idea what I am doing wrong?

Thanks,
Mohammed
Dim webRequest As HttpWebRequest
Dim responseReader As StreamReader
Dim responseData As String
Dim postData As String = "login=testexpert@yahoo.com&password=testexpert"
Dim cookies As CookieContainer = New CookieContainer()
Dim requestWriter As StreamWriter

Try
'post form data to page
    strUrl = "https://www.ideeli.com/login"
    webRequest = HttpWebRequest.Create(strUrl)
    webRequest.Method = WebRequestMethods.Http.Post
    webRequest.ContentType = "application/x-www-form-urlencoded"
    webRequest.CookieContainer = cookies
    webRequest.ContentLength = postData.Length

    requestWriter = New StreamWriter(webRequest.GetRequestStream)
    requestWriter.Write(postData)
    requestWriter.Close()

'recieve cookie
    webRequest.GetResponse().Close()

'now we send the cookie
    webRequest = HttpWebRequest.Create("http://www.ideeli.com")
    webRequest.CookieContainer = cookies
    responseReader = New StreamReader(webRequest.GetResponse.GetResponseStream())
    responseData = responseReader.ReadToEnd()
    responseReader.Close()
    strRequestedHTML = responseData

    Return
Catch ex As Exception
    ErrorLabel.Text += "<br />There was an error going to this site: " + strUrl + "<br> Error: " + ex.Message
    Return
End Try

Open in new window

0
Comment
Question by:mohali786
  • 2
3 Comments
 
LVL 17

Expert Comment

by:Zhaolai
ID: 33600771
Tried your code. Here is the return page:
Is it what you expected?
Do you get any errors? If so, what errors?


Screenshot.PNG
0
 

Author Comment

by:mohali786
ID: 33600988
I get the same page. However, this is not the page that I want. If I tried going to Ideeli.com without being logged in I would get this page. If I tried the same while being logged in I would get the sales page. I want to see the sales page.
0
 

Accepted Solution

by:
mohali786 earned 0 total points
ID: 33601929
Here is the code to resolve that. Basically what I do different is to GET the non-authenticated cookie first and then POST that with my login information
Dim webRequest As HttpWebRequest
Dim responseReader As StreamReader
Dim responseData As String
Dim postData As String = "login=testexpert@yahoo.com&password=testexpert"
Dim cookies As CookieContainer = New CookieContainer()
Dim requestWriter As StreamWriter

Try
'get login page with cookies
    strUrl = "https://www.ideeli.com/login"
    webRequest = HttpWebRequest.Create(strUrl)
    webRequest.CookieContainer = cookies

'recieve non-authenticated cookie
    webRequest.GetResponse().Close()

'post form data to page
    strUrl = "https://www.ideeli.com/login"
    webRequest = HttpWebRequest.Create(strUrl)
    webRequest.Method = WebRequestMethods.Http.Post
    webRequest.ContentType = "application/x-www-form-urlencoded"
    webRequest.CookieContainer = cookies
    webRequest.ContentLength = postData.Length

    requestWriter = New StreamWriter(webRequest.GetRequestStream)
    requestWriter.Write(postData)
    requestWriter.Close()

'recieve authenticated cookie
    webRequest.GetResponse().Close()

'now we get the authenticated page
    webRequest = HttpWebRequest.Create("http://www.ideeli.com")
    webRequest.CookieContainer = cookies
    responseReader = New StreamReader(webRequest.GetResponse.GetResponseStream())
    responseData = responseReader.ReadToEnd()
    responseReader.Close()
    strRequestedHTML = responseData


Catch ex As Exception
    ErrorLabel.Text += "<br />There was an error going to this site: " + strUrl + "<br> Error: " + ex.Message
    Return
End Try

Open in new window

0

Featured Post

3 Use Cases for Connected Systems

Our Dev teams are like yours. They’re continually cranking out code for new features/bugs fixes, testing, deploying, testing some more, responding to production monitoring events and more. It’s complex. So, we thought you’d like to see what’s working for us.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Gridview selected row 9 44
Footer for each row on Gridview 2 21
No Data for DropDown List 2 22
Client Validating 2 date fields, required & comparison 1 22
A long time ago (May 2011), I have written an article showing you how to create a DLL using Visual Studio 2005 to be hosted in SQL Server 2005. That was valid at that time and it is still valid if you are still using these versions. You can still re…
The article shows the basic steps of integrating an HTML theme template into an ASP.NET MVC project
This video teaches users how to migrate an existing Wordpress website to a new domain.
Learn how to set-up PayPal payment integration in your Wufoo form. Allow your users to remit payment through PayPal upon completion of your online form. This is helpful for collecting membership payments, customer payments, donations, and more.

786 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question