Re: Is it possible to screen scrape a secure site (HTTPS).....

From: Eric Lawrence [MSFT] (e_lawrence_at_hotmail.com)
Date: 02/25/04 

Date: Wed, 25 Feb 2004 10:42:23 -0800

There's probably a property on the object to allow you to add your
credentials.

If not, it's still pretty easy. First, figure out what protocol the secure
site is using for authentication-- is it BASIC, DIGEST, Negotiate, or
whatever. If it's basic, it's simple-- just add an Authorization header
with the base-64 encoded username:password string. If it's digest or
Negotiate, it gets trickier. 

-- 
Thanks,
Eric Lawrence
Program Manager
Assistance and Worldwide Services
This posting is provided "AS IS" with no warranties, and confers no rights.
"Max" <maximus@portvista.com> wrote in message
news:pe%_b.148205$Po1.42224@twister.tampabay.rr.com...
> This might work?
> https://username:password@www.domain.com
>
>
>
>
> "Ollie" <why do they need this!!!!> wrote in message
> news:%23Roocd4%23DHA.2348@TK2MSFTNGP09.phx.gbl...
> > I know you can screen scrape a website using the
> System.Net.HttpWebResponse
> > & System.Net.HttpWebRequest classes.
> >
> > But how do you screen scrape a secured website (https) that takes a
> username
> > & password, I guess what I am asking where does the username & password
> > go and where do you store any returned token for further requests...
> >
> > Cheers
> >
> > Ollie
> >
> >
> >
>
>

Relevant Pages