Re: Can't Pull Pages From External Sites

From: Joe Kaplan \(MVP - ADSI\) (joseph.e.kaplan_at_removethis.accenture.com)
Date: 09/09/04


Date: Wed, 8 Sep 2004 22:12:10 -0500

You probably need to send a cookie in your request as well that will
authenticate you. This would be the same cookie that is sent when you visit
the site with your browser. Otherwise, you need to negotiate the login
pages programmatically.

Joe K.

"RL" <rlondon@cyburban.com> wrote in message
news:qM2dndGL-PUp96LcRVn-sA@speakeasy.net...
> Hi,
>
> I'm trying to pull pages from news sites like New York Times and WSJ. (I
> have accounts with them.) I wrote a ultility that goes to their home
> pages
> and pulls out the links that I want. But when I try to get those links,
> authentication fails--I get login pages instead (I don't get those login
> pages when I access the desired pages from a browser). I tried to set
> request headers to make the request look like it's coming from IE, to no
> avail.
>
> Any ideas would be appreciated.
>
>