Re: Is it possible to screen scrape a secure site (HTTPS).....

From: Chad Z. Hower aka Kudzu (cpub_at_hower.org)
Date: 02/25/04

  • Next message: mklapp: "RE: Login failed for user 'NT AUTHORITY\ANONYMOUS LOGON'." 
    Date: Wed, 25 Feb 2004 20:51:45 +0200

    "Eric Lawrence [MSFT]" <e_lawrence@hotmail.com> wrote in news:#5pIH88#DHA.808
    @TK2MSFTNGP12.phx.gbl:
    > If not, it's still pretty easy. First, figure out what protocol the secure
    > site is using for authentication-- is it BASIC, DIGEST, Negotiate, or
    > whatever. If it's basic, it's simple-- just add an Authorization header
    > with the base-64 encoded username:password string. If it's digest or
    > Negotiate, it gets trickier.

    Indy supports all of these authentications and more. Its also free.

    http://www.indyproject.org/

    The only problem is that the .net version doesnt support SSL yet. BUT you
    could bundle it with an SSL tunnel if your options are limited. 

    --
Chad Z. Hower (a.k.a. Kudzu) - http://www.hower.org/Kudzu/
      "Programming is an art form that fights back"
  • Next message: mklapp: "RE: Login failed for user 'NT AUTHORITY\ANONYMOUS LOGON'."

    Relevant Pages