Re: [Full-disclosure] Re: Links to Google's cache of 626 FrSIRT exploits

Dave,

I couldn't get wget 'http://www.elsenot.com/frsirt-google.html' grep
-o 'href="[^"]*"' frsirt-google.html | cut -d '"' -f 2 > list.txt

to work, so I did

wget -O - http://www.elsenot.com/frsirt-google.html | sed 's/"/\n/g'
| grep ^http > list.txt

the first link times out and a few others, also a few return error
pages saying there isn't a cached page.
http://www.elsenot.com/frsirt-google.html

cheers
Ivan

On 3/22/06, Dave Korn <davek_throwaway@xxxxxxxxxxx> wrote:
layne@xxxxxxxxxxx wrote:
So you never recursively sucked FrSIRT.com before the public exploits
section was "definitively closed" well we're in luck (at least for a
little while) because Google did.

This page links to Google's cache of 626 FrSIRT exploits

http://www.elsenot.com/frsirt-google.html

If you want to fetch them with wget, you'll need to supply a plausible
user-agent using the -U option on the command line. Without that, google
just returns a "403 Forbidden". I found the following technique worked:

wget 'http://www.elsenot.com/frsirt-google.html'
grep -o 'href="[^"]*"' frsirt-google.html | cut -d '"' -f 2 > list.txt
wget -i list.txt -U 'User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1;
en-GB; rv:1.7.10) Gecko/20050717 Firefox/1.0.6'

although IIRC you could also just pipe the output from grep | cut straight
into wget, should you want to save yourself the temporary listing file.

cheers,
DaveK
--
Can't think of a witty .sigline today....



_______________________________________________
Full-Disclosure - We believe in it.
Charter: http://lists.grok.org.uk/full-disclosure-charter.html
Hosted and sponsored by Secunia - http://secunia.com/


_______________________________________________
Full-Disclosure - We believe in it.
Charter: http://lists.grok.org.uk/full-disclosure-charter.html
Hosted and sponsored by Secunia - http://secunia.com/

Relevant Pages

  • Shell Script Examples
    ... I'm looking for some really basic examples of shell scripts. ... example, I'd like to be able to wget an html page, grep it for text ... I'm also trying to find a simple example of an if statement with diff. ...
    (comp.unix.admin)
  • Re: [Full-disclosure] Re: Re: Links to Googles cache of 626 FrSIRTexploits
    ... I couldn't get wget 'http://www.elsenot.com/frsirt-google.html ' grep ... Charter: http://lists.grok.org.uk/full-disclosure-charter.html ... Hosted and sponsored by Secunia - http://secunia.com/ ...
    (Full-Disclosure)
  • Re: Yum Keeps Giving Error
    ... Do you have a transparent proxy in the network? ... $ wget http://mirror.atrpms.net/livna/fedora/8/i386/repodata/primary.sqlite.bz2 ... $ grep 17e08 repomd.xml ... I guess it works this way but not without disabling freshrpms .I changed my ip address to another one..Now how to remove the freshrpms repo?? ...
    (Fedora)
  • [Full-disclosure] Re: Re: Links to Googles cache of 626 FrSIRTexploits
    ... I couldn't get wget 'http://www.elsenot.com/frsirt-google.html ' grep ... Just wanna point out that I had those as two separate commands on separate ...
    (Full-Disclosure)
  • Re: [Full-disclosure] sandboxed browsing
    ... I mean wget, netcat, curl, etc... ... Full-Disclosure - We believe in it. ... Charter: http://lists.grok.org.uk/full-disclosure-charter.html ... Hosted and sponsored by Secunia - http://secunia.com/ ...
    (Full-Disclosure)