This project is read-only.

New Extension - Block Spiders

Topics: ASP.NET 2.0
Jun 30, 2008 at 6:52 PM
I posted a new extension on my blog that helps block spiders from downloading files that I make available.  Why would I want to do this?  Well it's hard to keep count of how many times a file is downloaded when a spider will download it as part of it's crawling process.  So this extension looks at the UserAgent for a matching string and then sends back an Access Denied whenever it finds a match.   Have a look at my blog for more details...

Jun 30, 2008 at 8:00 PM
That's really cool Chris. Thumbs up!