Aug 1, 2009 at 11:57 PM

 How comes the default robots.txt that ships with v1.5 not not disallow access to /admin* ?

Aug 2, 2009 at 6:45 AM

Probably because since there are no links going to any of the admin pages, a bot would not attempt to go to an admin page it doesn't know about.

And even if an attempt was made, the bot would just get kicked back to the login page since it wouldn't have access to the admin pages.

But, you're of course welcome to make any modifications to the robots.txt file you'd like.