home

Find “robot.txt” Files [read for more info]

Tags: , ,

The robots.txt file serves as a set of instructions for web crawlers. The “disallow” tag tells a web crawler where NOT to look, for whatever reason. Hackers will always go to those places first!
"robots.txt" "Disallow:" filetype:txt

Created By: sb123

Form Page: Find “robot.txt” Files [read for more info]

This entry was posted on Wednesday, September 20th, 2006 at 12:04 am and is filed under 网络. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

« Finding Rar File with google
Finding “Rcon Passwords” with google Options »

留言中至少要有一个中文字

Leave a Reply