Category: PHP Script Codes > robots.txt generator
This script lets you browse through your server´s directory structure. If a robots.txt is found, it is read and the appropriate allowed/disallowed folders are checked/unchecked. Just change the checkers and hit the ´update´ button to update the robots.txt. You may also delete the file or edit the comment. Changes are always made to ´User-agent: *´. Additionally the script warns, if no index-files or htaccess files were found. Updated: Now PHP 4.2 security conform.