Robots Generator

directory insecure: add an index-file oder .htaccess to minimize intrusion risks!
robots.txt not found
    /
    ..
 .udev
 block
 bsg
 bus
 char
 cpu
 disk
 dri
 fd
 hugepages
 input
 mapper
 net
 pts
 raw
 shm

comment:



USAGE: Check items for being allowed, uncheck items for being disallowed for user-agent *