Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without…
وسم الإضافة: crawler
Block Feed and Comments via robots.txt
Blocks some Feed and Comment resources in order to avoid spam bots