.Google.com confines robots.txt assistance to four industries, clarifying its own viewpoint on in need of support regulations.Google simply assists four specific robots.txt fields.In need of support directives in robots.txt will be dismissed.Look at bookkeeping your robots.txt files due to this improve.