.Google restricts robots.txt assistance to four industries, clarifying its stance on in need of support directives.Google only supports four certain robots.txt fields.In need of support regulations in robots.txt will be actually overlooked.Consider auditing your robots.txt files taking into account this improve.