.Google restricts robots.txt support to four industries, clarifying its own stance on unsupported ordinances.Google merely assists four specific robots.txt industries.In need of support directives in robots.txt will definitely be disregarded.Consider auditing your robots.txt documents in light of this upgrade.