Home / Search Engine Journal SEO / Blocking Special Files in Robots.txt

Blocking Special Files in Robots.txt

In the latest episode of Ask Google Webmasters, Google’s John Mueller goes over whether or not it’s okay to block special files in robots.txt.

Google SEO 101: Blocking Special Files in Robots.txt

Google’s John Mueller answers a question about using robots.txt to block special files, including .css and .htacess.

This topic was discussed in some detail in the latest edition of the Ask Google Webmasters video series on YouTube.

Here is the question that was submitted:

“Regarding robots.txt, should I ‘disallow: /*.css$’, ‘disallow: /php.ini’, or even ‘disallow: /.htaccess’?”

Mueller’s response is below:




Source link

About admin

Check Also

Googlers Do Not Answer Direct Messages; Here’s Why

Google’s Search Relations team explains why they cannot answer direct messages from SEOs and site …

Leave a Reply

Your email address will not be published. Required fields are marked *