Question

How do I correct the "Mobile page not crawlable due to robots.txt" issue showing in my Google Merchant Center feed? 

Answer

To resolve this issue, update the robots.txt file on your web server to allow Google's crawler to fetch the provided landing pages. See the following resources that may assist you with resolving this issue with Google: 

Learn more:

Test your current configuration:

One or more of your products uses the link attribute to specify a landing page that cannot be crawled by Google because robots.txt forbids Google's crawler to download the landing page when crawling with a mobile user-agent. This prevents Google from performing the automated quality and policy checks on product landing pages that ensure a seamless user experience. Affected products will stop showing in Shopping ads and free product listings for desktop and mobile devices until we are able to crawl the landing page.

Since we specialize in product data, you may need to contact Google support for further information on the changes needed to resolve this error. We also suggest reviewing your Google Search Console account with your site owner for the most recent information. 

This article is based on the following resource from Google. You can check the following link for the most recent information: