I am building a dapp and it needs data from Ethereum to render its content. When I check Google Search Console I see that Googlebot couldn’t connect to Infura and thus nothing was rendered on the screen. As long as Google can’t reach Infura, Google won’t be able to see nothing but a blank page which would kill my SEO.
Offending robots: https://mainnet.infura.io/robots.txt
Googlebot not being able to reach Infura and Google seeing a blank page:
It would be great if Googlebot was allowed to access Infura.