How to Fix Index Coverage Issue Server Error 5xx WordPress
The new Google Search Console Index Coverage report is picking up URL’s which are part of normal WordPress operations, such as /wp-includes/ and also /wp-content/themes/ folders, and, whatever .php files which are required for WordPress site to load. If you are seeing these types of Index Coverage Server Errors, then, here’s how you can fix them.
How to Video for Fixing Index Coverage Server Error 5xx for WordPress
Simplified Version for Fixing Server Errors (5xx)
- /wp-content/themes/Jupiter/sample.php file
But since these files shouldn’t be accessed, most web servers with WordPress installation often throws 500 Internal Server Error.
That means, the best way to remedy these errors is by first making sure that whichever XML sitemap you’ve submitted to Google Search Console does NOT produce such URL’s due to wrong setup (rare but could be caused by XML Plugin or Content Management Systems different than WordPress).
If the XML sitemaps are correctly working, then, you need to make sure that /wp-includes/ etc. folders and files within them are NOT accessible by the general public (because if it is, then Googlebot will usually find those URL’s thinking they are part of your WordPress site).
So you can include this in .htaccess file
<IfModule mod_autoindex.c> Options -Indexes </IfModule>
Which should disable directory browsing, thus, will also tell Googlebot “hey, these folders are not part of the general public view of my website”
You can then validate fix in Google Search Console Index Coverage Report, if however so far all is okay after you try these troubleshooting techniques, then, the last option could also be, blocking Googlebot access to those .php files through robots.txt file directives like:
User-agent: Googlebot Disallow: /wp-includes/* Disallow: /wp-includes/themes/YourThemeName
This last option should be coupled with Search Console fetch as Google feature upon validating the problem and triple check that Googlebot can see your website as intended. Try these and you can confidently validate these errors as fixed.
Update: New Blog Post with new video lessons can be found here > Google Search Console Errors