jason@position1seo.com
0141 404 7515
logo

This Is How Google Ranks Pages Blocked By Robots.txt

Robots.txt

In a recent Google Webmaster Central hangout, a question about “how does Google figure out query relevancy for ranking pages blocked by robots.txt” was asked. This is a good thing to ask, especially for site owners and SEO experts who are also curious about what types of search queries do these pages rank for.

In response, John Mueller admitted that Google couldn’t obviously view the page content if it’s already blocked. Instead, they’ll have to improve and look for another way to compare the URL with other URLs ranking for such queries.

It’s important to note though that Google will prioritise indexing the website’s other pages that are more accessible. In other words, if you have great content available for crawling and indexing, then that’s what Google will utilise.

However, it’s worth noting that pages blocked by robots.txt can still rank in the search results if Google sees they are worthwhile. For instance, if there are links pointing to that particular page, then Google will assume that the content is indeed valuable.

Ultimately, Mueller said that utilising robots.txt to block content is not advisable. But if it does happen, then Google will still try to rank the page in the search results.

This SEO news came from https://www.searchenginejournal.com/googles-john-mueller-explains-how-pages-blocked-by-robots-txt-are-ranked/316061/. Follow the link to know more.

Getting professional SEO services from trustworthy providers is one way to increase your site traffic, and eventually, get higher rankings. To know how we can help you, visit our website right now.

robots.txt 2
Author: Jason Ferry
Jason Ferry is an SEO specialist based in the United Kingdom. Taking pride in his many years of experience in the search engine optimisation industry, he has honed his skills in various digital marketing processes. From keyword marketing, website auditing, and link building campaigns, to social media monitoring, he is well-versed in all of them. Jason Ferry’s excellent skills in SEO, combined with his vast experience, makes him one of the best professionals to work with in the industry today. Not only does he guarantee outstanding output for everyone he works with, but also values a deep relationship with them as well.

Related  Posts

seo services uk blog 01
Why UK businesses are investing more in SEO services
UK businesses are boosting their digital presence. They are investing more in SEO services in the UK to gain visibility and attract customers online. But what drives this trend? Let's explore the reasons behind this shift. Increased online competition The online market is competitive. More businesses are joining the digital space. To stand out, you […]
seo company packages blog 01
What’s included in most SEO company packages?
Choosing an SEO company can feel overwhelming. Each agency promises different results, and the range of services can vary widely. That’s why it helps to understand the common elements most packages share. Companies offer various services bundled together. Here’s what you usually get with SEO company packages. Keyword research and analysis SEO companies start with […]
seo company small business blog 01
Why small businesses need an SEO company more than ever
Running a small business today presents unique challenges. Competition online is fierce, and without visibility in search results, even great products or services can go unnoticed. One key area often overlooked is search engine optimisation (SEO). Let's explore why hiring an SEO company for small businesses is crucial for your business growth. Increase your online […]