Non-Indexable Pages - Ryte Product Insights (2023)

Without indexing, the affected URLs can no longer be ranked. Depends on the strength of each oneURLLack of indexing can lead to a huge loss of visibility. Therefore, you should regularly check your website for non-indexable pages. Ryte can help you with that!

misconfigured or "forgotten" noindex tags

You can use the noindex tag to exclude websites from search engine indexing. In this case, iHeadersunrise


Crawlers like Googlebot can still follow links on the page, but don't index the URL. Normally it will be like thisno indexThe tag is used to temporarily prevent a URL from being indexed. This can be due to changes in the URL or changes in the URL structure, for example. However, if the tag is forgotten after the changes, the page will be permanently removed from the index. If still tagged without the "follow" suffix, followGoogle robotsthe links on the relevant page no longer. It also prevents other URLs on your site from being crawled and indexed.

How to find misconfigured noindex tags with Ryte Website Success:

In the Indexability menu, click the What can be indexed? section. You will then receive an overview of which URLs Google can index and where there are potential indexing problems.

Navigate to Nonidex using the robot bar in the diagram. After one click you will see all URLs tagged with "noindex":

Nicht indexierbare Seiten – Ryte Product Insights (1)

Illustration 1:Identify URLs tagged "noindex" with Ryte Website Success.

Then what should you do?

  • Remove any stray noindex tags from the URLs in question.

  • Then let Ryte track your project again and check it accordingly.

Misconfigured canonical tags

With aCanonical-TagYou can point Google to the "Original URL" for URLs with the same content. Usually Google ignores this when indexingDuplicatey refers to the canonical URL only.

Many errors can occur when setting canonical tags. It is therefore possible that the canonical tag points to a page with a noindex tag. In this case, the canonical page is not indexed. Basically, the canonical tag is just a recommendation to Google, not an instruction. If Googlebot assumes that the canonicals are set incorrectly, they will be ignored. For this purpose, Google checks the links stored in the Sitemap.xml.

Although the canonical tag cannot theoretically be equated with the noindex tag function, in practice faulty canonical tags have similar effects.

What you should also note about canonical tags:

How to check canonical tags with Ryte Website Success:

In the Indexability section, go to Canonicals. From there, click Canonical Use. The overview shows you where canonical tags are used and where not on your website.

Nicht indexierbare Seiten – Ryte Product Insights (2)

Figure 2:Verify canonical tag usage with Ryte Website Success.

Then what should you do?

  • Include self-referencing canonical tags if you don't want a page to refer to a canonical URL.

  • Check canonical tags and your link destinations. Everything is correct? Correct possible mistakes.

Fejl y robots.txt

the smallrobots.txtIt's just a text file stored at the root of your domain. But the file has a big impact on your website indexing. Because it contains instructions on how to allow bots to crawl your site. For example, you can use robots.txt to exclude bots or prevent all bots from crawling specific folders.

Robots.txt does not exclude URLs from indexing, which is often misunderstood. However, since the instructions prevent Googlebot from crawling the URLs, they cannot be indexed in this way either. By excluding folders, you can indirectly ensure that they are "not" indexed.

Because of this, you should check robots.txt regularly, especially after making changes to the file. In principle, it is advisable to let the Googlebot crawl as many areas as possible anyway. This ensures that Google can display your web pages as a human user would with their browser.

Common mistakes are:

  • Exclude folders with files like CSS or JavaScript that are important for loading functions on the website.

  • Exclusion of important categories.

  • Using wrong syntax in robots.txt, which means whole folders cannot be accidentally crawled.

To manage your robots.txt file with Ryte:

In the Indexability section, click Robots.txt. You already get an overview of which URLs are excluded from file crawling.

Nicht indexierbare Seiten – Ryte Product Insights (3)

Figure 3:Monitoring robots.txt with Ryte.

wrong redirects

redirects like this301 redirectHelp redirect old URLs to new URLs without losing link juice. Instructions stored in the Apache server's htaccess file are almost imperceptible to users. However, if the 301 redirect is configured incorrectly, there may be a loss in ranking, since the original page is no longer considered for indexing.

A common mistake is that a 301 redirect redirects to the wrong URL. It's also bad for indexing if a 301 redirects to a URL that points to another URL via Canonical, or redirects to a URL that is excluded from indexing via Noindex.

With Ryte you can control all redirects on your website:

In the "Indexability" area, click on the "Redirects" menu item and then on "Status Codes". The report immediately shows you all configured points.

Nicht indexierbare Seiten – Ryte Product Insights (4)

Figure 4:Check the redirects against the success of the Ryte website.

You have to do this:

  • Are 301 redirects still necessary? Check if the new URLs are already indexed by Google. You can do a simple "site query" with the correct URL. If the new URL already exists in the index, the 301 redirect can be removed.Google's Gary Illyes confirmed this in a tweet..

  • Are temporary redirects (302) still necessary? These redirects are usually set up when there are new URLs to redirect due to seasonal or marketing reasons. When the actions are finished, you can also remove the redirect.

Broken or missing internal link

An intact inner joint functions as a network of veins that supply the body with fresh blood. If the internal link is broken, the distribution ofLinkjuiceAnd in the worst case, broken links prevent individual URLs from being indexed on your website.

Conversions or restructuring on your website can cause URLs to become so-called "orphan pages". These are websites with no internal inbound links. If these pages are not externally linked via backlinks, the Googlebot no longer has the opportunity to crawl and index them.

Ryte Website Success can help track down orphaned pages:

To do this, click on "Links" and then on "Pages without incoming links". The report then lists all orphaned URLs.

Nicht indexierbare Seiten – Ryte Product Insights (5)

Figure 5:Find Orphaned Pages with Ryte Website Success.

So you should do the following:

Set the internal link again to the appropriate URL or folder. Correct the relevant link in the menu or content.

wrong pagination

URL pagination combined with unindexed and canonical tags can annoy search engines and therefore result in incorrect indexing or no indexing at all.

For example, if you have inserted a pagination and the paginated pages refer to the first page of the pagination, the paginated pages may no longer be indexed. Thepaginationbut to show Google that it's a continuous series of pages.

Pagination with the noindex tag can also often have potential errors. For example, it would be a mistake to exclude a paginated page from indexing with "noindex" and have that page refer to the first page of the pagination with a canonical tag.

In this case, Google is instructed not to include the page in question.IndexThat should be the case, but it would tell the bot to only consider links on the first page of pagination. This would interrupt the harmonious "circulation" of your page: the link juice could no longer reach all category pages.

How to find the errors with Ryte Website Success:

In the Indexability section, click Pagination, and then click Pagination Target.

Ryte will then show you where the links marked with rel="prev" lead to.

Nicht indexierbare Seiten – Ryte Product Insights (6)

Figure 6:Check pagination with Ryte Website Success.

You have to do this:

  • Make sure the page reference is correct and the highlighted links point to the correct page or folder. Correct any errors.

  • After the improvements, let Ryte recrawl your project and check the pagination again.

Pages with 404 status code

A 404 error page is displayed whenever the server can no longer find content for the requested URL (404 not found) in response to a client request. Now, if Googlebot crawls your website and encounters error pages frequently, the crawling will be severely disrupted. This can lead to the fact that the Googlebot can no longer reach the deeper areas of your website due to the limited crawl budget. There is such a high risk that these URLs will not be indexed due to lack of crawling.

How to find 404 errors with Ryte:

In the Indexability section, go to Status Codes. Then click the red ">4xx (not found)" button. The report will then show you all the URLs that are returning a 404 error code.

Nicht indexierbare Seiten – Ryte Product Insights (7)

Figure 7:Get status codes with Ryte.

You can do it:

  • Check that there is actually no relevant URL for the 404 errors that are present. If not, add a 301 redirect for new content.

  • Check if the URLs for which the server returns a 404 error are incorrect.

  • Check if you're using a custom 404 error page that offers users possible alternatives.Google also recommends using custom 404 pages. Because 404 errors cannot always be avoided and are a "natural" part of the web.With a well-designed error pageHowever, it can increase user-friendliness and prevent many users from churn.


The larger a web project is, the more likely it is that there will be errors. This makes it all the more important that you regularly check your project for errors, especially on websites with many URLs. It's always a good idea to check if you're making changes to the content, URL structure, or redirects. With Ryte, you can generate relevant reports to help you troubleshoot with little effort.


What is the best SEO practice for handling a page you no longer want on your website? ›

You can redirect them.

From an SEO perspective, 301 redirecting dead, irrelevant, or deleted pages will pass on most of that page's equity to the new page on your site. If the page is receiving organic traffic, has backlinks and you can redirect it to a relevant page, then use a 301 redirect.

What are the most important factors to review on page for SEO in order of priority? ›

12 Essential On-Page SEO Factors
  • Keywords. The most basic way to tell them your website's content answers a user's question is in the language you use. ...
  • Visual Assets. ...
  • Title Tags. ...
  • Meta Description. ...
  • Image Optimization. ...
  • Geotagging (For Local Search) ...
  • Site Speed. ...
  • Responsive Design.
Jun 10, 2022

How to do an on page SEO analysis? ›

How to Conduct an SEO Analysis
  1. Check Your Visibility on Google.
  2. Check URLs and Meta Descriptions.
  3. Analyze Titles and Headings.
  4. Evaluate Incoming Links.
  5. Analyze Your Spam Score.
  6. Check Your Internal Links.
  7. Investigate for Broken Links.
  8. Analyze Your Web Content.
Oct 1, 2020

Does Shopify do SEO for you? ›

Shopify online stores have SEO built in and features to help you optimize your content. Some SEO is taken care of automatically: auto-generated canonical tags are added to pages to prevent duplicate content from appearing in search results, your website's sitemap. xml and robots.

Which technique should be avoided in SEO? ›

Targeting Multiple Keywords and Their Variations

You might even think this method could make your articles rank highly across the board. However, this strategy is both an outdated and bad SEO tactic. For one, trying to rank for multiple keywords often means compromising on your article quality.

What are the top 5 things that make an article SEO optimized? ›

13 Tips to Help You Create SEO Friendly Content
  • Carry out a keyword research. Listen: 1. ...
  • Structure your content. Listen: 2. ...
  • Write catchy titles. Listen: 3. ...
  • Write SEO friendly URLs. Listen: 4. ...
  • Use small paragraphs. Listen: 5. ...
  • Optimize meta description. Listen: 6. ...
  • Optimize images. Listen: 7. ...
  • Add links that make sense. Listen: 8.
May 24, 2023

What are the 6 steps to create a SEO-friendly page? ›

How to Create an SEO-Friendly Website: 14 Tips for Long-Term Organic Growth
  1. Use Keywords Throughout Your Content.
  2. Use Header Tags.
  3. Have a Clean URL Structure.
  4. Include Keyword-Rich Anchor Text in Your Links.
  5. Make Sure the Website Is Mobile-Friendly.
  6. Optimize Images.
  7. Make Sure Your Web Pages Load Fast.
Mar 2, 2023

How can I improve my SEO score on my page? ›

Follow these suggestions to improve your search engine optimization (SEO) and watch your website rise the ranks to the top of search-engine results.
  1. Publish Relevant, Authoritative Content. ...
  2. Update Your Content Regularly. ...
  3. Metadata. ...
  4. Have a link-worthy site. ...
  5. Use alt tags.

Does SEO really increase sales? ›

Many brands make the mistake of relegating search engine optimization (SEO) to ranking websites and driving targeted traffic. They never align it with their sales efforts, leaving a huge gap in their business growth strategy. However, if executed well, SEO can help you significantly boost your sales.

Is SEO better on WordPress or Shopify? ›

WordPress is the leading choice for content sites, while Shopify is best for eCommerce sites. But when we stack the SEO capabilities of both platforms against each other—WordPress comes out on top. It's also the no-brainer choice for most business owners with a content marketing strategy.

How much does Shopify charge for SEO? ›

SEO pricing and plans can range anywhere from $1,000 to $10,000+ a month depending on the level of SEO effort. When you're at the top of the search results in Google or other search engines, your Shopify sales will grow exponentially.

Is it better to delete a page or redirect it? ›

In other words, you lose that ranking power, that good spot in the SERP, and that traffic. You also lose the ability for searchers to find you using the terms associated uniquely with that page. So what is the best thing to do? Redirect the page you want to delete to a relevant page.

How do I remove unwanted pages from my website? ›

Copy or delete a page
  1. On a computer, open a site in new Google Sites.
  2. At the right, click Pages.
  3. On the page you want to duplicate or delete, click More . To copy a page, choose Duplicate page. To delete a page, choose Delete. ...
  4. To publish your changes, at the top right, click Publish.

Does deleting a page hurt SEO? ›

Internal and External Links

Deleting a product without proper handling can lead to broken links, negatively impacting the user experience and SEO. Additionally, external websites may have linked to your product pages. Removing those pages could result in lost backlinks, which are crucial for SEO.

What is the most effective way to improve off-page SEO? ›

How to Do Off-Page SEO (7 Tips)
  1. Earn Quality Backlinks from High-Authority Sites. ...
  2. Create and Share Unique, Engaging Content. ...
  3. Create a Google My Business Account. ...
  4. Encourage Customer Reviews. ...
  5. Build a Strong Social Media Presence. ...
  6. Try Influencer Marketing. ...
  7. Monitor Your Brand Signals and Mentions.


Top Articles
Latest Posts
Article information

Author: Laurine Ryan

Last Updated: 02/10/2023

Views: 6337

Rating: 4.7 / 5 (57 voted)

Reviews: 88% of readers found this page helpful

Author information

Name: Laurine Ryan

Birthday: 1994-12-23

Address: Suite 751 871 Lissette Throughway, West Kittie, NH 41603

Phone: +2366831109631

Job: Sales Producer

Hobby: Creative writing, Motor sports, Do it yourself, Skateboarding, Coffee roasting, Calligraphy, Stand-up comedy

Introduction: My name is Laurine Ryan, I am a adorable, fair, graceful, spotless, gorgeous, homely, cooperative person who loves writing and wants to share my knowledge and understanding with you.