Add "don't index" switch to pages

Right now to prevent a page from being indexed in a Webflow site it requires this custom code in the before </head> tag of the custom code area:

<meta name="robots" content="noindex">


It would be nice to have a toggle switch within page settings for each page that would stop a page from being indexed as well as from being added to the auto generated sitemap.xml file for Webflow hosted sites.  

  • Waldo Broodryk
  • Jan 23 2017
  • Shipped
  • Marc Tiedemann commented
    November 06, 2023 17:00

    That I was allowed to experience this day...
    no, honestly: great work and very much appreciated! Thanks Webflow 🙏

  • Dnssense Roksit commented
    September 28, 2023 11:19

    This is SEO 101. Please help us.

  • Globalcare commented
    September 19, 2023 22:59

    +1

  • Risingteam Admin commented
    July 24, 2023 14:58

    +1 Also needed for our purposes. Incredible that something so simple and elementary hasn't been solved yet.

  • Adrian Hill commented
    June 26, 2023 19:30

    Bumping. We frequently add new pages and manually updating a sitemap is unsustainable. Our big issue is excluding certain pages. We have added noindex tags, but don't want them showing up on the sitemap.

  • Stephen commented
    March 28, 2023 11:07

    This would a very important feature for SEO to prevent Google constantly us there is errors because we've to put a no follow/no index on the pages.


    It would also be a good idea to have far better XML sitemap created that includes times and dates of when a page was last updated. As far as I know, at the moment, this would have to be done manually via a bespoke XML uploaded to Webflow.

  • Darryll Bayes commented
    March 24, 2023 10:57

    I don't see why this is such a hard thing to do. There are some pages that just shouldn't be visible as part of the sitemap. For indexing and access reasons such as thank you pages. Please make this feature work as expected.

  • Jon Gross commented
    March 07, 2023 22:35

    +1 on this. For websites with hundreds of pages, manually updating the sitemap is not a sustainable solution. Please let us know what the expected timing is on this feature (or a Yoast-like plugin or integration to a 3rd party tool that will accomplish the same goal)

  • Support commented
    March 06, 2023 11:04

    Please consider adding this SEO feature - it's crucial for bigger corporate sites that can't have all their pages listed on Google..

    Isn't it just adding one on/off button in the page settings?

  • Steve Canfield commented
    February 28, 2023 15:05

    Not being able to remove pages from the auto generated sitemap is extremely necessary. Please add this functionality Webflow!

  • Catalin commented
    January 25, 2023 13:13

    Make this happen, guys! This is a very basic feature that should already be implemented.

  • Reply Media commented
    January 17, 2023 15:33

    Since this is a critial SEO feature, are there any plugins to assist with this? Like the following

    https://rankmath.com/kb/how-to-noindex-urls/

    I often would love to omit marketing pages or similar from client sites

  • Robin Waite commented
    October 18, 2022 10:09

    Such a basic CMS feature, I upload articles to my site daily, so it's no practical to create and upload a new sitemap every time I make an update! Just a simple toggle to remove the hidden page from the sitemap. How hard can it be!!

  • Michael Wells commented
    August 31, 2022 04:05

    Totally agree, but there are multiple places to impact;

    1. META tag in the page HEAD;
      <meta name="robots" content="noindex">

    2. HTTP response header
      X-Robots-Tag: noindex

    3. sitemap.xml exclusion for the page

    4. Possibly, add noindex attributes to Links to the page


    Interestingly, the page probably should NOT be excluded from robots.txt . When a page is excluded, Google won't scan it again, which means it will never be removed from the search index either.

  • Kevin Pham commented
    August 30, 2022 00:55

    The current 'Exclude this page from site search results' checkbox option should be reworded: 'Exclude this page from internal search results (Remove content from Googles index)' or similar.

  • Tim Ritzema commented
    August 24, 2022 17:33

    Need this feature for WebFlow's ideal use case - which is marketing sites.

  • Øyvind Østmo commented
    August 24, 2022 06:52

    Common people, please, it's such a small effort for a huge impact.

  • Dennis Cutraro commented
    August 17, 2022 06:15

    Seems like a relatively easy implementation. Do you plan on working on this issue soon?

  • JP Garza commented
    July 06, 2022 21:57

    Any news???

  • Mason Blake commented
    July 01, 2022 19:10

    I am happily switching from Wordpress to Webflow and I am very pleased. However, when it comes to things like this, I am shocked to not have an option for this. So many options, but nothing to hide a file from search engines and XML sitemaps?

    Not having this feature means this having to deal with this set of workarounds:

    1. You must enter in manual meta description tag on each page

    2. You must then override the auto-generated Sitemap XML if you wish to exclude it

    3. Once you override the Sitemap XML and make a custom one, you now lose the benefit of having CMS content (blog articles) published automatically

    4. Which means every time you publish a new article you need to go in and modify the sitemap manually


    Webflow team - please help out. This is not too difficult of an ask.

  • Load older comments
  • +269