Add "don't index" switch to pages

Right now to prevent a page from being indexed in a Webflow site it requires this custom code in the before </head> tag of the custom code area:

<meta name="robots" content="noindex">


It would be nice to have a toggle switch within page settings for each page that would stop a page from being indexed as well as from being added to the auto generated sitemap.xml file for Webflow hosted sites.  

  • Waldo Broodryk
  • Jan 23 2017
  • Shipped
  • Marc Tiedemann commented
    6 Nov, 2023 05:00pm

    That I was allowed to experience this day...
    no, honestly: great work and very much appreciated! Thanks Webflow 🙏

  • Dnssense Roksit commented
    28 Sep, 2023 11:19am

    This is SEO 101. Please help us.

  • Globalcare commented
    19 Sep, 2023 10:59pm

    +1

  • Risingteam Admin commented
    24 Jul, 2023 02:58pm

    +1 Also needed for our purposes. Incredible that something so simple and elementary hasn't been solved yet.

  • Adrian Hill commented
    26 Jun, 2023 07:30pm

    Bumping. We frequently add new pages and manually updating a sitemap is unsustainable. Our big issue is excluding certain pages. We have added noindex tags, but don't want them showing up on the sitemap.

  • Stephen commented
    28 Mar, 2023 11:07am

    This would a very important feature for SEO to prevent Google constantly us there is errors because we've to put a no follow/no index on the pages.


    It would also be a good idea to have far better XML sitemap created that includes times and dates of when a page was last updated. As far as I know, at the moment, this would have to be done manually via a bespoke XML uploaded to Webflow.

  • Darryll Bayes commented
    24 Mar, 2023 10:57am

    I don't see why this is such a hard thing to do. There are some pages that just shouldn't be visible as part of the sitemap. For indexing and access reasons such as thank you pages. Please make this feature work as expected.

  • Jon Gross commented
    7 Mar, 2023 10:35pm

    +1 on this. For websites with hundreds of pages, manually updating the sitemap is not a sustainable solution. Please let us know what the expected timing is on this feature (or a Yoast-like plugin or integration to a 3rd party tool that will accomplish the same goal)

  • Support commented
    6 Mar, 2023 11:04am

    Please consider adding this SEO feature - it's crucial for bigger corporate sites that can't have all their pages listed on Google..

    Isn't it just adding one on/off button in the page settings?

  • Steve Canfield commented
    28 Feb, 2023 03:05pm

    Not being able to remove pages from the auto generated sitemap is extremely necessary. Please add this functionality Webflow!

  • Catalin commented
    25 Jan, 2023 01:13pm

    Make this happen, guys! This is a very basic feature that should already be implemented.

  • Reply Media commented
    17 Jan, 2023 03:33pm

    Since this is a critial SEO feature, are there any plugins to assist with this? Like the following

    https://rankmath.com/kb/how-to-noindex-urls/

    I often would love to omit marketing pages or similar from client sites

  • Robin Waite commented
    18 Oct, 2022 10:09am

    Such a basic CMS feature, I upload articles to my site daily, so it's no practical to create and upload a new sitemap every time I make an update! Just a simple toggle to remove the hidden page from the sitemap. How hard can it be!!

  • Michael Wells commented
    31 Aug, 2022 04:05am

    Totally agree, but there are multiple places to impact;

    1. META tag in the page HEAD;
      <meta name="robots" content="noindex">

    2. HTTP response header
      X-Robots-Tag: noindex

    3. sitemap.xml exclusion for the page

    4. Possibly, add noindex attributes to Links to the page


    Interestingly, the page probably should NOT be excluded from robots.txt . When a page is excluded, Google won't scan it again, which means it will never be removed from the search index either.

  • Kevin Pham commented
    30 Aug, 2022 12:55am

    The current 'Exclude this page from site search results' checkbox option should be reworded: 'Exclude this page from internal search results (Remove content from Googles index)' or similar.

  • Tim Ritzema commented
    24 Aug, 2022 05:33pm

    Need this feature for WebFlow's ideal use case - which is marketing sites.

  • Øyvind Østmo commented
    24 Aug, 2022 06:52am

    Common people, please, it's such a small effort for a huge impact.

  • Dennis Cutraro commented
    17 Aug, 2022 06:15am

    Seems like a relatively easy implementation. Do you plan on working on this issue soon?

  • JP Garza commented
    6 Jul, 2022 09:57pm

    Any news???

  • Mason Blake commented
    1 Jul, 2022 07:10pm

    I am happily switching from Wordpress to Webflow and I am very pleased. However, when it comes to things like this, I am shocked to not have an option for this. So many options, but nothing to hide a file from search engines and XML sitemaps?

    Not having this feature means this having to deal with this set of workarounds:

    1. You must enter in manual meta description tag on each page

    2. You must then override the auto-generated Sitemap XML if you wish to exclude it

    3. Once you override the Sitemap XML and make a custom one, you now lose the benefit of having CMS content (blog articles) published automatically

    4. Which means every time you publish a new article you need to go in and modify the sitemap manually


    Webflow team - please help out. This is not too difficult of an ask.

  • Load older comments
  • +269