Right now to prevent a page from being indexed in a Webflow site it requires this custom code in the before </head> tag of the custom code area:
<meta name="robots" content="noindex">
It would be nice to have a toggle switch within page settings for each page that would stop a page from being indexed as well as from being added to the auto generated sitemap.xml file for Webflow hosted sites.
The pinned admin response does not appear to be helpful for collection templates. It appears to only apply to single pages.
That I was allowed to experience this day...
no, honestly: great work and very much appreciated! Thanks Webflow 🙏
This is SEO 101. Please help us.
+1
+1 Also needed for our purposes. Incredible that something so simple and elementary hasn't been solved yet.
Bumping. We frequently add new pages and manually updating a sitemap is unsustainable. Our big issue is excluding certain pages. We have added noindex tags, but don't want them showing up on the sitemap.
This would a very important feature for SEO to prevent Google constantly us there is errors because we've to put a no follow/no index on the pages.
It would also be a good idea to have far better XML sitemap created that includes times and dates of when a page was last updated. As far as I know, at the moment, this would have to be done manually via a bespoke XML uploaded to Webflow.
I don't see why this is such a hard thing to do. There are some pages that just shouldn't be visible as part of the sitemap. For indexing and access reasons such as thank you pages. Please make this feature work as expected.
+1 on this. For websites with hundreds of pages, manually updating the sitemap is not a sustainable solution. Please let us know what the expected timing is on this feature (or a Yoast-like plugin or integration to a 3rd party tool that will accomplish the same goal)
Please consider adding this SEO feature - it's crucial for bigger corporate sites that can't have all their pages listed on Google..
Isn't it just adding one on/off button in the page settings?
Not being able to remove pages from the auto generated sitemap is extremely necessary. Please add this functionality Webflow!
Make this happen, guys! This is a very basic feature that should already be implemented.
Since this is a critial SEO feature, are there any plugins to assist with this? Like the following
https://rankmath.com/kb/how-to-noindex-urls/
I often would love to omit marketing pages or similar from client sites
Such a basic CMS feature, I upload articles to my site daily, so it's no practical to create and upload a new sitemap every time I make an update! Just a simple toggle to remove the hidden page from the sitemap. How hard can it be!!
Totally agree, but there are multiple places to impact;
META tag in the page HEAD;
<meta name="robots" content="noindex">
HTTP response header
X-Robots-Tag: noindex
sitemap.xml
exclusion for the pagePossibly, add
noindex
attributes to Links to the pageInterestingly, the page probably should NOT be excluded from
robots.txt
. When a page is excluded, Google won't scan it again, which means it will never be removed from the search index either.The current 'Exclude this page from site search results' checkbox option should be reworded: 'Exclude this page from internal search results (Remove content from Googles index)' or similar.
Need this feature for WebFlow's ideal use case - which is marketing sites.
Common people, please, it's such a small effort for a huge impact.
Seems like a relatively easy implementation. Do you plan on working on this issue soon?
Any news???