Jump to content

Draft:IndexNow

From Wikipedia, the free encyclopedia
  • Comment: Thanks for addressing some of the concerns! I'm not an expert in this area so I will leave this for another editor to review. Thanks, Caleb Stanford (talk) 04:28, 14 July 2025 (UTC)
  • Comment: Thanks for the helpful notes, @Caleb Stanford: and @CNMall41:. I've added live online links to the cited book sources, made the text more concise, added more wikilinks, and included additional citations. The protocol is used by millions of websites across various platforms globally so I'm hoping a page will make it easier for users to understand what it is. I'm working to make the draft more accessible while continuing to evaluate sourcing in line with WP:GNG.
  • Comment: Unfortunately, the concerns are not addressed. I cannot view the book entry so not sure what it says about IndexNow. As far as this source, it is WP:CHURNALISM (see this and this). Will leave for another reviewer but do not believe this will meet notability guidelines after a quick WP:BEFORE. Also, there is content on the page that is not sourced. You will need to provide an inline citation or remove the content. CNMall41 (talk) 16:53, 3 July 2025 (UTC)
  • Comment: Thank you for your feedback on the page. 
    To address this, I have updated the references to include citations from:
    -TechRadar: A reputable general technology news publication, providing a more independent perspective on the protocol's significance.
    - Books published by major publishers like O'Reilly: These provide more in-depth, academically reviewed, and enduring information, serving as strong secondary sources for technical topics.
    - Updated Authors to show that Barry Schwartz was the reporter on a few of these sources.
    I see your point about Search Engine Land (SEL) and Search Engine Journal (SEJ) being industry-specific publications. While they are highly authoritative and primary sources for news and developments within the search engine optimization and web technology communities, particularly concerning a niche technical protocol like IndexNow, I agree that broader sourcing strengthens the page's reliability according to Wikipedia's guidelines.
    Hopefully these sources will be more useful. Crystalontheweb (talk) 11:02, 3 July 2025 (UTC)
  • Comment: I would consider something written by Barry Schwartz like this to be reliable since he is an industry expert. However, SEL and SEJ are industry publications so there needs to be something outside of those. The others are blogs or otherwise unreliable. CNMall41 (talk) 16:18, 2 July 2025 (UTC)


IndexNow
Year startedOctober 18, 2021; 3 years ago (2021-10-18)
First publishedOctober 18, 2021; 3 years ago (2021-10-18)
OrganizationMicrosoft, Yandex, Naver, Seznam.cz, Yep
AuthorsSawood Alam, Internet Archive; Martin Fiala, Seznam; Vishnevsky Gleb Yandex; Fabrice Canel Microsoft
Base standardsHTTP, JSON, URL, UTF-8
Related standardsRSS, robots.txt, Sitemaps
DomainWeb indexing, Search engine optimization
LicenseCC-BY-SA 4.0
Websitewww.indexnow.org

IndexNow is an open protocol that allows website owners to inform participating search engines directly whenever website content is created, updated, or deleted. The system was introduced by Microsoft Bing and Yandex.[1]

History

[edit]

IndexNow was launched in October 2021 as a collaboration between Microsoft Bing and Yandex[2][3]. The protocol was developed with the intention to make the web more efficient by enabling faster content discovery and minimizing server load caused by repeated web crawling.[4]

In January 2022, the Bing Webmaster team created a plugin for Wordpress.[5]

In July 2023, Naver, a prominent South Korean search engine, announced its support for the IndexNow protocol.[6]

In September 2023, Wix.com, a website builder, announced a native integration that automatically submit URL updates to IndexNow by default, as content is published on each site.[7][8][9]

Bing Webmaster Tools added dedicated "IndexNow Insights Report" to their toolset in March 2024.[10]

In May 2025, native integrations with Shopify and Amazon (company) were announced as a means to manage shopping content by including Schema.org mark up in the IndexNow feed.[11][12]

How it works

[edit]

IndexNow is an open protocol. It operates at the application layer of the OSI model, as it enables communication between web servers (or content management systems) and search engines using HTTP requests to notify about content changes.[13][14]

Traditionally, search engines rely on web crawlers to discover new URLs before indexing the webpages.[15] Crawling is not automatic and in the case of Google, it can take a few days or event a few weeks for new content to be crawled.[16] By contrast, IndexNow uses an API to notify search engines about content changes to content in order to trigger a recrawl.[17]

To implement IndexNow, a website owner must generate an API key and host it in a text file at the site's root. When content changes, the website sends a simple HTTP request to a search engine endpoint, including the URL and the API key[14][18].

For example: 

https://www.bing.com/indexnow?url=https://www.example.com/page.html&key=your-api-key

When a search engine receives an IndexNow notification, it automatically shares that information with all other search engines that support the protocol.[19][14]

Websites can send notifications for individual pages or submit lists of up to 10,000 URLs at once.[20]

Adoption and tools

[edit]
IndexNow Insights Report
IndexNow Insights Report in Bing Webmaster Tools

In July 2022, reportedly 7% of new URLs clicked on Bing Search were sourced from the IndexNow protocol.[21] As of September 2023, IndexNow was used by over 60 million websites, publishing over 1.4 billion URLs daily.[22] As of 2024, IndexNow has grown to 2.5billion submitted URLs with 17% of all clicked URLs on Bing coming from IndexNow.[10]

Search Engines

[edit]

As of 2025, several search engines support IndexNow, including:

Platforms and integrations

[edit]

Since its release, IndexNow has been integrated into various platforms and services:

Google's adoption

[edit]

In 2021, a spokesperson From Google confirmed they were "testing the potential benefits of the protocol" with regards to making "web crawling more efficient".[35]

As of 2022, Google has not officially adopted the IndexNow protocol.[36] Google instead relies on an Indexing API for content like job postings.[37]

See also

[edit]

References

[edit]
  1. ^ "IndexNow - Instantly Index your web content in Search Engines". blogs.bing.com. 2021-10-18. Retrieved 2025-06-30.
  2. ^ "IndexNow - Instantly Index your web content in Search Engines". blogs.bing.com. 2021-10-18. Retrieved 2025-06-30.
  3. ^ Schwartz, Barry (2022-01-13). "IndexNow now officially co-sharing URLs between Microsoft Bing and Yandex". Search Engine Land. Retrieved 2025-06-30.
  4. ^ Enge, Eric; Spencer, Stephan; Stricchiola, Jessie (August 30, 2023). The Art of SEO. O'Reilly Media. p. 2. ISBN 9781098102562. In October 2021, Bing and Yandex announced a new initiative called IndexNow that pings search engines directly whenever content on a site is created, modified, or deleted. The objective is to reduce the inherent delay in waiting for a search engine crawler to return to the site to discover those changes, shortening the time it takes for the search engines to understand how to find and rank new or changed content, or remove deleted content from their indexes. In addition to removing the burden of manually notifying the search engines of changes you make to your site, this will reduce the load placed on your servers by the crawlers of search engines that support IndexNow.{{cite book}}: CS1 maint: date and year (link)
  5. ^ Opiah, Abigail (2022-01-06). "Microsoft unveils new IndexNow plugin for WordPress websites". TechRadar. Retrieved 2025-07-03.
  6. ^ Schwartz, Barry (2023-07-26). "Naver, Korean search engine, now supports IndexNow". Search Engine Land. Retrieved 2025-06-30.
  7. ^ Schwartz, Barry (2023-09-21). "Wix adds IndexNow support for faster indexing". Search Engine Land. Retrieved 2025-06-30.
  8. ^ Hines, Kristi (2023-09-21). "Microsoft Bing & Wix Announce IndexNow Integration". Search Engine Journal. Retrieved 2025-06-30.
  9. ^ Schwartz, Barry (2023-09-29). "Wix Supports IndexNow". Search Engine Roundtable. Retrieved 2025-06-30.
  10. ^ a b c Schwartz, Barry (2024-03-06). "Bing Webmaster Tools IndexNow Insights & Top SEO Insights". Search Engine Roundtable. Retrieved 2025-07-09.
  11. ^ "IndexNow Drives Smarter and Faster Content Discovery". blogs.bing.com. 2025-05-19. Retrieved 2025-06-30.
  12. ^ Schwartz, Barry (2025-05-19). "IndexNow helps with faster indexing of product updates and shopping ads". Search Engine Land. Retrieved 2025-06-30.
  13. ^ "Quickly index these web pages with IndexNow". DEV Community. 2024-09-19. Retrieved 2025-07-09.
  14. ^ a b c "Documentation | IndexNow.org". www.indexnow.org. Retrieved 2025-06-30.
  15. ^ "In-Depth Guide to How Google Search Works | Google Search Central | Documentation". Google for Developers. Retrieved 2025-07-09.
  16. ^ "Ask Google to Recrawl Your Website | Google Search Central | Documentation". Google for Developers. Retrieved 2025-07-09.
  17. ^ Abigail Opiah (2022-01-06). "Microsoft unveils new IndexNow plugin for WordPress websites". TechRadar. Retrieved 2025-07-09.
  18. ^ Montti, Roger (2021-10-18). "IndexNow is a Major Change to Search Engine Indexing". Search Engine Journal. Retrieved 2025-06-30.
  19. ^ "IndexNow: Announcing Sharing of Submitted URLs". blogs.bing.com. 2022-01-13. Retrieved 2025-07-09.
  20. ^ "Documentation | IndexNow.org". www.indexnow.org. Retrieved 2025-06-30.
  21. ^ Schwartz, Barry (2022-08-12). "IndexNow attributed for 7% of all new URLs clicked on in Bing in the past month". Search Engine Land. Retrieved 2025-07-09.
  22. ^ Hines, Kristi (2023-09-21). "Microsoft Bing & Wix Announce IndexNow Integration". Search Engine Journal. Retrieved 2025-06-30.
  23. ^ a b c Schwartz, Barry (2021-10-18). "IndexNow - new initiative by Microsoft and Yandex to push content to search engines". Search Engine Land. Retrieved 2025-07-09.
  24. ^ "IndexNow 소개". searchadvisor.naver.com (in Korean). Retrieved 2025-07-09.
  25. ^ Schwartz, Barry (2023-07-26). "Naver, Korean search engine, now supports IndexNow". Search Engine Land. Retrieved 2025-07-09.
  26. ^ Schwartz, Barry (2022-08-12). "IndexNow attributed for 7% of all new URLs clicked on in Bing in the past month". Search Engine Land. Retrieved 2025-07-09.
  27. ^ "Protokol IndexNow". Nápověda Seznam.cz Vyhledávání (in Czech). Retrieved 2025-07-09.
  28. ^ Montti, Roger (2022-06-08). "Yoast On Why It's Adopting IndexNow Protocol". Search Engine Journal. Retrieved 2025-07-09.
  29. ^ Opiah, Abigail Opiah (2022-01-06). "Microsoft unveils new IndexNow plugin for WordPress websites". TechRadar. Retrieved 2025-07-03.
  30. ^ Cutler, Kelly (December 3, 2023). Search Marketing: A Strategic Approach to SEO and SEM. Kogan Page. p. 52. ISBN 9781398612815.{{cite book}}: CS1 maint: date and year (link)
  31. ^ Krivit, Alex; Das, Abhi (2021-10-18). "Crawler Hints Update: Cloudflare Supports IndexNow and Announces General Availability". The Cloudflare Blog. Retrieved 2025-07-03.
  32. ^ "IndexNow Drives Smarter and Faster Content Discovery". blogs.bing.com. 2025-05-19. Retrieved 2025-07-09.
  33. ^ Schwartz, Barry (2025-05-20). "IndexNow Now Works With Product Schema; Shopify & Soon Amazon". Search Engine Roundtable. Retrieved 2025-07-09.
  34. ^ "IndexNow Sync". Majinsoft.
  35. ^ Schwartz, Barry (2021-11-10). "Google is testing the IndexNow protocol for sustainability". Search Engine Land. Retrieved 2025-07-09.
  36. ^ Schwartz, Barry (2022-08-12). "IndexNow attributed for 7% of all new URLs clicked on in Bing in the past month". Search Engine Land. Retrieved 2025-07-09.
  37. ^ Beilharz, Felix (December 12, 2023). Online Marketing Manager in Handbuch für die Praxis (in German). O'Reilly. p. 207. ISBN 9783960108245. IndexNow/Indexing API – Die Suchmaschinen Bing und Yandex setzen neben Sitemaps zusätzlich auf das IndexNow-Protokoll, um neue Seiten schnell aufzufinden, zu crawlen und zu indexieren. Google verlsst sich hier weiterhin auf die eigenen Crawling-Ressourcen und greift lediglich bei kurzlebigen Seitentypen wie Jobpostings und Livestream-Videos auf die eigene Indexing API zurück. Diese erlaubt es nicht nur, neue Inhalte schnell zu indexieren, sondern auch URLs zuverlässig entfernen zu lassen.{{cite book}}: CS1 maint: date and year (link)
[edit]
Retrieved from "https://en.wikipedia.org/w/index.php?title=Draft:IndexNow&oldid=1300406400"