# Documentation indexing problems **URL:** \ **Category:** Bug Reports\ **Created:** [October 3, 2024, 1:01pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860 "2024-10-03T13:01:26Z")\ **Posts on this page:** 16\ **Page:** 1
**Author:** ![Jack1](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/jack1/32/5556_2.png) [@Jack1](https://forum.cursor.com/u/Jack1)\ **Post date:** [October 3, 2024, 1:01pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/1 "2024-10-03T13:01:26Z")
Cant seem to index a single docsite I tried just adding the docs url > **[Langfuse Documentation - Langfuse](https://langfuse.com/docs)** > > Langfuse is an open source LLM engineering platform. It includes observability, analytics, and experimentation features. Tried the html sitemap method > [@Adding Documentations that don't have index-page or sitemaps](https://forum.cursor.com/t/adding-documentations-that-dont-have-index-page-or-sitemaps/15171/3): > > for example, in case of example.com/xyz/abc use only example.com as prefix the HTML-XML-sitemap of example.com as the Entrypoint is that what you did? by setting [https://langfuse.com](https://langfuse.com) as prefix and [https://www.xml-sitemaps.com/download/langfuse.com-3db9835b9/sitemap.html?view=1](https://www.xml-sitemaps.com/download/langfuse.com-3db9835b9/sitemap.html?view=1) as entrypoint Tried all the variations I could think off with appending slashes and whatnot. Also tried on the following docs as a test : - [Overview | RunPod Documentation](https://docs.runpod.io/overview) - [Setup - PrimeVue](https://primevue.org/setup/) It always just processes for 1 sec then says 0 pages indexed. Nothing in any of the Output Tabs related to any issues as this is probably done server side and no trace is coming back to us. Is anyone able to index anything right now ? ---
**Author:** ![Ethras](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/ethras/32/1857_2.png) [@Ethras](https://forum.cursor.com/u/Ethras)\ **Post date:** [October 3, 2024, 1:21pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/2 "2024-10-03T13:21:02Z")
Same issue here 😕 ---
**Author:** ![litecode](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/litecode/32/2966_2.png) [@litecode](https://forum.cursor.com/u/litecode)\ **Post date:** [October 3, 2024, 2:38pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/3 "2024-10-03T14:38:17Z")
I have also experienced document crawling not working on sites that it previously worked for and documented it here: > [@What does this red dot mean in custom docs?](https://forum.cursor.com/t/what-does-this-red-dot-mean-in-custom-docs/7138/6): > > Hi @Blorf299 , Here are the values I used at: Cursor Settings \> Features \> Docs \> + Add new doc when using 0.41.3: // initial input field https://getuikit.com/docs/introduction // prefix https://getuikit.com/docs // entrypoint https://getuikit.com/docs/introduction I am now also getting: Indexed 0 pages There are no logs present in Output \> Window. So seeing how [these settings worked when i last tried it](https://forum.cursor.com/t/using-docs-in-cursor-projects-how-to-use-the-mention-feature/13538/6), I would say there is possibly a bug. Below are screenshots of what I attempte… Currently at `0.41.3`. ---
**Author:** ![knowsuchagency](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/knowsuchagency/32/7185_2.png) [@knowsuchagency](https://forum.cursor.com/u/knowsuchagency)\ **Post date:** [October 3, 2024, 5:37pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/4 "2024-10-03T17:37:34Z")
Same issue here with `0.41.3`. I was previously able to index [https://raw.githubusercontent.com/knowsuchagency/promptic/refs/heads/main/README.md](https://raw.githubusercontent.com/knowsuchagency/promptic/refs/heads/main/README.md) but no longer. The indexing simply doesn’t work at all. I copied and pasted the docs to pastebin in case the issue was accessing github but it also fails to fetch the page and index it. ---
**Author:** ![Ethras](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/ethras/32/1857_2.png) [@Ethras](https://forum.cursor.com/u/Ethras)\ **Post date:** [October 4, 2024, 8:59pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/5 "2024-10-04T20:59:15Z")
Still not working ☚ ---
**Author:** ![Butanium](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/butanium/32/12281_2.png) [@Butanium](https://forum.cursor.com/u/Butanium)\ **Post date:** [January 1, 2025, 2:26pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/6 "2025-01-01T14:26:32Z")
still broken, can’t index [pygad.readthedocs.io](http://pygad.readthedocs.io) … ---
**Author:** ![shahsarick](https://avatars.discourse-cdn.com/v4/letter/s/5f9b8f/32.png) [@shahsarick](https://forum.cursor.com/u/shahsarick)\ **Post date:** [January 15, 2025, 10:37pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/7 "2025-01-15T22:37:52Z")
This is still broken. ---
**Author:** ![danperks](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/danperks/32/19087_2.png) [@danperks](https://forum.cursor.com/u/danperks)\ **Post date:** [January 18, 2025, 9:51pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/8 "2025-01-18T21:51:41Z")
@Butanium - While it does seem like Cursor is having issues getting an up to date version of those docs, it looks like there is a cached version already saved, so you should be able to use that for now! I’ve reported this one to look into - thanks for letting us know. ![Screenshot 2025-01-18 at 21.50.26](https://us1.discourse-cdn.com/cursor1/original/3X/e/a/ea230d5ac7c9fb5b242c9fdc9be5773ed87ad633.png) @shahsarick Hey, what documents are you trying to index? ---
**Author:** ![Butanium](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/butanium/32/12281_2.png) [@Butanium](https://forum.cursor.com/u/Butanium)\ **Post date:** [January 18, 2025, 10:10pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/9 "2025-01-18T22:10:17Z")
hey thx, where can I find this saved version? ---
**Author:** ![danperks](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/danperks/32/19087_2.png) [@danperks](https://forum.cursor.com/u/danperks)\ **Post date:** [January 19, 2025, 3:38pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/10 "2025-01-19T15:38:44Z")
Hey, just adding the URL you sent should work to at least load the cache, but I was seeing `Update failed` in the UI when the scraper attempted to get a more up-to-date copy. ---
**Author:** ![shahsarick](https://avatars.discourse-cdn.com/v4/letter/s/5f9b8f/32.png) [@shahsarick](https://forum.cursor.com/u/shahsarick)\ **Post date:** [January 24, 2025, 9:15pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/11 "2025-01-24T21:15:20Z")
[web3py](https://web3py.readthedocs.io/en/stable/) ---
**Author:** ![danperks](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/danperks/32/19087_2.png) [@danperks](https://forum.cursor.com/u/danperks)\ **Post date:** [January 27, 2025, 11:17am UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/12 "2025-01-27T11:17:19Z")
Seems to be working on my end, can you try again now? ![Screenshot 2025-01-27 at 11.17.03](https://us1.discourse-cdn.com/cursor1/original/3X/1/8/186df4c1026d5972684d610ccc67328f997f81ec.png) ---
**Author:** ![DieHardV](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/diehardv/32/32221_2.png) [@DieHardV](https://forum.cursor.com/u/DieHardV)\ **Post date:** [March 3, 2025, 8:26am UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/13 "2025-03-03T08:26:06Z")
HI, i can’t index gel db(previous edge-db) docs, [https://docs.geldata.com/](https://docs.geldata.com/) cursor not index that with generated sitemap too ![image](https://us1.discourse-cdn.com/cursor1/original/3X/4/a/4a99905e6e135de9515478cae8cc6957e5c8ee16.png) ---
**Author:** ![DieHardV](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/diehardv/32/32221_2.png) [@DieHardV](https://forum.cursor.com/u/DieHardV)\ **Post date:** [March 3, 2025, 8:29am UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/14 "2025-03-03T08:29:16Z")
Maybe that’s general problem and cursor can’t index unpopular libs? ---
**Author:** ![kristo](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/kristo/32/35664_2.png) [@kristo](https://forum.cursor.com/u/kristo)\ **Post date:** [March 12, 2025, 2:03pm UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/15 "2025-03-12T14:03:48Z")
I just had the same problem @DieHardV trying to index geldata as well. I even tried the same generated sitemap as you, but am still seeing “0 pages indexed” or “1 page indexed” with just the sitemap being indexed. Did you ever find a solution to this? ---
**Author:** ![system](https://sea3.discourse-cdn.com/cursor1/user_avatar/forum.cursor.com/system/32/99069_2.png) [@system](https://forum.cursor.com/u/system)\ **Post date:** [December 21, 2025, 8:57am UTC](https://forum.cursor.com/t/documentation-indexing-problems/20860/16 "2025-12-21T08:57:45Z")
Closed on December 21, 2025, 8:57am UTC This topic was automatically closed 22 days after the last reply. New replies are no longer allowed.