Jack1
1
Cant seem to index a single docsite
I tried just adding the docs url
Tried the html sitemap method
by setting https://langfuse.com as prefix and langfuse.com Site Map - Generated by www.xml-sitemaps.com as entrypoint
Tried all the variations I could think off with appending slashes and whatnot.
Also tried on the following docs as a test :
It always just processes for 1 sec then says 0 pages indexed.
Nothing in any of the Output Tabs related to any issues as this is probably done server side and no trace is coming back to us.
Is anyone able to index anything right now ?
2 Likes
I have also experienced document crawling not working on sites that it previously worked for and documented it here:
Currently at 0.41.3
.
1 Like
Same issue here with 0.41.3
. I was previously able to index https://raw.githubusercontent.com/knowsuchagency/promptic/refs/heads/main/README.md but no longer. The indexing simply doesn’t work at all. I copied and pasted the docs to pastebin in case the issue was accessing github but it also fails to fetch the page and index it.