Documentation indexing seems broken

Cant seem to index a single docsite

I tried just adding the docs url

Tried the html sitemap method

by setting https://langfuse.com as prefix and langfuse.com Site Map - Generated by www.xml-sitemaps.com as entrypoint

Tried all the variations I could think off with appending slashes and whatnot.

Also tried on the following docs as a test :

It always just processes for 1 sec then says 0 pages indexed.

Nothing in any of the Output Tabs related to any issues as this is probably done server side and no trace is coming back to us.

Is anyone able to index anything right now ?

2 Likes

Same issue here :confused:

I have also experienced document crawling not working on sites that it previously worked for and documented it here:

Currently at 0.41.3.

1 Like

Same issue here with 0.41.3. I was previously able to index https://raw.githubusercontent.com/knowsuchagency/promptic/refs/heads/main/README.md but no longer. The indexing simply doesn’t work at all. I copied and pasted the docs to pastebin in case the issue was accessing github but it also fails to fetch the page and index it.

Still not working :frowning: