Doc sets only seem to index a single page

I have some questions about the Docs feature. I’ve tried adding a few doc sets, ie the home page. For example, adding this SDK doc (https://meilisearch-python-sdk.paulsanders.dev/) ends up with just a single file. I would have expected crawling the various pages in the sidebar.

Is that the expected behavior? If it is, how can I reference like the entirety of a site, ie following links and whatnot?

Hey,

I’ve tried to index that page and I believe I get all the pages.

Can you try re-add the document, but remove the / off the end and see if that helps?

Good find, I was able to index more than one file!

I am gettting “Indexing failed” though after some 9 pages are indexed for that site. I haven’t found anywhere with more info yet (like the Output tab).

I tested some other URLs, and they are indexing without problems, so maybe it is just something weird about that one at this point.