How to index Three.js doc?

Bug Report
1

As shown on the Feature page, I used https://threejs.org/docs/ URL as Prefix and Entrypoint to index the Three.js doc :

Capture d’écran 2024-07-29 à 16.15.23
Capture d’écran 2024-07-29 à 16.15.231092×502 21 KB

2-3s later, the indexing is shown finished and only 3 pages are indexed.

2 Likes
2

Btw, it’s an example mentionned here:

Capture d’écran 2024-08-29 à 17.27.07
Capture d’écran 2024-08-29 à 17.27.071430×1032 120 KB

3

Documentation indexing seems to be absolutely abysmal so far for any docs page. I tried several ones, some using Docusaurus and others with custom solutions and the result was always Cursor skipping pages randomly and missing crucial data.

2 Likes
4

I am having the same issue. Did you find a solution? Adding the doc with that link causes cursor to hallucinate. I tried with the links to the doc in the threejs GitHub repo, but these are maintained as individual HTML files. So I could add a link for each part is the docs but that’s not really helpful.

5

I had a look at the Three.js docs site (https://threejs.org/docs) and tried to add it to my Cursor docs and can confirm it doesn’t get the desired pages, I tried a few different variations of the prefix and entrypoint.

I am assuming it is because the syntax of the links on the Three.js docs site is not as straightforward as others.

For reference, here’s a post showing how it looks when it does work (with another docs site):

Also for reference, this topic has some interesting comments from the devs on how the crawling is actually done: