What does this red dot mean in custom docs?

General
1

Does this red dot in the image on the left side of the custom doc name mean something special? I interpret it as if cursor has not yet finished indexing and will therefore change to green when it does. This doubt arose because when I click on the See Pages icon I only get the message “indexing…”.

image

2 Likes
2

i got this too for hume ai - Welcome to Hume AI — Hume API and then in just disappeared with no trace of hume at all. I did check the docs are available on and Incognito window

3

I think it stays red permanently, and the ‘see pages’ functionality is simply broken. The docs functionality is a real weak point in cursor.

And I wonder why they will only allow custom docs that go through them (eg. not allowing custom docs supplied locally)?

4

Perhaps this post can assist in understanding:

  • How the docs are crawled
  • What it looks like when the docs are successfully crawled
  • What values should be entered in the Prefix and Entrypoint fields when adding Docs to the Cursor Settings > Features > Docs area
5

But my ‘add new docs’ feature looks quite different than what your screenshots and the cursor docs show.

I just get a single text box for a URL under the label ‘add Docs’. And I’ve followed the process through and tried various things but have never seen the options you show.

I am using a perfectly ordinary, up-to-date, MacOS installation of Cursor (v0.41.3) and I’m a paid subscriber.

6

Hi @Blorf299 ,

Here are the values I used at:

Cursor Settings > Features > Docs > + Add new doc

when using 0.41.3:

// initial input field 
https://getuikit.com/docs/introduction

// prefix
https://getuikit.com/docs

// entrypoint
https://getuikit.com/docs/introduction

I am now also getting:

Indexed 0 pages

There are no logs present in Output > Window.

So seeing how these settings worked when i last tried it, I would say there is possibly a bug.

Below are screenshots of what I attempted:

Screenshot 01 - Add new doc

add_docs_p1
add_docs_p11463×563 18.6 KB

Screenshot 02 - Specify prefix and entrypoint values

add_docs_p2
add_docs_p2780×350 11.5 KB

Screenshot 03 - View indexed pages

add_docs_p3
add_docs_p31823×877 30.1 KB

7

Thanks for the helpful response @litecode.

I got it wrong, and can see now that mine is working correctly. Sorry about that. And my red dots have even turned green!

I would really like a way to prune these custom docs and remove the erroneous pages that keep coming up, but for now, I appreciate your help in just getting me sorted out!

1 Like
8

I am curious if this issue was resolved. I read through the documentation and followed @litecode examples when trying to crawl LangGraph and agency-swarm docs with no luck while at work.

9

Hi @plochner35 ,

Where I tested with these values:

// initial input field 
https://getuikit.com/docs/introduction

// prefix
https://getuikit.com/docs

// entrypoint
https://getuikit.com/docs/introduction

What values did you use?

And can you please share you system information from:

Cursor > Help > About

10

I tried adding the docs by using the @add method. I used http://langchain-ai.github.io as the prefix and Home as the entry point.
I am still on the trial but I turned on the check web when in chat, and it navigated to the web site and searched through it. However, it didn’t index. I turned that option off and ran it again and it is just a red dot with indexing… if I click the re-index it runs for a second and comes back zero pages indexed. It is the same issues as others from what I can tell. I have used the @add method as well as the settings method under features with the same results.
FYI when I told it to search the web and gave the url it was able to do that and find the answers, but it wasn’t webcrawling and indexing.

This is my system settings:
Version: 0.41.3
VSCode Version: 1.91.1
Commit: 51c8aff7cb5a89f4a0e462fbacab938bdbfaf140
Date: 2024-09-25T17:13:50.377Z
Electron: 29.4.0
ElectronBuildId: undefined
Chromium: 122.0.6261.156
Node.js: 20.9.0
V8: 12.2.281.27-electron.0
OS: Windows_NT x64 10.0.19045

11

I’m hooking up here. For a while now, I can no longer index. 0 pages are always indexed. No matter which docs I want to index or with which type, whether with @ or via settings.

Version: 0.41.3
VSCode Version: 1.91.1
Commit: 51c8aff7cb5a89f4a0e462fbacab938bdbfaf140
Date: 2024-09-25T17:13:50.377Z
Electron: 29.4.0
ElectronBuildId: undefined
Chromium: 122.0.6261.156
Node.js: 20.9.0
V8: 12.2.281.27-electron.0
OS: Darwin arm64 23.6.0