Is there any size limit for llms.txt indexed as Docs?

Hey, thanks for the request.

There aren’t any documented file size limits for @Docs in the official docs. But from community experience, files bigger than 50 to 60k tokens can be unstable during indexing.

Your 4 MB file, depending on what’s inside, is roughly 800k to 1.2M tokens (using ~5 characters per token). That’s a lot.

Based on this thread: Tutorial: Adding full repo context, pdfs and other docs, it’s recommended to split large files into multiple parts. This helps the system give the AI only the most relevant sections, which usually improves answer quality.

You can try:

  • Split llms.txt into several logical files (by API sections, classes, etc.)
  • Create a separate Gist for each part
  • Add them as multiple @Docs with clear names

Is indexing working right now, or are you seeing issues? If it’s indexing successfully, you can keep it as-is, but splitting it usually gives better results in practice.

On free vs paid, the file size limits don’t depend on your plan. They’re technical indexing limits.