Anyone know a good documentation scraper?

Discussion
1

Cursor/(LLMs) preform a lot better with documentation in the context window.

I’ve found Cursor’s built in doc scraping to not work. Does anyone have a good doc scraper?

Gitingest is good but only handles docs in git. I’ve tried firecrawl, which has worked, but is slow and breaks for a lot of sites.

Specifically, scraping swift package index https://swiftpackageindex.com/groue/GRDB.swift/v7.4.1/documentation/grdb or apple docs would be great.

2

Use Cursor and make one, it’s pretty simple😆

3

checkout GitHub - upstash/context7: Context7 MCP Server -- Up-to-date documentation for LLMs and AI code editors

4

This is cool! It’s still limited to git. So more convenient, but not changing my workflow. Would love other doc sites like SPM.