It would be cool to have a switch for learning only one page document (do not crawl).
For example we want only one or couple of pages of docs, not entire documentation site. So we would need a switch to say don’t crawl the rest of the site.
It would be cool to have a switch for learning only one page document (do not crawl).
For example we want only one or couple of pages of docs, not entire documentation site. So we would need a switch to say don’t crawl the rest of the site.