I believe I have the same issue, indexing a large codebase (~90k files) worked two days ago, then started to fail yesterday. Symptoms are similar:
- The % goes up to ~70%
- Then it goes to ~80% before going back to 70%, basically forever
- I see in the logs a bunch of “Bad unexpected errors” (even before reaching 70%)
I also see the fileQueue.length going down, then a startSync triggers and reset it to a higher value:
2025-02-25 18:51:01.121 [info] Waiting for jobs to finish. currentIndexingJobs.length: 192 concurrentUploads.current: 192 fileQueue.length: 28928
2025-02-25 18:51:01.124 [info] Completed job successfully: b08e4698-0a58-4991-a3db-dcb382b3ec3c <path>
2025-02-25 18:51:01.124 [info] fileQueue.length: 28927
2025-02-25 18:51:01.124 [info] Waiting for jobs to finish. currentIndexingJobs.length: 192 concurrentUploads.current: 192 fileQueue.length: 28927
2025-02-25 18:51:01.127 [info] Completed job successfully: b08e4698-0a58-4991-a3db-dcb382b3ec3c <path>
2025-02-25 18:51:01.127 [info] fileQueue.length: 28926
2025-02-25 18:51:01.127 [info] Waiting for jobs to finish. currentIndexingJobs.length: 192 concurrentUploads.current: 192 fileQueue.length: 28926
2025-02-25 18:51:01.226 [info] multiCodebaseIndexingJob dispose
2025-02-25 18:51:01.226 [info] Aborting indexing job.
2025-02-25 18:51:01.227 [info] Doing a startup handshake.
2025-02-25 18:51:01.233 [info] Completed job unsuccessfully, will retry: <path>: Bad unexpected error
2025-02-25 18:51:01.233 [info] Indexing job successfully done or aborted.
2025-02-25 18:51:01.501 [error] Error Checking Connection: [unimplemented] HTTP 404
2025-02-25 18:51:01.502 [info] Creating Indexing Repo client: https://repo42.cursor.sh
2025-02-25 18:51:01.502 [info] Creating repo client with backend url: https://repo42.cursor.sh
2025-02-25 18:51:07.027 [info] Finished computing merkle tree in 5778.967999999411 ms.
2025-02-25 18:51:07.027 [info] Doing the initial handshake with hash: 44f0ed95d578c427dd6c8b587fbd8fce522d0a7a6ea9ca78b00a415db7af198f
2025-02-25 18:51:07.028 [info] Handshake start
2025-02-25 18:51:07.310 [info] Handshake timing: 281.92479100078344, response: {"status":"STATUS_SUCCESS","codebases":[{"codebaseId":"b08e4698-0a58-4991-a3db-dcb382b3ec3c","status":"STATUS_OUT_OF_SYNC"}]}
2025-02-25 18:51:07.310 [info] Handshake result: {"status":"STATUS_SUCCESS","codebases":[{"codebaseId":"b08e4698-0a58-4991-a3db-dcb382b3ec3c","status":"STATUS_OUT_OF_SYNC"}]}
2025-02-25 18:51:07.311 [info] Starting fast remote sync.
2025-02-25 18:51:07.314 [info] Total num embeddable files: 72071
2025-02-25 18:51:07.314 [info] Root hash: 44f0ed95d578c427dd6c8b587fbd8fce522d0a7a6ea9ca78b00a415db7af198f
2025-02-25 18:51:07.314 [info] In the out of sync case.
2025-02-25 18:51:07.315 [info] [startSync]: ----------------------
syncing point nextSubtree{"relativePath":".","hash":"44f0ed95d578c427dd6c8b587fbd8fce522d0a7a6ea9ca78b00a415db7af198f"}
...
2025-02-25 18:51:07.316 [info] Waiting on semaphore to be released 1
2025-02-25 18:51:18.620 [info] Waiting on semaphore to be released 20
2025-02-25 18:51:18.815 [info] Waiting on semaphore to be released 1
2025-02-25 18:51:19.055 [info] setting numJobsToGo to 35567
2025-02-25 18:51:19.057 [info] [startSync]: numJobs: 35567
2025-02-25 18:51:20.969 [info] Uploading 35567 files.
2025-02-25 18:51:20.971 [info] Total number of files to embed: 72071
2025-02-25 18:51:20.971 [info] Not aborted
2025-02-25 18:51:20.971 [info] Starting while loop.
2025-02-25 18:51:20.971 [info] fileQueue.length: 35567
2025-02-25 18:51:20.971 [info] fileQueue.length: 35566
2025-02-25 18:51:20.971 [info] fileQueue.length: 35565