[Bug FOUND] Raw dataset in the project causes the cursor AI to crash and become unusable since yesterday update

I tried using .cursorignore to ignore all files in the codebase including the raw dataset folder, but cursorAI still freezes and crashes as soon as I open the project, especially when I click into the terminal console. The dataset are image dataset like femnist. I managed to isolate the issue because I tried removing the dataset folder and it resolves the problem.

Please help, I have been working on the same directory of the project since the beginning with no problem, it was only until 15 hours ago that I started to experience this problem?

I tried removing the dataset folder which temporarily fixed the issue. But now the problem is back?

I tried adding in the .cursorignore as
“benchmark/dataset/data/
benchmark/dataset/
benchmark/dataset/**
*.jpg
*.png
*.csv
*.wav
*”
and even disable the indexing, but none of these help?

It appears that Cursor AI scans through all the files first regardless of cursorignore. So, if you have large raw datasets in the project, it will hang and crash a few seconds after opening the project with Cursor AI. The question is why was there no problem before, what changed?

I now need to move the raw dataset to a location outside of the project and use symbolic link as a workaround to point to that target location.

How big is your CSV file’s, I ask because I have one for movie data that is a few hundred mbs and it crashes any app I try to open it in, I have to use a terminal CSV parser in order to access the data due to it crashing any text editor, Large CSV files are notorious for this and you often have to use a CSV viewer, online viewer or a terminal program to interact with the raw data.