Apologies if this is slightly off topic, but have you seen the .cursorignore feature?
See also:
https://docs.cursor.com/context/ignore-files
I’m not sure if that will have an effect in the Command Palette, but it should have in terms of what the AI component is ignoring.