BugBot re-reviewing PRs on push despite being configured to only run once

I asked my team members to set their own Personal Preferences to Only Run Once, but the first one who tried sees nothing on the Integrations page. Is that right?