Background agent setup with dual homed repos (github / azure devops)

Hey there!

I have a repo with remotes in both github and azure devops for reasons.

Background agent setup in this repo is stuck as it sees the devops remote and errors out. How can i get this to work with github remote instead? i do not see a way to manually set this or clear the current discovered azd remote repo.