how would I know which relay to get your "contact list" from
That's a good question, haha
I was wondering how other clients do this. I can update relays in amethyst and it shows up on snort and iris. At least I think that was what I noticed.
I guess this is done with NIP-05 as you mentioned using the relays key in the response.
relayskey in the response.