Yeah, I have "wild camped" before but like you said, you need to get permission. Sometimes that's hard to do as it's hard to identify who the land owner is ahead of time.
Normally though, if you ask ahead of time, most land owners are ok with it, so long as you don't leave a trace you were there. Which I think is fair.