This is one of the flaws of on chain Bitcoin that refuses to be addressed by devs. This is one of the biggest reasons Bitcoin will keep people away. People don't want to wait for confirmations when they can get their funds instantly using a different method.
Yeha, replace-by-fee involves creating a new transaction that conflicts with the original transaction and therefore is only available to the sender. The receiver can use child-pays-for-parent, though.