By sweep your funds into an on chain address you mean close their channel with you? Yeah that's a normal part of self custody with lightning network. Your channel partner has a channel with you in hopes of profit from routing fees. Without that, they have every reason to close the channel