Finally created a ticket for this: #646

Thanks for reporting @Onions!

I think I'll do a bug sprint later or tomorrow morning