High interest payments are a good thing. The best way to show voters government spending is too high.
Interest payments to bond holders are also taxed. For every $100 of interest government treasury claws back at least $20.
Government punishes their lenders. I am not sure if foreign bond holders get taxed like American bond holders.