Correct, the issue is that people often get hung-up on the term Non-Aggression Principle, because "aggression" is usually used differently in conversation.