Seeing a computer able to outperform humans at all tasks on the horizon is terrifying. No longer being the apex intelligence on this planet is terrifying. Understanding that the number one use for AGI is for military purposes is terrifying. Understanding the alignment problem is terrifying. AGI is not going to be aligned with humanity because we as a society are ill prepared to create an AGI that is humanity aligned. And even if we did it is extremely difficult to prove that what we have created is in fact humanity aligned.

This is a very doom and gloom video that I don't completely agree with but it does discuss some of the main points of Situational Awareness. Will give you a bit of my perspective: https://www.youtube.com/watch?v=k_onqn68GHY