"If you build that Empire, there is always that 1 person,.. That comes along and pushes you from the top."