The Most Intolerant Wins: The Dictatorship of the Small Minority