I did have a game where the warlock lost all their powers and went down to a level 0 commoner, but that lasted for something like 2 days irl and it was because my fighter killed his patron. He's a cleric now