The most frustrating thing in gaming that has existed since the dawn of gaming and persists to some degree today: having your inputs just totally get eaten so your character doesn't perform the action you expected when you hit the button.
From failing to jump right as you hit the edge of a cliff in Super Mario to ignoring a roll in Dark Souls, input lag/dropping is the biggest annoyance in any game of any style. Even those that timing isn't important.