I had this happen on Fedora with amd cards as well. At the time I was using riverwm which is based on wlroots. I tried a few other WMs that also used wlroots and had the same problem, so I think the issue is somehow related to wlroots but I don't know enough about it to be sure.
When I tried on KDE Plasma (Kwin) I had no issue. So you may want to try Plasma or Gnome and see if the issue persists.
ok, I haven't used hyprland so I wasn't sure. The wayland tiling WMs I tried all had the same problem so I don't know what the underlying cause is. I personally don't have performance issues on wayland plasma and I don't have an nvidia card in a linux system so I can't test it further. I hope you are able to figure it out.