I’ve been using Linux for almost 30 years, and I agree with you completely. There should be a plethora of tools to organize SSH hosts, but unfortunately none of them are great, or at least I’ve never particular gelled with any. I just remember the hostnames and what user I happen to use for each, and copy my keys around, because I jump around between a lot of computers.
I did use SSHwifty for a while because then I could just jump into a browser and go to a webpage with all of them. Dunno why I got away from that, it was handy.
Order of installation:
Fdroid
Aurora
Playstore… and if I get to this point, probably about 80% of the time I just don’t bother. If it needs Google Play Services, 100% no-install.