Free and Open Source Software

I would let your wallet decide.

phone, text, camera, GPS, web browser, notes, email, music player

GrapheneOS and the Librem 5 can handle this. If I hadn't bought a phone at the end of 2022 I'd likely go for the Librem 5 unless a used Pixel could be acquired.

I think the only thing you will lose with GrapheneOS is tap-to-pay, if you even use that. Beyond that, if you don't install GSF or even microG on the device you're already doing a lot in terms of privacy. You have to look into whether things like Uber would work without GSF (I don't use Uber so I can't check).

Are there other hardware suggestions or setups that you like?

I was going to set up a Nextcloud server, but ended up just using Syncthing. I thought I would need that full suite of services, but it turns out my workflow just needs a few directories. I use Markor to take notes and write drafts. Before, I did editing on my phone, but now I wait until I am sat down in front of a computer. Syncthing can run on an old Raspberry Pi and requires very little upkeep.

Another suggestion is to use something like UAD to debloat most any Android phone. It is a bit of a preview of what to expect from many alternative ROMs. You need to switch to OSM and use a different calendar app and possibly a different camera app, contacts, keyboard, etc. and you'll notice very quickly that...nothing really changes except maybe battery life.