I’m pretty similar. I’ve started to prefer handwritten notes in recent years for the sorts of reasons you mention.

That said, I feel uncomfortable leaving my notes only on paper. I scan most of my handwritten notes (at the moment, into Evernote).