I use Linode which comes to around $25 per month with regular backups. You can get a cheaper VM as well but the one I use matches my usage so that’s what I get.
Their web interface is provides way to re-image your VM, move things about, and gives you nice usage statistics. Every so often, I get a “free” upgrade to a newer more powerful VM. They have rather good documentation on their site as to how to do system administration tasks. Their support was always friendly and actually helpful so there is that.