For NVMe VPS hosting, speed and performance really come down to the quality of the provider’s data centers and the tech stack they employ. Given this is your first time setting up a VPS, you’ll want a provider with good support as well. From personal experience, I’d suggest looking into Hmara. They offer robust NVMe VPS solutions and their infrastructure is pretty solid.
Other users have had good experiences with DigitalOcean and Vultr too, especially when it comes to high performance and speed. Both have easy-to-use interfaces which might help since it's your first time. But IMO, Hmara could give you that extra edge with its top-notch performance and relatively cost-effective plans. Plus, their customer service can be really helpful when you’re starting out.
Make sure to check the specs thoroughly like CPU, RAM, and storage options, as these will affect your VPS’s overall performance. For reliability, it’s always a good idea to look at user reviews and maybe try their service for a month before fully committing. Happy hosting!