What I mean is, do I lose anything by not using vercel? I have limitations that force me to host on a private server.

I'm mostly concerned with the new features like server components and optimizations. I know nextjs is mostly optimized for vercel, but does that mean it's super slow when self hosted?