Azure Container Apps would be easier as it's Dockerizing an app.
https://code.visualstudio.com/docs/containers/app-service

@tafutada777 do you have any nextjs examples of docker-compose and Dockerfile files

just google it. many examples out there like this.
https://geshan.com.np/blog/2023/01/nextjs-docker/

one caveat. you might need to make pages dynamic as Next.js executes codes when building a Docker image, meaning static pages are backed in the image, which would be problem when spinning up an instance. many people get stuck with it and asked here.

Thanks @tafutada777