It should be in the root of the project not in the app directory. See here:

https://nextjs.org/docs/app/building-your-application/routing/middleware