Has anyone managed to import and use a React component within an .mdx file with Next.js?

I'm trying to do the following:

import CodeTabs from "@alias/to/component"

<CodeTabs>
'''python
some code
'''

'''lua
some code
'''
</CodeTabs>

and followed configuration from this guide: https://nextjs.org/docs/app/building-your-application/configuring/mdx

But I can't quite get it to work. It seems like in nextjs, it's possible to define custom React elements for individual HTML elements (for the mdx to html conversion), but I haven't found much information about importing React components into mdx files using the App Router.