It took some time but I got these (https://www.aliexpress.com/item/1005001685753066.html) little 1.14 displays to work with the Zero 3 so I wanted to share it here in case someone else is interested.
I have made a pull request https://github.com/radxa-pkg/radxa-overlays/pull/424 to have the overlay added to the radxa-overlays repo. All the info to get it working is in the pull request. I also made a patch for the kernel driver of the fb_st7789v to support offsets but I don’t know if it will be accepted by the kernel devs.