I am unable to build my custom Yocto OS without a GUI for my Radxa ROCK 5T.
If you can’t build it yourself, why not just use a ready-made generic one?
The only device-specific thing is the DTB.
We have Yocto layer for ROCK 5T. Please follow the repo’s README for build instruction.

