Found the solution, Writing uboot.bin.sd.bin from windows did not work. Neither RZ_USB_Boot_Helper_V1.0.0, Balenaecher nor git bash.
Flashed a copy of armbian on sd card, which works flawlessly, and did the dd part as described here Install os direct to emmc with ubuntu - Zero Series - Radxa Forum