There is now a buildroot OS available for the RockPi E.
Your repo says
# For the RockPi E (rk3328 based board) [needs more work]
I am new to buildroot but would like to help. Can you give me an idea of the kinds of things that need to be worked on?