There is always something to add or modify, as You mentioned kernel still needs some work on mainline to get biurcation ready there.
Wha about cooling? anything acitive? Anything for hard drives?
I’m investigating if hotswap for sata is possible on my setup. I’ll have 4 big 3.5 sata drives on ROCK 5B and next 4 on backup NAS based on ROCK 3B 
And I’ll need to create my own case.
what 10G nic are You using now?
em… To my best knowledge, the current mainline kernel had no bifucation implementation through the DTS up to this moment, be it the latest 6.10 or the 6.1 SDK from Rockchip, so we had to wait and see.
The official image from Radxa was based on Bullseye, which only support OMV6, so I had manually upgraded it to Bookworm for tasting OMV7. It’s a beta version but I have no adverse experience so far. 
For the cooling, the 5x3.5 HDD case I used actually built with one 12cm case fan slot.
As I’ve mentioned in the thread, I’ve use the 12cm case fan with PWM controller module for a balance of cooling and auscutic noise.
The fan is sit at the back of the enclosure blowing air out, covering all components inside the cage, including the rock5B (only with heatsink), the two HDDs, the nvme SSD, the 10G NIC (only with heatsink), the SATA card and the power regulators for power supply (to be discussed in thread later on).
For the 10G NIC I finally used, please refer to thread 2# 
Uh lala…
You get an Armbian userland/image with 5.10 BSP kernel in Bookworm flavour: http://fi.mirror.armbian.de/dl/rock-5b/archive/
And then all you need to do is to run a modification of my initial OMV install script (part of Armbian’s build system back then to bake ready-to-use optimized OMV images for a variety of SBC): https://github.com/OpenMediaVault-Plugin-Developers/installScript
OMG I am glad to see you here tkasier!
I noted the armbian is the best way to install OMV and it was my first choice indeed.
However, since there is quite a number of modifications I need on the kernel, (NIC driver, PCIe bifurcation, ZFS).
My original plan was to use the armbian built script. (I used it for building my Nanopi Neo4 image with 2.5G NIC, but the recent pcie fix on rk3399 is failed in my case btw). However, I was only able to use the mainline kernel source, which proved failed in PCIe bifurcation. When I try to retrivie the legacy kernel source of 5.10.x through the built script, I was always having verification error for 3 times and then the built script exit itself. I spent weeks on the script again and again but each time it failed at the download part so I switched to radxa official image. I would be glad if you could take a look to see if the data got any problem? 
Your 9xSSD array NAS is impressive!
Is that you are using USB step-up converter to get 12V for the SATA power cables?
What is your power scheme and power consumption for the 9 disks setup? 
x10 actually
And no, it’s actually step-down from 20v to 5v, since I’m using zmi25000 (as UPS) to power the whole system, so the purple chip is QC trigger for 20V then it’s step down to 5V10A for all the sata
As for power consumption, hm, never actually measured it for the whole system, but the battery is enough for 9-14 hours of powering the whole system
Can it achieve full 10gb in transfer ?
I am sure HDD will be the bottleneck right ?
you may refer to the picture of the file transfer at my first post in the topic
It is 986 MB/s, back and forth are similar in speed.
As I mentioned, I got a nvme SSD alongside with 10gbps NIC
to enable PCIe bifurcation, you did it by applying patch to kernel or u-boot? if u-boot, any downloadable u-boot image or patch file(s)?
Hello Enoch Leung!
The PCIe bifurcation was actually done through modifying the dts according to the PCIe developer guide from rockchip. It would take some effort to learn the correct pins to assign for rstn in pcie from the hardware schematics.
Since I use it for NAS with 10Gbps NIC, I just modify the dts and recompile the kernel with the required modules. So there is no patches / u-boot images.
However, there should have some debs for replacing the kernel. I could try to find them out if that is what you need.
I would also try to get the kernel patched for ZFS and ksmbd for better NAS performance.
u-boot would also use dts, and I want to update u-boot anyway to make it see my SSD, which is not detected at the moment and thus not bootable on my 5B. so, it is “easier” for me to just do PCIe bifurcation when u-boot loads. besides, I want to use openfyde and would like to NOT recompile kernel, hopefully it won’t override the dts defined by u-boot when kernel loads.
may you share the part you’d changed in dts? since you are using 5B as well, it should also work for me
I am not sure if the dts part contribute to your u-boot case.
Usually the SSD case is detected or not. In some rare case, for e.g. you are using Intel Octane M20 which basically combining two storage device on the same m.2 pcb, it would require bifurcation to recognize both octane memory and ssd correctly.
For the bifurcation, of course I am happy to share!
In my case, I’ve edited
./linux/arch/arm64/boot/dts/rockchip/rk3588-rock-5b.dts
You will need to modify the following nodes:-
&pcie30phy {
rockchip,pcie30-phymode = <PHY_MODE_PCIE_NANBNB>; /* 3 modes available, x4, x2+x2, x1+x1+x1+x1*/
status = “okay”;
};
&pcie3x2 {
reset-gpios = <&gpio4 RK_PB4 GPIO_ACTIVE_HIGH>; /* check your gpio pin for prst*/
vpcie3v3-supply = <&vcc3v3_pcie30>;
rockchip,perst-inactive-ms = <1000>;
supports-clkreq;
max-link-speed = <3>; /* PCIe speed */
status = “okay”;
};
&pcie3x4 {
num-lanes = <2>; /* limit lanes for 2x+2x bifurcation*/
reset-gpios = <&gpio4 RK_PB6 GPIO_ACTIVE_HIGH>; /* check your gpio pin for prst*/
vpcie3v3-supply = <&vcc3v3_pcie30>;
rochchip,perst-inactive-ms = <1000>;
supports-clkreq;
max-link-speed = <3>;
status = “okay”;
};
For those who wana play with a 10Gbps NAS but have no access to bifurcation board, you may consider Radxa Rock 5B Plus!
I’ve recently learnt that Radxa would soon release this board with tons of updates and native dual m2 PCIe slots with bifurcation built in! 
a small update~ the apt was finally fixed - sort of… can at least do some install n update without losing zfs module
ksmbd was so built for those who wana squeeze the performance
oh btw, i managed to got some photos of the rock 5b plus! let’s take a look
Looks good,
Now let’s wait for “more competitive” pricing information 
Obviously it’s great when we need two slots and wanted to use wifi (and/or lte card). I’m also curious about ddr5 extra speed, somebody just reviewed orange pi 5 plus and failed to show that.
wow: also @tkaiser reported his insights about R5 ITX, seems that it will take some time to get anything more from DDR5
they currently had not released the image to me so I am not able to flash other system to the board.
Maybe I would build it tonight but it requires me to work on x64 linux, which I only have arm64 at the moment 
Wohooo, that looks really nice ty for posting.
Yeah, that’s two PCIe ports looks great for NIC + PCIe Switch to x4 5xSata
Now I don’t know if I should go for Rock5 ITX or Rock5B Plus for my next Nas built 
