Since we finally have pcie 3.0 x4 lanes (and 2.1 x1 lane), I have decided to expand my RockPi4 storage to Rock5. While I’m still waiting for a few parts, namely
Here is first tests of network&storage performance. At first I was testing speed with FIO, but it’s results always lower than diskspd or real performance, so I have choosed to use diskspd. Both U.2 NVMe drives in mdadm raid0
Also do you see interrupts being bottlenecked by cpu0 (checking /proc/interrupts afterwards and in a separate run checking while benchmarking with atop what’s going on)?
Of course testing with Helios LanTest would also be welcomed
Especially the 1st three numbers (not sequential transfer speeds) are super low and results variation (the orange triangles) is extremely high. You might want to compare with the 10GbE SMB numbers here if you want: https://github.com/openmediavault/openmediavault/issues/101#issuecomment-468270197 (made with macOS but shouldn’t matter since Microsoft should still be able to fabricate a better SMB client than Apple).
As for diskspd performance and iperf3 numbers. I was neither aware that your NIC card sits in the Key E slot nor that Explorer and diskspd numbers differed. Anyway: without knowing CLI parameters (count of parallel/asynchronous threads for example) it’s a bit pointless to compare and I’m still interested in /proc/interrupts output to get a better understanding of RK’s 5.10 BSP kernel and PCIe.
2x A4 plasticine board
7x A5 plasticine board
3x DC-DC converted 20V to 5v based on XL4015 2x PD trigger for 20V5A and 1x PD trigger for 12V3A
2x QB826 as UPS to power up all of this
1x ANM24PE16 (PLX 8748)
2x JMB585
10x Samsung 870 EVO 1tb
3x noctua fans (one for board, one for DC-DC, one for ANM24PE16)
A lot of screws M3x5
A lot of Molex–2xMolex and Molex–2xSata_power
So 1 year and 3 months later, the NAS with 10 ssd drives powered by Power delivery trigger is still working just fine.
As for kernel it’s a bit tricky, since I dont update it because of NC552SFP that is connected to the top M.2 slot.
Right now its working by using mdadm raid5 from 10ssd drives. The roles are:
SMB share for personal usage
NFS share for vcenter
Torrent node
Nextcloud server
Decentralised java based image hosting server
The only problem I met is MOLEX cables, it’s actually better to use sata power cables because so far, there were a few situations (like 4 so far) where because of molex connection the ssd (from 1 to 4 ssd) were cut off, since they were powered off.
So mdadm raid had a bit of hiccup, but --force assemble always fixed it (and fsck.ext4).
Hi There, fyi, I’m using 2x2,5gbe and smb 3.1.1 to get full 5gbe connection. It’s working wonderful with single connection - better than trunk port i used before… Best
But in my case I still have windows 7 and some other legacy stuff, so I’m gonna failover to smb2 anyway, not even taking in account that I only have csr305 and all 4 ports are taken
great to see your work! @Dante4
i was also using the hp 10gbps nic with rock 5b before as my nas setup and it’s really fast! (it gave me 7xxMB/s using [5B ram disk] <> [nvme SSD on desktop] file transfer in samba）. However, as the data in ramdisk is flashed jn each reboot and size is limited. I’ve came up with the idea of pcie bifurcation to separate two pcie3x2 slots for 10G NIC and nvme SSD in hope to get a decent 10Gbps NAS.
