Plenty of errors with SATA HAT

#1

Hi,

I’ve been experimenting with different drives both in UASP and usb-storage modes and I get these errors in dmesg on my Raspberry Pi 4B 8GB. I’ve upgraded to the latest firmware and my version of ubuntu 20.04 is up to date. However everytime I scrub the array in ZFS there are checksum errors. So not only is the SATA Hat giving visible errors it is also silently failing by failing to write correctly to the drives.

[Sun Nov 15 00:23:27 2020] INFO: task z_wr_int:3421 blocked for more than 120 seconds.
[Sun Nov 15 00:23:27 2020]       Tainted: P         C OE     5.4.0-1022-raspi #25-Ubuntu
[Sun Nov 15 00:23:27 2020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Sun Nov 15 00:23:27 2020] z_wr_int        D    0  3421      2 0x00000028
[Sun Nov 15 00:23:27 2020] Call trace:
[Sun Nov 15 00:23:27 2020]  __switch_to+0x108/0x1c0
[Sun Nov 15 00:23:27 2020]  __schedule+0x328/0x828
[Sun Nov 15 00:23:27 2020]  schedule+0x4c/0xe8
[Sun Nov 15 00:23:27 2020]  io_schedule+0x24/0x90
[Sun Nov 15 00:23:27 2020]  rq_qos_wait+0x108/0x180
[Sun Nov 15 00:23:27 2020]  wbt_wait+0xbc/0xf8
[Sun Nov 15 00:23:27 2020]  __rq_qos_throttle+0x38/0x50
[Sun Nov 15 00:23:27 2020]  blk_mq_make_request+0x130/0x708
[Sun Nov 15 00:23:27 2020]  generic_make_request+0xbc/0x350
[Sun Nov 15 00:23:27 2020]  submit_bio+0x4c/0x280
[Sun Nov 15 00:23:27 2020]  vdev_submit_bio_impl+0xc/0x18 [zfs]
[Sun Nov 15 00:23:27 2020]  vdev_submit_bio+0x1c/0x30 [zfs]
[Sun Nov 15 00:23:27 2020]  __vdev_disk_physio.constprop.0+0x280/0x368 [zfs]
[Sun Nov 15 00:23:27 2020]  vdev_disk_io_start+0x88/0x330 [zfs]
[Sun Nov 15 00:23:27 2020]  zio_vdev_io_start+0xb8/0x270 [zfs]
[Sun Nov 15 00:23:27 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:23:27 2020]  vdev_queue_io_done+0x9c/0x128 [zfs]
[Sun Nov 15 00:23:27 2020]  zio_vdev_io_done+0xc8/0x1d0 [zfs]
[Sun Nov 15 00:23:27 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:23:27 2020]  taskq_thread+0x20c/0x3b0 [spl]
[Sun Nov 15 00:23:27 2020]  kthread+0x150/0x170
[Sun Nov 15 00:23:27 2020]  ret_from_fork+0x10/0x18
[Sun Nov 15 00:23:27 2020] INFO: task txg_sync:3476 blocked for more than 120 seconds.
[Sun Nov 15 00:23:27 2020]       Tainted: P         C OE     5.4.0-1022-raspi #25-Ubuntu
[Sun Nov 15 00:23:27 2020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Sun Nov 15 00:23:27 2020] txg_sync        D    0  3476      2 0x00000028
[Sun Nov 15 00:23:27 2020] Call trace:
[Sun Nov 15 00:23:27 2020]  __switch_to+0x108/0x1c0
[Sun Nov 15 00:23:27 2020]  __schedule+0x328/0x828
[Sun Nov 15 00:23:27 2020]  schedule+0x4c/0xe8
[Sun Nov 15 00:23:27 2020]  schedule_timeout+0x15c/0x368
[Sun Nov 15 00:23:27 2020]  io_schedule_timeout+0x2c/0x48
[Sun Nov 15 00:23:27 2020]  __cv_timedwait_common+0x160/0x1b0 [spl]
[Sun Nov 15 00:23:27 2020]  __cv_timedwait_io+0x40/0x50 [spl]
[Sun Nov 15 00:23:27 2020]  zio_wait+0x11c/0x220 [zfs]
[Sun Nov 15 00:23:27 2020]  dsl_pool_sync_mos+0x54/0xb8 [zfs]
[Sun Nov 15 00:23:27 2020]  dsl_pool_sync+0x3b0/0x3b8 [zfs]
[Sun Nov 15 00:23:27 2020]  spa_sync_iterate_to_convergence+0xf8/0x1f0 [zfs]
[Sun Nov 15 00:23:27 2020]  spa_sync+0x2ec/0x520 [zfs]
[Sun Nov 15 00:23:27 2020]  txg_sync_thread+0x244/0x2a0 [zfs]
[Sun Nov 15 00:23:27 2020]  thread_generic_wrapper+0x78/0xa8 [spl]
[Sun Nov 15 00:23:27 2020]  kthread+0x150/0x170
[Sun Nov 15 00:23:27 2020]  ret_from_fork+0x10/0x18
[Sun Nov 15 00:23:27 2020] INFO: task z_wr_int:2931735 blocked for more than 120 seconds.
[Sun Nov 15 00:23:27 2020]       Tainted: P         C OE     5.4.0-1022-raspi #25-Ubuntu
[Sun Nov 15 00:23:27 2020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Sun Nov 15 00:23:27 2020] z_wr_int        D    0 2931735      2 0x00000028
[Sun Nov 15 00:23:27 2020] Call trace:
[Sun Nov 15 00:23:27 2020]  __switch_to+0x108/0x1c0
[Sun Nov 15 00:23:27 2020]  __schedule+0x328/0x828
[Sun Nov 15 00:23:27 2020]  schedule+0x4c/0xe8
[Sun Nov 15 00:23:27 2020]  io_schedule+0x24/0x90
[Sun Nov 15 00:23:27 2020]  rq_qos_wait+0x108/0x180
[Sun Nov 15 00:23:27 2020]  wbt_wait+0xbc/0xf8
[Sun Nov 15 00:23:27 2020]  __rq_qos_throttle+0x38/0x50
[Sun Nov 15 00:23:27 2020]  blk_mq_make_request+0x130/0x708
[Sun Nov 15 00:23:27 2020]  generic_make_request+0xbc/0x350
[Sun Nov 15 00:23:27 2020]  submit_bio+0x4c/0x280
[Sun Nov 15 00:23:27 2020]  vdev_submit_bio_impl+0xc/0x18 [zfs]
[Sun Nov 15 00:23:27 2020]  vdev_submit_bio+0x1c/0x30 [zfs]
[Sun Nov 15 00:23:27 2020]  __vdev_disk_physio.constprop.0+0x280/0x368 [zfs]
[Sun Nov 15 00:23:27 2020]  vdev_disk_io_start+0x88/0x330 [zfs]
[Sun Nov 15 00:23:27 2020]  zio_vdev_io_start+0xb8/0x270 [zfs]
[Sun Nov 15 00:23:27 2020]  zio_nowait+0xbc/0x168 [zfs]
[Sun Nov 15 00:23:27 2020]  vdev_queue_io_done+0xf0/0x128 [zfs]
[Sun Nov 15 00:23:27 2020]  zio_vdev_io_done+0xc8/0x1d0 [zfs]
[Sun Nov 15 00:23:27 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:23:27 2020]  taskq_thread+0x20c/0x3b0 [spl]
[Sun Nov 15 00:23:27 2020]  kthread+0x150/0x170
[Sun Nov 15 00:23:27 2020]  ret_from_fork+0x10/0x18
[Sun Nov 15 00:25:28 2020] INFO: task z_wr_int:3421 blocked for more than 241 seconds.
[Sun Nov 15 00:25:28 2020]       Tainted: P         C OE     5.4.0-1022-raspi #25-Ubuntu
[Sun Nov 15 00:25:28 2020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Sun Nov 15 00:25:28 2020] z_wr_int        D    0  3421      2 0x00000028
[Sun Nov 15 00:25:28 2020] Call trace:
[Sun Nov 15 00:25:28 2020]  __switch_to+0x108/0x1c0
[Sun Nov 15 00:25:28 2020]  __schedule+0x328/0x828
[Sun Nov 15 00:25:28 2020]  schedule+0x4c/0xe8
[Sun Nov 15 00:25:28 2020]  io_schedule+0x24/0x90
[Sun Nov 15 00:25:28 2020]  rq_qos_wait+0x108/0x180
[Sun Nov 15 00:25:28 2020]  wbt_wait+0xbc/0xf8
[Sun Nov 15 00:25:28 2020]  __rq_qos_throttle+0x38/0x50
[Sun Nov 15 00:25:28 2020]  blk_mq_make_request+0x130/0x708
[Sun Nov 15 00:25:28 2020]  generic_make_request+0xbc/0x350
[Sun Nov 15 00:25:28 2020]  submit_bio+0x4c/0x280
[Sun Nov 15 00:25:28 2020]  vdev_submit_bio_impl+0xc/0x18 [zfs]
[Sun Nov 15 00:25:28 2020]  vdev_submit_bio+0x1c/0x30 [zfs]
[Sun Nov 15 00:25:28 2020]  __vdev_disk_physio.constprop.0+0x280/0x368 [zfs]
[Sun Nov 15 00:25:28 2020]  vdev_disk_io_start+0x88/0x330 [zfs]
[Sun Nov 15 00:25:28 2020]  zio_vdev_io_start+0xb8/0x270 [zfs]
[Sun Nov 15 00:25:28 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:25:28 2020]  vdev_queue_io_done+0x9c/0x128 [zfs]
[Sun Nov 15 00:25:28 2020]  zio_vdev_io_done+0xc8/0x1d0 [zfs]
[Sun Nov 15 00:25:28 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:25:28 2020]  taskq_thread+0x20c/0x3b0 [spl]
[Sun Nov 15 00:25:28 2020]  kthread+0x150/0x170
[Sun Nov 15 00:25:28 2020]  ret_from_fork+0x10/0x18
[Sun Nov 15 00:25:28 2020] INFO: task z_wr_int:2931735 blocked for more than 241 seconds.
[Sun Nov 15 00:25:28 2020]       Tainted: P         C OE     5.4.0-1022-raspi #25-Ubuntu
[Sun Nov 15 00:25:28 2020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Sun Nov 15 00:25:28 2020] z_wr_int        D    0 2931735      2 0x00000028
[Sun Nov 15 00:25:28 2020] Call trace:
[Sun Nov 15 00:25:28 2020]  __switch_to+0x108/0x1c0
[Sun Nov 15 00:25:28 2020]  __schedule+0x328/0x828
[Sun Nov 15 00:25:28 2020]  schedule+0x4c/0xe8
[Sun Nov 15 00:25:28 2020]  io_schedule+0x24/0x90
[Sun Nov 15 00:25:28 2020]  rq_qos_wait+0x108/0x180
[Sun Nov 15 00:25:28 2020]  wbt_wait+0xbc/0xf8
[Sun Nov 15 00:25:28 2020]  __rq_qos_throttle+0x38/0x50
[Sun Nov 15 00:25:28 2020]  blk_mq_make_request+0x130/0x708
[Sun Nov 15 00:25:28 2020]  generic_make_request+0xbc/0x350
[Sun Nov 15 00:25:28 2020]  submit_bio+0x4c/0x280
[Sun Nov 15 00:25:28 2020]  vdev_submit_bio_impl+0xc/0x18 [zfs]
[Sun Nov 15 00:25:28 2020]  vdev_submit_bio+0x1c/0x30 [zfs]
[Sun Nov 15 00:25:28 2020]  __vdev_disk_physio.constprop.0+0x280/0x368 [zfs]
[Sun Nov 15 00:25:28 2020]  vdev_disk_io_start+0x88/0x330 [zfs]
[Sun Nov 15 00:25:28 2020]  zio_vdev_io_start+0xb8/0x270 [zfs]
[Sun Nov 15 00:25:28 2020]  zio_nowait+0xbc/0x168 [zfs]
[Sun Nov 15 00:25:28 2020]  vdev_queue_io_done+0xf0/0x128 [zfs]
[Sun Nov 15 00:25:28 2020]  zio_vdev_io_done+0xc8/0x1d0 [zfs]
[Sun Nov 15 00:25:28 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:25:28 2020]  taskq_thread+0x20c/0x3b0 [spl]
[Sun Nov 15 00:25:28 2020]  kthread+0x150/0x170
[Sun Nov 15 00:25:28 2020]  ret_from_fork+0x10/0x18
[Sun Nov 15 00:27:29 2020] INFO: task z_wr_int:3421 blocked for more than 362 seconds.
[Sun Nov 15 00:27:29 2020]       Tainted: P         C OE     5.4.0-1022-raspi #25-Ubuntu
[Sun Nov 15 00:27:29 2020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Sun Nov 15 00:27:29 2020] z_wr_int        D    0  3421      2 0x00000028
[Sun Nov 15 00:27:29 2020] Call trace:
[Sun Nov 15 00:27:29 2020]  __switch_to+0x108/0x1c0
[Sun Nov 15 00:27:29 2020]  __schedule+0x328/0x828
[Sun Nov 15 00:27:29 2020]  schedule+0x4c/0xe8
[Sun Nov 15 00:27:29 2020]  io_schedule+0x24/0x90
[Sun Nov 15 00:27:29 2020]  rq_qos_wait+0x108/0x180
[Sun Nov 15 00:27:29 2020]  wbt_wait+0xbc/0xf8
[Sun Nov 15 00:27:29 2020]  __rq_qos_throttle+0x38/0x50
[Sun Nov 15 00:27:29 2020]  blk_mq_make_request+0x130/0x708
[Sun Nov 15 00:27:29 2020]  generic_make_request+0xbc/0x350
[Sun Nov 15 00:27:29 2020]  submit_bio+0x4c/0x280
[Sun Nov 15 00:27:29 2020]  vdev_submit_bio_impl+0xc/0x18 [zfs]
[Sun Nov 15 00:27:29 2020]  vdev_submit_bio+0x1c/0x30 [zfs]
[Sun Nov 15 00:27:29 2020]  __vdev_disk_physio.constprop.0+0x280/0x368 [zfs]
[Sun Nov 15 00:27:29 2020]  vdev_disk_io_start+0x88/0x330 [zfs]
[Sun Nov 15 00:27:29 2020]  zio_vdev_io_start+0xb8/0x270 [zfs]
[Sun Nov 15 00:27:29 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:27:29 2020]  vdev_queue_io_done+0x9c/0x128 [zfs]
[Sun Nov 15 00:27:29 2020]  zio_vdev_io_done+0xc8/0x1d0 [zfs]
[Sun Nov 15 00:27:29 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:27:29 2020]  taskq_thread+0x20c/0x3b0 [spl]
[Sun Nov 15 00:27:29 2020]  kthread+0x150/0x170
[Sun Nov 15 00:27:29 2020]  ret_from_fork+0x10/0x18
[Sun Nov 15 00:27:29 2020] INFO: task z_wr_int:2931735 blocked for more than 362 seconds.
[Sun Nov 15 00:27:29 2020]       Tainted: P         C OE     5.4.0-1022-raspi #25-Ubuntu
[Sun Nov 15 00:27:29 2020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Sun Nov 15 00:27:29 2020] z_wr_int        D    0 2931735      2 0x00000028
[Sun Nov 15 00:27:29 2020] Call trace:
[Sun Nov 15 00:27:29 2020]  __switch_to+0x108/0x1c0
[Sun Nov 15 00:27:29 2020]  __schedule+0x328/0x828
[Sun Nov 15 00:27:29 2020]  schedule+0x4c/0xe8
[Sun Nov 15 00:27:29 2020]  io_schedule+0x24/0x90
[Sun Nov 15 00:27:29 2020]  rq_qos_wait+0x108/0x180
[Sun Nov 15 00:27:29 2020]  wbt_wait+0xbc/0xf8
[Sun Nov 15 00:27:29 2020]  __rq_qos_throttle+0x38/0x50
[Sun Nov 15 00:27:29 2020]  blk_mq_make_request+0x130/0x708
[Sun Nov 15 00:27:29 2020]  generic_make_request+0xbc/0x350
[Sun Nov 15 00:27:29 2020]  submit_bio+0x4c/0x280
[Sun Nov 15 00:27:29 2020]  vdev_submit_bio_impl+0xc/0x18 [zfs]
[Sun Nov 15 00:27:29 2020]  vdev_submit_bio+0x1c/0x30 [zfs]
[Sun Nov 15 00:27:29 2020]  __vdev_disk_physio.constprop.0+0x280/0x368 [zfs]
[Sun Nov 15 00:27:29 2020]  vdev_disk_io_start+0x88/0x330 [zfs]
[Sun Nov 15 00:27:29 2020]  zio_vdev_io_start+0xb8/0x270 [zfs]
[Sun Nov 15 00:27:29 2020]  zio_nowait+0xbc/0x168 [zfs]
[Sun Nov 15 00:27:29 2020]  vdev_queue_io_done+0xf0/0x128 [zfs]
[Sun Nov 15 00:27:29 2020]  zio_vdev_io_done+0xc8/0x1d0 [zfs]
[Sun Nov 15 00:27:29 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:27:29 2020]  taskq_thread+0x20c/0x3b0 [spl]
[Sun Nov 15 00:27:29 2020]  kthread+0x150/0x170
[Sun Nov 15 00:27:29 2020]  ret_from_fork+0x10/0x18
[Sun Nov 15 00:29:29 2020] INFO: task z_wr_int:3421 blocked for more than 483 seconds.
[Sun Nov 15 00:29:29 2020]       Tainted: P         C OE     5.4.0-1022-raspi #25-Ubuntu
[Sun Nov 15 00:29:29 2020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Sun Nov 15 00:29:29 2020] z_wr_int        D    0  3421      2 0x00000028
[Sun Nov 15 00:29:29 2020] Call trace:
[Sun Nov 15 00:29:29 2020]  __switch_to+0x108/0x1c0
[Sun Nov 15 00:29:29 2020]  __schedule+0x328/0x828
[Sun Nov 15 00:29:29 2020]  schedule+0x4c/0xe8
[Sun Nov 15 00:29:29 2020]  io_schedule+0x24/0x90
[Sun Nov 15 00:29:29 2020]  rq_qos_wait+0x108/0x180
[Sun Nov 15 00:29:29 2020]  wbt_wait+0xbc/0xf8
[Sun Nov 15 00:29:29 2020]  __rq_qos_throttle+0x38/0x50
[Sun Nov 15 00:29:29 2020]  blk_mq_make_request+0x130/0x708
[Sun Nov 15 00:29:29 2020]  generic_make_request+0xbc/0x350
[Sun Nov 15 00:29:29 2020]  submit_bio+0x4c/0x280
[Sun Nov 15 00:29:29 2020]  vdev_submit_bio_impl+0xc/0x18 [zfs]
[Sun Nov 15 00:29:29 2020]  vdev_submit_bio+0x1c/0x30 [zfs]
[Sun Nov 15 00:29:29 2020]  __vdev_disk_physio.constprop.0+0x280/0x368 [zfs]
[Sun Nov 15 00:29:29 2020]  vdev_disk_io_start+0x88/0x330 [zfs]
[Sun Nov 15 00:29:29 2020]  zio_vdev_io_start+0xb8/0x270 [zfs]
[Sun Nov 15 00:29:29 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:29:29 2020]  vdev_queue_io_done+0x9c/0x128 [zfs]
[Sun Nov 15 00:29:29 2020]  zio_vdev_io_done+0xc8/0x1d0 [zfs]
[Sun Nov 15 00:29:29 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:29:29 2020]  taskq_thread+0x20c/0x3b0 [spl]
[Sun Nov 15 00:29:29 2020]  kthread+0x150/0x170
[Sun Nov 15 00:29:29 2020]  ret_from_fork+0x10/0x18
[Sun Nov 15 00:29:29 2020] INFO: task z_wr_int:2931735 blocked for more than 483 seconds.
[Sun Nov 15 00:29:29 2020]       Tainted: P         C OE     5.4.0-1022-raspi #25-Ubuntu
[Sun Nov 15 00:29:29 2020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Sun Nov 15 00:29:29 2020] z_wr_int        D    0 2931735      2 0x00000028
[Sun Nov 15 00:29:29 2020] Call trace:
[Sun Nov 15 00:29:29 2020]  __switch_to+0x108/0x1c0
[Sun Nov 15 00:29:29 2020]  __schedule+0x328/0x828
[Sun Nov 15 00:29:29 2020]  schedule+0x4c/0xe8
[Sun Nov 15 00:29:29 2020]  io_schedule+0x24/0x90
[Sun Nov 15 00:29:29 2020]  rq_qos_wait+0x108/0x180
[Sun Nov 15 00:29:29 2020]  wbt_wait+0xbc/0xf8
[Sun Nov 15 00:29:29 2020]  __rq_qos_throttle+0x38/0x50
[Sun Nov 15 00:29:29 2020]  blk_mq_make_request+0x130/0x708
[Sun Nov 15 00:29:29 2020]  generic_make_request+0xbc/0x350
[Sun Nov 15 00:29:29 2020]  submit_bio+0x4c/0x280
[Sun Nov 15 00:29:29 2020]  vdev_submit_bio_impl+0xc/0x18 [zfs]
[Sun Nov 15 00:29:29 2020]  vdev_submit_bio+0x1c/0x30 [zfs]
[Sun Nov 15 00:29:29 2020]  __vdev_disk_physio.constprop.0+0x280/0x368 [zfs]
[Sun Nov 15 00:29:29 2020]  vdev_disk_io_start+0x88/0x330 [zfs]
[Sun Nov 15 00:29:29 2020]  zio_vdev_io_start+0xb8/0x270 [zfs]
[Sun Nov 15 00:29:29 2020]  zio_nowait+0xbc/0x168 [zfs]
[Sun Nov 15 00:29:29 2020]  vdev_queue_io_done+0xf0/0x128 [zfs]
[Sun Nov 15 00:29:29 2020]  zio_vdev_io_done+0xc8/0x1d0 [zfs]
[Sun Nov 15 00:29:29 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:29:29 2020]  taskq_thread+0x20c/0x3b0 [spl]
[Sun Nov 15 00:29:29 2020]  kthread+0x150/0x170
[Sun Nov 15 00:29:29 2020]  ret_from_fork+0x10/0x18
[Sun Nov 15 00:31:30 2020] INFO: task z_wr_int:3421 blocked for more than 604 seconds.
[Sun Nov 15 00:31:30 2020]       Tainted: P         C OE     5.4.0-1022-raspi #25-Ubuntu
[Sun Nov 15 00:31:30 2020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[Sun Nov 15 00:31:30 2020] z_wr_int        D    0  3421      2 0x00000028
[Sun Nov 15 00:31:30 2020] Call trace:
[Sun Nov 15 00:31:30 2020]  __switch_to+0x108/0x1c0
[Sun Nov 15 00:31:30 2020]  __schedule+0x328/0x828
[Sun Nov 15 00:31:30 2020]  schedule+0x4c/0xe8
[Sun Nov 15 00:31:30 2020]  io_schedule+0x24/0x90
[Sun Nov 15 00:31:30 2020]  rq_qos_wait+0x108/0x180
[Sun Nov 15 00:31:30 2020]  wbt_wait+0xbc/0xf8
[Sun Nov 15 00:31:30 2020]  __rq_qos_throttle+0x38/0x50
[Sun Nov 15 00:31:30 2020]  blk_mq_make_request+0x130/0x708
[Sun Nov 15 00:31:30 2020]  generic_make_request+0xbc/0x350
[Sun Nov 15 00:31:30 2020]  submit_bio+0x4c/0x280
[Sun Nov 15 00:31:30 2020]  vdev_submit_bio_impl+0xc/0x18 [zfs]
[Sun Nov 15 00:31:30 2020]  vdev_submit_bio+0x1c/0x30 [zfs]
[Sun Nov 15 00:31:30 2020]  __vdev_disk_physio.constprop.0+0x280/0x368 [zfs]
[Sun Nov 15 00:31:30 2020]  vdev_disk_io_start+0x88/0x330 [zfs]
[Sun Nov 15 00:31:30 2020]  zio_vdev_io_start+0xb8/0x270 [zfs]
[Sun Nov 15 00:31:30 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:31:30 2020]  vdev_queue_io_done+0x9c/0x128 [zfs]
[Sun Nov 15 00:31:30 2020]  zio_vdev_io_done+0xc8/0x1d0 [zfs]
[Sun Nov 15 00:31:30 2020]  zio_execute+0xac/0x118 [zfs]
[Sun Nov 15 00:31:30 2020]  taskq_thread+0x20c/0x3b0 [spl]
[Sun Nov 15 00:31:30 2020]  kthread+0x150/0x170
[Sun Nov 15 00:31:30 2020]  ret_from_fork+0x10/0x18

And the output from ZFS:

  pool: tank
 state: ONLINE
status: One or more devices has experienced an unrecoverable error.  An
        attempt was made to correct the error.  Applications are unaffected.
action: Determine if the device needs to be replaced, and clear the errors
        using 'zpool clear' or replace the device with 'zpool replace'.
   see: http://zfsonlinux.org/msg/ZFS-8000-9P
  scan: scrub in progress since Sat Nov 14 21:24:08 2020
        3.19T scanned at 49.3M/s, 2.70T issued at 41.8M/s, 4.89T total
        2.26M repaired, 55.22% done, 0 days 15:16:18 to go
config:

        NAME        STATE     READ WRITE CKSUM
        tank        ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            sda     ONLINE       0     0    12  (repairing)
            sdb     ONLINE       0     0    17  (repairing)
            sdc     ONLINE       0     0    15  (repairing)
            sdd     ONLINE       0     0    14  (repairing)

errors: No known data errors
CPU & case Fan control
#2

ZFS on disks via USB on toy hardware, seriously?

#3

Why shouldn’t it work? It is just a computer like anything else.

#4

Its just a car like any other.

#5

Hahaha nice one, but it is still working transport. So @igorp what would you recommend for a small form factor lower power ARM system to run ZFS over four 2.5" drives?

I uploaded the cloudshell firmware which was reported to support UASP. This time I had no kernel errors on copying around 4TB of data but when I ran the ZFS Scrub plenty of checksum errors which means the conrroller is silently introducing errors.

#6

Anything that has native / PCI connected SATA. In term of Radxa, their Rockpi 4 for example. There are plenty others created around RK3399. Some around Marvel chips (which are also in entry level NAS hardware) and we never heard for (expected) problems as you are experiencing.

#7

lol :joy::joy: :joy: