I have a server with about 6TB of media files on a single 8TB WD hdd.Before I ask a question I probably should provide some background.These files were on BTRFS for a few weeks but after an unrelated hardware issue and subsequent OS rebuild I accidentally trashed the disk & had to restore the files from a backup, so I decided to use that as an opportunity to try out ZFS instead. The main reason that I want to use zfs is for its ability to maintain data integrity. Before I moved to btrfs (and now zfs) I had these files on ext4 and after a drive developed a bitrot issue I had a bunch of files get silently corrupted.So, after reloading the data onto zfs things were OK for a few weeks until I noticed in the morning today that the disk was being flogged relentlessly.After a bit of poking around I found that it was being scrubbed by zfs at the blindingly fast rate of 586K/s. At that rate it will never complete!Now part of this process is me getting more familiar with ZFS so if I am misunderstanding something here please let me know but I believe that the scrub is needed for data integrity purposes because the whole dataset is stored on a single physical disk?If this is correct will the flogging problem be solved if I were to buy more disks and use some form of raidz?If so what would be the best way to solve this problem?1) Buy 2 x 4TB disks and use non-redundant striping? (cheapest) 2) Buy 3 x 4TB disks and use redundant stripe? (more expensive)3) Buy a second 8TB disk and mirror it? (most expensive)Bear in mind I don't really require the redundancy of options 2 & 3 (availability) & I am more interested in maintaining the data (integrity) without having the disk constantly flogging doing scrubs.System details:intel i3 6100T16Gb RAM8TB WD RedUbuntu 16.04 (on a separate SSD)zfs compression and dedup are turned off (they were turned on at first but I have since turned them off)Thanks for reading
Large media storage & ZFS or BTRFS
linux;ubuntu;zfs