Looks like all I needed to do was ask the question in a public forum before I realized what was wrong. I disabled L3 cache under Smartpool settings. I needed to disable it for the nodepool.  Before: Cluster-1# isi storagepool nodepools view --name=s210_18tb_3.2tb-ssd_256gb                  ID: 2                Name: s210_18tb_3.2tb-ssd_256gb               Nodes: 1, 2, 3, 4   Protection Policy: +2:1              Manual: No          L3 Enabled: Yes L3 Migration Status: l3  After: Cluster-1# isi storagepool nodepools view --name=s210_18tb_3.2tb-ssd_256gb                  ID: 2                Name: s210_18tb_3.2tb-ssd_256gb               Nodes: 1, 2, 3, 4   Protection Policy: +2:1              Manual: No          L3 Enabled: No L3 Migration Status: storage
I've set a directory to use Data on SSD for its SSD strategy however when running a test workload all the disk activity still occurs on the HDDs. I'm guessing I'm missing a setting somewhere. About this cluster/node pool:  S210 node pool - 4 nodes total L3 Cache was enabled it is now disabled (same results after disabling) smartpools is NOT licensed Directory is set to Manually managed - Data on SSD.  Any thoughts on what could be wrong?
Confirm Data on SSD Strategy is working