XCP-NG ZFS Setup (Valid for Ubuntu, Debian, RedHat, and all othe Linux Distributions)

ZFS Setup on XCP-NG 

Other Linux package manager list is provided at the end of the article

My Recommendation: sudo yum install zfs --enablerepo=epel,base,updates
Official/Production: sudo yum install zfs
Run instead of system restart: sudo modprobe zfs

Check ZFS Version: zfs version

lsblk or fdisk -l or lsblk -o NAME,SIZE,VENDOR,MODEL

SAS
/dev/sdo                                                              8:80   0   1.1T  0 disk
/dev/sdm                                                               8:48   0   1.1T  0 disk
/dev/sdk                                                            8:128  0   1.1T  0 disk
/dev/sdq                                                               8:96   0   1.1T  0 disk
/dev/sdn                                                               8:64   0   1.1T  0 disk
/dev/sdl                                                             8:32   0   1.1T  0 disk
/dev/sdr                                                              8:144  0   1.1T  0 disk
/dev/sdp                                                               8:112  0   1.1T  0 disk


sudo zpool create -f mysaspool raidz2 /dev/sdo /dev/sdm /dev/sdk /dev/sdq raidz2 /dev/sdn /dev/sdl /dev/sdr /dev/sdp

sudo zpool status mysaspool

sudo zfs create mysaspool/mysasdataset

sudo zfs set compression=lz4 mysaspool/mysasdataset

zfs destroy mysaspool/mysaspool

sudo zfs list

_________________________________________________________________________________________

lsblk

sdf                                                               8:224  0 931.5G  0 disk
sdd                                                             8:192  0 931.5G  0 disk
sdi                                                              65:0    0 931.5G  0 disk
sdg                                                             8:208  0 931.5G  0 disk
sde                                                               8:176  0 931.5G  0 disk
sdj                                                              65:16   0 931.5G  0 disk
sdh                                                               8:240  0 931.5G  0 disk


sudo zpool create -f myssdpool raidz1 /dev/sdf /dev/sdd /dev/sdi /dev/sdg /dev/sde /dev/sdj

sudo zpool status myssdpool

sudo zfs create myssdpool/myssddataset

sudo zfs set compression=lz4 myssdpool/myssddataset

sudo zfs list

________________________________________________________________________________________
Create NVME Pool
lsblk

sudo wipefs -a /dev/nvme1n1
sudo wipefs -a /dev/nvme2n1


sudo zpool create -f mynvmepool raidz1 /dev/nvme1n1 /dev/nvme2n1
sudo zpool status mynvmepool

sudo zfs create mynvmepool/mynvmedataset

sudo zfs set compression=lz4 mynvmepool/mynvmedataset

sudo zfs list


________________________________________________________________________________________
ZFS POOL SSD/NVME ARC CACHE DRIVE

zpool status
sudo zpool add mysaspool cache /dev/nvme1n1
zpool status

CHECK PERFORMANCE: arcstat -a
ARC Summary: arc_summary
________________________________________________________________________________________
Destroy Pool
sudo zpool destroy mynvmepool

________________________________________________________________________________________
Import ZFS Pool
zpool import myssdpool

Or if pool was destroyed
zpool import -D
zpool import -D myssdpool

________________________________________________________________________________________

Repair ZFS Pool

zpool offline myssdpool sdl
lsblk
zpool replace myssdpool /dev/sdl /dev/sdp
If not empty use below command to wipe (warning all the data on that disk will be permanently removed)

fdisk -l
sudo wipefs -a /dev/sdp
sudo zpool status myssdpool


________________________________________________________________________________________


zpool iostat

zpool iostat -v
zpool iostat -v 2

2 is refresh interval

Arc stat: cat /proc/spl/kstat/zfs/arcstats

________________________________________________________________________________________

SMART DATA:
sudo smartctl -i /dev/sda

________________________________________________________________________________________

DISK BENCHMARK DIRECTLY
DD
cd myssdpool
dd if=/dev/zero of=testfile bs=1M count=51200 conv=fdatasync

dd if=testfile of=/dev/null bs=1M

FIO:
sudo yum install fio --enablerepo=epel,base,updates
cd myssdpool
fio --name=write_test --filename=testfile --rw=write --bs=1M --size=50G --numjobs=1 --iodepth=1 --runtime=60 --time_based --group_reporting

fio --name=rand_rw --filename=testfile --rw=randrw --bs=4k --size=4G --numjobs=1 --iodepth=32 --runtime=60 --time_based --group_reporting


________________________________________________________________________________________

Install netdata
yum install netdata netdata-ui -y
systemctl start netdata
systemctl enable netdata

systemctl status netdata
http://172.16.69.251:19999

firewall-cmd --add-port=19999/tcp --permanent
firewall-cmd --reload

___________________________________________

The basic package management commands for Linux include apt, yum, pacman, dnf, and zypper. These commands can be used to install, remove, update, search for, and get more information about packages. 
Commands 

Update
sudo apt upgrade for APT
sudo yum update for YUM
sudo pacman -Syu for Pacman
sudo dnf upgrade for DNF
sudo zypper update for Zypper

Install
sudo apt install [package name] for APT
sudo yum install [package name] for YUM
sudo pacman -S [package-name] for Pacman
sudo dnf install [package-name] for DNF

Remove
sudo apt remove [package name] for APT
sudo yum remove [package name] for YUM
sudo pacman -R [package-name] for Pacman
sudo dnf remove [package-name] for DNF

Search
apt search [package name] for APT
yum search [package name] for YUM
pacman -Ss [package-name] for Pacman
dnf search [package-name] for DNF