LINUX – Network Throughput Tuning

General Approach

To check what setting your system is using, use ‘sysctl name’ (e.g.: ‘sysctl net.ipv4.tcp_rmem’). To change a setting use ‘sysctl -w’. To make the setting permanent add the setting to the file ‘sysctl.conf’.

cho > /etc/sysctl.conf
echo -e "\
# /etc/sysctl.conf \r
# ---------------- BEGIN ---------------- \r
# to load new settings \r
# sysctl --load /etc/sysctl.conf \r
# \r
### TCP tuning \r
# \r
# For hosts with 10G NIC optimized for network paths up to 200ms RTT, or a 40G NIC up on paths up to 50ms RTT \r
# allow testing with 512MB buffers \r
net.core.rmem_max = 536870912 \r
net.core.wmem_max = 536870912 \r
# \r
# increase Linux autotuning TCP buffer limits \r
# min, default, and max number of bytes to use  \r
# allow auto-tuning up to 128MB buffers \r
net.ipv4.tcp_rmem = 4096 87380 268435456 \
net.ipv4.tcp_wmem = 4096 65536 268435456 \r
# \r
# recommended to increase this for CentOS6 with 10G NICS or higher \r
net.core.netdev_max_backlog = 250000 \r
# \r
# don't cache ssthresh from previous connection \r
net.ipv4.tcp_no_metrics_save = 1 \r
# \r
# recommended default congestion control is htcp \r 
# test with 'sysctl net.ipv4.tcp_available_congestion_control'
net.ipv4.tcp_congestion_control = reno \r
# \r
# recommended for hosts with jumbo frames enabled \r
net.ipv4.tcp_mtu_probing = 1 \r
# \r
# recommended for CentOS7/Debian8 hosts \r
net.core.default_qdisc = fq \r
# \r
fs.inotify.max_user_watches = 100000 \r
#\r
# --------------- END ------------------" \
> /etc/sysctl.conf
cat /etc/sysctl.conf
sysctl --load /etc/sysctl.conf
sysctl -p

cho > /etc/sysctl.conf

echo -e "\

# /etc/sysctl.conf \r

# ---------------- BEGIN ---------------- \r

# to load new settings \r

# sysctl --load /etc/sysctl.conf \r

# \r

### TCP tuning \r

# \r

# For hosts with 10G NIC optimized for network paths up to 200ms RTT, or a 40G NIC up on paths up to 50ms RTT \r

# allow testing with 512MB buffers \r

net.core.rmem_max = 536870912 \r

net.core.wmem_max = 536870912 \r

# \r

# increase Linux autotuning TCP buffer limits \r

# min, default, and max number of bytes to use \r

# allow auto-tuning up to 128MB buffers \r

net.ipv4.tcp_rmem = 4096 87380 268435456 \

net.ipv4.tcp_wmem = 4096 65536 268435456 \r

# \r

# recommended to increase this for CentOS6 with 10G NICS or higher \r

net.core.netdev_max_backlog = 250000 \r

# \r

# don't cache ssthresh from previous connection \r

net.ipv4.tcp_no_metrics_save = 1 \r

# \r

# recommended default congestion control is htcp \r

# test with 'sysctl net.ipv4.tcp_available_congestion_control'

net.ipv4.tcp_congestion_control = reno \r

# \r

# recommended for hosts with jumbo frames enabled \r

net.ipv4.tcp_mtu_probing = 1 \r

# \r

# recommended for CentOS7/Debian8 hosts \r

net.core.default_qdisc = fq \r

# \r

fs.inotify.max_user_watches = 100000 \r

#\r

# --------------- END ------------------" \

> /etc/sysctl.conf

cat /etc/sysctl.conf

sysctl --load /etc/sysctl.conf

sysctl -p

CentOS – How do I safely delete old kernel versions ?

Linux

package-cleanup:

Using package-cleanup command which is a part of yum-utils package we can uninstall any number of old kernels automatically. As an example using --oldkernels --count=2 option with package-cleanup command the command will remove all unused kernel while keeping last three most recent kernel versions installed.

package-cleanup --oldkernels --count=1

1	package-cleanup --oldkernels --count=1

yum:

list installed kernels

run rpm -q kernel

1	run rpm -q kernel

remove kernels no longer needed; listed above

yum remove kernel

1	yum remove kernel

automated:

By default CentOS will keep last 5 kernels installed on your system. This behavior is defined by installonly_limit=5 line within /etc/yum.conf file. Update the /etc/yum.conf configuration file appropriately to keep desired number of old kernels on your system after update. The minimum value to be set is 2.

Example of /etc/yum.conf configuration file to keep only last two kernel versions:

[main]
cachedir=/var/cache/yum/$basearch/$releasever
keepcache=0
debuglevel=2
logfile=/var/log/yum.log
exactarch=1
obsoletes=1
gpgcheck=1
plugins=1
installonly_limit=2
bugtracker_url=http://bugs.centos.org/set_project.php?project_id=23&ref=http://bugs.centos.org/bug_report_page.php?category=yum
distroverpkg=centos-release

[main]

cachedir=/var/cache/yum/$basearch/$releasever

keepcache=0

debuglevel=2

logfile=/var/log/yum.log

exactarch=1

obsoletes=1

gpgcheck=1

plugins=1

installonly_limit=2

bugtracker_url=http://bugs.centos.org/set_project.php?project_id=23&ref=http://bugs.centos.org/bug_report_page.php?category=yum

distroverpkg=centos-release

ZFS – CENTOS Downgrade

ZFS

ZFS – Downgrade Commands for Centos:

To do the downgrade/re-install dance:

sudo yum remove zfs zfs-kmod spl spl-kmod libzfs2 libnvpair1 libuutil1 libzpool2 zfs-release
sudo yum install http://download.zfsonlinux.org/epel/zfs-release.el7_6.noarch.rpm

1 2	sudo yum remove zfs zfs-kmod spl spl-kmod libzfs2 libnvpair1 libuutil1 libzpool2 zfs-release sudo yum install http://download.zfsonlinux.org/epel/zfs-release.el7_6.noarch.rpm

nano /etc/yum.repos.d/zfs.repo
[zfs]
enabled=0

[zfs-kmod]
enabled=1

nano /etc/yum.repos.d/zfs.repo

[zfs]

enabled=0

[zfs-kmod]

enabled=1

sudo yum search zfs* --show-duplicates
sudo yum list --showduplicates zfs
sudo yum install kmod-spl-0.7.9-1.el7_5.x86_64 kmod-zfs-0.7.9-1.el7_5.x86_64

sudo yum search zfs* --show-duplicates

sudo yum list --showduplicates zfs

sudo yum install kmod-spl-0.7.9-1.el7_5.x86_64 kmod-zfs-0.7.9-1.el7_5.x86_64

2018-09-14/by wriedel

ZFS – Tuning

ZFS

ZFS tuning for SAS3 Storage Tank

####
# ZFS tuning
###
echo > /etc/modprobe.d/zfs.conf
echo -e "\
# ---------------- BEGIN ----------------  \r
# ZFS tuning for SAS3 12GE Storage Tank \r
# tank-a  Total Memory: 327680 MB
# tank-b  Total Memory: 393216 MB
# total arc size limited to 90% of free -m - factor is 1024  \r
# zfs_arc_max={{ '%d' | format(memtotal_mb*1024*1024*0.9) }} \r
options zfs zfs_arc_min=262144000000 \r
options zfs zfs_arc_max=314572800000 \r
options zfs zfs_compressed_arc_enabled=0 \r
###\r
# txg timeout \r
options zfs zfs_txg_timeout=5 \r
###\r
# disable prefetch \r
options zfs zfs_prefetch_disable=1 \r
###\r
# tune l2arc \r
# max write speed to l2arc \r
# default : 8 * 1024 * 1024 \r
# setting here : 500 * 1024 * 1024 \r
options zfs l2arc_write_max=524288000 \r
options zfs l2arc_write_boost=524288000 \r
options zfs l2arc_noprefetch=0 \r
options zfs l2arc_headroom=24 \r
###\r
# dirty pages \r
options zfs zfs_dirty_data_max_percent=40 \r
###\r
# sync zfs_vdev_* \r
# increase them so scrub/resilver is more quickly at the cost of other work \r
options zfs zfs_vdev_scrub_min_active=24 \r
options zfs zfs_vdev_scrub_max_active=64 \r
# sync write \r
options zfs zfs_vdev_sync_write_min_active=8 \r
options zfs zfs_vdev_sync_write_max_active=32 \r
# sync reads (normal) \r
options zfs zfs_vdev_sync_read_min_active=8 \r
options zfs zfs_vdev_sync_read_max_active=32 \r
# async reads : prefetcher \r
options zfs zfs_vdev_async_read_min_active=8 \r
options zfs zfs_vdev_async_read_max_active=32 \r
# async write : bulk writes \r
options zfs zfs_vdev_async_write_min_active=8 \r
options zfs zfs_vdev_async_write_max_active=32 \r
###\r
# scrub \r
options zfs zfs_top_maxinflight=320 \r
options zfs zfs_resilver_delay=0 \r
options zfs zfs_scrub_delay=0 \r
options zfs zfs_resilver_min_time_ms=5000 \r
###\r
# scheduler \r
options zfs zfs_vdev_scheduler=deadline \r
###\r
# cpu limits \r
options zfs zio_taskq_batch_pct=85 \r
options zfs zfs_sync_taskq_batch_pct=85 \r
###\r
# history \r
options zfs zfs_read_history=100 \r
options zfs zfs_read_history_hits=100 \r
options zfs zfs_txg_history=10 \r
###\r
# other tuning\r
options zfs zfs_nocacheflush=1 \r
###\r
# --------------- END ------------------" \
> /etc/modprobe.d/zfs.conf
cat /etc/modprobe.d/zfs.conf
/sbin/modprobe zfs

cat /proc/spl/kstat/zfs/arcstats

####

# ZFS tuning

###

echo > /etc/modprobe.d/zfs.conf

echo -e "\

# ---------------- BEGIN ---------------- \r

# ZFS tuning for SAS3 12GE Storage Tank \r

# tank-a Total Memory: 327680 MB

# tank-b Total Memory: 393216 MB

# total arc size limited to 90% of free -m - factor is 1024 \r

# zfs_arc_max={{ '%d' | format(memtotal_mb*1024*1024*0.9) }} \r

options zfs zfs_arc_min=262144000000 \r

options zfs zfs_arc_max=314572800000 \r

options zfs zfs_compressed_arc_enabled=0 \r

###\r

# txg timeout \r

options zfs zfs_txg_timeout=5 \r

###\r

# disable prefetch \r

options zfs zfs_prefetch_disable=1 \r

###\r

# tune l2arc \r

# max write speed to l2arc \r

# default : 8 * 1024 * 1024 \r

# setting here : 500 * 1024 * 1024 \r

options zfs l2arc_write_max=524288000 \r

options zfs l2arc_write_boost=524288000 \r

options zfs l2arc_noprefetch=0 \r

options zfs l2arc_headroom=24 \r

###\r

# dirty pages \r

options zfs zfs_dirty_data_max_percent=40 \r

###\r

# sync zfs_vdev_* \r

# increase them so scrub/resilver is more quickly at the cost of other work \r

options zfs zfs_vdev_scrub_min_active=24 \r

options zfs zfs_vdev_scrub_max_active=64 \r

# sync write \r

options zfs zfs_vdev_sync_write_min_active=8 \r

options zfs zfs_vdev_sync_write_max_active=32 \r

# sync reads (normal) \r

options zfs zfs_vdev_sync_read_min_active=8 \r

options zfs zfs_vdev_sync_read_max_active=32 \r

# async reads : prefetcher \r

options zfs zfs_vdev_async_read_min_active=8 \r

options zfs zfs_vdev_async_read_max_active=32 \r

# async write : bulk writes \r

options zfs zfs_vdev_async_write_min_active=8 \r

options zfs zfs_vdev_async_write_max_active=32 \r

###\r

# scrub \r

options zfs zfs_top_maxinflight=320 \r

options zfs zfs_resilver_delay=0 \r

options zfs zfs_scrub_delay=0 \r

options zfs zfs_resilver_min_time_ms=5000 \r

###\r

# scheduler \r

options zfs zfs_vdev_scheduler=deadline \r

###\r

# cpu limits \r

options zfs zio_taskq_batch_pct=85 \r

options zfs zfs_sync_taskq_batch_pct=85 \r

###\r

# history \r

options zfs zfs_read_history=100 \r

options zfs zfs_read_history_hits=100 \r

options zfs zfs_txg_history=10 \r

###\r

# other tuning\r

options zfs zfs_nocacheflush=1 \r

###\r

# --------------- END ------------------" \

> /etc/modprobe.d/zfs.conf

cat /etc/modprobe.d/zfs.conf

/sbin/modprobe zfs

cat /proc/spl/kstat/zfs/arcstats

ZFS tuning for SAS3 ALL SSD + nVME Storage Tank

####
# ZFS tuning
# https://www.svennd.be/tuning-of-zfs-module/
###
echo > /etc/modprobe.d/zfs.conf
echo -e "\
# ---------------- BEGIN ----------------  \r
# ZFS tuning for SAS3 ALL SSD + nVME Storage Tank \r
# total arc size limited to 90% of free -m - factor is 1024  \r
# zfs_arc_max={{ '%d' | format(memtotal_mb*1024*1024*0.9) }} \r
options zfs zfs_arc_min=262144000000 \r
options zfs zfs_arc_max=283115520000 \r
options zfs zfs_compressed_arc_enabled=0 \r
###\r
# txg timeout \r
options zfs zfs_txg_timeout=5 \r
###\r
# disable prefetch \r
options zfs zfs_prefetch_disable=1 \r
###\r
# tune l2arc \r
# max write speed to l2arc \r
# default : 8 * 1024 * 1024 \r
# setting here : 500 * 1024 * 1024 \r
options zfs l2arc_write_max=524288000 \r
options zfs l2arc_write_boost=524288000 \r
options zfs l2arc_noprefetch=0 \r
options zfs l2arc_headroom=24 \r
###\r
# dirty pages \r
options zfs zfs_dirty_data_max_percent=40 \r
###\r
# sync zfs_vdev_* \r
# increase them so scrub/resilver is more quickly at the cost of other work \r
options zfs zfs_vdev_scrub_min_active=24 \r
options zfs zfs_vdev_scrub_max_active=64 \r
# sync write \r
options zfs zfs_vdev_sync_write_min_active=8 \r
options zfs zfs_vdev_sync_write_max_active=32 \r
# sync reads (normal) \r
options zfs zfs_vdev_sync_read_min_active=8 \r
options zfs zfs_vdev_sync_read_max_active=32 \r
# async reads : prefetcher \r
options zfs zfs_vdev_async_read_min_active=8 \r
options zfs zfs_vdev_async_read_max_active=32 \r
# async write : bulk writes \r
options zfs zfs_vdev_async_write_min_active=8 \r
options zfs zfs_vdev_async_write_max_active=32 \r
###\r
# scrub \r
options zfs zfs_top_maxinflight=320 \r
options zfs zfs_resilver_delay=0 \r
options zfs zfs_scrub_delay=0 \r
options zfs zfs_resilver_min_time_ms=5000 \r
###\r
# scheduler \r
options zfs zfs_vdev_scheduler=deadline \r
###\r
# cpu limits \r
options zfs zio_taskq_batch_pct=85 \r
options zfs zfs_sync_taskq_batch_pct=85 \r
###\r
# history \r
options zfs zfs_read_history=100 \r
options zfs zfs_read_history_hits=100 \r
options zfs zfs_txg_history=10 \r
###\r
# other tuning\r
options zfs zfs_nocacheflush=1 \r
###\r
# --------------- END ------------------" \
> /etc/modprobe.d/zfs.conf
cat /etc/modprobe.d/zfs.conf
/sbin/modprobe zfs

cat /proc/spl/kstat/zfs/arcstats

####

# ZFS tuning

# https://www.svennd.be/tuning-of-zfs-module/

###

echo > /etc/modprobe.d/zfs.conf

echo -e "\

# ---------------- BEGIN ---------------- \r

# ZFS tuning for SAS3 ALL SSD + nVME Storage Tank \r

# total arc size limited to 90% of free -m - factor is 1024 \r

# zfs_arc_max={{ '%d' | format(memtotal_mb*1024*1024*0.9) }} \r

options zfs zfs_arc_min=262144000000 \r

options zfs zfs_arc_max=283115520000 \r

options zfs zfs_compressed_arc_enabled=0 \r

###\r

# txg timeout \r

options zfs zfs_txg_timeout=5 \r

###\r

# disable prefetch \r

options zfs zfs_prefetch_disable=1 \r

###\r

# tune l2arc \r

# max write speed to l2arc \r

# default : 8 * 1024 * 1024 \r

# setting here : 500 * 1024 * 1024 \r

options zfs l2arc_write_max=524288000 \r

options zfs l2arc_write_boost=524288000 \r

options zfs l2arc_noprefetch=0 \r

options zfs l2arc_headroom=24 \r

###\r

# dirty pages \r

options zfs zfs_dirty_data_max_percent=40 \r

###\r

# sync zfs_vdev_* \r

# increase them so scrub/resilver is more quickly at the cost of other work \r

options zfs zfs_vdev_scrub_min_active=24 \r

options zfs zfs_vdev_scrub_max_active=64 \r

# sync write \r

options zfs zfs_vdev_sync_write_min_active=8 \r

options zfs zfs_vdev_sync_write_max_active=32 \r

# sync reads (normal) \r

options zfs zfs_vdev_sync_read_min_active=8 \r

options zfs zfs_vdev_sync_read_max_active=32 \r

# async reads : prefetcher \r

options zfs zfs_vdev_async_read_min_active=8 \r

options zfs zfs_vdev_async_read_max_active=32 \r

# async write : bulk writes \r

options zfs zfs_vdev_async_write_min_active=8 \r

options zfs zfs_vdev_async_write_max_active=32 \r

###\r

# scrub \r

options zfs zfs_top_maxinflight=320 \r

options zfs zfs_resilver_delay=0 \r

options zfs zfs_scrub_delay=0 \r

options zfs zfs_resilver_min_time_ms=5000 \r

###\r

# scheduler \r

options zfs zfs_vdev_scheduler=deadline \r

###\r

# cpu limits \r

options zfs zio_taskq_batch_pct=85 \r

options zfs zfs_sync_taskq_batch_pct=85 \r

###\r

# history \r

options zfs zfs_read_history=100 \r

options zfs zfs_read_history_hits=100 \r

options zfs zfs_txg_history=10 \r

###\r

# other tuning\r

options zfs zfs_nocacheflush=1 \r

###\r

# --------------- END ------------------" \

> /etc/modprobe.d/zfs.conf

cat /etc/modprobe.d/zfs.conf

/sbin/modprobe zfs

cat /proc/spl/kstat/zfs/arcstats

Some more good advice:

SvennD

ZFS-Discuss

2018-09-13/by wriedel

ZFS – SNMP

ZFS

ZFS – SNMP Extend Commands:

#Zpool Usage
extend .1.3.6.1.4.1.2021.88 zpool_name /bin/bash -c "sudo zpool list -H -o name"
extend .1.3.6.1.4.1.2021.88 zpool_snap /bin/bash -c "sudo zpool list -Ho name|for strzpool in `xargs`;do sudo zfs get -rHp -o value usedbysnapshots $strzpool|awk -F: '{sum+=$1} END{print sum}';done"
extend .1.3.6.1.4.1.2021.88 zpool_used /bin/bash -c "sudo zpool list -Ho name|xargs sudo zfs get -Hp -o value used"
extend .1.3.6.1.4.1.2021.88 zpool_data_used /bin/bash -c "sudo zpool list -Ho name|for strzpool in `xargs`;do snap=`sudo zfs get -rHp -o value usedbysnapshots $strzpool|awk -F: '{sum+=$1} END{print sum}'`;pool=`sudo zfs get -Hp -o value used $zpool`; echo $pool $snap|awk '{print (\$1-\$2);}';done"
extend .1.3.6.1.4.1.2021.88 zpool_available /bin/bash -c "sudo zpool list -Ho name|xargs sudo zfs get -Hp -o value available"
extend .1.3.6.1.4.1.2021.88 zpool_capacity /bin/bash -c "sudo zpool list -H -o capacity"

#ARC Usage
extend .1.3.6.1.4.1.2021.85 arc_meta_max /bin/bash -c "sudo grep arc_meta_max /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"
extend .1.3.6.1.4.1.2021.85 arc_meta_used /bin/bash -c "sudo grep arc_meta_used /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"
extend .1.3.6.1.4.1.2021.85 arc_size /bin/bash -c "sudo grep -m 1 size /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"
extend .1.3.6.1.4.1.2021.85 arc_meta_limit /bin/bash -c "sudo grep arc_meta_limit /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"
extend .1.3.6.1.4.1.2021.85 arc_meta_c_max /bin/bash -c "sudo grep c_max /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

#ARC Stats
extend .1.3.6.1.4.1.2021.89 arc_hits /bin/bash -c "sudo grep -m 1 hits /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"
extend .1.3.6.1.4.1.2021.89 arc_misses /bin/bash -c "sudo grep misses /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

#L2ARC Stats
extend .1.3.6.1.4.1.2021.89 arc_l2_hits /bin/bash -c "sudo grep l2_hits /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"
extend .1.3.6.1.4.1.2021.89 arc_l2_misses /bin/bash -c "sudo grep l2_misses /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

#VFS IOPS
extend .1.3.6.1.4.1.2021.90 vopstats_zfs_nread /bin/bash -c "humnum=$(sudo zpool iostat | tail -n 1 | awk -F' ' '{print $4}') ; case ${humnum: -1:1} in [0-9]) echo $humnum | tr -d ' ' ;; 'K') bc -p ${humnum: 0:-1}*1024**1 | tr -d ' ' ;; 'M') bc -p ${humnum: 0:-1}*1024**2 | tr -d ' ' ;; 'G') bc -p ${humnum: 0:-1}*1024**3 | tr -d ' ' ;; 'T') bc -p ${humnum: 0:-1}*1024**4 | tr -d ' ' ;; 'P') bc -p ${humnum: 0:-1}*1024**5 ;; esac"
extend .1.3.6.1.4.1.2021.90 vopstats_zfs_nwrite /bin/bash -c "humnum=$(sudo zpool iostat | tail -n 1 | awk -F' ' '{print $5}') ; case ${humnum: -1:1} in [0-9]) echo $humnum | tr -d ' ' ;; 'K') bc -p ${humnum: 0:-1}*1024**1 | tr -d ' ' ;; 'M') bc -p ${humnum: 0:-1}*1024**2 | tr -d ' ' ;; 'G') bc -p ${humnum: 0:-1}*1024**3 | tr -d ' ' ;; 'T') bc -p ${humnum: 0:-1}*1024**4 | tr -d ' ' ;; 'P') bc -p ${humnum: 0:-1}*1024**5 ;; esac"

#VFS Throughput
extend .1.3.6.1.4.1.2021.90 vopstats_zfs_read_bytes /bin/bash -c "humnum=$(sudo zpool iostat | tail -n 1 | awk -F' ' '{print $6}') ; case ${humnum: -1:1} in [0-9]) echo $humnum | tr -d ' ' ;; 'K') bc -p ${humnum: 0:-1}*1024**1 | tr -d ' ' ;; 'M') bc -p ${humnum: 0:-1}*1024**2 | tr -d ' ' ;; 'G') calc -p ${humnum: 0:-1}*1024**3 | tr -d ' ' ;; 'T') calc -p ${humnum: 0:-1}*1024**4 | tr -d ' ' ;; 'P') calc -p ${humnum: 0:-1}*1024**5 ;; esac"
extend .1.3.6.1.4.1.2021.90 vopstats_zfs_write_bytes /bin/bash -c "humnum=$(sudo zpool iostat | tail -n 1 | awk -F' ' '{print $7}') ; case ${humnum: -1:1} in [0-9]) echo $humnum | tr -d ' ' ;; 'K') bc -p ${humnum: 0:-1}*1024**1 | tr -d ' ' ;; 'M') bc -p ${humnum: 0:-1}*1024**2 | tr -d ' ' ;; 'G') bc -p ${humnum: 0:-1}*1024**3 | tr -d ' ' ;; 'T') bc -p ${humnum: 0:-1}*1024**4 | tr -d ' ' ;; 'P') bc -p ${humnum: 0:-1}*1024**5 ;; esac"

#DeDupe Ratio
extend .1.3.6.1.4.1.2021.91 zfs_dedup_ratio /bin/bash -c "zpool list | grep vol | cut -d \" \" -f 13 | tr -cd '[:digit:]'"

#Zpool Usage

extend .1.3.6.1.4.1.2021.88 zpool_name /bin/bash -c "sudo zpool list -H -o name"

extend .1.3.6.1.4.1.2021.88 zpool_snap /bin/bash -c "sudo zpool list -Ho name|for strzpool in `xargs`;do sudo zfs get -rHp -o value usedbysnapshots $strzpool|awk -F: '{sum+=$1} END{print sum}';done"

extend .1.3.6.1.4.1.2021.88 zpool_used /bin/bash -c "sudo zpool list -Ho name|xargs sudo zfs get -Hp -o value used"

extend .1.3.6.1.4.1.2021.88 zpool_data_used /bin/bash -c "sudo zpool list -Ho name|for strzpool in `xargs`;do snap=`sudo zfs get -rHp -o value usedbysnapshots $strzpool|awk -F: '{sum+=$1} END{print sum}'`;pool=`sudo zfs get -Hp -o value used $zpool`; echo $pool $snap|awk '{print (\$1-\$2);}';done"

extend .1.3.6.1.4.1.2021.88 zpool_available /bin/bash -c "sudo zpool list -Ho name|xargs sudo zfs get -Hp -o value available"

extend .1.3.6.1.4.1.2021.88 zpool_capacity /bin/bash -c "sudo zpool list -H -o capacity"

#ARC Usage

extend .1.3.6.1.4.1.2021.85 arc_meta_max /bin/bash -c "sudo grep arc_meta_max /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

extend .1.3.6.1.4.1.2021.85 arc_meta_used /bin/bash -c "sudo grep arc_meta_used /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

extend .1.3.6.1.4.1.2021.85 arc_size /bin/bash -c "sudo grep -m 1 size /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

extend .1.3.6.1.4.1.2021.85 arc_meta_limit /bin/bash -c "sudo grep arc_meta_limit /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

extend .1.3.6.1.4.1.2021.85 arc_meta_c_max /bin/bash -c "sudo grep c_max /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

#ARC Stats

extend .1.3.6.1.4.1.2021.89 arc_hits /bin/bash -c "sudo grep -m 1 hits /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

extend .1.3.6.1.4.1.2021.89 arc_misses /bin/bash -c "sudo grep misses /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

#L2ARC Stats

extend .1.3.6.1.4.1.2021.89 arc_l2_hits /bin/bash -c "sudo grep l2_hits /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

extend .1.3.6.1.4.1.2021.89 arc_l2_misses /bin/bash -c "sudo grep l2_misses /proc/spl/kstat/zfs/arcstats |awk -F' ' '{print $(NF)}'"

#VFS IOPS

extend .1.3.6.1.4.1.2021.90 vopstats_zfs_nread /bin/bash -c "humnum=$(sudo zpool iostat | tail -n 1 | awk -F' ' '{print $4}') ; case ${humnum: -1:1} in [0-9]) echo $humnum | tr -d ' ' ;; 'K') bc -p ${humnum: 0:-1}*1024**1 | tr -d ' ' ;; 'M') bc -p ${humnum: 0:-1}*1024**2 | tr -d ' ' ;; 'G') bc -p ${humnum: 0:-1}*1024**3 | tr -d ' ' ;; 'T') bc -p ${humnum: 0:-1}*1024**4 | tr -d ' ' ;; 'P') bc -p ${humnum: 0:-1}*1024**5 ;; esac"

extend .1.3.6.1.4.1.2021.90 vopstats_zfs_nwrite /bin/bash -c "humnum=$(sudo zpool iostat | tail -n 1 | awk -F' ' '{print $5}') ; case ${humnum: -1:1} in [0-9]) echo $humnum | tr -d ' ' ;; 'K') bc -p ${humnum: 0:-1}*1024**1 | tr -d ' ' ;; 'M') bc -p ${humnum: 0:-1}*1024**2 | tr -d ' ' ;; 'G') bc -p ${humnum: 0:-1}*1024**3 | tr -d ' ' ;; 'T') bc -p ${humnum: 0:-1}*1024**4 | tr -d ' ' ;; 'P') bc -p ${humnum: 0:-1}*1024**5 ;; esac"

#VFS Throughput

extend .1.3.6.1.4.1.2021.90 vopstats_zfs_read_bytes /bin/bash -c "humnum=$(sudo zpool iostat | tail -n 1 | awk -F' ' '{print $6}') ; case ${humnum: -1:1} in [0-9]) echo $humnum | tr -d ' ' ;; 'K') bc -p ${humnum: 0:-1}*1024**1 | tr -d ' ' ;; 'M') bc -p ${humnum: 0:-1}*1024**2 | tr -d ' ' ;; 'G') calc -p ${humnum: 0:-1}*1024**3 | tr -d ' ' ;; 'T') calc -p ${humnum: 0:-1}*1024**4 | tr -d ' ' ;; 'P') calc -p ${humnum: 0:-1}*1024**5 ;; esac"

extend .1.3.6.1.4.1.2021.90 vopstats_zfs_write_bytes /bin/bash -c "humnum=$(sudo zpool iostat | tail -n 1 | awk -F' ' '{print $7}') ; case ${humnum: -1:1} in [0-9]) echo $humnum | tr -d ' ' ;; 'K') bc -p ${humnum: 0:-1}*1024**1 | tr -d ' ' ;; 'M') bc -p ${humnum: 0:-1}*1024**2 | tr -d ' ' ;; 'G') bc -p ${humnum: 0:-1}*1024**3 | tr -d ' ' ;; 'T') bc -p ${humnum: 0:-1}*1024**4 | tr -d ' ' ;; 'P') bc -p ${humnum: 0:-1}*1024**5 ;; esac"

#DeDupe Ratio

extend .1.3.6.1.4.1.2021.91 zfs_dedup_ratio /bin/bash -c "zpool list | grep vol | cut -d \" \" -f 13 | tr -cd '[:digit:]'"

LibreNMS:
https://community.librenms.org/t/zfs-support/1839

https://docs.librenms.org/#Extensions/Applications/#zfs

2018-09-12/by wriedel

CentOS – NIC Teaming with LACP

Linux

A Comparison of Features in Bonding and Team

Feature	Bonding	Team
broadcast Tx policy	Yes	Yes
round-robin Tx policy	Yes	Yes
active-backup Tx policy	Yes	Yes
LACP (802.3ad) support	Yes (active only)	Yes
Hash-based Tx policy	Yes	Yes
User can set hash function	No	Yes
Tx load-balancing support (TLB)	Yes	Yes
LACP hash port select	Yes	Yes
load-balancing for LACP support	No	Yes
Ethtool link monitoring	Yes	Yes
ARP link monitoring	Yes	Yes
NS/NA (IPv6) link monitoring	No	Yes
ports up/down delays	Yes	Yes
port priorities and stickiness (“primary” option enhancement)	No	Yes
separate per-port link monitoring setup	No	Yes
multiple link monitoring setup	Limited	Yes
lockless Tx/Rx path	No (rwlock)	Yes (RCU)
VLAN support	Yes	Yes
user-space runtime control	Limited	Full
Logic in user-space	No	Yes
Extensibility	Hard	Easy
Modular design	No	Yes
Performance overhead	Low	Very Low
D-Bus interface	No	Yes
multiple device stacking	Yes	Yes
zero config using LLDP	No	(in planning)
NetworkManager support	Yes	Yes

Config Snippets:

CentOS 7
No NetworkManager

NEXUS vPC Switch A:

!
interface port-channel223
  description LACP: to nas-a
  switchport access vlan 161
  spanning-tree port type edge
  logging event port link-status
  logging event port trunk-status
  bandwidth 80000000
  vpc 223
!
interface Ethernet2/3
  description NAS: nas-a UCS-C240M4-A-A
  no lldp transmit
  no lldp receive
  switchport access vlan 161
  spanning-tree port type edge
  logging event port link-status
  logging event port trunk-status
  channel-group 223 mode active
!

interface port-channel223

description LACP: to nas-a

switchport access vlan 161

spanning-tree port type edge

logging event port link-status

logging event port trunk-status

bandwidth 80000000

vpc 223

interface Ethernet2/3

description NAS: nas-a UCS-C240M4-A-A

no lldp transmit

no lldp receive

switchport access vlan 161

spanning-tree port type edge

logging event port link-status

logging event port trunk-status

channel-group 223 mode active

!
interface port-channel224
  description LACP: to nas-b
  switchport access vlan 162
  spanning-tree port type edge
  logging event port link-status
  logging event port trunk-status
  bandwidth 80000000
  vpc 224
!
interface Ethernet2/4
  description NAS: nas-b UCS-C240M4-B-A
  no lldp transmit
  no lldp receive
  switchport access vlan 162
  spanning-tree port type edge
  logging event port link-status
  logging event port trunk-status
  channel-group 224 mode active
!

interface port-channel224

description LACP: to nas-b

switchport access vlan 162

spanning-tree port type edge

logging event port link-status

logging event port trunk-status

bandwidth 80000000

vpc 224

interface Ethernet2/4

description NAS: nas-b UCS-C240M4-B-A

no lldp transmit

no lldp receive

switchport access vlan 162

spanning-tree port type edge

logging event port link-status

logging event port trunk-status

channel-group 224 mode active

core-A# sh vpc 223
vPC status
----------------------------------------------------------------------------
id     Port        Status Consistency Reason                     Active vlans
------ ----------- ------ ----------- -------------------------- -----------
223    Po223       up     success     success                    161         

core-A# sh vpc 224
vPC status
----------------------------------------------------------------------------
id     Port        Status Consistency Reason                     Active vlans
------ ----------- ------ ----------- -------------------------- -----------
224    Po224       up     success     success                    162

core-A# sh vpc 223

vPC status

----------------------------------------------------------------------------

id Port Status Consistency Reason Active vlans

------ ----------- ------ ----------- -------------------------- -----------

223 Po223 up success success 161

core-A# sh vpc 224

vPC status

----------------------------------------------------------------------------

id Port Status Consistency Reason Active vlans

------ ----------- ------ ----------- -------------------------- -----------

224 Po224 up success success 162

NEXUS vPC Switch B:

!
interface port-channel223
  description LACP: to nas-a
  switchport access vlan 161
  spanning-tree port type edge
  logging event port link-status
  logging event port trunk-status
  bandwidth 80000000
  vpc 223
!
interface Ethernet2/3
  description NAS: nas-a UCS-C240M4-A-B
  no lldp transmit
  no lldp receive
  switchport access vlan 161
  spanning-tree port type edge
  logging event port link-status
  logging event port trunk-status
  channel-group 223 mode active
!

interface port-channel223

description LACP: to nas-a

switchport access vlan 161

spanning-tree port type edge

logging event port link-status

logging event port trunk-status

bandwidth 80000000

vpc 223

interface Ethernet2/3

description NAS: nas-a UCS-C240M4-A-B

no lldp transmit

no lldp receive

switchport access vlan 161

spanning-tree port type edge

logging event port link-status

logging event port trunk-status

channel-group 223 mode active

!
interface port-channel224
  description LACP: to nas-b
  switchport access vlan 162
  spanning-tree port type edge
  logging event port link-status
  logging event port trunk-status
  bandwidth 80000000
  vpc 224
!
interface Ethernet2/4
  description NAS: nas-b UCS-C240M4-B-B
  no lldp transmit
  no lldp receive
  switchport access vlan 162
  spanning-tree port type edge
  logging event port link-status
  logging event port trunk-status
  channel-group 224 mode active
!

interface port-channel224

description LACP: to nas-b

switchport access vlan 162

spanning-tree port type edge

logging event port link-status

logging event port trunk-status

bandwidth 80000000

vpc 224

interface Ethernet2/4

description NAS: nas-b UCS-C240M4-B-B

no lldp transmit

no lldp receive

switchport access vlan 162

spanning-tree port type edge

logging event port link-status

logging event port trunk-status

channel-group 224 mode active

core-B# sh vpc 223
vPC status
----------------------------------------------------------------------------
id     Port        Status Consistency Reason                     Active vlans
------ ----------- ------ ----------- -------------------------- -----------
223    Po223       up     success     success                    161         

core-B# sh vpc 224
vPC status
----------------------------------------------------------------------------
id     Port        Status Consistency Reason                     Active vlans
------ ----------- ------ ----------- -------------------------- -----------
224    Po224       up     success     success                    162

core-B# sh vpc 223

vPC status

----------------------------------------------------------------------------

id Port Status Consistency Reason Active vlans

------ ----------- ------ ----------- -------------------------- -----------

223 Po223 up success success 161

core-B# sh vpc 224

vPC status

----------------------------------------------------------------------------

id Port Status Consistency Reason Active vlans

------ ----------- ------ ----------- -------------------------- -----------

224 Po224 up success success 162

CentOS 7 Server – Config: nas-a:

[root@nas-a network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-enp6s0
NM_CONTROLLED=no
DEVICETYPE=TeamPort
MTU=9000
ONBOOT=no
TYPE=Ethernet
TEAM_MASTER=team0
DEVICE=enp6s0
HWADDR=28:AC:9E:E8:60:F0

[root@nas-a network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-enp6s0

NM_CONTROLLED=no

DEVICETYPE=TeamPort

MTU=9000

ONBOOT=no

TYPE=Ethernet

TEAM_MASTER=team0

DEVICE=enp6s0

HWADDR=28:AC:9E:E8:60:F0

[root@nas-a network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-enp7s0
NM_CONTROLLED=no
DEVICETYPE=TeamPort
MTU=9000
ONBOOT=no
TYPE=Ethernet
TEAM_MASTER=team0
DEVICE=enp7s0
HWADDR=28:AC:9E:E8:60:F1

[root@nas-a network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-enp7s0

NM_CONTROLLED=no

DEVICETYPE=TeamPort

MTU=9000

ONBOOT=no

TYPE=Ethernet

TEAM_MASTER=team0

DEVICE=enp7s0

HWADDR=28:AC:9E:E8:60:F1

[root@nas-a network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-team0
NM_CONTROLLED=no
DEVICE=team0
DEVICETYPE=Team
MTU=9000
BOOTPROTO=none
ONBOOT=yes

# LACP
TEAM_CONFIG='{"runner": {"name": "lacp", "active": true, "fast_rate": true, "tx_hash": ["eth", "ipv4", "ipv6"]},"link_watch":    {"name": "ethtool"},"ports":    {"enp6s0": {}, "enp7s0": {}}}'

# IPv4
IPADDR=192.168.161.231
PREFIX=24
GATEWAY=192.168.161.254
DNS1=192.168.167.244
DNS2=192.168.168.244
DOMAIN=toocoolforyou.net
DEFROUTE=yes

# IPv6
IPV6INIT=yes
IPV6_PRIVACY=no
IPV6_AUTOCONF=no
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
IPV6ADDR=2001:67c:21b0:4161:192:168:161:231/64
IPV6_DEFAULTGW=2001:67c:21b0:4161:192:168:161:254

# Firewall Zone
ZONE=public

[root@nas-a network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-team0

NM_CONTROLLED=no

DEVICE=team0

DEVICETYPE=Team

MTU=9000

BOOTPROTO=none

ONBOOT=yes

# LACP

TEAM_CONFIG='{"runner": {"name": "lacp", "active": true, "fast_rate": true, "tx_hash": ["eth", "ipv4", "ipv6"]},"link_watch": {"name": "ethtool"},"ports": {"enp6s0": {}, "enp7s0": {}}}'

# IPv4

IPADDR=192.168.161.231

PREFIX=24

GATEWAY=192.168.161.254

DNS1=192.168.167.244

DNS2=192.168.168.244

DOMAIN=toocoolforyou.net

DEFROUTE=yes

# IPv6

IPV6INIT=yes

IPV6_PRIVACY=no

IPV6_AUTOCONF=no

IPV6_DEFROUTE=yes

IPV6_FAILURE_FATAL=no

IPV6ADDR=2001:67c:21b0:4161:192:168:161:231/64

IPV6_DEFAULTGW=2001:67c:21b0:4161:192:168:161:254

# Firewall Zone

ZONE=public

CentOS 7 Server – Config: nas-a:

[root@nas-b network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-enp6s0
NM_CONTROLLED=no
DEVICETYPE=TeamPort
MTU=9000
ONBOOT=no
TYPE=Ethernet
TEAM_MASTER=team0
DEVICE=enp6s0
HWADDR=84:3D:C6:77:62:2A

[root@nas-b network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-enp6s0

NM_CONTROLLED=no

DEVICETYPE=TeamPort

MTU=9000

ONBOOT=no

TYPE=Ethernet

TEAM_MASTER=team0

DEVICE=enp6s0

HWADDR=84:3D:C6:77:62:2A

[root@nas-b network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-enp7s0
NM_CONTROLLED=no
DEVICETYPE=TeamPort
MTU=9000
ONBOOT=no
TYPE=Ethernet
TEAM_MASTER=team0
DEVICE=enp7s0
HWADDR=84:3D:C6:77:62:2B

[root@nas-b network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-enp7s0

NM_CONTROLLED=no

DEVICETYPE=TeamPort

MTU=9000

ONBOOT=no

TYPE=Ethernet

TEAM_MASTER=team0

DEVICE=enp7s0

HWADDR=84:3D:C6:77:62:2B

[root@nas-b network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-team0
NM_CONTROLLED=no
DEVICE=team0
DEVICETYPE=Team
MTU=9000
BOOTPROTO=none
ONBOOT=yes

# LACP
TEAM_CONFIG='{"runner": {"name": "lacp", "active": true, "fast_rate": true, "tx_hash": ["eth", "ipv4", "ipv6"]},"link_watch":    {"name": "ethtool"},"ports":    {"enp6s0": {}, "enp7s0": {}}}'

# IPv4
IPADDR=192.168.162.231
PREFIX=24
GATEWAY=192.168.162.254
DNS1=192.168.167.244
DNS2=192.168.168.244
DOMAIN=toocoolforyou.net
DEFROUTE=yes

# IPv6
IPV6INIT=yes
IPV6_PRIVACY=no
IPV6_AUTOCONF=no
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
IPV6ADDR=2001:67c:21b0:8162:192:168:162:231/64
IPV6_DEFAULTGW=2001:67c:21b0:8162:192:168:162:254

# Firewall Zone
ZONE=public

[root@nas-b network-scripts]# cat /etc/sysconfig/network-scripts/ifcfg-team0

NM_CONTROLLED=no

DEVICE=team0

DEVICETYPE=Team

MTU=9000

BOOTPROTO=none

ONBOOT=yes

# LACP

TEAM_CONFIG='{"runner": {"name": "lacp", "active": true, "fast_rate": true, "tx_hash": ["eth", "ipv4", "ipv6"]},"link_watch": {"name": "ethtool"},"ports": {"enp6s0": {}, "enp7s0": {}}}'

# IPv4

IPADDR=192.168.162.231

PREFIX=24

GATEWAY=192.168.162.254

DNS1=192.168.167.244

DNS2=192.168.168.244

DOMAIN=toocoolforyou.net

DEFROUTE=yes

# IPv6

IPV6INIT=yes

IPV6_PRIVACY=no

IPV6_AUTOCONF=no

IPV6_DEFROUTE=yes

IPV6_FAILURE_FATAL=no

IPV6ADDR=2001:67c:21b0:8162:192:168:162:231/64

IPV6_DEFAULTGW=2001:67c:21b0:8162:192:168:162:254

# Firewall Zone

ZONE=public

CentOS 7 Server – Show Commands:

[root@nas-a /]# teamdctl team0 state view -v

setup:
  runner: lacp
  kernel team mode: loadbalance
  D-BUS enabled: yes
  ZeroMQ enabled: no
  debug level: 0
  daemonized: no
  PID: 5029
  PID file: /var/run/teamd/team0.pid
ports:
  enp6s0
    ifindex: 2
    addr: 28:ac:9e:e8:60:f0
    ethtool link: 40000mbit/fullduplex/up
    link watches:
      link summary: up
      instance[link_watch_0]:
        name: ethtool
        link: up
        down count: 0
        link up delay: 0
        link down delay: 0
    runner:
      aggregator ID: 3, Selected
      selected: yes
      state: current
      key: 0
      priority: 255
      actor LACPDU info:
        system priority: 65535
        system: 28:ac:9e:e8:60:f0
        key: 0
        port_priority: 255
        port: 2
        state: 0x3f
      partner LACPDU info:
        system priority: 32667
        system: 00:23:04:ee:be:a0
        key: 32991
        port_priority: 32768
        port: 16899
        state: 0x3d
  enp7s0
    ifindex: 3
    addr: 28:ac:9e:e8:60:f0
    ethtool link: 40000mbit/fullduplex/up
    link watches:
      link summary: up
      instance[link_watch_0]:
        name: ethtool
        link: up
        down count: 0
        link up delay: 0
        link down delay: 0
    runner:
      aggregator ID: 3, Selected
      selected: yes
      state: current
      key: 0
      priority: 255
      actor LACPDU info:
        system priority: 65535
        system: 28:ac:9e:e8:60:f0
        key: 0
        port_priority: 255
        port: 3
        state: 0x3f
      partner LACPDU info:
        system priority: 32667
        system: 00:23:04:ee:be:a0
        key: 32991
        port_priority: 32768
        port: 515
        state: 0x3d
runner:
  active: yes
  fast rate: yes
  system priority: 65535

[root@nas-a /]# teamdctl team0 state view -v

setup:

runner: lacp

kernel team mode: loadbalance

D-BUS enabled: yes

ZeroMQ enabled: no

debug level: 0

daemonized: no

PID: 5029

PID file: /var/run/teamd/team0.pid

ports:

enp6s0

ifindex: 2

addr: 28:ac:9e:e8:60:f0

ethtool link: 40000mbit/fullduplex/up

link watches:

link summary: up

instance[link_watch_0]:

name: ethtool

link: up

down count: 0

link up delay: 0

link down delay: 0

runner:

aggregator ID: 3, Selected

selected: yes

state: current

key: 0

priority: 255

actor LACPDU info:

system priority: 65535

system: 28:ac:9e:e8:60:f0

key: 0

port_priority: 255

port: 2

state: 0x3f

partner LACPDU info:

system priority: 32667

system: 00:23:04:ee:be:a0

key: 32991

port_priority: 32768

port: 16899

state: 0x3d

enp7s0

ifindex: 3

addr: 28:ac:9e:e8:60:f0

ethtool link: 40000mbit/fullduplex/up

link watches:

link summary: up

instance[link_watch_0]:

name: ethtool

link: up

down count: 0

link up delay: 0

link down delay: 0

runner:

aggregator ID: 3, Selected

selected: yes

state: current

key: 0

priority: 255

actor LACPDU info:

system priority: 65535

system: 28:ac:9e:e8:60:f0

key: 0

port_priority: 255

port: 3

state: 0x3f

partner LACPDU info:

system priority: 32667

system: 00:23:04:ee:be:a0

key: 32991

port_priority: 32768

port: 515

state: 0x3d

runner:

active: yes

fast rate: yes

system priority: 65535

[root@nas-a /]# teamdctl team0 config dump -v
{
    "device": "team0",
    "link_watch": {
        "name": "ethtool"
    },
    "ports": {
        "enp6s0": {},
        "enp7s0": {}
    },
    "runner": {
        "active": true,
        "fast_rate": true,
        "name": "lacp",
        "tx_hash": [
            "eth",
            "ipv4",
            "ipv6"
        ]
    }
}

[root@nas-a /]# teamdctl team0 config dump -v

{

"device": "team0",

"link_watch": {

"name": "ethtool"

"ports": {

"enp6s0": {},

"enp7s0": {}

"runner": {

"active": true,

"fast_rate": true,

"name": "lacp",

"tx_hash": [

"eth",

"ipv4",

"ipv6"

]

}

[root@nas-a /]# ls -la /sys/class/net/  
lrwxrwxrwx.  1 root root 0 Sep  8 12:01 enp6s0 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/0000:02:01.0/0000:04:00.0/0000:05:00.0/0000:06:00.0/net/enp6s0
lrwxrwxrwx.  1 root root 0 Sep  8 12:01 enp7s0 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/0000:02:01.0/0000:04:00.0/0000:05:01.0/0000:07:00.0/net/enp7s0
lrwxrwxrwx.  1 root root 0 Sep  8 12:01 lo -> ../../devices/virtual/net/lo
lrwxrwxrwx.  1 root root 0 Sep  8 12:01 team0 -> ../../devices/virtual/net/team0

[root@nas-a /]# ls -la /sys/class/net/

lrwxrwxrwx. 1 root root 0 Sep 8 12:01 enp6s0 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/0000:02:01.0/0000:04:00.0/0000:05:00.0/0000:06:00.0/net/enp6s0

lrwxrwxrwx. 1 root root 0 Sep 8 12:01 enp7s0 -> ../../devices/pci0000:00/0000:00:01.0/0000:01:00.0/0000:02:01.0/0000:04:00.0/0000:05:01.0/0000:07:00.0/net/enp7s0

lrwxrwxrwx. 1 root root 0 Sep 8 12:01 lo -> ../../devices/virtual/net/lo

lrwxrwxrwx. 1 root root 0 Sep 8 12:01 team0 -> ../../devices/virtual/net/team0

2018-09-10/by wriedel

LINUX – Network Throughput Tuning

General Approach

CentOS – How do I safely delete old kernel versions ?

package-cleanup:

yum:

automated:

ZFS – CENTOS Downgrade

ZFS – Downgrade Commands for Centos:

ZFS – Tuning

ZFS tuning for SAS3 Storage Tank

ZFS tuning for SAS3 ALL SSD + nVME Storage Tank

ZFS – SNMP

ZFS – SNMP Extend Commands:

CentOS – NIC Teaming with LACP

A Comparison of Features in Bonding and Team

Config Snippets:

NEXUS vPC Switch A:

NEXUS vPC Switch B:

CentOS 7 Server – Config: nas-a:

CentOS 7 Server – Config: nas-a:

CentOS 7 Server – Show Commands:

Meet with us

Where to find us

Get in touch with us

Latest Blog Entries

Archive for month: September, 2018

General Approach

package-cleanup:

yum:

automated:

ZFS – Downgrade Commands for Centos:

ZFS tuning for SAS3 Storage Tank

ZFS tuning for SAS3 ALL SSD + nVME Storage Tank

ZFS – SNMP Extend Commands:

A Comparison of Features in Bonding and Team

Config Snippets:

NEXUS vPC Switch A:

NEXUS vPC Switch B:

CentOS 7 Server – Config: nas-a:

CentOS 7 Server – Config: nas-a:

CentOS 7 Server – Show Commands:

Meet with us

Where to find us

Get in touch with us

Latest Blog Entries