StorPool 19.01 Release Change Log

More details for the changes are available at StorPool 19.01 Release Notes

19.01.1376.ce07826 – -> 19.01.1408.59a31ff

  • Updated dependencies when MLNX OFED is used.

  • Balancer fix for cases where overrides are enabled.

  • Adds bridge multicluster stability fixes.

  • Updates python bindings with missing functionality available in the present API.

  • Adds diagnostic features for the /usr/lib/storpool/monitor utility.

  • Adds updates and fixes in internal tools.

19.01.1357.39c014c – -> 19.01.1376.ce07826

  • Adds volumecare support for unnamed volumes.

  • The in-server disk tester now sends FUA writes during tests (except for –no-fua y disks).

  • Improved performance when relocating data from SSD or NVMe disks

  • Adds handling in api-ip for some obscure kernel 4.18 behavior leaving leftover routes.

  • Adds a fix for API to not show deleted snapshots addressed by global ID.

  • Adds a fix for volumeMoveRemote API call now properly handling IOPS and bandwidth limits.

  • Includes updates and fixes in internal tools.

19.01.1346.dd68fa2c6 – -> 19.01.1357.39c014c

  • Fixes a bug in handling old-style iSCSI reservations used by VMWare 4.x and 5.x

  • Adds storpool_volumecare as an installable module (More on storpool_volumecare here)

  • Adds support for Micron 7300 Pro NVMe

  • Updates and improvements in internal tools

19.01.1293.cfcb869 – -> 19.01.1346.dd68fa2c6

  • Cluster volume/snapshot limit bumped to 60k volumes/snapshots.

  • StorPool API now automatically fails over in case its address vanishes for any reason.

  • The storpool_cg tool now properly handles disks with custom objects and/or entries counts.

  • Now automatically patching /etc/kdump.conf to blacklist non-important but memory intensive drivers.

  • New default TCP sysctl settings for better throughput performance for bridge enabled nodes.

  • Updated installation helper scripts handling better latest rpm/deb packages and other improvements.

19.01.1217.1635af7 – -> 19.01.1293.cfcb869

  • Improvements in storpool_initdisk tool - exit code 0 on --nvme-smart, added --json output

  • Adds spopenstack in the main source tree

  • Initial CentOS 8 build support

  • Major installation package system changes - new implementation of most core installation tools, all service files are now handled as rpm/deb packages

  • Critical fix for all systems running with hard disk drives, resiliency on power outages.

19.01.1108.02703b8c5 – -> 19.01.1217.1635af7

  • Improves handling of lost packets in iSCSI connections

  • Adds full cluster maintenance mode monitoring improvements

  • Server now automatically tests and returns disks on transient failures

  • Improvement in multicluster - volume create/update flags now mandatory for MultiCluster API endpoint, adds VolumeRevert operation

  • Improvement in multicluster - volume exports and remote volumes can now be listed

  • Performance improvements - more efficient bridge and API interoperability

  • Performance improvements in dematerialization

  • Adds CLI improvements - iSCSI list interfaces

  • Updates cgtool defaults - the system.slice is now with 4G limit by default

  • Adds minor fixes and improvements in balancer, build and automation tools

19.01.1025.0baac06a6 – -> 19.01.1108.02703b8c5

  • storpool_bridge performance improvements

  • Oracle Linux support

  • Kernel 5.4 support

  • Increase limit of total volumes and snapshots to 45000

  • Better support for LACP hashing handling

19.01.878.7b1f83e3d – -> 19.01.1025.0baac06a6

  • Maintenance mode

  • Support for volume creation with global IDs instead of volume names, see global ID volumes

  • Revert to snapshot functionality

  • NIC initialization and configuration is now non-blocking, see non-blocking NIC configuration

  • Availability of information for active iSCSI sessions

  • Acceleration support for virtio-net based adapters

  • Add support for a global active operations list

  • storpool_initdisk now has extra validation of flags and devices

  • reuseServer implicit on a down disk in small clusters, more on this here

19.01.759.024d1bd – -> 19.01.878.7b1f83e3d

  • Infrastructure to allow customers to access StorPool packages

  • Tools to help with installing new modules and services

  • Add bridge buffer size options (location update command), see also Bridge throughput performance

  • Fix for sending monitoring data in blackholed IPv6 networks

19.01.742.47c6e9c – -> 19.01.759.024d1bd

  • iSCSI TCP fixes and optimizations

  • Improvements in handling of I/O errors for NVMe devices

  • Compatibility improvement in Python bindings: fix the type of the allowRemoteExported field so that it’s not always sent to the StorPool API

19.01.719.c40dd8c – -> 19.01.742.47c6e9c

  • Major improvement in aggregation performance with a significantly more efficient internal trigger

  • Improvements in dematerialization with mixed server and controller versions in the same cluster

  • Various fixes and improvements in the in-iSCSI TCP implementation

  • Performance improvements in the storpool_controller service

  • Fix for thread priorities in some services that were leading to timeouts and service restarts

19.01.544.39e62dbad – -> 19.01.719.c40dd8c

  • Various improvements/fixes in multicluster, more on mc here

  • Various iSCSI fixes and optimizations

  • A better handling of TRIMs over iSCSI

  • Improvements in balancer tools, handling some edge cases

  • Various other improvements in internal tools and services

19.01.496.6d2c5bf83 – -> 19.01.544.39e62dbad

  • Adds setirqaff validation option

  • Adds a required default kernel configuration option for improved performance with known supported storage controllers

  • Improved storpool_bridge performance under constrained CPU and network bandwidth conditions

  • Adds colorless output for the storpool_tree utility with flags for volumes and snapshots

19.01.385.fc63315ef – -> 19.01.496.6d2c5bf83

  • Removes excessive debug print logging

  • Improved kdump setup tooling for Debian based systems

  • Support for larger set of switch hash functions for LACP and ECMP

  • Updates in fio testing framework scripts, closely following latest monitoring alerting

19.01.375.684a0da12 – -> 19.01.385.fc63315ef

  • Adds support for monitoring through IPv6 only hosts.

  • Adds hardware acceleration support for BCM57412 NetXtreme-E 10Gb Ethernet Controllers.

  • Adds improved stability of quorum keeping service in unstable network conditions.

  • Adds stability improvements in the quorum keeping service in unstable networking conditions.

  • Updates the detection for hardware accelerated NICs for the bnxt_en driver in the cgroup configuration helper tools.

  • Adds an API fix and improvements related to multicluster support with CloudStack deployments, more on mc here

  • Adds expansion support for Kubernetes integration.

19.01.355.896c5ebaf – -> 19.01.375.684a0da12

  • Adds fix for the CLI when a volume is created without a template.

  • Improvements in logging, handles unexpected verbosity.

  • Improvements in statistics collection daemons, safer methods for data collection.

  • Improvements for stability and edge cases handling in API.

  • Improvements in storpool_cg for converged nodes, single-thread hosts migration fixes.

  • Improvements in monitoring collection scripts, now collecting and handling more data.

19.01.318.daa3c5938 – -> 19.01.355.896c5ebaf

  • Improvements in API performance when balancer overrides are in place.

  • Improvements for iSCSI when persistent reservations (MicroSoft CSV) are being used with target failover.

  • Improvements for aggregation logic during recovery.

  • Adds change in CLI for template propagate, now stating propagate is mandatory on template changes.

  • Adds fix for removing the reuseServer flag for volumes/snapshots previosly applied with reuseServer

  • Adds an automatic disabling through vf-udevhelper for the internal i40e based NICs LLDP listener.

  • Adds an update storpool_daemon with systemd, now no longer forking and other smaller improvements.

  • Adds more variables reported by the server_stat tool, visible also in the collected statistics for the cluster.

  • Adds stability fixes in the storpool_iscsi service.

  • Adds performance fixes with improved read latency for HDD pools.

  • Adds default configuration changes for internal command output timeouts when collecting periodic reports.

  • Improvements in storpool_cg for server cache autodetection during cgroup config migration, various other improvements.

19.01.301.f1b25e7 – -> 19.01.318.daa3c5938

  • Adds CLI support for multicluster mode, more on mc here

  • Improvements for iSCSI with LACP bonds, unrealiable network, etc.

  • Adds fixes in python bindings

  • Improvements in cgtool chain

  • Improvements in kubernetes integration code

  • Improvements in API responsiveness during dematerialization

19.01.271.de5921845 – -> 19.01.301.f1b25e7

  • Enables setting the SMP affinity of MegaRAID controllers

  • Adds support for CentOS 7.7 (kernel 3.10.0-1062.1.1.el7.x86_64)

  • Adds support for mixed routed/switched networks for iSCSI

  • Adds various storpool_iscsi improvements and fixes

  • Various other improvements in internal tools and services

19.01.212.66fed3091 – -> 19.01.271.de5921845

  • Improvements in the irq pinning tools for better CPU congestion avoidance on storage service CPU cores

  • Improvements in internal tools for stress testing drives

  • Adds support for non-jumbo frames routed networks

  • Adds support for hardware or no sleep options for bridge service and cgroup configuration tools

  • Adds support for upgrading 18.02 clusters with iSCSI to accelerated storpool_iscsi

  • Adds various storpool_iscsi improvements and fixes

  • Adds initial support for storpool_iscsi persistent reservations

19.01.199.b98e9d4 – -> 19.01.212.66fed3091

  • Adds support for 4.18 line of kernels

  • Improvements in python-bindings, monitoring services, cgroup tools

  • Various other improvements in internal tools and services

19.01.182.666093099 – -> 19.01.199.b98e9d4

  • Adds priority based recovery for better handling of remote bridge recovery operations

  • Adds tools for easier upgrade from 18.02 with multi site setup

  • Adds common configuration for all supported hardware accelerated NIC drivers

  • Improvements in the tooling for enabling required hardware acceleration settings

18.02.1030.2e4eab8 – -> 19.01.182.666093099

  • Adds support for multiple clusters in the same location

  • Read operations now can be forwarded through the active bridge connection for not fully recovered snapshots

  • Adds support for 4.20 and 5.0 kernel line

  • Adds significant protocol improvements for small block size and low IO queue depth read/write operations latency

  • Adds significant performance improvements for storpool_iscsi, now running only on addapters with support for hardware acceleration (i40e, ixgbe, mlx4_ib, mlx5_ib drivers)

  • Adds support for iSCSI on layer 3 only networks (routed networks)

  • Adds support for hardware accelerated bnxt driver based Broadcom adapters

  • Adds backwards compatibility with pre 19.01 release versions

  • Fixes AMD EPYC v.1 hardware sleep latency issues

18.02.953.79d8ee7 – -> 18.02.1030.2e4eab8

  • Adds fix for storpool_beacon service backup nets detection with single-vlan and misconfigured network

  • Adds support for Samsung PM981 NVMe drives

  • Adds support for up to 7 server instances on a single node

  • Improves snapshot dematerialization without impact processing of other API calls

  • Adds fix for snapshot space miscalcuated gains for snapshots with very small amount of data

  • The CLI now properly shows all units in KiB, MiB, GiB to prevent any confusion

  • Adds a new service storpool_abrtsync, which will automatically send reports from aborted services (repsync deprecated and removed on the first run of storpool_abrtsync)

  • Handles per-host alerts in storpool_stat for processes in the root cgroup and unreachable API (for nodes configured to access it)

  • Consolidates most cron tasks in a single cron job handled by the storpool_periodic tool

  • Renames the storpool_initdisk’s’ --force option to the unabmiguous --wipe-all-data

  • Includes various other improvements in the storpool_server, storpool_beacon services, python bindings, cgroup setup tools and in the disk stress testing tool

18.02.944.478cc9f – -> 18.02.953.79d8ee7

  • Fixes in automation for rebasing long volume-snapshot chains

  • Speed up TRIM operations for volumes exposed through iSCSI, now ~600GB/s instead of 2-12GB/s

  • Adds SP_PREFERRED_PORT option, enabling active-backup redundant networking

  • Improvements in relocator in aggregate heavy enviroments, such as HDD-only placement templates

  • Improvements in balancer tools when mixing drives in the same placement group

18.02.886.f6b2fcf20 – -> 18.02.944.478cc9f

  • Add storpool_process tool for listing and reclassifying processes in their intended cgroups

  • Add the storpool_cg tool for creating cgroups based on predefined config or by autodetecting settings based on installed services and hardware

  • The monitor collector tool now detects the SSL CA list location

  • The multi-server-helper tool now supports configurations with selectable number of SSD only instances

  • Fix for the storpool_initdisk tool when the underlying devices are with a long PCI address

  • Improvements in storpool_stat collecting service, now gathering data for services network traffic and iostat for all drives, including system ones

  • Fixed inventory collection not updating the latest kernel booted

18.02.847.b09fd4bec – -> 18.02.886.f6b2fcf20

  • The storpool_initdisk tool now handles NVMe journals for hard disk drives

  • The storpool_initdisk tool now lists empty NVMe partitions

  • Fix storpool_controller service might end up in storpool.slice cgroup on systemd daemon-reload

  • Add support for 4.19+ & OFED in the storpool_rdma kernel module

  • Fix templates status output when the same placement group is used more than once

  • Drops support for Ubuntu 14.04 and Debian 8 distributions

  • Various other improvements in internal tools and services

18.02.763.0aa70d7 – -> 18.02.847-b09fd4bec

  • Workaround for bnx2x based NICs getting in partial reset when large-receive-offload is disabled

  • Improvements in TRIM performance on top of a StorPool volume

  • Improvements in recovery times with remote backups

  • Python bindings python3 support

  • Added proxy support for sending monitoring and statistics data

  • Various other improvements in internal tools and services

18.02.458.ac2f823 – -> 18.02.763.0aa70d7

  • Support for 4k native NVMe devices

  • Support for Intel Optane drives

  • Support for Micron 9200MAX NVMe

  • Support for AMD EPYC hardware sleep

  • Support for Intel X550 in hardware accelerated mode with ixgbe driver

  • Support for MTU 1500 with bnx2x and ixgbe based NICs

  • Updates in tools for automatic hardware acceleration configuration

  • Updated on-boot hugepages reservation mechanism

  • Performance and stability improvements in API service

  • Updated ixgbe driver based acceleration to evade issues with in-kernel driver

  • Updated ixgbe driver based acceleration with support for Debian 9 based nodes

  • Added Ubuntu 18.04 LTS support

  • Updates in statistics gathering - support for sending to secondary databases, cgroups memory statistics, various reliability and performance improvements

  • Updated dependencies

  • Various reliability and stability improvements in internal tools and services

18.02.370.2b8c3c3 – -> 18.02.458.ac2f823

  • Support for Kubernetes

  • Support for ARM64 architecture

  • Support for POWER architecture

  • Improvements in the installation procedure, VF helper included

  • hardware acceleration for NICs with bnx2x driver

  • Initial support for Alpine Linux

  • New API call to quickly return just the status of all volumes

  • Changes in the way data on the underlying drives is aggregated in a more efficient manner

  • New hardware support - Micron 9200 NVMe

  • Native 4k drives support

  • Various improvements in internal tools, monitoring and services

18.02.334.c204ed2 – -> 18.02.370.2b8c3c3

  • Add support for Samsung PM1725a NVMe

  • Add new tool, transfer_status to show the status of the currently running bridge transfers

  • Add new tool, sDump to print network stats in human-readable format

  • Fix for data transfer issues caused by the kernel remapping some of StorPool’s memory

  • Add preliminary support for Ubuntu 18.04

  • Work-around for kernel crashes caused by bugs in the ixgbe kernel driver when using acceleration

  • Add stats collection for per-CPU statistics, to be available in https://analytics.storpool.com/

18.02.206.06d240e – -> 18.02.334.c204ed2

  • Add additional logging for storpool_bridge service

  • Higher default parallelism for the storpool_bridge transfers

  • Lower CPU usage, higher efficiency for storpool_block during TRIM operations

  • Exit when the support for hardware sleep is not available and hardware sleep is requested

  • Added additional network statistics through the use of the statsDump tool and storpool_ping tools, added netlatency tool to quickly measure and report the network latency from one of the nodes to the other participants in the cluster

  • Added support for storpool_bd kernel module with 4.10+ kernels and storpool_rdma with 4.15+ kernels

  • storpool_server/storpool_initdisk/storpool_nvmed now support hotplug NVMe devices

  • Various other reliability fixes and improvements

18.02.178.9d29cd7 – -> 18.02.206.06d240e

  • No longer ignore snapshots being deleted when re-basing long snapshot-volume chains

  • Fix a bug in handling aborted iSCSI operations in storpool_iscsi service

  • Fix in storpool_server to not forget to delete moved snapshot objects

  • Add support for centos 7.5 in the storpool_rdma kernel module

  • Add support for 4.14+ & OFED in the storpool_rdma kernel module

  • Add support for 4.12+ in the storpool_pci kernel module

  • Improve some of the diagnostic and monitoring tools

  • Make the “recovery” state of a task clearly visible in the output of storpool task list

18.02.164.7277e8c – -> 18.02.178.9d29cd7

  • Disable check of BBU status for genreport

  • Fix service name and symlinks on CentOS 6 for the storpool_controller service

  • Fix installing dependency packages on Ubuntu 14.04

  • Fix the installation of the CentOS 6 cgmove init script

  • Remove “reload” for init scripts, as it’s not supported by the StorPool services and actually does “restart”

  • Add /usr/lib/storpool/get_tech_support - Collects useful information to be sent to support for initial troubleshooting in case of no access to the cluster.

18.02.119.b8796bb – -> 18.02.164.7277e8c

  • Use port 443 (instead of 8086) in the storpool_stat service to get through firewalls more easily

  • Let the StorPool CLI prompt be customized using the SP_CLI_PROMPT variable

  • Add support for GCC 7

  • Strip the zero VLAN tag in the storpool_rdma module

  • Multiple fixes and improvements on the server and bridge services

  • Remove log entries for recovered objects (prevents syslog flooding)

  • Handle the new fio 3.1+ log format in the disk_tester tool

  • Improve the fio test scripts

  • Run the mgmt and bridge services in a separate memory cgroup - mgmt.slice

  • Add the SP_CPU_DMA_LATENCY variable to the storpool.conf.example file (more info at https://access.redhat.com/articles/65410 and https://www.kernel.org/doc/Documentation/power/pm_qos_interface.txt)

  • Add a check for the status of the BBU/Cache Vault of RAID controllers

  • Improve repsync service

  • Add a tool for filtering git logs

  • Add a tool for rotating snapshots on number of volumes

  • Add a tool for to quickly check the network latency to other nodes in the cluster (uses addresses in /etc/storpool.conf)