Newton Series Release Notes

9.1.2

Bug Fixes

  • Fixed an issue where the NetApp cDOT NFS driver failed to clone new volumes from the image cache.

9.1.1

Bug Fixes

  • Fixed Non-WAN port filter issue in Kaminario iSCSI driver

  • Fixed issue of managing a VG with more than one volume in Kaminario FC and iSCSI Cinder drivers.

9.1.0

Bug Fixes

  • The NetApp cDOT driver now sets the replication_status attribute appropriately on volumes created within replicated backends when using host level replication.

9.0.0

Prelude

Everything in Cinder’s release notes related to the High Availability Active-Active effort -preluded with “HA A-A:”- is work in progress and should not be used in production until it has been completed and the appropriate release note has been issued stating its readiness for production.

The default key manager interface in Cinder was deprecated and the Castellan key manager interface library is now used instead. For more information about Castellan, please see http://docs.openstack.org/developer/castellan/ .

New Features

  • dell_server_os option added to the Dell SC driver. This option allows the selection of the server type used when creating a server on the Dell DSM during initialize connection. This is only used if the server does not exist. Valid values are from the Dell DSM create server list.

  • Added support for the use of live volume in place of standard replication in the Dell SC driver.

  • Added replication failback support for the Dell SC driver.

  • Added volume driver for Zadara Storage VPSA.

  • Added a new config option scheduler_weight_handler. This is a global option which specifies how the scheduler should choose from a listed of weighted pools. By default the existing weigher is used which always chooses the highest weight.

  • Added a new weight handler StochasticHostWeightHandler. This weight handler chooses pools randomly, where the random probabilities are proportional to the weights, so higher weighted pools are chosen more frequently, but not all the time. This weight handler spreads new shares across available pools more fairly.

  • Allow API user to remove the consistency group name or description information.

  • Support for snapshot backup using the optimal path in Huawei driver.

  • Added REST API to update backup name and description.

  • Report pools in volume stats for Block Device Driver.

  • Updating the Datera Elastic DataFabric Storage Driver to version 2.1. This adds ACL support, Multipath support and basic IP pool support.

  • Changes config option default for datera_num_replicas from 1 to 3

  • Support for use of ‘fc_southbound_protocol’ configuration setting in the Brocade FC SAN lookup service.

  • Added Keystone v3 support for Swift backup driver in single user mode.

  • Added volume backend drivers for CoprHD FC, iSCSI and Scaleio.

  • HA A-A: Add cluster configuration option to allow grouping hosts that share the same backend configurations and should work in Active-Active fashion.

  • HA A-A: Updated manage command to display cluster information on service listings.

  • HA A-A: Added cluster subcommand in manage command to list, remove, and rename clusters.

  • HA A-A: Added clusters API endpoints for cluster related operations (index, detail, show, enable/disable). Index and detail accept filtering by name, binary, disabled, num_hosts, num_down_hosts, and up/down status (is_up) as URL parameters. Also added their respective policies.

  • Separate create and update rules for volume metadata.

  • Capabilites List for Datera Volume Drivers

  • Extended Volume-Type Support for Datera Volume Drivers

  • Naming convention change for Datera Volume Drivers

  • Volume Manage/Unmanage support for Datera Volume Drivers

  • New BoolOpt datera_debug_override_num_replicas for Datera Volume Drivers

  • Added using etags in API calls to avoid the lost update problem during deleting volume metadata.

  • Configuration options for the DRBD driver that will be applied to DRBD resources; the default values should be okay for most installations.

  • Added manage/unmanage volume support for Dell Equallogic driver.

  • Added backend driver for FalconStor FreeStor.

  • Added backend driver for Huawei FusionStorage.

  • Introduced generic volume groups and added create/ delete/update/list/show APIs for groups.

  • Added create/delete APIs for group snapshots and an API to create group from source.

  • Added group type and group specs APIs.

  • Added manage/unmanage snapshot support to the HNAS NFS driver.

  • Add support for reporting pool disk type in Huawei driver.

  • Add support for hybrid aggregates to the NetApp cDOT drivers.

  • Volume manage/unmanage support for IBM FlashSystem FC and iSCSI drivers.

  • Added support for querying volumes filtered by group_id using ‘group_id’ optional URL parameter. For example, “volumes/detail?group_id={consistency_group_id}”.

  • New FC Cinder volume driver for Kaminario K2 all-flash arrays.

  • New iSCSI Cinder volume driver for Kaminario K2 all-flash arrays.

  • Added the ability to list manageable volumes and snapshots via GET operation on the /v2/<project_id>/os-volume-manage and /v2/<project_id>/os-snapshot-manage URLs, respectively.

  • The v2 API extensions os-volume-manage and os-snapshot-manage have been mapped to the v3 resources manageable_volumes and manageable_snapshots

  • Added host-level (whole back end replication - v2.1) replication support to the NetApp cDOT drivers (iSCSI, FC, NFS).

  • Added Cinder consistency group for the NetApp NFS driver.

  • Added HA support for NexentaEdge iSCSI driver

  • Added NBD driver for NexentaEdge.

  • Support for force backup of in-use Cinder volumes in Nimble driver.

  • Add get_manageable_volumes and get_manageable_snapshots implementations for Pure Storage Volume Drivers.

  • The xiv_ds8k driver now supports IBM XIV, Spectrum Accelerate, FlashSystem A9000, FlashSystem A9000R and DS8000 storage systems, and was renamed to IBM Storage Driver for OpenStack. The changes include text changes, file names, names of cinder.conf flags, and names of the proxy classes.

  • Support for retype volumes with different encryptions including changes from unencrypted types to encrypted types and vice-versa.

  • Added support for manage/unmanage snapshot in the ScaleIO driver.

  • Added support for scaling QoS in the ScaleIO driver. The new QoS keys are maxIOPSperGB and maxBWSperGB.

  • Added support for oversubscription in thin provisioning in the ScaleIO driver. Volumes should have extra_specs with the key provisioning:type with value equals to either ‘thick’ or ‘thin’. max_oversubscription_ratio can be defined by the global config or for ScaleIO specific with the config option sio_max_over_subscription_ratio. The maximum oversubscription ratio supported at the moment is 10.0.

  • Added v2.1 replication support to SolidFire driver.

  • Added consistency group support to the Huawei driver.

  • Added support for querying volumes filtered by glance metadata key/value using ‘glance_metadata’ optional URL parameter. For example, “volumes/detail?glance_metadata={“image_name”:”xxx”}”.

  • Added supported driver checks on all drivers.

  • Added backend driver for Synology iSCSI-supported storage.

  • Added support for vhd and vhdx disk-formats for volume upload-to-image.

  • Support for iSCSI multipathing in EMC VMAX driver.

  • Added oversubscription support in the VMAX driver

  • QoS support in EMC VMAX iSCSI and FC drivers.

  • Added backend driver for Violin Memory 7000 iscsi storage.

  • New Cinder driver based on storops library (available in pypi) for EMC VNX.

  • A new API to display the volumes summary. This summary API displays the total number of volumes and total volume’s size in GB.

  • Added snapshot manage/unmanage support to the EMC XtremIO driver.

  • Added backend driver for ZTE iSCSI storage.

Known Issues

  • When running Nova Compute and Cinder Volume or Backup services on the same host they must use a shared lock directory to avoid rare race conditions that can cause volume operation failures (primarily attach/detach of volumes). This is done by setting the “lock_path” to the same directory in the “oslo_concurrency” section of nova.conf and cinder.conf. This issue affects all previous releases utilizing os-brick and shared operations on hosts between Nova Compute and Cinder data services.

Upgrade Notes

  • In certain environments (Kubernetes for example) indirect calls to the LVM commands result in file descriptor leak warning messages which in turn cause the process_execution method to raise and exception.

    To accommodate these environments, and to maintain backward compatibility in Newton we add a lvm_suppress_fd_warnings bool config to the LVM driver. Setting this to True will append the LVM env vars to include the variable LVM_SUPPRESS_FD_WARNINGS=1.

    This is made an optional configuration because it only applies to very specific environments. If we were to make this global that would require a rootwrap/privsep update that could break compatibility when trying to do rolling upgrades of the volume service.

  • The ‘backup_service_inithost_offload’ configuration option now defaults to ‘True’ instead of ‘False’.

  • If policy for update volume metadata is modified in a desired way it’s needed to add a desired rule for create volume metadata.

  • The Cinder database can now only be upgraded from changes since the Kilo release. In order to upgrade from a version prior to that, you must now upgrade to at least Kilo first, then to Newton or later.

  • Any Volume Drivers configured in the DEFAULT config stanza should be moved to their own stanza and enabled via the enabled_backends config option. The older style of config with DEFAULT is deprecated and will be removed in future releases.

  • HNAS drivers have new configuration paths. Users should now use cinder.volume.drivers.hitachi.hnas_nfs.HNASNFSDriver for HNAS NFS driver and cinder.volume.drivers.hitachi.hnas_iscsi.HNASISCSIDriver for HNAS iSCSI driver.

  • HNAS drivers will now read configuration from cinder.conf.

  • Support for iSCSI multipath in Huawei driver.

  • Support iSCSI configuration in replication in Huawei driver.

  • The Scality driver has been marked as unsupported and is now deprecated. enable_unsupported_drivers will need to be set to True in cinder.conf to continue to use it.

  • While configuring NetApp cDOT back ends, new configuration options (‘replication_device’ and ‘netapp_replication_aggregate_map’) must be added in order to use the host-level failover feature.

  • Pure volume drivers will need ‘purestorage’ python module v1.6.0 or newer. Support for 1.4.x has been removed.

  • The XML API has been removed in Newton release. Cinder supports only JSON API request/response format now.

  • The ISERTgtAdm target was deprecated in the Kilo release. It has now been removed. You should now just use LVMVolumeDriver and specify iscsi_helper for the target driver you wish to use. In order to enable iser, please set iscsi_protocol=iser with lioadm or tgtadm target helpers.

  • The config options scheduler_topic, volume_topic and backup_topic have been removed without a deprecation period as these had never worked correctly.

  • Users of the IBM Storage Driver, previously known as the IBM XIV/DS8K driver, upgrading from Mitaka or previous releases, need to reconfigure the relevant cinder.conf entries. In most cases the change is just removal of the xiv-ds8k field prefix, but for details use the driver documentation.

  • Deployments doing continuous live upgrades from master branch should not upgrade into Ocata before doing an upgrade which includes all the Newton’s RPC API version bump commits (scheduler, volume). If you’re upgrading deployment in a release-to-release manner, then you can safely ignore this note.

  • EMC ScaleIO driver now uses the config option san_thin_provision to determine the default provisioning type.

  • If using the key manager, the configuration details should be updated to reflect the Castellan-specific configuration options.

  • use oslo_middleware.sizelimit rather than cinder.api.middleware.sizelimit compatibility shim

  • The default interval for polling vCenter tasks in the VMware VMDK driver is changed to 2s.

  • The VMware VMDK driver supports a new config option ‘vmware_host_port’ to specify the port number to connect to vCenter server.

  • For EMC VNX backends, please upgrade to use cinder.volume.drivers.emc.vnx.driver.EMCVNXDriver. Add config option storage_protocol = fc or storage_protocol = iscsi to the driver section to enable the FC or iSCSI driver respectively.

Deprecation Notes

  • IntOpt datera_num_replicas is changed to a volume type extra spec option– DF:replica_count

  • BoolOpt datera_acl_allow_all is changed to a volume type extra spec option– DF:acl_allow_all

  • Configuring Volume Drivers in the DEFAULT config stanza is not going to be maintained and will be removed in the next release. All backends should use the enabled_backends config option with separate stanza’s for each.

  • Deprecated the configuration option nas_ip. Use option nas_host to indicate the IP address or hostname of the NAS system.

  • The old HNAS drivers configuration paths have been marked for deprecation.

  • The XML configuration file used by the HNAS drivers is now deprecated and will no longer be used in the future. Please use cinder.conf for all driver configuration.

  • The Scality driver has been marked as unsupported and is now deprecated. enable_unsupported_drivers will need to be set to True in cinder.conf to continue to use it. If its support status does not change it will be removed in the next release.

  • All barbican and keymgr config options in Cinder are now deprecated. All of these options are moved to the key_manager section for the Castellan library.

  • cinder.api.middleware.sizelimit was deprecated in kilo and compatability shim added to call into oslo_middleware. Using oslo_middleware.sizelimit directly will allow us to remove the compatability shim in a future release.

  • VMware VMDK driver deprecated the support for vCenter version 5.1

  • Old VNX FC (cinder.volume.drivers.emc.emc_cli_fc.EMCCLIFCDriver)/ iSCSI (cinder.volume.drivers.emc.emc_cli_iscsi.EMCCLIISCSIDriver) drivers are deprecated. Please refer to upgrade section for information about the new driver.

Security Issues

  • The qemu-img tool now has resource limits applied which prevent it from using more than 1GB of address space or more than 2 seconds of CPU time. This provides protection against denial of service attacks from maliciously crafted or corrupted disk images.

Bug Fixes

  • 3PAR driver creates FC VLUN of match-set type instead of host sees. With match-set, the host will see the virtual volume on specified NSP (Node-Slot-Port). This change in vlun type fixes bug 1577993.

  • Added the options visibility and protected to the os-volume_upload_image REST API call.

  • Projects with the admin role are now allowed to operate on the quotas of all other projects.

  • Volumes created on NetApp cDOT and 7mode storage systems now report ‘multiattach’ capability. They have always supported such a capability, but not reported it to Cinder.

  • NetApp cDOT block and file drivers now report replication capability at the pool level; and are hence compatible with using the replication_enabled extra-spec in volume types.

  • Fixed StorWize/SVC error causing volume deletion to get stuck in the ‘deleting’ state when using FlashCopy.

  • Fixed issue where the HNAS driver was not correctly reporting THIN provisioning and related stats.

  • Fixed live migration on EMC VMAX3 backends.

  • Fix issue with PureFCDriver where partially case sensitive comparison of connector wwpn could cause initialize_connection to fail when attempting to create duplicate Purity host.

  • Fixed ‘No Space left’ error by dd command when users set the config option volume_clear_size to a value larger than the size of a volume.

  • Fixed backup and restore of volumes in VMware VMDK driver.

  • Fixed the VMware VMDK driver to create volume from image in ova container.

  • Added support for images with vmware_adaptertype set to paraVirtual in the VMDK driver.