tempest

Tempest is a set of integration tests to be run against a live OpenStack cluster. Tempest has batteries of tests for OpenStack API validation, Scenarios, and other specific tests useful in validating an OpenStack deployment.

Alongside with the tempest project, this snap also includes the currently maintained tempest plugins, the python-tempestconf package and several curated test lists to provide ease of use.

The python-tempestconf package provides discover-tempest-config command line application that automatically generates a tempest configuration appropriate for your cloud.

Plugins

The snap provides all the plugins listed in the OpenStack release notes and those cannot be removed or updated. Currently, it is not possible to add new plugins or use your own.

List of plugins:

• barbican-tempest-plugin
• blazar-tempest-plugin
• cinder-tempest-plugin
• cloudkitty-tempest-plugin
• cyborg-tempest-plugin
• designate-tempest-plugin
• ec2api-tempest-plugin
• freezer-tempest-plugin
• glance-tempest-plugin
• heat-tempest-plugin
• ironic-tempest-plugin
• keystone-tempest-plugin
• kuryr-tempest-plugin
• magnum-tempest-plugin
• manila-tempest-plugin
• mistral-tempest-tests
• monasca-tempest-plugin
• murano-tempest-plugin
• neutron-tempest-plugin
• octavia-tempest-plugin
• oswin-tempest-plugin
• sahara-tests
• senlin-tempest-plugin
• solum-tempest-plugin
• telemetry-tempest-plugin
• trove-tempest-plugin
• venus-tempest-plugin
• vitrage-tempest-plugin
• watcher-tempest-plugin
• zaqar-tempest-plugin
• zun-tempest-plugin

Quickstart

Running the tempest smoke suite against a deployed OpenStack cloud would look like this.

# Install the tempest snap
sudo snap install tempest

# Have the cloud credentials in the environment
source novarc

# Initialize a tempest workspace directory called cloud-01
tempest init cloud-01
cd cloud-01

# Generate the tempest configuration specific to the cloud
# use `--create` flag if resources like flavors needs to be created
discover-tempest-config

# Run the tempest smoke suite
tempest run --smoke

For more information please refer to the Tempest QuickStart and python-tempestconf documentation.

Test Lists

The tempest snap provides a set of pre-defined test lists with different profiles and a mechanism to specify them easily.

The @BUILTIN_TESTLISTS keyword will be automatically replaced by the full path of the directory storing the built-in test lists.

Note: the single-quotation marks around the test list file path is required if the @BUILTIN_TESTLISTS keyword is used (in other words, when running tempest with a built-in test list file). Failure to do so will result in a wrong path error.

readonly-quick
For quickly verifying the behavior of the target cloud and making sure tempest is correctly set up

 tempest run --load-list '@BUILTIN_TESTLISTS/readonly-quick'

refstack-2022.11
Version 2022.11 of the RefStack guidelines. The list includes the required and advisory tests of all platforms.

 tempest run --load-list '@BUILTIN_TESTLISTS/refstack-2022.11'

Links

OpenStack Release Notes
https://releases.openstack.org/antelope/index.html#tempest-plugins

python-tempestconf
https://opendev.org/openinfra/python-tempestconf

discover-tempest-config
https://docs.opendev.org/openinfra/python-tempestconf/latest/cli/cli_options.html#discover-tempest-config

Tempest QuickStart
https://docs.openstack.org/tempest/latest/overview.html#quickstart

RefStack
https://refstack.openstack.org/#/