Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
titlesona-tempest.conf
[network-feature-enabled]
ipv6_subnet_attributes = False
ipv6 = False
api_extensions = default-subnetpools,network-ip-availability,subnet_allocation,external-net,router,security-group,ext-gw-mode,net-mtu
 ,tag,tag-ext,sorting,pagination,project-id,address-scope,standard-attr-description,standard-attr-revisions,standard-attr-timestamp,standard-attr-tag,quotas,flavors,net-mtu-writable,extraroute,quota_details,provider,service-type

[compute-feature-enabled]
metadata_service = False

[compute]
min_compute_nodes = 2

[network]
floating_network_name = net-public
project_networks_reachable = False

...

Code Block
languagebash
$ sudo docker exec -it router bash
╔═════════════════════════════════════════════════════════════════════════════╗###############################################################################
# Welcome to Rally Docker container!                                          ║
║  Rally certification tasks, samples and docs are located at /opt/rally/     ║
║#
#                                                                             #
#  WARNING: DO NOT OVERRIDE /home/rally DIRECTORY                             #
#                                                                             #
#  /home/rally/data      - a default place with rally database. Use it for    #
#      mounting own directories and synchronizing rally database.             #
#  /home/rally/source    - a directory with documentation, pre created tasks, #
#      sampes and source code                                                 #
#  /etc/rally/rally.conf - a default configuration file of rally. To override #
#      it, mount custom configuration file to /home/rally/.rally/rally.conf   #
#                                                                             #
#  Rally at readthedocs - http://rally.readthedocs.org                        #
#  How to contribute - http://rally.readthedocs.org/en/latest/contribute.html #
#  If you have any questions, you can reach the Rally team by:                #
#    * e-mail - openstack-dev@lists.openstack.org with tag [Rally] in subject ║
║ #
#    * gitter - https://gitter.im/xRally/Lobby room                           #
#    * irc - "#openstack-rally" channel at freenode.net                       #
╚═════════════════════════════════════════════════════════════════════════════╝
###############################################################################

root@router:/home/rally# rm -rf data && mkdir -p data
root@router:/home/rally# rally-manage db recreate
root@router:/home/rally# source admin-openrc.sh
root@router:/home/rally# rally deployment create --fromenv --name sona-test

...

Code Block
languagebash
root@router:/home/rally# rally verify create-verifier --type tempest --name tempest-verifier --source https://github.com/sonaproject/tempest.git --version pikerocky
root@router:/home/rally# rally verify configure-verifier --extend sona-tempest.conf


Run Test

1. Create sona-skip-list.yaml as below to filter out not supported feature tests. Note that, by far SONA is verified against all tempest tests, but if some of the tests fail, you need to add the failed tests into the skip list. The latest version of blacklist of test cases can be found in following link. https://github.com/sonaproject/tempest-sona-conf/blob/master/sona-skip-list.yaml

Code Block
titlesona-skip-list.yaml
tempest.scenario.test_snapshot_pattern.TestSnapshotPattern.test_snapshot_pattern[compute,id-608e604b-1d63-4a82-8e3e-91bc665c90b4,image,network,slow]: "not support"
neutron_tempest_plugin.api.test_routers.RoutersTest.test_router_interface_status[id-db3093b1-93b6-4893-be83-c4716c251b3e]: "not support"


2. Now, run Tempest network related API and scenario tests.

Code Block
rally@1cc98e0b5941:~$root@router:/home/rally# rally verify start --pattern network --skip-list sona-skip-list.yaml --detail
2017-05-16 06:03:35.215 1109 INFO rally.api [-] Starting verification (UUID=e9fcd543-a438-4845-82a9-62cc2ead2693) for deployment 'sona-test' (UUID=f51f26b4-0603-4f8a-a29a-21d045d898df) by verifier 'tempest-verifier' (UUID=aadced51-ddf6-4cb9-a422-df0d51119679).

======
Totals
======

Ran: 326 336 tests in 1806.546 sec.
 - Success: 161
 - Skipped: 175
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=42b6f756-7ebf-4d6b-b0f4-dd41c06bd8ae) as the default verification for the future operations.

Verify Against Tempest Plugin

1. If you would like to verify SONA against neutron-tempest-plugin, you need to add the plugin as a tempest extension using following command.

Code Block
languagebash
root@router:/home/rally# rally verify add-verifier-ext --source https://github.com/openstack/neutron-tempest-plugin.git


2. Now, run Tempest network related API and scenario tests.

Code Block
root@router:/home/rally# rally verify start --pattern neutron_tempest_plugin --skip-list sona-skip-list.yaml --detail
2017-05-16 06:03:35.215 1109 INFO rally.api [-] Starting verification (UUID=e9fcd543-a438-4845-82a9-62cc2ead2693) for deployment 'sona-test' (UUID=f51f26b4-0603-4f8a-a29a-21d045d898df) by verifier 'tempest-verifier' (UUID=aadced51-ddf6-4cb9-a422-df0d51119679).
======
Totals
======

Ran: 564 tests in 15151052.553455 sec.
 - Success: 150231
 - Skipped: 177333
 - Expected failures: 0
 - Unexpected success: 0
 - Failures: 0

Using verification (UUID=27174189fa929aeb-bbad5d68-4292464a-b58a9ae2-dccf7dfab99663a3c689304d) as the default verification for the future operations.