Warning

title	Deprecated

This page is obsolete and will be removed soon, please see https://wiki.opencord.org/display/CORD/VTN+Developer+Information instead.

You will need:

An ONOS cluster installed and running
An OpenStack service installed and running ("stable/mitaka" version is used

Note
This page explains how to set up and use the CORD-VTN service manually. It is possible to test CORD-VTN without XOS, but it is recommended to set up CORD-VTN with XOS. This link https://github.com/open-cloud/xos/blob/master/xos/configurations/cord-pod/README.md would be helpful if you're going to build whole CORD test environment.

You will need:

An ONOS cluster installed and running (see ONOS documentation to get to this point)
An OpenStack service installed and running (detailed OpenStack configurations are described here)
An XOS installed and running (optional if you need to test CORD VTN functionalities only, not the other CORD services)

Note
Note that official CORD reference implementation deploys all controller services including ONOS, OpenStack and XOS run on the one single "head node" but this page deploys the controller services in separate nodes.

...

Architecture

The high level architecture of the system is shown in the following figure.

...

Bootstraps OVS and "br-int" interface in a compute node to be controlled by ONOS and CORD-VTN properly
Provides a basic connectivity among all VMs in the same service(i.e. same Neutron network).
Provides an external connectivity to a VM with public type of service network.
Provides a local management connectivity, which is a limited connection between a VM and compute node.
Provides a service dependency between two services. It guarantees forwarding all traffics from 'service A', which is tenant service, to one of the VM of 'service B', which is provider service.
Provides WAN and LAN connectivities for vSG container.
Provides APR ARP and DHCP proxy for the virtual networks.

...

Let's install networking-onos (Neutron ML2 plugin for ONOS) first.

Code Block

language	bash

$ gitmkdir clone-p https://githubopt/stack && cd /opt/stack
$ git clone https://github.com/openstack/networking-onos.git
$ cd networking-onos
$ sudo python setup.py install

...

Specify ONOS access information. You may want to copy the config file to /etc/neutron/plugins/ml2/ where the other Neutron configuration files are.

Code Block

language	bash
title	networking-onos/etc/conf_onos.ini

# Configuration options for ONOS ML2 Mechanism driver
[onos]
# (StrOpt) ONOS ReST interface URL. This is a mandatory field.
url_path = http://onos.instance.ip.addr:8181/onos/cordvtn
# (StrOpt) Username for authentication. This is a mandatory field.
username = onos
# (StrOpt) Password for authentication. This is a mandatory field.
password = rocks

...

For DevStack users, use this sample DevStack local.conf to build OpenStack controller node. Make sure your DevStack branch is consistent with the OpenStack branches, "stable/mitaka" in this example.

Code Block

title	local.conf of Controller Node

[[local|localrc]]
HOST_IP=10.134.231.28
SERVICE_HOST=10.134.231.28
RABBIT_HOST=10.134.231.28
DATABASE_HOST=10.134.231.28
Q_HOST=10.134.231.28

ADMIN_PASSWORD=nova
DATABASE_PASSWORD=$ADMIN_PASSWORD
RABBIT_PASSWORD=$ADMIN_PASSWORD
SERVICE_PASSWORD=$ADMIN_PASSWORD
SERVICE_TOKEN=$ADMIN_PASSWORD

DATABASE_TYPE=mysql

# Log
SCREEN_LOGDIR=/opt/stack/logs/screen

# Images
IMAGE_URLS="http://cloud-images.ubuntu.com/releases/14.04/release/ubuntu-14.04-server-cloudimg-amd64.tar.gz,http://www.planet-lab.o    rgorg/cord/trusty-server-multi-nic.img"
FORCE_CONFIG_DRIVE=alwaysTrue


NEUTRON_CREATE_INITIAL_NETWORKS=False
# Networks
Q_ML2_TENANT_NETWORK_TYPE=vxlan
Q_ML2_PLUGIN_MECHANISM_DRIVERS=onos_ml2
Q_PLUGIN_EXTRA_CONF_PATH=/opt/stack/networking-onos/etc
Q_PLUGIN_EXTRA_CONF_FILES=(conf_onos.ini)

NEUTRON_CREATE_INITIAL_NETWORKS=False

# Services
enable_service q-svc
disable_service n-net
disable_service n-cpu
disable_service tempest
disable_service c-sch
disable_service c-api
disable_service c-vol
 
# Branches
GLANCE_BRANCH=stable/mitaka
HORIZON_BRANCH=stable/mitaka
KEYSTONE_BRANCH=stable/mitaka
NEUTRON_BRANCH=stable/mitaka
NOVA_BRANCH=stable/mitaka

If you use other deploy tools or build the controller node manually, please set the following configurations to Nova and Neutron configuration files.

...

Code Block

language	bash
title	/etc/neutron/neutron.conf

core_plugin = neutron.plugins.ml2.plugin.Ml2Plugin
dhcp_agent_notification = falseFalse

Code Block

title	/etc/neutron/plugins/ml2/ml2_conf.ini

[ml2]
tenant_network_types = vxlan
type_drivers = vxlan
mechanism_drivers = onos_ml2

[securitygroup]
enable_security_group = True

...

Code Block

title	/etc/nova/nova.conf

[DEFAULT]
force_config_drive = alwaysTrue
network_api_class = nova.network.neutronv2.api.API
security_group_api = neutron
 
[neutron]
url = http://[controller_ip]:9696
auth_strategy = keystone
admin_auth_url = http://[controller_ip]:35357/v2.0
admin_tenant_name = service
admin_username = neutron
admin_password = [admin passwd]

...

Code Block

title	local.conf for Compute Node

[[local|localrc]]
HOST_IP=10.134.231.30  <-- local IP
SERVICE_HOST=162.243.x.x  <-- controller IP, must be reachable from your test browser for console access from Horizon
RABBIT_HOST=10.134.231.28
DATABASE_HOST=10.134.231.28

ADMIN_PASSWORD=nova
DATABASE_PASSWORD=$ADMIN_PASSWORD
RABBIT_PASSWORD=$ADMIN_PASSWORD
SERVICE_PASSWORD=$ADMIN_PASSWORD
SERVICE_TOKEN=$ADMIN_PASSWORD

DATABASE_TYPE=mysql

NOVA_VNC_ENABLED=True
VNCSERVER_PROXYCLIENT_ADDRESS=$HOST_IP
VNCSERVER_LISTEN=$HOST_IP

LIBVIRT_TYPE=kvm
# Log
SCREEN_LOGDIR=/opt/stack/logs/screen

# ImagesServices
IMAGEENABLED_URLS="http://cloud-images.ubuntu.com/releases/precise/release/ubuntu-12.04-server-cloudimg-amd64.tar.gz"

LIBVIRT_TYPE=kvm

# Services
ENABLED_SERVICES=n-cpu,neutronSERVICES=n-cpu,neutron
 
# Branches
NOVA_BRANCH=stable/mitaka
KEYSTONE_BRANCH=stable/mitaka
NEUTRON_BRANCH=stable/mitaka

Note
If your compute node is a VM, try http://docs.openstack.org/developer/devstack/guides/devstack-with-nested-kvm.html this first or set `LIBVIRT_TYPE=qemu`. Nested KVM is much faster than `qemu`, if possible.

...

Additional compute node setup

1. Set . Make sure your OVS version is 2.3.0 or later.

2. Set OVSDB listening mode in your compute nodes. There are two ways.

Code Block
$ ovs-appctl -t ovsdb-server ovsdb-server/add-remote ptcp:6640:host_ip

...

Code Block
$ sudo ovs-vsctl show cedbbc0a-f9a4-4d30-a3ff-ef9afa813efb ovs_version: "2.3.0"

3. Make sure that ONOS user(sdn by default) can Should be able to SSH from ONOS instance to compute nodes with key.

...

Config Name	Descriptions
privateGatewayMac	MAC address of virtual private network gateway, it can be any MAC address
publicGateways	List of public network gateway and MAC address
publicGateway:gatewayIp	Public gateway IP
publicGateway:gatewayMac	MAC address mapped to the public gateway IP
localManagementIp	Management IP for a compute node and VM connection, must be CIDR notation
ovsdbPort	Port number for OVSDB connection (OVSDB uses 6640 by default)
ssh	SSH configurations
ssh: sshPort	Port number for SSH connection
ssh: sshUser	SSH user name
ssh: sshKeyFile	Private key file for SSH
openstack	OpenStack configurations
openstack: endpoint	OpenStack Keystone endpoint
openstack: tenant	Tenant name, this tenant must have admin authorization able to see all the network resources
openstack: user	User name, this user must have admin authorization able to see all the network resources
openstack: password	Password for the tenant and admin above
nodes	list of compute node information
nodes: hostname	hostname of the compute node, should be unique throughout the service
nodes: hostManagementIp	Management IP for a head node and compute node, it is used for OpenFlow, OVSDB, and SSH session. Must be CIDR notation.
nodes: dataPlaneIp	Data plane IP address, this IP is used for VXLAN tunneling
nodes: dataPlaneIntf	Name of physical interface used for tunneling
nodes: bridgeId	Device ID of the integration bridge (br-int)

Note
localManagementIp, dataPlaneIp and hostManagementIp must not be overlapped

-int)

Note
localManagementIp, dataPlaneIp and hostManagementIp must not be overlapped

Code Block

title	network-cfg.json

{
    "apps" : {
        "org.onosproject.cordvtn" : {
            "cordvtn" : {
                "privateGatewayMac" : "00:00:00:00:00:01",
                "publicGateways" : [
                    {

Code Block

title	network-cfg.json

{
    "apps" : {
        "org.onosproject.cordvtn          "gatewayIp" : {"10.141.192.158",
            "cordvtn" : {
                "privateGatewayMac"gatewayMac" : "00a4:0023:0005:0034:0056:0178",
                 "publicGateways"  : [}
                ],
          {
      "localManagementIp" : "172.27.0.1/24",
                "gatewayIpovsdbPort" : "207.141.192.1586640",
                "ssh" : {
      "gatewayMac" : "a4:23:05:34:56:78"
            "sshPort" : "22",
      }
              "sshUser" : ]"root",
                    "localManagementIpsshKeyFile" : "172.27.0.1/24"~/.ssh/id_rsa"
                },
                "ovsdbPortopenstack" : "6640",
{
                    "sshendpoint" : {"http://10.243.139.46:5000/v2.0/",
                    "sshPorttenant" : "22admin",
                    "sshUseruser" : "hyunsunadmin",
                    "sshKeyFilepassword" : "~/.ssh/id_rsanova"
                },
                "openstackxos" : {
                    "endpoint" : "http://10.24355.13930.46:5000/v2.0/",
                    "tenant" : "admin"16:80",
                    "user" : "adminpadmin@vicci.org",
                    "password" : "novaletmein"
                },
                "nodes" : [
                    {
                        "hostname" : "compute-01",
                        "hostManagementIp" : "10.55.25.244/24",
                        "dataPlaneIp" : "10.134.34.222/16",
                        "dataPlaneIntf" : "veth1veth0",
                        "bridgeId" : "of:0000000000000001"
                     },
                     {
                        "hostname" : "compute-02",
                        "hostManagementIp" : "10.241.229.42/24",
                        "dataPlaneIp" : "10.134.34.223/16",
                        "dataPlaneIntf" : "veth1veth0",
                        "bridgeId" : "of:0000000000000002"
                     }
                ]
            }
        }
    }
}

...

Code Block

onos> devices
id=of:0000000000000001, available=true, role=MASTER, type=SWITCH, mfr=Nicira, Inc., hw=Open vSwitch, sw=2.03.2, serial=None, managementAddress=compute.01.ip.addr, protocol=OF_13, channelId=compute.01.ip.addr:39031
id=of:0000000000000002, available=true, role=STANDBY, type=SWITCH, mfr=Nicira, Inc., hw=Open vSwitch, sw=2.03.2, serial=None, managementAddress=compute.02.ip.addr, protocol=OF_13, channelId=compute.02.ip.addr:44920

...

Code Block

language	bash

$ curl -X POST -u onos:rocks -H "Content-Type:application/json" http://[onos_ip]:8181/onos/cordvtn/service-dependency/[net-A-UUID]/[net-B-UUID]/b

...

Code Block
$ curl -X DELETE -u onos:rocks -H "Content-Type:application/json" http://[onos_ip]:8181/onos/cordvtn/service-dependency/[net-A-UUID]/[net-B-UUID]

...

Page tree

Versions Compared

Old Version 100

New Version Current

Key

Architecture

Additional compute node setup

Page tree

Page History

Versions Compared

Old Version 100

New Version Current

Key

Architecture

Additional compute node setup