Due to a ransomware attack, the wiki was reverted to a July 2022 version. . We apologize for the lack of a more recent valid backup.
| Warning | ||
|---|---|---|
| ||
This page is deprecated and may be removed in a near future. |
| Table of Contents |
|---|
Introduction
In this wiki page, we are going to show you how to setup the hardware switches for CORD Fabric.
Here we focus on Accton 6712 40G x 32 switches, which are the switches we use to build the CORD Pod in ON.Lab.
Ideally, all hardware switches running OF-DPA pipeline should be compatible with the Fabric control logic (i.e. Segment Routing app on ONOS)
Wire Up
Connect power cable, console port and management network.
Install Open Networking Linux (ONL)
The switches are shipped with Open Networking Install Environment (ONIE) bootloader. After booting up, we should see the ONIE prompt from console.
Here we assume that the management port on the switch already has Internet access. (via DHCP)
In the console, type
...
| Info |
|---|
The switch will automatically reboot into ONL after installation. Default login credential of ONL is: root/onl |
Configure Management Interface
We might want to configure a fixed IP address for the management interface.
First edit /etc/network/interfaces and configure ma1, which is the management interface.
...
| Code Block |
|---|
# persist /etc/network/interfaces # savepersist |
Install OF-DPA package
| Info |
|---|
The OF-DPA package is a Debian package that includes the OF Agent. You need this file for 6712s and 5712s which are both x86 based: ofdpa-i.12.1.1_12.1.1+accton1.7-1_amd64.deb For 5710s use the powerpc debian package: ofdpa-i.12.1.1_12.1.1+accton1.7-1_powerpc.deb Download from here: https://github.com/onfsdn/atrium-docs/tree/master/16A/ONOS/builds Please note: Only this version of OF-DPA will work for the fabric! |
...
| Code Block |
|---|
# service ofdpa stop # dpkg -i --force-overwrite /mnt/flash2/ofdpa-i.12.1.1_12.1.1+accton1.7-1_amd64.deb |
(Optional) Configure OF-DPA
By default, all 32 ports are running in 1x40G mode. The /etc/accton/ofdpa.conf need to be modified if we want to break out 1x40G into 4x10G.
...
| Code Block |
|---|
# service ofdpa restart # persist /etc/accton/ofdpa.conf # savepersist |
Run ONOS
Please follow the same instruction as described in [Archived] Software Switch Installation Guide ONOS section.
| Note |
|---|
Host learning is not fully supported with OFDPA switches at this moment. Please refer to Network Config Host Provider and configure host manually. Detail: CORD-86 |
Run Indigo OpenFlow Agent
Run Indigo OpenFlow Agent to connect the switch to controller(s)
| Code Block |
|---|
# brcm-indigo-ofdpa-ofagent --dpid=0x0000000000000001 --controller=10.128.10.5 --controller=10.128.10.6 --controller=10.128.10.7 |
(Optional) Useful Configurations
As mentioned, the OF-DPA package need to be installed every time switch is rebooted. We can add it into /etc/rc.local so it will be automatically installed
...
| Code Block |
|---|
# persist /etc/rc.local # savepersist |
Useful Commands
There are some useful commands under /usr/bin/ofdpa-2.0-ea3/examples/
| Code Block |
|---|
client_cfg_purge client_debugcomp client_debuglvl client_drivshell client_event client_flowtable_dump client_grouptable_dump client_oam_dump client_port_table_dump client_tunnel_dump ofdpa_bridging.py ofdpa_mplsl3vpn.py ofdpa_mpls_lsr_ecmp.py ofdpa_mpls_lsr.py ofdpa_pktrx_setup.py ofdpa_pktrxtx.py OFDPA_python.py ofdpa_routing.py ofdpa_srcmac_learn.py ofdpa_vxlan.py |
Debugging
Sometimes the switch fails to install OpenFlow rules because they are not compliant with the OFDPA requirements. In these cases you may want to run OFDPA in debug mode to get more insight on how to properly install the flow rules. To enable debugging mode type the following:
...
After this, you should be able to see more comprehensible messages.
Recovery from a faulty ONL install
If, for some reason, the ONL install process fails, you may be brought to the grub rescue prompt upon reboot. You may or may not find system files, or even basic grub rescue commands (i.e. 'help'). There are two options for returning to a (known working) ONIE prompt.
...