OPEN NETWORKING REVOLUTION

Aftab Siddiqui Internet Society

Technical Engagement Manager - Asia Pacific siddiqui@isoc.org

OpenComputeProjectOCPisacollabora-veandcommunityfocusedini-a-veonredesigninghardwaretechnologytoefficientlysupportthegrowingdemandsoncomputeinfrastructure.

Projects:• Storage• Networking• ServerDesign• OpenRack• Cer-fica-on• HardwareManagement• DataCenter

2

Tradi5onalNetworking

• ProprietaryFeatures

3

• FewAPIsAvailable

• Locked-inandcomplexsupportmodels

• MostlyproprietaryASICs

OpenNetworking

4

Operating System

• Cumulus Linux • PicOS • IPInfusion • SwitchLight OS • MS Sonic • FBOSS • Etc….

Open Standard Hardware

• Dell ON • HP Altoline • EdgeCore • Mellanox • Etc……

Merchant Silicon• Broadcom • Spectrum

Whataremyop5ons?

5

Vendor Model ASIC Ports CPU Memory

Dell S4048 Trident II 48x10G SFP+6x40G QSFP+ Intel Atom C2338 2GB

Dell S6000 Trident II 32x40G QSFP+ Intel Atom S1220 4GB

Dell Z9100 Tomahawk 32 x Multirate

Accton/EdgeCore/HP 5712 Trident II 48x10G SFP+

6x40G QSFP+ Intel Rangely C2538 8GB

Accton/EdgeCore/HP 6712 Trident II 40G x 32 Intel Rangely C2538 8GB

Mellanox SN2700 Spectrum 32 x Multirate Spectrum

Mellanox SN2100 Spectrum 16 x Multirate Spectrum

Facebook6-Pack….toocomplicated?

6

Fabric Card

Line Card [16 x 40G]

Facebook 6-Pack Modular Chassis

NetworkOpera5ngSystem• Hardwarespecifica-onofswitchesaremoreorlesssimilarbuttoughtaskistopicktherightNetworkOpera-ngSystem

• Bestwayistofindmajorrequirementandcheckthefeatures(nobrainer)

• IfthereisanyvirtualenvironmentavailableforthoseNOSthendeployandtest.

• CumulusLinuxandIPinfusionbothprovidevirtualizedversionsoftheirNOSandwithoutanysignificantrestric-ons

• CumulusVXisthemostuserfriendlyVMavailableto-date.Itsupportsallmajorenvironments

• AllNOSareevolvingquiterapidly,keepchecking.

7

FirstImpression

8

where is the CLI?

All the Network Operating Systems are based on Linux and therefore offer the same kind of CLI… CumulusLinux, OcNOS, ONL, Dell OS10 etc

FirstImpression

9

Linux

Every NOS offer different port naming convention Some NOS offer utilities to simplify command line config such as auto complete

FirstDeploymentExperience

Target:EstablishConnectivitybetweenmultiplePoPs.

Media:DarkFibre

ServiceOffering:Backhaul(Layer2)andTransitservices.

Budget:Challenging(wewereforcedtolookintowhitebox

switches)

ProjectTimelines:Weeksrathermonths

POC:Allservices(layer2andtransit)from4PoPs

10

FirstDeploymentExperience

● Network Design [Dell S4048-ON switches, CumulusLinux], VXLAN overlay

11

NotthatSimple

12

BasicAutoma5on

13

VariablesRequired:hname=HostnameAswp=NumberofInterfaceslip=LoopbackIPbint=Bondinterfacename(e.g.bond0)bslaves=Memberofbondinterfaces(separatewith,orspace)bip=BondIPlocalasn=LocalASN(Eg:420000XXXXwhereXXXXisPOP-ID)remotehname=HostnameB*nip=NeighbourIPforBGP(e.g.30.10.0.2)*remoteasn=RemoteASN(eg:420000XXXXwhereXXXXisPOP-ID)*-PopulatedAutomaticallyonselectionofRemoteHost

StandardConfigura5on

14

-CreateUserCredentials-EnableRouting(e.g.Quagga)-NTP-DNS-MOTD-SWPInterfaces

BasicAutoma5on

15

POP-A:autoswp4ifaceswp4mtu9216

autovni-600030ifacevni-600030vxlan-id600030vxlan-local-tunnelip30.30.0.1vxlan-remoteip30.10.6.1

autobr-vl104ifacebr-vl104bridge-portsswp4.104vn1-600030bridge-stpon

POP-B:autoswp4ifaceswp4mtu9216

autovni-600030ifacevni-600030vxlan-id600030vxlan-local-tunnelip30.10.6.1vxlan-remoteip30.30.0.1

autobr-vl104ifacebr-vl104bridge-portsswp4.104vn1-600030bridge-stpon

FirstDeploymentExperience•WhiteboxSwitchesaregoodeveninenterpriseandISPsaswell.Youdoneed10G/40G25G/50Gswitchesinyournetwork.

•CumulusLinuxworkedwellfor“almost”everythingweneededButreviewyourrequirementbeforeselectingNOS.

•VXLANcansolvemanyproblemstohelpde-clutterlayer2network.MTUcanbeakillerthough(50extraBytestoaccommodate)anditbreaksLACPandLLDP.

•OperationallysimpleandeconomicaldeploymentIFyouhaveproperautomation.

16

Thanks

AnyQues5ons

17

FirstDeploymentExperience• VXLANPacketCaptures

18