JUNIPER –DISAGGREGATION

STATUS AND UPDATE

Savi Venkatachalapathy
Dr. PLM

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
DISCLAIMER
This statement of direction sets forth Juniper Networks current
intention and is subjected to charge at any time without notice. No
purchases are contingent upon Juniper Networks delivering any
feature or functionality depicted in this presentation.

This presentation contains proprietary information and should not be

discussed or shared without a signed non-disclosure agreement
(NDA).
© 2019 Juniper Networks 2
Juniper Business Use Only
Juniper Business Use Only
 AGENDA

• Disaggregation
• Overview
• Benefits and Challenges

• Disaggregation
• Control Plane
• Routing Stack
• NOS

• Summary

• Q&A

© 2019 Juniper Networks 3

Juniper Business Use Only
Juniper Business Use Only
 Disaggregation overview

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
 DISAGGREGATION – POSSIBLE MEANINGS

Supplier Disaggregation NOS Disaggregation

• HW and NOS SW from different vendors • Control plane, Data plane and Management plane from
• HW from ODM termed as “White Box” devices different vendors. Ex: SONiC,cRPD, P4Runtime
• OCP, TIP driving standards for ONL, ONLP • Standards based interfaces and interactions. Ex: SAI, P4
• NOS SW could be further disaggregated

Juniper poised to address Disaggregation!!

© 2019 Juniper Networks 5

Juniper Business Use Only
Juniper Business Use Only
 DISAGGREGATION – BENEFITS AND CHALLENGES

Desired Benefits Current Challenges

• Innovation • Standards and API still evolving

• Mix & match best of breed components • Functional components not plug and play (yet)
• Agility • Onus of system integration shifted to customer
• Upgrade functional blocks with minimal disruption • Support and procurement models more complex
• Rapid scaling of network functions in cloud and/or virtualized • None above are insurmountable; but a reflection of current
appliances state of industry and work needed to operationalize
• Cost disaggregation
• Leverage cloud economics with containerized network
functions
• Operational Efficiency
• Decouple software delivery and hardware supply chain risks

© 2019 Juniper Networks 6

Juniper Business Use Only
Juniper Business Use Only
 JUNOS on WHITE BOX

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
JUNOS – SOFTWARE ARCHITECTURE

CLL, XML, JSON, REST APIs, Apache Thrift, Cloud Management

ONIE is an install environment

Python, Thrift
Junos Junos PFE (Forwarding drivers) code and

Automation

Guest App
Analytics
Active Standby PFE Platform Platform code unplugged from Junos
(Native (Native and run natively on Linux
Linux) Linux)
VM VM Forwarding driver and platform code can
be upgraded independent of Junos
Linux KVM
Junos abstraction from hardware which
System Services Wind River Linux 7 (Yocto) accelerates pace of innovation

ONIE

Hardware (x86 CPU, SDRAM, Merchant ASIC and Juniper ASIC) Stepping stone towards disaggregation
of HW and SW

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
 SWITCH HARDWARE – PLATFORM ARCHITECTURE

Junos Dependencies
App

Control Plane
• HAL
– No standard APIs
– SAI falls short
• Platform Drivers
PI

– ONL Drivers
Chassis Management HAL – Dependent on ODM
vendors
• Chassis Management
– Dependent on ONLP/OpenBMC
Platform Drivers PFE implementation
PD

SDK – Dependent on OOM/Optic drivers

Drivers
for pluggable optics
Optics FRU LED PFE-ASIC

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
 JUNOS ON WB – DESIGN APPROACH

Collaborative Approach
• Open Networking HW: x86 CPU, OCP
Open Network Install Environment (ONIE)

Compliant
Management
Process • Data Plane: Integrate the underlying
PFE SDK into the control plane
Control Plane Chassis • FRU Management: Integrate with the
Process Management user space FRU drivers from the
Process vendors.
• Chassis Management: Handshake
Data Plane Process FRU Management between the control plane process and
Process the FRUs. Integrates Optics, LEDs.
• Control Plane: High level process for
PFE FRUs
control plane applications
Open Networking Hardware
(Intel CPU, Merchant Silicon, PSUs, Fans, Optics)

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
JUNOS DISAGGREGATION – OCP WHITE BOX Shipping

Junos
Control Plane
Junos Mgmt
Plane
Data plane • In production at multiple Customer
deployments
Merchant Chassis &
FRU drivers
PFE SDK
• Support model with Juniper JTAC for
HW and Vendor for SW
ONIE Linux

OCP compliant platform • Customer relying on their DevOps

Fans PSU
for Day0 installation and
Optics LED
Intel CPU Merchant Silicon deployments

Supported White box HCL

• Accton Edgecore7816-64X-O (Tomahawk2) – website doesn’t refer JunOS https://www.edge-
core.com/productsInfo.php?cls=1&cls2=5&cls3=166&id=309
11
Under consideration (2020)
• Trident 4 (ODM vendor TBD)

© 2019 Juniper Networks 11

Juniper Business Use Only
Juniper Business Use Only
 JUNOS INFRASTRUCTURE
for DISAGGREGATION

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
DISAGGREGATION – JUNOS EVOLUTION

Linux Centricity Disaggregation

3rd PFE MGD
Programmability PFE Other
Party
MGD
APIs APIs
Automation PFE MGD
Platform RPD
RPD Platform ZTP L2 RPD
MGD PFE
APIs
Platform Juniper or 3rd Party SW Infra
RPD Platform Junos VM Distributed SW Infrastructure

Junos FreeBSD Junos Linux Junos Linux 3rd Party Linux

Juniper HW Juniper HW Juniper HW Juniper or 3rd Party HW

• FreeBSD Unix • Openflow • All Linux native applications • Disaggregated RPD

• NETCONF • OpenConfig • Software modularity • SONiC on Juniper
• gRPC (gNMI, gNOI, gRIBI) • Support of 3rd party software • EVO on white box
• JET & JTI
• P4 (via AFT)

90’s - 2012 2014+ 2019+

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
 • Market leadership in Junos
JUNOS EVOLVED - IN A NUTSHELL • Enhanced in Junos Evolved

External Tooling (ZTP, Puppet…) and Controllers

Streaming Mgmt Plane API JET Control

Consistent control, management and data plane
(SNMP, CLI, NETCONF, Forwarding Plane API
telemetry Plane API • RPD, MGD, L2 apps
OpenConfig) (OpenFlow, P4, AFI)
• PFE 2.0 (AFT) for custom ASIC based HW

Openness
• Linux native platform and apps
Mgmt Routing
3rd • Support for 3rd party software and tools
Party
Modularity
Platform • Component level design with resiliency
Fwd • Support for hitless component upgrade
Sensors
Logically Centralized Database
State DB
• All state modelled and API Accessible
Linux • Pub-sub communication between components
• Strong fault isolation between components
Hardware • Improved diagnostics for rapid debugging

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
JUNOS EVOLVED - ARCHITECTURE

Linux as base OS
• Leverage wide support and vast developer base.
• Use open source tools wherever possible.
RPD MGD Platform Fabric PFE …….
• Support standard Linux tools
• Native Linux applications
Pub-sub state system Remove state from kernel
• No kernel state repository and state propagation.
• Minimize changes to kernel.
Linux Kernel • Separate logic from state

Modularity
ASIC • Formalized interfaces between components.
• Pub-sub communication between components
• Clear separation / fault isolation between
components.
• Lego blocks to support different use cases.
• Support component upgrade without system reboot.

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
 JUNOS EVOLVED - 3RD PARTY APPS

JET APIs • 3rd party applications can be run on host or in

docker or LXC container. (Requires Junos toolchain
Container

App App to build custom application on host)

Linux API
Linux API
RPD
intercept
intercept • Containers can be a different Linux distro with it’s
own package manager
/proc netdevice ioctl netlink
• Support for agent-based DevOps tools to manage
Intercept Library the device (ex: Chef, Puppet)

• Support for Linux Network APIs through intercept

/proc Netdevice ioctl netlink library (using LD_PRELOAD)
Linux
Packet I/O

Physical device ports

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
JUNOS EVOLVED - 3RD PARTY APPS (CONTD.)

Facility Notes container native

Packet IO and Ability to send and receive packets over mgmt and/or data interfaces. ✅ ✅
Linux socket APIs Standard libc – send, receive, listen, etc.
rtnetlink Ability to use rtnetlink to query networking state like interfaces, routes, ✅ ✅
etc.
netdevice Ability to read network devices ✅ ✅
proc Ability to query kernel data structures using standard interfaces ✅ ✅
provided by Linux kernel
Junos APIS Ability to access Juniper North Bound APIs - NetConf/JET/Telemetry ✅ ✅
Linux package Ability to use standard Linux package management ✅ ❌
manager

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
 JUNOS ROUTING STACK
DISAGGREGATION

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
CONTAINDERIZED ROUTING PROTOCOL - CRPD

• Platform flexibility with choice of x86

server/Switch
• Cloud deployment model
• Junos Innovation with Juniper’s
Routing, Telemetry and Analytics
• Enhanced automation and optimized
network operations with API
programmability, diagnostics
• Open Programmability with ongoing
support for SONiC, Open/R,
OpenConfig

JunOS routing stack in a process/container, controlling native host routing table

© 2019 Juniper Networks 19

Juniper Business Use Only
Juniper Business Use Only
CRPD – PRODUCT OVERVIEW

Automation

• Containerized Juniper Routing stack

• Lightweight (<400MB)
JET JET

Management
Cli, Netconf, SNMP, OpenConfig • Fast start-up (seconds v/s minutes)
Routing Protocols
BGP, IGP, STATIC • Same Junos Management stack such
Routing Infrastructure as APIs, Netconf/YANG, Openconfig
Telemetr
y
RIB, Label Manager, BFD Telemetr
y

FIB Adaptation Layer • Orchestrated by K8s, OpenShift

Netlink, rtsock, fpm

© 2018
© 2019
Juniper
Juniper
Networks
Networks
Juniper Business Use Only
Juniper Business Use Only
CRPD - ARCHITECTURE

• Interface states from kernel via

Netlink

• Injects route state to kernel

• Adapters to inject route state to FIB

© 2019 Juniper Networks 21

Juniper Business Use Only
Juniper Business Use Only
CRPD - USE CASES

Reliable Routing stack from Juniper

Use Cases
• Host Based Routing:
• Enables L3 connectivity between
servers and ToR switches
• Egress Peer Traffic Engineering:
• Central controller to instruct ingress
router to direct traffic across spefici
egress router
• Enables egress peer TE to select best
advertised egress route and mapping
to the specific egress point
• Route Reflector
• For scale-out IP CLOS fabric

© 2019 Juniper Networks 22

Juniper Business Use Only
Juniper Business Use Only
 SWITCH NOS
DISAGGREGATION

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only
SONIC - OVERVIEW
Applications

Routing
Stack
Telemetry/
Analytics
Management
Stack • Open Source switch OS based on
Linux (Debian)
Switch State Service • Decouples switch hardware and
syncd software
User Space SONiC
SAI
• Leverages ONIE Bootloader
ASIC SDK

• Built on SAI for the forwarding plane

programming
Platform Drivers
(Fan, PSU, Sensors, Eeprom)
Network Drivers ASIC Drivers
• Growing ecosystem with backing
Kernel Space
from ASIC vendors and OEM
• Containerized Switch software
CPU Memory ASIC
Fans PSU
Optics LED components
Hardware
24

Switch Vendor Provided

© 2019 Juniper Networks 24

Juniper Business Use Only
Juniper Business Use Only
SONIC - ARCHITECTURE

• Redis DB Container
• Hosts APPL_DB, CONFIG_DB, ASIC_DB,
STATE_DB, COUNTERS_DB
• Accessible to applications through UNIX socket
• SWSS Container
• Communication across all other modules and
Redis DB Engine
• Hosts both producers and consumers of the DB
• Syncd Container
• Syncs the switch n/w state and ASIC state
• Initializes and configures the switch ASIC
• Fpmsynd Daemon
• Syncs the FIB state from the Routing daemon to
the APPL_DB

© 2019 Juniper Networks 25

Juniper Business Use Only
Juniper Business Use Only
CRPD - WITH SONIC Development

cPRD runs as a Docket Container

Integrated with the fpmsyncd container

Provides FIB interface orchestration, host path

Packet I/O

Features:

• BGP: inet, inet6, add-path, BMP, EVPN-

signaling

• ECMP

• BFD

© 2019 Juniper Networks 26

Juniper Business Use Only
Juniper Business Use Only
JUNIPER HARDWARE – WITH SONIC SWITCH OS Development

Juniper
Routing
Other
containers
3rd party
• Single PFE Switch:
(Telemetry
containers
Stack
(RPD)
Mgmt,
Services)
• Broadcom SAI
• Juniper platform drivers uploaded on
SONiC GitHub
Switch State Service
• Support for QFX5210-64C
SAI API
• Multi PFE Switch:
ONIE Linux • Juniper to implement a SAI shim layer
Platform Juniper SAI
drivers Shim • Platform drivers for

Platform:
OCP/Juniper/3rd party ASICs

Juniper contribution

© 2019 Juniper Networks 27

Juniper Business Use Only
Juniper Business Use Only
DISAGGREGATED SW – LICENSE MODEL

HW Software License
Classification Licenses Portability

WB categorized into HW 3 tiers of Licenses: Standard, Portability within the same

classes Advanced and Premium class

HCL for each class published SW license tiers per each

class.
New classes added on rolling
basis Subscription licenses with
flexible terms

© 2019 Juniper Networks 28

Juniper Business Use Only
Juniper Business Use Only
DISAGGREGATED SW – SUPPORT MODEL

Mandatory support purchase

JTAC
Software Juniper is first line of support

Provided by WB Vendor
Hardware Juniper will not handle RMA/Sparing

© 2019 Juniper Networks 29

Juniper Business Use Only
Juniper Business Use Only
SUMMARY

• JunOS supports disaggregation – ASIC certification is a one-off exercise

• Shipping Junos SW licenses for White Box

• White box, virtual and containerized applications top use cases

• cRPD

• Emerging use case: SONiC

• Supported on Juniper QFX5210-64C platform
• planned to support on QFX5200-32C

© 2019 Juniper Networks 30

Juniper Business Use Only
Juniper Business Use Only
 THANK YOU

© 2019 Juniper Networks

Juniper Business Use Only
Juniper Business Use Only