Building L2VPNs with Provider Backbone

Bridging Ethernet VPN (PBB-EVPN)

Implementation and Use Cases

April 23rd, 2014

Tina Lam (tinalam@cisco.com)
Jose Liste (jliste@cisco.com)

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 1
Todays Presenters

Tina Lam (tinalam@cisco.com)

Product Manager
Cisco

Jose Liste (jliste@cisco.com)

Technical Marketing Engineer
Cisco

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 2
 Agenda

What is PBB-EVPN and its benets?

PBB-EVPN in ASR9000

Use Cases

Demonstra?on

Summary

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public
What is PBB-EVPN?
xEVPN family introduces next
generation solutions for Ethernet
services
E-LAN E-LINE E-TREE
BGP control-plane for Ethernet Segment
and MAC distribution and learning over
MPLS core
Same principles and operational EVPN
experience of IP VPNs
No use of Pseudowires
Uses MP2P tunnels for unicast
Multi-destination frame delivery via ingress PBB- EVPN EVPN
replication (via MP2P tunnels) or LSM EVPN VPWS E-TREE
Multi-vendor solutions under IETF
standardization
Focus of Presentation
jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public
PBB-EVPN Business Advantages
Business Continuity All-Active (per-flow) access load-balancing
Fast convergence (link / node / MAC moves)
Service Robustness
Control-plane (BGP) learning in the Core. PWs no longer used
Designed to Scale Scalability of IP VPN. MAC address scalability

Per-flow and per-service access load-balancing

CapEx Optimization PE load-balancing (BGP multi-pathing). Access / core ECMP

Ease of Provision and Peer PEs auto-discovery. Redundancy group auto-sensing

Operational consistency with L3 IP VPN
Operation
Support existing and new service types (E-LAN, E-Line, E-
Service Flexibility TREE, VLAN-aware bundling)

Open standard
Investment Protection Multi-vendor support

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
PBB-EVPN in Cisco ASR9000

6
Introducing PBB-EVPN in Cisco ASR 9000

Introducing the next-generation of

L2VPNs Provider Backbone
Bridging Ethernet VPN (PBB-
EVPN)
Support across Cisco ASR 9000
series router family
From ASR9001-S to ASR9922
Support starting with Cisco IOS-
XR release 4.3.21 (FCS 09/2013)
Enhanced Ethernet Line Cards
(Typhoon) required as Ingress and
Egress linecards (1) PBB-EVPN support started in IOS-XR 4.3.2 and 5.1.1 releases
jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public
 PBB-EVPN PE
PBB Ethernet VPN PBB
Highlights Backbone EVPN
Edge Bridge

Next generation solution for Ethernet

multipoint (E-LAN) services by combining Data-plane address Control-plane address
learning from Core advertisement / learning
Provider Backbone Bridging (PBB - IEEE Remote C-MAC to remote over Core (B-MAC)
802.1ah) and Ethernet VPN B-MAC binding

Data-plane learning of local C-MACs and Data-plane address

PE1 PE3

remote C-MAC to B-MAC binding learning from Access

Local C-MAC to local B- B-MAC:
MAC binding B-M2
PEs run Multi-Protocol BGP to advertise local B-M1

Backbone MAC addresses (B-MACs) & learn CE1 CE3

remote B-MACs
MPLS
Takes advantage of PBB encapsulation to simplify C-MAC: C-MAC:
MB
BGP control plane operation faster convergence MA
B-MAC: B-M2
Lowers BGP resource usage (CPU, memory) on B-M1

deployed infrastructure (PEs and RRs)

PE2 PE4
Under standardization at IETF WG draft:
draft-ietf-l2vpn-pbb-evpn BGP MAC adv. Route
EVPN NLRI
MAC B-M1 via PE2
jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public
To PBB or not to PBB?
What is the value of combining PBB
and EVPN functions?

PBB
Lower control-plane overhead than
EVPN alone
PBB-EVPN uses only a sub-set of EVPN
routes
Simpler and Faster failure convergence for
all-active multi-homing scenarios
Faster MAC move convergence handled in
data-plane
Lower control-plane scale requirements
than EVPN alone
BGP MAC advertisements for smaller
Backbone MAC (B-MAC) address space
Requires less resources (CPU, memory)
on deployed infrastructure (PEs / RRs)
jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
 Provider Backbone Bridging Overview
PBB (IEEE 802.1ah-2008) defines an IB-BEB
architecture that includes
I-comp
224 service instances (I-SID) per B-VLAN

L2 Access

L2 Core
MAC-in-MAC B-comp
I-comp
I-Component
CBP
Learns & forwards using C-MACs I-comp
PIP
Maintains a mapping table of C-MACs to
B-MACs B-DA / B-SA 12B

Performs PBB encap/decap on PIP B-DA / B-SA B-Tag 4B

B-Component I-TAG I-TAG 6B

Learns & forwards using B-MACs C-DA / C-SA C-DA / C-SA C-DA / C-SA

Push / pop B-VLAN on CBP

IB-BEB = I-/B-comp Backbone Edge Bridge Customer Frame Customer Frame Customer Frame
I-SID = Backbone Service Instance Identifier
PIP = Provider Instance Port
CBP = Customer Backbone Port
jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Concepts
EVPN Instance (EVI) Ethernet Segment BGP Routes BGP Route Attributes

SHD CE1 Route Types Extended Communities

ESI1 PE1

EVI
BD [1] Ethernet Auto-Discovery (AD) Route ESI MPLS Label

[2] MAC Advertisement Route ES-Import

MHD CE2
[3] Inclusive Multicast Route MAC Mobility
BD EVI PE2
ESI2 [4] Ethernet Segment Route Default Gateway
PE

EVI identifies a VPN in the
network
Encompass one or more
bridge-domains, depending
on service interface type
Port-based
VLAN-based (shown above)
VLAN-bundling
VLAN aware bundling (NEW)
jliste@cisco.com
Represents a site
connected to one or more
PEs
Uniquely identified by a 10-
byte global Ethernet
Segment Identifier (ESI)
Could be a single device or
an entire network
Single-Homed Device (SHD)
Multi-Homed Device (MHD)
Single-Homed Network (SHN)
Multi-Homed Network (MHN)
2014 Cisco and/or its affiliates. All rights reserved.
EVPN and PBB-EVPN
define a single new BGP
NLRI used to carry all EVPN
routes
NLRI has a new SAFI (70)
Routes serve control plane
purposes, including:
MAC address reachability
MAC mass withdrawal
Split-Horizon label adv.
Aliasing
Multicast endpoint discovery
Redundancy group discovery
Designated forwarder election
Cisco Public
New BGP extended
communities defined
Expand information carried
in BGP routes, including:
MAC address moves
C-MAC flush notification
Redundancy mode
MAC / IP bindings of a GW
Split-horizon label encoding
Used by PBB-EVPN
 PBB-EVPN Model
Cisco ASR 9000
I-Component:
PBB Edge B-Component:
Bridges Domain PBB Core
Bridges Domain

Interface (Physical / Bundle)

BD-1
Ethernet Segment Identifier (ESI)
Source B-MAC I-SID X BD-4

BD-2 EVI aaa

Ethernet Flow Points MPLS
I-SID Y EVPN
(EFP) (Layer2 sub-if) Forwarder
BD-3 BD-5

I-SID Z EVI bbb

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public
PBB-EVPN Model Connecting with
existing services
Cisco ASR 9000
I-Component:
B-Component: VPLS VFI
PBB Edge
PBB Core (PBB-VPLS)1
EoMPLS PW Bridges Domain
Bridges Domain

BD-1 VFI

I-SID X BD-4

BD-2 EVI aaa

MPLS
I-SID Y EVPN
Forwarder
BD-3 BD-5

VPLS VFI I-SID Z EVI bbb

VFI

(1) Co-existence of VPLS VFI and EVI under same Core BD in IOS-XR 5.1.2 (Apr. 14)
jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public
 PBB-EVPN Encapsulation

EVPN
Ethernet BD
BD Forwarder MPLS
Access I-SID X EVI aaa

DA (NH router)
SA
6B B-DA E-type (MPLS 0x8847)
6B B-SA PSN MPLS label 4B
24-bit I-SID
inside I-TAG 2B E-type (I-TAG 0x88E7) EVPN MPLS label EVPN MPLS label 4B
4B I-TAG Control Word Control Word 4B

DA DA
PBB Header PBB Header 18B
SA SA
E-type (802.1q 0x8100) 802.1q Tag (0x8100)
C-VID C-VID
Payload E-Type Payload E-Type Customer Frame Customer Frame

Payload Payload

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public
PBB-EVPN Operation
Multicast Tunnel ID / Endpoint Discovery1
Inclusive Multicast
2 route signals MPLS
I-SID X Flood List
Entry 1: PE 2 label A
label to be used in the
downstream direction
X Y CE2
Entry 2: PE 3 label B PE2
Entry 3: PE 4 label C
PE1
PE3

RR X
BD

I-SID X BD
CE1 EVPN
Forwarder
MPLS
EVI aaa CE3
BD

I-SID Y 1
At start-up, PEs send X Y
2 EVPN Inclusive Multicast
I-SID Y Flood List routes to signal I-SID
Entry 1: PE 2 label D membership PE4 CE4
Entry 2: PE 4 label E
(1) Ingress / Head Replication model shown
EVPN Inclusive Multicast route
jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
PBB-EVPN Operation
MAC Advertisement
B-MAC Reachability Advertisement route signals MPLS
2
label to be used in the
L2 Routing Information Base (RIB) downstream direction
B-DA2; Next Hop PE2; label F
B-DA3; Next Hop PE3; label G CE2
B-DA4; Next Hop PE4; label H PE2

PE1 B-DA2
PE3

RR
B-DA3
BD

I-SID X BD
CE1 EVPN
Forwarder
MPLS
B-DA1 EVI aaa CE3
BD

I-SID Y 1
At start-up, PEs send B-DA4
EVPN MAC
Advertisement route for
local B-MAC/EVI PE4 CE4

EVPN MAC Advertisement route

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 16
 PBB-EVPN Operation
Multi-Destination Traffic Forwarding (Per-ISID Ingress Replication)
1 3
CAM Table I-SID X
Multi-destination Traffic Entry1: C-MAC1a; B-DA1
I-SID X Flood List
Unknown unicast X Y CE2
Entry 1: PE 2 label A
Broadcast CAM Table I-SID Y
Entry 2: PE 3 label B PE2
Multicast Entry1: C-MAC1b; B-DA1
Entry 3: PE 4 label C
PE1
SA: C-MAC1a PE3
DA: FFFF.FFFF.FFFF
SA: C-MAC1b X
DA: FFFF.FFFF.FFFF
BD

I-SID X BD
CE1 EVPN
Forwarder
MPLS
C-MAC1a B-DA1 EVI aaa CE3
BD
C-MAC1b
I-SID Y
2
Ingress replication X Y
I-SID Y Flood List with Per-ISID flooding
Entry 1: PE 2 label D 3 copies for I-SID X PE4 CE4
Entry 2: PE 4 label E 2 copies for I-SID Y

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
 PBB-EVPN Operation
Known Unicast Traffic Forwarding
1 L2 Routing Information Base (RIB)
Known Unicast Traffic CAM Table I-SID X B-DA2; Next Hop PE2; label F
Entry1: C-MAC1a; local B-DA3; Next Hop PE3; label G CE2
C-MAC2
Lookup B-DA4; Next Hop PE4; label H
Entry2: C-MAC2; B-DA2 PE2
Entry3: C-MAC4; B-DA4
PE1 B-DA2
SA: C-MAC1a PE3
Lookup
DA: C-MAC2
SA: C-MAC1a
DA: C-MAC4
BD

I-SID X BD
CE1 EVPN
Forwarder
MPLS
C-MAC1a B-DA1 EVI aaa
BD

I-SID Y
2
B-DA4
Known Unicast
delivered to specific C-MAC4
remote PEs PE4 CE4

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
PBB-EVPN Failure Scenarios / Convergence
Link / Segment Failure All-Active Load-Balancing
2
PE1 withdraws B-MAC
advertised for failed
1 segment (B-M1)
PE1 detects failure
of one of its
attached segments PE1 PE3

B-M1 B-M2

CE1 CE3

2 MPLS
PE1 withdraws Ethernet
Segment Route At idle state, PE3, PE4
B-M2
B-M1 install two (2) next
hops for B-MAC B-M1 3
PE3 / PE4
4 PE2 PE4
remove PE1 from
PE2 reruns DF election. PE3, PE4 RIB Path List path list for B-
Becomes DF for all I- MAC (B-M1)
SIDs on segment VPN MAC ESI NH
RT-a B-M1 n/a PE1
PE2

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public
 PBB-EVPN Operational Scenarios 4
MAC Mobility 3 MAC Mobility event handled entirely by After move, host sends
Gratuitous/Reverse ARP at
Host M1 moves
1 from CE1 to CE3s data-plane learning new location, PE3 updates
C-MAC M1 location (local
PE1 learns C-MAC M1 on local location
port.) PE3 also forwards
port and forwards across core 2 5 across core according to C-
according to C-MAC DA to Via data-plane Via data-plane
Remote B-MAC mapping MAC DA to Remote B-MAC
learning, PE3 learns learning, PE1 mapping
C-MAC M1 via B- updates C-MAC M1
MAC B-M1 location (via B-MAC
PE1 PE3 B-M2) PE1 PE3
VID 100
SMAC: M1
1 4 VID 100
SMAC: M1
DMAC: M2 B-M1 B-M1 DMAC: F.F.F
B-M2 B-M2

L3 L4 PBB
CE1 L1 L2 PBB CE3 CE1 CE3
M1
MPLS M1 MPLS M1

B-M2 B-M2
B-M1 B-M1

PE1 MAC Table PE3 MAC Table

I-SID xyz PE2 PE4 I-SID xyz PE2 PE4
PE1 MAC Table PE3 MAC Table
C-MAC B-MAC C-MAC B-MAC
I-SID xyz I-SID xyz
M1 - M1 B-M1
C-MAC B-MAC C-MAC B-MAC
1 2
M1 B-M2 M1 -
5 4
jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Multi-Homing Use Cases

21
PBB-EVPN
Access Multi-Homing Options
Single Home Device (SHD) Dual Home Device (DHD) Dual Home Device (DHD)
Single Home Network (SHN) All-Active (Per-Flow) LB Single-Active (Per-Service) LB
PE1 PE1

CE1 BMAC 1 BMAC 1

ESI W ESI W
ESI Null PE1 VID X VID X
CE1 CE1
VID X MPLS MPLS MPLS
Core Core Core
CE2
ESI Null
VID X VID Y
VID X BMAC 1 BMAC 2
ESI W ESI W

PE2 PE2

Null Ethernet Segment Main candidate for Data Different B-MACs and
Identifier (ESI) Center deployments identical ESI on PEs
No DF election / No vlan Identical B-MAC and ESI on Per service (I-SID) carving
carving PEs (manual or automatic)
CE flush via STP TCN / MVRP

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
PBB-EVPN
Access Multi-Homing Options (cont.)
Multi Home Device (MHD) Multi Home Device (MHD)
All-Active (Per-Flow) LB Single-Active (Per-Service) LB

PE1 PE1
BMAC 1 BMAC 1
ESI W ESI W
VID X
VID X
CE1 CE1
BMAC 1 MPLS BMAC 2 MPLS
ESI W ESI W
Core Core
VID X VID Y

VID X
PE2 PE2
VID Z
BMAC 1 BMAC 3
ESI W ESI W

PE3 PE3

More than two (2) PEs in More than two (2) PEs in
redundancy group redundancy group
Same as DHD All-Active Same as DHD Single-
Load-balancing Active Load-balancing

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
PBB-EVPN
Access Multi-Homing Options (cont.)
Dual Home Network (DHN) Dual Home Network (DHN) Dual Home Network (DHN)
ITU-T G.8032 REP Single-Active (Per-Service) LB
PE1 PE1 PE1
ESI Null BMAC 1
CE1 CE1 ESI Null CE1 ESI W
VID X
VID X

VID Y
VID Y VID X

R-APS
REP Edge
MPLS REP-AG MPLS MPLS
REP No REP-AG Core
G.8032 Core Neighbour Core
Open Sub-ring
RPL VID Y
Link VID X
VID X

VID Y
ALT VID Y
CE2 ESI Null port CE2 ESI Null CE2 BMAC 2
PE2 PE2 ESI W PE2

Treated as SHN by PEs Treated as SHN by PEs Different B-MAC on PEs

Null ESI; No DF election / No
service carving
Ring operation controlled by
R-APS protocol
jliste@cisco.com
Null ESI; No DF election / No Identical ESI on PEs
service carving
Per service (I-SID) carving
Segment operation controlled (manual or automatic)
by REP protocol
CE flush via STP TCN / MVRP
2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
Demonstration

25
 Demonstration Topology
Focus of Demonstration
DHD
Active/Active
per Flow Three (3) E-LAN
Lo0 14.14.14.5 services between
PE1 CE-1, CE-2, CE-3
TG CE2 ASR9006
Lo0 14.14.14.7
P EVI 111 P
PE3
ASR9006 CE3 TG
I-SID 111010

I-SID 111020

SHD I-SID 111030

SHD with
TG Bundle
PE2
ASR9001 P
CE1 P
Lo0 14.14.14.6
Legend:
SHD = Single-Home Device
DHD = Dual-Home Device
TG = Traffic Generator

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public
Summary
PBB-EVPN is a next-generation L2VPN solution based on BGP control-plane for
MAC distribution/learning over the core
PBB-EVPN was designed to address following requirements:
All-active Redundancy and Load Balancing
Simplified Provisioning and Operation
Optimal Forwarding
Fast Convergence
In addition, PBB-EVPN and its inherent MAC-in-MAC hierarchy provides:
Simplified control plane operation and faster convergence
Lower control-plane scale requirements (BGP CPU and memory)
MAC address Scalability
PBB-EVPN applicability goes beyond DCI into Carrier Ethernet use cases

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
References

Cisco.com PBB-EVPN User Documentation:

http://www.cisco.com/c/en/us/td/docs/routers/asr9000/software/asr9k_r5-1/lxvpn/
configuration/guide/lesc51x/lesc51pbb.html
(Video / Slides) Cisco Live 365: BRKMPL-2333: E-VPN and PBB-EVPN:
The Next Generation of MPLS-Based Layer 2 VPN (2014 Milan)
https://www.ciscolive.com/online/connect/sessionDetail.ww?SESSION_ID=76547

You can also meet us at Cisco Live 2014 San Francisco (May 19-24)
Breakout Session: BRKMPL-2333
Request a Meet The Expert (MTE) session

jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
Presentation_ID 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public
PBB-EVPN Shipping Features

IOS-XR 4.3.2 Aug 2013 XR 5.1.2 Apr 2014

ASR9K1 PBB-EVPN Introduction PBB-EVPN Enhancement
Port, VLAN, VLAN-bundle Mode MAC Security on PBB-EVPN
PE Auto-discovery PBB-EVPN and PBB-VPLS Seamless Integration
Ethernet Segment Identifier Auto-config w/ LACP
Single-homing
Single-active Multi-homing
All-active Multi-homing
Access Redundancy w/ LACP, G.8032, MST, nV
Cluster
Designated Forwarding (DF) election
MAC Mobility
Multicast Ingress Replication
BGP ISSU and NSR
BGP Route Reflector (RR) for PBB-EVPN

IOS XE 3.11 Nov 2013

ASR1K BGP Route Reflector (RR) for PBB-EVPN

(1) Requires use of Enhanced Ethernet Linecards (Typhoon) for access-facing and core-facing interfaces
jliste@cisco.com 2014 Cisco and/or its affiliates. All rights reserved. Cisco Public