ACCESS BRILLIANCE

EFM OAM Tutorial

Current as of IEEE P802.3ah/D3.2

Kevin Daines
Editor, EFM OAM Sub-task force

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Agenda
g Overview
g OAM Protocol Data Units (OAMPDUs)
g Events
n Critical Link Events
n Link Events
g Variable Retrieval
g Remote Loopback
n Internal block diagram
n Starting and exiting timing diagrams
g Organization Specific Extensions
g Discovery
g Active & Passive Modes
2

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Overview: Parent Organizations

g IEEE 802 LMSC
n Local Area Network/Metropolitan Area
Network Standards Committee
g IEEE 802.3 CSMA/CD
n Carrier Sense Multiple Access with
Collision Detect (CSMA/CD) Working
Group
n Commonly referred to as the Ethernet Working Group

g IEEE P802.3ah Ethernet in the First Mile

Task Force (EFM)
3

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Overview: OSI Layer Stack

P802.3ah Layers
OSI Higher Layers
Reference LLC
Model Operations, Administration, and Maintenance (OAM)
Layers MAC Control
MAC
Application
Reconciliation Sublayer (RS)
Presentation
GMII MII MII
Session
PCS PCS PCS
Transport
PMA PMA PMA
Network
PMD PMD PMD
Data Link
MDI MDI MDI
Physical
MEDIUM MEDIUM MEDIUM
1 Gb Link 100 Mb Link 2/10 Mb Link
Segment Segment Segment

OAM = Operations, Administration, & Maintenance PCS = Physical Coding Sublayer

MDI = Medium Dependent Interface PMA = Physical Medium Attachment
(G)MII = (Gigabit) Media Independent Interface PMD = Physical Medium Dependent
4

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Overview: Objectives
g OAM provides mechanisms to:
n Monitor link operation and health

n Improve fault isolation

g Method: OAM data conveyed in basic

(untagged) 802.3 Slow Protocol frames
n Sent between two ends of a single link
n Note: called a DTE in 802.3 terminology
n Slow Protocols allows S/W implementation

g Fills major requirement to reduce EFM OpEx

5

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Overview: Non-objectives
g Does not provide capabilities for:
n Station management
n Protection switching
n Provisioning
n No SET functions
n Bandwidth allocation
n Speed/duplex negotiation
n End-to-end OAM communication
n 802.3 scope restricted to single links

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Overview: Compatibility
g Optionality
n OAM is optional; software and/or hardware
implementations possible
n May be implemented on one or more ports within a system
n Individual OAM features are optional
g Supported media
n All point-to-point (P2P) and emulated P2P links supported
g 802.3x MAC Flow Control (PAUSE)
n Inhibits all traffic including OAMPDUs
g 802.3z 1000BASE-X Auto Negotiation
n Support for unidirectional fault signaling is mutually
exclusive with 802.3z Auto Neg
n 802.3z Auto Neg must be disabled for fault signaling to be
sent over 1000BASE-X unidirectional links

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAMPDU: Unidirectional
g 802.3ah/Clause 66 adds optional feature to
allow optical links to operate unidirectionally
n Legacy links become inoperable when one direction fails
n Newer links can send Information OAMPDUs unidirectionally
to signal link fault
n 100BASE-X PCS, 1000BASE-X PCS & 10GbE RS supported

Normal link Unidirectional

link

X
Data frames & Only Info
OAMPDUs sent OAMPDUs
in both sent in one
directions direction
8

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAMPDU: Forwarding - NOT

g Only traverse a single link
n Not forwarded by bridges
g Communication beyond a single link left to
higher layers

OAMPDUs

OAMPDUs

OAMPDUs

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAMPDU: Size/Rate
g Must be standard Octets
6 01-80-c2-00-00-02 [Slow Protocol]
frame length 6 MAC Source Address

n 64-1518 octets 2 Type=88-09 [Slow Protocols]

1 Subtype = 0x03 [OAM]
n Maximum PDU size 2 Flags field
determined during 1 Code
Discovery process 42-1496 Data/Pad field
4 Frame Check Sequence

g Must be untagged 64-1518

n Maximum of (10) OAMPDUs per second

n Max rate defined in Annex 43B as modified by EFM
n May be sent multiple times to increase likelihood of reception
by remote device (e.g., in the case of high bit errors)
10

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAMPDU: Flags field

g Length: 2 octets
g Legend: Critical Link Event bit
State information bit

Fields Flags field Bit

DA Reserved 15:7 [6] [5] Remote Discovery status
SA Remote Stable 6 [4] [3] Local Discovery status
Type Remote Evaluating 5 0 0 Unsatisfied, cant complete
Subtype Local Stable 4 0 1 Discovery in process
Flags Local Evaluating 3 1 0 Satisfied, Discovery complete
Code Critical Event 2 1 1 Reserved
Data/Pad Dying Gasp 1
FCS Link Fault 0

11

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAM Critical Link Events

g Link Fault
n Signal remote device that receive path is broken
n Sent once per second in Information OAMPDU
g Dying Gasp
n Signal remote device that unrecoverable local
fault (e.g., power failure) has occurred
n May be sent immediately/continuously
g Critical Event
n An unspecified critical event has occurred
n May be sent immediately/continuously

12

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAMPDU: Codes
Code OAMPDU Length
0x00 Information varies
0x01 Event Notification varies
0x02 Variable Request varies
0x03 Variable Response varies
0x04 Loopback Control 64 octets
0x05-0xFD Reserved
0xFE Organization Specific varies
0xFF Reserved

Unknown/unsupported OAMPDUs sent to OAM client

Different than 802.3x behavior, which filtered unsupported
opcodes

13

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAMPDU: Information
g Code: 0x00
g Data field: Information TLVs
g Length: varies

Fields
DA Data field Octets Information TLV Octets

SA Local Information Type = 0x01 1

16
Information TLV Information Length = 0x10 1
Type
Remote Version = 0x01 1
Subtype 16
Information TLV
Flags Revision 2
Information TLV
Code=0x00 n State 1
#3
Data/Pad OAM Configuration 1

FCS OAMPDU Configuration 2

OUI 3
Vendor Specific Information 4
14

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Information TLVs
Information Type Information TLV Name
0x00 End of TLV marker
0x01 Local Information
0x02 Remote Information
0x03-0xFD Reserved
0xFE Organization Specific Information
0xFF Reserved

Sent as Information TLVs within Information PDU

n Local & Remote used for Discovery Process
n Optional Organization Specific Information used for
extension purposes
15

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Local/Remote Information
7 6 5 4 3 2 1 0
1 Information Type 8-bit Type
1 Information Length 0x10
1 OAM Version 0x01

2 Revision 16-bit Revision

1 State reserved Mux Parser Action

1 OAM Configuration reserved Vars Events LB Unidir Mode
OAMPDU reserved Max OAMPDU Size
2
Configuration Maximum OAMPDU Size

24-bit Organizationally Unique Identifier

7 Vendor Identifier

32-bit Vendor Specific Information

16

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAMPDU: Event Notification

g Code: 0x01
g Data field: One or more Link Event TLV(s)
g Length: Variable

Fields Data field example Octets

DA Sequence Field 2 Errored Symbol Period Event Octets
SA Errored Symbol Period Event Type = 0x01 1
40
Event TLV
Type Event Length = 0x28 1
Event TLV #2
Subtype Timestamp = in 100ms intervals 2
Event TLV #n
Flags Window = symbols 8
Code=0x01 Threshold = symbols 8
Data/Pad Errors = symbols 8
FCS Error Running Total = symbols 8
Event Running Total = events 4

17

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAM Link Event TLVs

Event Type Event TLV Name
0x00 End of TLV marker
0x01 Errored Symbol Period Event
0x02 Errored Frame Event
0x03 Errored Frame Period Event
0x04 Errored Frame Seconds Summary Event
0x05-0xFD Reserved
0xFE Organization Specific Event TLV
0xFF Reserved

Sent as Link Event TLVs within Event Notification PDU

n May be sent multiple times to increase likelihood of reception
(e.g., in the case of high bit errors)
n Includes time reference when generated
18

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Errored Symbol Period Event

g A window, measured in number of symbols, where
number of errored symbols exceeded a threshold
g Type: 0x01
g Length: 0x28 (40 octets)
g Value:
Fields Width Description
Timestamp 16-bits Time reference, in 100ms units, when generated
Lower bound: Symbols in 1 second
Window 64-bits
Upper bound: Symbols in 60 seconds
Lower bound: 0
Threshold 64-bits
Upper bound: unspecified
Errors 64-bits # of symbols errors in Window
Total Errors 64-bits Total # of symbol errors since reset
Total Events 32-bits Total # of events sent since reset
19

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Errored Frame Event

g A window, measured in 100ms intervals, where
number of errored frames exceeded a threshold
g Type: 0x02
g Length: 0x1A (26 octets)
g Value:

Fields Width Description

Timestamp 16-bits Time reference, in 100ms units, when generated
Lower bound: 1 second
Window 16-bits
Upper bound: 60 seconds
Lower bound: 0
Threshold 32-bits
Upper bound: unspecified
Errors 32-bits # of frame errors in Window
Total Errors 64-bits Total # of frame errors since reset
Total Events 32-bits Total # of events sent since reset
20

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Errored Frame Period Event

g A window, measured in received frames, where
number of errored frames exceeded a threshold
g Type: 0x03
g Length: 0x1C (28 octets)
g Value:

Fields Width Description

Timestamp 16-bits Time reference, in 100ms units, when generated
Lower bound: # of 64B frames in 1 second
Window 32-bits
Upper bound: # of 64B frames in 60 seconds
Lower bound: 0
Threshold 32-bits
Upper bound: unspecified
Errors 32-bits # of frame errors in Window
Total Errors 64-bits Total # of frame errors since reset
Total Events 32-bits Total # of events sent since reset
21

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Errored Frame Seconds Summary

g A window, in 100ms intervals, where number of
errored frame seconds exceeded a threshold
g Type: 0x04
g Length: 0x16 (22 octets)
g Value:

Fields Width Description

Timestamp 16-bits Time reference, in 100ms units, when generated
Lower bound: 10 seconds
Window 16-bits
Upper bound: 900 seconds
Lower bound: 0
Threshold 16-bits
Upper bound: unspecified
Errors 16-bits # of errored frame seconds in Window
Total Errors 64-bits Total # of errors causing since reset
Total Events 32-bits Total # of events sent since reset
22

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Organization Specific Event

g Organizations may define events that are of variable
length and are distinguished by the OUI
g Type: 0xFE
g Length: varies
g Value:

Fields Width Description

OUI 24-bits Organizationally Unique Identifier
varies varies varies

23

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAMPDU: Variable Req/Resp

g Variable Request g Variable Response
n Code: 0x02 n Code: 0x03
n Data: Variable Descriptors n Data: Variable Containers
n Length: Variable n Length: Variable

Fields Data field Octets Variable Descriptors Octets

Variable Descriptors 3 Branch = 0x07 1
Request

Code=0x02
Variable Descriptors 3 Leaf = 0x0002 2
Data
Branch = 0x07 1
FCS
Leaf = 0x0005 2

Data field Octets Variable Containers Octets

Fields Variable Container 8 Branch = 0x07 1
Response

Variable Container Leaf = 0x0002 2

Code=0x03
Width = 0x04 1
Data
Value = 0x0102_0304 4
FCS

24

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Variable Retrieval
g Transfer Ethernet counters and statistics via Variable
Containers/Descriptors
g Variables are referenced using Annex 30A CMIP
registration arcs
g Can be used to emulate L2 Ping
n (i.e., Tx Variable Request, Rx Variable Response)

g Examples: CMIP Registration Arcs

Variable Branch Leaf
aFramesTransmittedOK 0x07 0x0002
aFrameCheckSequenceErrors 0x07 0x0006
aOctetsReceivedOK 0x07 0x000E
25

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAMPDU: Loopback Control

g Code: 0x04
g Data field: Loopback Command (1 octet)
g Length: 64 octets

Fields
DA
SA
Type
Subtype
Flags Data field Octets List of Loopback Commands
Code=0x04 Loopback Command 1 Command Description
Data/Pad 0x00 Reserved
FCS 0x01 Enable Remote Loopback
0x02 Disable Remote Loopback
0x03-FF Reserved
26

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAM Remote Loopback

Local DTE Remote DTE
g Local DTE sends Client Client
arbitrary data frames LLC LLC
OAM OAM
g Remote DTE returns MAC CTRL MAC CTRL
data frames MAC MAC
RS RS
g Frame BER equals bit GMII GMII
BER to high probability PCS PCS

when bit BER is better PMA PMA

PMD PMD
than 10 6
MDI MDI
MEDIUM MEDIUM
Tx Rx Tx Rx

Can be implemented in H/W or S/W

27

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAM Sublayer Block Diagram

g OAM client
n Configures OAM sublayer
through Control OAM client Upper layers (e.g., MAC Client)
n Processes received PDUs

control

OAMPDUs
n Transmits PDUs

status
g Control
MAC client frames
n Provides interface with OAM
Control
client entity
n Contains Discovery process
g Parser OAMPDUs
n Inspects received frames, loopback
sends PDUs to Control and
based on configuration, sends:
Multiplexer Parser
n Non-PDUs to upper layer
or
OAM
n Non-PDUs to Multiplexer
g Multiplexer Lower layers (e.g., MAC Control, MAC)
n Multiplexes PDUs and non-
PDUs
28

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

Starting Remote Loopback

Local DTE Remote DTE

1 Stops sending data frames;

configures Multiplexer and
Parser to DISCARD

2 Sends Loopback Control PDU 2

w/ Enable Loopback
3 Receives Loopback Control
OAMPDU w/ Enable
Loopback

4 4 Within one second, configures

Parser to LOOPBACK;
sends Information OAMPDU
5 Receives Information OAMPDU w/ updated state info
6 Configures Multiplexer to FWD
frames

7 Starts sending loopback frames

29 Source: Jee-Sook Eun, ETRI

EFM OAM Tutorial - March 2004
 ACCESS BRILLIANCE

Exiting Remote Loopback

Local DTE Remote DTE

1 Stops sending loopback frames

2 Sends Loopback Control PDU 2
w/ Disable Loopback 3 Receives Loopback Control
OAMPDU w/ Disable
Loopback

4 Within one second,

4 configures Parser to FWD;
configures Mux to FWD
sends Information
5 Receives Information OAMPDU OAMPDU w/ updated state
info;
6 Configures Multiplexer and
Parser to FWD frames

7 Resumes sending data frames

30 Source: Jee-Sook Eun, ETRI

EFM OAM Tutorial - March 2004
 ACCESS BRILLIANCE

OAMPDU: Organization Specific

g Code: 0xFE
g Distinguisher: IEEE 24-bit Organizationally Unique Identifier
g Data field: Organization Specific

Fields
DA
SA
Type
Subtype
Data Field
Flags
24-bit Organizationally
3
Code=0xFE Unique Identifier
Data/Pad
FCS

31

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAM Discovery
g Allows local DTE to detect OAM on remote
DTE
g Once OAM support is detected, both ends of
the link exchange state and configuration
information
n e.g. mode, PDU size, loopback support
g If both DTEs are satisfied with settings, OAM
is enabled on link
g Loss of link and non-reception of PDUs for 5
seconds are causes of Discovery re-starting
32

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAM Active Mode

g A DTE in Active mode:
n Initiates the OAM Discovery process
n Sends Information PDUs
n May send Event Notification PDUs
n May send Variable Request/Response PDUs
n May send Loopback Control PDUs
n Exceptions:
n Does not respond to Variable Request PDUs from DTEs
in Passive mode
n Does not react to Loopback Control PDUs from DTEs in
Passive mode

33

EFM OAM Tutorial - March 2004

 ACCESS BRILLIANCE

OAM Passive Mode

g A DTE in Passive mode:
n Waits for the remote device to initiate the
Discovery process
n Sends Information PDUs
n May send Event Notification PDUs
n May respond to Variable Request PDUs
n May react to received Loopback Control PDUs
n Is not permitted to send:
n Variable Request PDUs
n Loopback Control PDUs

34

EFM OAM Tutorial - March 2004