Escolar Documentos
Profissional Documentos
Cultura Documentos
100G migration
Important testing considerations
white
paper
Intra-data center 100G migration
Important testing considerations
white
paper
Market research firm LightCounting reported in September 2016 that cloud data center
operators accounted for 35% of the deployment of 100GbE optical transceivers while
telecom operators represented 65%. In 2017, this trend will be heavily reversed with 55% of
the deployment being carried out by cloud data centers.
By Nicholas Gagnon
Business Development
Telecom operators have adopted CFP, CFP2, CFP4 and coherent-based 100GbE transceivers
Manager, DataCenter, EXFO
while cloud data centers are embracing the QSFP28 transceiver which is less costly and has
less features. Telco operators that have installed CFP, CFP2, CFP4 are now adopting QSFP28
transceivers and leaf-spine architecture to save costs. To achieve this objective, they have
formed an industry group called CORDa (from central office re-architected as data centers)
and initiated work with the Open Compute Project (OCP) and its new OCP Telco Projectb
focused on data center technologies for telecom companies. There is no doubt that the data
center industry is setting the pace for the transceiver and cabling infrastructure sectors.
According to the Cisco Global Cloud Index (GCI)c, global data center traffic is projected to
triple and reach 10.4 zettabyte by 2019, with 83% of the growth coming from cloud services
and applications. The same source states that bandwidth requirements are increasing
more rapidly within the data centers than anywhere else. The global data center traffic is
broken down as follows: 73% of this traffic will come from within the data center (storage,
production and authentication traffic); 18% is traffic between data centers and users; and 9%
will come from traffic between data centers (replication and inter-database links).
Bandwidth
requirements are
increasing more 18% 9% 73%
rapidly within the By 2019, traffic between data 0.9 ZB (9%) will come from But the vast majority of data
centers and end users will traffic between data centers, center traffic. 7.6 ZB (73%) will
data centers than reach 1.9 ZB annually (18% of
taotal data centertraffic).
such as replication and
interdatabase links.
still be coming from within the
data center, such as storage,
anywhere else. production, development,
andauthentication traffic.
Figure 1. Forecasted 10.4 zettabyte global data center traffic distribution in 2019
This paper addresses test considerations inside data centers (intra-data center tests).
Readers interested in the data center interconnect (DCI) portion of the network are invited
to consult EXFOs recently published application noted on DCI test considerations.
Given that 73% of the Robustness: all 100G transceivers are not created equal
global data center Where transceivers are concerned, CFP4 optics are more robust and stable, being based on
a more a mature and proven CFP series design. On the other hand, QSFP28 performance
traffic will be found finds a niche in the data center market with their lower cost and lower power consumption
within data centers, benefits, even if their reach is lower than the CFPs transceivers. It has been also observed
that 100G optics using four 25G lanes are more sensitive to connector reflectance at the
this portion of the patch panel than 10G SFP transceivers.
network will be under The following explains the fundamental difference between reflectance (return loss) and
the most pressure for total optical return loss (ORL):
The term reflectance applies to the amount of energy returned by specific points within
the network. Each point of reflectance is independent.
ORL (dB)
We use the term ORL when speaking of the amount of energy returned by a section or
an entire link.
An ORL meter sends out a light signal and measures the total return signal.
Coherent-based transmission with DWDM/EDFA system used for DCI can lead to Automatic
Power Reduction (APR) mode in presence of high reflectance of around 30 dB.
Many webscale companies have adopted the parallel optics architecture using MPO-based
connection to the transceiver for 100G (4x25G) lane over SMF. The cleaning and inspection of
MPO-based (APC angle connectors SMF) pre-terminated fiber assemblies are more difficult
and take more time than for duplex LC-based components, but parallel optics provide a great
benefit; the possibility to optically break out the bandwidth.
A good example is taking a 100G PSM4 transceiver port at the intermediate distribution area
(IDA) switch port feeding an MPO connector (four transmit and four receive fibers at each
25G lane) and then using a Y-cable to connect two zone distribution area switches, found at
different locations, and bring four times two transmit and two receive fibers of 25G, or four
times 50G logical interfaces to feed separate pods in two separate rooms.
This 2x100G (PSM4) deployment broken out in 4x50G interfaces is less expensive than a
4x40G deployment.
To make a well-grounded decision, there are other considerations. For instance, is it a new
pre-terminated assembly installation or is it a re-architecture of an existing infrastructure?
If damaged connector endfaces due to human error are put asideas they can happen on
both new or old connectors, especially when technicians are not properly trainedchances
of measuring bad reflectance on a new connection are lesser than on an old one.
Bottom line: if reflectance becomes a significant issue, which more likely in the context of
existing infrastructure, then the OTDR is to be preferred. Otherwise, using an OLTS remains
a good option and an OTDR can always be used in Tier-2 troubleshooting if issues come up
during Tier-1 testing.
Use case 2
Changing/migrating transceivers
Test: We have seen field operations whereby several thousands of transceivers had to be
migrated within a couple of weeks. This implies a huge number of permanent links to convert
to higher rates.
Thanks to pioneering When changing so many transceivers, we recommend using an intelligent pluggable optics
test application to evaluate the proper operation of transceivers. Solutions like iOptics
developments in the provide a pass/fail verdict based on predefined or autonomously discovered thresholds.
form of algorithms The test allows to quickly pinpoint any fault in the optical device under test.
for intelligent event Another best practice is to perform a permanent link validation of the fiber infrastructure.
If not done and pluggable quality issues happen, especially if the quality of the transceiver
detection and has not been investigated with an intelligent pluggable optics test application, technicians
easy-to-interpret link have no reference to know whether the fault lies in the pluggable or the fiber. This leads to
a lot of (avoidable) time wasted in just trying to understand the issue.
mapping displays
For minimum testing requirements, we recommend to use an OLTS because this instrument
on the graphical is the fastest to deliver a pass/fail diagnostic and can validate the permanent link under 5
user interface, seconds. It can also measure ORL. However, ORL is not a measurement of reflectance (or
back reflection), but since links in data center average around 200 meters in length and
one new solution typically include 2-3 connections, an ORL measurement is a good indicator of the presence
is transforming of bad connectors. In case of a bad ORL measurement, the connector endfaces present
on the link under test must be inspected using a fiber probe or an OTDR can be used to
OTDRtesting. troubleshoot the link.
Use case 3
Troubleshooting (Tier-2)
Test: Troubleshooting means that an issue has been detected but has not necessarily been
located. When mapping faults along a fiber link, the OTDR is the best option. An OTDR test
takes longer than an OLTS (total IL, ORL, length, pass/fail diagnostic), but provides more
detailed information (maps faults and loss, measures reflectance, total IL, ORL, length and
gives pass/fail diagnostic). For short distance links in data centers, the OTDR test time
ranges between 15 and 35 seconds, depending of the level of resolution required.
For years, OTDR technology has been too complex to grasp for non-experts. However, thanks
to pioneering developments in the form of algorithms for intelligent event detection and
easy-to-interpret link mapping displays on the graphical user interface, one new solution is
transforming OTDR testing. The intelligent Optical Link Mapper (iOLM) brings intelligence and
automation to OTDR testing and makes any technician an expert at the touch of one button.
Optical networking and IT personnel can now be empowered to certify and troubleshoot fiber,
whenever and wherever reflectance matters.
The iOLM-OTDR technology has also evolved with pass/fail diagnostics and parallel optics
requirements. The iOLM software has been improved to be used in combination with a
multifiber SWITCH-MF. With the iOLM, testing the MPO/MTP connector is simple, easy and
a sure shot.
Figure 3. User-friendly interface of an iOLM-OTDR SWITCH-MF MPO/MTP fiber characterization test kit.
Conclusion
Additional references
This paper presented test considerations for 100G and has put the emphasis on the
Cisco Visual Networking rising importance of the reflectance as an important parameter that can impact network
Index: Global Mobile Data
performance, even at the protocol layer, for 100G (4x25G) systems.
TrafficForecast Update,
2015-2020, Feb. 2016,
For serial duplex deployments, we recommend the use of an OLTS (usually LC connectors to
www.cisco.com/c/en/us/
solutions/collateral/service- the transceiver), due to the speed of testing of less than 3 seconds at 2 wavelengths and of
provider/visual-networking- less than 5seconds with the ORL option. In a typical singlemode link of 200meters with less
index-vni/vni-forecast-qa.pdf than 3 connections, ORL degradation can be used to indicate the quality of the connectors
of fibers under test. Amore thorough analysis using a fiber inspection probe or an OTDR
25-50-100G Ethernet Options
can be performed afterwards.
and Experience in the
Data Center, Paul Zugnoni,
Using an OLTS with an ORL option to screen and validate fibers in a quick and easy test
LinkedIn, NANOG 68,
www.nanog.org/sites/default/ is a clever way to narrow down to the few fibers that can create issues among large fiber
files/20161015_Zugnoni_25-50- volumes. Using an OTDR would be very time-consuming even though it would provide
100G_Ethernet_Options_v1.pdf valuable reflectance metrics. When in doubt or when performing Tier-2 troubleshooting, an
OTDR loaded with the iOLM is the bestchoice.
The use of the iOLM-OTDR directly for Tier-1 testing makes sense in the case of EDFA or
Raman amplified link getting out of the data center (DCI) or to validate the last patch panel
connection reflectance. Most amplifiers on the market have an APR mode, which is a security
feature that shuts down the signal in presence of a reflectance higher than 30 dB at the
patch panel. The fiber count in DCI situation being smaller than inside the data center, it is
preferable and more efficient to use the OTDR from the start in the case of new builds or
higher speed interface migrations. Fornew MPO/MTP to the transceiver testing, using an
iOLM-OTDR for an end-to-end test is a good practice since it will create a birth certificate
of the link and of all its MPO/MTP connections at the time of turn-up or modification. The
reflectance results of all these connections will serve as a reference of the initial performance
for each connection, which can be used to troubleshoot future events.
Test instruments will certainly ease 100G migration projects. It is good to keep in mind that
training and well-designed methods of procedure (MOPs) are the perfect companions for
your testers.
For any questions regarding test solutions, training and MOPs for your 100G or migration
projects, please contact our experts who will be happy to revert to you at the earliest. See
below for contact information.