Você está na página 1de 8

Intra-data center

100G migration
Important testing considerations

white
paper
Intra-data center 100G migration
Important testing considerations

white
paper

Market research firm LightCounting reported in September 2016 that cloud data center
operators accounted for 35% of the deployment of 100GbE optical transceivers while
telecom operators represented 65%. In 2017, this trend will be heavily reversed with 55% of
the deployment being carried out by cloud data centers.
By Nicholas Gagnon
Business Development
Telecom operators have adopted CFP, CFP2, CFP4 and coherent-based 100GbE transceivers
Manager, DataCenter, EXFO
while cloud data centers are embracing the QSFP28 transceiver which is less costly and has
less features. Telco operators that have installed CFP, CFP2, CFP4 are now adopting QSFP28
transceivers and leaf-spine architecture to save costs. To achieve this objective, they have
formed an industry group called CORDa (from central office re-architected as data centers)
and initiated work with the Open Compute Project (OCP) and its new OCP Telco Projectb
focused on data center technologies for telecom companies. There is no doubt that the data
center industry is setting the pace for the transceiver and cabling infrastructure sectors.

According to the Cisco Global Cloud Index (GCI)c, global data center traffic is projected to
triple and reach 10.4 zettabyte by 2019, with 83% of the growth coming from cloud services
and applications. The same source states that bandwidth requirements are increasing
more rapidly within the data centers than anywhere else. The global data center traffic is
broken down as follows: 73% of this traffic will come from within the data center (storage,
production and authentication traffic); 18% is traffic between data centers and users; and 9%
will come from traffic between data centers (replication and inter-database links).
Bandwidth
requirements are
increasing more 18% 9% 73%
rapidly within the By 2019, traffic between data 0.9 ZB (9%) will come from But the vast majority of data
centers and end users will traffic between data centers, center traffic. 7.6 ZB (73%) will
data centers than reach 1.9 ZB annually (18% of
taotal data centertraffic).
such as replication and
interdatabase links.
still be coming from within the
data center, such as storage,
anywhere else. production, development,
andauthentication traffic.

Figure 1. Forecasted 10.4 zettabyte global data center traffic distribution in 2019

This paper addresses test considerations inside data centers (intra-data center tests).
Readers interested in the data center interconnect (DCI) portion of the network are invited
to consult EXFOs recently published application noted on DCI test considerations.

a. Central office re-architected as a data centerCORD, http://opencord.org


b. Open Compute Project (OCP), OCP Telco Project www.opencompute.org/blog/telecommunications-industry-leaders-embrace-ocp
c. Cisco Global Cloud Index: Growth in The Cloud, 2014-2019, Infographics
www.cisco.com/c/dam/assets/sol/sp/cloud_index/global-cloud-index-infographic.pdf
d. Our application note: www.exfo.com/library/technical-resources/application-notes-case-studies-white-papers/anote339

2017 EXFO Inc. All rights reserved. 2


white paper

Bearing the brunt of the bandwidth boom:


theintra-data center network segment
In todays landscape of network transformations, 10G is no longer sufficient within the data
center. If 40G/100G is not adopted, it will be at the expense of using significantly more
fiber (2.5 to 4 times more). According to market observations, the cost of 100G optics is
becoming affordable in 2016-2017 (both for PSM4 parallel or CWDM4 serial duplex) and the
25G interface at the server will be widely adopted. Given that 73% of the global data center
traffic will be found within data centers, this portion of the network will be under the most
pressure for bandwidth increase. This is driving the high-priority deployment of 100G and
400G links in this space.

Given that 73% of the Robustness: all 100G transceivers are not created equal
global data center Where transceivers are concerned, CFP4 optics are more robust and stable, being based on
a more a mature and proven CFP series design. On the other hand, QSFP28 performance
traffic will be found finds a niche in the data center market with their lower cost and lower power consumption
within data centers, benefits, even if their reach is lower than the CFPs transceivers. It has been also observed
that 100G optics using four 25G lanes are more sensitive to connector reflectance at the
this portion of the patch panel than 10G SFP transceivers.
network will be under The following explains the fundamental difference between reflectance (return loss) and
the most pressure for total optical return loss (ORL):

bandwidth increase. Reflectance ( dB)


Comes from abrupt changes in the IOR (e.g., connectors, mechanical splices, bulkheads,
fiber breaks).

Ratio of incident light to reflected light. Reflectance is expressed as a negative value.

The term reflectance applies to the amount of energy returned by specific points within
the network. Each point of reflectance is independent.

ORL (dB)
We use the term ORL when speaking of the amount of energy returned by a section or
an entire link.

ORL values range between 14.7 dB (high) and 60 dB (low).

An ORL meter sends out a light signal and measures the total return signal.

2017 EXFO Inc. All rights reserved. 3


white paper

Reflectance: what do we learn from standards?


Table 1 below presents the reflectance specifications of physical-layer components
for optical fiber connections as documented by the two main component standards for
multimode fiber (MMF) and singlemode fiber (SMF): the ISO/IEC 11801 and TIA-568.

Reflectance ISO/IEC 11801 TIA-568.3-D ISO/IEC 14763-3


(2010) (2013, ballot 6) (2014)
MMF 20 dB 20 dB 35 dB

SMF 35 dB UPC 35 dB UPC 45 dB UPC


55 dB analog video

Table 1. Reflectance value referenced in the main standards.

The cleaning and


The minimum mated pair transmission performance reflectance or back reflection for SMF
inspection of is 35 dB, whether measured against the IEC 61300-3-6, documented in the ISO/IEC 11801
MPO-based (APC (2nd edition, 2002-09), or the TIA/EIA-455-107-A (FOTP-107), documented in the TIA-568.3-D
(2013, ballot 6).
angle connectors
The ISO/IEC 14763-3 (2014-06) details the requirement for the implementation and operation
SMF) pre-terminated of customer premises cabling and sets a 45 dB return loss requirement for the reference
fiber assemblies are test cord matings. It mentions that these components should have the same or better
performance specification as the hardware terminating the cabling under test.
more difficult and
take more time than Feedback from the field
for duplex LC-based We have worked with several customers who have deployed 100G (4x25G) lane transceivers
over singlemode fiber inside data centers, and observed that the reflectance target was in the
component . . . 40 to 45 dB range for existing patch panels equipped with LC/UPC. Connector reflectance
can be degraded with the presence of contaminants or defects on connector endfaces. This
phenomenon can appear on existing infrastructure or brand new pre-terminated assemblies.
Older patch panels equipped with LC/UPC connectors may not present the typical connectors
reflectance specification of 55 dB.

Coherent-based transmission with DWDM/EDFA system used for DCI can lead to Automatic
Power Reduction (APR) mode in presence of high reflectance of around 30 dB.

Many webscale companies have adopted the parallel optics architecture using MPO-based
connection to the transceiver for 100G (4x25G) lane over SMF. The cleaning and inspection of
MPO-based (APC angle connectors SMF) pre-terminated fiber assemblies are more difficult
and take more time than for duplex LC-based components, but parallel optics provide a great
benefit; the possibility to optically break out the bandwidth.

A good example is taking a 100G PSM4 transceiver port at the intermediate distribution area
(IDA) switch port feeding an MPO connector (four transmit and four receive fibers at each
25G lane) and then using a Y-cable to connect two zone distribution area switches, found at
different locations, and bring four times two transmit and two receive fibers of 25G, or four
times 50G logical interfaces to feed separate pods in two separate rooms.

2017 EXFO Inc. All rights reserved. 4


white paper

This 2x100G (PSM4) deployment broken out in 4x50G interfaces is less expensive than a
4x40G deployment.

Figure 2. 200G (4x50G) deployment leveraging MPO-based break-out approach.

If reflectance Which test method to choose and when?


becomes a significant Best practice tip: Whenever a test is performed, it is crucial to bear in mind that each time
a connector is manipulated, a fiber inspection probe must be used for inspection before
issue, which more reconnection. This applies to all situations.
likely in the context of Below are the recommended tests that provide value for the relevant use cases:

existing infrastructure, Use case 1


thenthe OTDR is to Fiber architecture construction and expansion or
be preferred. re-architecture of the data center (Tier-1)
Test: Since contractors are usually performing the tests at this stage, test requirements
are a good way for both parties to demonstrate that the work has been done as per
specifications and best practices, based on industry standards and/or more stringent
customer requirements.

Traditionally, test requirements can be summarized as a pass/fail diagnostic based on total


insertion loss (IL) and length. For this reason, the instruments of choice have been an optical
loss test set (OLTS) or a source and a power meter. This scenario is not bad, but in the 100G
era and as discussed previously, reflectance at patch panels becomes more important. An
OLTS does not measure reflectance. Only an optical time-domain reflectometer (OTDR) can
measure reflectance easily in the field.

To make a well-grounded decision, there are other considerations. For instance, is it a new
pre-terminated assembly installation or is it a re-architecture of an existing infrastructure?
If damaged connector endfaces due to human error are put asideas they can happen on
both new or old connectors, especially when technicians are not properly trainedchances
of measuring bad reflectance on a new connection are lesser than on an old one.

Bottom line: if reflectance becomes a significant issue, which more likely in the context of
existing infrastructure, then the OTDR is to be preferred. Otherwise, using an OLTS remains
a good option and an OTDR can always be used in Tier-2 troubleshooting if issues come up
during Tier-1 testing.

2017 EXFO Inc. All rights reserved. 5


white paper

Use case 2
Changing/migrating transceivers
Test: We have seen field operations whereby several thousands of transceivers had to be
migrated within a couple of weeks. This implies a huge number of permanent links to convert
to higher rates.

Thanks to pioneering When changing so many transceivers, we recommend using an intelligent pluggable optics
test application to evaluate the proper operation of transceivers. Solutions like iOptics
developments in the provide a pass/fail verdict based on predefined or autonomously discovered thresholds.

form of algorithms The test allows to quickly pinpoint any fault in the optical device under test.

for intelligent event Another best practice is to perform a permanent link validation of the fiber infrastructure.
If not done and pluggable quality issues happen, especially if the quality of the transceiver
detection and has not been investigated with an intelligent pluggable optics test application, technicians
easy-to-interpret link have no reference to know whether the fault lies in the pluggable or the fiber. This leads to
a lot of (avoidable) time wasted in just trying to understand the issue.
mapping displays
For minimum testing requirements, we recommend to use an OLTS because this instrument
on the graphical is the fastest to deliver a pass/fail diagnostic and can validate the permanent link under 5
user interface, seconds. It can also measure ORL. However, ORL is not a measurement of reflectance (or
back reflection), but since links in data center average around 200 meters in length and
one new solution typically include 2-3 connections, an ORL measurement is a good indicator of the presence
is transforming of bad connectors. In case of a bad ORL measurement, the connector endfaces present
on the link under test must be inspected using a fiber probe or an OTDR can be used to
OTDRtesting. troubleshoot the link.

Use case 3
Troubleshooting (Tier-2)
Test: Troubleshooting means that an issue has been detected but has not necessarily been
located. When mapping faults along a fiber link, the OTDR is the best option. An OTDR test
takes longer than an OLTS (total IL, ORL, length, pass/fail diagnostic), but provides more
detailed information (maps faults and loss, measures reflectance, total IL, ORL, length and
gives pass/fail diagnostic). For short distance links in data centers, the OTDR test time
ranges between 15 and 35 seconds, depending of the level of resolution required.

2017 EXFO Inc. All rights reserved. 6


white paper

For years, OTDR technology has been too complex to grasp for non-experts. However, thanks
to pioneering developments in the form of algorithms for intelligent event detection and
easy-to-interpret link mapping displays on the graphical user interface, one new solution is
transforming OTDR testing. The intelligent Optical Link Mapper (iOLM) brings intelligence and
automation to OTDR testing and makes any technician an expert at the touch of one button.
Optical networking and IT personnel can now be empowered to certify and troubleshoot fiber,
whenever and wherever reflectance matters.

The iOLM-OTDR technology has also evolved with pass/fail diagnostics and parallel optics
requirements. The iOLM software has been improved to be used in combination with a
multifiber SWITCH-MF. With the iOLM, testing the MPO/MTP connector is simple, easy and
a sure shot.

Figure 3. User-friendly interface of an iOLM-OTDR SWITCH-MF MPO/MTP fiber characterization test kit.

2017 EXFO Inc. All rights reserved. 7


white paper

Conclusion
Additional references
This paper presented test considerations for 100G and has put the emphasis on the
Cisco Visual Networking rising importance of the reflectance as an important parameter that can impact network
Index: Global Mobile Data
performance, even at the protocol layer, for 100G (4x25G) systems.
TrafficForecast Update,
2015-2020, Feb. 2016,
For serial duplex deployments, we recommend the use of an OLTS (usually LC connectors to
www.cisco.com/c/en/us/
solutions/collateral/service- the transceiver), due to the speed of testing of less than 3 seconds at 2 wavelengths and of
provider/visual-networking- less than 5seconds with the ORL option. In a typical singlemode link of 200meters with less
index-vni/vni-forecast-qa.pdf than 3 connections, ORL degradation can be used to indicate the quality of the connectors
of fibers under test. Amore thorough analysis using a fiber inspection probe or an OTDR
25-50-100G Ethernet Options
can be performed afterwards.
and Experience in the
Data Center, Paul Zugnoni,
Using an OLTS with an ORL option to screen and validate fibers in a quick and easy test
LinkedIn, NANOG 68,
www.nanog.org/sites/default/ is a clever way to narrow down to the few fibers that can create issues among large fiber
files/20161015_Zugnoni_25-50- volumes. Using an OTDR would be very time-consuming even though it would provide
100G_Ethernet_Options_v1.pdf valuable reflectance metrics. When in doubt or when performing Tier-2 troubleshooting, an
OTDR loaded with the iOLM is the bestchoice.

The use of the iOLM-OTDR directly for Tier-1 testing makes sense in the case of EDFA or
Raman amplified link getting out of the data center (DCI) or to validate the last patch panel
connection reflectance. Most amplifiers on the market have an APR mode, which is a security
feature that shuts down the signal in presence of a reflectance higher than 30 dB at the
patch panel. The fiber count in DCI situation being smaller than inside the data center, it is
preferable and more efficient to use the OTDR from the start in the case of new builds or
higher speed interface migrations. Fornew MPO/MTP to the transceiver testing, using an
iOLM-OTDR for an end-to-end test is a good practice since it will create a birth certificate
of the link and of all its MPO/MTP connections at the time of turn-up or modification. The
reflectance results of all these connections will serve as a reference of the initial performance
for each connection, which can be used to troubleshoot future events.

Test instruments will certainly ease 100G migration projects. It is good to keep in mind that
training and well-designed methods of procedure (MOPs) are the perfect companions for
your testers.

For any questions regarding test solutions, training and MOPs for your 100G or migration
projects, please contact our experts who will be happy to revert to you at the earliest. See
below for contact information.

EXFO serves over 2000 customers in more than 100 countries.


To find your local office contact details, please go to www.EXFO.com/contact.
WPAPER080.1AN 17/02 2017 EXFO Inc. All rights reserved. 8

Você também pode gostar