Network Troubleshooting and Optimization With Nemo Tools

Mobile Network Driving Test Training
With ANITE NEMO tools

Bui Nguyen Dat, TSE Ha Noi, Oct 2013
Table of content
Part 1: Overview
1. Overview of driving test tools 2. Driving test solution Part 2: Testing with Nemo Outdoor 1. Overview 2. Software and tools 3. Testing with Nemo Outdoor Part 3: Handy solution 1. Overview 2. Software and tools 3. Testing with Nemo Handy Part 4: Analyzing and reporting with Nemo Analyze Software 1. Overview 2. Software and tools 3. Using Nemo Analyze Summary 2
Telecom Test & Optimization Expert
Part 1: Overview
3
1. Overview of driving test tools

Part of all phases of Mobile Network life circle: planning, turn up, maintaining, optimizing, troubleshooting. Traditional purpose: verify the quality of Mobile Network, analyze QoS and QoE parameters. QoS parameters:
Configuration Services
4
1. Overview
Driving Test Standards
Testing standards:
3GPP ETSI (102 250) ITU-T P.86x
5
1. Overview
Traditional testing devices
Outdoor test tools: Nemo Outdoor KPIs test Services test
Handy & Indoor test tools: Nemo Handy Indoor Walking test
6
1. Overview
New testing devices
Benchmarking test: Nemo Invex Benchmarking services & KPI for many operator Require high performance hardwares Auto-test: Nemo Autonomous Automatically route test Daily test QoS, KPIs QoE test: Nemo CEM
7
2. Driving test solution

Hardware
Hardware
2xTest phone Nokia C5 01xUSB modem Sierra wireless Aircard 312U (to test data up to HSPA+) 01xLaptop X230 Accessories: GPS USB, Cable, USB hub
8

Software
Nemo Outdoor
Instalation software Nemo Outdoor license (dongle) Drivers for terminal Nemo Handy Software setup in test phone License in test phone Nemo Analyze Instalation software Nemo Analyze license (dongle)
9

Working flow
10

Testing capability
Supported Technologies:
HSPA+ Dual Cell /HSPA+ 2100 (upto 42.2 Mbps DL/5.76 Mbps UL with 312U) WCDMA/HSDPA/HSUPA 2100 (312U/Nokia C5) GSM/GPRS/EDGE 850/900/1800/1900 (312U/Nokia C5)
Supported applications:
Voice call/Video call FTP/HTTP (DL/UL) SFTP WAP/HTTP browsing HTTP streaming (YouTube) RTSP streaming/streaming quality with PVI algorithm Iperf service testing (for TCP and UDP) Ping trace route testing SMTP/S, POP3/S, and IMAP/S protocols (for email testing) SMS, MMS, and USSD testing 11

Reporting capability
Importing & storing logfile for analyzing Analyzing & exporting result Creating report (various format: PDF, CSV, TXT, HTML, WORD, POWER POINT) Troubleshooting with Proffesional version Create report template with Proffesional version
12
Summary Driving test overview:

Outdoor test, indoor test, benchmarking test, auto-test, QoE test Testing standard: 3GPP, ETSI 102 250 (services), ITU-T P.86x (VQ)
Currently solution for driving test:

Nemo Outdoor + terminals: controlling and data collecting (driving & outdoor) Nemo Handy with Nokia C5: data collecting (indoor & walking test) Nemo Analyze: post-processing & reporting
13
Discussion
14
Part 2: Testing with Nemo Outdoor
15
1. Overview
NEMO TOOLS FOR NETWORK TESTING
Nemo tools will help our customers to optimize the quality of wireless voice and data networks and to maximize their revenue stream.
Nemo Handy
Nemo Analyze
Nemo Outdoor
Nemo Invex
Complete toolset from data collection to post-analysis with open file format
Nemo FSR1
Nemo
Autonomo us
16
1. Overview
NEMO OUTDOOR
Nemo Outdoor is a pioneering network measurement and optimization solution for perfecting the air interface of wireless networks. Nemo Outdoor is always among the first-to-market with support for the very latest technologies, currently supporting measurements on LTE, HSPA+ DC, WCDMA, GSM, 1xEV-DO, CDMA, iDEN, WiMAX, TD-SCDMA, and TETRA networks.
Nemo Outdoor supports more than 270 test terminals and scanners.
Patented Multi-Data functionality in Nemo Outdoor empowers the user to connect up to 6 terminals to one laptop. Comprehensive and cost-efficient Drive testing, QoS and benchmarking measurements can all be carried out on a single platform. 17
1. Overview
NEMO OUTDOOR PRODUCT PLATFORM
18
Modem 3 Modem 2 Modem 1
Scanner 3 Scanner 2 Scanner 1
18
1. Overview
SUPPORTED CHIPSETS AND TERMINAL VENDORS
Base software works for all technologies Look and feel always the same. Handlers are all optional and can be selected depending on technology and terminals required. Currently supported UE devices from Nokia, ZTE, Huawei, Motorola, LG, Samsung, Sierra Wireless, Novatel, Pantech, Bandrich, QualcommTM, and other RunCom-, Beceem-, Nvidia-, Qualcomm chipset based vendors Wide selection of supported Scanning receivers from Nemo, PCTEL, Anritsu, DRT, and Rohde & Schwarz.
19
1. Overview
NEMO OUTDOOR HARDWARE NEMO MULTI LITE

The 4th generation Nemo Multi Lite is a compact and cost-effective benchmarking solution for use with Nemo Outdoor Simultaneous multi-data testing with a single laptop (Patented) Possibility to measure up to six networks Supports more than 270 test devices, mix & match, including Nokia, Motorola and Qualcomm-based terminals and USB modems Supports any combination of technologies ranging from GSM to HSPA+, CDMA 2000, and TD-SCDMA to EVDO and LTE
System Highlights High quality rugged case - Maximum protection for Nemo drive testing tools Compact size - Can be taken inside most of the aircrafts as carry-on luggage Built-in 2500 mAh battery pack - In case of power failures measurements can be continued. Can also be used for indoor testing.
20
20
1. Overview
NEMO OUTDOOR HARDWARE NEMO WALKER
Compact and convenient backpackbased carrying solution for network measurement equipment Holds all necessary test devices
Up to six test mobiles or USB modems Scanner Voice Quality accessories GPS receiver USB hub Tablet PC
Use case examples

Voice quality benchmarking in parks and pedestrian zones Roll-out LTE service KPI verification at shopping malls Multi-technology and multi-operator benchmarking on trains, buses, and boats
Wire-free mobility
Three hot-swappable Li-ion batteries Up to 36 hrs of usage without an external power supply
In-vehicle use with standard +12V input

21
1. Overview
22 NEMO OUTDOOR VOICE QUALITY TESTING MOBILE TO MOBILE
With Nemo Outdoor it is possible to perform mobile-to-mobile and mobile-to-fixed-to-mobile voice quality measurements The measurement is based on the ITU-T recommendations P.862.1 (narrow band) and P.862.2 (wide band) producing a PESQ score that is mapped on an EMOS (Estimated Mean Opinion Score) scale. POLQA P.862.3 support with Android phone
22
1. Overview
NEMO OUTDOOR VOICE QUALITY TESTING MOBILE TO FIX
23
23
1. Overview
NEMO OUTDOOR APPLICATION TESTING
Nemo Outdoor enables network operators to test their network using the same application protocols as their customers and, therefore, provides results that correspond with the end-user experience. The information provided by Nemo Outdoor assists in the verification and troubleshooting of new services reducing the time-to-market.
24
1. Overview
NEMO OUTDOOR VIDEO STREAMING QUALITY
Nemo video quality uses Psytechnics PVI algorithm A non-intrusive method for measuring the video quality of IP networks Based on IP parametric analysis of live traffic
Available parameters: Video codec Video frame rate Video protocol Video quality degradation due to compression Video quality MOS Video quality MOS degradatation Video quality jitter Video quality packet error rate Video quality degradation due to packet errors Video quality type Video preview can be seen during the measurement
25
1. Overview
NEMO OUTDOOR TROUBLE SHOOTING
Pilot and frequency scanning can be performed on Nokia terminals. Hence, there is no
need to use a separate fast frequency scanner to perform scanning and missing neighbor detection on both GSM and WCDMA bands simultaneously, which adds to costeffectiveness and increases user convenience.
Missing neighbor detection using a Nokia terminal no need for a separate scanner to be used simultaneously
Missing Neighbor Detection requires that terminal & scanner be used simultaneously. Both GSM/WCDMA missing neighbors can be detected simultaneously.
26
1. Overview NEMO OUTDOOR NEMO SERVER
With Nemo Outdoor it is possible to conduct data testing against
Commercial/private servers and Nemo test server
27
April 21, 2014 Telecom Test & Optimization Expert
1. Overview
NEMO OUTDOOR ADVANTAGE FEATURES

Channel lock/scr. code lock Cell barring Timeslot testing Cell testing
Also called sleeping cell detection. UE is automatically locked to neighbor cells and test call is made. Surrounding cells can be tested from a single location.
Forced handovers
Supported in Nokia terminals
Measurement report message modification with Nokia UEs (3G) Neighbor list Decoded from signaling messages Measurement lists User parameters
User can select parameters to be decoded from signaling messages and show them in the UI during measurements and playback
28
April 21, 2014 Telecom Test & Optimization Expert
1. Overview
NEMO OUTDOOR LOGFILE FORMAT
Produces measurement files in an open ASCII file format
Files can be directly imported to Nemo analysis tool Nemo Analyze as well as to various third-party post-processing/analysis tools.
No conversion or parsing of the files A detailed description of the file format is included in the product user documentation. The file format description contains all recorded events and their parameters.
29
2. Software & Tool Nemo outdoor installation packet Drivers:

Phone Nokia C5 USB modem sierra wireless GPS driver
30
2. Software & Tool

Setup Software
Start program
31
3. Testing with Nemo Outdoor

NEMO OUTDOOR USER INTERFACES
Tool bar + function
Workspaces Parameter tree + Drag & drop functionality Device manager Export/import user interface settings
Instant playback
32

NEMO OUTDOOR CONNECT DEVICE
33

NEMO OUTDOOR CREATE SCRIPT
Can be used for voice and video calls, HTTP/FTP packet data uploads/downloads, HTML/WAP browsing, SMS/MMS messages, emails, and ping. Can be used to create Conditional scripts where the type of the detected packet technology determines how the script proceeds. The Loop script command enables scripts where a portion of the script is repeated a number of times before proceeding with the rest of the script. With the Wait script command, the user can create scripts that are not activated before a certain system or bandwidth is active.
Use script files to run measurements Makes voice/video calls, data transfers, etc. automatically Can be created and edited with Nemo Outdoors built-in script editor
34
3. Testing with Nemo Outdoor NEMO OUTDOOR GRAPH Multi-layer capability for displaying multiple results in single graph Parameters displayed in graphical and numerical format Event notifications displayed on graphs and maps
35
3. Testing with Nemo Outdoor NEMO OUTDOOR GRID, TABLE
Messages from events, L3, etc. decoded

User parameters can be defined by the user, and later used in the various data views
36
3. Testing with Nemo Outdoor NEMO OUTDOOR MAP

Route planning - measurement route can be planned beforehand Parameter-based route coloring Active cell information can be plotted along the routes Base station icons, site names, and cell information displayed on map Color set to color BTS icons based on different parameters Find cell - possibility to search cells on the map Possibility to plot the same measurement several times on a map to easily correlate different parameters
Interfering cell presentation on the map

37
3. Testing with Nemo Outdoor NEMO OUTDOOR MAP

Export
to Google Earth
38
3. Testing with Nemo Outdoor NEMO OUTDOOR INDOOR OPTION & MAP
Nemo Outdoor with Indoor option is suited for indoor measurements. No bulky hardware needed: just a phone connected straight to a Tablet PC or Graphics Tablet. Standard Graphics formats (.jpeg, .bmp, etc.) and MapInfo maps supported Import a floor plan and use that as a map Nemo Outdoor supports markers, correlate events to positioning coordinates Colored based on parameter values Event notification icons can be displayed on the map
39

NEMO OUTDOOR RUNNING TEST AND SAVING LOGFILE, PLAYBACK
40
Summary
Powerful platform-based tool All the latest customer needs can be met through additions of options to the flexible and expandable Nemo Outdoor platform. Comprehensive and cost-efficient : one platform with support for different terminal vendors and more than 270 different test devices. Centralized solution All of the test devices among the extensive selection can be connected to a single laptop. Capable of benchmarking for 3 Network operator simultaneously Latest technologies : Support for LTE, HSPA+, TD-SCDMA, TETRA, GSM/GPRS/EDGE, WCDMA, HSDPA/HSUPA, DVB-H, CDMA/EVDO and WIMAX. Extremely easy to set up, configure and use with Autodetect devices, automated test with advantage script function. Fully customizable user interface, supported online map Open Street Map
41
Discussion & Practice
42
Part 3: Testing with Nemo Handy
43
1. Overview
NEMO HANDY
Nemo Handy belong to Anite Nemo Tool that help customer to quick troubleshooting inside field without laptop or driving test, walking test in small road, or inside building.
Nemo Handy
Nemo Analyze
Nemo Outdoor
Nemo Invex
Complete toolset from data collection to post-analysis with open File Format
Nemo FSR1
Nemo
Autonomo us
44
1. Overview NEMO HANDY PRODUCT FAMILY

Consists of smart phone and tablet based tools supporting Symbian (Handy-S), Android (Handy-A) and Windows Mobile (Handy-W) operating systems
Nemo Handy- S with Nokia C7-00
Nemo Handy-A with HTC Desire HD
Nemo Handy-A with Samsung Galaxy Tab 8.9 LTE
Nemo Handy-W with HTC Touch Pro 2
Nemo Multi Handy is the most portable and cost-effective benchmarking solution in the market
Multiple Handy terminals collecting syncronized measurement
data that enable benchmarking with up to seven terminals
45
1. Overview NEMO HANDY-S - Key Features

Collecting all KPIs that capable with Nemo Outdoor & Terminal Graphical, fully customizable and user-friendly user interface Voice quality measurements based on Mean Opinion Score (MOS) Enables collecting geographical coordinates with an internal or Bluetooth GPS receiver Supports EGSM/GPRS/EDGE/WCDMA/HSPA/ measurements Indoor map with markers and geodetic coordinates Automated service testing with scripts Real-time statistics BTS information, i.e. serving cell name, site name, distance to serving cell, and cell ID, can be displayed based on BTS file Forcing commands for channel lock, scrambling code lock, system lock, and cell barring Cell and timeslot testing, handover assist and handover suppression GSM frequency scanning and UMTS pilot scanning Playback for viewing measurement files after measurements
46
1. Overview NEMO HANDY-A - Key Features

Support up-to-date terminals: Galaxy TAB, Galaxy S2, S3, S4, HTC Desire HD, Incredible-S, Sensation, Thunderbolt, Vivid, Raider Supports GSM/WCDMA/HSPA/LTE measurements Automated service testing with scripts: voice call, FTP data transfers and HTTP data transfers Supports the following view types: line graphs, bar graphs and text views Real-time statistics Graphical, user-friendly user interface Enables collecting geographical coordinates with an internal GPS receiver Indoor map with markers and geodetic coordinates Live outdoor map Notifications on the map and graphs HTML testing with real web browser
47
1. Overview NEMO HANDY-W - Key Features

Supports GSM/WCDMA/HSPA measurements Manual Data Transfer (FTP) Logging Internal GPS Support Voice Call All Qualcomm chipset based parameters logged Based on HTC Touch Pro 2
48
1. Overview NEMO HANDY INTERFACES

User interface Multiple pages Bar graphs, line graphs, numerical views Indoor map Outdoor map Real-time statistics
49
2. Software & Tools

Installation Handy-S file License file (generated matching with IMEI) Nemo File Manager (auto convert Handy Logfile when importing to Nemo Analyze)
Installation step: Copy installation file and license file to memory or SD card of phone Open Application Office File Manager Run installation file & license file
50
3. Testing with Nemo Handy-S General information

Open Nemo Handy software in phone Press Option to view all Control Comands
Press about to view all license
51
3. Testing with Nemo Handy-S Manually testing

Press Option Tool choose test case run/call automatically recording end call/stop stop logging save logfile
52
3. Testing with Nemo Handy-S Script testing

Press Option Scipts Open Open a predefined logfile or create New Run Start Logging Stop Stop recording & save
53
Summary
Handy Solution: Handy-Symbian, Handy-Android, Handy-Window Phone Ease of use Intuitive user interface makes all operations from timeslot testing to creating complex measurement scripts time-effective and easy Multi Handy functionality A centralized solution for conducting large-scale measurements. One Nemo Handy works as a Master unit, sending script commands to as many as 6 Slave units Immediate file sharing Share display configuration files and scripts with other Handy users
54
55
Part 4: Analyzing and reporting with Nemo Analyze Software
56
1. Overview Nemo Analyze

Nemo Analyze Standalone
PC based postprocessing, analysis and reporting tool In-dept analysis and troubleshooting Corporate wide access to network KPIs via web interface Instant data reporting, benchmarking, statistics and map plots over nationwide data sets Enterprise level client-server based post-processing solution Centralized data storage, management and advanced search functionality In-dept analysis and troubleshooting
Nemo Analyze Snapshot

Nemo Analyze Enterprise
57
1. Overview Nemo Analyze Centralize solution

Analysis and Optimization
Visualization of all NW and application level diagnostics on map and various graphs Fully customizable, multi-page, synchronised UI
Nemo Analyze Enterprise
Nemo product portfolio
Troubleshooting
Server Clients Quickly found NW and application level problems from large data sets Drill-down to full details Root-cause analysis
Nemo Analyze Standalone
Benchmarking
Automatic benchmarking of QoS and NW KPIs between operators, technologies, terminals, and areas. CSV format ASCII data
Ascom TEMS products
Rohde&Schwarz ROMES product
Reporting Statistical reporting on NW and application level KPIs.
58
1. Overview Nemo Analyze Technologies supported

Supported technologies: GSM, GPRS,
EDGE, WCDMA, HSPA+ Upgradable technologies: CDMA, LTE, Wimax mobile, iDEN, TETRA, TDSCDMA, iDEN, DVB-H, EVDO, TDMA, WiMAX Benchmarking and analysis:
Different technologies Different test terminals and

scanners
59
1. Overview Nemo Analyze Storing Capacity
Thousands of log files can be loaded into Nemo Analyze running on a standard laptop Hundreds of hours of measurement data can be analyzed simultaneously as one dataset Every sample is stored into the database instead of just aggregates Files can be instantly filtered and merged based on geographical area, operator, time, measurement name, serving system, problem event, or any combination of these attributes
E.g. Find files from London downtown, from last month, with dropped calls
Coverage comparison over 1125 hours (140 man-days) of data
60
1. Overview Nemo Analyze Live Map

Nemo Analyze supports KML-based live maps, OpenStreetMap, and Google Maps. Internet connection is required, the map tiles are retrieved as needed when map is opened, zoomed, or panned. Live maps can be used the same way as regular MapInfo maps, including
Route colorcoding Base station overlay Line drawing to serving and neighbour cells Delta plotting Use in saved workbooks
61
2. Software & Tool Nemo Analyze

Installation file License inside copy protection dongle Nemo File Manager (import handy logfile)
Run Installation file run Nemo File Manager
62
2. Software & Tool Nemo Analyze User Interfaces

Work book
Tool & Menu Logfile group by folder Parameter, Queries, Troubleshooting tool
Logfile, BTS file, Map, report template control menu
Database loader
63
3. Using Nemo Analyze Exporting Process

Importing logfile
Choose logfile/multi logfile choose parameter Statistic or Open Select Data view Drag-drop inside map/grid Exporting workbook
64
3. Using Nemo Analyze Reporting Process

Importing logfile
Choose logfile/multi logfile right click select Report save or print report
65
3. Using Nemo Analyze Services performance report

KPI reporting on following services:
Voice call (ETSI-compliant) Video call (ETSI-compliant) SMS MMS Generic packet data (Attach + PDP Context Activation) WAP HTTP FTP E-mail Ping Streaming
66
3. Using Nemo Analyze Advanced functions Event Scheduler

Typical steps of the post-processing chain can be
automated :
Loading measurement data into the tool Running report for the new data Checking critical KPIs from the new data
Distributing reports and problem alarms in the

organisation
67
3. Using Nemo Analyze Advanced functions (2)

Spreadsheets report design: Drag and drop parameter aggregates and statistics on a single spreadsheet based on multiple measurement files and KPIs save report template MS Excel Report templates: Export query result data sets from Nemo Analyze to a selected location within an existing MS Excel document.
68
3. Using Nemo Analyze Advanced functions KPI workbench

User-friendly way of creating custom parameters and KPIs No need for SQL or programming knowledge
Provides tools for complex KPIs: State machine, useful e.g. in tracking certain signaling message sequences AVG, MIN, MAX, COUNT, CASE, etc
69
3. Using Nemo Analyze Advanced functions Automatic troubleshooting

Drill-down:
Get list of failures (e.g. dropped calls)

in the dataset Drill-down with double-click to see full details per failure Full details analysed only around the problem events efficient troubleshooting of vast datasets
1. level: summary
Predefined troubleshooting and optimization tasks:
Call failure and dropped call root

cause analysis Missing neighbor analysis Neighborlist optimizer Cell overspilling analysis and crossfeeder detection Cell footprint survey BCCH clash analysis (overlapping BCCH) Scrambling code clash analysis(overlapping scr) HSUPA low throughput root cause analysis
2. level: individual failures
3. level: full details
70
Summary
Complete analyzing and reporting software that support:
Importing and storing logfile in database Exporting and reporting Automatically analyzing and reporting with event schedule Creating Report templates with Microsoft excel KPIs workbench
71
72

Network Troubleshooting and Optimization With Nemo Tools

Enviado por

Dados do documento

Descrição original:

Direitos autorais

Formatos disponíveis

Compartilhar este documento

Compartilhar ou incorporar documento

Opções de compartilhamento

Você considera este documento útil?

Este conteúdo é inapropriado?

Direitos autorais:

Formatos disponíveis

Network Troubleshooting and Optimization With Nemo Tools

Enviado por

Direitos autorais:

Formatos disponíveis

Mobile Network Driving Test Training

With ANITE NEMO tools

1. Overview of driving test tools

2. Driving test solution

2. Driving test solution

2. Driving test solution

2. Driving test solution

2. Driving test solution

Summary Driving test overview:

Currently solution for driving test:

Part 2: Testing with Nemo Outdoor

Modem 3 Modem 2 Modem 1

Scanner 3 Scanner 2 Scanner 1

NEMO OUTDOOR HARDWARE NEMO MULTI LITE

NEMO OUTDOOR HARDWARE NEMO WALKER

Use case examples

In-vehicle use with standard +12V input

22 NEMO OUTDOOR VOICE QUALITY TESTING MOBILE TO MOBILE

NEMO OUTDOOR VOICE QUALITY TESTING MOBILE TO FIX

1. Overview NEMO OUTDOOR NEMO SERVER

With Nemo Outdoor it is possible to conduct data testing against

Commercial/private servers and Nemo test server

Supported in Nokia terminals

2. Software & Tool Nemo outdoor installation packet Drivers:

2. Software & Tool

3. Testing with Nemo Outdoor

Tool bar + function

3. Testing with Nemo Outdoor

3. Testing with Nemo Outdoor

3. Testing with Nemo Outdoor NEMO OUTDOOR GRID, TABLE

Messages from events, L3, etc. decoded

3. Testing with Nemo Outdoor NEMO OUTDOOR MAP

Interfering cell presentation on the map

Telecom Test & Optimization Expert

3. Testing with Nemo Outdoor NEMO OUTDOOR MAP

3. Testing with Nemo Outdoor

Discussion & Practice

Part 3: Testing with Nemo Handy

1. Overview NEMO HANDY PRODUCT FAMILY

Nemo Handy- S with Nokia C7-00

Nemo Handy-A with HTC Desire HD

Nemo Handy-A with Samsung Galaxy Tab 8.9 LTE

Nemo Handy-W with HTC Touch Pro 2

1. Overview NEMO HANDY-S - Key Features

1. Overview NEMO HANDY-A - Key Features

1. Overview NEMO HANDY-W - Key Features

1. Overview NEMO HANDY INTERFACES

2. Software & Tools

3. Testing with Nemo Handy-S General information

Press about to view all license

3. Testing with Nemo Handy-S Manually testing

3. Testing with Nemo Handy-S Script testing

Discussion & Practice

Part 4: Analyzing and reporting with Nemo Analyze Software

1. Overview Nemo Analyze

Nemo Analyze Snapshot

Nemo Analyze Enterprise

1. Overview Nemo Analyze Centralize solution

Nemo Analyze Enterprise

Nemo product portfolio

Nemo Analyze Standalone

Ascom TEMS products

Rohde&Schwarz ROMES product