Escolar Documentos
Profissional Documentos
Cultura Documentos
Contents
1
Introduction
1.1
1.2
Capabilities ....................................................................................................................... 8
1.3
1.4
2.2
1.2.2
1.2.3
IP Trace Import.............................................................................................................. 8
1.2.4
1.2.5
1.2.6
1.2.7
1.2.8
1.2.9
1.2.10
1.3.2
1.3.3
1.3.4
11
2.1.2
2.1.3
2.1.4
2.1.5
2.1.6
2.2.2
System Description
3.1
1.2.1
Overview
2.1
Licensing ......................................................................................................................... 18
3.1.1
Local Licensing............................................................................................................ 18
3.1.2
Floating Licensing........................................................................................................ 18
3.1.3
Key Features
4.1
18
20
4.1.2
4.1.3
4.1.4
4.1.5
4.1.6
4.2
4.3
4.1.8
Diagnostics ..................................................................................................................28
4.1.9
4.2.2
4.2.3
4.2.4
4.2.5
4.2.6
4.2.7
4.2.8
4.2.9
4.2.10
Histogram View............................................................................................................ 39
4.2.11
4.2.12
4.3.2
Reporting .....................................................................................................................43
4.3.3
45
5.1
5.2
5.2.2
5.2.3
4.1.7
51
6.1.2
6.1.3
6.1.4
6.1.5
6.1.6
Appendices
58
7.1
7.2
7.3
7.4
7.5
7.6
7.7
GIS .................................................................................................................................. 60
7.8
Reporting......................................................................................................................... 60
7.9
7.10
Map Support.................................................................................................................... 62
7.11
7.12
Export ............................................................................................................................. 62
7.13
7.14
Introduction
For true benchmarking, monitoring, rollout, and analysis and troubleshooting of UMTS, CDMA, TDSCDMA, WiMAX, and LTE wireless networks, Ascom Network Testing offers the post-processing
tool TEMS Discovery.
TEMS Discovery is highly configurable and extremely user-friendly. It allows engineers to easily
assess wireless performance and quickly pinpoint network problems.
Highly automatic data processing increases the efficiency and provides instant access to
knowledge about the behavior and performance of your network. No other product can match the
variety of information elements that TEMS Discovery handles, allowing thorough analysis of the
collected data. With comprehensive GIS data support and display you can pinpoint and visualize
network problems.
Analyzing air interface measurements in TEMS Discovery is the only way to obtain a truly
adequate picture of the network, thanks to the many unique and advanced features within TEMS
Discovery that competing reporting and analysis products cannot match.
TEMS Discovery helps operators to:
Increase revenue: Problems can be located and fixed before they start affecting
customers, improving customer satisfaction and reducing churn. Fewer blocked and
dropped calls mean more call time and higher earnings. A high quality of service also
helps attract new subscribers.
Maximize their competitive edge: With TEMS Discovery the entire network is
scrutinized down to the smallest detail. Every single event, all important key
performance indicators (KPIs), any signs of network degradation, and many more are
examined continuously. This keeps your network at the highest possible quality, leaving
competitors behind.
Speed up rollout and verification of new technology: Analyzing huge data volumes
takes a lot of time and with TEMS Discovery the process can be simplified and focused
on detecting and solving problems not only processing data. With the introduction of
TEMS Discoverys new diagnostics features, users can pinpoint issues in network
configuration and other problems that can be time-consuming to identify. Using
diagnostics, they can find the signatures of the problems and highlight them.
TEMS Discovery provides comprehensive data processing for both packet-switched and circuitswitched data. TEMS Discovery supports all major radio technologies, as listed in Appendix 6.3.
This data processing uses multiple data sources, such as measurement data from drive test
devices and scanners, as well as GIS data, network cell configuration and parameters, neighbor
lists, and antenna patterns. To complete the picture, drive test data can be synchronized with
network call traces and IP traces (LibPcap).
For LTE, for example, TEMS Discovery supports analysis of both LTE scanner data and LTE
device data from all supported drive test tool vendors, more than 2,000 LTE information elements,
events, and cell data items.
NT12-3246, 1.0,2/24/2012
The TEMS Discovery portfolio is easy to configure according to your post-processing needs,
starting from single logfile analysis in TEMS Discovery Replay, up to a fully automated centralized
post-processing solution based on TEMS Discovery Enterprise.
With TEMS Discovery, you will increase your efficiency and profit via:
Easy and extensive customization capabilities: The various views and Data Explorers can be
arranged in countless combinations. Multiple sub-views for easy side-by-side comparison or the
more conventional views with maps (including Google Maps and Microsoft Bing Maps, through
license agreements), time series, messages, tables, histograms, or reports the choice is yours. In
addition, TEMS Discovery includes a completely customizable report template builder, key
information settings, analysis sets, point detail configuration, and more.
Figure 1.
Low total cost of ownership: The software can be deployed with minimal IT system requirements
and with minimal dependence on third-party software. Large volumes of data are handled with low
memory demand, and the intuitive interface provides a fast learning curve and reduced analysis
time. There is also integrated online access to free or low-cost GIS data sources.
Flexible deployment architecture: Network configuration is easy to set up with minimal platform
requirements and allows for collaboration of engineers across functional roles and geographies.
The processed data is instantly accessible across the organization and provides highly organized
information, with an unlimited number of composite datasets.
Multivendor capabilities. TEMS Discovery handles a variety of drive test tools and is thus the
only post-processing tool you need to learn, maintain, and upgrade.
1.1
RF engineers are notified of all sorts of local malfunctions (weak signal reception, bad
C/I, low data throughput, etc.), prompting them to try out various tweaks to the network
configuration. TEMS Discovery provides easy access to information elements as well as
on-demand data extraction and intelligence embedding with the Script Builder, for
pinpointing and evaluating network problem areas. Advanced R&D staff can also use
TEMS Discovery as a research tool in the rollout stage of emerging technologies,
because it provides customization of scripts.
Managers are able to supervise the organizations processes and services. They can
keep track of any events or metrics of interest (dropped call rate, to give just one
example) by studying reports easily defined with the Report Builder. They are aided in
making decisions on investments and organizational improvements. By getting a tighter
grip on the networks end-to-end voice and data quality, the company is also in a better
position to offer customers reliable service level agreements.
Network planners learn about spots with recurrent problems by requesting statistics
confined to specific areas. This helps reveal deficiencies in the network layout or the
underlying theoretical models, while also providing input for improvements. As a result,
planners are able to boost network utilization and get maximum mileage out of the
existing network before new investments are made.
Marketing staff can extract statistics on usage patterns, furnishing the basis for
precisely targeted advertising campaigns. Being more intimately familiar with the
networks quality of service, marketers can also work out more advanced and precise
charges for various services. It is less risky to promise, and charge for, quality that has
been thoroughly assured.
The customer care unit can order coverage information to enlighten customers who
are making complaints or enquiries. Complaints can be cross-checked against network
status reports to help determine whether a problem resides in the network or in the
customers handset.
1.2
Capabilities
1.2.1
TEMS Discovery supports the import of native drive test data from the major drive test tool vendors
(see Appendix 6.2).
With the generic data import, any text-based (.tab or .csv) file format can be imported to TEMS
Discovery. It is easy to define an import schema by dragging and dropping.
1.2.2
Call traces from Ericsson and WCDMA can be imported and synchronized with the drive test data.
1.2.3
IP Trace Import
IP trace data (LibPcap) collected together with drive test data can be synchronized and analyzed in
TEMS Discovery.
NT12-3246, 1.0,2/24/2012
1.2.4
Site data can be imported as network configuration files. TEMS Discovery supports import of cell
configuration data from multiple network planning tool and drive test tool vendors. Network
configuration data can also be imported from Ericsson OSS (Bulk CM), as shown in Appendix 6.4.
With the generic network configuration import, any text-based (.tab or .csv) file format can be
imported to TEMS Discovery. It is easy to define an import schema by dragging and dropping.
Network configurations imported into TEMS Discovery can be exported to Ascom Network
Testings TEMS XML cell file format.
1.2.5
For map display, there is a wide selection of free or low-cost yet high-quality data available. TEMS
Discovery supports approximately 100 commonly used GIS file formats, including:
Automatic merging of GIS data with different sources, formats, and projections
1.2.6
The network configuration file can contain antenna type as a parameter of the sector table. TEMS
Discovery is able to provide a view for the antenna pattern of a sector.
1.2.7
Coverage maps exported from external planning tools can be imported into TEMS Discovery.
Those coverage maps can be displayed in the Map View for viewing, or used to generate delta
metrics.
1.2.8
Handover matrices can be imported. Based on those matrices, TEMS Discovery can perform
neighbor list tuning and eventually export a neighbor list work order for implementation. See
Appendix 6.12.
1.2.9
Import API
TEMS Discovery provides an API for users to develop their own parser to import data into TEMS
Discovery. This means that you can import native data from any tool and any type of data.
1.2.10
Operating Systems
TEMS Discovery is a .NET application that can be used with most of the Microsoft operating
systems. See Appendix 6.1.
1.3
Functionality Levels
TEMS Discovery Standard includes all the functionality needed to analyze drive test
data, multiple logfile analysis.
1.3.1
TEMS Discovery Replay is a low-cost single logfile post-processing tool for TEMS logfiles. With
TEMS Discovery Replay you can quickly analyze collected logfiles. For more information, see
Appendix tables.
1.3.2
The Standard version includes multiple logfile analysis capabilities with synchronized views and
built-in standard reporting. TEMS Discovery Standard 1 is available with local or network license.
For more information, see Appendix tables.
1.3.3
The Professional version includes all of the functionality needed for drive test data analysis and
lets you tailor the tool to fit into the process flow.
TEMS Discovery includes Script Builder, Report Builder, and automatic data processing, just to
mention some of the advanced features that can make the analysis efficient. For more information,
see Appendix tables.
1.3.4
The Enterprise version is a tool for server-based, centralized post-processing. It offers a huge
processing capacity and includes a multidimensional statistical database that simplifies reporting
and analysis on a statistical level. The processed data can be accessed and analyzed from the
TEMS Discovery Web Client or from TEMS Discovery Professional. TEMS Discovery Enterprise is
based on Microsoft SQL Server 2008 R2 and can easily be integrated into a Microsoft
SharePoint/Reporting Services environment.
1.4
For additional information concerning TEMS Discovery or other TEMS products, please visit us on
the Web at www.ascom.com/networktesting.
To sign up for a subscription to TEMS Bulletins, please go to the link above and click Register for
TEMS Bulletins. This free service includes email notification of TEMS product launches, version
upgrades, and patches, as well as our online customer magazine.
TEMS Discovery Standard bundled with TEMS Investigation supports only logfiles collected with TEMS
Investigation.
10
NT12-3246, 1.0,2/24/2012
Overview
2.1
With TEMS Discovery, you have the flexibility to configure a wide range of items, from simple view
layouts and key information settings to sophisticated report templates. You can embed your
companys preferences, expertise, and knowledge into the tool and thereby define your sets of
preferences or templates.
Post-processing with TEMS Discovery fulfills a full range of needs:
Initial tuning: Find missing neighbors, evaluate your coverage, and review your
services, among other tasks.
Network monitoring: Key performance indicators (KPIs) for voice, data services,
streaming video, and video telephony help you to keep track of the quality of your
network. They also serve as good decision support for your improvements.
Network optimization: The tool assists in pinpointing network problems, including root
cause analysis.
Benchmarking: Find out if you are best or worst or somewhere between, and identify
the differences between you and your competitors.
Coverage analysis: Coverage is not only about measuring your signal strength values,
but also accessibility of different services, limited service plots, and no-coverage plots.
With various drive test tools you can perform measurements on your roaming partners
to find out if they are fulfilling their requirements. TEMS Discovery coverage plots can
also be used in your planning tool.
Indoor: TEMS Discovery can import indoor measurements including RF data, pinpoints,
and maps in a single operation, if the indoor map is not positioned, the map can be
geolocated with a few clicks.
11
2.1.1
Full access to various types of data and simultaneous display of this data enhances your
understanding of the networks performance. You can customize what to display on the screen as
well as how it is displayed.
Figure 2.
Some of the useful functions that enable you to find what you are looking for are listed below:
12
NT12-3246, 1.0,2/24/2012
2.1.2
Scripting Capabilities
The Script Builder provides an advanced function to extract data from messages and apply
customized algorithms to generate new metrics and events. It offers rule-based classification of
events and automated analysis, and thus considerable time savings.
Figure 3.
The Script Builder assists in customizing algorithms and extracting specific data
All metrics
Generated metrics and events are accessible from all tools and reports, similar to
already built-in metrics and events.
13
2.1.3
Reporting Capabilities
Accurate analysis templates and reports are important for the sharing of knowledge.
The Report Builder within TEMS Discovery is designed to provide great flexibility for generating
reports in Microsoft Office Excel (*.xls) format from drive test data. It eliminates the need to
request customized generations from other tool vendors, or to manipulate data manually.
There are also predefined and built-in report templates for RAN tuning or acceptance reports. See
chapter 6.8.
With the Report Builder, reports can be designed either from the measurement database or from
the multidimensional database in TEMS Discovery Enterprise.
The corresponding Map View is automatically included in the report, so there is no need to copy
and paste.
Figure 4.
With the Report Builder, all you need to do is drag-and-drop data objects to generate a final report.
Here are the advantages of the tool:
14
Styles
Charting
NT12-3246, 1.0,2/24/2012
Reports can be sent via email directly to specific recipients or to predefined groups of recipients.
2.1.4
A problem set is a group of predefined rules for filtering out specific logfiles (from a large set of
logfiles) that contain problems. TEMS Discovery is delivered with a number of built-in problem sets
for the different technologies. The problem sets can be customized and connected to analysis sets
tailored for the analysis of the detected problem.
Figure 5.
Users can define any combination of problem sets from predefined or user-defined events.
2.1.5
Analysis Set
An analysis set is a group of view layouts (map, time chart, message view, etc.) with precise
configuration settings describing the specific names of the metrics to be displayed in a given view.
The user can tailor and save analysis sets for specific tasks. To perform an analysis the user
selects a data source and opens the selected analysis set. All views included in the analysis set
will be opened and populated with selected metrics and events in a single click.
2.1.6
TEMS Discovery offers an efficient way of working that can reduce the time to pinpoint and analyze
problems.
1. Load the data that will be analyzed: drive test data, network configurations, call traces, IP
traces.
2. Generate a report so problem areas can be prioritized and analyzed in the desired order.
3. Use the problem set to filter out the prioritized problem areas.
4. Launch an analysis set designed to analyze and troubleshoot a specific problem area.
NT12-3246, 1.0, 2/24/2012
15
2.2
TEMS Discovery is easy to learn and extremely user friendly. That minimizes the need for training
and the amount of startup time required. A getting-started function called Walk-U-Through (TEMS
Discovery Wizard) walks you through some of the most common usage tasks.
Figure 6.
Since the tool has an exceptional number of rich features and supports all possible technologies, it
is a complete choice for your post-processing needs.
The user interface and the way of working are the same in the PC-based analysis tools and the
Web-based tool.
2.2.1
TEMS Discovery fully integrates Google Maps/Microsoft Bing Maps. Moreover, more than 100
different file formats of terrain elevation data, raster image data, and vector files are supported.
Figure 7.
USGS TerraServer
16
Free downloading of data for TEMS Discovery default boundary or any userdefined area
Web links to popular websites for free or low-cost GIS data sources
NT12-3246, 1.0,2/24/2012
2.2.2
TEMS Discovery supports measurement data from the major vendors of drive test tools. This
means that there is only one tool to learn and that it is easy to have a common way of working.
17
System Description
TEMS Discovery can be deployed for different scenarios, from stand-alone data processing to
centralized data processing and network licenses.
3.1
Licensing
TEMS Discovery has two types of licensing: local licensing and network licensing.
3.1.1
Local Licensing
The local license is installed on each users laptop or desktop, and each user can have the
different configurations of options on his/her dongle. Hence, there is no need to have access to the
intranet.
Figure 8.
3.1.2
Floating Licensing
This licensing is achieved by a license pool, with a global or regional license server. Multiple users
can share the license as long as there are free licenses available on the server. The license pool
needs to have the same setup of options, and all users will get the same license options.
Figure 9.
18
NT12-3246, 1.0,2/24/2012
3.1.3
Network Licensing
Network licensing is software-based. This licensing is achieved by a license pool, with a global or
regional license server. Multiple users can check out a license for a specific time; after a license
has expired, it is disabled and returned to the license server. All TEMS Discovery licenses in the
pool must have the same set of options.
Figure 10.
19
Key Features
This chapter describes some the key features of TEMS Discovery and is by no means a
comprehensive list. The aim is to cover some essentials of how the product works, and to spotlight
a number of specific functions that are particularly useful.
4.1
Using drive test data and site data, you can build business intelligence for the entire organization
with TEMS Discovery. The data is processed and easily accessible for many different purposes by
all departments. Following are examples of typical recipients.
20
The sales force, which can be provided with reports showing improvements that
have been made and comparisons with competitors
NT12-3246, 1.0,2/24/2012
4.1.1
To be able to find specific information with little effort and analyze it smoothly, the collected data
has to be very well-organized and cleverly managed.
Figure 11.
Organized and well-managed data enables easy access and fast analysis
In TEMS Discovery:
There is controlled sharing of all processed data across multiple users, for avoiding
duplication of work.
Old data can be easily archived, and restored if needed with its structure intact.
Data from different data sources, such as drive test data, IP trace, and call trace is
handled in an integrated manner.
21
4.1.2
The multidimensional statistical database makes it fast and easy to analyze huge amounts of data
and to filter data in many different ways and dimensions. The multidimensional statistical database
in TEMS Discovery is user-configurable by drag and drop.
Any metric and event in the measurement database can be defined as a metric in the database.
Dimensions can be defined by time, area, device attributes, or events and metrics. See section
6.1.4.
The multidimensional database supports computation of statistics such as count, min, max, and
mean.
The data is automatically geo-binned at seven different levels. The user selects the smallest bin
size. Additional bins will be created automatically based on multiples of the smallest defined bin
size (100m 100m, 200m 200m, 400m 400m, up to max bin size defined as 12,800m
12,800m).
Figure 1.
22
NT12-3246, 1.0,2/24/2012
4.1.3
TEMS Discovery supports comprehensive message decoding, giving you full access to information
elements. Extracting the value of a key information element from over-the-air Layer 3 signaling
messages is as simple as clicking the desired information element, or IE, in the built-in IE explorer.
You can select any information elements and display their values in the message summary view,
eliminating the need to check message details one by one.
Figure 2.
Quick reference and signaling message encyclopedia for RF engineers and expert
users
To make the analysis complete, drive test data can be correlated with Ericsson Traffic Recordings
(UETR) and IP traces (LibPcap).
The data from all different sources will be synchronized.
23
4.1.4
The message flow diagram enhances the ability to analyze the radio signaling or IP signaling by
presenting the uplink and downlink signaling as a flow chart including time delays and response
times.
Figure 3.
24
NT12-3246, 1.0,2/24/2012
4.1.5
For analysis of huge amounts of information to be possible at all, the handling and processing of
the collected data must be carried out in a very efficient manner.
Figure 4.
One of the major reasons why TEMS Discovery is so powerful and yet so easy to use is that the
processing of data is fast and efficient, due to the following features:
Flexible processing, where the user selects IEs of interest and whether to perform
geolocation binning directly or later on
25
26
NT12-3246, 1.0,2/24/2012
4.1.6
The binning of data directly affects the KPI statistics as well as analysis of the data.
Figure 5.
For utmost flexibility, there are several options available for data binning as shown below:
Smart selection
Geo-binning
Distance binning
Grid binning
Per-region mixed resolution (for example, fine resolution in dense urban areas and
coarse resolution in rural areas)
Holes can be defined in regions, for additional binning (and filtering) options
27
4.1.7
In order to find specific information among the collected data, no matter how well organized it is,
you need a filtering function that assists you in this complex task.
Figure 6.
You have several filtering options that, whether used individually or combined, bring out the wanted
information. Those filtering options are:
Geographical regions
4.1.8
Diagnostics
Diagnostics (intelligent rule-based analysis) is a supremely powerful feature that will help you to
pinpoint existing or potential problem areas that are often difficult and tedious to locate manually.
The diagnostics are designed to reveal weaknesses related to cell configuration, tuning and
optimization, accessibility, retainability, and integrity. Diagnostics are also used for classification of
problem events like drop, block, etc.
Examples of diagnostics included in TEMS Discovery
28
Low PESQ categorization on WCDMA (due to missing neighbor, pilot pollution, etc.)
NT12-3246, 1.0,2/24/2012
4.1.9
The sharing of processed data across the organization is handled via a designated public folder.
TEMS Discovery provides:
Figure 7.
TEMS Discovery document and configuration sharing across the organization. Contents of red-colored
configurations can be further set to read-only or hidden for intellectual property rights (IPR) protection
29
4.2
Analysis Views
This section highlights some of the views that will assist you in analyzing your network. The
intention is not to provide a comprehensive description of all details but to give you a taste of the
capabilities of TEMS Discovery.
The analysis views are the same in the PC based analysis tools and the Web based analysis tool.
The Web client includes most of the analysis views for a first analysis, see section 6.9.
4.2.1
Map View
The Map View is a multilayer display that can show multiple datasets, multiple cell configurations,
and multiple GIS in the same view. To display data in the Map View, you simply drag the data
object from the Data Explorer and drop it into the Map View.
Figure 8.
Map View presenting multiple types of data (drive tests, GIS, indoor floor print, cell configuration) in
multiple synchronized or nonsynchronized subviews, multimetrics displayed with offset, and floating legends
TEMS Discovery supports terrain elevation data, raster image data, and vector files. You can
download free high-resolution aerial images and terrain elevation data directly from several GIS
servers worldwide.
Multiple synchronized subviews can easily be created for extensive geographical comparison and
analysis.
Cell sites can then be plotted on the map. Cell names, identities, or any other labels can be
presented next to the cell site symbol. Clicking a site displays information about it.
30
NT12-3246, 1.0,2/24/2012
The information loaded into the Map View can also be displayed in Google Maps or Microsoft Bing
Maps.
Figure 9.
Indoor drive test data can also be displayed with high-resolution satellite images as background
Spider movement tool: Displays ray lines that link the data point to the appropriate sector
for serving and neighboring sites.
Sector coverage tool: Makes it possible to click on a sector to view its coverage.
IntelliSense tool: Displays the information of a data object in a tool tip while moving the
mouse over that data object.
Neighbor list IntelliSense tool: Displays ray lines that link to neighboring sectors, when
moving the mouse over a sector.
Antenna pattern viewer tool: Makes it possible to click on a sector to view its antenna
pattern.
Terrain path profile tool: Displays the terrain path profile when clicking and holding to
draw a path.
In addition, the Map View display can be captured as an image file or be exported as a TIFF file or
GIS package. You can also generate a PDF file or print the Map View display.
31
4.2.2
With the integration of Microsoft Bing Map or Google Map in TEMS Discovery it is possible to get a
3D view of the collected data and it is easy to understand the radio environment. To set up the
view, the user drags-and-drops metrics, events, and cell configurations into Google Map or
Microsoft Bing Map.
Figure 10.
32
NT12-3246, 1.0,2/24/2012
4.2.3
The Time-series Chart displays how the values of radio parameters evolve over time. Several
parameters can be plotted in the same chart to enable quick inspection of correlation. Important
time chart features include:
Events shown
Figure 11. Time-series Chart displaying multiple metrics and events. Coloring indicates changes in active set
membership.
The user can place a label with user-defined text in the chart
The Time-series Chart display can be printed and saved as an image file
33
4.2.4
Message View
The Message View contains two panels. The left-hand panel is a spreadsheet that lists the
messages in time sequence, and the right-hand panel displays detailed information of the selected
message at the left.
Figure 12.
34
By mobile ID
By type of information
By selected message
By KeyInfo
NT12-3246, 1.0,2/24/2012
4.2.5
Table View
Table View provides a tabular display of multiple metrics and events, and the data can be exported
to Excel or MapInfo MID/MIF.
Figure 13.
The Table View can also display a statistical report of the metrics.
Figure 14.
35
4.2.6
The Point Details View provides a convenient overview of detailed information from a particular
time or location. By moving the cursor into the Map View and Time Chart, or by changing the row
selection in the spreadsheet of the Message View and Table View, the detailed information will be
displayed as shown below.
Figure 15.
The Point Details View displays detailed information about a specific measurement sample or message
You control what to display by selecting a specific user-configurable metric group from the
configuration combo box. You can also edit or sort the displayed metric group.
The Point Details View can also be displayed in the Map View as tool tip information.
Figure 16.
36
NT12-3246, 1.0,2/24/2012
4.2.7
The Instant Chart View is a user-configurable view for graphical display of a set of array data.
Features include:
Multiple configurations
Examples of usage:
Scanner or phone data: Ec/Io and RSCP for all pilots on one or multiple UARFCNs
Figure 17.
37
4.2.8
Metric correlation enables the indication of a linear/nonlinear relationship between two metrics. You
simply drag a metric data object from the Data Explorer and drop it into the Metric Correlation
View, then drag another metric data object and drop it into the same view. The relationship
between these two metrics is then established with the least squares fitting mathematical
procedure.
Figure 18.
4.2.9
This view summarizes device problems based on predefined or user-configurable problem sets
(dropped calls, handover failures, etc.). You drag-and-drop devices into the view and if a device
has problems, its background color will change from white to orange.
You can choose to display all devices or only those with problems. You can view the details of a
problem for a particular device or analyze the device itself.
All problem-related information can be saved to Excel.
From the Problem Summary View you can open the problem file with an analysis set designed to
evaluate the specific problem at hand.
Figure 19.
38
NT12-3246, 1.0,2/24/2012
4.2.10
Histogram View
The Histogram View is for graphical display of metric data showing the proportion of data that falls
into each specific plot band. The graphical display of metric data can be shown as a bar graph, a
2D pie chart, or a 3D pie chart. All options can be freely converted from one to the other.
Figure 20.
39
4.2.11
Multidimension Statistic View displays on-demand statistical data for multiple metrics in multiple
user-selected dimensions. The user can filter data by using the built-in dimensions device
attributes, time and date, UDR, cell configuration, or the user can define a new dimension from any
metric by drag-and-drop the metric. The Multidimension Statistic View supports different statistical
aggregation methods including mean, max, min, count, standard deviation, etc.
Figure 21.
The Multidimension Statistic View also provides a chart presentation of the selected data in the
table.
Figure 22.
To drill down to the details behind the statistical data, you can click on a cell in the grid and a list of
files will be generated in the spreadsheet. You can save the list to file, create a composite dataset
from the list, or generate a report from the list. All data can be exported to external files.
40
NT12-3246, 1.0,2/24/2012
4.2.12
The Sector Statistic View displays a metric per sector binning; its functions are similar to those of
the Table View. To display data in the Sector Statistic View, drag the metric data object from the
Data Explorer and drop it into the Sector Statistic View.
Figure 23.
41
4.3
4.3.1
Script Builder
TEMS Discovery provides an easy-to-use scripting capability with the built-in Script Builder. With
the Script Builder, new metrics or events can be defined by combining already defined metrics and
events.
With the Script Builder you can define:
New metrics, either based on all built-in metrics or on those extracted from any Layer 3
message. One example of a new metric would be mean signal strength three seconds
before a handover.
New events, with combinations of defined events, metric thresholds, or Layer 3 messages.
An example of a new event would be handover failure due to bad coverage. In this case,
the built-in dropped call event is the trigger event and if the signal strength three seconds
before handover is below a defined threshold, then the new event is generated.
All new metrics and events defined will be available in all tools in the same way as the built-in
metrics and events.
Figure 24. This script calculates the RRC setup time as the time between RRC Connection Request and RRC
Connection Setup Complete
42
NT12-3246, 1.0,2/24/2012
4.3.2
Reporting
The Report View shows a particular mobile device or dataset based on a predefined report
template. Simply right-click on a mobile device or dataset, select Send to Report View, and TEMS
Discovery will generate a report (in Excel XLS format) based on the selected report template from
the target data.
You also have the option to define your own report template or to specify what you want to include
in a report, with the help of the very flexible Report Builder.
This eliminates the need to request customized report generation from other tool vendors, or to
manipulate data manually.
The Report Builder:
Provides drag-and-drop access to all metrics and events absolutely no SQL, Macro, or
VB script knowledge required.
Can create very demanding and advanced report templates with complicated device
filtering criteria.
Figure 25.
With the Report Builder you can create your own templates and define how to display your data
Single values of metrics with statistical parameters such as count, mean, min, max, linear
average, standard deviations, variance, sum, first, duration, unique count, and more
Map Views with options for cell configuration, GIS data, and output area range
Sector-by-sector statistics
File-by-file statistics
43
Correlation statistics
4.3.3
The batch printing feature is an easy way to generate PDF reports including user-defined maps,
histograms, or time chart configurations.
With this useful function you can:
Select any configuration of metrics for Map View display or for a specific chart type.
Figure 26.
44
NT12-3246, 1.0,2/24/2012
TEMS Discovery is designed for in-depth study of your measurement data. It gives fast and full
access to already processed data. A generous set of data presentation views helps you visualize
the quality and performance of the network. TEMS Discovery uses a high-performance geographic
information system (GIS), supporting approximately 100 different map formats.
TEMS Discovery uses synchronizable views such as maps, time charts, messages, tables, and
point details to display data collected at the same time (for drive test data playback). There are
also data summary views such as histograms, metric correlation, reports, batch PDF views, and
problem summary views to present statistic data in various formats. The Problem Summary View,
for example, provides an easy way to pinpoint problems and drill down among user-configurable
analysis sets, to find the cause. Some usage examples are found in section 5.2, Further Examples
of How to Use TEMS Discovery.
Figure 27.
5.1
All of the data in TEMS Discovery is well organized, and, unlike competing tools where you need to
load raw log data in every new session, TEMS Discovery loads the data once and saves the
processed data permanently until removed.
Several projects may be active at the same time. Each project has its own workspace where all
views belonging to the project are kept together. This coherence makes it very easy to work with
several projects without losing track of what views belong together. View sizes can be freely
adjusted.
All views in a project are synchronized. Selecting a new item in one project view automatically
highlights the corresponding item in all other views.
45
A dataset is created by importing one or several raw drive test files. All of the processed data are
organized according to certain attributes, including the original file names, device names, mobile
IDs, labels, etc.
Processed data from one or more datasets of a project can be logically combined into composite
datasets. A typical practice is to group the processed data by one attribute, such as mobile IDs or
functional labels (long call, short call, PS call, etc.).
An analysis set is a group of view layouts that includes precise configuration settings describing
the specific names of the metrics to be displayed in a given view. You can send a whole set of
metrics defined in an analysis set from a selected data source with a single click.
5.2
The illustrations shown in section 4 mainly serve to support the description of the user interface
components. This section provides further examples of data presentations and analysis.
5.2.1
Figure 28. In this example, the reason behind a dropped call is analyzed. It appears that the SIR target cannot be
reached because of weak signal power. With the help of Google Maps, the user can conclude that the call was
dropped inside a building.
46
NT12-3246, 1.0,2/24/2012
5.2.2
TEMS Discovery has a number of features that make the analysis of TEMS Pocket indoor
measurements simpler and more efficient.
TEMS Pocket logfiles including an indoor map can be imported directly into TEMS Discovery and
displayed in the Map View with the indoor map as background. To get a complete picture of indoor
and outdoor measurements, TEMS Discovery provides an easy way of geopositioning the data, as
described in section 5.2.2.1.
To make indoor data collection efficient, multiple TEMS Pocket units can be used in parallel.
Employing one unit as the master, the user collects data and sets the pinpoints. The slave TEMS
Pocket will only run test scripts and collect data, so the logfiles from the master device will include
measurement data, map image, and pinpoints, and the logfiles from the slave device will include
measurement data only.
When the data is imported into TEMS Discovery, all logfiles will be positioned automatically as the
master device (see section 5.2.2.2).
5.2.2.1
Figure 29. Indoor measurements from TEMS Pocket, for example, can be positioned within the building where the
measurements are performed. The TEMS Pocket *.zip file containing the indoor measurements and the floor
plan is imported as a regular drive test data file. When any data is dragged and dropped into the Map View, the
floor plan appears with the selected data samples plotted. To position these measurements in relation to the
actual building, you right-click the floor plan in the explorer and GIS/coverage map tab and select Floor Print
Rectifier. Then you simply mark the corners of the floor plan and the corresponding corners of the building, and
the positioning is done. The result is displayed in the next figure.
NT12-3246, 1.0, 2/24/2012
47
Figure 30. After geo-rectification, the indoor measurement data can be displayed like normal outdoor drive test
data along with other GIS and cell configuration data
48
NT12-3246, 1.0,2/24/2012
5.2.2.2
To import master and slave indoor files into TEMS Discovery, select the master and slave logfiles
and enable the All TEMS Indoor files share the same floor print and way points option.
Figure 31.
By using Automatic Data Processing, TEMS Pocket master-slave logfiles can be imported and
positioned automatically.
49
5.2.3
Sector-Based Statistics
Color coding of sector icons with drive test KPIs for instantaneous, graphical visualization of
network performance
Figure 32.
50
Statistics easily generated per sector, clearly displaying the selected KPIs
NT12-3246, 1.0,2/24/2012
6.1
TEMS Discovery Enterprise meets the growing demand from large mobile operators for
centralized, automated, highly scalable solutions for enterprise-grade post-processing and analysis
of huge volumes of drive, in-building, nomadic, and autonomous test data. TEMS Discovery
Enterprise offers a single, unified platform for all of these data sources, constituting a highly
scalable clientserver solution that provides multifaceted performance information throughout the
network life cycle: all the way from rollout through optimization to benchmarking, in-building testing,
and subscriber quality of experience (QoE) assessment.
Figure 33.
The solution includes back-end data processing, Web-based clients, and connected workstation
components.
Figure 34.
51
The back-end system for TEMS Discovery Enterprise includes automated data processing, data
storage, analysis, and systemwide reporting. Web-based access is provided via a TEMS Discovery
Web Client that enables high-level analysis and on-demand reporting remotely from PCs, mobile
tablets, and devices. TEMS Discovery Professional is used as the systems troubleshooting,
configuration, and development tool.
6.1.1
Figure 35.
The data processing component includes the centralized processing engine, data storage, and
report generation. The automatic data processing handles multiple drive test logfiles in parallel and
stores metrics and events in the measurement database, whose structure is the same as in TEMS
Discovery Professional. After the data has been processed into the measurement database, it is
aggregated into the multidimensional statistics database. The raw logfiles are archived in the logfile
repository.
Both the measurement and the multidimensional statistics databases are user- configurable.
52
Time binning
Distance binning
Area binning
Multidimensional statistics
o
User-selectable metrics
User-selectable dimensions
NT12-3246, 1.0,2/24/2012
6.1.2
Web Client
Figure 36.
The TEMS Discovery Web Client is for visualization of high-level analysis as well as for on-demand
reporting. In the Web Client, statistical data can be displayed on dashboards and in graphs and
maps.
Figure 37.
53
6.1.3
Figure 38.
TEMS Discovery Professional is a vital part of the TEMS Discovery Enterprise solution.
Professional is the configuration tool where scripts, reports, dashboards, data aggregation, and the
statistical database are designed. Professional is also an advanced troubleshooting tool for
measurement database in situations where detailed information like Layer 3 and IP signaling is
required.
TEMS Discovery Professional can connect directly to TEMS Discovery Enterprise and analyze
data or download data locally without any need for reprocessing.
To support multidimensional statistical data analysis, TEMS Discovery Professional includes a
Multidimension Statistic View that connects directly to the statistical database: see section 6.3.2.
Configuration management
54
NT12-3246, 1.0,2/24/2012
6.1.4
With the multidimensional database builder the user defines the statistical database. The database
configuration is done by drag and drop of events and metrics that are to be included. Defining
dimensions (filters) for the database is also done by drag and drop. A dimension can consist of any
combination of time, area, metric, event, or device attribute.
Figure 39.
55
6.1.5
The Multidimensional Statistical Viewer gives direct access to the statistical database for analyzing
data and drilling down to problems by filtering data along selected dimensions. Troubleshooting of
logfiles can be done with a single mouse click in TEMS Discovery.
Figure 40.
56
NT12-3246, 1.0,2/24/2012
6.1.6
Dashboard Builder
With the Dashboard Builder, user-defined dashboards can be designed based on the metrics and
dimensions in the multilevel statistics database. The dashboard can include maps, charts, gauges,
and other graphical presentations that help visualize the statistics.
Figure 41.
Dashboard Builder
57
Appendices
7.1
Function
Replay
Standard
Professional Enterprise
Back-end
Replay*
Standard**
Professional Enterprise
Back-end
7.2
Logfile Support
Function
TEMS Investigation 8.0 13.1
TEMS Pocket 7.3 11.2
TEMS Automatic 7.2 9.0
TEMS Symphony (MDFS 6.1)
TEMS Monitor Master (MDFS 6.1)
Nemo nmf & Legacy .dt*, fs* files
File format version 2.0.8
JDSU .aod & Legacy .sd5 files
E6474A 16.0
LG LTE DM (LLDM), Version K
ZK Celltest (Log File Format V6.27)
Call trace (Ericsson UETR) W11A
IP trace (LibPcap)
Flexible text file import to User-defined Metric
Groups
Custom data import by plug-in API
Logfile extension:
Logfile extension:
.tmz
.log
58
NT12-3246, 1.0,2/24/2012
Logfile extension:
.qmd
.qmz
7.3
Supported Technologies
Function
Replay
Standard
Professional
Enterprise
Back-end
GSM/GPRS/EGPRS
WCDMA/HSPA/HSPA+
CDMA (IS-95/CDMA 2000 1x/EVDO rev 0, rev A & rev B)
TD-SCDMA
FDD-LTE
TD-LTE
WiMAX
7.4
Function
Data Processing
Replay
Standard
Professional
Enterprise
Back-end
Professional
Enterprise
7.5
Function
Replay
Standard
59
7.6
Handover Matrix
Function
Replay
Standard
Professional
Enterprise
Back-end
Replay
Standard
Professional
Enterprise
Web Client
Professional
Enterprise
Back-end
Alcatel-Lucent
7.7
GIS
Function
Supports more than 110 different
GIS data formats, including many
free or low-cost high-resolution
terrain data, satellite images, and
vector data
GIS data: terrain elevation, clutter,
raster image, vector data
Automatic merging and reprojection of data from different
map sources
Directly import GIS data from
multiple free online GIS data
sources
Integrated Google Earth
/map/satellite/terrain
Integrated Microsoft Bing Map
/map/satellite/terrain
3D Map View
Terrain profile tool
7.8
Reporting
Function
Replay
Standard
60
NT12-3246, 1.0,2/24/2012
7.9
Analysis Views
Function
Replay
Standard
Professional
Enterprise
Web Client
Map View
Table View
Message Summary and Detailed
View
Time-series XY Chart
Instant Chart View
Histogram View
Point Details View
Message Flow Diagram
Metric Correlation View
61
7.10
Map Support
Function
Replay
Standard
Professional
Enterprise
Web Client
Replay
Standard
Professional
Enterprise
Back-end
Replay
Standard
Professional
Enterprise
Back-end
7.11
Function
Advanced Script Builder
Powerful report template builder
Summary PDF view
Batch printing of multiple metrics
Script and Report execution
Multi dimensioning statistical
reporting
7.12
Export
Function
Export of single metric to MapInfo
mif/mid, delimited text files
Export of single metric to Google
kml/kmz
Export of multiple metrics to MapInfo
mif/mid, delimited text files, Excel
62
NT12-3246, 1.0,2/24/2012
files
Export of image files, PDF files,
GeoTIFF files
Neighbor list work order export
7.13
Function
Replay
Replay
Project handling
Export and import of projects
Data organization and management
Extensive data sharing across
organization
7.14
License Options
Function
Local license
Network license
Floating license
**
HW dongle licensing
Technology option
Automatic data processing option
Included
Included
63