QoE Analyzer User Guide

Version V 0.2
Guide Version
0.1
0.2

QoE Version
1.35
1.40

Date
03/17/14
03/20/14

Author
Kranthi Sontineni
Zach McPherson

Comment
Initial Draft
First Edit

Contents
1 Introduction............................................................................................................................... 4
1.1 Purpose............................................................................................................. 4
1.2 Scope................................................................................................................ 4
2 Installation................................................................................................................................ 5
2.1 Required hardware and software.......................................................................5
2.2 Installing QoE Analyzer...................................................................................... 5
2.3 Type of input files QoE analyzer can process.....................................................5
2.4 Saving the output files...................................................................................... 5
3 Display Overview...................................................................................................................... 6
3.1 ADD Files........................................................................................................... 6
3.1.1 IP filtering Feature....................................................................................... 6
3.1.2 IP filtering If user chooses NO...................................................................6
3.1.3 IP filtering If user chooses YES..................................................................6
3.2 Analyze.............................................................................................................. 8
3.3 PCAP.................................................................................................................. 8
3.3.1 PCAP Testing................................................................................................ 8
3.3.2

TCP RTT.................................................................................................... 9

3.3.3

DNS RTT................................................................................................. 10

3.3.4

TCP Failures........................................................................................... 10

3.3.5

Inter Packet arrival Time........................................................................11

3.3.6

Total Bytes............................................................................................. 12

3.3.7

Throughput............................................................................................ 12

3.3.8

Data Usage............................................................................................ 13

3.3.9

TCP sequence analysis...........................................................................13

3.3.10 TCP flows............................................................................................... 14

3.3.11 E2E Analysis............................................................................................ 15
3.4 ISF................................................................................................................... 16
3.4.1Print RLCs (limited to UMTS/WCDMA)........................................................17
3.4.2 Radio states (Limited to UMTS/WCDMA)...................................................17
3.4.3 Radio signaling messages (Limited to UMTS/WCDMA)..............................18
3.4.2

LTE RRC.................................................................................................. 18

3.5 Cross layer (limited to UMTS/WCDMA)............................................................19

3.5.1 RLC PDU analysis...................................................................................... 19
3.5.2 Radio state graph with IP layer Packets....................................................19
3.6 Log cat testing................................................................................................. 20
3.7 Converters....................................................................................................... 20

1 Introduction
1.1 Purpose
The purpose of T-Mobiles QoE Analyzer is to help engineers post process QXDM, PCAP,
and other log files for a more in depth analysis.
QoE Analyzer application can post process the radio layer, the network layer, as well provide
a cross layer analysis for the inputted log files and export the data into readable tables with
graphical representations of the data.

1.2 Scope
This reference manual is intended to guide users through the installation process as well
as explain and provide examples for each of the various QoE KPIs.

2 Installation
2.1 Required hardware and software
QoE analyzer is designed to be installed and run on a workstation running Microsoft
Windows XP, Vista & 7.

2.2 Installing QoE Analyzer

Installer sets up the QoE analyzer execution environment, which includes installing
application binaries, data files.
The QoE analyzer installation consists of three main files.
Application files: It consists of all the Output files, templates and other files
QoE analyzer .application
Setup.exe
Installation of QoE analyzer setup.
1. Open QoE analyzer folder
2. Click on setup and it will install in current folder location.
3. QoE analyzer will pop up after the installation is complete.
Updating from an older version.
1. Uninstall QoE from the Add/Remove Programs menu.
2. Open QoE analyzer folder
3. Click on setup and it will install in current folder location.
4. QoE analyzer will pop up after the installation is complete.

2.3 Type of input files QoE analyzer can process.

1. Qxdm (.isf files)
2. Wireshark (.pcap files)
3. Logcat files (.txt)

2.4 Saving the output files.

By default, the tool will store all the output files in the AppData folder under the users
profile. To get to this information, just click on the Output button on the QoE Analyzer
GUI.

3 Display Overview
3.1 ADD Files
Click on add files and load single file or multiple files from your local drive to perform
analysis.
QoE analyzer supports .isf, .Pcap and .txt file formats as input.

3.1.1 IP filtering Feature

When user loads Pcap file, QoE analyzer will pop up a window asking user would they
Like to Enable IP filtering

3.1.2 IP filtering If user chooses NO

QoE analyzer will analyze traffic from all the available IP addresses present in
the input file
3.1.3 IP filtering If user chooses YES

QoE analyzer displays all Ip addresses available in the input trace file.
To choose interested single IP Address click on EDIT tab

Click yes for single IP address and enter interested IP address and click OK

Click NO if you are interested in analyzing traffic from multiple IP address. Hold ctrl key to
select multiple IP addresses

3.2 Analyze
Add files and select features you are interested in and then click analyze to perform analysis.

3.3 PCAP
Choose Pcap to perform analysis related to IP Layer if the input file is in .pcap format.
Load .pcap file and select features you are interested in for QoE analyzer to analyze the traffic.
3.3.1 PCAP Testing

Enable Pcap testing to analyze any IP feature present in this tab.

3.3.2 TCP RTT

This feature enables user to understand TCP connection times and RTTs related
to TCP connection establishment.
Input: Add .pcap file and you can choose filtered IP or all the available
Ips in the trace file and check TCP RTT and click Analyze.

Output:

Will get .csv file with details related to number of TCP connection opened,
TCP connection times,TCP SYN to Syn/ACK RTT and TCP SYN/ACK to
ACK RTT.

3.3.3 DNS RTT

This feature enables user to understand DNS lookup times.

Input: Add .pcap file and you can choose filtered IP or all the available
Ips in the trace file and check DNS RTT and click Analyze.

Output:

Will get .csv file with all the DNS lookup times.

3.3.4 TCP Failures

Input: Add .pcap file and choose filtered IP or all the available Ips in the

trace file and check TCP failures and click Analyze

Output: will get .csv file with count of number of TCP retransmissions,

Number of TCP Dup Acks and TCP Resets

.
3.3.5 Inter Packet arrival Time
Input: Add .pcap file and choose filtered IP or all the available Ips in the

trace file and choose Inter Pkt Arrival time and click Analyze

Output: .csv file is generated with inter packet delta time with frame

number and delta value.

Delta Frame
Frame

Delta

0.000

0.002

0.041

0.002

0.000

0.000

0.035

0.000

0.001

10

0.000

3.3.6 Total Bytes

Input: Add .pcap file and choose filtered IP or all the available Ips in the

trace file and choose Total bytes and click Analyze.

Output: .csv file will be generated with details of amount of data sent and
received.

3.3.7 Throughput
Input: Add .pcap file and choose filtered IP or all the available Ips in the

trace file and choose Throughput and click Analyze.

Ex: I have .pcap file as input and I choose IP address 208.54.32.45 to draw
throughput graph.

Output: .csv file will be generated with the throughput graph for the IP
addresses choice made.

3.3.8 Data Usage

Input: Add .pcap file and choose filtered IP or all the available Ips in the

trace file and click on Data Usage.

Output: Popup will be displayed on the QoE analyzer with the summary
of the trace file.

3.3.9 TCP sequence analysis

Input: Add .pcap file and choose filtered IP or all the available IPs in the

trace file enter filter tcp.seq== 20059 in the filter box. To understand the
particular TCP sequence.
Example: In this case I am interested to understand the TCP sequence for
IP address 208.54.32.45. So I will choose this IP and click on Seq analysis.
(Processing of file will take time according to input file size)

Output: .csv file is generated with the TCP sequence and TCP ACK

details in data and graphical representation.

DL - TCP.Seq
TCP.Seq
10:33:36.000

10:40:48.000

10:48:00.000

10:55:12.000

UL - TCP.Ack
10:33:36.000

3.3.10

10:40:48.000

10:48:00.000

TCP.Ack
10:55:12.000

TCP flows

Input: Add .pcap file and choose all the available IPs and click on TCP

flows

Example: In this case I am interested to understand the no of TCP

streams, amount of data received and sent, retransmission ratio, duplicate

Ack ratio for all the IP addresses .(Processing of file will take time
according to input file size).
Note: for this feature you cannot filter IP. you have to choose all the Ips

Output: .csv file is generated with Original packet%, Original Byte%, UL

reset %, DL Reset%, Retransmission %, Duplicate Ack %, per Ip and per

TCP stream.( useful for performing analysis to understand TCP
retransmissions)

3.3.11 E2E Analysis

Input: Add 3 .pcap files from UE , Ran and core and choose filtered IP or

all the available Ips in the trace file and enter any interested IP address or
TCP sequence Number to map among all the Nodes and print the delta
between packets.( used for Cross node analysis)

Example: In case I am interested to understand the specific Packet arrival

at different node. I will input three files and key in the Sequence number I
am interested in filter box.

Output: .csv file is generated with the correlation between UE , PGW and

server for that particular sequence number and displays delta time at each
node.

From the above graph, we can understand that TCP sequence number
200509 was retransmitted 6 times and delayed for 30sec at UE side.
Now we can dig deeper at UE side to understand why it took 30 sec to
deliver packet.

3.4 ISF
Click on QXDM testing and choose the features you are interested in. you can choose either
one or all.

3.4.1Print RLCs (limited to UMTS/WCDMA)

Using this feature you can understand both RLC uplink and downlink PDUs with RLC
Sequence and PDU retransmissions. This feature can be very slow depending on the size of the
.isf. If you are not interested in the RLC transmissions, then it is best to leave this unchecked.

Input: QXDM .isf file

Example: I am choosing all the features to analyze.

Output: .csv file with all the RLC UL and DL PDUs retransmissions, radio state
graph and number of RRC signaling messages exchanged between UE and Node
B.

3.4.2 Radio states (Limited to UMTS/WCDMA)

Using this feature user can understand UMTS Radio states transition.
Input: QXDM .isf file

Output: .csv file with all the UMTS radio states information printed in data and
graphical format.

3.4.3 Radio signaling messages (Limited to UMTS/WCDMA)

Using this feature user can understand amount of RRC signaling exchanged between device and
RAN.
Input: QXDM .isf file
Output: .csv file with the count of number of RRC signaling messages exchanged
between UE and RAN.

3.4.2 LTE RRC

Using this feature user can understand LTE RRC events.

Input: QXDM .isf file
Output: .csv files with all the RRC event messages with timestamp and channel
information.

3.5 Cross layer (limited to UMTS/WCDMA)

3.5.1 RLC PDU analysis

Input: Add .isf file and check RLC and Retransmission analysis then hit analyze

Output: This feature will map all the IP packets with corresponding RLC UL and
DL PDUs and counts the IP retransmissions and RLC PDU retransmissions.

3.5.2 Radio state graph with IP layer Packets

Input: Load .isf and PCAP generated from .isf file and key in the IP frame
number(frame.number==400) in Tshark filter and click Analyze

Output: .csv is generated with Radio state graph with input IP packet overlaid on

it. This feature will help engineers to understand the device was in which state
while sending or receiving interested IP packet.

3.6 Log cat testing

This feature enables user to understand Video start up times, buffer events and buffer
duration, MTBR for the YouTube tests.
Input: Logcat txt files

Output: .csv file with Video start up times, buffer events, buffer duration, MTBR
and other QoE metrics for YouTube.

3.7 Converters
This feature enables user to filter wire shark or .isf files( filtering process will be lot
quicker when compared to QCAT filtering for .isf files)
Input:
1. Load Pcap file and key in the filter in the Filter tab and select the
interested columns from the below list and click on convert.
2. Load Isf file and key in the Packet ID you want to filter in the QXDM filter
box.
Output: .csv file with the filter data with choice of columns information