Você está na página 1de 84

2014

Executive Summary Rajkot

[BENCHMARKING REPORT]

Benchmarking Report
Rajkot 3G_Cluster 7

LINKQUEST TELECOM LIMITED


1

Executive Summary

Operators

Technology

Band of
Operation

IDEA 3G

UMTS

2100

DOCOMO 3G

UMTS

2100

VODAFONE 3G

UMTS

2100

emographics of Rajkot
Rajkot is the fourth largest city in the state of Gujarat, India, after Ahmedabad, Surat, and Vadodara. Rajkot is
the 35th-largest urban agglomeration in India, with a population more than 1.28 million. This district is
surrounded byMorbi districtin north,SurendranagarandBotaddistricts in east,AmreliandJunagadhdistricts in
south andPorbandarJamnagar districtin west. The district occupies an area of 11203km. The district is named
after its headquarters, Rajkot city. The name of the city of Rajkot (literally means the city of princes) was
probably derived from Raju Sandhi, the co-founder of the erstwhileprincely stateof Rajkot in 1610.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Link
Link Quest
Quest Benchmarking
Benchmarking Methodology
Methodology

Section
1

Drive Test Equipment


Benchmarking Setup
Post processing tool
Data Collection Details
Test Scenario
Voice Testing Algorithm
Data Testing Algorithm
Strategic Location Testing
Voice & Data KPI weightages
Key Performance Indicators Calculation
Methodology

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Drive Test Equipment

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Benchmarking Setup
RF Benchmarking audit is done to test the Radio interface and
draw competitive results
1. Data tests are categorized as tests for Ping test, FTP DL/UL, HTTP DL, Web Browsing and

1. Data tests are categorized as tests for Ping test, FTP DL/UL, HTTP DL, Web Browsing and
Email Send/Receive.
We have used script files for conducting drive on Nemo Invex, These script files contain the
various parameters that determine how the mobile devices behave during Ping test FTP DL/UL,
HTTP DL, Web Browsing and Email Send/Receive.
2. Following are precautions taken for the KPIs associated with a Drive Test : DT being
conducted within the specified timeframe which has been scheduled ,Adherence to
predetermined distance and route, Validity and accuracy of data being collected during the DT
drive
3. The system uses specially configured test (Calibrated) phones attached to controlling
devices in isolation chambers to perform various tests such as voice calls, data calls, video
calls etc. The equipment is flexible in configuration supporting a maximum of 20 phones on
the same testing platform.
Via BSS and
Internet
Internet
Core Network
Cloud
Cloud

RF
Interface
RF
Interface

5
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

FTP
Server

Tool

6
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Data Collection Details


CLUSTER 7
City

Rajkot

Measureme
nt
Period

8/3/2014

Tests done

9 :00 AM to 7.00 P.M

Linkquest fixed Lines used


for MOS testing.
The drive route was created
to cover the dense
population area , key
commercial area, key
residential area. The route
consisted of Highways and
Main Roads.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Test Scenario
A Benchmarking Test drive was conducted by Link Quest Telecom in

Rajkot city to measure Voice & Data KPIs for 3G.


The operators and Technology considered for benchmarking are:

Generation

Test

Technology

Operator

All

Scanner

UMTS

UMTS operators
Idea

3G

Voice

UMTS

DoCoMo
Vodafone
Idea

3G

Data

UMTS

DoCoMo
Vodafone

8
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Voice Testing Algorithm


Test Details

Specifications

No of Operators
tested

(Idea, DoCoMo, Vodafone)

Voice Test Algorithm


Call Duration

3 mins (180 Secs)

Idle time in between


calls

15 Secs

Continuous call for 3 minute duration


with 15 seconds of idle time. Speech
samples are sent and received which
provide the MOS score for voice
quality. This was repeated for the
entire duration of collection.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Data Testing Algorithm


Email Receive

GPRS

Attach
PDP Activation
PING

3 times 32 Byte
116.214.26.163 (FTP Server
ID)
FTP DL
15 MB File-GSM
FTP UL

1 MB File-GSM
PING

10 Different Websites
HTTP

10 Different Websites
Email Send

100 KB Email from SMTP


server
Wait time after the loop

15 Sec

Wait time between all test

2 Sec

100KB Email from POP3


Server
YouTube Streaming
180Sec of YouTube
Streaming
GPRS
PDP Deactivation
Detach
HTTP Websites
1 www. flipkart. com
2 www. naukri. com
3 www. espncricinfo.
com
4www. facebook.
com
5 www. google. com
6 www. irctc.co.in
7
www.moneycontrol.c
om
8 www.zedge.net
9 www.ndtv.com
10 www. youtube.
com

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Voice & Data KPI


Weightages
5 KPIs are used to arrive at the Voice Quality Score and 5 KPIs are used to arrive at the
Data Quality Score. Following are the details of weightings assigned to different KPIs.
These are used for arriving at the final ranking of the operator.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Key Performance Indicators Calculation


Methodology
For Delay Time & RTT we have calculated score based on
*RTT or Delay Time Score=100 ((Actual Time * 100) / Max Time)
For calculating the Overall score , Values of all KPIs multiplied with the weightage

given to the corresponding KPI .

The results of each KPIs will be added to arrive at the final score and operators will be

ranked as per the score.


12
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Management
Management Summary
Summary

Section 2
Voice Quality Score
Data Quality Score

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

All Over Network Weightage & Ranking UMTS


Voice
5 KPIs are used to arrive at the Network
Quality Score. Following are the details of
weightings assigned to different KPIs.
These are used for arriving at the final
ranking of
the operator.

Operator

Score

Rank

Idea 3G

72.56

DoCoMo 3G

82.62

Vodafone 3G

72.04

Idea leads at 2nd position in Voice UMTS Ranking.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

All Over Network Weightage & Ranking UMTS


Data
5 KPIs are used to arrive at the Data
Quality Score. Following are the details of
weightings assigned to different KPIs.
These are used for arriving at the final
ranking of
the operator.

Operator

Score

Rank

Idea 3G

39.58

DoCoMo 3G

39.14

Vodafone 3G

40.38

Idea leads at 2nd position in Data UMTS Ranking.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Detailed
Detailed Voice
Voice Analysis
Analysis

Section 3
Scanner Performance Analysis
RSCP Distribution (Scanner)
EcNo Distribution (Scanner)
Pilot Pollution (Scanner)

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

RSCP ( Scanner)
Idea 3G

DoCoMo 3G

CONFIDENTIAL Copyright 2013 Link Quest Telecom Limited

Vodafone 3G

Idea RSCP (Scanner)

Idea 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

DoCoMo RSCP (Scanner)

DoCoMo 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone RSCP (Scanner)

Vodafone 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

RSCP (Scanner) Comparison


Summary

Operator

Coverage Rate using


formula

Rank

Idea 3G

88.99%

DoCoMo 3G

68.67%

Vodafone 3G

90.60%

Vodafone has the best RSCP Coverage among all other operators

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Grade RSCP dbm


A
-65<= x < 0
-75 <= x <
B
-65
-85 <= x <
C
-75
-93 <= x <
D
-85
-99 <= x <
E
-93
benchmarked.
F
x < -99

EcNo ( Scanner)
Idea 3G

DoCoMo 3G

CONFIDENTIAL Copyright 2013 Link Quest Telecom Limited

Vodafone 3G

Idea EcNo(Scanner)

Idea 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

DoCoMo EcNo(Scanner)

DoCoMo 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone EcNo (Scanner)

Vodafone 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

EcNo (Scanner) Comparison


Summary

Operator

Coverage Rate using


formula

Rank

Idea 3G

83.68%

DoCoMo 3G

89.20%

Vodafone 3G

83.99%

Grade

EcN0

-9<=x

-12<=x<-9

-15<=x<-12

X<-15

DoCoMo has the best EcNo Coverage among all other operators benchmarked.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Idea - Pilot Pollution (Scanner)


Pilot
Pollution

DoCoMo has higher pilot pollution compared to other competitors.


27
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Detailed
Detailed Voice
Voice Analysis
Analysis

Section 4
Voice Performance Analysis
RSCP Distribution (Dedicated Mode)
EcNo Distribution (Dedicated Mode)
MOS Comparison (Dedicated Mode)
Call Setup Time
Call Setup Success Rate
Call Completion Success Rate
Accessibility V/s Retain ability
Comparison
Voice Quality: MOS Comparison
HOSR Analysis
Serving System Analysis (Dedicated
Mode)
RAB Setup Success Rate Analysis
BLER Analysis
Active Set Size Analysis

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

RSCP - (Dedicated Mode)


Idea 3G

DoCoMo 3G

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone 3G

Idea RSCP (Dedicated Mode)

Idea 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

DoCoMo RSCP (Dedicated Mode)

DoCoMo 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone RSCP (Dedicated Mode)

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone
3G

RSCP (Dedicated Mode) Comparison Summary

Operator

Coverage Rate using


formula

Rank

Idea 3G

78.77%

DoCoMo 3G

54.83%

Vodafone 3G

72.19%

Idea has best RSCP Coverage in benchmarked.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Grade RSCP dbm


A
-65<= x < 0
-75 <= x <
B
-65
-85 <= x <
C
-75
-93 <= x <
D
-85
-99 <= x <
E
-93
F
x < -99

EcNo (Dedicated Mode)


Idea 3G

DoCoMo 3G

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone 3G

Idea EcNo (Dedicated Mode)

Idea 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

DoCoMo EcNo (Dedicated Mode)

DoCoMo 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone EcNo (Dedicated Mode)

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone
3G

EcNo (Dedicated Mode) Comparison Summary

Operator

Coverage Rate using


formula

Rank

Idea 3G

91.34%

DoCoMo 3G

92.68%

Vodafone 3G

90.01%

Grade

EcN0

-9<=x

-12<=x<-9

-15<=x<-12

X<-15

DoCoMo has the best EcNo Coverage among all other operators benchmarked.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

PESQ MOS - (Dedicated Mode)


Idea 3G

DoCoMo 3G

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone 3G

Idea MOS (Dedicated Mode)

Idea 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

DoCoMo MOS (Dedicated Mode)

DoCoMo 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone MOS (Dedicated Mode)

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone
3G

PESQ - MOS (Dedicated Mode)

Operator

Average (DL+UL) MOS

Idea 3G

3.34

DoCoMo 3G

3.47

Vodafone 3G

3.21

DoCoMo has the best MOS value among all other operators benchmarked.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Call Setup Time (CST)

Operator

Avg. Call Setup time


(Sec )

Min (Sec)

Max(Sec)

Idea 3G

6.29

5.56

9.87

DoCoMo 3G

3.44

2.17

12.93

Vodafone 3G

3.67

2.92

7.30

DoCoMo has best call set up time compare to other operators..

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Call Setup Success


Rate

Total
Total
Over all
Establis Setup
CSSR
h
Failure

Operator

Total Call
Attempts

Idea 3G

44

44

DoCoMo 3G

43

43

Vodafone 3G

45

45

100.00
%
100.00
%
100.00
%

Call Attempts

Setup Failure

3G

2G

3G

2G

44

39

44

All operators have 100% call setup success rate in benchmarked.


45
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

CSSR
3G

2G

100.00
NA
%
100.00 100.00
%
%
100.00 100.00
%
%

Call Completion Success


Rate

Operator

Total Call
Total
Established Success

Total
Drop

Overall
CCSR

Call
Established

Drop

CCSR

3G

2G

3G

2G

3G

2G
NA

Idea 3G

44

43

97.73%

44

97.73%

DoCoMo 3G

43

43

100.00%

39

100.00
100.00%
%

Vodafone 3G

45

44

97.78%

44

97.73% 100.00%

DoCoMo has best call completion success rate compare to all other operators
benchmarked.
46
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Accessibility V/s Retainability

All Operators have 100% CSSR & DoCoMo has best CCSR compare to all other
operators benchmarked.

47
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Idea Call Drop Analysis

48
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Idea Call Drop Analysis

S. No

Long

Lat

Call Type

RSCP(dBm)/
Rx Lev

Ec/No/
Rx Quality

Serving
System

Serving Cell
ID

70.79048

22.13546

Drop

-80.70

-21.30

UMTS FDD

50187

49
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Handover Success Rate 3G

Soft Handover

IRAT Handover

Handover

Operator
Attempts

Success

Attempts

Success

Soft
Handover

IRAT

Idea 3G

463

463

100.00%

100.00%

DoCoMo 3G

545

545

100.00%

100.00%

Vodafone 3G

620

620

100.00%

100.00%

All Operators have 100% soft handover success rate & 100% IRAT success rate.
50
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Success Rate

Voice Serving System Plots (Dedicated Mode)


Idea 3G

DoCoMo 3G

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone 3G

Idea Serving System (Dedicated


Mode)

Idea 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

DoCoMo Serving System (Dedicated


Mode)

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

DoCoMo
3G

Vodafone Serving System (Dedicated


Mode)

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone
3G

Radio Bearer Setup Success rate

All operator have 100% Radio Bearer Setup Success Rate in Benchmarked.

55
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Idea - BLER

All operators have comparable BLER during whole drive.

56
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Idea Active Set Size

Idea has higher percentage of Active Set Size in Benchmarked.

57
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Detailed
Detailed Data
Data Analysis
Analysis

Section 5
Data Performance Analysis

GPRS Attach and PDP Performance


PS Connection Statistics
Ping test Performance
Video Streaming Performance
FTP DL/UL Performance
HTTP Performance Analysis
Email Performance
Data Technology
PS Drop Rate Analysis
EcNo Distribution
Modulation & CQI

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Attach Statistics

Idea has best Attach Performance among all the other operators benchmarked.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

PDP Statistics

All Operators have 100% PDP Attach Success Rate while Vodafone has best PDP Context
activation time.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

PS Connection Statistics

Idea has best PS connection Setup Success Rate while DoCoMo has best PS Connection
Setup Time.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Ping Test Results

DoCoMo has best RTT among all other operators benchmarked .


62
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Streaming Results

Vodafone has best Streaming Performance among all other operators benchmarked .

63
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

FTP Download Statistics

Operator

Total attempts

Success

Drop

Time out

FTP DL Success Rate

FTP DL Throughput
Kbps

Idea 3G

18

16

88.89%

1621.57

DoCoMo 3G

15

12

80.00%

1092.95

Vodafone 3G

13

30.77%

809.86

Idea has best FTP DL Performance among all the operators benchmarked.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

FTP Upload Statistics

Operator

Total attempts

Success

Drop

Time out

FTP UL Success
Rate

FTP UL Throughput
Kbps

Idea 3G

14

14

100.00%

858.09

DoCoMo 3G

13

13

100.00%

799.86

Vodafone 3G

12

12

100.00%

545.60

Idea has best FTP UL Performance among all the operators benchmarked.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

HTTP Performance

Idea has best HTTP success rate while Vodafone has best HTTP Browsing Time.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Idea - HTTP Success Rate Details


URL

Total
Attempts

Success

Timeout

Success
Rate

HTTP DL
Time

www.espncricinfo.com

100.00%

24.91

www.facebook.com

12

12

100.00%

30.81

www.flipkart.com

10

10

100.00%

17.17

www.google.com

13

13

100.00%

23.34

www.irctc.co.in

100.00%

6.07

www.moneycontrol.com

100.00%

8.47

www.naukri.com

88.89%

9.62

www.ndtv.com

100.00%

23.38

www.youtube.com

100.00%

7.46

www.zedge.net

100.00%

14.85

Idea has poor accessibility to www.naukri.com.


CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Idea - FTP UL/DL & HTTP Failure

68
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Email send Receive Success Rate

Email
Send
Success
Rate

Email
Send
Time

Email
Receive
Attempts

Email
Receive
Success

Email
Receive
Success
Rate

Email
Receive
Time

Operator

Email Send
Attempts

Email
Send
Success

Idea 3G

100.00%

9.36

100.00%

12.84

DoCoMo 3G

100.00%

7.36

100.00%

4.64

Vodafone
3G

100.00%

8.93

100.00%

6.64

DoCoMo has best Email Send & Email Receive Performance.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Data - Technology Plots


Idea 3G

DoCoMo 3G

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone 3G

Idea Data Technology

Idea 3G
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

DoCoMo Data Technology

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

DoCoMo
3G

Vodafone Data Technology

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Vodafone
3G

Idea Comparison Ec/No

Idea has best EcNo compared to other competitors.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

APP FTP DL/UL ThroughputHSDPA

Idea has max. percentage of greater than 1024kbps throughput in FTP DL and UL compare to
other operators.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

APP HTTP DL ThroughputHSDPA

Vodafone has max. percentage of greater than 512kbps throughput in HTTP DL compare
to other operators

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

MAC-hs FTP DL/UL ThroughputHSDPA

DoCoMo has max. percentage of greater than 1024kbps throughput in FTP DL and UL
compare to other operators.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

MAC-hs HTTP DL ThroughputHSDPA

Vodafone has max. percentage of greater than 512kbps throughput in HTTP DL


compare to other operators

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Idea CQI & Modulation Scheme


CQI

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Modulation Schemes

Modulation and CQI

DoCoMo has better Modulation while Idea has better CQI compared to other competitors.

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Management
Management Summary
Summary

Section 6
SWOT Analysis for Idea
Observations and
Recommendations

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Threats
Vodafone has best Coverage.
DoCoMo has best Call Setup Time.
DoCoMo has best Email Send/Receive
Time.
DoCoMo has best RTT.

Idea Voice & Data Score can be


improved by optimize Network
Quality.

Opportunities

Idea

Strength

Retainability.
MOS Value.
Call Setup Time.
HTTP Browsing Time.
Email Send /Receive Time.
Streaming Performance.

Weakness

Accessibility.
Handover Success Rate.
Attach Performance.
FTP Downlink Performance.
FTP Uplink Performance.
HTTP Browsing Success Rate.
Email Send /Receive Success Rate.

SWOT Analysis for Idea

Observations and Recommendations


Idea has best Accessibility.
DoCoMo has best Retainability.
DoCoMo has the best MOS value.
Vodafone has best Coverage.
Idea has best Attach Performance.
DoCoMo has best RTT value.
Idea has the best FTP Download
Performance.
Idea has the best FTP Upload
Performance.
Vodafone has best Streaming
Performance.
DoCoMo has best Email Send/ Receive
Performance.
Idea stands on 2nd Rank in Voice & 2nd
Rank in Data in Rajkot Town (Cluster-7).
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

CLUSTER
7

84
CONFIDENTIAL Copyright 2014 Link Quest Telecom Limited

Você também pode gostar