Udaipur 3G Benchmark Report February 2012
PhiMetrics Technologies Pvt. Ltd.
Section 1
PhiMetrics Benchmarking Methodology • • • • • • •
Benchmarking Equipment and setup Data Collection Details Voice Testing Algorithm Data Testing Algorithm Strategic Location Testing Benchmarking KPIs: Score Evolution Voice & Data KPI weightages
Executive Summary – Udaipur Udaipur
Details 0.6 Million 37 km² 16,457 per km²
Population Area
Population Density Udaipur Operators
Tech
Band of Operation (MHz)
No. of 3G Cells*
No. of 2G Cells*
Subscribers
Airtel
3G+2G
2100/900
142
20
12.9 Million
Reliance
3G+2G
2100/1800
32
187
5.25 Million
BSNL
3G+2G
2100/900
119
99
5.28 Million
Reliance HSD
EVDO
850
15
2.3 Million
*No of Cells is an indicative no the cells encountered during the Voice drive Subscriber figures are for Rajasthan Circle taken from the latest TRAI report.
Demographics of Udaipur Udaipur , also known as the City of Lakes, is a city, a Municipal Council and the administrative headquarters of the Udaipur district in the state of Rajasthan in western India. The city lies on the Golden Quadrilateral National Highway (NH) 8, midway between Delhi and Mumbai, located around 700 km from either city. 3 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Benchmarking Equipment and Setup • •
•
Nemo Invex is an evolutionary chassis-based benchmarking solution which combines powerful intuitive software and scalable military grade hardware design to create superior drive-test systems for wireless networks. It is built upon a modular platform for Quality of Service (QoS) wireless network drive testing, RF optimization and competitive network benchmarking. The system uses specially configured commercial phones attached to controlling devices in isolation chambers to perform various tests such as voice calls, data calls, video calls etc.
4 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Data Collection Details A benchmarking activity, was carried out in Udaipur for over 250Kms across the city. The details of the activity are: – Total route covered in KMs : approx 250 Kms – Measurement Period : 30th Jan 2012 to 2nd Feb 2012 – Measurement time during the day : 8 AM to 9 PM
Cluster 3: Area Covered: Panchwati, Pulan, Sobhagpura, Ahinsapuri
* Except congested area
– –
Measurement days during the week : Monday to Saturday The drive route was created to cover the dense population area , key commercial area, key residential area. The city was divided into 4 clusters/areas. The route consisted of Highways, Main Roads, Other roads and Streets in the composition mentioned below. • Highway - 20% • Main Road - 40% • Other Road - 20% • Streets - 20%
Cluster 1: Area Covered: Pichola, Kalaji Goraji
4 Cluster 4: Area Covered: NH - 76
Cluster 2: Area Covered: Hiran Magari, Vardhman Nagar, Jawahar Nagar, Railway Colony
This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Voice Testing Algorithm Test Details
Specifications
No of Operators tested
Dual Mode (Airtel, Reliance, BSNL)
Voice Test Algorithm Call Duration
3 mins (180 Secs)
Idle time in between calls
10 Secs
Continuous call for 3 minute duration with 10 seconds of Idle time. Speech samples (DL and UL) are sent and received which provide the MOS score for voice quality. This was repeated for the entire duration of collection
6 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Data Testing Algorithm Test Details No of Operators tested
Specifications Dual Mode (Airtel, Reliance,BSNL) EvDo Network (Reliance)
Data Test Algorithm Attach and PDP Activation Ping FTP Download FTP Upload HTTP Email send Email Receive
Before every test 3 times - 32 bytes on www.google.co.in 10 MB (for EvDo) and 15 MB (for Dual Mode) from server 1 MB (for EvDo) and 1 MB ( for Dual Mode ) to Server 10 different websites. 100 KB Email to SMTP server 100 KB Email from POP3 server
No
HTTP Websites
1 2 3 4 5 6 7 8
www.google.com www.facebook.com www.nimbuzz.com www.airtel.in www.cricinfo.com www.vuclip.com www.youtube.com www.admob.com www.zedge.net www.nokia.com
9 10
• After every application test, we have 2 sec Idle time before the next Application is tested.
7 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Strategic Location Testing Strategic Locations No of Operators tested
Specifications Dual Mode (Airtel, Reliance, BSNL) EvDo Network (Reliance)
Data Test Algorithm WAP Test FTP Download
10 different WAP sites 10 MB (for EvDo) and 15MB (for Dual Mode) from Server
Email send
100 KB Email to SMTP server
Email Receive
100 KB Email from POP3 server
SMS
SMS send to same number (160 char)
MMS
MMS send to same number 15 Kb
WAP sites wap.google.co.in m.facebook.com m.orkut.com wapin.com m.cricinfo.com m.vuclip.com m.youtube.com m.admob.com m.zedge.net m.sonyericsson.com
Apart from the above tests during the drive, at 5 strategic locations across the city, additional stationary tests were carried out. These locations are important locations of the city. 1. Airport
4. Suraj Pol
2. Bus Stand
5. Trident Hotel
3. Chetak Circle
8 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Benchmarking KPIs: Score Evolution
Each KPI is then measured on a scale of 0 to 200 on the basis of performance. Value of the Particular KPI is not reported default score is 100. The Score is then weighted with the respective weightages to arrive at an overall Voice or a Data Score. 9
This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Voice & Data Quality Score 5 KPI’s are used to arrive at the Voice Quality Score and 15 KPI’s are used to arrive at the Data Quality Score Following are the details of weightings assigned to different KPIs. These are used for arriving at the final ranking of the operator.
*Coverage Calculation: Coverage = A%*10+B%*8+C%*6+D%*1 10
GRADE A B C D
RSCP IN dBm 0 to -74 -74 to -82 -82 to -90 -90 to -98
10
Section 2
Management Summary • • • • •
Overall Voice Quality Score Overall Data Quality Score SWOT Analysis for Airtel Voice Quality Score Data Quality Score
Voice Quality Score VQI
CSSR
CST 192
2.1
1
2.54
1
CCR 100% 99.64% 99.05%
4.06
100%
1
1
99.35%
3 2
3G Coverage
MOS 100% 3
98.78% 96.16% 2
1
95.85%
115
3.77
3
97.00%
3.71 3.66
2
1
3.86 88 3
85.00% 3
62 3
4.68
2
1
Airtel 3G
2
Reliance 3G
3
BSNL 3G
2
0
9.82
77.26%
VQI Scoring
VCQI
CST
CSSR
CCSR
MOS
Coverage
Airtel 3G Reliance 3G BSNL 3G
142.05 23.81 72.33
162.00 121.20 115.50
90.1 7 32.2
148.7 34.3 0
167.1 0 155.7
130.9 0 76.3
CST= Call Setup Time
65.00%
2
CSSR= Call Setup Success Rate
68.00%
0:00%
3.06
Call setup time, Accessibility, Retainability,MOS, Coverage
CCR= Call Completion Rate MOS= Mean Opinion Score
12
Data Quality Score DCQI
HTTP
FTP UL
FTP DL
163
200
Email 200
200
200
170
PING
PDP Context
Data Attach
200
200
2
1
1
4
147 159 107
140 123
4
108
133
118 81
1
100
1
4
87
100
1 80
2
2
100
4
100
100
3
1
2 4
58
4 61
4 2
56
60
1
53
62
62
41
3
3 1
3
13
2 3 4
3
0
0
3
DQI Scoring
DCQI
HTTP
FTP DL
FTP UL
Airtel 3G Reliance 3G BSNL 3G Reliance EvDo
78.28 48.54 7.25 62.29
8.2 0 0 0
92.64 79.62 0 65.28
178.88 74.82 0 103.6
89.97 83.61 22.35 58.47
9
Data Attach 65.12 0 77.08 100
2
0
PDP Context 163.32 181.08 23.24 100
Ping RTT
54.1 0 0 145.8
0
0
2
3
1
Airtel 3G
2
Reliance 3G
3 4
BSNL 3G Reliance EvDo
13
0
Section 3
Detailed Voice Analysis • • • •
Voice Performance Analysis Coverage Distribution Call Setup Time Call Setup Success Rate –
•
Call Completion Success Rate –
• •
Call Completion Failure Analysis
Accessibility V/s Retainability: Market Comparison Voice Quality: MOS – – –
•
Call Setup Failure Analysis
Airtel MOS Performance Airtel EcIo, BLER Pilot Pollution Analysis
Handover Analysis
Voice Performance Analysis Call Setup Time: Airtel has the least call setup time of 2.77 sec. Call Setup Success Rate: Airtel has 98.77% Accessibility with just 2 block calls in the entire drive test.
Call Completion Success Rate: Airtel has 1 drop call and has 99.38% Retainability in the city. Voice Quality: Airtel has best speech quality as compared to other operators.
Parameter Call Setup Time Accessibility Retainability MOS Coverage Best Operator
Best Value 2.77 sec 98.77% 99.38% 3.95 89.64%
Operator Airtel Airtel Airtel Airtel Airtel
Airtel 3G
Operator
Coverage
Accessibility
Retainability
Call Setup Time
Voice Quality
Airtel 3G
1
1
1
1
1
Reliance 3G
3
3
2
2
3
BSNL 3G
2
2
3
3
2
Ranking for Voice KPIs
15 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Coverage Distribution Coverage was measured with the help of a digital scanner/phone for all the networks.
Operator
% of Samples > -82
Coverage Rate using formula
Rank
Airtel 3G
88.32%
89.64%
1
Reliance 3G
49.70%
60.95%
3
BSNL 3G
73.50%
80.27%
2
•
Airtel has good 3G coverage footprint in the city as compared other operators.
•
Reliance coverage was found to be noncontiguous which might be due to temporary failure.
16 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Coverage Plot
•
There were some poor coverage patches(highlighted areas) in the city. Cluster 3 has lower coverage which includes industrial areas and Udaipur bypass.
17 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Radio Technology Distribution
•
Airtel has almost all its voice traffic on 3G, which has resulted in better voice quality compared to other operators.
18 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Call Setup Time (CST) •
Airtel has the best call setup time compared to other 3G operators.
19 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Call Setup Success Rate Call Setup Success Rate is a measure of subscriber experience associated with the access to network resource. It consists of congestion of network or unavailability of network resources. Operator
Call Attempts
Blocked Calls
CSSR
Block Rate
Airtel 3G
162
2
98.77%
1.23%
Reliance 3G
165
6
96.36%
3.64%
BSNL 3G
172
5
97.09%
2.91%
•
Airtel has 98.77% Accessibility with 2 fail calls.
Call Setup Success Rate
Airtel 3G
Reliance 3G
BSNL 3G
Total Calls Attempts
162
165
172
1
1
1
Technology
Blocked Call Reasons (Radio Cause)
2G
SDCCH Drop
2G
High RxQual
1
2G
Bad Downlink Coverage
2
2G
TCH Assignment failure
1
3G
RRC Connection failed
3G
Bad Downlink Coverage
3G
Missing Neighbour
3G
High BLER
1
3G
Poor EcIo
1
2 1 1
Total
2
6
5
CSSR
98.77%
96.36%
97.09%
20
This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves he right to use this format for its other customers if required.
Call Completion Success Rate Call Completion Success Rate is a measure of subscriber experience associated with the continued use of network resources that have been granted. It consists of radio link drops or abnormal network-initiated releases. Operator
Total Call Established
Dropped Calls
CCSR
Drop Rate
Airtel 3G
162
1
99.38%
0.63%
Reliance 3G
165
5
96.86%
3.14%
BSNL 3G
172
22
86.83%
13.17%
•
Airtel has 99.38% call completion rate with 1 drop call.
Call Completion Success Rate
Airtel 3G
Reliance 3G
BSNL 3G
Total Calls Established
162
165
172
Technology
Dropped Call Reasons
2G
DL Interference
2
2G
Bad Downlink Coverage
3
3G
Missing Neighbour
3G
Missing Handover
3G
Low EcIo
1
3G
RRC Release received
20
1 1
Total
1
5
22
CCSR
99.38%
96.86%
86.83%
21 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Call Setup Failure & Drop Plot
Fail Call
Drop Call
22 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Accessibility V/s Retainability: Market Comparison
23 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Voice Quality: UL & DL MOS •
Airtel has better DL and UL speech quality amongst all operators.
24 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Plot DL MOS
DL MOS
25 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Plot EcNo/ BLER
Ec/No
BLER
26 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Pilot Pollution Airtel
•
A scan was performed to detect all PSCs that were within 10dB Max CPICH EcNo
•
It was found that there were a lot of instances where up to 7 PSCs were found in certain locations. These could cause substantial Interference. Due to Fast Fading, the instantaneous EcIo could go below the threshold and cause a call to be dropped
•
Some of the areas in cluster 1 and 2 have more number of polluting cells.
27
This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Handover Performance Inter cell Handovers HO Attempts HO Success HO failure Success Rate Avg HO Duration (s)
2G handovers Airtel 3G Reliance 3G 25 362 358 24 1 4 96.00% 98.90% 0.116 0.126
BSNL 3G 118 109 9 92.37% 0.161
Intracell Handovers HO Attempts HO Success HO failure Success Rate Avg HO Duration (s)
Airtel 3G 9 9 0 100.00% 0.042
Reliance 3G 1 1 0 100.00% 0.088
BSNL 3G 19 19 0 0.00% 0.071
Soft Handovers HO Attempts HO Success HO failure Success Rate
3G-3G Handovers Airtel 3G Reliance 3G 5246 270 270 5246 0 0 100.0% 100.0%
BSNL 3G 2651 2651 0 100.0%
UTRAN Handovers HO Attempts HO Success HO failure Success Rate
IRAT Handovers Airtel 3G Reliance 3G 4 5 4 5 0 0 100.0% 100.0%
BSNL 3G 71 70 1 98.6%
This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Section 3
Detailed Data Benchmarking • •
Data Performance Analysis FTP Performance –
•
HTTP Browsing Analysis –
• • • • • • • •
FTP Application Throughput Analysis HTTP Performance (Airtel)
FTP DL/UL and HTTP Failures Email Performance GPRS Attach and PDP performance Data Access Technology Distribution Ping Response: Latency Performance SMS Analysis MMS Analysis KPI Overview Table
Data Performance Analysis Test Operator Airtel 3G Reliance 3G BSNL 3G Reliance EvDo
Test
FTP Upload (15%) FTP UL Success (40%)
1 3 4 2
FTP Download (25%)
HTTP (30%)
Email Send (5%)
FTP UL HTTP FTP DL Success FTP DL Throughput HTTP Success Throughput Download (40%) (60%) (40%) (60%) time (60%)
1 2 4 3
2 4 3 1
GPRS Attach (5%)
1 2 4 3
1 3 4 2
PDP context activation (5%)
Operator
GPRS attach success rate (60%)
GPRS attach Delay (40%)
PDP context success (60%)
PDP context Delay (40%)
Airtel 3G
2
1
1
2
Reliance 3G
3
3
1
1
BSNL 3G
1
2
3
3
4 1 3 2
Email Send Success (30%)
1 1 4 3
Email Retrieve (5%)
Email Send Email Retrieve time (20%) Success (30%)
2 3 4 1
1 3 4 2
Ping (10%)
Email Retrieve time (20%)
Ping RTT
1 3 4 2
2 4 3 1
•
Airtel have good FTP performance with best downlink and uplink throughput.
•
HTTP browsing performance in terms of browsing success rate.
•
Least GPRS attach delay.
•
Airtel has best Email send success rate.
•
Higher browsing delay.
Ranking for Data KPIs
30 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
FTP Statistics • File transfer is becoming increasingly and legitimately popular as a method of transferring media files (movies and music). • The FTP test is used to test the FTP service availability and to measure the application throughput for file download or file upload. The test is successful when the desired operation (uploading or downloading) has succeeded. • Airtel has best downlink and uplink throughput as compared to other operators. * BSNL has low FTP throughputs due to lack of access to data plans beyond a certain limit.
31 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
HTTP Browsing Analysis
• The web browsing quality of experience is generally associated with the time it takes to locate and download a web page within a web browser application. • The HTTP Download test was conducted with 10 different websites. The Downloaded Page size was approx 350Kb. • Airtel has higher HTTP browsing time for all web sites.
32 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
HTTP Performance
33 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Airtel FTP DL/UL and HTTP Failures
FTP DL Failure HTTP Browsing Failure FTP UL Failure
34 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Email Send / Retrieve •
A 100KB email was sent and downloaded via the POP and SMTP protocols. This is a close simulation of Users accessing pull mail from their work IDs using their hand phone.
•
Airtel has good overall email performance with least email retrieve delay.
35 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Ping Response: Latency Performance
•
A Latency Test was Conducted with www.google.co.in with 32bytes of data to figure out the round trip time. A Ping Response signifies the average delay it takes to access a particular service.
•
Airtel has high ping latency, as it takes higher number of hops to reach destination server.
36 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Data Access Technology Distribution
• Airtel has spent maximum amount of time on 3G compared to other operators.
37 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Attach and PDP Context Statistics
• Airtel has good GPRS attach and PDP context activation success rate.
• Airtel has higher PDP context delay compared to Reliance.
38 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
CQI & Modulation Scheme
Operator
CQI > 25
HS-DSCH Codes > 8
Airtel 3G
51.89%
43.29%
Reliance 3G
45.59%
21.95%
BSNL 3G
42.33%
39.19%
• Airtel has better channel quality and has been assigned higher number of codes.
39 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
SMS & MMS Analysis
40 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
KPI Overview Table The attached KPI table gives an overview about the most important performance figures collected during this Dual mode Benchmarking campaign.
41 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Section 4
Clusterwise Analysis • • • • •
Clusterwise Summary – Voice Clusterwise Snapshot – Voice Clusterwise Summary – Data Clusterwise Snapshot – Data Cluster Analysis – – – –
Cluster 1 Cluster 2 Cluster 3 Cluster 4
Clusterwise Summary – Voice
Cluster 3
Voice Index Cluster 4
Cluster 1 Cluster 2 Cluster 3 Cluster 4
Airtel
1
1
1
1
Reliance
3
2
3
3
BSNL
2
3
2
2
Cluster 1
Cluster 2
43 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel3G for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Clusterwise Snapshot – Voice
44 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel3G for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Clusterwise Summary – Data
Cluster 3
Cluster 4 Cluster 1
Data Index
Cluster 1
Cluster 2
Cluster 3
Cluster 4
Airtel 3G
1
1
1
1
Reliance 3G
4
3
3
3
BSNL 3G
3
4
4
4
Reliance EvDo
2
2
2
2
Cluster 2
45 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel3G for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Clusterwise Snapshot: Data
46 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel3G for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Cluster 1 (Pichola, Kalaji Goraji) CST
Good
CSSR
MOS
Excellent Coverage
Average
Focus Area: HTTP Browsing Success Rate
Poor
CCR
Best Operator Voice: Airtel 3G Data: Airtel 3G
• Airtel has low HTTP success rate.
1
47 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Cluster 2 (Hiran Magari, Vardhman Nagar, Jawahar Nagar, Railway Colony) CST
Good
Focus Area: Block call and Drop Call MOS
Excellent
Coverage
Best Operator Voice: Airtel 3G Data: Airtel 3G
• Airtel has 2 failed calls and 1 drop call in the entire drive and all of them were in this cluster.
2
CCR
Average
Poor
CSSR
48 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Cluster 3 (Panchwati, Pulan, Sobhagpura, Ahinsapuri) CSSR
Good
MOS
Focus Area: Ping RTT and Downlink throughput
ExcellentCCR
Best Operator Voice: Airtel 3G Data: Airtel 3G
• Airtel has poor downlink throughput in this cluster compared to other clusters
CST
• High ping RTT
Coverage
Average
3
Poor
49 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Cluster 4 (NH-76) CST
Good
Focus Area: FTP DL Statistics CSSR MOS ExcellentCCR
Coverage
Average
Poor
Best Operator Voice: Airtel 3G Data: Airtel 3G
• Airtel has poor FTP DL success rate
4
50 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Section 5
Strategic Locations Analysis • • •
Strategic Location: Overview Strategic Location: Voice Analysis Strategic Location: Data Analysis – – – – – –
Overall Location 1: Airport Location 2: Bus Stand Location 3: Chetak Circle Location 4: Suraj Pol Location 5: Trident Hotel
Strategic Location: Overview
Locations
Latitude
Longitude
Airport
24.62473
73.88862
Bus Stand
24.57684
73.70061
Chetak Circle
24.59066
73.69103
Suraj Pol
24.57998
73.69714
Trident Hotel
24.58082
73.67027
5 Strategic Locations were tested for Voice (Accessibility testing) and Data Tests
52
This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Strategic Location: Voice Analysis Operators
Calls Attempted
Calls Failed
Calls Dropped
Call Setup Time
Airtel 3G
75
0
0
2.65
Reliance 3G
74
0
0
2.99
BSNL 3G
75
0
0
3.18
Failed
•
• •
Locations
Airtel 3G
Reliance 3G
BSNL 3G
Airport
0
0
0
Bus Stand
0
0
0
Chetak Circle
0
0
0
Suraj Pol
0
0
0
Trident Hotel
0
0
0
Voice Testing was done at each location with many short calls of 30s duration were made from a stationary position. Voice Accessibility was measured. MOS could not be measured as the duration of the call was too short for voice clips to be relayed
53 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Strategic Location : Data Analysis Test FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay
Airtel 3G
Reliance 3G
BSNL 3G
Reliance EvDo
10 10 100.00% 1637.83 15 100.00% 12.4 15 100.00% 9.6 50 100.00% 2.4 6.4 15 80.00% 8.54 37.4
12 0 75.00% 1735.15 15 100.00% 24.5 15 100.00% 11.7 50 90.00% 3.7 6.1 9 20.00% 9.13 20.0
9 0 0% 67.79 15 86.67% 45.3 15 93.33% 27.9 50 94.00% 2.1 3.9 6 0.00% 0.00 0.0
10 0 70.00% 367.88 11 73.33% 9.9 11 73.33% 15.4 -
50
30
40
10
44 88.00% 49.1
18 60.00% 11.9
32 80.00% 39.7
6 60.00% 30.8
-
54 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Location 1: Airport Test
FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay
Airtel 3G
Reliance 3G
BSNL 3G
Reliance EvDo
2 2 100.00%
2 2 100.00%
1 0 0.00%
2 0 0.00%
987.97
93.0
32.35
26.27
3 100.00% 13.6 3 100.00% 22.6 10 100.00% 2.4 4.8 3 100.00% 7.99 24.8
3 100.00% 90.4 3 100.00% 34.1 10 70.00% 5.3 10.3 0 0.00% 0.00 0.0
3 100.00% 90.3 3 100.00% 61.9 10 100.00% 2.3 4.5 0 0.00% 0.00 0.0
3 100.00% 17.1 3 100.00% 52.6 -
10
10
10
10
8 80.00% 92.6
4 40.00% 36.4
6 60.00% 65.2
6 60.00% 61.5
55 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Location 2: Bus Stand Test
FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt
WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay
Airtel 3G
Reliance 3G
BSNL 3G
Reliance EvDo
2 2 100.00% 2970.318 3 100.00% 15.3 3 100.00% 6.6 10 100.00% 2.3 4.6 3 66.67% 7.41 47.1
3 3 100.00% 2020.502 3 100.00% 7.3 3 100.00% 5.4 10 80.00% 3.5 0.0 3 0.00% 0.00 0.0
2 0 0.00% 124.94 3 100.00% 32.1 3 100.00% 11.4 10 100.00% 2.5 4.6 3 0.00% 0.00 0.0
2 1 100.00% 530.78 3 100.00% 8.9 3 100.00% 5.9 -
10
0
10
-
8 80.00% 37.3
0 0% 0.0
10 100.00% 43.1
-
56 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Location 3 : Chetak Circle Test
FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt
WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay
Airtel 3G
Reliance 3G
BSNL 3G
Reliance EvDo
2 1 50.00% 2535.94 3 100.00% 8.4 3 100.00% 4.9 10 100.00% 2.7 17.8 3 100.00% 12.79 20.0
3 3 100.00% 2415.13 3 100.00% 8.7 3 100.00% 7.5 10 100.00% 3.1 5.4 3 100.00% 9.13 20.0
3 0 0.00% 106.75 3 100.00% 9.3 3 100.00% 5.2 10 70.00% 3.0 5.3 0 0.00% 0.00 0.0
2 2 100.00% 331.56 0 0.00% 0.0 0 0.00% 0.0 -
10
10
0
0
10 100.00% 4.4
4 50.00% 3.7
0 0.00% 0.0
0 0.00% 0.0
57 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Location 4 : Suraj Pol Test FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay
Airtel 3G
Reliance 3G
BSNL 3G
Reliance EvDo
2 2 100.00% 1228.58 3 100.00% 9.2 3 100.00% 7.2 10 100.00% 2.4 0.0 3 66.67% 7.10 47.8
1 1 100.00% 2123.471 3 100.00% 8.8 3 100.00% 6.1 10 100.00% 3.3 0.0 0 0.00% 0.00 0.0
1 0 0.00% 0.00 3 33.33% 62.7 3 66.67% 49.6 10 100.00% 2.6 4.8 0 0.00% 0.00 0.0
2 2 100.00% 272.81 2 100.00% 14.6 2 100.00% 12.8 -
10
10
10
-
10 100.00% 74.1
10 100.00% 19.2
6 60.00% 47.0
-
58 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Location 5 : Trident Hotel Test
FTP DL Access FTP DL Success FTP DL Accessibility FTP DL Mean Data rate(Kbps) Email Send Access Email Send Success % Email Send Delay Email Receive Access Email Receive Success % Email Receive Delay SMS send Access SMS send Success % SMS send Delay (sec) e2e Delivery Time (sec) MMS send Access MMS send Success % MMS send Delay e2e MMS Delivery Time(sec) WAP Browsing Attempt WAP Browsing Success WAP Browsing Success Rate WAP Browsing Delay
Airtel 3G
Reliance 3G
BSNL 3G
Reliance EvDo
2 2 100.00% 1361.36 3 100.00% 15.3 3 100.00% 6.6 10 100.00% 2.3 4.6 3 66.67% 7.41 47.1
3 0 0.00% 0.00 3 100.00% 7.3 3 100.00% 5.4 10 100.00% 3.5 0.0 3 0.00% 0.00 0.0
2 2 0.00% 23.308 3 100.00% 32.1 3 100.00% 11.4 10 100.00% 2.5 4.6 3 0.00% 0.00 0.0
2 2 100.00% 574.62 3 100.00% 8.9 3 100.00% 5.9 -
10
0
10
-
8 80.00% 37.3
0 0.00% 0.0
10 100.00% 43.1
-
59 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Section 6
Summary • •
SWOT Analysis for Airtel Key findings
SWOT Analysis for Airtel Strengths
Weaknesses
• • • •
• High HTTP browsing time • Higher ping RTT • Poor data performance in cluster 3 in terms of downlink throughputs and RTT • Cluster 3 has poor 3G coverage compared to other clusters
Airtel has least call setup time. Airtel has best Accessibility and Voice call Retainability. Airtel has best DL speech quality. Airtel has 100% FTP UL success rate and best FTP Downlink and Uplink throughput.
Opportunities • 3G coverage can further be improved by improving it in cluster 3 • Ping latency can be improved by optimizing routing nodes and delay for each hops
Threats
• Web Browsing experience is lower compared to other 3G Cities
61 This report is generated in Phimetrics Proprietary format. This report format cannot be duplicated or copied by Airtel for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Observations and Recommendations •
Airtel has the best 3G experience for both voice and data, which can be capitalized given the importance of this tourist place.
•
Cluster 1 and 2 still have few areas which can be further improved for indoor coverage.
•
The Browsing experience can be further improved to widen the gap with its competitors by improving latency.
62 This report is generated in Phimetrics Proprietory format. This report format cannot be duplicated or copied by Airtel3G for other reports. Phimetrics reserves the right to use this format for its other customers if required.
Thank You Prepared by: Sanket Jain Verified by:
Hardik Patel
Attested by:
Mohit Lohani
63