202011 umlaut italy auditreport v3...channel2: side1 (volte) to side2 (volte) 115 sec call window 70...

Audit Report.Mobile Benchmark Italy, 2020

Meäsurement setup.Meäsurement overview.

Drivetest Voice Data

Device Samsung Galaxy S10Samsung Galaxy S10 4G pref (System 1) Samsung Galaxy S20+ 5G pref (System 2 + walktest)

Test Cases Mobile-to-Mobile (M2M)Channel1: Side1 (VoLTE) to Side2 (VoLTE) Channel2: Side1 (VoLTE) to Side2 (VoLTE) 115 sec call window70 sec call duration15 sec call setup timeoutMulti-RAB traffic injection on both sides

Data 4G/5G preferred CAHTTP DL datastream 7sHTTP UL datastream 7sHTTP 5MB DL fixed file transferHTTP 2.5MB UL fixed file transferWeb Browsing - Kepler ETSI Ref. Page10 Live web pages 3 YouTube HD video ~ 45s

Mobility andRoute Types

Drivetest and city Walktest56% in Cities, 13% in Towns and 31% on RoadsCities, towns and roads

Samples ~ 8100 per Operator ~44000 per Operator

Dates 18 drivetest and 6 walktest measurement days14.10.2020 – 05.11.2020

umlaut tested and measured the performance of Data

services using the latest 5G capable smartphones,

benchmarking the typical user experience in

metropolitan and rural areas of Italy.

The audit was done as a performance benchmark

performed by umlaut between 14.10.2020 – 05.11.2020 in

cities and towns as well as on connection roads.

Dedicated measurements have been executed as drive

tests outdoors using a Samsung Galaxy S10 and

Samsung Galaxy S20+ Smartphone.

All data measurements have been performed in 5G and

4G preferred mode. Voice measurements have been done

in 4G preferred mode on both sides, while call origin has

been alternated.

The following pages provide a comparative overview about

the performance results observed for the different tested

service types.

2

umlaut report

3

17 % of population measured

11200 kmmeasuring distance

Padova

VeronaMilano

Torino

Genova

Alessandria

Bologna

Pescara

Roma

Napoli

Battipaglia

Bari

Foggia

Palermo

Catania

Reggio di Calabria

Methödology.

The leader in mobile benchmarking, umlaut, has analyzed

the mobile networks of Italy with regards to mobile net-

work performance. We measure smartphone voice and

data performance based on extensive drivetests – from

major metropolitan areas to smaller cities and connection

roads.

We objectively define the routes and test methodology

and publish the results through certificates or public

benchmark reports.

As the de-facto industry standard, our benchmarking me-

thodology focuses on customer-perceived network quality

and covers a wide range of mobile services.

Today, more than 200 mobile networks in more than

120 countries are being evaluated by our unique scoring

methodology. It allows a technical analysis that is unpre-

cedented in its level of detail and enables comparisons

between the network performance and capability of each

mobile network. Our public benchmarks as well as the

certificate benchmarks help network operators to demon-

strate how well they are delivering wireless connections to

consumers, business users and enterprises and reveals the

areas of improvement.

Testing ärea.Drive route.

DrivetestWalktestRoads

4

umlaut report

5

Vodafone and TIM are the only operators capapble for VoLTE - VoLTE measurements.

Achieved values of all networks under test in each of the relevant Voice Key Performance Indicators (KPIs) for the

categories "Cities", “Towns” and "Roads".

Voice.

6

umlaut report umlaut report

Cities Drivetest

Qualifier [%] 99,2 99,1 98,6 98,8

Call Setup Time [s] 3,1 4,6 4,0 6,5

Call Setup Time (P90) [s] 3,6 5,6 7,0 8,3

Speech Quality (AVG) [MOS-LQO] 4,4 3,8 4,2 3,7

Speech Quality (P10) [MOS-LQO] 3,8 3,4 3,4 3,2

Multirab connectivity [%] 99,8 99,2 99,1 95,5

Cities Walktest

Qualifier [%] 100,0 99,8 99,7 99,5






Towns

Qualifier [%] 98,6 98,9 99,2 99,0






Roads

Qualifier [%] 95,4 96,2 92,4 95,9






Voice Service Group Unit Vodafone WindTre TIM Iliad

Data.Avg and Max Throughputs nationwide and 5 cities cluster.

The graph shows the average Throughput (darker shade) and the maximum Throughput (lighter shade) for the

category data stream download. The graph on the left is showing the nationwide throughput, the graph on the right is

showing the throughput rates for Bologna, Milano, Napoli, Roma and Torino.

99,8% 99,4%

Vodafone

100,0% 99,6%

TIM

100%

Operator

5G Devices - 4GReliability

eKPI7s DL Datarate

Cities Walktest

Cities Drivetest

70,1 51,8

Vodafone

57,6 64,5

460,5

200,2

294,9

210,8

109,2 86,9

875,6

805,7

Vodafone TIMOperator

5G Devices Avg and Max Throughputs [Mbps]

eKPI7s DL Datarate

Cities Walktest

Cities Drivetest

DL Dataratenationwide

8

umlaut report

9

46,6

329,7

74,6

355,2

Iliad WindTre

177,1134,2

875,6

805,7



DL Datarate5 cities

36,7

252,3

68,9

294,3

Iliad WindTre

Milano

Bologna

Roma

Napoli

Torino

Data. Avg and Max Throughputs for Bologna and Milano.

The graph shows the average Throughput (darker shade) and the maximum Throughput (lighter shade) for

the category data stream download in Bologna. The graph on the left is showing the Throughput for

Bologna, the graph on the right is showing the throughput rates for Milano.

Avg and Max Throughputs for Napoli.

99,8% 99,4%

Vodafone

100,0% 99,6%

TIM

100%

Operator


eKPI7s DL Datarate

Cities Walktest

Cities Drivetest

70,1 51,8

Vodafone

57,6 64,5

460,5

200,2

294,9

210,8

121,985,5

412,3

218,4



eKPI7s DL Datarate

Cities Walktest

Cities Drivetest

DL DatarateBologna

10

umlaut report

11

31,1

73,282,1

264,7

Iliad WindTre

195,0 181,0

684,3

766,5



DL DatarateMilano

38,3

252,3

74,9

279,8

Iliad WindTre


the category data stream download in Napoli.

277,5

138,3

875,6

723,7



DL DatarateNapoli

28,0

158,0

58,2

256,6

Iliad WindTre

Data.Avg and Max Throughputs for Roma and Torino.


the category data stream download in Roma. The graph on the left is showing the Throughput for Roma, the

graph on the right is showing the throughput rates for Torino.

99,8% 99,4%

Vodafone

100,0% 99,6%

TIM

100%

Operator


eKPI7s DL Datarate

Cities Walktest

Cities Drivetest

70,1 51,8

Vodafone

57,6 64,5

460,5

200,2

294,9

210,8

124,7 101,6

706,8652,1


5G Devices - 5G Avg and Max Throughputs [Mbps]

eKPI7s DL Datarate

Cities Walktest

Cities Drivetest

DL DatarateRoma

12

umlaut report

13

41,0

204,7

73,8

294,3

Iliad WindTre

162,8 148,1

574,1

805,7



DL DatarateTorino

37,7

76,1

60,3

181,9

Iliad WindTre

Avg and Max Throughputs Vodafone 4G vs 5G.

64,2

317,6289,3

875,6

4G 5GTechnology

4G versus 5G Avg and Max Throughputs [Mbps]

DL DatarateVodafone


the category data stream download 4G only versus data stream download 5G only for Vodafone in the 5

cities cluster Bologna, Milano, Napoli, Roma and Torino.

Key takeäways.

Vodafone customers with 5G capable device have higher average download data speed in Milano, Roma, Torino, Napoli, Bologna than the competition.

The nationwide measurements show Vodafone leading in relevant KPIs for voice, leveraging on the mature Volte technology.

In Milano, Roma, Torino, Napoli, Bologna, 5G technology shows a material step change on average and peak downlink speed compared to 4G technology.

14

umlaut report

15

umlaut report

umlaut SE

Am Kraftversorgungsturm 3 · 52070 Aachen · Germany

Hakan Ekmen · Chief Executive Officer Telecommunication

cell +49 151 571 33 235 · [email protected]

www.umlaut.com

202011 umlaut italy auditreport v3...channel2: side1 (volte) to side2 (volte) 115 sec call window 70...

Documents