1_umts terminal testing

8/3/2019 1_UMTS Terminal Testing

1/23

Agere Systems - Optimay GmbH May, 2003- 1 -

UMTS terminal testing: Apractical perspective

Olaf Bergengruen

May, 2003


2/23


We will not survive without a

proper regression test system,an Optimay engineer


3/23


Overview

Virtual testing

Logical view (what we want to test)

Why virtual testing

Requirements to the test system

3GPP approach

Test model

Test cases

Optimays implementation

GSM/GPRS virtual test system

GSM/GPRS/UMTS virtual test system


4/23


Test environment / logical view(conformance testing, FTA)

GSM/GPRS testsGSM 11.10

UMTS tests

3GPP 34.123

SAT tests

GSM 11.10-4

UTRAN

simulation

GERAN

simulation

SIM

simulationMS

Um

Uu

Cu


5/23


Test environment / logical view (2)

UTRANsimulation

GERANsimulation

SIMsimulationMS

Um

Uu

Cu

USB802.11

Bluteoothsimulation

MMI

simulation

WAP

TCP/IP

test cases

WAP

tcp/ip


6/23


Why virtual test environment

We need a SW only environment (no specific HW)

HW is expensive or does not exist

HW debugging is difficult and time consuming

SW developers dont want to be bothered withHW issues or dont have the specific skills

We need to be much faster than real time

Developers want to use standard tools (compilers,editors, debuggers)


7/23


Requirements to the virtual test system

Test system shall be much faster than realtime

Support the design of test scenarios at a highlevel of abstraction

All test suites need to run over night:GSM/GPRS tests (GSM 11.10), UMTS test(3GPP 34.123), STK tests (GSM 11.10-4),MMI test cases and possibly other suites(TCP/IP, WAP, ...)

Test system shall be available to anybody, atanytime, on any PC


8/23


GSM/GPRS test architecture


9/23


GSM/GPRS test architecture

SSGMM, MM, CC, etc

Optimay test scripts(GSM/GPRS test cases)

RLC/MAC L2

MMIcontrol

Logical L1

MAC/RLC

MSPhone Apps

Logical L1

L2

DSP emulation

GRR RR

L1 simulation(Radio Block transfer)


10/23


Great approach: L1 simulatedinterface

Basic communication with the Tester via threefunctions: RxRadioBlock, TxRadioBlock,TimerTick

These functions can be extended as needed tosimulate DSP code or other HW relatedfunctionality

MS is the master of system ticks, about 100

times faster than real time

Tester and MS are tightly coupled whichallows debugging using standard tools


11/23


Debugging GMM code ...static voidGMMDoRoutingAreaUpdate( GM_IE_UPDATE_TYPE RauType, BOOLEAN FirstAttempt )

{

MMRAUpdPending = FALSE;

GMRauType = RauType;

GMStopT3302( );

GMStopT3311( );

if ( ! FirstAttempt )

{

GMT3330Expiries = 0;

if ( GMActState == GMActDetachInit )

{

GMStopT3321( );

GMDetachPending = TRUE;

}

}

if ( GMTriggerAction == GM_GS_ATTACH_COMP )

{

/* Reinitialise the trigger action variable. */

GMTriggerAction = GM_NO_TRIGGER_ACTION;

/* Confirm the end of the ATTACH procedure to GS */

SEND( GSGMEstCnf ) ( );

}


12/23


Highlights of our GSM/GPRSvirtual test system

Extremely efficient performance (around 1300tests in 20 minutes)

Includes testing of DSP code

About 30 man-years development effort(including test case development)


13/23


Drawbacks of our GSM/GPRSsimulation

Tester uses proprietary (in house) test scriptlanguages and encoders which are difficult tomaintain

It is difficult to write test cases

Tester is not nicely layered as shown in theprevious slide, so it is difficult to extend andmaintain

Summarizing: the system can not beextended to implement an UMTS SystemSimulator


14/23


3GPP test model(TS 34.123-3)

RF cable

MAC

PHY (UTRAN)

SS

PHY

MAC

RLC

RRC

NAS (GMM, MM, CC, etc)

TTCN test scenarios

RLC

RRC-

adapt.PDCP

L1 (GERAN)

RLC/MAC L2

LLC

SNDCP

MMI / E-MMI

control

L1

MAC/RLC

L2

RR / GRR

UE

Phone Apps


15/23


Why we need a Test Model

Main reason for us: If we comply with the3GPP Test Model we can use the TTCN testcases developped here at ETSI / STF 160

In general:

Clear and stable interfaces to the SS enablesmanufacturers to develop the test equipment

It reduces ambiguities within test case scenarios

It enables outsourcing of testing activities and SW re-

use

It provides a common consens or understanding of thecomplete system to manufacturers and operators


16/23


A test case (1/2) ...

Configure SS

Configure PHY / L1

Configure MAC

Configure RLC

Schedule and send System Information Blocks

Test case preamble

Bring UE into initial state (e.g. CS and PS registration)

Perform Location Update procedure Perform GPRS Attach procedure


17/23


Test case body Stimulate the UE, e.g.

Send X message to the UE, or

Change cell power levels, or

Trigger the UE via AT command to initiate a call

Verify responses

Match messages from the UE to expected values

Assign a verdict (PASS, FAIL, INCONC)

Test case postamble

Complete signalling to bring UE into stable state

A test case (2/2) ...


18/23


So, how to design a Virtual Testerwhich matches the 3GPP model

and our requirements ?


19/23


Problems designing an overallGSM/GPRS/UMTS Test Env.

The clean 3GPP model is not enough for acomplete MS test environment

We need to re-use tools, tracers, and most of

all test cases developed for GSM in the newenvironment

We can not afford to develop the UMTS testsuite in house, we need to re-use the 3GPP

tests

The L1 and DSP simulation strategies for GSMdo not match those of UMTS


20/23


Current approach (a compromise)

Multi-threaded system: The proper MS, theGSM SS, the UMTS SS and the SIM simulator

All communicating via shared buffers

The tick-master is the MS, when all jobs forcurrent frame are completed, it issues a tickand all System Simulators prepare data (radioblocks) for next frame.

Each SS will send a tick-ack to the MS whenit is ready for next frame

When all SSs are done: the MS L1 engine willfetch or store a radio block


21/23


Cu

UuUm

Thread 3

Thread 2Thread 1

.bst, .asc files(Optimay tests)

L1 emulation

L2

RLC/

MAC

GERAN simulation

SNDCP/

LLC

TTCN suite(3GPP tests)

PHY emulation

MAC

UTRAN simulation

PDCP

RLC

SIMsimulation

.sat files(Optimay)

Thread 0

MS

GSM/GPRS/UMTS Test Environment

Thread 4

Tracer


22/23


Summary

A Virtual Test Environment is an essential tool

for development

for quality assurance

3GPP test model

A rough overview of our implementation


23/23


Thank you.

1_umts terminal testing

Documents