texas english language proficiency assessment … english language proficiency assessment system...

TexasEnglishLanguageProficiencyAssessmentSystem(TELPAS)UpdateSEPTEMBER12 , 2017

TETNEVENT #4851

STUDENT ASSESSMENTDIV IS ION - TEXAS EDUCATIONAGENCY

ESMERALDACAVAZOS

DRAFT

Disclaimer

TheseslideshavebeenpreparedbytheStudentAssessmentDivisionoftheTexasEducationAgency.Ifanyslideischangedforlocaluse,pleaseremovetheTEAfooteratthebottomoftheslide.ThispresentationisnotintendedtoreplacethereviewofrequiredmanualsandadditionalinformationontheTEAwebsite.

TEA - SEPTEMBER 2017 TELPAS UPDATE 2

Topics� GeneralTELPASProgramUpdates� OnlineTrainingandCalibration� TELPASReading� TELPASListeningandSpeaking� AlternateEnglishLanguageProficiencyAssessment� Accommodations� RecommendedStepstoTakethisFall� Questions


TELPASOnlineTrainingandCalibration


TELPASHolisticRatingTraining–NEWThisYear� TheGrades2-12OnlineBasicTrainingCourseandcalibrationactivitieswillnowonlyincludethedomainofwriting.

� Aseparateholistically-ratedlisteningandspeakingratertrainingwillbeavailablefortherarecircumstancesinwhichastudentcan’taccesstheonlinelisteningandspeakingassessment.

� Eachtrainingcoursewillnowhaveapracticeactivityoutsideofthemodules.� Aftercompletingthemodulesandpracticeactivities,certificatesofcompletionwillbeavailabletoprintinthescoringsummarytab.Testingcoordinatorswillnolongerneedtoprintcertificates.


OnlineTrainingandCalibration

� Holisticratingtrainingiskey.� Individualsmust completestate-requiredtrainingandcalibrationactivitiestoberaters.

� Thosewhocompleteallrequirementsbutdon’tsuccessfullycalibratebytheendofset2mayberatersifdistrictchooses,but districtsmustprovideratingsupportinamannerthatassuresvalidandreliableassessment.

� Validityandreliabilitychecksmustbeimplementedduringthetestingwindow.

OnlineTrainingandCalibration� Calibrationmustbecompletedinamonitoredsetting.� Ratershavetwoopportunitiestocalibrate.� Forgrades2-12,raterswillcalibrateonlyonthedomainofwriting.� Localproceduresmustbeestablishedforverifyingthecompletionofonlinecoursesandcalibrationactivities.

� TheTELPASOnlineTrainingCenterdoesnotsavetraininghistoriesorcertificates.Accountsandcertificateswillbepurgedfromtrainingsiteattheendofeachtrainingwindow.

� Ratersneedtoprintandretainacopyoftheirtrainingandcalibrationcertificates.Certificatesarealsoemailedtoratersuponcoursecompletionandsuccessfulcalibration.


ImportanttoEmphasizeItisaviolationofstateassessmentproceduresandaserioustestingirregularitytorecord,discuss,orshareanswerstotheratingpracticeandcalibrationactivities.� Aftercompletionofcalibrationactivities,proctorsmustdestroyallnotestakenaboutspecificstudentprofiles.


NOTE:Whilecollaborationisencouragedduringtheliveadministration,itisimperativethatratercalibrationisdoneindividuallytoensurethatratersareabletoapplytheproficiencyleveldescriptors(PLDs)accuratelyandconsistently.

HolisticRatingTrainingResources2017–2018trainingresources:� PowerPointpresentations(comingsoon)o MakingtheELPS-TELPASConnection:K–12Overviewo IntroductoryTrainingonthePLDs(separatemodulesforK–1and2–12)o Grades2–12WritingCollectionOverviewo HolisticRatingTrainingRequirements

� EducatorGuidetoTELPASo TheEducatorGuidewillbeupdatedfor2017-2018toreflectthechangesin

thetestdesign.


2017TELPASGradesK–1 Grades2–12

• Holistically-ratedlistening,speaking,reading,andwritingassessmentsbasedonclassroomobservationsandstudentinteractions.

• Onlinemultiple-choicereadingtest• Holistically-ratedstudentwriting

collection• Holistically-ratedlisteningandspeaking

assessmentsbasedonclassroomobservationsandstudentinteractions

TeachersservingasnewTELPASratersforwriting,listening,speaking,andreadingcompleteonlinebasictraining*component.AllTELPASratersmustcompletemonitoredonlinecalibrationactivitiesannually.

TeachersservingasnewTELPASratersforwriting,listening,andspeakingcompleteonlinebasictraining*component.AllTELPASratersmustcompletemonitoredonlinecalibrationactivitiesannually.

*Newratersandreturningraterswhohavenotcompletedcalibrationactivitieswithinthelast3schoolyearsarerequiredtocompletetheonlinebasictrainingcoursebeforecalibrating.



2018TELPASGradesK–1 Grades2–12

Sameas2017 • Onlinemultiple-choicereadingtestwithshorterblueprint

• Onlinelisteningandspeakingtest• Holistically-ratedstudentwriting

collection

Sameas2017 TeachersservingasnewTELPASratersforwritingcompleteonlinebasictraining*component.AllTELPASratersmustcompletethemonitoredonlinecalibrationactivitiesannually.

*Newratersandreturningraterswhohavenotcompletedcalibrationactivitieswithinthelast3schoolyearsarerequiredtocompletetheonlinebasictrainingcoursebeforecalibrating.

TEA - SEPTEMBER 2017 TELPAS UPDATE

School Year

ListeningB I A H

SpeakingB I A H

ReadingB I A H

WritingB I A H

16-17 18 30 29 22 24 32 26 18 37 30 19 14 39 31 19 11

15-16 18 30 29 22 25 31 26 18 36 31 20 13 36 31 19 11

14–15 19 30 29 22 26 31 25 17 37 30 19 13 40 31 19 11

13–14 20 30 29 22 27 31 25 17 38 29 21 13 40 31 19 11

12–13 20 30 29 21 27 31 25 17 35 26 20 18 40 31 18 11

11–12 20 31 28 21 5 17 33 44 7 14 27 53 7 25 36 31

TELPASPercentofStudentsatEachProficiencyLevelatGradesK–2

B = BeginningI = IntermediateA = AdvancedH = Advanced High

12


School Year

ListeningB I A H

SpeakingB I A H

ReadingB I A H

WritingB I A H

16-17 4 11 26 59 6 14 29 51 12 27 40 21 8 23 35 35

15-16 4 11 26 59 6 14 30 50 11 26 43 20 7 23 35 35

14–15 4 11 27 58 6 15 30 49 12 27 40 22 7 23 36 34

13–14 4 11 28 58 6 15 31 48 12 25 40 22 7 23 36 33

12–13 4 12 29 56 5 16 32 46 7 14 25 54 7 24 37 32

11–12 4 13 31 53 5 17 33 44 7 14 27 53 7 25 36 31

TELPASPercentofStudentsatEachProficiencyLevelatGrades3–12

B = BeginningI = IntermediateA = AdvancedH = Advanced High

13

TELPASCompositeScore


Domain Weight

Listening 10%

Speaking 10%

Writing 30%

Reading 50%


TELPASCompositeRatings2012–2017PercentofStudentsReachingAdvancedHigh

SchoolYear K–2 3–12

2017 14 34

2016 14 34

2015 14 34

2014 13 34

2013 18 53

2012 18 51

15

TELPAS2017ReadingReleasedTestsThe2017TELPASReadingTestsforGrades2-12havebeenreleasedandpostedintheRelatedWebpagessectionontheTELPASResourcespageathttp://tea.texas.gov/student.assessment/ell/telpas/.


TutorialsNewTELPAStutorialswillbereleasedinJanuary.TheyarebeingredesignedtoassiststudentswiththefunctionalityoftheTELPASonlinetestinginterface.Theplanistoincludepracticeactivitiesora‘tryit’feature.Onceposted,thetutorialscanbefoundintheRelatedWebpagessectionontheTELPASResourcespageathttp://tea.texas.gov/student.assessment/ell/telpas/.


TELPASGradeLevelsREADING• Grade2

• Grade3• Grades4-5• Grades6-7• Grades8-9• Grades10-12

LISTENING&SPEAKING• Grades2-3

• Grades4-5• Grades6-8• Grades9-12


TELPASReading



ReadingBlueprintsGrades2,3,and4-5PREVIOUS CURRENT


ReadingBlueprintsGrades6-7,8-9,and10-12PREVIOUS CURRENT

TELPASReadingGrades2-12:ReportingCategoriesReportingCategory1

ThestudentwilldemonstrateanunderstandingofwordsandlanguagestructuresnecessaryforconstructingmeaninginEnglish.

ReportingCategory2

ThestudentwilldemonstrateabasicunderstandingofavarietyoftextswritteninEnglish.

ReportingCategory3

ThestudentwilldemonstrateanabilitytoanalyzeandevaluateinformationandideasinavarietyoftextswritteninEnglish.


OtherELPSExpectationsforReadingThefollowingELPSstudentexpectationsareassessedthroughoutthetestandarenotspecifictoanyonereportingcategory.

Thestudentisexpectedto:

(A)learnrelationshipsbetweensoundsandlettersoftheEnglishlanguageanddecode(soundout)wordsusingacombinationofskillssuchasrecognizingsound-letterrelationshipsandidentifyingcognates,affixes,roots,andbasewords

(B)recognizedirectionalityofEnglishreadingsuchaslefttorightandtoptobottom

(D)useprereadingsupportssuchasgraphicorganizers,illustrations,andpretaughttopic-relatedvocabularyandotherprereadingactivitiestoenhancecomprehensionofwrittentext

(E)readlinguisticallyaccommodatedcontentareamaterialwithadecreasingneedforlinguisticaccommodationsasmoreEnglishislearned

(H)readsilentlywithincreasingeaseandcomprehensionforlongerperiods


TELPASGrades2-12ListeningandSpeaking



2018TELPASListeningandSpeakingDevelopment2015-2016schoolyear

• Workinternallytodrafttestblueprints,createitemtypes,draftpoliciesandprocedures

2016Spring-Summer

• GatherfeedbackfromEnglishLanguageLearnerFocusGroupandTexasTechnicalAdvisoryCommittee

• Developfirstsetoflisteningandspeakingitems

• Educatorcommitteereviewsfirstitemsetforcontentandbias

2016Fall

• CompletecognitivelabwithELLsingrades3-12toobservetheirinteractionwithonlinetestingplatformanditemtypes

• Buildpilotlisteningandspeakingtests

2017

• Administerpilottovolunteerdistricts

• Scoringanddataanalysis

• Buildfirstoperationallisteningandspeakingtests

2018

• FirstadministrationofTELPASListening&Speakingtest

PilotParticipationApproximately109districts,468campuses,and22,255studentsparticipatedinthepilot.

Ofthetotalstudents,approximately

8180studentsingrades2-3,



4002studentsingrades9-12,and

85%wereELLs.

Non-ELLswereincludedinthepilotstudytocomparenativeEnglishspeakerperformancetoELLperformance.


ListeningandSpeakingBlueprint:Grades2-12


Listening

RC1:wordsandlanguagestructures 5points

RC2:basicunderstanding 16points

RC3:analyzeandevaluate 6points

Total 27pointsSpeaking

RC1:summarizeandprovideinformation 16pointsRC2:shareopinionsandanalyzeinformation 20points

Total 36points

ListeningGrades2-12:ReportingCategoriesListeningReportingCategory1

ThestudentwilldemonstrateanunderstandingofspokenwordsandlanguagestructuresnecessaryforconstructingmeaninginEnglish.

ListeningReportingCategory2

ThestudentwilldemonstrateabasicunderstandingofspokenEnglishusedinavarietyofcontexts.

ListeningReportingCategory3

ThestudentwilldemonstrateanabilitytoanalyzeandevaluateinformationandideaspresentedinspokenEnglishinavarietyofcontexts.


Itemswrittentotargeteachofthe4TELPASproficiencylevels◦ Beginning:includepictureidentification,matchingpicturetoaudioprompt◦ Intermediate:includemorecomplexpicturematching,picturesequencebasedonashortaudiostimulus

◦ AdvancedandAdvancedHigh:includemultiple-choicelisteningcomprehensionitemsbasedonvideostimuluswrittentotargetthoseproficiencylevels

2018TELPASListening,Grades2-12



2018TELPASListening,Grades2-12

� Forlisteningitems,thetextofthestimulusand/orpromptisnotavailableonscreen.

� Tointeractwithonlinelisteningitems,studentswillbeusing“clickonthecorrectanswer”anddrag-and-dropfunctionalities,aswellasrespondingtomultiple-choicequestionsforpassage-basedandnon-passaged-baseditems.

� Studentswillneedtowearheadsets.� Allaudioisrecordedinastudio;notext-to-speechaudioisused.� Audioisprovidedforthestimulus/taskgray-boxdirectionlines.

Audio: Click on the ball.


Audio 1: The kitten lies on a blanket with the dog.

Audio 2: The kittens lie together in a basket.

TEA - SEPTEMBER 2017 TELPAS UPDATE32

Look at the picture and listen to the audio. Choose the answer that best matches the picture.

Audio 1: The people are looking for their clothes.Audio 2: The people are folding their clothes.Audio 3: The people are buying some clothes.Audio 4: The people are making new clothes.


SpeakingGrades2-12:ReportingCategoriesSpeakingReportingCategory1

ThestudentwilldemonstrateanabilitytousespokenEnglishtoprovideandsummarizeinformationinavarietyofacademicandsocialsituations.

SpeakingReportingCategory2

ThestudentwilldemonstrateanabilitytousespokenEnglishtoshareopinionsandanalyzeinformationinavarietyofacademicandsocialsituations.



TELPASSpeaking,Grades2-12

� Forspeakingitems,thetextofthepromptisavailableonscreenforstudentstoreadandalsoavailableinanaudiofileforstudenttolistento.

� Tointeractwithspeakingitems,studentswillbeusingaudiocapturefunctionalitytorecordaresponse,listentotheresponse,anddeleteandre-recordifnotsatisfiedwiththeirfirstresponse.

� Studentswillneedtowearheadsetswithamicrophone.� Thecomputerwillcapturestudentspokenresponses.� Studentshaveupto90secondsofrecordingtimeforaresponse.� Studentswillhavetwoopportunitiestorecordtheirresponse.

Speakingpromptsarescoredaccordingtoa2or4pointrubricdependingontheitemtype.◦ Two-pointitemtypesarefairlysimple,suchasmakingapredictionbasedonapicturestimulusorusingasimplemaptoprovidedirections.

◦ Four-pointitemstypesaremoreopenended,suchasusingaseriesofpicturestoexplainamulti-stepprocess,comparingandcontrasting,ortakingapositiononanissueanddefendingthatposition.

TELPASSpeaking,Grades2-12


Imaginethatyouareatthelibrary.Youaregoingtomeetyourfriendatthepark.Explainhowyouwouldgetthere.

Read the information below. You will use the map to give directions. When you are ready to speak, tell as much as you can.


Imagine you could design your own elective class. Talk about what the class would be like, what you would learn and do in the class, and why you want to take that class.

Read the directions below. When you are ready to speak, tell as much as you can.


Look at the two pictures and read the directions below. When you are ready to speak, tell as much as you can.

• First describe at least two ways these pictures are similar.• Next describe at least two ways these pictures are different.

1 2


MicrophoneandHeadphoneRequirementsItisrecommendedthatheadsetsbeuni-directional,withnoise-cancellingmicrophones.

Desktop/LaptopHeadphonesandMicrophones

• Head-mountedUSBheadsetwithmicrophoneandheadphonesmustbecompatiblewiththerequirementsbelow:


HeadphoneFeatures Soundmode Stereo

Earpiece Double

DriverUnitSize 32mm

FrequencyResponse 20– 20000Hz

Impedance 32ohms

MicrophoneFeatures FrequencyResponse 100– 12000Hz

Impedance 3320ohms


MicrophoneandHeadphoneRequirementsHandheldDeviceHeadphonesandMicrophones

1.3.5mmsinglejack

2.Over-the-earstyle(non-earbud)

3.Lightweightanddurabledesign

4.Clearaudiothroughtheheadphones

5.Clearrecordedaudioquality

6.Ambientnoisecancellationfunctionalityofmicrophone(whenthemicrophonedetectsambientnoise,itfiltersoutthatnoisefromthespeaker’svoice)

7.Adjustableplasticboommicrophoneforeasycleaning

8.Leatheretteearpadsforeasycleaning

9.Ambidextrousheadsetdesign

10.Noin-linevolumecontrolormutebuttonthatcouldnegativelyimpacttesting(e.g.,accidentalraising/loweringofvolumeduringtest)

TELPASSpringDates– DRAFT


Date ActivityJan2-5 TELPASmanualsshippedtodistrictsJan10 AssemblingandVerifyingGrades2–12WritingCollectionscourseavailableJan22 Enddatefordistrictcoordinatortraining—allTELPAScomponentsJan22 OnlinebasictrainingcoursesfornewK–1and2–12ratersavailableJan29 Enddateforcampuscoordinatortraining—holisticallyassessedcomponentsFeb12 CalibrationwindowopensfornewandreturningratersFeb12 EnddatefortrainingratersonadministrationproceduresFeb12 EarliesteligibilitydateforTELPASwritingsamplesFeb26–Apr6 TELPASassessmentwindow

* TELPAS data verification must be conducted within the assessment window. There will not be a separate data verification window.

TELPASOnlineTesting� Grades2–12onlineTELPASreadingtestsandentryofholisticratinginformationaredeliveredthroughtheTestNav.

� Enteringstudentsholisticratingsdonotrequireastudenttestticket.Holisticratingsessionsstillneedtobecreatedbeforeenteringratingsinformation.

� AfterselectingtheindividualstudentintheTexasAssessmentManagementSystemaTestNavwindowwillpop-upfordesignatedpersonneltoenterratingsinformation.


PaperReadingTestorHolistically-RatedListeningandSpeakingAssessmentsInrarecases,astudentmayrequireanaccommodationthatrequiresapaperadministrationoftheTELPASonlinereadingtest.PaperadministrationsoftheTELPASonlinereadingtestmustbeapprovedbyTEA.

ForastudentthatcannotbeassessedwiththeTELPASonlinelisteningandspeakingassessments,thestudentwillneedtobeholisticallyratedinlisteningandspeakingwhichwillalsoneedtobeapprovedbyTEA.

Theprocesswillbethesimilartowhatwasdonelastyearforpapertestrequests.

UpdatedinformationwillbepostedontheCoordinatorManualResourceswebpage.


AlternateEnglishLanguageProficiencyAssessment


§ 200.6(h)EnglishLearnersENGLISHLANGUAGEPROFICIENCYTESTSEachStatemust- developauniform,valid,andreliablestatewideassessmentofEnglishlanguageproficiency,includingreading,writing,speaking,andlisteningskills;and- requireeachlocaleducationalagency(LEA)tousesuchassessmenttoassessannuallytheEnglishlanguageproficiency,includingreading,writing,speaking,andlisteningskills,ofallEnglishlearnersinkindergartenthroughgrade12inschoolsservedbytheLEA.

EachState’slanguageproficiencyassessmentmust- bealignedwiththeState’sEnglishlanguageproficiencystandardsand- providecoherentandtimelyinformationabouteachstudent’sattainmentoftheState’sEnglishlanguageproficiencystandards


§ 200.6(h)EnglishLearnersENGLISHLANGUAGEPROFICIENCYTESTSIfanEnglishlearnercannotbeassessedinoneormoredomainsduetoadisability,andthereisnoappropriateaccommodation,aStatemustassessthestudent’sEnglishlanguageproficiencybasedonthedomainsthatcanbeassessed.

(e.g.,anon-verbalEnglishlearnerwhobecauseofanidentifieddisabilitycannottakethespeakingportionoftheassessment)

AStatemustprovideanalternateassessmentforEnglishlearnerswithsignificantcognitivedisabilitieswhocannotparticipateintheEnglishlanguageproficiencytestevenwithappropriateaccommodations.

DepartmentofEducation:EveryStudentSucceedsAct(ESSA)AssessmentFactSheetJanuary11,2017

Accommodations


Changesto2018AccessibilityFeaturesthatincludeTELPASAdditionalassistivetools◦ amplificationdevices(e.g.,speakers,frequency-modulated[FM]systems)◦ projectiondevices(e.g.,closed-circuittelevisions[CCTVs]orLCDprojectorsforonlinetests)

Photocopyingorenlargingthefollowingnon-securetestmaterials:◦ testadministrationdirections◦ blankanswerdocuments

*Theseaccessibilityfeatureswerepreviouslydesignatedsupports.

DesignatedSupportsDesignatedsupportsforTELPASinclude:

• BasicTranscribing

• IndividualizedStructuredReminders

• LargePrint(approvedpaperonly)

• ManipulatingTestMaterials

• SpellingAssistance(new)

• ComplexTranscribing(new)

• ExtraDay-

• Other

• AmplificationandprojectiondevicesarenowAccessibilityFeatures*For TELPAS grades 2-12 writing, complex transcribing does not require an Accommodation Request Form. Refer to the Special Instructions/Considerations section for additional information.

RecommendedStepstoTakethisFall

1.ConductELPSandTELPASprofessionaldevelopmentsessions•TeachersarerequiredtoimplementtheELPSandcontentareaTEKSininstruction.

•DistrictandcampusadministratorsneedworkingknowledgeofELPSandTELPAS.

•TELPASfamiliarizationtrainingis◦ goodforfutureraters◦ agoodwaytoreinforceuseofPLDsforalllanguagedomains(listening,speaking,reading,andwriting)allyearlong.Forexample,incorporatewritingassignmentsduringcontentareainstructionsothereisasmoothtransitiontogatherwritingsamplesforTELPASinthespring.


2.HelpsupportteacheruseofTELPASresultsandELPSPLDstomonitorandmaximizelearningofEnglishBeginningofyear:• ReviewELLs’pastTELPASresultstoseeiftheyaremakingsteadyprogress

inlearningEnglish.• TELPASconfidentialcampusstudentrostersinclude◦ 2yearsoftestscores◦ howlongstudenthasbeeninU.S.schools


3.HelpsupportLPACuseofTELPASresultsandELPSPLDstomonitorandmaximizelearningofEnglish

LPACmeetingsduringschoolyear:

UsepreviousTELPASresultsandcurrentyear’steacherinputto◦ gaugeprogressinEnglishproficiency◦ reviewandadjustlinguisticaccommodationsandsupportsusedininstruction

◦ planforinstructionalinterventions,ifnecessary◦ planfordesignatedsupportsduringstateassessment


TELPASEducatorCommitteesInputfromTexaseducatorsisacriticalcomponentofensuringthatthestateassessmentsdevelopedbytheStudentAssessmentDivisionoftheTexasEducationAgency(TEA)arevalid,reliable,high-qualitymeasuresofstudentachievement.

Weareseekingqualifiededucatorsfromyourschoolordistricttoserveonstatewidecommitteeswhowillparticipateandreviewtestitems(questions)inaTexasEnglishLanguageProficiencyAssessmentSystem(TELPAS)EducatorCommitteemeeting.


TELPASEducatorCommitteesEligibilityCriteria:

OurprocessisdependentoneducatorswhoarecurrentlyworkingwithEnglishlanguagelearners(ELLs)andhavebilingual/ESLexperience.Contentarea(math,science,andsocialstudies)educatorsarealsoeligible.However,theymusthavebilingual/ESLexperience.


TELPASEducatorCommitteesRecommendationProcess

Eligibleeducatorscanberecommendedbysuperintendents,administrators,directors,specialists,departmentheads,educationaldiagnosticians,oreducationservicecenter(ESC)staff.Therecommendationmustbesubmittedonlinebytheappropriatedistrict,campus,orESCstaffmember.

OnlineRecommendationForm:

1.Goto:http://tea.texas.gov/student.assessment/

2.ClickonStudentAssessmentA-ZDirectory.

3.ScrolldownandclickonEducatorCommittees.

4.Completeonlineform.


ContactInformation

InformationregardingAssessmentsforELLscanbefoundat:http://tea.texas.gov/student.assessment/ell/

TEAStudentAssessmentDivisionphonenumber:(512)463-9536

[email protected]


texas english language proficiency assessment … english language proficiency assessment system...

Documents