dr. beth bean director of research and information colorado department of higher education ryan...

78
Dr. Beth Bean Director of Research and Information Colorado Department of Higher Education Ryan Allred Senior Data Systems Engineer Colorado Department of Higher Education & Colorado GEAR UP NCCEP Capacity Building Workshop February 5, 2013 Making Data Work for You: A Colorado Story

Upload: talisa

Post on 25-Feb-2016

60 views

Category:

Documents


0 download

DESCRIPTION

Making Data Work for You: A Colorado Story . Dr. Beth Bean Director of Research and Information Colorado Department of Higher Education Ryan Allred Senior Data Systems Engineer Colorado Department of Higher Education & Colorado GEAR UP NCCEP Capacity Building Workshop - PowerPoint PPT Presentation

TRANSCRIPT

PowerPoint Presentation

Dr. Beth BeanDirector of Research and InformationColorado Department of Higher Education

Ryan Allred Senior Data Systems EngineerColorado Department of Higher Education &Colorado GEAR UP

NCCEP Capacity Building Workshop February 5, 2013

Making Data Work for You:A Colorado Story

AgendaAbout ColoradoData Tracking and Best PracticesOpportunitiesChallenges2Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20132AgendaAbout ColoradoOverview, Data Tracking Data Used in DecisionsGEAR UP, State, NationalBest PracticesGEAR UP, State3Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20133HighlightsColorado4Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20134High School Graduation RatesOn-Time graduation rates for students graduating after the 2010-2011 school year.

Colorado GEAR UPvs.StatewideCollege Matriculation RatesEntering college in the fall term immediately following graduation for students graduating after the 2010-2011 school year.

Colorado GEAR UPvs.Statewide

College Persistence RatesEntering college in the fall term immediately following graduation and persisting through spring of year 1 for students graduating after the 2010-2011 school year. This is compared to the 2010-11 statewide retention rates, student returning in fall of year 2.

Colorado GEAR UPvs.StatewideEthnicityDemographics

Comparison of the two largest ethnicity groups for 2011 graduates.

Colorado GEAR UPvs.StatewideIncome Demographics

Comparison of income related demographics for 2011 graduates.

Colorado GEAR UPvs.Statewide

DUAL/CONCURRENTEnrollmentColorado has several concurrent enrollment programs including the state sponsored CONCURRENT and ASCENT programs. In addition, there are many institutional sponsored programs.

StatewideColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201311

Image from: colorado.comState CapitolColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201312

Beth Bean last SaturdayHigher education OverviewThe State of Colorado13Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201313We Are HereColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201314

About Colorado5.1 million - Population (July 2011, Dept of Local Affairs)4.2 Million in Front Range (Pueblo to Ft. Collins)2 million Households (Census 2010)854,265 K-12 students432,500 Postsecondary students

Website: Colorado.govColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201315About ColoradoColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201316

Colorado DemographicsColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201317Source: 2010 Census - http://dola.colorado.gov/dlg/demog/2010censusdata.htmlColorado Job DemographicsColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201318Source: 2010 Census - https://dola.colorado.gov/demog_webapps/jsn_parameters.jsfThe Colorado Paradox & PromiseClose the Achievement GapsHalve the Drop Out RateDouble the number of Certificates & DegreesIncrease Student and Family awareness of Career Pathways.

Colorado Department of Higher Education NCCEP Capacity Building Workshop - February 5, 2013Do you strongly agree or disagree with the belief?19Minding the Colorado Gap Ethnicity/Race

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201320When we divide this data further and look at educational attainment by race and ethnicity you see the traditional gap that people typically think of Colorado has one of the largest gaps only surpassed by CA. this gap looking at the percent of whites who have a degree compared to the percent of minorities in the highest ethnic category that have a degree. In this case for CO it would be Hispanic students. Currently just over 15% of Hispanic students have a certificate or degree beyond HS. 8% have a bachelors degree. If things remain the same only 9% of Hispanic males in high school today will go onto higher education. 20The Colorado Gap - Income

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201321This slide represents other ways we can speak of the gap. There are numerous groups that fall into the gap other than just minority groups. Other areas where CO is falling behind in serving include low income students and adult student. Research supports that there is a correlation between level of income and level of educational attainment. Lower income students have lower educational attainment and students from higher levels of income have higher levels of educational attainment. The red in this map represents low educational attainment and low family income and the gray areas represents neutral zones that are fairly average. The green represents those areas of in CO that have high personal wealth and high educational attainment in co these are focused around the Denver area. 21Percentage of Jobs in 2018 that Will Require a Postsecondary Education, by State

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201322B.C. Be ClosedA.D. Access to Data Big Data: The shifting paradigm.

DATA

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201323Before I jump into specific data issues in Colorado I want to briefly discuss a cultural paradigm that is occurring. In the past which I will call BC for be closed data was treated as a item to be coveted and kept secret. People were very possessive of their data and liked having it and hoarding it and not sharing not unlike gholum in lord of the rings. Luckily we are moving into the present and future which I will call AD for access to data. There is a national and international movement to open data and data sharing. One example of this is Data.gov is anyone familiar with data.gov? It has almost 400K raw data sets available from federal, state, and local governments. It is like the old open source Napster but for data nerds. In Colorado the idea of a Colorado Marketplace is being explored, which is a small initiative tied to SLDS but would be a local open data source. These are all examples of the open data movement and the shift to making data available and to create more data linkage and sharing. 23Statewide Longitudinal Data Systems

National Center for Education Statistics (NCES), specifically Institute of Education Sciences (IES). Grants four rounds of ARRA funding41 states to dateAid state education agencies to develop and implement longitudinal data systems

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20132424Postsecondary Student B.A. English 3.04GPA2 semesters of remediation in Math Average per Year $4,623 Financial Aid Transferred from Community College23 year old Hispanic Male 153 hours to graduate 1110 on SATConcurrent Enrolled in HS

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201325K-12 and Postsecondary Link Cherry Creek H.S.College Student600 Science CSAP ScoreFRL 5 years11th Grade ACT3.44 GPA ESL Cherry Creek Middle School

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201326K-12 Student 26Education to WorkforceK-12 Student College StudentEmployeeArea of EmploymentSalary Data Employment Duration

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201327District at a Glance Search Tool Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201328

Data Links(Legislative Action)2002 required longitudinal analysis of the CSAP test, creating the SASID (CRS 22-7-603.5)2008 - every postsecondary institution in Colorado must provide each enrolled student with a unique identifier (CRS 235127.4)2008 unified data protocols, open data sharing between state agencies (HB 08-1364)Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201329Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201330

Kenosha Pass, Jefferson CountyColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201331

Hanging Lake, Glenwood Canyon, CO; 7,040 feet above sea levelData trackingData Flow from GEAR UP to the Governor32Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

32Data?Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201333

DATAINFORMATIONRaw inputQualitative or quantitative attributes Not significant alone Observations and recordings done to obtain data Derived from DataInformation is a conceptSignificant aloneAnalysis done to obtain information Data versus Information Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201334Aggregated Reporting, High Level System and Trend AnalysisExamples: IPEDS, National ComparisonsSystems Integration, Reports & Analysis, Systems PolicyExamples: Statewide Graduation Rates, Dropout, Retention, MatriculationUnit Record Student Data, Point on EntryExamples: Demographic, Academic, ServicesDownstream Data Flow State View Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201335DataInformationComplianceDownstream Data Flow State View (Non-GEAR UP Students)Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201336High SchoolSchool DistrictCO Dept of EducationState AgenciesCO Dept of Higher EdLegislature/ GovernorFederal (IPEDS)DataInformationComplianceIHE (College)NSCDownstream Data Flow State View (GEAR UP Students)Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201337High SchoolSchool DistrictCO Dept of EducationState AgenciesCO Dept of Higher EdLegislature/ GovernorFederal (IPEDS)IHE (College)Colorado GEAR UPDataInformationComplianceNSCDownstream Data Flow State View (Links)Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201338High SchoolSchool DistrictCO Dept of EducationState AgenciesCO Dept of Higher EdLegislature/ GovernorFederal (IPEDS)IHE (College)DataInformationCompliance

K-12 Student ID

SSN

NSC

Student Names

Colorado GEAR UP

More Data trackingColorado Data39Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

39 Colorado GEAR UP (GU3)Data Type#Regions8All Schools33Source: Colorado GEAR UPhttp://www.coloradogearup.org/public/Schools.aspxColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201340

Data Type# StudentsTotal Students3,833GU 2 (2005-2011 Grant)860GU 3 (2011-2017 Grant)2,973Source: Colorado GEAR UP Student DatabaseColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201341 Colorado GEAR UP

K-12 EnvironmentData Type#School Districts178All Schools2,209Source: Colorado Department of Education, 2011 October Counthttp://www.cde.state.co.us/cdereval/rv2011pmlinks.htmSchool Counts - http://www.cde.state.co.us/cdereval/DownloadableMailingLabels.htmColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201342

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201343Data Type# Records

Enrollment12,455,624Degrees Awarded846,779Financial Aid 3,921,121Applicant/Assessment1,831,603Educator Preparation146,944Remedial Course438,017OpportunitiesData Friendly EnvironmentData Driven LeadershipLegislative SupportGrant Funded SupportEager Research CommunityLinks and Relationships are establishedMOUSLDS

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20134444OpportunitiesPostsecondary outcomes LINKED to K-12 performanceLabor and Employment Outcomes Pre-Collegiate Program EffectivenessNational enrollment and transfer studies (NSC)

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20134545ChallengesData Quality - Linking and Sharing CGU Grads, CDE Graduate DataMOU in FERPA PurgatoryBurden vs. Benefit vs. SecurityUncollected data attributesReducing Overlap in collections

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20134646Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201347

Mile High Skyline, at dawnColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201348

Aspen, COData in Formative decisionsPolicies and Legislation49Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 2013

49Data in Formative DecisionsTo inform and change policy To aid in P-20 understandingState and Federal Mandates

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20135050Data Sharing Colorado Department of Education School DistrictsGEARUP, TRIO, other Pre-collegiate ProgramsInstitutions, Researchers, Graduate Students

Share aggregate data daily/publiclyi3: Searches, Downloads, ReportsSharing potential and practice increasing

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20135151Data in Legislative DecisionsConcurrent Enrollment ASCENT

Reverse Transfer Credit When Its Due

SASID Linkage (K-12 to Postsecondary link)

Performance Funding

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20135252Data in Policy DecisionsRemedial Assessment2013-14 Revisions by statue K-12 accountability measureAdmission Index/Cut Score2013-14 Revisions by statue K-12 and HE Alignment

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20135353Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201354

Hiking Pikes Peak: Summit is 14,114 feet above sea levelData in GEARUP decisionsAdministration, Management, Services55Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201355Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201356

Data in GEAR UP AdministrationService Data Informs Student Contact HoursMissing Service Data Advisor ManagementRemediation Progress, Achievement Informs Need for InterventionsCollege GPA, Attendance Inform need for College Services

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20135757Data Analyzing GEAR UP DecisionsGU2 (Cycle 2005-2011)Dual Courses & CLEP TestsTranscripted Hours On-Track to GraduateCohorts, Year-by-Year Tracking College Matriculation RatesCollege PersistenceSuccess Rates

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20135858GEAR UP ResultsGU2 (2005-2011)First Graduating Cohort in May 201187 % - On-Time Graduation (of Active 9th-12th)72 % Statewide Rate84 % - College Going Rate (of HS Graduates)46% Statewide Rate (to Public Colleges)81 % - Year 1 College Persistence 69 % - On Track To Graduate 44 % Statewide RateColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201359Source: Colorado GEAR UP - Improving Academic Achievement: A Report on Colorado GEAR UP II At-Risk Student Outcomes, August 2012Data Influences GEAR UP DecisionsGU3 (2011-2017)State Remedial Rates, GU2 Students Need for Remedial Intervention GU3 Early Assessment and EnrollmentRemedial Progress TrackingInforms effective methodsIdentifies advisors/students needing extra attention

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20136060Ongoing ResearchFurther 2011 Graduates AnalysisCombining effortsColorado GEAR UPColorado Department of Higher EducationColorado Department of EducationNational Research InstitutionsHarvard UniversityStanford UniversityUniversity of Colorado University of MichiganVanderbilt University

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201361Ongoing ResearchFurther 2011 Graduates AnalysisIn depth analysis of statewide dataset of high school students going to college, progress and outcomesRanging concentrations of studyDual/Concurrent EnrollmentRemedial Trends, Progress and OutcomesEffects of CLEP TestingFinancial AidCost-Benefit Analysis

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201362Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201363

Salida, COBest Practices, overviewWhat we got right64Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201364What We Have LearnedData Drives Legislation, Policies, Decisions Remedial ReportEarly RemediationDelivery MethodsProgress & OutcomesTranscript FrameworkFinancial Aid Allocations to collegesFunding ModelsColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20136565What We Have LearnedRelationshipsDepartment of EducationLocal Education Agencies (LEA)Denver Public Schools Remedial ProjectMake Data AvailableAvailable data leads to more discussion, progress, and changeCorrections to data and data collectionTransparencyColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20136666What We Have LearnedData SharingNo one knows what they want in the beginningOpen communication leads to clear messageAsk questions about data and what is being delivered, assumptions lead to errorsThink Long TermBaby steps are great, Redoing work is not

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20136767

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201368Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201369

Denver BroncosBest Practices, COLORADO GEAR UpBuilding on Success70Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201370What Have We Learned (GU)Customize Data SystemFlexible, customized data system offers ability to track exactly what you needCollege Portfolio exampleRequires technical staff

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20137171Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201372

Online Survey

(Student &Control)

72Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201373CustomCurriculum

73What Have We Learned (GU)Be a Data Collection OverachieverMore detail on student and services gives you the ability to review actions and make correctionsService Categories exampleReview data constantly, navigate accordinglyColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20137474Service Category ExampleFederal APR Categories (12)College visit/College student shadowingComputer Assisted LabCounseling/advising/academic planning/career counselingCultural eventsEducational field tripsFamily eventsJob site visit/job shadowingMentoringOtherSummer programsTutoring/Homework assistance/Academic enrichmentWorkshopsColorado GEAR UP Expansion (31)ACADEMIC - Academic InterventionACADEMIC - Academic PlanningACADEMIC - Credit RecoveryACADEMIC - Remediation Lang ArtsACADEMIC - Remediation MathACADEMIC - Tutoring/HomeworkCAREER - Career WorkshopCAREER - Field TripCAREER - InternshipCAREER - Job ShadowingCOLLEGE - COFCOLLEGE - College ApplicationsCOLLEGE - College CourseCOLLEGE - College EssayCOLLEGE - College ReadinessCOLLEGE - College VisitsCOLLEGE - Financial AidCOLLEGE - ResearchCOLLEGE - ScholarshipsCOLLEGE - Testing and AssessmentsEXTRACURRICULAR - Community ServiceEXTRACURRICULAR - Cultural EventsEXTRACURRICULAR - Summer ProgramsMENTORINGPARENT - College PrepPARENT - Family EventPARENT - Field TripPARENT - Home VisitsPARENT - Telephone/Mail/E-mailSURVEY - ParentSURVEY - StudentColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 201375What Have We Learned (GU)RelationshipsVital to efficient data collection, dont key enter data that exists with a partnerLink or ShareChallenging the status quo can lead to hard conflict, then roadblocksFind benefit to partner, students and overallCommunicate messageColorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20137676Principal Lessons LearnedUpcoming book, to be published in 2013Get Your Ass to College: How One School Closed the Achievement GapBy Dr. Scott Mendelsberg, Executive Director of Colorado GEAR UP, former principal of Abraham Lincoln High SchoolThis book describes the galvanizing program Lincoln called College Now that changed the school and forced the State of Colorado to change the way it viewed education. How this program increased the college matriculation rate from 17% to 73% in one year. The Colorado State Governor, the Denver Mayor, state senators and congressmen, future U.S. Senators and Congressmen and U.S. Presidential cabinet members are all involved in one way or the other, plus the President of the United States.Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20137777Visit Us DHE & CGUPlease visit our website. Data and reporting is only valuable if it is used.

http://highered.colorado.gov

http://highered.colorado.gov/i3/

http://www.coloradogearup.org

Questions and comments?

Thank you!

Colorado Department of Higher Education NCCEP Capacity Building Workshop February 5, 20137878Chart17070686767666666656564646464646463636262626262626161616161595959595958585757575656555554545454525149

Series 1

Sheet1Series 1ND70MN70MA68CO67WA67NE66UT66MD66HI65CT65IL64KS64VA64NH64NJ64OR64NY63AK63MI62WY62MT62VT62IA62SD62WI61ID61RI61CA61AZ61NC59ME59FL59MO59DE59GA58NM58OH57PA57OK57TX56SC56AL55IN55NV54TN54MS54KY54AR52LA51WV49To resize chart data range, drag lower right corner of range.