wcet.wiche.edu

Lessons Learned with Institutional Data Analytics

October 9, 2014

• The webcast will begin at the top of the hour. • There is no audio being broadcast at this

time. • If you need assistance, contact Blackboard

Collaborate: 866-388-8674. • An archive of this webcast will be available on

the WCET website next week.

1

Lessons Learned with Institutional Data Analytics

October 9, 2014

wcet.wiche.edu

Lessons Learned with Institutional Data Analytics

• Welcome.

• Thank you Blackboard Collaborate!

• If you have technical issues:

• Call 866-388-8674

• Use the chat box for questions.

• Archive, PowerPoint, and Resources available next week.

Megan Raymond, WCET

3

wcet.wiche.edu

Questions from the Audience

If you have a question during the presentation, please add your questions to the chat box. We will monitor the chat box and have time for Q&A at the end of each section.

4

wcet.wiche.edu

Moderator

Matthew Milliron Senior Director, Client Success

Civitas Learning

5

wcet.wiche.edu

Presenters

Jennifer McGrath Freed Vice President, Academic

Affairs Rio Salado College

6

Karen Vignare Vice Provost, University of Maryland

University College

wcet.wiche.edu

OCCURING WITHOUT AN INFRASTRUCTURE TO UNDERSTAND WHAT WORKS, WHEN AND FOR WHICH STUDENTS. SILOED SYSTEMS NOT SHARING OR COMBINING THE POWER OF ALL DATA COLLECTED.

NUMEROUS STUDENT SUCCESS INITIATIVES

wcet.wiche.edu

THAT CONNECTS TO SYSTEMS ALREADY IN PLACE AND ANALYZES THE DATA FROM EACH OF THEM TO GAIN NEW AND POWERFUL INSIGHTS IN WAYS NO SINGLE SYSTEM OR POINT SOLUTIONS ALONG CAN DO.

IMAGINE A DATA AND ANALYTICS PLATFORM

wcet.wiche.edu

BETTER DECISION-MAKING MODEL

Blunt decisions

Comprehensive data

Precise decisions

Point data

ACROSS THE STUDENT LIFECYCLE

wcet.wiche.edu

Broad

Deep

Practical

Specific

Diverse

Sustainable

Intuitive

Accessible

Humanizing

Cross-System

Insightful features

Real-world quality, consistency

To the college and each student

Fluent in many modeling approaches

Model re-fresh & rapid feedback/testing

Intuitive UI to drive adoption

Meet users where they are

Personal, empowering, dynamic

Data

Science

People

KEYS TO STUDENT SUCCESS SCIENCE

wcet.wiche.edu

Jennifer McGrath Freed

Vice President, Academic Affairs Rio Salado College

11

wcet.wiche.edu

About Rio Salado College

12

One of 10 Maricopa Community Colleges

Locations throughout Maricopa County

Serves nearly 60,000 students, more than half online

wcet.wiche.edu

Analytics at Rio Salado College

Predictive Analytics- RioPACE

PAR Civitas

13

wcet.wiche.edu

Why Analytics?

Predictive- student success and interventions

Comparative- learning from like institutions

Decisions and Directions- Proactive decisions about the future

14

wcet.wiche.edu

RioPACE

Which factors are effective as early/point-in-time predictors of course outcome in an online environment?

Can we predict course outcomes using data retrieved from our SIS and LMS? If so, can we generate early and/or rolling (i.e. weekly) predictions?

How do we respond to students flagged as at-risk?

15

wcet.wiche.edu

Predictive Analytics Reporting

Predictive Collaborative Comparative Intervention

16

wcet.wiche.edu

Civitas

Predictive Collaborative Proactive Decisions Student-Focused

17

wcet.wiche.edu

What We Have Learned

Predictive analytics- a moving target

The importance of community

Interventions are essential

Challenges of data mining

18

wcet.wiche.edu

Future Directions

Beyond course data Student data Intervention tracking Success, persistence,

and completion

19

wcet.wiche.edu

Questions from the Audience

20

wcet.wiche.edu

Karen Vignare

21

Vice Provost, University of Maryland University College

wcet.wiche.edu

• Pioneer in adult and distance education since 1947 • One of 11 accredited, degree-granting institutions in the

University System of Maryland • Focus on the unique educational and professional

development needs of adult students • Almost 90,000 students enrolled worldwide

University of Maryland University College

wcet.wiche.edu

• Analytics History: Started over three years ago by current president (formerly IR SVP)

• Set up an Office of Analytics which helps optimize all internal data—marketing, enrollment, financial, and learner

• Have created a culture of evidence-based/data-driven decision making within administration

History of Analytics at UMUC

23

wcet.wiche.edu

• Partner with Civitas Learning • Create a cross-functional steering committee &

academic intervention team • Joined PAR second wave • Through grant funding, built a transfer student

data mart with two community colleges

Building our Analytics Toolset

wcet.wiche.edu

Putting Civitas PA to work

Four term pilot academic/advising pilot with mixed results based on risk score Marketing segmentation—very effective

based on likely persistence Continuing development of new tools—Ilume,

Insight, Faculty apps & Degree Maps

25

wcet.wiche.edu

CC Predictors of First Term GPA Positive Predictors

Older

Married

Successful Course Completion at CC

Successful Math Completion at CC

Successful English Completion at CC

CC GPA

CC Cumulative Credits

Negative Predictors

Minority

Received PELL Grant

Withdrawals

Non-Significant

Female

Taken Honors

Taken Dev Ed

Taken Online

wcet.wiche.edu

Turning Insights into Action to Improve Student Success Spend time on building a cross-institutional

team Don’t expect every intervention to work or be

significant Keep asking questions Develop a retention model

27

wcet.wiche.edu

Questions from the Audience

28

wcet.wiche.edu

Learn More and Stay Connected

Visit the WCET’s Connect, Learn, Advance services on our website: http://wcet.wiche.edu/ Attend WCET’s 26th Annual Meeting in

Portland, OR, November 19-21. http://wcetconference2014.wiche.edu/

29

wcet.wiche.edu

Learn More and Stay Connected

Join WCET today! http://wcet.wiche.edu/contact-us/join-wcet

Become a WCET member: benefits extend to your entire institution: News digests- academic, technology, and policy. Discounted access to events including Leadership Summits and

Boot Camps. Listservs. Free webcasts. Exclusive member only resources.

30

wcet.wiche.edu

Additional Information and Resources

Access to the resources discussed during this webcast, including the archive, will be available next week. http://wcet.wiche.edu/connect/webcasts

31

wcet.wiche.edu

Thank You to our Technology Provider

32

wcet.wiche.edu

Thank you Supporting Members for your commitment to WCET and e-Learning Boise State University Colorado State University Cooley LLP Lone Star College System Michigan State University University of Missouri/Mizzou Online University of North Texas University of West Georgia

wcet.wiche.edu

Thank you WCET Annual Sponsors

Blackboard CourseSmart/Vital Source Pearson Learning Solutions

Learn about Sponsorship Opportunities:

http://www.wcet.wiche.edu/sponsorship