Integrating Open Source Web 2.0 and Smartphone Technologies to Automate Academic CME

Integrating Open Source Web 2.0 and Smartphone Technologies to Automate Academic CME

Presented at:

2011 Medicine 2.0 Conference

# 741

Mila Kostic, Perelman School of Medicine at the University of Pennsylvania, Office of CME

Jeremy C. Lundberg, MSW, DLC Solutions and Ethos CE

Presented at:

2011 Medicine 2.0 Conference

# 741

Mila Kostic, Perelman School of Medicine at the University of Pennsylvania, Office of CME

Jeremy C. Lundberg, MSW, DLC Solutions and Ethos CE

Disclosures and Disclosures and AcknowledgementsAcknowledgementsDisclosures and Disclosures and AcknowledgementsAcknowledgements

๏ Mila Kostic has no interest in selling a Mila Kostic has no interest in selling a technology, program, product or service to technology, program, product or service to the audience.the audience.

๏ Jeremy Lundberg has an interest in selling Jeremy Lundberg has an interest in selling a technology, product or service to CME a technology, product or service to CME professionals.professionals.

๏ Grateful to Rod Campbell at Penn CME for Grateful to Rod Campbell at Penn CME for data and project leadership data and project leadership

Setting the Stage: 2003-2010Setting the Stage: 2003-2010Setting the Stage: 2003-2010Setting the Stage: 2003-2010๏ 10 FTEs10 FTEs๏ Developed large online presence housed in separate Developed large online presence housed in separate

content management system (CMS)content management system (CMS)๏ 2009 2009 ๏ 5,431 activities (live, self study online, RSS, other)5,431 activities (live, self study online, RSS, other)๏ 734,815 certificates issued 734,815 certificates issued ๏ Leased new database - Eventually replaced by another as Leased new database - Eventually replaced by another as

program grewprogram grew

๏ 20102010๏ 1,000,000 MD and 500,000 non-MD records1,000,000 MD and 500,000 non-MD records๏ 96 RSS96 RSS๏ Over 5,500 web-based self-study CME activitiesOver 5,500 web-based self-study CME activities๏ Growing number of PI-CMEGrowing number of PI-CME๏ Database administered manuallyDatabase administered manually๏ Attendance collected using barcode scanningAttendance collected using barcode scanning

2010: The RSS Problem2010: The RSS Problem2010: The RSS Problem2010: The RSS Problem๏ 90 weekly sessions.90 weekly sessions.๏ 112,500 attendees to be recorded (from 112,500 attendees to be recorded (from

RSS alone)RSS alone)๏ 6 month backlog to enter attendance 6 month backlog to enter attendance

into database.into database.๏ 2 FTEs + required to:2 FTEs + required to:

๏ Review applicationsReview applications๏ Monitor disclosures and handoutsMonitor disclosures and handouts๏ Conduct onsite visitsConduct onsite visits๏ Enter attendees into databaseEnter attendees into database๏ Training and approvalsTraining and approvals๏ Monitoring peer-review processMonitoring peer-review process

2010: The Learning Platform 2010: The Learning Platform ProblemProblem2010: The Learning Platform 2010: The Learning Platform ProblemProblem

๏ Educational portfolio advanced to include much Educational portfolio advanced to include much more interactive curricula - with no adequate LMS more interactive curricula - with no adequate LMS solutionssolutions๏ Housed programs off-siteHoused programs off-site๏ Expensive to develop advanced case-based modules, Expensive to develop advanced case-based modules,

simulationssimulations

๏ Need for communities of practice in virtual Need for communities of practice in virtual environmentenvironment๏ By practice setting By practice setting ๏ By specialty/content categoryBy specialty/content category๏ PI CMEPI CME

๏ Need for good user interfaceNeed for good user interface๏ Need for integration with EMRs for PI/QI CME Need for integration with EMRs for PI/QI CME

projectsprojects

Major Goals and Major Goals and SolutionsSolutionsMajor Goals and Major Goals and SolutionsSolutions

Needs SolutionsImport, organize and house large amounts of learner participation data

Open-source solution allowing for standards-based XML data exchange (web services), use of mobile text messaging (SMS) technology

Allow easy creation of interactive modular content

Modular SCORM-compliant LMS allowing for easy development and import of content

Friendly user interface Drupal CMS, roles-based interface for administrators and relational and filtered views for learners

Enable multidirectional learning and blending of CME with non educational exchange

Learning Groups and Communities of Practice (to include data exchange)

Integration with other institutional LMSs and EMR

XML data exchange and communities-based QI interventions

Internal and external reporting of data and educational outcomes (research, regulatory, and scholarly exchange)

PARS reporting to ACCME (regulatory) based on MedBiq XML standard; views and integration with 3-rd party reporting tools for large evaluation of outcomes reporting and display

EthosCE LMSEthosCE LMSEthosCE LMSEthosCE LMS๏ Full-featured, open source content-learning Full-featured, open source content-learning

management systemmanagement system๏ Designed specifically for continuing medical educationDesigned specifically for continuing medical education๏ ACCME PARS compliant ACCME PARS compliant ๏ No licensing fees or user restrictionsNo licensing fees or user restrictions๏ Organizations retain complete access to source codeOrganizations retain complete access to source code๏ Personalized, Web 2.0 learning environmentPersonalized, Web 2.0 learning environment๏ Automates and streamlines “back office” administrationAutomates and streamlines “back office” administration๏ Role-based permissions and security protocolsRole-based permissions and security protocols๏ Flexible outcomes and compliance reporting engineFlexible outcomes and compliance reporting engine๏ Integrates with 3rd party applicationsIntegrates with 3rd party applications

Technology Development Technology Development ProcessProcessTechnology Development Technology Development ProcessProcess

๏ Interviewed key UPenn stakeholders to Interviewed key UPenn stakeholders to analyze current “pain points” and workflowanalyze current “pain points” and workflow

๏ Recommended new automated workflow Recommended new automated workflow using mobile text messaging (SMS) using mobile text messaging (SMS) technologytechnology

๏ Configured EthosCE Attendance Tracking Configured EthosCE Attendance Tracking ModuleModule

๏ Modified Drupal SMS Module, MobivityModified Drupal SMS Module, Mobivity๏ Created custom API between SMS and Created custom API between SMS and

Attendance Tracking ModulesAttendance Tracking Modules

Mobile SMS Attendance Tracking Mobile SMS Attendance Tracking WorkflowWorkflowMobile SMS Attendance Tracking Mobile SMS Attendance Tracking WorkflowWorkflow

Web-based CME ProcessWeb-based CME ProcessWeb-based CME ProcessWeb-based CME Process

Creating RSS WorkflowCreating RSS WorkflowCreating RSS WorkflowCreating RSS Workflow

RSS Coordinator DashboardRSS Coordinator DashboardRSS Coordinator DashboardRSS Coordinator Dashboard

UPenn RSS PlatformUPenn RSS PlatformUPenn RSS PlatformUPenn RSS Platform

User FeedbackUser FeedbackUser FeedbackUser Feedback๏ Positive adoption rates and feedback from HCPs regarding Positive adoption rates and feedback from HCPs regarding

new RSS mobile systemnew RSS mobile system

๏ Allows for instant RSS attendance credit to “My CME” Allows for instant RSS attendance credit to “My CME” transcripts and ACCME PARStranscripts and ACCME PARS

๏ CME office staff and series-level coordinators see RSS Online CME office staff and series-level coordinators see RSS Online Workflow screens as “very useful”Workflow screens as “very useful”

๏ RSS workflow enables complete attendance management for RSS workflow enables complete attendance management for registered and non-registered HCPsregistered and non-registered HCPs

๏ Attendance admin screen allows flexibility in record keepingAttendance admin screen allows flexibility in record keeping

๏ Study participants asked to rate the following on a 5-Study participants asked to rate the following on a 5-point Likert scale (1=Poor, 5=Excellent)point Likert scale (1=Poor, 5=Excellent)๏ Ease of Use:Ease of Use: 4.5 average rating 4.5 average rating๏ Clarity of Instructions: Clarity of Instructions: 4.5 average rating4.5 average rating๏ Credit Monitoring:Credit Monitoring: 4.6 average rating 4.6 average rating

Website/User InterfaceWebsite/User InterfaceWebsite/User InterfaceWebsite/User Interface

Learning Learning Groups/CommunitiesGroups/CommunitiesLearning Learning Groups/CommunitiesGroups/Communities

Major Goals and Major Goals and SolutionsSolutionsMajor Goals and Major Goals and SolutionsSolutions

Needs SolutionsImport, organize and house large amounts of learner participation data

Open-source solution allowing for standards-based XML data exchange (web services), use of mobile text messaging (SMS) technology

Allow easy creation of interactive modular content

Modular SCORM-compliant LMS allowing for easy development and import of content

Friendly user interface Drupal CMS, roles-based interface for administrators and relational and filtered views for learners

Enable multidirectional learning and blending of CME with non educational exchange

Learning Groups and Communities of Practice (to include data exchange)

+/-

Integration with other institutional LMSs and EMR

XML data exchange and communities-based QI interventions

+/-

Internal and external reporting of data and educational outcomes (research, regulatory, and scholarly exchange)

PARS reporting to ACCME (regulatory) based on MedBiq XML standard; views and integration with 3-rd party reporting tools for large evaluation of outcomes reporting and display

+/-

Lessons LearnedLessons LearnedLessons LearnedLessons Learned

๏ After many pathways…go with an After many pathways…go with an integrated LMS/CMS systemintegrated LMS/CMS system๏ No easy solutions for large data imports from old No easy solutions for large data imports from old

databases (re-register users)databases (re-register users)

๏ Critical to have solid internal resource to guide project Critical to have solid internal resource to guide project management with vendors and partnersmanagement with vendors and partners

๏ Get the process right (from needs, through case studies, Get the process right (from needs, through case studies, solutions, testing, improving to launch and continuous solutions, testing, improving to launch and continuous assessment and improvement)assessment and improvement)

๏ Internal integration allows for easier integration with other Internal integration allows for easier integration with other stakeholders (partners for content and reporting, EMR for stakeholders (partners for content and reporting, EMR for continuous data and practice outcomes exchangecontinuous data and practice outcomes exchange))

Lessons Learned Lessons Learned (cont’d)(cont’d)Lessons Learned Lessons Learned (cont’d)(cont’d)

Significant SavingsSignificant Savings๏ One point of entry for all activities, all users, and links to internal and external One point of entry for all activities, all users, and links to internal and external

resourcesresources

๏ Automated attendance records controlled by learnersAutomated attendance records controlled by learners๏ Less room for error Less room for error ๏ Instant availability of records on transcriptInstant availability of records on transcript๏ Instant reporting capabilities for administrators and coordinatorsInstant reporting capabilities for administrators and coordinators๏ Value added to other regulatory bodies at departments and institution-levelValue added to other regulatory bodies at departments and institution-level

๏ Less issues with session documentation approval timelinesLess issues with session documentation approval timelines

๏ Time and effort savingsTime and effort savings

๏ One, integrated CME administrative processOne, integrated CME administrative process

๏ Can provide limited administrative privileges to internal and external Can provide limited administrative privileges to internal and external collaboratorscollaborators

๏ Peer-review process Peer-review process

๏ CME CoordinationCME Coordination

๏ Easy assessment and evaluation data collection, analysis and reportingEasy assessment and evaluation data collection, analysis and reporting