PowerPoint Presentation

Karin PfisterOER CoordinatorCharles Darwin UniversityInnovating in the MOOC Space

Hello everyone! A little bit about myself to begin with. My name is .. And I work as the OER Coordinator, which includes MOOCs, at Charles Darwin University. The purpose of my session today is to showcase some of the innovative learning experiences that we have experimented with through our MOOCs, share with your our lessons learnt through this journey, and hopefully you will feel inspired to try some of these innovative approaches in your online learning environments. 1

Charles Darwin, Evolution and Tropical Australia2

2

The Art and Science of Memory3

3

Whos Counting4

4

The Innovative Media Production Studio5-IMPS!We create innovative, interactive learning resources developed specifically for the online environment through 3D animation, 3D modeling, video, web design, web programming and game design solutions.

I work as part of a team in the Innovative Media Production Studio (click) IMPS yes thats right, we are a bunch of imps- but we do pretty well for being a team of imps as we create..(click) We get to work in this inspiring space (cick) that includes a green screen room, sound room and work spaces desiged to encourage creativity and collaboration. If you want to see more about us and our work space (click) here is a QR code you can scan. So, in addition to creating resources for regular courses, our team was tasked back in 2013 with creating CDUs first MOOC. Now who here works at a University or organisatino that has created a MOOC? Who has worked on developing a MOOC? Has anyone ever participated in a MOOC? Well.... It was exciting, but we soon learned.

5

Making a MOOC is like moving a mountain.

~Arie K. DenBoom , Coordinator of the first University of Amsterdam MOOC6

Through the design, development and delivery of three very unique MOOCs, our team gained extensive knowledge, skills and appreciation for what goes into the making of impressive, innovative, award winning MOOCs. Though all three were vastly different in approach, the common brief was that they must be: Innovative and First of their kindHighly engagingPush the boundaries of what is possible Be comprised of primarily original material and content 6

7The MOOC Team that Moved 3 Mountains

Team Leader- Alison LockleyBusiness Manager- Helen RysavyMOOC Coordinator- Karin Pfister3D Animator, Multimedia, Video Production- Dan HartneySound Technician - Jack TinappleWeb Programmer - Matt ElveyVideo Editing Erin Lawson, Paula WilsonSubject Matter Experts, Course AuthorsOLT Team Member- Learning Design

Basically we had a team of 9-10 people working on our MOOCs with varying levels of involvement. Keep in mind we were developing the MOOCs, sometimes more than one at a time, in addition to all of the other projects we were meant to be working on for internal core units at the University. In developing the MOOCs, the team made a conscious decision to create mot of our own original content. This decision was based on several factors, including the desire to create MOOCs with our own unique style and pespective, issues with the us of existing content under Australia copyright law and the need for a range of interactive resources that were not readily available or did not exist. Creating our own content enabled the repurposing and integration of resources into existing credit-bearing units. Now before I get too far into this presentation, I want to be sure that I address your curiosities during our time together- so are there any questions you have upfront I want to be sure that I dont go on an on about things you are not interested in and make sure I hit the mark to address the reasons you came to this session. (Write Qs on whiteboard or butcher paper to be sure I address later)7

8Overcoming Roadblocks and Challenges

Doubts/ concerns from faculty about the benefits of providinga free learning experienceSecuring a budget to promoteand market the MOOCsPrioritising the time required to develop the contentLanguage barriers with collaborators(Accounting MOOC)

So sometimes it felt a bit like this, with crocodiles swimming around us It was easy to get bogged down in the enormity of what we were doing.... Some of these challenges included (Click) These challenges were overcmoe through patience and persistence.8

9ADDIE and SAM- Instructional DesignInformation GatheringSavvy StartCollaborative Brainstorming

So, with our friends ADDIE and SAM we began the journey... Creating 3 MOOCs in 3 years. 9

10The Making of a MOOC

BenchmarkingBrainstormingConcept DesignPrototypingReviewDesign IterationsProduction MeetingsTestingTroubleshooting........

The process ended up looking a little like this (the prototype, review, design iterations here in the middle) In the initial concept meeting or meetings, we brainstorm and come up with lots of crazy ideas of what we want the MOOC to look and feel like. Prior to this meeting I will have done some benchmarking, seeing what already exists. 10

11

Raw Content

So, lets begin- After the initial concept meeting with the entire team, the SME would write the content, .then submit for review to a head of school, when its been approved and gets submitted to me, and it looks something like this. Weve all seen it, traditional Word docs, PDFs textbook material. NOT MOOC-ISH at all.11

12Mapping the Content

So I begin my magic MOOCIFYING PROCESS. I take the raw content and start doing something like this imagining what would be good as a video, what is suited to a tutorial, or an interactive, or a branching scenario...12

13Storyboarding the Content

Now some of the digital media we create will require storyboarding, especially for our Storylines or Branched scenariosI sometimes sketch this out by hand or do it electronically in a PP, as long as you are communicating the visual aspects, the interactions and any scripting or links that will be included.... At this stage we begin to have weekly or every other weekly production meetings wtih the subject matter experts- they are very much a part of each step of the development stage. 13

14Scripting the Videos

If a video is needed, it needs to be scripted with all visual descriptions as well as the narrative, to take it from this to (click) this. 14

15Creating the Videos

Creating video is definitely the most costly and time-consuming way to present the content, but we have all the equipment needed for creating high end, quality professional video and we experimented with different types and formats of video content, learning a lot along the way about what hits the mark for optimal learning. We have learned that short and sharp videos are best ideally around the 3 min mark or less.15

16Creating the Videos

16

17Massive Open Online Course- MOOC

In our greenscreen room we will have an actor, or sometimes just a nonqualified team member like myself the actor will learn their lines and be directed by our video production team, and then Dan our magic man will design amazing settings and backgrounds for the final cut. Being a video animator comes in handy for some of the crazy ideas the team comes up with to portray dry content like The Accounting CycleSo you can see here that having the skills in the team to create dynamic, engaging video comes in handy and we have a lot of fun in the process....17

18Creating the Interactives and Animations

18

19Creating Formative Quiz Questions and Assessments

19

20Testing

On-campus studentsStaffH.S. studentsTarget audience representatives

During our testing phase we utilised on campus students, staff, h.s. students, chinese students etc. who came into our studio to do live testing under observation- cannot stress the importance of this enough as we learned so many things that we wouldnt have known otherwise. We used a variety of methods for each of the MOOCs, including Google forms, paper based forms and of course observation and discussion as the testers worked through the MOOCs. 20

21Promotion MOOC Lists and Catalogues

The MOOC ListClass CentralOpen Education CatalogueCD MOOCMEM MOOC

You can see from these results from two MOOCs we launched, the MOOC listing is where most MOOC participants go to find out what MOOCs are on offer- so I make sure I get our MOOCs listed early in these places.

21

22Promotion- Social Media

Having an active Social Media campaign is desirable for your MOOC promotion- we have found that a week before launch date is a good time to start posting and then continue throughout the entire MOOC. We used FB and Twitter accounts to promote.. CDU accounts plus individual schools set up FB pages for discussions and sharing. We also have various budgets that were used for Google Ads, FB Ads, etc. 22

23Promotion- Blackboard Social Media

TwitterFacebook

23

24MOOC Delivery-

During our MOOC delivery we were sometimes running the live webinars, moderating discussion boards, or answering emails sent to our MOOCs inbox. WE have experimented with different delivery timeframes, from as little as 4 weeks to as long as 10 weeks. We pretty much run all MOOCs now around the 6-8 week delivery timeframe as we found from experience that this seems to work the best. 24

25Evaluation and Reporting

Tools used:Open Ed Analytics and ReportsGoogle AnalyticsGoogle Forms YouTube AnalyticsSocial Media AnalyticsSharestream Analytics

During the MOOC delivery and then after closure, we used a range of tools to collect and interpret diverse data on access, activity/ engagement including the reports and analytics tools available from Open Education as well as Google analytics, surveys, Google Forms, YouTube analytics and even Social media analytics. After each MOOC running I create a report that collates, synthesizes and interprets the data from these analytics tools.25

26Space to Innovate Blackboards Open Education Platform

Leveraging:

flexibilityinteractivityexpertise

We chose to host our MOOCs on Blackboards Open Education platform for a number of reasons:Since our university is already a BB client, it was free- as opposed to a very large cost involved in utilizing other platformsIt was a familiar platform for our lecturers to use, easy for them to get in there on the discussion boards, make announcements and build content when needed.It was a familiar environment for our students who were taking the MOOCs, or any potential students who may then become enrolled at CDU.The resources developed for the MOOCs could easily be used in our other courses, and we would have the experienced any complexities or nuances of adapting them for full functionality in this platform.Troubleshooting and help, fully supported by the BB Open Ed team- who have been wonderful and highly prompt in their responses. Allowed open authentication and self-enrolment. Part of the purpose of todays talk is to showcase how we have used MOOCs as spaces to experiment with innovative technologies and how you might use this to gain ideas for leveraging interactivity and the Blackboard LMS to improve teaching and learning in your own online space. Since our MOOCs are not aligned with any particular course requirements, this provided a space for more flexibility and allows for creativity to flourishAll of our MOOCs were designed to be firsts of their kind- as in- we would benchmark and see what was already out there. And we designed them to leverage this environment (click) flexibility, (click) interactivity, and (click) expertise.. Meaning our digital and educational expertise , as well as bringing in expertise from the outside (next slide) for example Professor Janet Browne, Charles Darwin Scholar for the CD MOOC webinars

26

27Leveraging Expertise

Charles Darwin MOOCPeter and Rosemary Grant, PrincetonJonas Von Essen, Memory MOOCAlex Malley, Accounting MOOCDr. Simon Moss, Associate Prof Psychology

Prof Stephen Garnett, Charles Darwin MOOC

for example Professors Janet Browne from Harvard and Professors Peter and Rosemary Grant from Princeton, Charles Darwin Scholars. They presented in webinars for the MOOC and have guest appearances in the MOOC Jonas Von Essen, Two time World Memory Champion, hosted our Memory MOOC, and Alex Malley CEO of CPA Australia makes a guest appearance in the Accounting MOOC.Its worthwhile to consider how you can bring in world experts to make your content come alive, whether that be in video form, video conferencing with the class over Skype or collaborate in which you can put the recording into your course, social media interactions, etc.

27

28Leveraging Interactivity

Wherever possible, when the content lends itself to be interactive, I try to envision how the learner has to physically DO something with the content to create a more active rather than passive learning environment. For example, fill in an income statement, explore what happens to assets, equity and liabilities via a slider interactive, or virtually listen to what several pseudo accountants have to say about a how to record a company paying off a debt, and then deciding who is correct. Rather than passively reading what they each have to say, the learner has to physically explore their views and then make a decision. (go to this interactive). We can even lose learners attention during a video so adding in a question here and there that the learner must answer to continue is handy.

28

29Interactive Video

We can even lose learners attention during a video so adding in a question here and there fot the learner to answer to continue is handy.

29

30Interactive Timelines

Make one for your online course:https://timeline.knightlab.com/

30

31Branching Scenarios

We have created Programmed branching scenarios (as in our Remote Sensing project for environmental studies) or we can create branching scenarios utilising Storyline software that anyone on the team can create without having to be a programmer. Storyline integrates nicely into the Open Ed platform. You can play around a bit more with gamifying content in storyline by adding choices, progress bars, and characters. 31

32Gaming ElementsChoice pointsProgress barsCharactersBadges

The integration of Storyline into the Open Education platform also lends itself to adding in more gaming elements to your course, so we experimented with (click through) From those participants who responded, on average around 38% stated that earning a badge was an important motivator for them to complete the course. This percentage was as high as 67% for our first MOOC and as low as 20% in our Memory MOOC. 32

33Interactive Immersive Environments

Our team has been experimenting with virtual reality and 360 degree panoramas, especially for our Virtual Health Precinct project in which we have virtual labs. Inside these panoramas there are hotspots that when clicked bring up video scenarios, tutorials or tasks to complete. (Lets have a look inside- cut to tab open inside Lab)33

34Interactive Immersive Environments

This has been very effective for external students, who often miss out on the face to face lab exercises or field studies, and can now conduct experiments or sampling virtually. We used the Memory MOOC to test out some of the capabilities of what might be possible. 34

35The Memory MOOC

Special Features:Initiated by FacultyHas been run 3 times with over 1400 participants27 original videos, 11 interactivesCourse completion badge and certCreative, fun, immersive approachUse of Social Media hashtag to link conversationsUse of Psychology in Darwin FB page to promote and discussUsed as a whole course for 2 Psychology units

35

36

Charles Darwin, Evolution and Tropical Australia MOOCSpecial Features:Initiated by executiveHas been run 3 times with over 800 participants39 original videos, 10 interactivesAward Winning MOOC- BB Catalyst Award for Exemplary Course and Directors Choice AwardCourse completion badgePersonal, warm styleLive webinars with content expertsDiscussion Forums moderated by SMEUse of Social Media hashtag to link conversations outside of the MOOCAssets incorporated into regular coursesCourse content is also on iTunes U

Our first MOOC has been run three times as well with over 800 participants. This MOOC won Blackboards exemplary course award, Directors choice (wording..) The first two times it was run live as in, live discussion boards and live webinars. The third time we ran it without the webinars and no live discussion board. This decision was based on availability of human resources to run the course live. This MOOC was developed to leverage the Charles Darwin Universitys namesake and showcase CDUs stellar environmental research. It was initiated by executive. Feedback from participants was overwhelmingly positive- and many commented on the personal, warm approach of this MOOC, like they felt they were in the room with the experts. Lets have a look inside. This MOOC is jam- packed with content. Lets look at some of the lovely video work (look at intro to course vid with Steve Reynolds) and then the Finches Interactive, Part 2 content, Galapagos Finches. 36

37Whos Counting: An Interactive Introduction to Accounting

https://www.cdu.edu.au/moocs/accounting

Open Now!!Enrol:Special Features:Initiated by executiveHas been run 2 times with 782 participants- Open Now!30 original videos, 9 interactives8 TutorialsCourse completion badges and certSexy, funky approachUsed as a whole course internallyMOOC on a stick for remote areas with no internet

This MOOC was an experimental collaborative project between CDU and its Chinese partner Anhui Normal University. This MOOC had some unique objectives, includingTo promote Accounting as an exciting career choice and attract students to study accounting at CDUTo promote CDU among potential students in ChinaTo fill a need that existed globally for high quality fun interactive online learning in the field of AccountingTo trial working collaboratively with our Chinese partner universityInnovation objectives- to experiment with scenario based learning, characters, branching in storyline (click) This MOOC was an executive initiated project as opposed to a faculty or school initiative like the other two MOOCs. It has been run twice and is currently open if anyone would like to enrol- Open until September 27. Go into platform and show cycling video in Module 1 Part 3 (first video)37

38

So as you have experienced and seen now, all three of our MOOCs were very different, initiated in different ways, designed in vastly different ways, with completely different purposes and outcomes. This has provided our team and university a unique perspective on this type of Open Learning and MOOCs in particular. 38

39Lessons Learnt

We had some really really great ideas along the journeys, or what we thought were great ideas.. From putting our Memory MOOC champion into the Cage of Death to memorise material under pressure, (that was a great idea!) to ... Pub/ memorising drink orders, which ended up here in our banishment room of good ideas gone bad.... 39

40Lessons Learnt: Translations and Transcripts = Time

We hired a translation company . Found out later we had the expertise in house... Had students and lecturers check translations and make amendments. Could have saved a lot of money by paying students to do the translation work and with better, more contextual results. Time and support for language checking .....40

41Lessons Learnt: Regular review checkpoints during development

Be Agile: regular production meetings with SMEs, target audience, stakeholders, etc. This provides the client with plenty of opportunities to provide important feedback early on. This will also minimise the amount of re-work or changes that will need to be done. 41

42Lessons Learnt: Clear communication is essential

Source: Gawker.com

Working with collaborators who do not speak English and are from very different cultural backgrounds can be very difficult and time-consuming- so be prepared for miscommunications, misunderstandings and delayed problem solving! Written and verbal comms between all stakeholders is so important. We used project wikis to communicate and keep track of all aspects of the projects.

42

43Lessons Learnt: Open Ed has no beta-tester role

No beta testing role available in the Open Ed platform so our work around was to open a course temporarily but not publish it to the Open Ed catalog, and put a big announcement on the landing page that the course was only open temporarily for testing. We found that the Preview mode does not give accurate performance results. 43

44Lessons Learnt: A sprinkle of announcements boosts engagement

MOOC engagement spikes after an announcement is sent out in emails with a link to the course- but dont send out too many. We found that one on the opening day, one half way through and then one a few days before closing (with a reminder to fill in the course feedback) seems to work well. 44

45Lessons Learnt: People dont like filling in surveys

We were hoping to gain all kinds of information from our participants but we found that very few were taking the time to fill in the feedback. In our first running of our first mooc there was a pre-course survey and a course feedback. We have gotten much better results by putting a google form with two questions on the landing page. We are finding that almost all participants will quickly fil this in- no extra clicking to go through to get to the survey and its quick and painless- we ask How did you hear bout this course? and What are your goals/ reasons for enrolling in the course. We used to ask what country they were from but then found that this information is available via the Open Education Admin panel on Download enrolment data 45

46MOOC Success: Creative, Synergistic Team Required

And a major lesson learnt is you need a cohesive, energetic, synergetic, creative team- so positive team building activities built into your work processes go a long way to preserve the momentum and morale as you work through a major project like a MOOC.46

47Opportunities for innovation in the MOOC SpaceIncrease and enhance resources for direct integration into regular university coursesLecturers gain knowledge and skills on what is possible in the BB platform Enhance lecturers knowledge of cutting edge technologiesEnhance outreach and visibility on a national and global stageExperiment with innovative approaches and technologiesA new way of attracting and interacting with potential students Establish your university as a participant in the Open Access movementPartnerships and collaboration within and beyond your organisationOpens pathways for RPL

So you wonder, all this work and money, What benefit are MOOCs to the University which has heavily invested resources into their creation?A common benefit of all three MOOCs for CDU was the knowledge and skills gained by our team and the lecturers we worked with in seeing what was possible in the Blackboard platform. This resulted in all three cases in enhanced resources for direct integration into regular university courses, lifting the standard for many of our online courses. Another residual benefit was the effect that the development of these MOOCs had on the SME, our residential lecturers. By being interwoven and directly involved in each step of the design, development and delivery processes, they gained a deeper understanding of the content an and increased proficiency in the features and potential of the BB learning platform that they use for their regular olnine courses. They also gained an enhanced knowledge of cutting edge technologies, which enabled them to envision and employ these technologies into their courses. Word also spreads among staff and now we have many other courses utilising similar strategies, tools and high end resources for their courses.47