Beyond Logic Models:Beyond Logic Models:Evaluating Complex Evaluating Complex Emerging ProgramsEmerging Programs

Sarah Baughman

John Dorner

Karen Jeannette

eXtension

http://www.extension.org/militaryfamilies

http://blogs.extension.org/militaryfamilies

• Anne Adrian

• Sarah Baughman, Evaluation Specialist

• Bob Bertsch

• Peg Boyles

• Kyleen Burgess

• Chris Canjar

• Thomas G. Coon, Administrative advisor

• John Dorner, Vice-Chair

• Brent Elrod, National Program Leader

• Kevin Gamble

• Diana Hagan

NetLit Steering CommitteeNetLit Steering Committee

• Connie Hancock

• Amy Hays

• Karen Jeannette

• Stephen Judd, Chair

• Jim Langcuster

• Kristen Mastel

• Rich Phelps

• Jerry Thomas

• Terrence Wolfork

• Barbara Woods

Image Credit: http://www.flickr.com/photos/info_grrl/6862478946/in/set-72157629286123040/

Image credit: http://www.flickr.com/photos/kelvin255/3518359517/

How do we plan to measure outcomes when we aren't sure where we are going?

Developmental Evaluation adapts to Developmental Evaluation adapts to the realities of complex nonlinear the realities of complex nonlinear dynamics rather than trying to impose dynamics rather than trying to impose order and certainty on a disorderly and order and certainty on a disorderly and uncertain world. uncertain world. – Michael Quinn Patton– Michael Quinn Patton

Evaluation ProgressEvaluation Progress

Steps along the way

internal evaluator with eval committee

establishing the framework

developing initial evaluation questions

surveying steering committee for sensitizing concepts

reflective practice

Reflections to Reflections to move us forwardmove us forward

Participating in online networks is an essential skill for our increasingly inter-connected world. Network Literacy is the ability to leverage technology to create connections with other people and/or organizations in a virtual space.

http://www.flickr.com/photos/foxypar4/

• Networks are powerful• Participating in networks has opened opportunities for

creating stronger relationships resulting in professional collaborations

• Learning, co-learning, and active learning all happen with participation in networks

• Comfort level increases through active participation in networks

• Need for recognizing barriers to participating in networks

Image credit: http://www.flickr.com/photos/mag3737/

What role can we play? What role can we play? • Role model good online teaching• Leveraging individual CoP member networks to

create impact within the system• Leader in defining, creating best practices for online

learning and extension education• Serve as “technology stewards” for CES by showing

how tools and approaches can address challenges.• Strategic efforts to leverage our networks around

specific events

Roles we can playRoles we can play

• Hold national level online conversations about cooperative extension that are open to the public to raise awareness of cooperative extension programs.

• Support the efforts of others within Extension working to build network literacy.

Next StepsNext Steps

• Discussion results of reflective practice with the steering committee

• Engage entire CoP in more specific plans to more forward

• Continue to document our work

What we’ve learnedWhat we’ve learned

• Time consuming, challenging approach

• Stakeholder involvement has been difficult to get

• We are making progress in individual learning networks

• Increasing engagement and interaction outside of CoP membership

What we’ve learnedWhat we’ve learned

• Time consuming, challenging approach

• Stakeholder involvement has been difficult to get

• We are making progress in individual learning networks

• Increasing engagement and interaction outside of CoP membership

Harold Jarche: www.jarche.com

Listening SessionListening Session

• Offer a chance to invest

• Opportunity to identify themes (sensitizing concepts to work from)

• Create opportunity to request specific contributors/contributions

• Provide tighter direction for future educational offerings (webinars, blog posts, etc)

Themes can help identify contributors Themes can help identify contributors and “community indicators” and “community indicators”

• Can we provide programming that responds to themes and increase:– #new contributors– # contributors from state systems– # contributors from external learning

networks– Repeat visitors, contributors

Contact Information Contact Information SarahBaughman

@programeval

sarahbaughman@extension.org

John Dorner

@jdorner

jdorner@extension.org

Karen Jeannette

@kjeannette

Karen.jeannette@extension.org