DARM 2013: Assessment and decision makingMikko V. Pohjola, Nordem Oy, (THL)

Presenter background

• M.Sc. (tech), University of Oulu, Industrial engineering and management, 2006

• PhD student, University of Eastern Finland, Environmental health / SYTYKE, 2007-2012

• Researcher, National Institute for Health and Welfare (THL), 2006-2011

• Research consultant, Nordem Oy, 2012->

– Also former work experience in consultancy entrepreneurship as well as industry

Contents

• Some practical things

• Homework 1 - basic concepts

• Effectiveness of decisions and decision support?

• Expert roles?

• Aim: to understand the big picture on this course

• (in order to understand how the more detailed/practical parts relate to the course topic as well as to your expertise)

Homework 1

• regulatory and academic assessment approaches?

• traditional and novel assessment approaches?

• relevant stakeholders?

• effectiveness?

• decision support?

• pragmatic knowledge service?

• role of modelling?

• framework for effective assessment and knowledge-based policy?

• intentional artifacts?

Concepts

• Assessment – knowledge support for practical needs

• Policy – decisions and actions with societal relevance

• Practices – (common) ways of dealing with things

• Effectiveness – capability (or likelihood) of achieving intended outcomes

• Evaluation – analysis of the capability (or likelihood) of achieving intended outcomes

Decision analysis & risk management?

Extrapolation

Measurements and population characteristics

Hazard identification

Dose-response assessment

Exposure assessment

Risk characterization

Regulatory options

Evaluation of options

Decisions and actions

Risk assessment

Risk management

Observations

Policy makingAssessment OutcomesImplementation

Assessment & decision making?

Basic problem

• Lankinen, et al.: State research institutes and research funding: proposal on a comprehensive reform:

– “Preparation, decision-making and implementation of policy should be based on researched information and evidence.…the use of research-based information in social policy decision-making, must be strengthened”

• If we want policy to be ”knowledge-based” and ”effective”…• …what constitutes effective knowledge-based policy?

• and effective knowledge support to policy making?

Common perspectives to effectiveness

•Assessment (and modeling)•Quality assurance / control•Uncertainty analysis•Technical assessment of models•”Effectiveness”•Other

PolicyOutcomes (vs. objectives)Behavioral responses + CBAMonitoringEx ante – ex post evaluationFactors limiting implementation

Process UseOutput

Constraints

Outcomes

Context

Modelling/assessment

Enablers

Framework for knowledge-based policy

Policy makingAssessment OutcomesImplementation

(Knowledge) practices

Evaluation &management

• Design• Execution• Follow-up

• Process• Product• Use• Interactio

n

Framework for knowledge-based policy

• Focus on knowledge support to decision making– Decision makers' needs?– Societal needs?– Other needs?– Expert knowledge– Local knowledge– Opinions, views, perspectives, values– → collaborative search for questions and

answers

Engagement & Interaction

Collaboration & openness

Framework for knowledge-based policy

• Evaluation and management of effectiveness -> proactive guidance of decisions and actions both now and in the future

– Transparency & effectiveness• Dimensions of openness• Properties of good assessment• Relational evaluation approach

Transparency & effectiveness

• Dimensions of openness– Scope of participation– Access to information– Timing of openness– Scope of contribution– Impact of contribution

Transparency & effectiveness

• Properties of good assessment– Quality of content– Applicability

• Relevance• Availability• Usability• Acceptability

– Efficiency

Evaluation & management

• Relative evaluation approach– Co-development of practices– Multiple perspectives– Evaluation of– Plan– Implementation– Outcomes

Conclusions• Pohjola M.V.: Assessments are to change the world - Prerequisites

for effective environmental health assessment:– Common practices of environmental health assessment are insufficient.

Policy decisions are not based on best available knowledge.– Collaboration, openness, practical problem framing, application of

science also in development of solutions is needed in assessment-policy-society interaction.

– Methods and tools of assessment as well as public attitudes already enable open, transparent and collaborative policy support. A cultural change in assessment and particularly policy making is still required.

– The focus of future development shall be set particularly on developing practices of effective use of knowledge in policy making.

What is the role of experts (like you)?• Research, background knowledge• Substantive expertise, expert knowledge for

assessments• Facilitation of decision support?• Opinions, lay person views?• …?

Got answers now?

• regulatory and academic assessment approaches?

• traditional and novel assessment approaches?

• relevant stakeholders?

• effectiveness?

• decision support?

• pragmatic knowledge service?

• role of modelling?

• framework for effective assessment and knowledge-based policy?

• intentional artifacts?

Thank you!