mindy hernandez, innovator in residence, cfed senior researcher, ideas42 cfed assests learning...
TRANSCRIPT
Mindy Hernandez, Innovator in Residence, CFED
Senior Researcher, ideas42
CFED Assests Learning Conference September 23, 2010
Behavioral Economics 201:
Applying Behavioral Research to Asset Building Initiatives:
Lessons From a Year of Experimentation
Demand
Cost Hassle
Embarrassment$
Demand
Hassle
Lots of hassle
Pretty easy
Demand for New Savings Product, SuperSave
50 500
“psychological subsidy”
From a behavioral perspective
The CFED Innovation Year Connect with great partners
Target the highest value challenges
Understand the context
Design and implement an intervention
Evaluate and learn
Process: Understanding the Context
A Note on Methodology
Outcome
Evaluation
Quasi-
experimental
Rigor
Confidence
Experimental
Increasing preparedness at tax time for self-employed clients: Campaign for Working Families (CWF) & Foundation Communities Austin, TX (FC)
Increasing take-up of savings products and public benefits at tax time: CWF
Increasing the use of direct deposit and savings accounts: Bank On DC & the Summer Youth Employment Program
2009-2010 Innovation Projects
PlusConsumer Credit Counseling Services
of the Delaware Valley (CCCSDV)
Increasing debt counseling attendance
Increasing response rates to surveys
These projects were supported by the Annie E. Casey Foundation
Emerging Lessons: What Seems to Make a
Difference
Simplification is key
Well designed reminders help
Behaviorally-informed incentives can make a difference
Simplify
CCCSDV
CCCSDV - Debt Counseling
Increased financial stability
Recruit clientsClients come for debt counseling
Complex form
Clients receive financial counseling
Simplify Form
60%
CCCSDVOriginal debtCounseling
Letter
Plus 5 pages Of financialworksheets
CCCSDVRevised debtCounseling
Letter
Zero worksheets
Results
n= 584
38% 43% 37%
24% 20%
QE Design
Well Designed Reminders Help
CWF Preparedness & Foundation Communities
CWF: Preparedness at Tax Time
Increased tax refunds
Encourage/educate clients to prepare Clients prepare
Hassle, stressful, time-intensive
Make a planSend reminders
Clients havepaperwork needed
for tax day
Does Tax Preparedness Matter?
n= 259
Irene Skricki1234 Maine StBaltimore, MD
Irene Skricki1234 Maine StBaltimore, MD
Complete excel sheet!
Find train receipts!
Call Comcast for copy of internet bill
Irene Skricki
April1, 2010April 5,2010
Control Treatment
(mean) refund_less_eitc (mean) refund_less_eitcrefund_hi/refund_lo
Preparation of Filers
Results
n = 41
Tax refunds Without EITC for SETI Clients at CWF - 2010
$241
$1,837
+$1,596
Experimental Design
Impact DiscussionThe findings are potentially very powerful. This
was a small sample; more research needs to be done.
In statistical analyses, the two groups seem to be random and similar. There are no statistically significant differences between the two groups.
In adjusted analyses, we find the treatment seemed to have a significant effect.
Behavioral IdeasReminders can act as channel factors, nudging
us toward our desired intention.
• Consistency: We like to appear consistent to ourselves and others
• Public accountability: We are more likely to follow through when we have told others of our intentions
• Planning (Implementation intentions): Detailing the steps needed to implement our goals helps
Foundation CommunitiesBusiness Class Enrollment
Increased businesscapacity & income
Advertise ClassClients enroll in
class
Depletion, Overload
Clientsattend class
Send reminders
Do Reminders Matter?
Impact DiscussionLetters did seem to significantly increase interest and
enrollment.
Additional postcards didn’t seem to make a difference.
Letters were especially helpful for those who did not receive a a refund: tax filers who received a negative refund and a letter were significantly more to express interest or attend a class compared to similar filers who did not receive the letter.
Experimental Design
Behaviorally Wise Incentives
CCCSDV
CCCSDV- Survey Response
Improved DMP Program
Send surveys- incentives
People complete surveys
Hassle, time-intensive
Send pre-incentives
CCCSDV able tolearn from clients
88%
Why Pre-incentives Work
Survey completio
n
Survey completio
n
ResultsSurvey Response Rates at CCCSDV
n =968
Experimental Design
Implementation Lessons Learned
Expectations. Sometimes we see big, exciting effects but most interventions have modest results- even these can be valuable.
Evaluation. There can be tension between learning & impact
Staff. Program staff are the single most important element to implementing a successful intervention.
Time. Even simple interventions require significant program staff time- in both design and implementation.
Implementation. Pay attention to the right intervention point: Build on current processes. Details Matter.
From Theory to Application
Early challenges
to traditional economic
Model(Early 1900s)
Breakthrough behavioral research
(Kahneman and TverskyProspect Theory, 1979)
Large-scale applied Behavioral pilots
Applied in the field with great success(Save More
Tomorrow; 2001)
Today:Testing
in the field
Administration for Children & Families BIAS
Project2010
Case Study: Foundation Communities
Linda Paulson, Tax Services Coordinator
What I Learned as a Practitioner Research Partner
There is a new way to look at data
Allocate enough staff (not just volunteer) time. Make sure you have the staff capacity and data resources dedicated to the project.
Find easy ways to collect data that can be built into current data collection systems (tax wise or survey monkey)
Next Steps for Foundation Communities
Look into cost effective ways to send reminders (email and text)
Use preparedness data to target unprepared clients and offer one-on-one coaching for preparedness
Case Study Campaign for Working FamiliesA program partner of the Urban Affairs Coalition in
Philadelphia, PA
Megan Kiesel, Director of Impact and Outreach
What I Learned as a Practitioner Research Partner
Think about overall program design
Think about implementation (not just what services you’re offering but how are you offering those services?)
Think about how to make small changes in current processes
Find a research partner- speed dating at the ALC is a great opportunity! CFED is also collecting names for the future.
Next Steps for CWF
Continue partnering with researchers to conduct formal experiments with more intention and staff support
Continue to integrate behavioral changes into larger program design
Final Thoughts: What Now?Create you own map: What are the key goals? Put yourself in
your clients’ context- where are the chutes? Potential ladders?
Read Nudge (Cass & Sunstein) and Influence (Cialdini)
Be realistic & prepare: Do you have the staff, data and time?
Connect with great research partners (CFED can help!)
Big picture: continue the conversation: how can we continue to connect great researchers to big problems and great practitioners?
Learn more on the the blog:Cfed.org&Watch out for the white paper