nm community survey
TRANSCRIPT
![Page 1: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/1.jpg)
Pacific Institute for Research and Evaluation www.pire.org
NM Community Survey
Data Collection Training
February 9, 2021
1
![Page 2: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/2.jpg)
Photo credit: TruScribe
You are experts in your own communities
![Page 3: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/3.jpg)
Agenda
• Important Dates for your Calendar
• Why We Survey
• Changes to the Survey for FY 21
• Changes to the Data Collection Process for FY21
• Protocol Development
• Budget Reminders from OSAP
• Data Entry and Analysis
• Contact Us3
![Page 4: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/4.jpg)
Important Dates for Your Calendar
February 16- First draft of data collection protocol
due to PIRE
February 17-22 - PIRE internal review of data
collection protocols. PIRE will work with sites
individually to prepare protocol for SEOW review
February 19-25 - SEOW reviews
February 26 - PIRE works with communities to
finalize protocols
March 1- Data collection may begin with approved
protocol and online survey goes live4
![Page 5: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/5.jpg)
Important Dates for Your Calendar
• Mid-March TBD - Data Entry Training
• April 30 - Data collection ends
• May 7 - Data files (for paper surveys) are due
• June 1-15 - PIRE returns aggregated data files to
LEs
• Late June - PIRE returns R-reports (if resources
available)
• July 15 - All EOY reporting documents submitted
to OSAP
5
![Page 6: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/6.jpg)
6
NEW MEXICO COMMUNITY SURVEY (NMCS)
WHY WE SURVEY
![Page 7: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/7.jpg)
What is NMCS?
• Gathers state- and community-level data on ATOD and
prescription drug use
• Evaluates effectiveness of locally implemented
environmental strategies on intervening variables and
outcomes
• FY 2020-11,774 surveys; 75% online
7
![Page 8: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/8.jpg)
How Will the Data be Used?
• Programs and communities to assess local needs and track
changes over time in key prevention areas
• OSAP to track changes in ATOD use & IVs over time at a state
level
• State agencies to improve & increase prevention services to all
New Mexicans
• SEOW (State Epi Outcomes Workgroup) to monitor and track
local progress
• PPC (Statewide Prevention Policy Consortium), & PDO
Advisory Board to encourage alignment of goals among state
agencies
• How do you use the data? 8
![Page 9: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/9.jpg)
The NM Community Survey
• Sample: Adults 18 years and older living in
NM
• Goal = collect reasonably representative
sample of adults in the community
March 1-April 30, 2021 (9 weeks)
9
![Page 10: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/10.jpg)
10
NEW MEXICO COMMUNITY SURVEY (NMCS)
CHANGES TO THE SURVEY FOR FY21
![Page 11: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/11.jpg)
BIG, Ol’,
CAVEAT
11
![Page 12: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/12.jpg)
The NM Community Survey-
Core + 10 Optional Modules
• Core (38)
• adverse childhood
experiences (ACEs)
(12)
• college community (1)
• community alcohol-
related harms (10)
• gambling (5)12
• marijuana (15)
• mental health (12)
• methamphetamine (7)
• additional opioid questions
(9)
• poly-substance use (6 for
PFS-20; 2 for all others)
• tobacco (7)
![Page 13: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/13.jpg)
Changes to NMCS in FY21
Mostly online; online recruitment focus
expanded at state and program levels
• Core
•Mental Health
•Limited changes to Community, Marijuana,
and Meth Modules
•New PFS20 Module
13
![Page 14: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/14.jpg)
The NM Community Survey- Core
• 38 questions (paper/offline Qualtrics
survey)
• Covers the following topics:
– Demographics
– Perception of ATOD within the community
– Alcohol consumption & access
– Prescription painkiller use & access
14
Online survey link = Core + 2 Poly-substance
use (30 day meth and polysub use)
![Page 15: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/15.jpg)
Changes to the Core
Are you?
Do you think of yourself as?
What sex is listed on your original birth
certificate (sex assigned at birth)?
15
![Page 16: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/16.jpg)
Changes to the Core
Do you identify as LGBTQ?
Which of the following best describes how
you think of yourself?
16
![Page 17: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/17.jpg)
Changes to Mental Health
Anxiety
Poor physical or mental health keep you
from doing your usual activities, such as
self-care, work or recreation?
At any time in the past year, did you think
about killing yourself?
2 suicide questions17
![Page 18: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/18.jpg)
Changes to Community Alcohol
Harms Related Module
In your opinion, when is it okay for someone
to provide alcohol to minors (i.e., under 21)
(not for religious purposes)?
Moved from Core to Community Module
18
![Page 19: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/19.jpg)
Changes to Marijuana Module
Have you ever used marijuana?
Have you used marijuana in the past 12
months?
I support local law enforcement actions to
prevent driving under the influence of
marijuana.
19
![Page 20: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/20.jpg)
Changes to Meth Module
Have you ever used methamphetamine?
Have you used methamphetamine in the
past 12 months?
20
![Page 21: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/21.jpg)
Photo credit: Pixabay
Photo credit: Chris Yates
21
Take a Minute…
Questions?
![Page 22: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/22.jpg)
22
NEW MEXICO COMMUNITY SURVEY (NMCS)
CHANGES TO DATA COLLECTION
PROCESS FY21
Data is collected online or in-person
New Mexican residents only
18 or older
1 submission per person
![Page 23: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/23.jpg)
23
![Page 24: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/24.jpg)
Minimum Requirements for In-Person
24
![Page 25: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/25.jpg)
Recruitment Ideas
25
• Visual Media
• Direct Mail
• Social Media
• Partnerships
• Working with Municipalities/Local Systems
You can spend money on these things!
See protocol for full descriptions and
examples!
![Page 26: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/26.jpg)
State-Wide Recruitment Efforts
• PIRE uses social media research and advertising to target
web-savvy participants in your communities.
• PIRE places and monitors Facebook & Instagram ads in
English and Spanish.
• Halfway through, we will begin zipcode targeting in areas
with low response rates
26
![Page 27: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/27.jpg)
State-Wide
Visual Ad
27
Who Needs Posters?
Who needs fliers?
How many?
Write us in the chat!
![Page 28: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/28.jpg)
Example of Social Media Ads
28
![Page 29: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/29.jpg)
Example of a Community Ad
29
![Page 30: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/30.jpg)
Example of a Very Effective Ad
30
![Page 31: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/31.jpg)
Discussion
Photo credit: Burst
![Page 32: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/32.jpg)
32
NEW MEXICO COMMUNITY SURVEY (NMCS)
PROTOCOL DEVELOPMENT
![Page 33: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/33.jpg)
Protocol Overview
• Every community must submit a data collection
protocol to PIRE
• Must be approved prior to collecting any data
33
![Page 34: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/34.jpg)
For those who have conducted the
survey in previous years…
• You must use the FY 21 form. It has changed A
LOT!
34
New to data collection? Welcome!
Email PIRE if you do not have access to your FY20 files.
![Page 35: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/35.jpg)
Data Collection Protocol seeks to
Balance Multiple Needs
• Safe data collection practices
• Seeking “randomness”
• Representative
• Culturally appropriate
• Provides voice to difficult to reach populations
35
![Page 36: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/36.jpg)
Who are You Sampling?
• NM residents
• 18 and over (oversample young adults)
• This includes:
– Spanish & English speaking
– Parents
– Elderly
– Undocumented & non U.S. Citizens
– College students
– All race/ethnicities
– Sexual & gender minorities 36
![Page 37: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/37.jpg)
Choosing Optional Modules
• You may choose to add any of the additional
modules to paper/Qualtrics offline or on-line.
– Remember how much additional questions increase
the time to take the survey, and choose wisely.
• NOTE: You may also add additional questions
pertaining to your evaluation needs*
– Questions must be approved by PIRE/SEOW and
must include a statement that questions are directly
from the provider and not OSAP. (See protocol
document)37
![Page 38: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/38.jpg)
Incentives for Participation
38
![Page 39: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/39.jpg)
To participate in the drawing….
39
![Page 40: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/40.jpg)
Incentives for Online Data Collection
• Online incentives are only available if the
participant takes the survey online
– No connection between your responses and your
information for the drawing.
– Only eligible to win the weekly incentive during the
week you completed the survey.
• Duplicate entries are not allowed. (We
remove duplicate entries from later drawings.)
40
![Page 41: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/41.jpg)
Start Planning Now for Data
Collection
While waiting for feedback on your
protocol, start getting your recruitment into
place.
• You may need to get permission to recruit in many
places
41
![Page 42: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/42.jpg)
Final Words on Data Collection
Protocol
• Remember that if you make a significant
change to your protocol after it has been
approved, such as adding a site or changing
an ad, you must let PIRE know.– PIRE’s IRB requires that we supervise data collection in
this way. If data collection occurs in other ways, it could
inadvertently incur a violation & all data collection must
stop for the entire state
42
![Page 43: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/43.jpg)
Pacific Institute for Research and Evaluation www.pire.org
OSAP Budget Slides 2021
![Page 44: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/44.jpg)
Budgeting for the data collection - from OSAP
• Same Process: Budget form is due Feb 19th
• to OSAP for review and approval
• I will do a walkthrough of those instructions separately from this training
• Any budget modifications must also be approved by OSAP
• Consider how and who completes data collection and data entry
• least expensive options preferable (e.g. volunteers)
• Actual cash incentives over $1 are no longer allowed, as per OSAP
![Page 45: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/45.jpg)
Covid adjustments
• **Gift cards/incentives should be limited to
the number of paper surveys expected
and cannot be used for other coalition
purposes**
• Since Covid is making most of the data
collection online
– recruitment and promotion will be bigger
sections of your budget this year (printing and
media)
– For any in-person paper surveys, think about
![Page 46: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/46.jpg)
An Important Word about Stipends &
Budgets – from OSAP
• Maximum stipend $2.50 gift card this year• Ask for in-kind/ donated/coupon incentives
– Pair with OSAP dollars only if no other options
• Good ballpark for stipends/incentives is $2, less is ideal!
• Focus on your elevator pitch
– On why data/ data collection is important
• Consider other options (e.g. Lottery style, raffle: donated
items/cards, store coupons, etc.)
![Page 47: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/47.jpg)
Stipends (FKA: Incentives)
• You don’t have to provide a gift to participants, but highly recommended:
– Gift cards work great but you must track every bit of money that is given for auditing purposes.
– Water, candy bars, healthy snacks.
– Not substance abuse, mental health, prescription drug, or alcohol related gifts, even if it is promoting the prevention coalition.
– Consider tracking different incentives to study what works best.
• You may not collect any personal or identifying information on respondents
• Can you get donated gifts, e.g., coupons?
47
![Page 48: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/48.jpg)
48
NEW MEXICO COMMUNITY SURVEY (NMCS)
EARLY LOOK AT DATA ENTRY AND ANALYSIS
![Page 49: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/49.jpg)
Data Entry and Analysis
• We will provide a training on data entry in mid-
March only for communities collecting
paper/pencil
• PIRE provides cleaned data file with all your data
combined from the on-line surveys and any that
are gathered in other communities.
• Your local evaluator will help you to create any
graphs or tables and Community Survey Findings
Sheet. 49
![Page 50: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/50.jpg)
Where else can NMCS information be found?
50
![Page 51: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/51.jpg)
51
NEW MEXICO COMMUNITY SURVEY (NMCS)
CONTACT US
![Page 52: NM Community Survey](https://reader030.vdocuments.net/reader030/viewer/2022012812/61c3c53463bd552643195d01/html5/thumbnails/52.jpg)
If you have questions in the field…
• Dave Currey 919-265-2622
• Ashley Simons-Rudolph - 919-622-5220
• Marissa Elias – 575-202-2232
• Kim Zamarin 505-907-0801
52