using the internet to enhance testing in counseling · test-taker’s parents or guardians...
TRANSCRIPT
![Page 1: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/1.jpg)
1
Using the Internet to Enhance
Testing in Counseling
James P. Sampson, Jr.
Florida State University
Copyright 2002 by
James P. Sampson, Jr.
All Rights Reserved
![Page 2: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/2.jpg)
2
Common Elements of Assessment
Selection
Orientation
Administration
Scoring
Interpretation
![Page 3: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/3.jpg)
10
Common Elements of Assessment
Selection
Orientation
Administration
Scoring
Interpretation
![Page 4: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/4.jpg)
11
Test Selection
• Identify potential instruments
related to client needs
• Select measure on technical quality
![Page 5: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/5.jpg)
14
Test Selection
• Download standardized descriptions of
potentially appropriate assessments
• Access links to published test reviews
• Cross-reference assessments with
literature on special populations
• Access links to test publishers to obtain
specimen sets or sample reports
![Page 6: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/6.jpg)
10
Common Elements of Assessment
Selection
Orientation
Administration
Scoring
Interpretation
![Page 7: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/7.jpg)
19
Test Orientation
• Delivered to test taker or
test-taker’s parents or guardians
– computer-assisted instruction
– frequently asked questions (FAQ’s)
• Theory-based or atheoretical
• Description of assessment process
• Orientation to self-assessment adds description of
circumstances where counseling may be needed
![Page 8: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/8.jpg)
10
Common Elements of Assessment
Selection
Orientation
Administration
Scoring
Interpretation
![Page 9: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/9.jpg)
21
Test Administration
• Access tests from password-protected publisher web sites
• Access self-assessments from free self-help web sites by completing links
• Access to fee charging self-assessments require individual or org. prepayment
• E-mail or videoconferencing to seek assistance when problems occur with self-help tests
![Page 10: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/10.jpg)
22
Test Administration
• Advantage
– Remote administration - fewer barriers
• Disadvantages
– potentially compromises standardization
– aptitude, achievement, IQ, neurological
– environmental factors (distractions)
– psychological factors (intimidation)
– no opportunity to record deviations
![Page 11: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/11.jpg)
23
Test Administration
• Use of visual images as well as text
• Benefits:
– manipulation tasks - card sorts
– individuals with limited reading ability
• Limitations:
– higher developmental costs
– reactivity to irrelevant data in images
![Page 12: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/12.jpg)
10
Common Elements of Assessment
Selection
Orientation
Administration
Scoring
Interpretation
![Page 13: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/13.jpg)
24
Test Scoring
• Proceeds immediately after
administration
• Self-assessment - no practitioner is
available to explain scoring
• “Black-box” scoring may increase
perceptions of “magical” answers
![Page 14: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/14.jpg)
14
Common Elements of Assessment
Selection
Orientation
Administration
Scoring
Interpretation
![Page 15: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/15.jpg)
15
Test Interpretation
Three aspects of test interpretation:
1. Client Preparation
2. Generalized Test Interpretation
3. Specific Test Interpretation
![Page 16: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/16.jpg)
16
Client Preparation
• Begins in orientation
• Purpose and process of testing
• Repetitive information - boredom -
poor counselor performance
• Computer effective with repetition
• Counselor provides specific info
![Page 17: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/17.jpg)
17
Specific Test Interpretation
• Counseling: Face-to-face or
distance
• Computer-based test interpretation
![Page 18: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/18.jpg)
18
Specific Test Interpretation
Four options:
1. Computer-based test interpretation
2. Two-way videoconferencing
3. Moderated list servers
4. Moderated computer conferences
5. Follow-up resource links
![Page 19: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/19.jpg)
19
Generalized Test Interpretation
• Basic terminology and concepts
• Repetitive information - bored
counselor - poor performance
• Counselor may appear disinterested
• Knowledge gaps - less prepared
• Better delivered by computer
• Time used for insight and application
![Page 20: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/20.jpg)
20
Computer-Based Test
Interpretation (CBTI)
• Provides an expanded and
consistent knowledge base
• Uses research data and practitioner
experience
• More objective and comprehensive
• Less subject to interpreter bias
![Page 21: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/21.jpg)
21
Types of CBTI
Four types of CBTI:
1. Descriptive
2. Clinician-modeled
(renowned clinician type)
3. Clinician-modeled
(statistical model type)
4. Clinical actuarial
![Page 22: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/22.jpg)
22
CBTI Variation
• Self-assessment
• Counselor-mediated assessment
– Client as consumer
– Practitioner as consumer
![Page 23: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/23.jpg)
23
Self-Assessment
• Designed for little or no practitioner
assistance
• Example: Self-Directed Search
• Both generalized and specific
interpretation
![Page 24: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/24.jpg)
24
Counselor-Mediated Assessment
• Client as primary consumer
• Designed to include practitioner
• Example: Strong Interest Inventory
• Password-protected web site
• Generalized test interpretation
• Practitioner intervention
• CBTI specific interpretation
![Page 25: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/25.jpg)
25
Counselor-Mediated Assessment
• Practitioner as primary consumer
• Example: MMPI-2
• Password-protected web site
• No generalized test interpretation
• CBTI specific interpretation
• Practitioner intervention
![Page 26: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/26.jpg)
26
Relationship Issues
• Videoconferencing and face-to-face
interaction - similar, but not identical
• Equivalency is not the issue
• Effectiveness is the issue
• Research and development needed
![Page 27: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/27.jpg)
27
Ethical Issues
• Confidentiality
• Attractive, but invalid assessment
• Lack of needed counselor intervention
• Misuse of, or dependency on, CBTI
• Awareness of local circumstances
• Limited access to the Internet - SES
• Limited auditory and visual privacy
![Page 28: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/28.jpg)
28
Ethical Standards
• National Board for Certified
Counselors - Practice of Internet
Counseling
• National Career Development
Association - Guidelines for the Use
of the Internet for Provision of Career
Information and Planning Services
![Page 29: Using the Internet to Enhance Testing in Counseling · test-taker’s parents or guardians –computer-assisted instruction –frequently asked questions (FAQ’s) • Theory-based](https://reader036.vdocuments.net/reader036/viewer/2022071008/5fc55294b97c154d2947cffd/html5/thumbnails/29.jpg)
29
For Additional Information
www.career.fsu.edu/techcenter/
Thank You