cassc research and testing committee · 2014-02-20 · cassc research and testing committee m i n u...

CASSC Research and Testing Committee

M I N U T E S

Meeting: Monday, September 26, 2011

Building 5000 (Bonnie McCabe Hall), Wolfson Campus, Room 5620

1-min_09_11.docx; 10-26-2011 1

Present: Alex Alvarez, Ian Cobham, Julio Fernandez de Cueto, Christine Dundas, David Heredia, Rulx Jean-Bart, David

Kaiser (Co-Chairperson), Ivonne Lamazares, Juan Carlos Meza, Dora Mejia-Montoya, Adam Porro, Barbara Rodriguez, Silvio Rodriguez (Co-Chairperson), Ivo Rokovich, Bruce Smitley (for Susan Thomas), Leighton Spence, Michelle Thomas (for Cynthia Schuemann), Carol Tulikangas Not Present: Ana Maria Bradley-Hess

I. Review of Minutes

Minutes of the meeting of May 25, 2011 were approved.

II. Standing Item(s)

A. Research - David Kaiser reported that Institutional Research is involved in the following projects:

Aspen Prize application

MDC3 - Gates Completion by Design

B. Placement Criteria document 2012-2013

- Overview of the Placement Criteria Review Process

Silvio Rodriguez discussed the Overview of the Placement Criteria Review Process document

(http://www.mdc.edu/ir/CPT_CLAST/placement.asp), the timeline, answered a few questions about last year’s

review process, and reminded the discipline/area representatives of their role in the annual review process.

C. Testing Fees effective July 1, 2011

- Overview of the Testing Fees Review Process

Silvio Rodriguez discussed the Testing Fees Review Process document that is used for the annual review of testing

fees at MDC and informed the Committee of recommended minor changes in the document (attached) that needed

to be voted on. The changes were approved by the Committee. He also informed the Committee that the process

of reviewing testing fees charged by other institutions has been initiated and reminded them that the Testing Fees

effective July 1, 2011 are posted at http://www.mdc.edu/testing_information/fees/default.asp.

III. New Business

A. Meeting Calendar

Silvio Rodriguez presented the new CASSC Research & Testing Committee Meeting Calendar (attached), which also includes the committee’s responsibilities for the academic year https://www.mdc.edu/cassc/committees_rt.asp). He also reminded the Committee that the regular meeting dates are usually the last Wednesday of each month. The Committee agreed to have the November meeting on December 5 and the April/May meetings on May 14.

B. Committee Responsibilities

David Kaiser reminded the committee members of their responsibilities.

C. Research Requests

The Committee reviewed, discussed and voted on the following request: Researcher: Iliana M. Patron / Capella University (Approved)

Proposal: Dissertation Research-Qualitative Study

Researcher: Postsecondary Data for the M-DCPS High School Graduating Class of 2010 (Approved)

Proposal: Dr. Maribel Harder and Dr. Lupe Diaz / University of Miami and Miami-Dade County Public Schools

Researcher: The Effects of Concept Mapping on College Students’ Reading Achievement (Approved)

Proposal: Assistant Professor David Heredia – College Prep Department – Miami Dade College – Kendall Campus

http://www.mdc.edu/ir/CPT_CLAST/01-981.pdf

http://www.mdc.edu/ir/CPT_CLAST/placement.asp

http://www.mdc.edu/testing_information/fees/default.asp

https://www.mdc.edu/cassc/committees_rt.asp


M I N U T E S



1-min_09_11.docx; 10-26-2011 2

IV. Follow-up Items

A. Postsecondary Education Readiness Test (PERT)

Silvio Rodriguez informed the Committee of the PERT updates list below. Attached is the MDC PERT data through

September 16, 2011 that he presented, as well as the June, July, and August 2011 Monthly PERT Updates pre-

pared by The Florida College System.

MDC students are scoring on target for average scores (=100) for Reading and are below target on Writing

and Math.

MDC PERT administrations have increased considerably.

All subtests are now adaptive.

The lower level diagnostic component is ready and it is available for faculty review on an on-going basis

through the campus Testing Directors. The upper level component should be ready soon.

V. Information Items

A. MDC3/CbD

David Kaiser informed the Committee that the College is in the early stages of this project and there are campus

planning teams and multiple sub-groups working on this project.

B. No more CLAS – graduation status for pre 2009-3 enrolled students

Silvio Rodriguez informed the Committee that effective July 1, 2011, College-Level Academic Skills (CLAS) is no

longer an associate in arts degree or bachelor's degree graduation requirement. Students enrolled at Miami Dade College (MDC) in credit classes during Summer Term 2009-3 and thereafter do not need to meet CLAS require-ments for MDC graduation purposes. He also informed the Committee that recommendations prepared by Dulce

Beltran, College Registrar and him for students enrolled at MDC prior to 2009-3 have been finalized and they would soon be going through an approval process.

Below are the recommendations for students who met all graduation requirements except for the CLAS requirement

and who were enrolled prior to 2009-3.

1) Students will be identified (IT will provide a list) and checked against the National Student Clearinghouse data-base for verification to determine if the student has subsequently received an AA degree or higher. If the stu-dent is found to have an AA degree or higher, the college will not proceed with contacting the student or award-ing an AA degree.

2) If the student is not found to have received an AA degree or higher a communication will be sent to the student to provide MDC consent to graduate them. Communication will be sent via e-mail (if valid e-mail on file) or via post office letter, for those students without valid e-mails on file.

3) Student consent will be done electronically on an MDC secure website. Once the consent is on file, students

will be graduated with an effective date of July 1, 2011 and after.

C. State-wide placement retesting policy

Silvio Rodriguez informed the Committee that Julie Alexander from the FLDOE would be presenting a draft State-wide placement retesting policy at the October 12-14 CIA/CSA meetings. (From PERT FAQ 9/30/2011: State Board of Education Rule 6A-10.0315, F.A.C., will be updated to include retesting policies. It is anticipated that rule devel-opment will be initiated this fall with State Board approval targeted in November of 2011).

The draft rule includes a limit on the number of retests allowed and required remediation prior to retesting. The most recent version is available via https://app1.fldoe.org/rules/default.aspx and https://www.flrules.org/gateway/readFile.asp?sid=2&tid=10503856&type=1&File=6A-10.0315.htm.

https://app1.fldoe.org/rules/default.aspx

https://www.flrules.org/gateway/readFile.asp?sid=2&tid=10503856&type=1&File=6A-10.0315.htm


M I N U T E S



1-min_09_11.docx; 10-26-2011 3

VI. Reports

A. Testing Directors – Barbara Rodriguez reported on the following early in the meeting:

PERT and High School Testing

The Testing Directors invited Georgette Perez, New Student Center Director liaison for recruitment, and Rene Gar-cia, Director of Enrollment, to participate in their agenda item regarding the guidelines for PERT and high school testing. The discussion focused on MDC’s role in PERT administrations to the high schools. The discussion stems from legislative revisions made to Section 1008.30, Florida Statutes, as a result of House Bill 1255. Consequently, Miami-Dade County Public Schools (M-DCPS) and MDC are working on the testing section sections of the Inter-institutional Articulation Agreement (IAA). The information below is currently included in the draft agreement. The primary responsibility for administering the PERT to 11

th graders rests with M-DCPS. Pursuant to HB 1255,

MDC will not administer required 11th grade testing or postsecondary readiness testing except for the following cate-

gories of M-DCPS students: (1) students who have met the GPA and other MDC requirements with the exception of testing for dual enrollment, (2) students who have formally applied for admission to the School for Advanced Stud-ies, (3) high school students already enrolled in the New World School of the Arts, (4) high school participants in jointly sponsored or approved projects, and 5) any group MDC considers that it will be in the students’ best interest to be tested by MDC.

Child Care Testing

The Testing Directors hosted Samuel Ore, Laurie Shapero, and Maria Bello of the Childcare Training Program to re-view testing procedures and to clarify any pending issues regarding the child care exams. As a result of the meeting, InterAmerican campus will provide a Saturday exam with 7 block sessions. There needs to be one additional Satur-day with 7 block sessions during the month of December. Testing centers will receive revenue on a monthly basis versus once a term. The Childcare Training program has requested additional testing dates and/or an increase in seating capacity.

Testing Directors Re-visioning Retreat

The Re-visioning Retreat will be held on Friday, October 28, 2011 at the North Campus. The retreat supports one of service area report goals for Institutional Effectiveness: Coordinate a retreat for Testing Directors in Fall 2011 to re-vision their role in students’ early experiences at the College in keeping with completion agenda initia-tives and the first year experience. The retreat will focus on goal #3 from the College’s strategic plan: Emerging plans for developing model pathways for student completion at MDC indicate a need for the testing areas to contrib-ute in additional ways to the holistic assessment and intake of students. It is important for the directors to identify their strengths and weaknesses in assuming a broader role as that emerges. The retreat will include Testing Direc-tors, testing full timers, key testing part-timers, and other key employees. The retreat is being coordinated by Silvio Rodriguez and Barbara Rodriguez. CLEP college-wide contract

The Testing Directors are supporting a change of their campus-based contracts to a college-wide one. This will al-low West and Hialeah Campuses to be part of the contract after their test center agreements are supported by their campus and submitted and approved by The College Board.

PERT Diagnostics

Adam Porro has agreed to pilot the PERT Diagnostics at the Wolfson Campus. The results of that pilot will be inter-faced with campus-based plans that the testing directors are developing.

The lower level PERT Diagnostic component was launched on Wednesday, August 10

. The State’s free no cost

testing window for reviewing the PERT Diagnostic component is from September 12th through October 14, 2011. (note: On October 4 the upper level component was launched and the free review period was extended to October 21). An expanded review period outside the State’s free period will be available at MDC on an on-going basis for faculty and staff following the same guidelines used for the PERT. Faculty and staff should contact their campus Testing Director to make appointments for their review.

B. IR Activities

This information was reported in Section ll-A.


M I N U T E S



1-min_09_11.docx; 10-26-2011 4

C. Area Report for CASSC Research and Testing Representatives

Deans: Carol Tulikangas reported on the new full time faculty that were hired for this academic year.

College Preparatory/Mathematics: Silvio Rodriguez reported that these areas had a joint discipline meeting on

September 13 to set an agenda and work teams for this academic year. David Heredia reported on the College Prep current task work groups that have been developed to enhance college prep. College task groups were formed for new policies and procedures for the following areas; diagnostic testing, exit testing, labs, alternative modes of instruction and learning communities. Workgroups have been charged with the roles of identifying best practices and providing recommendations for future changes.

Next Meeting:

The next meeting of the Research & Testing Committee will be Monday, October 31, 2011 at 2:00pm in building 5000 (Bonnie McCabe Hall), Wolfson Campus Room 5620.

Distribution:

CASSC Research & Testing Committee Diego Tibaquira, CASSC Chairperson, 2011-2012 Joanne Bashford, Associate Provost for Institutional Effectiveness Pamela Menke, Vice Provost for Education Michael Reiner, Associate Provost for Academic Affairs

Testing Fees Review Process.doc Revised: TBA

MIAMI DADE COLLEGE

OVERVIEW OF THE TESTING FEES REVIEW PROCESS as of 04/01/2010 TBA

Requests for the establishment of a testing fee or revising a fee must be presented to the CASSC Research and Testing Committee by the lead campus Testing Director. The following are the steps for establishment or revision of all student testing fees at Miami Dade College: Step 1: Each Fall, the Institutional Test Administrator (ITA) initiates the annual testing fees review process. Step 2: The lead campus Testing Director begins the process of working with the campus Testing Directors to review testing fees charged by other institutions. Step 3: Proposed recommendations are presented to the CASSC Research and Testing Committee by lead campus Testing Director. (for review and comments) Step 4: Proposed recommendations are presented to the Student Deans Council by lead campus Testing Director and ITA. (for review, comments, and support to continue the review process) Step 5: Proposed recommendations are presented to the Academic Leadership Council by lead campus Testing Director and ITA. (for review and comments) Step 6: Proposed recommendations are presented to the Campus CASSCs by lead campus Testing Director and ITA. (information item for review and comments) Step 7: Proposed recommendations are presented to the College CASSC by lead campus Testing Director and ITA. (information item for review and comments) Step 6 8:Proposed recommendations are presented to the College Provost by ITA. (for review, comments, and approval)

2011-2012-schedule September 27, 2012


MEETING SCHEDULE

2011-2012

Bonnie McCabe Hall, Room 5620, Wolfson Campus,

(usually the last Monday of each month at 2:00 p.m.)

SEPTEMBER 26, 2011

OCTOBER 31, 2011

DECEMBER 05, 2011

JANUARY 30, 2012

FEBRUARY 27, 2012

MARCH 26, 2012

MAY 14, 2012

JUNE 25, 2011

JULY 30, 2012 - NO MEETING SCHEDULED

AUGUST 27, 2012 - NO MEETING SCHEDULED ___________________________________________________________________________

Committee Responsibilities:

Provide an ongoing review of the College's testing programs and make

recommendations for change

Review, evaluate and revise testing policies and procedures to maintain

effectiveness and consistency

Generate an annual placement criteria document that implements College and

State requirements

Assure accurate storage and retrieval of test scores

Advise and help determine College research priorities for the year

Approve multi-campus research studies and access to College computer files

Review and forward significant research findings to Academic and/or Student

Deans, and others, as appropriate

2010-1 CPT

Placement*

N % N % %

Reading Placement

REA0001 4 0.7% 208 2.5% 8.1%

REA0002 20 3.7% 1066 13.0% 16.9%

REA0003 168 31.3% 3182 38.8% 16.3%

EXEMPT 344 64.2% 3746 45.7% 45.0%

Total Students tested in Reading 536 100% 8202 100%

Writing Placement

ENC0002 5 1.0% 187 2.2% 5.2%

ENC0020 78 16.1% 2345 27.8% 15.2%

ENC0021 88 18.2% 1828 21.7% 13.4% Reading = 10,794 Writing = 10.401 Math = 12,249

ENC1101 313 64.7% 4063 48.2% 54.3%

Total tested in Writing 484 100% 8423 100%

Mathematics Placement

MAT0002 79 15.5% 616 6.5% 20.0%

MAT0020 251 49.1% 4265 45.0% 32.7%

MAT0024 138 27.0% 3141 33.1% 9.0%

MAT1033 or Higher 43 8.4% 1461 15.4% 22.5%

MAT1033 31 6.1% 1014 10.7% -

MAC1105 9 1.8% 361 3.8% -

Refer to Math Dept. 3 0.6% 86 0.9% -

Total tested in Math 511 100% 9483 100%

Prepared by Silvio Rodriguez, Institutional Research, 9/20/2011

Reading = 63 min Writing = 32 min Math = 37 min

April 21, 2011 begins recalibration period.

PERT Average Times through 8/08/2011

Miami Dade College - CPT, PERT, & Placement Results by Levels

PERT 4/21/11-9/16/11

The PERT data should be used very cautiously since course performance data is not

yet available (expected after summer term 2010-3 is completed)

*Sources: Test Master Record for CPT and PERT results. 2010-1 CPT placement results from

Table 17, 2010-1 Placement Test Results

PERT 12/06/10-4/20/11

PERT Administrations at MDC as of July 11, 2011

102.6 98.9 98.9 100.0 96.5 94.1

2030405060708090

100110120130140150

College readyReading = 104

College readyWriting =99

College readyMath = 113

PERT Average Scores (target = 100)

State PERTthrough 8/08/11

MDC PERT4/21/11-9/16/11

N % N %

Campus

North 375 54.3% 3057 29.6%

Kendall 50 7.2% 3311 32.0%

Wolfson 128 18.6% 1685 16.3%

Medical 9 1.3% 85 0.8%

Homestead 2 0.3% 396 3.8%

InterAmerican 26 3.8% 561 5.4%

Hialeah 63 9.1% 853 8.3%

West 37 5.4% 386 3.7%

Total students tested 690 100% 10334 100%

PERT 12/06/10-4/20/11 PERT 4/21/11-9/16/11

PERT Administrations by Campus

cpt pert placement R6.xlsx/CPT

SR-09/20/2011 Page 1

Administrations since Recalibration

on April 20, 2011

P.E.R.T. Update 08/08/11

Diagnostic • The lower level diagnostic tests will go live in

August.

• McCann and the Division will host webinars for

faculty and staff during the month of August.

• McCann has agreed to provide free testing units so

that faculty will be able to take the diagnostic tests.

Resources Florida’s Postsecondary Readiness

Competencies may be accessed at

www.fldoe.org/cc/collegecareerreadiness.asp

Placement • Placement rates are getting closer to the targeted

numbers. In all three subjects, the differences between

the current and the target declined.

• Remember: variations from historical CPT placement

rates are expected since P.E.R.T. questions are aligned

and approved by Florida faculty whereas the

CPT/Accuplacer items are not.

• Given that not all colleges are fully implementing the

P.E.R.T., or have only recently done so, the placement

rates shown below will likely continue to shift as more

students from more colleges are tested.

Math: Avg = 98.9 Target Current Difference

College Algebra 7.1% 7.3% 0.2%

Intermediate Algebra 14.1% 14.6% 0.5%

Upper Level Dev. Ed. 41.9% 38.5% -3.4%

Lower Level Dev. Ed. 36.9% 39.6% -2.7%

Reading: Avg = 102.6

College Ready 42.0% 48.3% 6.3%



Writing: Avg = 98.9

College Ready 55.3% 51.6% -3.7%


Lower Level Dev. Ed. 23.2% 27.9% 4.7%

PERT Math

PERT Reading

PERT Writing

Brevard Community College 530 471 463

Broward College 6,289 5,343 5,576

Chipola College 156 179 150

College of Central Florida 528 502 505

Daytona State College 2,292 2,152 2,158

Edison State College 2,586 1,963 2,023

Florida A&M University 410 223 246

Florida Gateway College 276 250 245

Florida Keys Community College 291 211 231

Florida State College at Jacksonville 3,107 2,455 2,773

Gulf Coast State College 502 483 445

Hillsborough Community College 3,963 3,603 3,647

Indian River State College - 3 1

Lake-Sumter Community College 1,283 1,189 1,120

Miami Dade College 6,149 5,092 5,110

North Florida Community College 157 136 125

Northwest Florida State College 1,265 1,117 1,130

Palm Beach State College 4,100 3,557 3,510

Pasco-Hernando Community College 2,354 2,012 1,997

Pensacola State College 1,768 1,331 1,352

Polk State College 2,809 2,362 2,308

Santa Fe College 654 659 657

Seminole State College 2,260 2,067 2,012

South Florida Community College 757 641 623

St. Johns River State College 662 538 541

St. Petersburg College 299 298 260 State College of Florida, Manatee-Sarasota 947 826 820

Tallahassee Community College 2,233 1,819 1,796

Valencia College 5,275 5,238 5,084

Total 53,902 46,720 46,908

Test Session Times • The table below shows that math and writing are

close to the target of 30 minutes per subtest. Reading

tests are taking closer to 1 hour.

• New reading questions have shorter passages so we

expect the average times to decline as they are put

into production.

Math Writing Reading

Median Time 0:37 0:32 1:03

http://www.fldoe.org/cc/collegecareerreadiness.asp

Administrations since Recalibration

on April 20, 2011


Placement • Transition from linear to computer-adaptive (CAT)

in both mathematics and writing is planned for early

July.

• House Bill 1255 was signed by the Governor. One

effect of this bill is to make readiness testing

mandatory for all 11th grade students within specified

FCAT ranges. The Division has begun working with

our K-12 counterparts to transfer the responsibility

for this testing from the colleges to the districts.

Resource The Division of Florida Colleges has

developed a College and Career Readiness

webpage that may be accessed at

www.fldoe.org/cc/collegecareerreadiness.asp

College PERT Math

PERT Reading

PERT Writing





Edison State College 1,257 970 984





Gulf Coast State College 33 31 29


Indian River State College 0 3 1

Lake-Sumter Community College 713 680 661

Miami Dade College 1,513 1,345 1,344


Northwest Florida State College 712 606 620

Palm Beach State College 1,894 1,535 1,539


Pensacola State College 1,031 773 773



Seminole State College 1,051 956 934


St. Johns River State College 333 285 280

St. Petersburg College 95 94 88

State College of Florida, Sarasota Manatee 411 343 340

Tallahassee Community College 1,204 997 934

Valencia State College 2,338 2,285 2,230

Grand Total 25,651 22,194 22,411

Recalibration Analysis • At midnight April 20th, the P.E.R.T. was recalibrated.

This was done to adjust for higher than expected

performances most likely caused by differences

between the pilot and actual populations.

• The recalibration has been generally successful. The

overall averages for each test are much closer to the

target mean of 100.

• More importantly, the placement rates are much

closer to the targeted numbers.

• Remember: variations from historical CPT placement

rates are expected since P.E.R.T. questions and

competencies are aligned and approved by Florida

faculty whereas the CPT/Accuplacer items are not.

• Given that not all colleges are fully implementing the

P.E.R.T., or have only recently done so, the placement

rates shown below will likely shift as more students

from more colleges are tested. The Division will

continue to monitor and report these results.

Math Target Current Difference

College Algebra 7.1% 10.0% 2.9%

Intermediate Algebra 14.1% 17.0% 2.9%



Reading

College Ready 42.0% 50.3% 8.3%



Writing

College Ready 55.3% 51.0% -4.3%


Lower Level Dev. Ed. 23.2% 29.5% 6.3%


The Florida College System

Administrations as of May 27, 2011


Placement Diagnostic•Transition from linear to computer-adaptive (CAT)

in mathematics is targeted for July 6.

•Paper/pencil, Braille and large font will also be

available July 6.

•McCann Associates is working to ensure the

computerized version of the P.E.R.T. is compatible

with JAWS screen reading software.

•The writing blueprint has been revised.

Competency 10 has been removed from the

blueprint and one item has been added to

Competency 4. The total number of items will

remain - 25 operational and 5 field test.

•McCann Associates and the Division are finalizing

plans for an ongoing item review process including

faculty volunteers. Faculty will have the option of

participating in diagnostic and/or placement

reviews.

•The initial round of faculty item review has been

completed for the lower level diagnostics in

mathematics, reading and writing.

•The plan for item development and review is to

alternate between the lower and upper level diagnostic

so that both levels are ready for launch at the same

time.

•The launch of the diagnostics is planned for August

10, 2011.

•P.E.R.T. diagnostics will be linear.

•McCann Associates and the Department are

discussing plans for the diagnostic reports that will be

used for instructional planning.

•The Division continues to discuss use of the

diagnostic assessments for modular developmental

education implementation. The Developmental

Education Initiative modularization pilots have

completed their first term and are in the process of

analyzing results.

House Bill 1255 passed the Legislature and pending the

Governor’s signature will result in amendments to s. 1008.30,

Florida Statutes, regarding common placement testing for

high school students and remediation opportunities.

http://www.myfloridahouse.gov/Sections/Documents/loaddoc.aspx?Fi

leName=_h1255er.docx&DocumentType=Bill&BillNumber=125

5&Session=2011

Subtest

Average

Scores Cut Scores

Mathematics 97.60 113

Reading 108.32 104

Writing 106.43 99

ResourceThe Division of Florida Colleges has developed a

College and Career Readiness webpage that may be

accessed at

http://www.fldoe.org/cc/collegecareerreadiness.asp.

College Math Reading Writing





Edison State College 172 141 137






Indian River State College 0 1 0

Lake-Sumter Community College 690 660 660

Miami Dade College 845 911 835


Northwest Florida State College 561 485 502

Palm Beach State College 850 676 661


Pensacola State College 1,219 983 961



Seminole State College 1,146 1,065 1,044


St. Johns River Community College 438 386 374

St. Petersburg College 7 7 6

State College of Florida, Manatee-Sarasota147 109 113

Tallahassee Community College 1,824 1,506 1,417

Valencia Community College 3,304 3,234 3,218

Grand Total 27,613 25,417 25,035

http://www.myfloridahouse.gov/Sections/Documents/loaddoc.aspx?FileName=_h1255er.docx&DocumentType=Bill&BillNumber=1255&Session=2011


