how to assess students outcomesmoodle.liu.edu.lb/liu/soe/seminars/abet/how to... · how to assess...
TRANSCRIPT
How to assess the Students Outcomes?
Case Study: Tecsup – PerúABET Symposium XIVSt. Louis, Missouri, USA
Henry Gómez UrquizoElectrotechnical Department Head
Tecsup – ArequipaPerú
Content
• Tecsup the Institution• Quality in higher education
• Terminology used• Continuous Improvement Plan
• The PEO and SO of IEP• Assessment and evaluation of SO of IEP
23/02/2012 2hgomez@tecsup‐aqp.edu.pe
Tecsup in Peru and the world• Private Technologic Higher Education Institute
• Was founded in 1984• Three campus in Peru:
– Lima– Arequipa– Trujillo
• Regular Students: >3000 • Trained Workers: >60000
23/02/2012 3
Lima
Arequipa
Trujillo
hgomez@tecsup‐aqp.edu.peCampus Services
Applied Engineering Programs
• Site: www.tecsup.edu.pe• Accredited Programs:
23/02/2012 4hgomez@tecsup‐aqp.edu.pe
23/02/2012 5
Quality in Higher Education
• Tecsup addresses its activity to achieveeducational excellence.
Fulfillment minimal requirements
Products and process oriented to the client
satisfaction
The entire organization is committed to the achievement of
excellence, "the best possible"
According to standard Quality Excellence
Products
Process
Organization
Quality models
Stadiums of the quality
hgomez@tecsup‐aqp.edu.pe
ABET TerminologyTAC 2012‐2013
POE “A”
SO “a”
Program Educational Objectives (POE)SO
“b”
SO “c
”
SO “h”
SO “I”
SO “j”…
POE “B” POE “D”POE “C” POE “E”
Students Outcomes (SO)
6
Institutional Mission
Specific Objectives of the Courses (SOC)
23/02/2012 hgomez@tecsup‐aqp.edu.pe
23/02/2012 7
Continuous Improvement Plan (CIP)• The CIP is a institutional strategy created with the
purpose of optimize the educational services that weprovide.
hgomez@tecsup‐aqp.edu.pe
ASESSMENT
CIP StrategyEVALUATION ACTIONS
EDUCATIONAL OBJECTIVES
STUDENTS OUTCOMES
COURSES OBJECTIVES
Survey to students
about Courses
Reports of Courses grades
Reports on execution of courses
Survey to students
about services
Portfolio of the courses
Criterios de desempeño
Performances of students in Internship I
Interview to students about SO
Survey to students about SO
Performances of students in Internship II
Survey to the alumni
Survey to the
employers
Collection of data through the WEB site
Minutes of Technical Committee
COMMITTES
Central Committee of Improvement
Technical advisor
Committee
Students and alumni services Committee
Jefatura de Departamento
FORMULATION AND ACHIEVEMENT
Program Educational Objectives
Students
Outcomes
Courses
Objectives
Excellence Organization
23/02/2012 8
PLANNING
Performance criteria in activities
hgomez@tecsup‐aqp.edu.pe
Program
Committee
SO PEO
CommitteesImprovement Actions
Companies
ASSESSMENT ASSESSMENT
EVALUATION
ACTIONS
9
ADMITION
SEMESTR
E 1
SEMESTER 2
INTERS
HIP I
SEMESTER 3
SEMESTER 4
SEMESTER 5
SEMESTER 6
INTERS
HIP II
Industrial Electrotechnical Program (IEP)
23/02/2012 hgomez@tecsup‐aqp.edu.pe
Student Graduates
Cyclical revision of the PEO
23/02/2012 10hgomez@tecsup‐aqp.edu.pe
11
Program Educational Objectives of IEP
Program Educational Objectives (PEO)PEO “A”
Our graduates develop, install and maintain electrical system based on solid knowledge of Electrical Installations and Power Systems.
PEO “B”Our graduates identify and
analyze problems to implement effective solutions
PEO “C”Our graduates behave with initiative, creativity, effective resource management and
teamwork
PEO “D”Our graduates are
professionals commitment with their development, quality and safety in work
PEO “E”Our graduates practice ethical principles and contribute to the development of society
Mission of Electrotechnical Department (ED)
To develop the professionals in Electrotechnical area, who apply their knowledge and skill to contribute the success of companies and development of the country.
Mission of the Educative Institution (IE)To develop people and companies through education, training and
consultancy services
23/02/2012 hgomez@tecsup‐aqp.edu.pe
“a”Students design, implement and optimize electric systems using their knowledge of electric installations and power systems, applying modern tools and techniques
“b”Students apply mathematics, science and technology in the design, installation, operation and maintenance of electric systems
“c”Students conduct tests and measurements, analyze and interpret their results in order to evaluate and improve systems.
“d” Students apply creativity in the design of systems.
“e” Students work effectively on teams.
“f” Students identify, analyze and solve problems on equipment and systems. .
“g” Students communicate effectively.
“h” Students recognize the contemporary issues of their career and society. They practice continuous life long learning and respect for diversity.
“i” Students work with quality and safety, and proceed with ethical principles. .
“j” Students manage effectively materials and human resources under their responsibility. .
12
Students Outcomes(SO) of IEP
23/02/2012 hgomez@tecsup‐aqp.edu.pe
23/02/2012 13
Direct and indirect assessment of SO
Surveys
Performance
Interviews
Need improveExcellent Good Deficient
Assessment tool
Objective assessment
hgomez@tecsup‐aqp.edu.pe
Qualification
Performance Criteria
23/02/2012 14hgomez@tecsup‐aqp.edu.pe
Selection of activities for assess SO
23/02/2012 15hgomez@tecsup‐aqp.edu.pe
Taxonomía de Bloom
23/02/2012 16Learning levels
Definitions
Verbs to use
Situation where to apply hgomez@tecsup‐aqp.edu.pe
Learning levels according toBloom Taxonomy
23/02/2012 17
Levels
Crite
ria
hgomez@tecsup‐aqp.edu.pe
SO "a"
1. Knowledge 2. Comprehensión 3. Application 4. Analysis 5. Sintesis 6. Evaluation
Select materials and equipment according to the requirements of an electrical system
Identifies the components necessary for an electrical system
Distinguishes the functional
characteristics of the various components of an electrical system
It calculates and determines the
necessary components for an electrical
installation
Connects and reviews the components of an electrical installation
Develop and implement projects of electrical systems
Defines the characteristics of a project on electrical
systems
Interprets the characteristics of such
a project electrical system
Implements a project on electrical systems
Discusses the features of a project on
electrical systems
Develops projects of electrical systems
Improve actual electrical systems in order to save electric energy
Defines electrical parameters that allow the energy savings in an electrical system
Distinguishes the electrical parameters more relevant to the energy savings of an electrical installation
Controls electrical parameters that allow
the energy saving
Investigates aspects that allow the energy-saving in an electrical
installation
Revises electrical systems and proposes
alternatives to save energy
Evaluates economic and technical feasibility
of alternatives for energy saving in an electrical installation
ATTRIBUTES FRAMEWORK FOR SO "a"Students design, implement and optimize electric systems using their knowledge of electric installations and power systems,
applying modern tools and techniques
Performance Criteria or Attributes
Cognitive Domain Categories
Rubric for SO assessment
23/02/2012 18hgomez@tecsup‐aqp.edu.pe
Levels
Categories
Attributes to observe
Final grade percent
Partial grade
Grade Mark
Sample of Balance Scorecard in CIP
23/02/2012 19hgomez@tecsup‐aqp.edu.pe
a1 a2 b1 b2
a1.1 Electric Distribution Network 61% a2.1 Electrical Installation Mounting 80% b1.1 Electrical Measurement 68% b2.1 Electrical Control Systems 82%
a1.2 Power System 71% a2.2 Industrial Automation 76% b1.2 Power Systems Protection 93% b2.2 Power Systems ####
a1.3 Power System Protection 71% a2.3 Process Control 69% b1.3 Proces Control 62% b2.3 Industrial Electronic 78%
a1.4 Process Control 79% a2.4 Power System Protection 85% b2.4 Electromechanical Systems Ma 75%
Activities Activities Activities Activities
Selects materials and equipment according to requirements of electric system
Develops and implements electric system projects
Uses superior calculus in the analysis of electric systems
Uses software for the analysis, simulation and operation of electric systems
70% 77% 71% 82%
Report Report
Performance Criteria Performance Criteria Performance Criteria Performance Criteria
Student Outcome "a" Student Outcome "b"Students design, implement, and optimize electric systems using their knowledge of
electric installations and power systems, with modern tools and techniqueThe students apply mathematics, science and design technologies, installation,
operation and maintenance of electric systems
74% 76%
a3
a3.1 Audit and Energetic Eficiency 68%
a3.2 Electromechanical System Main80%
a3.3 Electromechanical Systems Ma 69%
Activities
Improves existing electric systems to save electric energy
68%
Performance Criteria
b3
b3.1 Electrical Machine II 75%
b3.2 Transformer Maintenance 81%
Activities
Applies concepts of physics and chemistry on the selection and maintenance of components
78%
Performance Criteria
Application of CIP in SO of IEP
Criterios de desempeño
Desempeño de estudiantes en las Prácticas
Desempeño de estudiantes en las Pasantías
Students survey about SO achievement
Entrevista a Estudiantes sobre logro de Resultados
Los estudiantes:a) Diseñan, implementan y optimizan sistemas eléctricos utilizando sus
conocimientos de instalaciones eléctricas y sistemas de potencia, aplicando técnicas y herramientas modernas.
b) Aplican matemática, ciencia y tecnología en el diseño, instalación, operación y mantenimiento de sistemas eléctricos.
c) Conducen pruebas y mediciones, analizan e interpretan sus resultados para evaluar y mejorar sistemas.
d) Aplican la creatividad en el diseño de sistemas.
e) Trabajan eficazmente en equipo.
f) Identifican, analizan y solucionan problemas de equipos y sistemas.
g) Se comunican eficazmente.
h) Reconocen los aspectos contemporáneos de la profesión, la sociedad, practican el aprendizaje permanente y el respeto por la diversidad.
i) Trabajan con criterios de calidad, seguridad y actúan con principios éticos.
j) Gestionan eficazmente los recursos materiales y humanos a su cargo.
Logro de Resultados 2006
74% 80% 83% 77%87%
69%76% 80% 86%
77%
0%
20%
40%
60%
80%
100%
a b c d e f g h i j
Resultados del Programa
23/02/2012 20hgomez@tecsup‐aqp.edu.pe
Conclusions
• Direct assessment is a useful tool to assess SOachievement.
• Its application demand great effort of faculty• Faculty require an inducement plan and apermanent monitors system in each part of theprocess.
• Data gathering and assessment process must besystematic because the large amount of data.
• The assistance of the administrative staff isequally valuable to lighten the teacher of theirroutine tasks.
23/02/2012 21hgomez@tecsup‐aqp.edu.pe
22
Thanks ….
23/02/2012 hgomez@tecsup‐aqp.edu.pe