2004-2005 statewide building operators certification and training program evaluation prepared for...
TRANSCRIPT
2004-2005 Statewide 2004-2005 Statewide Building Operators Certification and Training Building Operators Certification and Training
Program EvaluationProgram Evaluation
Prepared for California’s Investor-Owned Utilities: Pacific Gas and Electric Company
San Diego Gas and Electric CompanySouthern California Edison Company
Southern California Gas Company
MAESTRO Workshop – July 27, 2006
Presented By: Jane S. Peters, Ph.D.
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 2
Advisory CommitteeAdvisory Committee
Project Advisory Committee Members:• Beatrice Mayo (Chris Ann Dickerson)
– Statewide Lead, Pacific Gas and Electric Company
• Carol Yin– Southern California Edison
• Brenda Gettig– SEMPRA
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 3
What is the BOC Program?What is the BOC Program?
Building Operator Certification & Training Program
8 days of instruction on O&M techniques for • Optimal building
performance• Energy efficiency• Occupant comfort
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 4
What is the BOC?What is the BOC?
Training provided by Northwest Energy Efficiency Council (NEEC) under contract to California utilities
Launched In California in 2002• 15 Level I series in 2004-
2005• 3 Level II series in 2004-
2005
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 5
Evaluation MethodEvaluation Method
Build on Previous Findings Showing High Levels of Satisfaction• Two prior California studies• Two Northeast studies• Seven Northwest studies
Three of the studies estimated energy impacts
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 6
Evaluation MethodEvaluation Method
Analysis of Interview Data• 58 Participating Students• 25 Supervisors of Students• 58 Nonparticipating Supervisors• 17 Utility and BOC Staff and Instructors
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 7
Students and Supervisors AreStudents and Supervisors AreHighly SatisfiedHighly Satisfied
90% report satisfaction• Same as prior
evaluations
The less-satisfied students• Are those with the most
experience • Desire a more advanced
course
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 8
Students and Supervisors AreStudents and Supervisors AreHighly SatisfiedHighly Satisfied
93% of students report using concepts they’ve been taught• 75% of supervisors report BOC-trained
operators have saved energy, money, and increased comfort
80% of students report greater confidence in their ability to provide “demand response”
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 9
Course Locations and Student CommutesCourse Locations and Student Commutes
MapQuest® was used to analyze distances between students’ workplaces and training locations
Shortest commute:• Oakland—8 minutes (median)
Longest commute:• Stockton—52 minutes (median)
Commutes within the LA area varied the most:• Oxnard—17 minutes (median) • Ontario—39 minutes (median)
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 10
But Does the BOC Do Anything?But Does the BOC Do Anything?
?
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 11
Evaluation Focused on O&M ActionsEvaluation Focused on O&M Actions
Students and nonparticipants reported whether they took 12 specific O&M actions:• At least as often as every few months• Every six months• Every year• Every few years• Never
Students reported on their own actions; nonparticipants reported on actions of themselves or their staff
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 12
Students Check the Boiler Combustion Students Check the Boiler Combustion SystemSystem More OftenMore Often
Students Nonparticipants
About once a year24%
Every few months
55%
About tw ice a
year18%
Every few years3%
Every few years26%
About tw ice a
year13%
Every few months
18%
About once a year43%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 13
Students Inspect Steam Traps Students Inspect Steam Traps More OftenMore Often
Students Nonparticipants
Never6%
Every few years0%
About tw ice a
year29%
Every few months
53%About once a year12%
Never6%
Every few years31%
About tw ice a
year6%
Every few months
19%
About once a year38%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 14
Students Test for Proper Damper Students Test for Proper Damper Modulation More OftenModulation More Often
Students Nonparticipants
Never8%
Every few years0%
About tw ice a
year11%
Every few months
54%
About once a year27%
Never6%
Every few years29%
About tw ice a
year29%
Every few months
18%
About once a year18%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 15
Students Check & Recalibrate Chilled Students Check & Recalibrate Chilled Water Loop Controls More OftenWater Loop Controls More Often
Students Nonparticipants
Never13%
Every few years0%
About tw ice a
year17%
Every few months
53%
About once a year17%
Never17%
Every few years22%
About tw ice a
year9%
Every few months
22%
About once a year30%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 16
Students Lubricate Motor, Fan, and Students Lubricate Motor, Fan, and Pump Bearings More OftenPump Bearings More Often
Students Nonparticipants
Never6%
Every few years0%
About tw ice a
year17%
Every few months
69%
About once a year8%
Never5%
Every few years34%
About tw ice a
year18%
Every few months
20%
About once a year23%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 17
Students Inspect Fan and Pump Motor Students Inspect Fan and Pump Motor Belt Alignments & Bearings More OftenBelt Alignments & Bearings More Often
Students Nonparticipants
Never3%Every few
years0%
About tw ice a
year22%
Every few months
61%
About once a year14%
Never9%
Every few years36%
About tw ice a
year14%
Every few months
18%
About once a year23%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 18
Students Inspect the Compressed Air Students Inspect the Compressed Air System for Leaks More OftenSystem for Leaks More Often
Students Nonparticipants
Never14%
Every few years3%
About tw ice a
year7%
Every few months
66%
About once a year10%
Never15%
Every few years38%
About tw ice a
year15%
Every few months
10%
About once a year22%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 19
Students Monitor Compressed Air Students Monitor Compressed Air Systems More OftenSystems More Often
Students Nonparticipants
Never18%
Every few years3%
About tw ice a
year0%
Every few months
68%
About once a year11%
Never30%
Every few years20%
About tw ice a
year8%
Every few months
22%
About once a year20%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 20
Students Appear to Check Settings on Students Appear to Check Settings on Packaged AC Units More OftenPackaged AC Units More Often
Students Nonparticipants
Never17%
Every few years8%
About tw ice a
year4%
Every few months
50%
About once a year21%
Never11%
Every few years29%
About tw ice a
year16%
Every few months
22%
About once a year22%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 21
Students Appear to Check for LeaksStudents Appear to Check for Leaks in Air Ducts More Often in Air Ducts More Often
Students Nonparticipants
Never25%
Every few years12%
About tw ice a
year6%
Every few months
41%
About once a year16%
Never25%
Every few years21%
About tw ice a
year10%
Every few months
15%
About once a year29%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 22
Students and Nonparticipants Are Similar Students and Nonparticipants Are Similar in Cleaning Chiller Tubesin Cleaning Chiller Tubes
Students Nonparticipants
Never17%
Every few years22%
About tw ice a
year4%
Every few months
13%
About once a year44%
Never4%
Every few years30%
About tw ice a
year0%
Every few months
9%
About once a year57%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 23
Students and Nonparticipants Are SimilarStudents and Nonparticipants Are Similar in Adjusting VFDs to Match Loads in Adjusting VFDs to Match Loads
Students Nonparticipants
Never19%
About once a year27%
Every few months
11%About
tw ice a year4%
Every few years0%
Only at the time of VFD
installation39%
Never0%
Only at the time of VFD
installation45% Every few
years11%
About tw ice a
year11%
Every few months
8%
About once a year25%
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 24
ConclusionsConclusions
BOC is a mature program• Mature curriculum• Mature delivery process
BOC participants are highly satisfied Course locations are good BOC training increases the energy-
efficiency actions of building operators• Four studies using different self-report
methods have reached this conclusion
07/2706 2004-2005 Statewide Building Operator Certification and Training Program 25
RecommendationsRecommendations
“Stay the course” in program implementation• Program implementers already recognize the
need for expanded marketing
Design and fund impact evaluation to meet California protocols• Consider training the entire staff of a large
facility, with pre- and post-metering of key end-uses