florida power & light company hurricane irma response security training workin… · florida...
TRANSCRIPT
Florida Power & Light CompanyHurricane Irma ResponseCarlos N. MoralesManager, Corporate Security
NERC CIPC ConferenceMarch 2018
► Roughly the sizeof Texas
► Affected all 35 counties served by FPL
► Slow-moving storm –impacted some areasfor nearly 24 hours
Hurricane Irma:
Preparing for Hurricane Irma
Largest restoration workforce in industry history
stagingsites
29restoration
workers
~28,000
More staging sites to support crews than in any other hurricane
Winds alone weren’t the biggest issue
major damage fromflooding
andstorm surge
most outages caused by
fallen treesand
wind-blown debris
Flooding and storm surge on both coasts
Flagler County Collier County
Lee County Volusia County Brevard County
Most distribution outages caused by falling trees and wind-blown debris
West Coast Miami-Dade County Palm Beach County
Broward County Miami-Dade County Miami-Dade County
Worked around the clock to restore power
Extreme restoration challenges
Wilma vs. Irma
Saffir-Simpson Scale Category 3 Category 4Maximum SustainedWinds in Florida 120 mph 130 mph
Cyclone DamagePotential Index* 2.8 4.3
*Index developed by the National Center for Atmospheric Research that rates a storm’s ability to cause destruction
Hurricane winds (74+ mph)
Strong tropical storm winds(55-73 mph)Moderate tropical storm winds (39-54 mph) Hurricane Wilma, 2005 Hurricane Irma, 2017
FPL Counties Impacted 21 35
Customer Impacted 3.2 million 4.4 million
% of FPL Customers 75% 90%
Wilma vs. IrmaRestoration
Poles damaged 12,400 4,600
Hurricane Wilma, 2005 Hurricane Irma, 2017
Substations De-energized 241 92
Substations Restored 5 days 1 day
Wilma vs. IrmaRestoration
Hurricane Wilma, 2005 Hurricane Irma, 2017
Customer Restoration 18 days 10 days
75% of Customers Restored 8 days 3 days50% of Customers Restored 5 days 1 day
Average Customer Outage 5.4 days 2.3 days
95% of Customers Restored 15 days 7 days
Underground systems are not indestructible…
…but they generally perform well
Working to enhanceRestoration Information
Building on provenHardening Investments
Educating communities aboutRight Tree, Right Place
Key improvements moving forward
To provide enterprise security risk management products and services that meet the needs of our customers and enhances their ability to be competitive.
Corporate Security
Safe & SecureWorkplace
Incident Response and Investigation
EnterpriseSecurity Risk Management
Support NEE Emergency
Operations Teams
Corporate Security’s Storm Role
Emergency Coordinator
Security Lodging
CoordinatorLead SOC Specialist
Area Security Managers
Systems Support Team
Threat Investigations /
Intelligence
Storm & Assistant Storm
Coordinators
Preserve a safe and secure workplace for employees and contractors
• 30+ sites established consisting of processing, staging, parking, and micro site which required 24-hour security coverage
• Area Security Managers geographically placed to assist with investigations
• At storm’s peak, we deployed 450 contract security officers from three different companies
• Security officers deployed immediately to substations with downed fences or communication issues
• Maintained regular contact with state and local EOC’s to coordinate law enforcement support requests
• Responded to 109 threats from the public against employees and contractors
Corporate Security’s Storm Response
• Multiple security guard force contracts in place – ready to deploy as needed
• Annual training with security teams and contractors about security’s role and responsibilities
• Pre-landfall training with guards to review expectations and obligations
• Annual tabletop drills with law enforcement agencies help establish the importance of critical infrastructure locations and impacts to their communities
Security Best Practices
Texas Strong: Hurricane Harvey Response and Restoration
Bert SausseEmergency OperationsCenterPoint Energy – Houston Electric
March 6, 2018
CenterPoint Energy Proprietary and Confidential Information
About CenterPoint Energy An Electric and Natural Gas Utility
Electric Transmission and Distribution
• Electric utility operations with ~2.4 million metered customers across ~5,000 square miles in and around Houston, Texas
• 19th largest U.S. investor-owned electric utility by customer base(1)
• 86,828,902 MWh delivered
Natural Gas Distribution
• Regulated gas distribution jurisdictions in six states with ~3.4 million customers
• 6th largest U.S. gas distribution company by customer base(1)
• Delivered 411 bcf of natural gas
Energy Services
• Non-regulated competitive natural gas supply and related energy services serving ~33,000 commercial and industrial customers across 33 states
• Delivered 777 bcf of natural gas
2
(1) As of Dec. 31, 2015 per EEI and AGA Source: Form 2016 10-K
CenterPoint Energy Proprietary and Confidential Information
Advance Preparations – Emergency Operating Plans
• Our Electric and Natural Gas businesses each has an Emergency Operations Plan
• Annual drill to test our emergency response
• Coordinate our EOP with state and local officials
• Work with a mutual assistance network that allows us to provide/receive assistance to/from other utilities across the country following natural disasters • On average, CenterPoint Energy sends linemen
4-6 times per year to help other utilities restore power
• Contracts for fuel, lodging and materials are executed in advance so we’re ready if a storm strikes
3
CenterPoint Energy Proprietary and Confidential Information
Timeline
4
Preparations Outreach EOP Harvey Makes Landfall Resources Operations Employee
Assistance Status
Aug. 22, 2017 Electric and Gas Operations, logistics, fleet, service centers and facilities make preparations
Begin posting storm readiness tips and safety information on social media
Aug. 23, 2017 Regulatory and Gov’t Relations work with officials
News release distributes on hurricane preparedness
Email to employees on preparedness
Aug. 24, 2017 Electric and Gas Operations activate EOP
Media interviews
Publish social media messages on preparedness and safety
Increase in employee messages on preparedness and EOP assignments
Aug. 25, 2017 Harvey makes landfall as a Category 4 hurricane near Port Aransas, Texas
Over the next five days, Harvey drops more than 50 inches of rain across our service territory
Aug. 26, 2017 Activate Incident Command Center
Issue news release on damage assessment and restoration update
First wave of mutual assistance crews for Gas and Electric Operations
Aug. 26-early Sept. 2017
Electric Operations builds a mobile substation to restore service to the Memorial area
Gas Operations helps the city of Beaumont address a breach in the pipeline under the Neches River
Sept. 1, 2017 CNP announces Employee 1st
Fund to support impacted employees
CNP announces $1.25 Million to assist Harvey recovery
Sept. 7-8, 2017 Electric Operations resumes normal operations for most employees on Sept. 7
Gas Operations resumes normal operations on Sept. 8
A Corporate Response Team is established to manage ongoing issues
CenterPoint Energy Proprietary and Confidential Information
Wind Event vs. Water Event
5
Hurricane HarveyHurricane Ike
CenterPoint Energy Proprietary and Confidential Information
Hurricane Harvey – A Record-breaking Storm• After making landfall as a Category 4
storm near Port Aransas, Texas, Hurricane Harvey stalled, impacting south Texas, southeast Texas and Louisiana for days
• Maximum sustained winds were 130 mph winds at landfall
• 51.88 inches of rainfall in southeast Texas, breaking the single-storm record of 48 inches set in 1978 and more than 10-year annual average
• More than 42,000 lightning strikes across electric service territory
• Harvey spawned tornadoes in southeast Texas, Louisiana, Alabama, Mississippi, Tennessee and North Carolina
6
CenterPoint Energy Proprietary and Confidential Information
Restoration Execution Restore Power Safely and Efficiently
7
1. Restore service to key facilities vital to public safety, health and welfare and secure downed power lines
2. Repair major lines and fuses that restore power to greatest number of customers in least amount of time
3. Repair transformers, which typically serve about 10 customers
4. Repair individual electric drops to homes
CenterPoint Energy Proprietary and Confidential Information
Impact of Grid Modernization Benefits of Advanced Metering System (AMS) and Intelligent Grid
• The Smart Grid, including distribution automation devices such as intelligent grid switches, allowed us to quickly isolate problems on our grid and restore service to customers through those devices. Operated more than 250 of these devices during the event impacting more than 140,000 customers Were able to avoid almost 41 million outage minutes for our customers 16.71 SAIDI minutes saved due to automation
• AMS meters increased efficiency during the storm Executed 45,000 orders remotely at 97% performance Billed 700,000 accounts with actual readings at 98.9% performance Executed remote turn off/on for safety reasons
• Use of real-time analytics to assess, monitor and resolve cases Aided in developing better situational awareness Allowed us to correlate weather and flooding information with outages, providing operations with critical
decision-making tools
8
CenterPoint Energy Proprietary and Confidential Information
Impact of Grid ModernizationUse of Technology during Storm
• Drones helped to assess damage and evaluate work conditions More than 500 locations were tracked using 15 drones Enabled real-time situational awareness, accelerating restoration assessments Allowed us to efficiently direct crews to accessible locations Infrared capabilities helped identify equipment that needed further inspection
• Mobile data on each crew kept outage management efficient• Ability to use Power Alert Service (PAS) to keep customers informed
AMS meters provide outage information that enables our predictive analytics engine to supply data to PAS and IVR systems, ultimately allowing for better, more detailed customer updates
• Memorial mobile substation Memorial substation impacted by several feet of water 50MVA mobile substation installed on private property in 7 days Provided service to more than 9,000 customers without power
• Flood wall at Grant substation helped protect service to Texas Medical Center9
CenterPoint Energy Proprietary and Confidential Information
Harvey by the NumbersElectric Operations Response
• 293 total electric circuits locked out and 4,494total electric fuses out
• 8 substations out of service and 9 substations inaccessible due to high water
• More than 2,200 employees plus 1,500contractors & mutual assistance personnel from7 states
• 308 SAIDI minutes with 1.2 millioncustomers impacted
• 755 million total minutes out over 10 days
10
CenterPoint Energy Proprietary and Confidential Information
Harvey by the NumbersElectric Operations Response
• 5 staging sites• 352,000 total hours worked
during EOP event (160 hours per employee)
• Approximately 85 crew spokespersons used
• 104,412 meals served
• More than 12,000 hotel rooms utilized
11
CenterPoint Energy Proprietary and Confidential Information
Harvey by the NumbersElectric Operations Response
• More than 1.27 million total restorations
• More than 1,200 safety orientations and 120 crew safety observations
• 36 air boats, 15 drones and 15amphibious vehicles used
12
CenterPoint Energy Proprietary and Confidential Information
Harvey by the NumbersGas Operations Response
• Responded to 8,246 gas emergency orders
• 130,016 gas meters assessed for damage
• Approximately 53,000 gas meters submerged under water that required remediation
• Approximately 460 crossings inspected of which 7 required remediation
13
CenterPoint Energy Proprietary and Confidential Information
Harvey by the NumbersGas Operations Response
• More than 1,050 EOP responders
• Mutual assistance resources from 4 states• Approximately 60 internal and contractor crews traveled to Sinton/Victoria area
(Day 1)
• Approximately 80 internal crews from Arkansas, Oklahoma and North Texas traveled to Houston (Day 5)
• Approximately 15 internal crews from Louisiana and adjacent Texas offices (Lufkin and Huntsville) traveled to Beaumont (Day 6)
• 21,168 meals served
• CNP coordinated with city of Beaumont to address breach in 18-inch gas pipeline under the Neches River A remote methane leak detector (RMLD) mounted on a drone to
check methane levels in Neches River Divers, air boats, drones and high-profile vehicles used during
response
14
CenterPoint Energy Proprietary and Confidential Information
Harvey by the NumbersGas Operations Response
• Inspected 863 stations • 83 submerged due to flood waters of which 75
required remediation Relief valves, debris removal, fencing
• Advanced Leak Survey Technology • Surveyed 554 miles in South Texas within five
days (wind impacted areas)
• Reviewed 83 photos for safety compliance before posting publicly
15
CenterPoint Energy Proprietary and Confidential Information
Harvey by the NumbersCustomer Service Response
• 176,193 calls to the call center
• 67,479 were answered by agents with IVR handling the remainder
• 352,629 outage notifications delivered through PAS service
• 22,257 new PAS enrollments
16
Customer Service
CenterPoint Energy Proprietary and Confidential Information
Harvey by the NumbersCustomer Service Response
• 160 Facebook posts that reached 1,095,314 people
• 566 tweets that reached 2,531,685 people
• 630,206 visits to CenterPointEnergy.com
• At the height of the storm, web traffic was more than 600% higher than average
• Translated more than 50communications into Spanish
17
Customer Service
CenterPoint Energy Proprietary and Confidential Information
Harvey by the NumbersCommunity Giving and Employee Support
• $1.25 million donated to Harvey recovery and relief efforts
• More than $125,000 donated to CNP Employees 1st Fund; company matching contributions up to $200,000
• Contributed $50,000 to city of Beaumont for special assistance
• 301 calls to the EOP Employee Assistance hotline
18
CenterPoint Energy Proprietary and Confidential Information
Harvey by the NumbersCommunity Giving and Employee Support
• 340 employees impacted with home or vehicle damage
• 34 responses from employees offering shelter to another employee
• 68 responses to CNP rideshare program
• 46 children cared for in EOP daycare at CNP Tower
19
Community Giving & Employee Support
CenterPoint Energy Proprietary and Confidential Information
Hurricane Comparisons
20
Year Name Cat. Winds - Sustained (mph)
Tropical Storm Wind Field (Miles)
Electric Outages Restoration
1983 Alicia 3 115 125 750,000 16 days
1989 Hugo 4 140 190 696,000 18 days
1992 Andrew 4 160 105 1.4 million 34 days
2004 Charley 4 150 170 874,000 14 days
2005 Katrina 3 125 230 970,000 6 weeks
2005 Rita 3 115 205 719,000 6 days
2005 Wilma 3 120 230 3.2 million 18 days
2008 Ike 2 110 450 2.15 million 18 days
2017 Harvey 4 130 270 1.27 million 10 days
CenterPoint Energy Proprietary and Confidential Information
Lessons Learned
• Logistics, Logistics, Logistics• Where’d this island come from? New Vehicles! What do we REALLY need?
• Remember your BCP and WAR in Emergency Operations• ICS Works…but you have to be Semper Gumby• Don’t over prepare for restoration you can’t do• Review your flood maps and flood plains• Who’s on first? What’s on second? I don’t know who’s on third!?• Deceleration
21
CenterPoint Energy Proprietary and Confidential Information
Harvey Video
Hurricane Harvey
22
LA TUNA CANYON FIRE
Christopher O. Vicino, Director of Security and Emergency Management
1
About the LADWP• Largest municipal water and power
utility in the nation.• Established more than 100 years ago. • Delivers water and electricity to 3.8
million residents and businesses.• 10,000+ employees• Revenue-producing proprietary
department, transfers a portion of its annual electric revenues to the City.
• Operations are financed solely by the sale of water and electric services.
• Capital funds are raised through the sale of bonds. No tax support is received.
• Five-member Board of Water and Power Commissioners.
2
LADWP Security Services Division• Proprietary security force• 305 FTEs
– 271 uniform positions– 7 investigators– 27 support staff
• 55 facilities • 14 facilities with contract
security• Fixed posts• Vehicle patrols• Air patrols
3
La Tuna Canyon Fire• September 1-9, 2017• 1,061 firefighters, 206 engines,
9 helicopters, 5 water tenders, and 4 dozers
• Governor declared a state emergency
• Largest wildfire in Los Angeles in 50 years
• 7,194 acres burned• 10 buildings destroyed• 5 injured• Cause of fire is still under
investigation
4
Impacted Facilities Verdugo Reservoir• Built in 1953• 105 acres• 98.9 acre feet of water• Floating plastic cover• Currently offline
5
Energy Control Center• Built in 1980• 81 acres• 34 Load Dispatchers• 20 Senior Load
Dispatchers• 116 total employees
6
7
8
9
10
11
Challenges/Lessons Learned
• Access roads cut off by fire • Some employees refused to evacuate • Firefighters unfamiliar with the ECC• Fire fueled by overgrown brush and high winds• National Incident Management System (NIMS)• Safety equipment
12
13