artificial intelligence applications in renewable energy · 2020. 8. 25. · title: artificial...

34
Artificial Intelligence Applications in Renewable Energy Grant Buster AI in Energy: Advancing New Research Paradigms August 17, 2020

Upload: others

Post on 09-Mar-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

Artificial Intelligence Applications in Renewable Energy

Grant BusterAI in Energy: Advancing New Research ParadigmsAugust 17, 2020

Page 2: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

Messaging + Blue Infographic

Content

NREL | 2

\

SolarWind Water

Geothermal

RenewablePower

Bioenergy

Vehicle Technologies

Hydrogen

Sustainable Transportation

Buildings

Advanced Manufacturing

Government Energy Management

Energy Efficiency

Grid IntegrationHybrid Systems

Energy SystemsIntegration

NREL Science Drives Innovation

Page 3: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 3

The National Solar Radiation Database (NSRDB)

Page 4: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 4

The Wind Integration National Dataset (WIND Toolkit)

Page 5: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 5

Artificial Intelligence (AI) Today

Where are we?

Page 6: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 6

Google DeepMind’s AlphaGo

Game of Go:361 possible moves3361 unique board states

https://deepmind.com/research/case-studies/alphago-the-story-so-farhttps://www.youtube.com/watch?v=WXuK6gekU1Y

Page 7: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 7

Tesla as a Utility: Autobidder

“Autobidder provides independent power producers … the ability to autonomously monetize battery assets”

https://electrek.co/2020/06/15/tesla-officially-approved-electric-utility-uk-why/https://electrek.co/2020/05/03/tesla-autobidder-new-product-electric-utility/

Page 8: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

AI Applications at NREL

Page 9: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 9

Limitations of Mechanistic Cloud Models:

Page 10: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 10

Using Theory to Guide Learning:Physics-Guided Neural Networks (phygnn)

𝐿𝐿𝐿𝐿𝐿𝐿𝐿𝐿 = 𝜆𝜆0𝐿𝐿𝐿𝐿𝐿𝐿𝐿𝐿 �𝑌𝑌,𝑌𝑌 + 𝜆𝜆𝑝𝑝𝐿𝐿𝐿𝐿𝐿𝐿𝐿𝐿𝑝𝑝( �𝑌𝑌)

Example neural network loss surfacehttps://www.cs.umd.edu/~tomg/projects/landscapes/

Open source: https://github.com/NREL/phygnn

Page 11: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 11

phygnn: reduces error, improves data product

Page 12: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 12

Original Data

Improved Data

Page 13: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

What about in the field?

Page 14: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

Geothermal Operational Optimization with Machine Learning

Partnership between:

Page 15: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 15

Step 1: Build a Digital Twin

Page 16: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 16

Step 2: Hindcast Validation

Steam Delivery Power Generation

Page 17: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 17

Step 3: Reinforcement Learning

Action

Reward +Observation

Agent(s)

Environment

Page 18: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 18

Reinforcement Learning Experiment #1:

Agent controls:- Line Pressures- Wells

Page 19: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 19

Lessons Learned

• Centering the reward at zero is an example of bad reward shaping (at least for this environment)

• The agent learned how to terminate the episode quickly to get the least amount of negative reward

Page 20: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 20

Lessons Learned

• Centering the reward at zero is an example of bad reward shaping (at least for this environment)

• The agent learned how to terminate the episode quickly to get the least amount of negative reward

• In other words, the negative reward shaping affected the agent’s will to live!

Page 21: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 21

Reinforcement Learning Experiment #2

Agent controls:- Line Pressures- Wells

Improved:- Rewards- Termination

conditions

Page 22: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 22

Agent Exploration in Action!

Page 23: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 23

Agent Exploration in Action!

Page 24: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 24

Agent Exploration in Action!

Page 25: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 25

Agent Exploration in Action!

Page 26: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 26

Agent Exploration in Action!

Page 27: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 27

Agent Exploration in Action!

Page 28: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 28

Agent Exploration in Action!

Page 29: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 29

Agent Exploration in Action!

Page 30: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 30

Agent Exploration in Action!

Page 31: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 31

Agent Exploration in Action!

Page 32: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 32

Agent Exploration in Action!

Page 33: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

NREL | 33

Agent Exploration in Action!

Page 34: Artificial Intelligence Applications in Renewable Energy · 2020. 8. 25. · Title: Artificial Intelligence Applications in Renewable Energy Author: Grant Buster Subject: Addressing

www.nrel.gov

Thank you

This work was authored by the National Renewable Energy Laboratory, operated by Alliance for Sustainable Energy, LLC, for the U.S. Department of Energy (DOE) under Contract No. DE-AC36-08GO28308. This material is based upon work supported by the U.S. Department of Energy’s Office of Energy Efficiency and Renewable Energy (EERE) under the Geothermal Technology Office Award Number DE-EE0008766 and the Solar Energy Technologies Office (Systems Integration Subprogram) Contract Number 36598. The views expressed in the article do not necessarily represent the views of the DOE or the U.S. Government. The U.S. Government retains and the publisher, by accepting the article for publication, acknowledges that the U.S. Government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this work, or allow others to do so, for U.S. Government purposes.

[email protected]://www.linkedin.com/in/grant-buster/

Solar Data Team:Mike Bannister, Aron Habte, Dylan Hettinger, Galen Maclaurin, Michael Rossol, Manajit Sengupta, and Yu Xie

GOOML Team:Andy Blair, Jay Huggins, Ross Ring-Jarvi, Michael Rossol , Paul Siratovich, Nicole Taverna, Jon Weers

NREL/PR-6A20-77593