mixed reality and offshore wind power: a powerful …new quest enjoy quest like game ~~~ quest...

1CDTI-NEDO Joint Workshop on Offshore Wind

CDTI-NEDO Joint Workshop on Offshore Wind

Kitakyushu, 8th of July 2019

Mixed Reality and Offshore Wind Power: A Powerful Combination

Saik Park

Section Manager

Hokutaku Co., Ltd.


In the Renewable Energy industry in Japan, Hokutaku Ltd. is a unique and independent service provider and specialized to service all models of global wind turbine OEM’s installed in Japan. With its customer focus, longtime experience & know how in Renewables, comprehensive service approach and fast reaction, Hokutaku Ltd. has been able to establish long-lasting and trusting relationship with its customers. Hokutaku Ltd. has its head office with a warehouse and test facilities in Asahikawa, Hokkaido, and branch office with 2nd warehouse & test facilities in Kitakyushu, Fukuoka. In addition, branch office equipped in the same way will be built in Fukushima shortly.

Find out more here: http://www.hokutaku-co.jp/index.html

Hokutaku Co., Ltd.

SCADA Engineer

・Worked with Mita-Teknik on installation and configuration of new software for SCADA platforms

・ Followed up customer issues and performed necessary troubleshooting, fault finding and diagnostics

Wind Turbine Maintenance Technician

・ Performed scheduled and unscheduled maintenance on wind turbines: NEG Micon, Vestas, Nordex, Lagerwey, Mitsubishi and Hitachi

Saik Park

http://www.hokutaku-co.jp/index.html


Key Challenges Facing Offshore Wind Farm Maintenance

Source: Under the Wave off Kanagawa, Katsushika Hokusai https://rijks-web.azurewebsites.net/en/collection/RP-P-1956-733

We Can Solve This by Mixed Reality

https://rijks-web.azurewebsites.net/en/collection/RP-P-1956-733


What is Mixed Reality (MR)?

AR VRMRAugmented Reality

Mixed Reality

Pokemon GO IKEA Place

Technology to superimpose information on world we see

Artificial environment that is created with software

Virtual Reality

Result of blending physical world with digital world

PlayStation VR


New Maintenance Strategy: Mixed Reality Application


Development of Mixed Reality Application for Offshore Wind

MR Hololens Screen

Wind Turbine Nacelle


Scheduled Preventative-Maintenance using Mixed Reality

Vestas controllerSiemens controllerGamesa controllerGE controller…Source: Hokutaku Hibiki Wind Farm

Vestas V80

Push the PAUSE button, ~~~

No matter turbine brands, Easy to use turbine controllers

Source: Hokutaku Minamiizu Wind FarmMicon 400kW

Push * and PAUSE button together, ~~~



Air filter on hydraulic power unit

Intuitive understanding and Helping newly hired technician

Pressure valve

Air breather filter

Gear oil filter

Off-line filter

Relief valve

Brake pressure switch

… … …



Safety tips & advice help make our workplace safe

Watch Your Head

Electrical Hazard

Danger: Live WireKeep Off

How to Escape Lift

xxxxxxx******oooooo

Wear HarnessAnd Double Lanyard



No need to bring all documents to turbine nacelle

Avatar-bot

Screen size adjustment

File and Documents download

Connect to server and search

e.g. Pressure/Torque Conversion Chart



Pop-up pictures make observation easy and effective

2 years ago

1 year ago

Present

e.g., Keeping an eye on condition for Grease Leakage problem



Have better life reducing time to create report

Photo reportCheck sheet

Video



Better experience across accessing and operating PC

e.g., Remote access to Inventory Management System or Field test software,Remote access to SCADA or specified PC, etc.

Virtual screen by remote access



Video game experience can change work life

Source: Final Fantasy XIV

Bolt Tightening

New Quest

Quest

Move to Main Bearing

Prepare Hydraulic Pump and Torque Wrench

Check Pressure/Torque Conversion Chart

Set Pressure in Pump

Set Hydraulic Torque Wrench

Operate Pump and Torque Wrench

☑

☑

☑

☑

☑

☑New Quest Enjoy quest like game~~~ Quest Complete



Make perfect preparation for specific work

- Tool List for replacement of Yaw Brake System- Tool List for ~~~

Source: Microsoft Hololens

Tool List Display

C-ring pliers(long bend type)

Insulated screwdriver3mm tip

… … …

(sample)



MR Hololens Screen

In warehouse


Maintenance Training Course using Mixed Reality

Offer the most appropriate training method before climbing turbine

Bringing turbines into Office


Training for Scheduled maintenance and Unscheduled maintenance


Maintenance Training Course using Mixed Reality

Practice makes perfect

SAFETY FIRST


Simulation training, Pre-Safety inspection, …

Scenario-based simulation training

Proper tool selection

Pre-Safety inspection



MR Hololens Screen

Wind Turbine Nacelle


Remote Assistance using Mixed Reality

Transceiver OFF and Hololens ON, Make life easier

Scheduled / Unscheduled maintenance with Hololens

Effective communication and Intuitive instruction

Source: Trimble

Live Video

Photo

Chat

Co-worker



Real-time collaboration and troubleshooting

Trouble

Report

Support


Proper instructionby remote marker

Live video stream



1) Due to jack up from jack-up vessel2) By anchor3) Due to cable bent (kink)

Source: https://www.maritime-executive.com/article/somalia-detains-boxship-over-cut-internet-cable

Undersea cable damage

Redundant Communication Device

Automatic switch across network

Suitable for all communication: ADSL, Optical network, 3G, 4G, 5G and Satellite internet

Optical5G

4G

Satellite

Appendix

https://www.maritime-executive.com/article/somalia-detains-boxship-over-cut-internet-cable