Introduction of information technology in metrology

Toshiyuki TAKATSUJINational Metrology Institute of Japan (NMIJ, AIST)

Hype Cycle for Emerging Technology, 2018

From Gartner

Hype Cycle

From Gartner

1. Innovation Trigger2. Peak of Inflated Expectation3. Trough of Disillusionment4. Slope of Enlightenment5. Plateau of Productivity

From Gartner

Deep Learning

IoT

Block Chain

Digital Twin

AR

General Electric• Predix (Industrial IoT Platform)

Predict failure of jet engine Optimization of flight path

Improve productivity,Reduce development time,and so on

For software 5 B$ sales in 2016 Expect 15 B$ in 2020

Measurement and sensor technology play indispensable roles.

Metrology vs Information Technology

Make use of IT for metrology Make use of metrology for IT

• Computer• Internet• 5G• AI

Sensors for• Self-driving• Health• Environment

Computer vs Optics in 1980s and 90s

Use Computer for Optics Use Optics for Computer

déjà vu: This must be the same path that we once walked along.

• Computer• Imaging device

• Optical computing• Fast Fourier Transform

Computer vs Optics in 1980s and 90s

Use Computer for Optics Use Optics for Computer

Quantum Computer ?

ü At that time, silicon computers were too slow.ü No one imagined the rapid growth of the speed and data capacity of the

computers.

ü FFT can be calculated in real time.ü Optical storage devices disappeared.

General Electric• Predix (Industrial IoT Platform)

10 M sensors for 28,000 enginesPredict failure of jet engine Optimization of flight path

Improve productivity,Reduce development time,and so on

For software 5 B$ sales in 2016 Expect 15 B$ in 2020

Measurement and sensor technology play indispensable roles.

The subsidiary company was sold in 2018.

StrategiesArea Strategy

Europe Industrie 4.0USA Industrial Internet

China MiC 2025Thailand Thailand 4.0

JapanConnected Industries

Society 5.0

Innovation in manufacturing

Smart society

Industrie 4.0• Low-lot, high-mix production• RF Tag

European Metrology Cloud

Blockchain• Bitcoin is the most famous application of Blockchain.• Various applications

• Food traceability• Safety confirmation service at the time of disaster• Electronic medical record sharing service• Any documents in a company can be recorded.

Hash function SHA-256

Easy

Very difficult

45bd90a529dcf134…..21256 digit binary number= 64 digit hexadecimal

A completely different number is created by just changing one digit.

(Irreversible function)

Structure of the blockchain

Previous hash Nonce

Block

Current hash

Block header

Block

Transaction

Previous hash Nonce

Current hash

Block header

Transaction

Calibration certificates

a) Whole view of traceability chain b) Reality for a user c) Ideal view for a user

DesignRecord of Current certificate

Encrypted information of parent certificates

ID of certificate

ID of laboratory

Digital signature of lab. EBD0 ... 5D7F

Tx_ID(1),( Tx_ID(2), ... )2

1

Hash of Encrypted Certificate

URL of Encrypted Certificate

Toshiyuki Takatsuji, et. al., Blockchain technology to visualize the metrological traceability, Precision Engineering, Volume 58, 2019, Pages 1-6

Metrology for IT or IT for Metrology• Perform ordinary metrology with the aid of IT

• So that, the job can be done efficiently and effectively.• Not many applications• Researchers in metrology area (metrologists) are interested in this

approach.

• Perform IT with the aid of metrology• Almost all big data is collected by sensors (metrology?).• Most people are interested in this approach.• A lot of applications

Brinell hardness

200 μm 200 μm

(d)(c)

40 μm 40 μm

(b)(a)

Convolutional neural network (CNN)

240

240

Fc1 Fc2

2048 2048

Output

Conv1

Conv2

Pool1Pool2 Pool3

InputOutput

Input

32 filters11x11 filter size Stride: 4

3x3 max-pooling Stride: 1

(240x240x1)

(60x60x32)

64 filters5x5 filter size Stride: 1

(29x29x64)

3x3 max-pooling Stride: 1

(14x14x128) (14x14x128) (6x6x64)

Conv3128 filters3x3 filter size Stride: 1

Conv4128 filters3x3 filter size Stride: 1

Conv564 filters3x3 filter size Stride: 1

3x3max-pooling Stride: 1

Comparison Image

CNN

RG

50 μm

200 HBW 400 HBW

100 μm

Region growing (RG) method

Comparison Image

CNN

RG

50 μm

100 HBW 550 HBW200 HBW

50 μm100 μm

Region growing (RG) method

Don’t rely too much on AI.• The logic between the input and output is unknown.• The result of the inference is not always correct.

IT applications using sensors• iPhone contains GPS, camera, air pressure, 3 axis gyro,

acceleration, proximity, and ambient light sensors.• Smart meters• Sensors on a car• CCTV

• Trillion sensors will be sold in 2023.

InsecamWeb cameras without password or using default password3,000 cameras can be seen. 60 from Thailand.

Security• Update firmware regularly• Don’t use default or easy password

http://www.datagenetics.com/blog/september32012/

PIN

1000 and 100 digits

10 a

nd 1

dig

its

19xx: year of birth? xyxy

1234

4321

8068

http://www.datagenetics.com/blog/september32012/

Security

Hidden chips ‘launch spam attacks from irons’

PC nearby will be infected.

https://www.bbc.com/news/blogs-news-from-elsewhere-24707337

Environment & social infrastructure Human life Social mechanism

Solve large scale & complex social issues

• Disaster• Environment• Aging infrastructure

ü Sustainable society

• Monitoring• Crime prevention• Health

ü Safe society

• Economics• Social issues

ü Society 5.0

uWide, deep, quick understanding by advanced, diversified, expanded metrologyuAppropriate treatment for privacy protectionuEvaluation and improvement cycle of social system based on social metrology

Wider applications and improvement of metrology

CRDS-FY2018-RR-03, Center for Research and Development Strategy, Japan Science and Technology Agency