Jaeyong Chung

System-on-Chips (SoC) Laboratory

Incheon National University

Capstone Design

Lecture 1

Course Information

Schedule

Mon 6:00pm - 8:40pm (SI318)

Instructor

Jaeyong Chung (정재용, jychung@inu.ac.kr)

Office : 454, 4th floor, Building 8

Tel : 032-835-8458

Office Hours : 1 hour after lecture class, or by appointment

(send email to schedule an appointment)

Website: https://esc.inu.ac.kr

Chung Capstone Design 2

Before Class Starts..

Course Website

https://sites.google.com/site/epc6067/

Code of Ethics

Chung Capstone Design 3

Grading

Assignment (20%), 작품 Consulting 1회포함

Attendance (20%)

Intermediate Evaluation (20%)

Final Evaluation (40%)

Chung Capstone Design 4

Assignment #1

Explore Ideas (due on 3/19)

크라우드펀딩사이트 (예, kickstarter), 각종경진대회에서캡스턴디자인수업수준에서구현가능한전자/컴퓨터공학관련우수제품/서비스/작품들에대해조사해보시오

주안점

어떤시장을타깃하는가?

신시장창줄 /기존시장타깃

차별화요인은무엇인가?

어떤기술이사용되었는가?

인당한가지아이템

팀별발표

Chung Capstone Design 5

What is a capstone?

A capstone is literally, “one of the finishing or

protective stones that form the top of an exterior

masonry wall or building

Chung Capstone Design 6

Capstone Design

In the “smartphone” era (i.e., 2007 ~ 2016),

+

Chung Capstone Design 7

“Everything is better with Bluetooth”

https://www.youtube.com/watch?v=0KXoBcQER_0

Chung Capstone Design 8

블루투스마이크 & LED 미러볼

Chung Capstone Design 9

Capstone Design

In the “AI & IoT” era (i.e., 2017 ~ ),

Chung Capstone Design 10

IoT Enablers

Bluetooth Smart (Low Energy)

Beacon (Background scan)

System-on-chips

Smaller form factor

Lower power

Lower cost

Standard

These allow us to make

For example, a sensor swarm (i.e., many sensors)

https://www.youtube.com/watch?v=lniACfnHwVM

https://www.youtube.com/watch?v=uoOXRa8DXTM

Chung Capstone Design 11

IoT Hardware Platforms

http://postscapes.com/internet-of-things-hardware

Tinyduino ($18) PanStamps ($19)RFduino (built-in BLE)

Raspberry Pi Zero ($5) Intel Edison (Built-in WIFI and BLE)

Samsung Artik (built-in BLE)

Photon Built-in WIFI ($19)

Chung Capstone Design 12

Intel’s Lightshow

https://www.youtube.com/watch?v=eZ-js5zn-

I0&t=177s

https://www.youtube.com/watch?v=fCd6P7Ya1

60

Chung Capstone Design 13

블루투스응원봉

https://www.youtube.com/watch?v=gqgTh0GqDak

https://www.youtube.com/watch?v=2F634B1lM5M

Chung Capstone Design 14

인공지능과딥러닝

인공지능및딥러닝에대한전세계적관심 “전세계 AI 열풍…. 구글페이스북알리바바, 선도권경쟁치열”

알파고와이세돌의바둑대결후국내에서도딥러닝에대한관심의급격한증가

딥러닝은인공지능열풍을일으킨인공신경망기반의기계학습알고리즘

단순유행이아닌확실한실체가존재 빅데이터 + GPGPU등컴퓨팅성능향상 + 새로운아이디어

영상인식, 음성인식, 자연어처리등의성능의급격한향상

“4차산업혁명의꽃, 인공지능“

다양한산업에서적용되어보다나은서비스, 제품을만들어낼것

Chung Capstone Design 15

딥러닝응용

Image Captioning [Stanford] Object Detection

[Faster R-CNN]

Drive cars [Nvidia]

Medical Apps

[Lunit Inc]

► AlphaGo (1920 CPU +

280 GPU = 262KW)

► Lee, se-dol (20W)Neural Machine

Translation/Photo

Face Tagging

[Facebook]Commerce

[Amazon]

Chung Capstone Design 16

Machine Learning in Cloud

https://www.ibm.com/watson/developercloud/services-

catalog.html

Chung Capstone Design 17

When Cloud Is Problematic

Chung Capstone Design 18

Internet connections may not be available

Wireless connections are often not robust

Internet connections are often expensive

Wireless connections consume significant power

Short battery Life

Cloud is often not responsive

Long latency

Response time is not guaranteed

Hardware for Embedded Deep Learning

NVIDIA Jetson TK1 가격: 27만원2GB memory

NVIDIA Jetson TX1가격: 80만원4GB memory

Odroid-XU4가격:7만원Mali-T628 MP6 (OpenGL ES

3.0/2.0/1.1 and OpenCL 1.1 Full

profile)

Chung Capstone Design 19

(Recommended)

Software for Embedded Deep Learning

Chung Capstone Design 20

Google’s platforms

Tensorflow (for servers, +lot of resources, -difficult to program)

Tensorflow-lite (for mobile)

Facebook’s platforms

Pytorch (for servers, +easy to program, -less resources)

Caffe2 (for mobile)

From academy

Caffe (+stable, lot of resources)

AI Cat Chaser

https://devblogs.nvidia.com/parallelforall/ai-cat-chaser-jetson-tx1-caffe/

Chung Capstone Design 21

Self-Driving MarioKart

http://kevinhughes.ca/blog/tensor-kart

Chung Capstone Design 22

AI Camera in LG V30S

Chung Capstone Design 23

Dart: The world’s smallest Laptop Adaptor

Chung Capstone Design 24