google cloud next'17 정리
TRANSCRIPT
YongYoon.�SHIN�ETRI�
http://uni2u.tistory.com
Google�Cloud�Next�2017
What’s�NEW?�What�is�Google�Cloud�thinking�about?
Let’s�Together• OverView�
• Google�Cloud�Acquisitions�
• Google�Cloud�Security�
• Google�Cloud�Platform�
• Data�Analytics�
• Database�Services�
• Machine�Learning�Services�
• Pricing�&�Support�
• Developer�Platform�&�Tools�
• Infrastructure
History• Google�Cloud�Next�2017�(2017.03.08.�~�03.10.�San�Francisco)�
• 12,000+�attendees�
• 200+�sessions�
• Google�Cloud�platform�Services�
• GCP,�G�Suite,�Chrome,�Maps�and�Education�
• https://cloudnext.withgoogle.com/�
• https://www.youtube.com/playlist?list=PLIivdWyY5sqI8RuUibiH8sMb1ExIw0lAR
kaggle�AppBridge
AppBridge�인수
• 기업의�Google�Cloud�도입을�위함�
• AppBridge�(https://www.appbridge.io/)�
• Share�point,�Exchange,�On-Premises�등�파일�스토리지에서�G�Suite�및�Google�Drive로�마이그레이션�
• 드롭박스나�MS의�원드라이브�등�기업용�파일�동기화�및�공유�서비스
Identity-Aware�Proxy�(IAP)�Data�Loss�Prevention�(DLP)�
Key�Management�Service�(KMS)�Security�Key�Enforcement�(SKE)�
Google�Vault�Titan
Cloud�Identity-Aware�Proxy• Cloud�IAP�(Cloud�Identity-Aware�Proxy)�
• https://cloud.google.com/iap/�
• Google�Cloud�Paltform�에서�실행되는�클라우드�Application�Access�제어�
• VPN을�사용하지�않고�Application에�접근�
• 어디서나�안전한�Application�Access�
• 사용자,�ID,�Group�별�Access�제한�
• 통합�피싱�방지�보안�키�배포
Data�Loss�Prevention�API
• DLP�API�(Data�Loss�Prevention�API)�
• https://cloud.google.com/dlp/�
• 주요�데이터�관리�
• 패턴,�형식�식별을�위한�API�제공�
• 미리�정의�된�식별자�(40+)를�사용하여�데이터�분류�
• 텍스트�및�이미지�지원
https://cloud.google.com/sensitive-data-classification/demo/#/�https://storage.googleapis.com/gweb-uniblog-publish-prod/original_images/DLP_API_Presentation_2.gif
Cloud�Key�Management�Service
• Cloud�KMS�(Cloud�Key�Management�Service)�
• https://cloud.google.com/kms/�
• 클라우드에서�사용할�암호화�키�생성,�삭제,�관리
Security�Key�Enforcement
• SKE�(Security�Key�Enforcement)�
• https://cloud.google.com/security-key/�
• G�Suite�및�GCP�리소스�접근을�위한�보안키�
• 2단계�인증�
• USB�타입의�키�버튼
Vault�for�Google�Drive
• Vault�(Google�Vault)�
• https://gsuite.google.com/products/vault/�
• G�Suite를�위한�eDiscovery�및�아카이빙�솔루션�
• Vault를�사용하여�G�Suite�라이프�사이클�관리�
• 도메인에서�G�Suite�데이터�검색�
• 이메일�및�채팅�기록�보관
Titan
• 하드웨어�레벨의�인프라�액세스를�위한�인증�칩�
• 특수�목적�칩�
• 데이터�센터의�물리적�보안�
• 클라우드�인프라에�대한�물리�장치간�액세스를�위한�인증�칩
BigQuery�Data�Transfer�Service�Cloud�Dataprep�
New�Commercial�Datasets�Google�Cloud�Dataflow�Google�Cloud�Datalab�Google�Cloud�Dataproc
BigQuery�Data�Transfer�Service
• Fully�managed�data�import�service�for�Google�BigQuery�
• https://cloud.google.com/bigquery/transfer/�
• Google에서�관리하는�모든�광고�데이터�세트�쿼리�
• Google�Adwards,�DoubleClick�Campaign�Manager,�DoubleClick�for�Publishers,�YouTube�콘텐츠�및�채널�보고서에서�데이터�쿼리
Cloud�Dataprep
• Intelligent�Data�Preparation�
• https://cloud.google.com/dataprep/�
• 전용�데이터�엔지니어�리소스�없이�분석을�위한�데이터�시각화
New�Commercial�Datasets
• 상업용�데이터�셋�제공�
• Xignite:�금융�시장�데이터�
• HouseCanary:�주거용�부동산�평가�데이터�
• Remine:�주택�판매�시기�예측�데이터�
• AccuWeather:�과거�기상�데이터�
• Dow�Jones:�뉴스�아카이브
“Google�Cloud�is�making�Dow�Jones’�world-class�content�and�
data�easier�to�access�than�ever�before.�This�will�enable�
analysts�and�developers�to�use�modern�data�analytics�and�
machine-learning�tools�to�integrate�business-critical�
information�into�their�workflows.”�
—�Clancy�Childs,�Chief�Product�&�Technology�Officer,�Dow�
Jones
Python�for�Google�Cloud�Dataflow
• Cloud�Dataflow�
• https://cloud.google.com/dataflow/�
• 파이프�라인�처리를�위한�서비스�
• 일괄�처리�및�스트림�실행�
• Java�환경만�지원하였으나�Python�SDK�추가�지원
Stackdriver�Monitoring�for�Cloud�Dataflow
• Google�Stackdriver�
• https://cloud.google.com/stackdriver/�
• GCP�및�AWS의�Application에�대한�모니터링�및�진단�
• 모니터링�과�Dataflow�통합�
• Cloud�Dataflow�에�접근하여�분석하고�특정�Dataflow�작업�조건에�대한�경고�생성
Google�Cloud�Datalab
• Google�Cloud�Datalab�
• https://cloud.google.com/datalab/�
• 대화형�워크�플로우�
• python�및�SQL�등�사용�
• Jupyter�노트북�기반�환경�
Cloud�Dataproc
• Cloud�Dataproc�
• https://cloud.google.com/dataproc/�
• Spark,�Flink,�Hadoop�파이프�라인�관리�
• 대규모�데이터�세트�처리
Cloud�SQL�for�Postgre�SQL�Microsoft�SQL�Server�Enterprise�
Cloud�SQL�for�MySQL�improvements�Cloud�Spanner�
SSD�persistent-disk�performance�improvements�Federated�query�on�Cloud�Bigtable
Cloud�Spanner
• SQL�DB�서비스�
• 자동화된�수평확장�기능을�제공하는�관계형�DB�
• 내부적인�동작�방식은�보이지�않음�
• 3�노드�형식으로�셋팅하는�경우�읽기�초당�3만�쿼리/쓰기�초당�6천�쿼리�성능�주장
Cloud�Machine�Learning�Engine�Cloud�Video�Intelligence�API�
Cloud�Vision�API�Machine�learning�Advanced�Solution�Lab�
Cloud�Jobs�API�Machine�Learning�Startup�Competition
Cloud�Machine�Learning�Service• Cloud�Machine�Learning�Service�
• https://cloud.google.com/products/machine-learning/�
• https://cloud.google.com/ml-engine/�
• 분산�클라우드�머신�러닝�
• 몇시간�이내로�Terabytes�단위�모델링�
• GCP와�통합되어�TensorFlow,�Google�Dataflow,�BigQuery,�Cloud�Datalab�확장�활용
Cloud�Video�Intelligence�API• Cloud�Video�Intelligence�API�
• https://cloud.google.com/video-intelligence/�
• 동영상을�실시간으로�분석하여�장면전환�시점,�분위기,�출연중인�사물�등을�분석하여�데이터를�제공�
• ML�(Machine�Learning)�API�공개�(Vision�API)�
• 쉽게�사용할�수�있도록�API�가공�
• 퍼포먼스�및�커스텀�선택�가능�
• GPU�장착�Compute�Engine�추가�
• 시간당�0.7$�(상당히�고가)
https://cloud.google.com/video-intelligence/
Cloud�Vision�API
• Cloud�Vision�API�
• https://cloud.google.com/vision/�
• 다양한�이미지�세트�분류�
• Label�detection�
• Explicit�Content�Detection�
• Face/Logo/Landmark�Detection�
• Integrate�REST�API
Machine�Learning�Advanced�Solutions�LAB
• ASL�(Machine�Learning�Advanced�Solutions�LAB)�
• https://cloud.google.com/asl/�
• Google의�ML�전문가와�직접�협력하여�ML�적용
Cloud�Jobs�API
• Cloud�Jobs�API�
• https://cloud.google.com/jobs-api/�
• 구직자가�찾고있는�최적의�일자리�매칭
Google�AppEngine�Flex�Cloud�Functions�
Firebase�integration�with�GCP�Cloud�Container�Builder�
Community�Tutorials
App�Engine�Flexible�Environment• App�Engine�Flexible�
• https://cloud.google.com/appengine/docs/flexible/�
• Runtime�
• Java8/Servlet3.1/Jetty9/Python2.7/Python3.5/Node.js/Ruby/PHP/.NET/GO�지원�
• Infrastructure�Customization�
• Libraries�Customization�
• Performance�
• 응용�프로그램의�각�인스턴으세�필요한�CPU,�메모리�지정
Cloud�Functions• Serverless�Architecture�
• https://cloud.google.com/functions/�
• Cloud�Pub/Sub�&&�Cloud�Functions�(GCF)�
• Cloud�Pub/Sub�
• 이벤트�발신자에서�수신자로�전달하는�역할�
• Cloud�Source�Repo�PUSH�event/Cloud�Logging�event�
• GCF�
• 전달과정에서�실제�동작�수행�
• Node.js�만�지원
Cloud�Container�Builder
• Container�Builder�
• https://cloud.google.com/container-builder/�
• 배포�환경에�관계없이�GCP에�Docker�컨테이너�구축�
• 소프트웨어를�컨테이너에�패키징
Pricing
preemptible�instance• 선점(preemptible)�인스턴스�
• 남는�자원을�임시로�사용하는�요금제�
• 남아있는�구글�클라우드�리소스�일시�사용�
• standard-1�(1vCPU�+�3.75GB)�
• 기본가격:�44.53$�
• 지속사용에�대한�할인�적용:�31.17$�
• 1년�약정:�25.29$�
• 3년�약정:�18.07$�
• 선점�인스턴스:�9.67$�
• 단점�
• 인스턴스�실행시�최대�24시간�사용�(24시간�이전에�서버�종료)�
• 만약에�다른곳에서�더�많은�자원을�요청하면�해당�서비스가�종료
- 선점�인스턴스�사용�예�페르미랩�- 16만개의�vCPU�,�320�TB�RAM�을�사용하는데�시간당�1400$�- 대규모로�선점�인스턴스�사용하여�최대�80%까지�할인
New�Data�Center�Region
New�Region
2017.03.28.�신용윤�올림