introdução ao aws data pipeline
DESCRIPTION
Deck de slides do webinar sobre o serviço AWS Data Pipeline, um orquestrador orientado a dadosTRANSCRIPT
![Page 1: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/1.jpg)
Introdução ao AWS Data Pipeline:
ETL na Nuvem da AWS
José Papo
AWS Tech Evangelist
@josepapo
![Page 2: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/2.jpg)
![Page 3: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/3.jpg)
Amazon S3
Amazon
DynamoDB
Amazon
RDS
Amazon
Redshift
On
Premise
HDFS
(Amazon EMR)
![Page 4: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/4.jpg)
Amazon S3
Amazon
DynamoDB
Amazon
RDS
Amazon
Redshift
On
Premise
HDFS
(Amazon EMR)
![Page 5: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/5.jpg)
Amazon S3
Amazon
DynamoDB
Amazon
RDS
Amazon
Redshift
On
Premise
HDFS
(Amazon EMR)
![Page 6: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/6.jpg)
Amazon S3
Amazon
DynamoDB
Amazon
RDS
Amazon
Redshift
On
Premise
HDFS
(Amazon EMR)
![Page 7: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/7.jpg)
Input Datanode
Activity
Output Datanode
![Page 8: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/8.jpg)
Input Datanode com validação de pré-condição
Atividade com notificações de falha ou delay
Ouput Datanode
![Page 9: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/9.jpg)
![Page 10: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/10.jpg)
Amazon S3
logs
Custom
Precondition
EMR usage-by-geo job
Amazon EC2
report generation
Amazon
DynamoDB
event data
Amazon RDS
demographics
Amazon Redshift
DW table
Amazon
Redshift
DW table
Hive
script
![Page 11: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/11.jpg)
Amazon S3
logs
Custom
Precondition
EMR usage-by-geo job
Amazon EC2
report generation
Amazon
DynamoDB
event data
Amazon RDS
demographics
Amazon Redshift
DW table
Amazon
Redshift
DW table
Hive
script
![Page 12: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/12.jpg)
Nós gerenciamos Você gerencia
Instancias
EC2
EMR Clusters Recursos On Premise
Instancias
EC2
EMR Clusters
![Page 13: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/13.jpg)
![Page 14: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/14.jpg)
Na AWS On Premises
Alta Frequencia $1/mês $2.50/mês
Baixa Frequencia $.60/mês $1.50/mês
![Page 15: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/15.jpg)
DEMO!
![Page 16: Introdução ao AWS Data Pipeline](https://reader033.vdocuments.net/reader033/viewer/2022052906/558d23abd8b42a600a8b4780/html5/thumbnails/16.jpg)
OBRIGADO! awshub.com.br
slideshare.net/AmazonWebServicesLATAM
José Papo
AWS Tech Evangelist
@josepapo