building providers & dags in the airflow ecosystem · datadog druid e (asol fcc±ook ads ftp g...
TRANSCRIPT
![Page 1: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/1.jpg)
Building Providers & DAGs in the Airflow Ecosystem
![Page 2: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/2.jpg)
Airflow 2.0 TrajectoryDemo ELT DAGBYO & ShareQ&A
![Page 3: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/3.jpg)
DAG
Provider
Module Module
![Page 4: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/4.jpg)
Airflow 1.0Single core package
Dependency hell
Scattered docs
Airflow 2.0Decoupled providers
Minimal dependencies
BYO provider framework
![Page 5: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/5.jpg)
DAG
Provider
Module Module
![Page 6: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/6.jpg)
🔗 Enhance the story of Airflow integrations
🤝 Help the community share and discover Airflow providers and DAGs
📈 Speed up the developer experience
👌Surface quality metrics and certifications
![Page 7: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/7.jpg)
Need to connect A to B...Where to start?
![Page 8: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/8.jpg)
![Page 9: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/9.jpg)
DEMO
![Page 10: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/10.jpg)
Contribute
![Page 11: Building Providers & DAGs in the Airflow Ecosystem · DATADOG Druid E (asol fcc±ook Ads FTP g RPG HTTp Jdbc SQU salesforce . ASTRONOMER REGISTRY Building Blocks for your Apache Airflow](https://reader035.vdocuments.net/reader035/viewer/2022071517/613b9bf0f8f21c0c826917c5/html5/thumbnails/11.jpg)
Q&A