iot data platforms...swarm data in kafka pipelines real-time traffic routing across an entire...
TRANSCRIPT
1 1
IoT Data Platforms Processing IoT Data with Apache Kafka™
2 2
Common Challenges with Internet of Things (IoT)
Systems are overwhelmed by dramatic increases in
data volumes
The range of connected devices is broad, no one
size-fits-all solution
Data streams must flow both in and out of devices
3 3
More than 1 petabyte of data in
Kafka
Over 1.2 trillion messages per day
Thousands of data streams
Source of all data warehouse & Hadoop data
Over 300 billion user-related events
per day
4 4
70% of active Kafka Committers
Founded September 2014
Technology developed while at LinkedIn
Founded by the creators of Apache Kafka
About Confluent and Apache Kafka™
Jay Kreps CEO
Cheryl Dalrymple CFO
Todd Barnett VP WW Sales
Neha Narkhede CTO, VP Engineering
Luanne Dauber CMO
Chrix Finne Head of Product
5 5
Kafka Adoption Spans Many Industries
Financial Services Enterprise Tech Consumer Tech
Entertainment & Media Telecom Retail Travel & Leisure
6 6
Connected Car and Swarm Intelligence Using Confluent
850 sensors feed onboard processors
Regional data centers capture swarm data in Kafka pipelines
Real-time traffic routing across an entire geographic
region
7 7
IoT Value Chain and Confluent Platform
Sensors Data
M2M Protocols
Local Data Ingestion
IoT
Gateways
Data Transmission
Confluent Platform
Data
Aggregation
Data Ingestion at Scale
Stream Processing
Reporting
Actionable Insights
8 8
The Confluent Advantage
Connect services via a shared distributed log
Handle unlimited stream of data
Backed by the people that created Kafka
Operate with confidence
9 9
Introducing Confluent CloudTM
A Way to Liberate Developers.
10 10
“ Public cloud services that require developers to program to proprietary
APIs will not succeed. ”
Neha Narkhede, Co-Founder and CTO at Confluent
https://www.confluent.io/blog/announcing-confluent-cloud-apache-kafka-as-a-service/
11 11
Centrica Connected Home, Hive Home, and British Gas
12 12
Kafka IoT
13 13
Confluent Platform: Enterprise Streaming based on Apache Kafka™
Database Changes Log Events loT Data Web Events …
CRM
Data Warehouse
Database
Hadoop
Data Integration
…
Monitoring
Analytics
Custom Apps
Transformations
Real-time Applications
…
Apache Open Source Confluent Open Source Confluent Commercial
Confluent Platform
Confluent Platform
Apache Kafka™
Core | Connect | Streams
Data Compatibility
Schema Registry
Monitoring & Administration
Confluent Control Center
Operations
Replicator | Auto Data Balancing
Development and Connectivity
Clients | Connectors | REST Proxy