kafka messaging javacro2019 ibm pdfv · •kafka basics •kafka use cases •java connector...
TRANSCRIPT
Integrating Kafka with Enterprise Java for establishing a high performant distributed messaging infrastructure
Anamarija Talijanac, Irena KezićIBM Services13th May, 2019
Integrating Kafka with Enterprise Java for establishing a high performant distributed messaging infrastructure
Anamarija Talijanac, Irena KezićIBM Services13th May, 2019
• Kafka basics• Kafka Use Cases• Java Connector Architecture• Distributed messaging challenges• Reliable Kafka Processing• IBM Event Streams
Agenda
© 2019 IBM Corporation
Architectural overview
© 2019 IBM Corporation
Architectural overview
© 2019 IBM Corporation
Kafka basics
HIGH THROUGHPUT
DURABILITY RELIABILITY SCALABILITY
© 2019 IBM Corporation
Kafka basics
6
• Cluster / Broker• Topic / Partition• Producer / Consumer
© 2019 IBM Corporation
Kafka Use Cases
7
• Activity tracking• Commit Log• Metrics and Logging• Unit of Order• Stream processing
© 2019 IBM Corporation
Java Connector Architecture
© 2019 IBM Corporation
• The Java EE standard for integrating application servers with EIS.• Unified common client interface for heterogeneous resource providers
Java Connector Architecture
© 2019 IBM Corporation
• Lifecycle management Contract• Work management Contract• Connection Management Contract• Transaction Management Contract• Security Contract• Transaction Inflow Contract• Message Inflow Contract• Generic Context Contract
Java Connector Architecture
© 2019 IBM Corporation
EXACTLY ONCE DELIVERY
GUARANTEED ORDER OF MESSAGES
RELIABLE MESSAGING
Distributed messagingchallenges
© 2019 IBM Corporation
BEGIN TRANSACTION
CONSUME MESSAGE FROM KAFKA TOPIC
INSERT ROW INTO TARGET DATABASE
COMMIT TRANSACTION
XA with Kafka
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
Reliable Kafka Processing
© 2019 IBM Corporation
IBM Event Streams
• IBM has years of operational expertise running Apache Kafka for Enterprises
• Event Streams makes Kafka easy to run, manage & consume, reducing skill requirements and raising speed of deployment for faster time to value
• Support you can Trust – IBM has decades of experience supporting the World’s toughest environments
© 2019 IBM Corporation
IBM Event StreamsVisualisation of your topic
data
Tools to boost productivity