ibm message hub€¦ · 3 insights from the data you already have streaming data architectures •...

27
© 2016 IBM Corporation James Bennett Offering Manager, IBM Cloud Integration IBM Message Hub

Upload: others

Post on 21-May-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

© 2016 IBM Corporation

James Bennett

Offering Manager, IBM Cloud Integration

IBM Message Hub

Page 2: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

The continued growth of PaaS

2

Page 3: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

Use cases

3

Hub for asynchronously connecting services inside Bluemix or beyond

1

plus other on-prem data sources

Page 4: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

From one service to another

4

Think of Message Hub as the conduit between your cloud services….

…taking data, in the form of messages, from one service to another

Page 5: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

5

2Microservices allow applications to evolve rapidly

• Innovate and adapt quickly: Deploy and scale microservicesindependently

• Flexibility: Work in a range of languages that suit you

• Reliability: Remove the interdependency between microservices

Supporting a microservices infrastructure

Page 6: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

Different approaches

Connecting external systems

Event driven

Worker offload

• Posting video to multiple social sites after transcoding

• Respond to external events

• Updating external booking app• Posting updates to twitter

• Image processing• Text analytics

6

Page 7: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

7Insights from the data you already have3

Streaming data architectures

• Consume data in your way: Run real time and batch analytics on the same data

• Adapt to change: React to changing trends as they happen

• Protection of valuable data: Acts as a buffer between your data and the analytics engine

Page 8: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

Use cases

8

Hub for asynchronously connecting services inside Bluemix or beyond

Insights from the data you already have

1 2

3

Microservices allow applications to evolve rapidly

plus other on-prem data sources

Page 9: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

© 2016 IBM Corporation

Which technology?

Page 10: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

Why Apache Kafka?

Fast: Responds to your needs

Scalable: Scales according to demands

Durable: Prevents data loss through replication

Distributed: Fault-tolerant

Used by companies including: ü LinkedInü Yahooü Twitterü Netflixü Spotifyü Pinterestü Paypalü Tumblr

Page 11: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •
Page 12: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •
Page 13: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •
Page 14: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •
Page 15: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

Why Apache Kafka as a managed service?

15

Option 1

• Deploy your own Kafka cluster

• Deploy Zookeeper cluster to support it

• Put systems in place to operate the service 24x7

• Keep up-to-date with the open source community

• Handle version-to-version migration and updates

Option 2

• Use Message Hub

Page 16: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

Why Apache Kafka as a managed service?

16

Option 1

• Deploy your own Kafka cluster

• Deploy Zookeeper cluster to support it

• Put systems in place to operate the service 24x7

• Keep up-to-date with the open source community

• Handle version-to-version migration and updates

Option 2

• Use Message Hub

Page 17: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

IBM Message Hub• A scalable, distributed, high-throughput message bus based on Apache

Kafka• Wide compatibility via 3 APIs : REST, Kafka and MQ Light API (coming soon)

• Tightly integrated with the IBM Bluemix platform

MQ Light APIAMQP

RESTful APIHTTP

Apache KafkaTCP

Streams

Bluemix Public

Bluemix Dedicated(Announced, GA March)

Bluemix Local(Coming soon)

Available for …

Page 18: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

© 2016 IBM Corporation

Why does this matter for MQ?

Page 19: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

Connecting to, or exposing IBM MQ for new applications

A wide selection of options, including but not limited too:• Using the MQ client / library to connect a new application

19

Page 20: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

A wide selection of options, including but not limited too:• Using the MQ client / library to connect a new application• Use the MQ Light client / library to connect a new application

20

Connecting to, or exposing IBM MQ for new applications

Page 21: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

A wide selection of options, including but not limited too:• Using the MQ client / library to connect a new application• Use the MQ Light client / library to connect a new application• Expose MQ data internally, or externally using the Hybrid Integration

Platform

21

Connecting to, or exposing IBM MQ for new applications

Page 22: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

HYBRID INTEGRATION

SaaS PaaSOn-Premise

CONNECT XFORM DELIVER COMPOSE EXPOSE

Data APIsAppsTH GS

IN

API MANAGEMENT

SECURE GATEWAY

INTEGRATION ENGINE

DESIGN - OPERATE - MANAGE - MONITOR - GOVERN

MESSAGE &EVENT STREAMS

Page 23: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

HYBRID INTEGRATION

SaaS PaaSOn-Premise

CONNECT XFORM DELIVER COMPOSE EXPOSE

Data APIsAppsTH GS

IN

API MANAGEMENT

SECURE GATEWAY

INTEGRATION ENGINE

DESIGN - OPERATE - MANAGE - MONITOR - GOVERN

MESSAGE &EVENT STREAMS

Page 24: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

IBM MQ à IBM Message Hub

Message Hub

MQ Light API REST

Secure GatewayTunnel

Enterprise Messaging & Integration

MQ ExplorerMQ ClientMQ Light API

IBM MQ Appliance

Kafka

Page 25: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

Digital IT Enterprise IT

Message Hub(Based on Apache Kakfa)

MQ Light API

MQ Light API

Hybrid Messaging

25

Enterprise Messaging & Integration

MQ ExplorerMQ ClientMQ Light API

Kafka API REST API IBM MQ Appliance

Bluemix Public

Bluemix Dedicated(Announced, GA March)

Bluemix Local(Coming soon)

Cloud

On-Prem

IBM MessageConnect

Page 26: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

Next steps

• Some light reading:– Kafka website– IBM developer website

• Getting hands on:– Message Hub– Message Connect

26

Page 27: IBM Message Hub€¦ · 3 Insights from the data you already have Streaming data architectures • Consume data in your way: Run real time and batch analytics on the same data •

© 2016 IBM Corporation

[email protected]