ibm mq v8 enhancements

© 2014 IBM Corporation

Messaging across IT: IBM MQ V8 enhancements

Leif Davidsen – Senior Product Manager, IBM MessagingIBM Hursley [email protected]


The need for connectivity is growing

• Connectivity in business infrastructure is increasing – More information, more systems, more

services, deployed anywhere

• New sources of data are changing the world– However data without connectivity

becomes a burden not an asset

• Connect systems together– Deliver timely updates of targeted data– Gain business insight

– Applications and data change from growing costs to valuable assets

2


The challenge of using data to grow value

• Multiple data sources write massive amounts of information into storage– Challenge of useful off-line analysis grows

by the second once the data is committed to disk

• Extracting value from customer or transaction data is greatest as it is created– Realize the greatest value by moving the

data to where it can be consumed

– Movement must be rapid, reliable and secure to protect the integrity and security of the data

– Every second more data is being created – it becomes even more urgent to move it to where it can provide value

3


Moving data – where does it need to go?

• Systems are dynamic – new applications, new sources of data, new consumers of data– The challenge of delivering data to meet changing demands

needs a flexible infrastructure

• Roll-your own code in the applications

– Increases cost, time and complexity, but can deliver the code where you need it

• Storing the data in a database or file

– Creates a permanent record, but does nothing to provide timely analysis

• A messaging infrastructure can meet both needs– Keeps the application simple and able to adapt to change

– Can deliver filtered information to consuming applications, and also deliver to a permanent information store

4


Why Messaging is still important…do these sound familiar?

•Failures still happen - application and network – cloud and mobile especially

•Don’t try to handle these failures in your business application logic –

•Moves any type of data and any type of system, device or environment, with a common shared API

•Configurable: Persistence, Performance, Management, Security, etc.

“business transactions must happen only once”

“adding new services or applications is unpredictable”

“change is relentless”

“need to adopt new industry standards”

“must become more agile”

“losing data costs time money and reputation”

“business insight is key in today’s market”

“consumer interaction is forcing us to respond faster”

“we need to become more event driven”

Here is why messaging is important…

“our applications are getting too complex”“we need to recover from IT

failures better”

5


IBM Messaging – Market segments

Deliver Messaging Backbone for EnterpriseFocus on traditional MQ values, rock-solid enterprise-class service, ease-of-operation, breadth of platform coverage, availability, z/OS exploitation

Capture Big Data from Mobile and Internet of ThingsFocus on Internet-scale events, m2m device enablement, zero-admin, security and privacy, feed into real-time analytics, location-based notifications

Enable Developers to build more scalable, responsive applicationsFocus on new app dev use cases, breadth of languages, ease-of-deployment, lightweight services, integration with developer frameworks

6


So what is IBM MQ?

• Messaging you need– Simplifies applications, no need for complex connectivity logic or error

handling

– Scales from single application deployments to billions of messages per day

– Connects from the mainframe to the mobile and the Internet of Things, moving data from applications, files and services

– Most widely deployed enterprise messaging solution with the largest ecosystem and set of skilled practitioners

• Messaging as you need it– A secure messaging environment, with your customer and business data

encrypted end to end

– Built-in High Availability with automated failover

– A single point of visibility and control for the data flowing through your business

– Reliable, robust movement of data with transactional integrity

7


What does IBM MQ do?Provides messaging services to applications and Web services that need to exchange data and events with:

Universally supported by multiple platforms20 years leading in transactional message delivery

Financial Services & Banking

Government

Manufacturing

Retail

Q Manager Q Manager

Message

Queue

Application ZApplication A

Channels

Inherent reliable delivery and transaction control

Native, high-speed handling of any type of message or file

Native lightweight capabilities for supporting remote devices & sensors

End-to-end advanced security

Single point of control, visibility, and management for all data movement

Applications become more flexible and datamovement becomes more reliable

Capabilities like the Coupling Facility in System z provide unique strengths

Extensive support through years of development, skills and partner ecosystem extensions

Comprehensive single solution reduces complexity of deployment and operation

8


IBM MQ V8.0 and IBM MQ V8.0 for z/OS

Simplify your applications, increased resilience for your business

Rapid, reliable, simple, secure exchange of data across applications, systems and

services

Connect your applications, share information held in files, streamline your processes

Scale to meet peaks in transaction workloads and provide the QoS your business

demands

What’s new in IBM MQ V8.0

Grow your deployment faster, with larger

workloads, easier administration

Enhanced security with simpler, more

powerful operational support

New capabilities, additional platform

coverage, support for new standards

IBM MQ AMS available on IBM i for the first

time

What’s new in IBM MQ for z/OS v8.0

Exploit System z capabilities to improve

manageability &performance

Improved throughput, scalability and

operational tasks

Enhanced security and connectivity, with

support for new standards

No Charge for connecting MQ clients from

other platforms to MQ for z/OS

Scalable, secure, comprehensive connectivity using reliable messaging everywhere you need it

9


Key MQ enhanced capabilities• Key themes for this release

– Ease of use

• Get started faster

• Lowers the skills and cost for larger production operation/admin

– Scalability

• More messages through any machine

• More efficient clusters for increased throughput in larger multi-queue manager environments, especially for publish-subscribe

– Security

• Strong security on all platforms with SHA-2 and AMS everywhere

• More flexibility in security configuration and improved ease of use

– Exploitation of platform and standards currency

• Leverage the latest hardware for z/OS

• Consistent capabilities across platforms, support for JMS 2.0

10


Why should you care?

• Ease of use improvements?– Operational cost and complexity is a big concern

– Improvements here lower cost and dependency on highly skilled staff

• Security improvements– Security is growing in exec awareness everyday– No good having a system that can be secure if it is too complex to secure

• Scalability– Better exploitation of each machine, and use in clustering helps all

production use, from small to large– Many admin and operation tasks associated with scaling have simplified

too

• Exploitation of Hardware and standards– Can’t afford to build different solutions for different environments

11


IBM MQ V8 delivering best in class enterprise messaging

Platforms & Standards

Security Scalability System z exploitation

64-bit for all platformsUserid authentication via OS & LDAP

Multiplexed client performance

64-bit buffer pools in MQ for z/OS means less paging, more performance

Multiple Cluster Transmit Queue on all platforms

User-based authorisation for Unix

Queue manager vertical scaling

Performance and capacity

Support for JMS 2.0 AMS for IBM i & z/OSPublish/Subscribe improvements

Performance enhancements for IBM Information Replicator (QRep)

Improved support for .Net and WCF

DNS Hostnames in CHLAUTH records

Routed publish/subscribe

Exploit zEDC compression accelerator

SHA-2 for z, i & NSSMultiple certificates per queue manager

SMF and shared queue enhancements

12


MQ V8 – details of key features across platforms

• Security– Verify userid and password against operating system, including PassPhrase for z/OS and

LDAP for non-z/OS systems

• Reduces admin tasks , and increases security outcomes

– Use DNS hostnames for CHLAUTH

• Simplifies admin tasks when maintaining network

• IP address still preferred option

– Multiple certificate authorities per Queue Manager

• Easier to configure and deploy MQ to connect to internal and external endpoints

• Lowers operational costs, saves time, reduces errors

– AMS code integrated into core MQ code

• No install required, faster to start, faster operations

• Scalability – multiple updates including:– Routed Publish Subscribe in Clusters

• Better performance for publications and subscription notifications in clusters

• Standards and consistency– Support for JMS 2.0

• Enables application development complying to latest JMS spec

– Multiple Cluster Transmit Queue everywhere

• Allows multiple applications running at different speeds in a single cluster13


MQ V8 – details of key new z/OS-focused specific enhancements

• 64 bit buffer pools– Exploit large amounts of storage in today’s z hardware

– Increases performance and throughput

– Reduces admin overhead

• Log RBA constraint relief– Widens RBA field to hugely extend time taken to fill log

– Removes the need to restart Queue Manager due to full log, reduces risk of loss of persistent messages

• Making use of zEDC compression accelerator – SSL encryption increases security for message exchange

– Compression of message delivers higher throughput

– Transaction cost for message movement can be lower depending on the message

• Support for zEC12 and zBC12 Flash Express– Improving resiliency by leveraging increased memory in Coupling Facility

– Provides real benefits to users of MQ Shared Queues – further extending the unique capabilities provided by the Coupling Facility

• Performance improvements for IBM Information Replicator – Reduced CPU usage, and increased throughput14


MQ Client Attachment Feature

• MQ CAF is an additional charge applied to customer systems which connect MQ Clients on non z/OS platforms to MQ for z/OS– MLC charge, based on a percentage cost of their MQ MLC cost.

• Chargeable features like MQ CAF distort MQ architecture and use-cases– Drove customers to connect via intermediary Queue Managers, thus putting in layers

between the MQ for z system and the application user

– Deploying new applications on z/OS that benefitted from Client Connectivity needed additional justification

MQ Clientconnectivity




MQ Serverconnectivity MQ for z/OS

No CAF charged

MQ for z/OSCAF needed

• No CAF in WMQ for z/OS V7.1 VUE– Encouraged new workloads

• New in V8, and for V7 of MQ for z/OS– No CAF in V8 – not needed for client

connectivity to encourage new workloads on z/OS

– CAF can be removed from V7 deployments by applying a PTF

– Price of CAF for V7 set to $0 on 1st June 2014, to remove the need to apply PTFs15


What makes IBM MQ Advanced different?

• IBM MQ Advanced is a part that provides entitlement to IBM MQ Server, Managed File Transfer service, Advanced Message Security, and Telemetry:

– Buy a single part at a single price (per PVU) for all the distributed server capabilities.

– Buying 1000PVUs of IBM MQ Advanced, gets entitlement to 1000 PVUs of each of the 3 capabilities: base server, MFT service, and AMS, plus the option to connect unlimited Telemetry clients to the IBM MQ Servers.

• IBM MQ Advanced makes it easier for clients to buy and deploy all the IBM MQ distributed server capabilities they need within a single purchase.

– IBM MQ Advanced for Developers is also available specifically for development use only

Important points to note:

– Customers can also extend their network by purchasing Managed File Transfer agents to deploy on non-server entitled machines.

– To access the full capabilities of IBM MQ Advanced, deployment must use v7.5 or above.

– It is still possible to purchase individual MQ capabilities where a customer needs to be more specific about their system requirements.

– System availability can be improved with additional Idle-Standby parts.

IBM MQ Advanced

MQ AMS TelemetryMFT Service

16


IBM MQ

system

Channels

Application B

Where does Advanced Message Security fit in?

Application A

IBM MQ has many built in security features including:

– Control over administration commands (e.g. strmqm for starting a queue manager).

– Fine grained control over access to resources (e.g. queues).

– Secure communications (e.g. SSL and access controls).

– Extensible architecture which can be customised to meet the demands of an individual

business.

When the privacy of sensitive data must be guaranteed, businesses use IBM MQ

Advanced Message Security (AMS), a chargeable component for IBM MQ, or

included in MQ Advanced.

The data is encrypted from the point it leaves the sending application to the point it

enters the receiving application.

The encryption is controlled by policies on the queue manager so no changes are

required to existing applications.17


Where does Telemetry fit in?

• When a business needs real-time access for enterprise applications to connect to a range of mobile devices, remote sensors, actuators and other telemetry devices, they use Telemetry, a chargeable component of IBM MQ.

• IBM MQ Telemetry includes the following key components:– The Telemetry service that runs on the IBM

MQ server

– MQ Telemetry clients that are distributed to remote devices and applications

• Telemetry uses the MQTT protocol to send and receive messages between devices or applications and the MQ queue manager.

• From the MQ queue manager, the messages can be exchanged with other messaging applications.

Application BApplication A

Enterprise

Medical

DeviceVehicle

Oil Rig

Smart

Phone

Sensor

(e.g. RFID)

Telemetry client

Telemetry service

18


Where does Managed File Transfer fit in?

When businesses need to configure, track, and audit file transfer activity in a

consistent way, they use Managed File Transfer (MFT), available as two separate

chargeable components of IBM MQ (MFT Service and MFT Agent) as the

WebSphere MFT offering. MFT Service entitlement is included in MQ Advanced.

An MFT Agent performs the fundamental file transfer function

of sending and receiving files from the local system.

– When requested to send a file, an agent reads the file’s contents

and sends it to the destination agent over IBM MQ channels in the

form of one or more MQ messages.

– An optional logging component stores the contents of file

transfer log messages.

MFT Service installs a file transfer agent on a MQ server with

additional capabilities:

– Protocol bridge agents which are used to send and receive files

with legacy FTP, FTPS, or SFTP servers.

– MQ MFT supports file-to-file movement, but also file-to-message, and

message-to-file

– These offer unique ways to exploit the valuable data held in files

An MQ Explorer integrated GUI or command-line is used to configure and administer MFT.

IBM Sterling Control Center is included to provide additional monitoring of file transfers

MFT Agent MFT Agent

Application BApplication A

Logging

component

Channels

MQ network

19


Enhanced Managed File Transfer capabilities with IBM MQ

Enterprise Messaging with

publish/subscribe and queuing for any

application, on any OS, using any language

Connects applications reliably and securely

to send data anywhere to any solution

Extends application messaging to Mobile,

Internet of Things and Managed File

Transfer

Single, simplified licensing to provide all

the capabilities to connect the business,

and maximize data value

Do more with your MQ investment, lowering

operational overheads, and raising

efficiencies

Ensures all possible functions and

capabilities are available instantly to allow

the business to respond faster to changing

needs

Moves data from anywhere to anywhere

with included end to end monitoring and

management

MQ Advanced

MQ Advanced

All functions available and separately chargeable

All functions available for one single price

Sterling C:D

Sterling C:C

MQ

MQ Telemetry

MQ AMS

MQ MFT

MQ (D05V1LLB)

MQ Telemetry(D0PJTLL)

MQ AMS(D0PLFLL)

WMQ MFT(D0PJZLL)

These MFT functions also

available as a separate

bundle called WebSphere

Managed File TransferNOTE: WebSphere Managed File Transfer is exactly the

same as Sterling Connect:Direct Advanced

WebSphere MFT

(D14CXLL)

20


Key dates you need to know

• MQ V7.0.0 and V7.0.1 for multiplatforms – EOM, EOS effective September 2015– V7.0 will have had more than 7 years of support

• MQ V7.0.1 for z/OS – EOM, EOS effective September 2015– V7.0 .0 already out of service

• MQ V8 Announce: 22 April 2014

• MQ V8 Availability:

– 23 May 2014 (eGA Distributed)

• MQ Advanced for Developers now available to download at no cost, as well as per user with IBM support

– 13 June 2014 (z/OS and pGA Distributed)

21


Summary

• The need for messaging continues and grows in today’s infrastructure with the move to cloud, big data, mobile and the Internet of things

• MQ has been evolving rapidly with simpler packaging, more advanced features and easier access for development

• MQ V8 continues this progress with improved scalability, ease of use, security, support for standards and exploitation of h/w

• New workloads on z/OS can be supported with MQ for z/OS VUE

• Growing recognition of need for end to end encryption of messaging data provided by MQ AMS

• New opportunities for a simple story around Managed File Transfer with new package on distributed platforms including Sterling Connect:Direct and Sterling Control Center

22


1990s 2000s 2010s

JMS

MQIAssured delivery

IBM

MQSeries

Multi-platform

Mobile

.NET

Common criteriaEclipse

JMS 1.1RCMS

IBM MQ

Low

Latency

V1.1V2

V5V5.1

V5.3

V2.1

V5.2

V6

V7V7.0.1

SSLSOAP

XML

IBM MQ

Managed File

TransferIBM

MQTT

HTTPAJAXREST

Web 2.0Managed

File Transfer

Pub/sub

IBM MQ

Everyplace

IBM MQ

Advanced

Message

Security

V7.1V7.5

Integrated Messaging

Hypervisors

IBM MQ

Advanced

System PatternApplication Pattern

IBM MQ

Advanced for

Developers

IBM

MessageSight

Multiple clusterXMIT queue

Multi-instanceQMGR

IBM MQ

Low

Latency

20th Anniversary of MQ at IMPACT

V8

Timeline

23


Call to action for IBM MQ V8

• Find out more about how WebSphere MQ can meet your needs– Read the latest paper on why to upgrade to MQ V8 : Download it

here: https://ibm.biz/BdR5NA

• Talk to other developers, share your ideas, listen to issues, learn more from bite size blogs– The IBM Messaging community is already waiting for you– join the discussion here:

https://www.ibm.com/developerworks/community/blogs/messaging/

– Visit the download site and download IBM MQ Advanced for Developers V8 today: https://ibm.biz/BdR5Nk

24

https://ibm.biz/BdR5NA

https://www.ibm.com/developerworks/community/blogs/messaging/

https://ibm.biz/BdR5Nk

ibm mq v8 enhancements

Technology