wall street technology
Post on 11-Jul-2015
158 Views
Preview:
TRANSCRIPT
Informix Bells Wall Street! (Capital Markets)
Bharat Gera Session Z99
Michael Pintus
IBM Tuesday/24/Time
Agenda
• Requirements of Capital Markets, Industry Trends
• Informix Technology for Capital Markets
• Financial Market Case Study
• Q&A
6/1/2012 Informix Bells Wall Street - Session Z99 2
Requirements of Capital Markets,Industry Trends…
Emerging Technology Themes• Regulation, and then some more regulation
– BASEL II, III, Dodd-Frank, Fraud detection…
• Risk elevated to top of heap– Near real-time impact of global events– Risk as pre-trade input – Enterprise-wide or “Horizontal” Risk
views
6/1/2012 Informix Bells Wall Street- Session Z99 3
Large Scale Data Management Data warehousing Business Intelligence Reporting
Extreme Performance In-memory data grids Real-Time compute
infrastructure
6/1/2012 4
Requirements of Capital Markets, Industry Trends…
Emerging Technology Themes• Data is growing insanely
– Needs to be cleansed, manipulated, aggregated, analyzed, stored
– Market data is multiple Million messages/sec
– Unstructured data growing (market sentiment)
• Electronic trading is becoming the norm– 60% of US and 40% of European trading is
Electronic. Rapid growth in APAC
6/1/2012 4
Large Scale Data Management Data warehousing Big Data positioning
Extreme Performance High speed, scalable Warehouse Accelerator
Extreme Performance Deterministic
execution Complex event
processing High speed networks
Informix Bells Wall Street- Session Z99
6/1/2012 Informix Bells Wall Street - Session Z99 56/1/2012 5
Requirements of Capital Markets,Industry Trends ...
Emerging Technology Themes
• Banks need new customers and new sources of revenue
– M&A, customer segmentation, mobility
– Real-time view of profitability, product performance
• Reduce operating costs, while improving business agility
– Standardization, Scalability, Elasticity, On Demand
6/1/2012 5
Analytic Support SPSS, Cognos
Integrations
Standardized Infrastructure Automated
provisioning Management
Virtualized network, compute and storage
6/1/2012 Informix Bells Wall Street - Session Z99 66/1/2012 6
• Big Board’s (NYSE) Market Capitalization: ~14 Trillion $
• Average Daily Trading: ~150 Billion $
• Millions of Equity Ticks (Time Series Data Point) flow out per day with ExponentialData storage requirements
• Microseconds are the difference between winning and losing in the global financial markets, and access to the lowest latency data is imperative
6/1/2012 6
High Frequency Global Market Equities
Time Series Data
Capital Markets Application AreasCharacteristics and Technologies
6/1/2012Informix Bells Wall Street - Session Z99
7
Electronic Trading(Front Office)
Pre-Trade Analytics(Middle Office)
Data Management
(Back & Middle Office)
Characteristics • Low latency messaging
• Real-time eventprocessing
• Single-thread executionperformance
• High performance computation
with high performance IO forshared file systems
• Horizontal scale compute andvertical scale database.
• Reference and trade data
integration and transformationacross asset classes and
trading systems
• Transactional and data
warehouse functions providing
Technologies • Single thread
performance servers
• Optimized executionplatform
• High performancenetworking and TCP/IP
Stack
• In-memory data grids
• SMP systems for database
• Data warehousing for analytics
• Single thread performanceservers for risk and pricing
computations
• High speed Flash or directattach storage for Tick
databases
• High performance networking
• Distributed data grids andcaches
• SMP systems for database
• High-Availability datareplication
• Mixed workload databases
• High throughput messageoriented middleware.
• Horizontal scale Common Technology Themes:
Large Scale Data Management, Extreme Performance the “glue” for the entiresystem
Informix Technology for Capital Markets
6/1/2012 Informix Bells Wall Street - Session Z99 8
Comprehensive Technology Stack
6/1/2012 Informix Bells Wall Street - Session Z99 9
Informix Business Intelligence Integrations
TimesTen
Informix Flexible Grid
Informix Warehouse &Accelerator
Informix Time Series
Informix 11.70
Informix Genero
• Informix Business Intelligence Integrations– Comprehensive BI and Analytic Integrations
with IBM Cognos and SPSS
• Informix Flexible Grid– Highly Scalable, distributed data access and
flexible deployment
• Informix Genero– Modernized Application Development Stack
• Informix Warehouse Accelerator– Extreme Performance delivered for warehouse
queries: Acceleration up to 100X
• Informix Time Series– Informix Time Series delivers exceptional
performance and storage savings
• Informix 1170– Informix Panther release for Data Management
6/1/2012 Template Presentation - Session Z99 10
Large Scale Data Management
Informix in IBM Big Data Platform
InfoSphere BigInsights Hadoop-based low latency
analytics for variety and volume
IBM Netezza High
Capacity ApplianceQueryable Archive
Structured Data
IBM Netezza 1000BI+Ad Hoc
Analytics on Structured Data
IBM Smart Analytics
SystemOperational Analytics on
Structured Data
IBM Informix TimeseriesTime-structured analytics
IBM InfoSphere
WarehouseLarge volume structured
data analytics
InfoSphere StreamsLow Latency Analytics for
streaming data
MPP Data Warehouse
Stream ComputingInformation Integration
Hadoop
InfoSphere Information
ServerHigh volume data integration
and transformation
6/1/2012 Template Presentation - Session Z99 1111
Informix Time Series Solution Knocks Out Competition
• Informix Time Series delivers exceptional performance and storage savings– 25-70 times faster than the competition– 66% less storage required
• Handles all aspects of in one product - compliance, billing, customer portal, analytics, etc...
– Combine relational data with time series data in the same SQL query
Based on actual benchmark test run for a large US company
Re
lati
on
al
Sto
rage
Dis
k St
ora
ge R
eq
uir
em
en
t
Competitor
Data
(TimeSeries)
Tim
ese
rie
s
Dat
a ty
pe
Sto
rage
IBM-InformixData Storage Comparison for 1 million meters
Competition
Pro
cess
ing
Tim
e (
In H
ou
rs)
Data Loading ReportsPerformance Comparison for Data Loads and Reports for 1 Million Meters
IBM Informix
INFORMIX Other DB
Time to Load - 1,000,000 Data Points 18 Minutes 7 Hours
Reports Seconds to 11 min 2-7 HOURS
Storage Requirements - 1,000,000 Data Points 350GB 1.3 TB
6/1/2012 Informix Bells Wall Street - Session Z99 12
Client connectivity and
application development
Informix
database server
ClientApplication
ClientApplication
Data loading
IBM Data Studio
Informix TimeSeries Plug-in for Data Studio
Administration
IBM OpenAdmin Tool for InformixInformix TimeSeries Plug-in for OAT
TimeSeriesTimeSeriesTimeSeries
TimeSeries
data typesSQL routinesAPI routines
Java classes
Informix Time Series Architecture
6/1/2012 Informix Bells Wall Street - Session Z99 1313
Maximize Storage with Deep Compression
• Best in industry
• Minimize storage costs
• Improve performance
• Reduce energy consumption
• Easy to implement
• Customers achieving 70% storage savings
"With millions of financial transactions each day, we rely on IBM Informix to deliver high speed and reliability. With the compression capabilities, we can gain even greater value by reducing our storage requirements by 50%.”
- IT Manager, Large Financial Services Company
81
% Sm
aller
78
% Sm
aller
Sales Table Product Table
6/1/2012 Informix Bells Wall Street - Session Z99 14
Introducing Informix Flexible Grid
Redistribute work locally, regionally,
globally
An easy to manage Grid of Informix Servers for High-Availability, Scalability & Workload Balance
Six 9’s of availability –
zero downtime for planned
maintenance
Administer the grid
as if it were a single server
Mix hardware and versions
of OS and Informix
Optimize your Availability Always On” Availability with Informix
6/1/2012 Informix Bells Wall Street - Session Z99 1515
Business Continuity Demands:
24 x 7 availability
Downtime = Lost Revenue
Customizable disaster recovery plan
Multiple global backup locations
Worldwide application availability
Global marketplace
$6,450,000/hour is $107,500/minute!
Tim
e Is
Mo
ney
How do I minimize planned/unplanned outages?
If my data is
available ...
Then in 1 year it is
unavailable …
99% 3.6 days
99.9% 8.7 hours
99.99% 52 minutes
99.999% 5.2 minutes
99.9999% 30 seconds
Informix Flexible Grid offers measurable cost savings
6/1/2012 Informix Bells Wall Street - Session Z99 16
Scale globally
Manage easily
Balance workloads
Save DBA time
Re-use current hardware
Avoid platform lock-in
Ideal for the Cloud
Usage Example - Expanding Beyond a Single Cluster
6/1/2012 Informix Bells Wall Street - Session Z99 1717
Connection Manager for grid
Connection Manager for Cluster
Connection Manager for Cluster
AIX Linux
Flexible Grid
Secondary
HP
Secondary
Windows
Initially one cluster is neededBusiness grows and a new cluster in a new city is needed –new hardware is used
Business grows again and more servers are added
New applications are created that require data from both sites so a grid is created
Secondary
Flexible Grid - Simple Setup
6/1/2012 Informix Bells Wall Street - Session Z99 18
18
• Install Informix on your server machines
– Servers may have secondary servers attached such as HDR, RSS, or SDS servers
– Hardware can be from various vendors
• Define a grid to contain your servers:
– Just give your grid a name and tell it the list of servers to use
– You can either use the Open Admin Tool graphical interface or a command line tool to define your grid
– Configure whether you want to replicate just schema changes or schema and data changes
• The grid is ready to use!
Spread your Workload Across different Hardware, Operating systems, and versions of Informix
AIX Linux
Flexible Grid
Secondary
Solaris
Secondary
Windows
Informix Flexible Grid is easy to manage
6/1/2012 Informix Bells Wall Street - Session Z99 1919
Easy to Manage
– Manage ANYTHING from ANYWHERE with a single ‘click’
– Set-up takes minutes not days or weeks
– Propagate changes to all servers on the Grid
Reliable
– Continuous availability
– Automated failover
– Automatic storage provisioning on the grid
Hassle
New Cluster Replication Features
6/1/2012 Informix Bells Wall Street - Session Z99 2020
• Rolling Upgrade Support• No down time needed to upgrade to 11.70 and beyond
• Support for ER replication of tables without primary keys
• Support DDL changes across ER replicate set and HDR/RSS/SDS servers
• Snapshot clone of an existing server• Resulting server can be an RSS server or ER server
• Transactions on secondaries continue to completion when primary fails over
• Backup to the cloud• Support for ontape to backup/restore to/from a cloud storage manager
Informix 11.7 - A Single Platform for OLTP & Data Warehousing
6/1/2012 Informix Bells Wall Street - Session Z99 21
Graphic ETL designer
included in Growth and Ultimate
Editions
Informix for Data Warehousingand Business Intelligence
Integrates XPS warehouse capabilities for
up to 10x fasteranalytic queries
Integrates with IBM Cognos BI, Mashup Center, Data Quant, and
SPSS
On demand scale out for Analytic & OLTP workloads
Informix Ultimate Warehouse Edition
6/1/2012 Informix Bells Wall Street - Session Z99 2222
What it is What it does
Benefits
• Informix edition for warehouse
• Packaged as:• Informix Ultimate Edition
• Informix Warehouse
Accelerator (IWA)*
• Compression (Informix)
• Compresses and processes data
mart entirely in memory
•Uses a deep columnar approach for
optimizing performance
•Runs as an add-on to Informix
• Order of magnitude or more
performance gains
• Transparent to BI apps – queries
continue to run against Informix
•No maintenance
•Manage warehouse on Informix
*Informix Warehouse Accelerator requires a Linux Intel system as it is relies on optimizations in that environment
Extreme Performance
Informix Warehouse Accelerator
• Informix Warehouse Accelerator
– Accelerates warehouse queries up to 100X
• Leverages deep columnar approach
– On-demand scale-out for Analytic & OLTP workloads
– Lowers data warehouse costs
• No change to business apps
• No database tuning requirements
6/1/2012 Informix Bells Wall Street - Session Z99 23
Informix Warehouse Accelerator –Breakthrough Technology for Performance
6/1/2012 Template Presentation - Session Z99 24
1
2
34
5
6
7 1
2
34
5
6
7
Row & Columnar DatabaseRow format within IDS for transactional workloads and columnar data access via accelerator for OLAP queries.
Extreme Compression3 to 1 compression ratio
Massive ParallelismAll cores are used for each query
Predicate evaluation on compressed data
Often scans w/o decompression during evaluation
Frequency PartitioningEnabler for the effective parallel access of the compressed data for scanning. Horizontal and
Vertical Partition Elimination.
In Memory Database3rd generation database technology avoids
I/O. Compression allows huge databases to be completely memory resident
Multi-core and Vector Optimized Algorithms
Avoiding locking or Synchronisation
Comes with Smart Analytics Studio, a GUI tool, for configuring data mart with IWA
6/1/2012 Informix Bells Wall Street - Session Z99 2525
Take “No” for an answer!
NO
Application changes
Index maintenance
Storage allocation/data
partitioning
Statistics maintenance
Cube maintenance or
summary tables
New order of Performance!
10s to 100s of times
faster
Predictable response times
No maintenance!!Zero
administration!!
Informix Genero: New Generation of Modernized Apps
6/1/2012 Informix Bells Wall Street - Session Z99 2626
• Deploy apps faster with easy, graphical tools
• Deploy in browser-based, GUI, Windows or mobile and cloud environments
– Lower Development Costs
• Improve Developer Productivity
• Develop Apps 5 to 10 times faster
– Modernize existing 4GL Apps
Desktop, Web & Mobile
Informix Genero – The Fastest Path To…
6/1/2012 Informix Bells Wall Street - Session Z99 2727
the iPhone or iPad
27
Linux
Web 2.0Cloud
Packaging
6/1/2012 Informix Bells Wall Street - Session Z99 282828
Informix Genero Developer Suite Informix Genero Runtime Suite
Genero BDL with Web Services
Genero Application Server
Genero Studio (server and client)
Genero Desktop Client (Linux and Windows)
Genero Report Designer
Informix Client SDK 3.50
Genero BDL with Web Services (runtime)
Genero Application Server
Genero Desktop Client (Linux and Windows)
Genero Report Engine, Designer and Viewer
Informix Connect 3.50
Financial Market Case Study
6/1/2012 Informix Bells Wall Street - Session Z99 29
Informix in the Financial Market
6/1/2012 Informix Bells Wall Street - Session Z99 30
A Large Financial Solutions Software Company
Deploys the leading suite of Financial Solutions designed anddeveloped to leverage the power and advanced functionality ofInformix RDBMS
A Large Financial Solutions Software Company
– Powered By IBM
6/1/2012 Informix Bells Wall Street - Session Z99 31
Discover Informix
A Scalable Solution Architecture
6/1/2012 Informix Bells Wall Street - Session Z99 32
An IBM Validated Scalable
Architecture
6/1/2012 Template Presentation - Session Z99 33
Discover Informix
IKey Technical Highlights
6/1/2012 Informix Bells Wall Street - Session Z99 34
Informix embedded as part of the application
Customer deployments require minimal / no DBA support
Automatic schema upgrades when upgrading applications
Designed to be a financial engine with Informix Backend
Integration via Web API or native database access are fully supported
Software Development Differentiator – IBM Informix Genero
Case Studies (APAC)
6/1/2012 Informix Bells Wall Street - Session Z99 35
Large Revenue Board
54 Tax offices, 500+ users
Implemented for internal financialmanagement and payment processing for tax refunds
Application Developed in Genero
Auction House
Informix based Financial Engine fully integrated within
Internationally recognized level 1 global auction
Questions?!?
6/1/2012 Informix Bells Wall Street - Session Z99 36
top related