large scale, high volume business to business integration ... · logo vikas anand ramesh...
TRANSCRIPT
1 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Large scale, high volume business to business integration using Oracle B2B
ORACLE PRODUCT
LOGO
Vikas Anand Ramesh Anantharamaiah Krishnaprem Bhatia SOA Product Management SOA Product Development SOA Product Management
2 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
3 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle OTN Lounge
• Visit the Oracle OTN Lounge to connect with peers, meet experts, watch Oracle TechCasts, or receive free giveaways
• OTN Lounge is located at Howard Street Tent • Join the Fusion Middleware Power Hour, Tuesday 4-6PM
4 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Fusion Middleware Complete, Open, Integrated, Best-in-class
5 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Program Agenda
• B2B and Current Trends • High Volume Customer Case Studies • Oracle B2B • Best Practices for High Volume Customers • Demo
6 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
B2B and Current Trends
7 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
B2B Background Why B2B?
B2BStandard Bodies:
• ANSI X12 • UN/CEFACT • ebXML • OAG • Tradacoms • Odette • UCC • ACORD • ANSI HL7 • SWIFT • CIDX • PIDX • W3C • RosettaNet
INTERNET Enterprise B
Enterprises – • Extend their business processes to External Partners • Each vertical uses different standards • Provides an automated, secure mechanism to exchange messages
Enterprise A
Verticals:
• Retail • Hi Tech • Healthcare • Financial Services • Government • Transportation • Insurance • Chemicals • Petroleum
PIP 3A4 RosettaNet over RNIF
EDI 850 over AS2 Custom XML over ebMS
8 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
B2B Background What is B2B Gateway?
Provides common trading partner integration services such as
• Document Management • Transport and Exchange Management • Partner Management • Reports and Monitoring • System Management
B2B Gateway
Applications
Enterprise A
B2B Gateway
Enterprise B
Applications
Standards driven based on different document and exchange standards in different verticals
• Document Standards • EDI, RosettaNet, XML, HL7 • XML, CIDX/PIDX • Exchange Standards • ebXML, AS2, RNIF • FTP/HTTP/X.400
INTERNET
9 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
• Two major factors driving B2B adoption – The need to reduce costs and the need to – exchange documents electronically
• Comprehensive solutions should offer – Lower total cost of ownership – For better control and easier integration with backend apps – Easier integration of ERP applications with external partners – Better maintenance using a common tool – Visibility “End-To-End” – High availability and Scalability to service demand..
B2B Trends What major companies are looking for
10 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
SOA/B2B 11g Offering “CIO-BoB”
Broad & Deep Offering Lower Cost, Lower Risk
Comprehensive SOA Offering
Complete
Less Effort More Value
Designed to Work Together
Integrated
Robust, Proven Industry leading Software
Industry Leader
Best of Breed
#1
More Choice Maximizes Existing Investments
Standards-Based Architecture
Open
11 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
High Volume Customer Case
Studies
12 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Rosendin Electric
• Oracle BPEL Process Manager 11g to automate purchase approval • Oracle B2B 11g to automate integration with top vendors using EDI • Oracle WebLogic 11g for application server and infrastructure platform
Opportunities & Challenges
• Substantial savings for the company and a platform for future growth • Ability to manage and take advantage of early-pay discounts on annual
purchases with accelerated order placement • Repeatable standard for communication with internal/external data systems
Solution
Results
• Needed to automate the procure-to-pay process for accuracy and efficiency • Looking to ensure that projects remain on schedule and on budget • Eliminate the need to manually place and confirm receipt of orders • Goal to lower costs & improve time-to-market for new services
Supporting Quote “We’ve been able to transform the way we do business with Oracle SOA Suite 11g,” said Anand Tamboli, Director, Business Applications, Rosendin Electric. “With accurate and timely access to data, we are better able to work with our partners, service our customers and manage our business.”
13 Copyright © 2011, Oracle and/or its affiliates. All rights reserved. Oracle Confidential, Under NDA
SPS Commerce
• SOA Suite(BPEL PM, Oracle B2B) and ADF for internal / external app development • Created a data center architecture to handle data transformations • Provides end-to-end instance tracking of processes • Supports volumes for 52,000 manufacturers and 700+ retailers and distributors
• Leading outsourced EDI service provider connecting thousands of retailers & suppliers
• Recognized SaaS leader in EDI services and B2B integration with 37,000 customers
• Needs to support heavy transaction volumes across heterogeneous environments
• Requirement to support various data models
Opportunities & Challenges
• SOA-enabled platform ensures new features can be quickly rolled out to customers
• Greater visibility into process and data flows for faster issue diagnosis and resolution
• Customer satisfaction rate of 93%
Solution
Results
Went live November 2009 with 11g
Hot switch over 10g to 11g in one
night
4,000+ Partners / 30,000+ Agreements
Doubled throughput on half the hardware
15 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle Case Study
• Consolidate to Oracle SOA Suite for internal infrastructure • Oracle B2B for partner collaboration • Built a core set of 50 reusable services
Opportunities & Challenges
• Reduced development time for new services from 3 months to 2 weeks • Rapid consolidation of acquired infrastructures • 10X reduction in end-to-end message issue resolution • Met Oracle’s aggressive acquisition strategy by scalability of IT
Solution
Results
Oracle SOA Suite The internal standard at Oracle
• Disparate collection of EAI, B2B throughout Oracle • Needed to rapidly unify acquired companies into Oracle • Looking to consolidate and standardize application infrastructure • Goal to lower costs & improve time-to-market for new services
16 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle B2B
17 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
BAM CEP
EM
POLICY MANAGER
JDEV
Oracle SOA Platform
ERP MAINFRAME SERVICES EVENTS
BPEL PROCESS MGR BUSINESS RULES HUMAN WORKFLOW
SERVICE BUS DATA INTEGRATOR
REG/REP
Adapters & B2B PARTNERS DB
18 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle B2B Manages Partner interaction Messaging Services Transports Security Document Validation Document Translation
Composite Mediator Document Transformation Document Routing Code Conversions
BPEL Process Manager Process choreography Error Handing
Oracle Service Bus (Enterprise ESB) Document
transformation Document Routing Code conversions
Application Document processing
Business Rules Policies Constraints Computations Reasoning
Human Tasks Work list tasks Forms
Architecture Business Integration
Partner
Oracle B2B
Oracle Service Bus Applications / Devices
19 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle B2B 11g Main Features
DOCUMENT MANAGEMENT • Library of ALL EDIFACT, X12, X12N, HL7, HIPAA, EANCOM, NCPDP, RosettaNet, PFF etc. Document creation/validation/identification Data Migration Tests data generation Batching
EXCHANGE MANAGEMENT • AS1, AS2, ebMS, RNIF • Web services enablement of B2B services
TRANSPORT MANAGEMENT • All major transports including MLLP, TCP/IP, Oracle AQ, JMS, FTP, FTPs, sFTP, HTTP, HTTPs, SMTP, IMAP, POP3 • Define security/encryption/non repudiation of origin and receipt/retry intervals
20 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Oracle B2B 11g Main Features
TRADING PARTNER MANAGEMENT
• Define Trading Partners profiles and
capabilities • Trading Partner Agreements • Self service API to create TP/TPA from
command line tool
SYSTEM MANAGEMENT • Facilities to manage B2B
• Deploy, Manage Deployments, Types, Import/Export, Schedule Batching, Purging, Listening Channels, Configuration
• Command line utility for system management
REPORTS AND MONITORING • Application, Business, Wire, Error, Conversation
Reports • Metrics – system and trading partner level • Integration with EM, WLS Console, Oracle BAM • Command line resubmission of failed message • Instance message APIs for custom reports
22 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
.
Product Architecture
Internal Delivery Channels
B2B Engine Delivery Channels
Document Plugin
File FTP HTTP TCP/IP etc.
AQ JMS Fabric etc.
Weblogic Server
MDS (design time metadata)
Exchange Plugin
Runtime
SOA Composite
Listening Channels
Trading Partners
B2B Console
• Messages exchange using delivery channels • Exchange and Document Plugins identify and process the messages • Messages sent and received from the middleware using AQ/JMS/In-memory • B2B design time metadata stored in MDS
23 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Platform: Oracle B2B Typical Setup
Oracle B2B utilized the standard configuration recommended by Web Logic Server. It is a:
• HTTP Client • FTP Client • Mail Client • MLLP Client & Server • TCP/IP Client & Server
Data Tier
App Tier
DMZ
Oracle DB Repository
Oracle SOA Suite
OHS, FTP & Proxy Server
Load Balancer
Oracle B2B
Applications
Devices
24 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Best Practices for High Volume
Customers
25 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Best Practices
• Size it !! • Design it !! • The right Topology !! • Know the Product !! • Tune IT !!
26 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Large Scale High Volume Best Practices
Typical setup for Oracle B2B in a cluster for
• HA/Failover
• High volume, large scale implementations
27 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Large Scale High Volume Best Practices
• Capacity planning
• Infrastructure • HA setup - Weblogic cluster setup, JMS, OHS • Database – table space
• Design Planning • Design of Message flow
• Payload Type, Size, No. of msgs/sec • Broadcast • Message prioritization • Disabled validation • Batching of message flow • Scheduled message flow • Security – design, runtime • Callout usage - NOT recommended
28 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Large Scale High Volume Best Practices
• Runtime Planning • Purge (Capable of purging 100k messages in 8 seconds)
• Loop Purging, Parallel Purging, Partitioning (work in progress)
• Scheduled resubmit
• Throttling – polling, prioritization
• Large payload processing
• Logging level to ERROR
• Gateway outage recovery
29 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Performance Tuning Best Practices • Tight (in memory) integration with SOA Suite • Thread management
• Inbound, outbound threads. Done using EM • b2b.inboundThreadCount : For inbound messages • b2b.outboundThreadCount : For outbound messages • b2b.defaultThreadCount : For B2B internal events
• Gather DB stats • Server affinity in WebLogic JMS • Set Memory argument • Heap size setting • MDS cache • Setting the size of large payload
For Oracle JRocket export JAVA_VENDOR Oracle DEFAULT_MEM_ARGS="-Xms1024m -Xmx1024m" For Sun JVM export JAVA_VENDOR Sun DEFAULT_MEM_ARGS="-Xms1024m -Xmx1024m" if["$JAVA_VENDOR"!= "Oracle"];then DEFAULT_MEM_ARGS=“ $DEFAULT_MEM_ARGS -XX:CompileThreshold=100000 -XX:PermSize=256m -XX:MaxPermSize=256m"
30 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Operational benefits with Oracle B2B features
• Automating TP creation, Doc creation, Agreement creation process • Bulk metadata use cases – import / export • Automating Error/exception handling • Automating Resubmission, Purge, Archival • Performance Automation • Sequencing management • Side by side version management • API for querying runtime messages • API for bulk metadata creation
31 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Performance Tuning Generic parameters/monitoring/debugging
•Production Mode •Connection Pooling • Logging • Self tuning
WebLogic
•Heap Size •Nursery Size •GC Algorithm •Use Large pages •64 bit vs 32 bit
JVM
• SOA & Application Schema tuning
• Tuning Parameters • Redo Logs
Database
32 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Demo
33 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Process flow EDI X12 Host
Oracle B2B
EDI X12
Large Document
Oracle B2B
Read from file
From JMS Write To file
Internal App
35 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Summary • Understand the requirements and the Use Cases • Choose the right Technology • Size it !!! • Define the right design Patterns • Plan the runtime!!! • Leverage the Knobs to Tune
36 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Join the B2B Community
OTN Discussion Forum
http://forums.oracle.com/forums/forum.jspa?forumID=242
Team Blog http://blogs.oracle.com/oracleb2bgurus/
http://www.linkedin.com/groups?mostPopular =&gid=84228
Oracle.com/technetwork/middleware/b2b-integrations/overview/index.html
37 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
Q&A
38 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.
39 Copyright © 2011, Oracle and/or its affiliates. All rights reserved.