Orchestration and Choreography Specifications

Web services are emerging as the cornerstone for architecting and implementing business processes and collaborations within and across organizational boundaries. Two languages for Web service composition have emerged:

Business Process Execution Language (WS-BPEL) Developed by BEA, IBM, Microsoft, and Siebel and subsequently submitted to the WS-BPEL Technical Committee at OASIS.

Choreography Description Language (WS-CDL) Developed by the Web Services Choreography Working Group at W3C, based on an input specification written by Intalio, Sun, BEA, and SAP.

The goal of these languages is to glue Web services together in a process oriented way.

Comparing Web Services Orchestration and Choreography

The terms orchestration and choreography are frequently used to describe two approaches to composing Web services. Although the two terms overlap somewhat, Web services orchestration (WSO) refers to composing web services for business processes, whereas Web services choreography (WSC) refers to composing Web services for business collaborations (see Figure 6-13).

Figure 6-13. Comparing orchestration and choreography.

More specifically:

Web services orchestration is used for defining composite services and internal processes that reuse existing Web services. WSOs can be used to support the preparation of information to exchange externally in WSCs.

Web services choreography is used for defining how multiple parties collaborate in a peer-to-peer manner as part of some larger business transaction by exchanging messages with trading partners and external organizations, such as suppliers and customers.

In the case of WSO, the focus is on creating a composite service in a declarative (non-programmatic) manner. A WSO defines the services that compose the orchestration and the order in which the services should be executed, including parallel activities and conditional branching logic. In this way, the orchestration can be viewed as a simple process that is itself a Web service. WSO flows typically include control points for branching, parallel processing options, human response steps, and predefined steps of various types such as transformation, adapters, email, and Web services.

In the case of WSC, the focus is on defining how multiple parties collaborate as part of some larger business transaction. WSC allows each party to describe its part in the interaction in terms of the public message exchanges that occur between the multiple parties as Web services, rather than a specific business process that a single party executes, as is the case with WSO.

When defining business interactions using WSC, a formal description of the message exchange protocols used by business processes during their interactions is needed that models peer-to-peer message exchanges, both synchronous and asynchronous, within stateful, long-running processes involving two or more parties.

The definition of such business protocols involves precisely specifying the visible message exchange behaviour of each of the parties involved in the protocol, without revealing internal implementation details. There are two reasons for separating the public aspects of business process behaviour from internal or private aspects:

One is that organizations do not want to reveal their internal business processes and data management to their business partners.

The other is that separating public processes from private processes provides the freedom to change private details of the internal process implementation without affecting the public business protocol.

The key difference between WSO and WSC is that WSC is a peer-to-peer model, where there may be many parties collaborating in a business process, whereas a WSO is a hierarchical requester/provider model, where the WSO alone defines what services should be called and when they should be called, and the WSO does not define a collaboration among multiple parties.

Whereas WS-BPEL is focused on WSO and the composition of individual Web services and can be used to drive WSC-style interactions across enterprise boundaries, CDL is focused on WSC and the definition of cross-enterprise relationships, regardless of the underlying technology used to implement the organizational behaviour. CDL, on the other hand, is not well suited for WSO and for assembling specific Web services into composites. CDL can certainly reference Web services endpoints as the entry points of collaboration across enterprises, but its focus is definitely more on defining the relationship between companies. CDL defines its relationship to WS-BPEL, however, while the reverse isn't true (at least not at the time of this writing).

WS-BPEL

Web Services Business Process Execution Language (WS-BPEL) is a process-oriented composition language for Web services.

WS-BPEL is service-oriented and relies on WSDL. A WS-BPEL process can be exposed as a WSDL-defined service and can be invoked like any other Web service. Furthermore, WS-BPEL expects that all external Web services included in a web services composition be defined using a WSDL service contract. This approach allows a WS-BPEL process to invoke other WS-BPEL processes and also allows a WS-BPEL process to call itself recursively.

WS-BPEL defines a set of basic tasks for creating Web service compositions:

Invoke task Allows the business process to invoke a one-way or request-response operation on a portType offered by a Web service.

Receive task Allows the business process to do a blocking wait for a message to arrive.

Reply task Allows the business process to send a message in reply to a received message.

Wait task Tells the process to wait for some time. Assign task Copies data from one place to another. Throw task Indicates that an error condition has occurred. Terminate task Terminates the entire orchestration instance.

Structured tasks are used to combine the primitive tasks into more complex processes:

Sequence task Define an ordered sequence of tasks. Switch task Ability to select a particular branch based on conditional logic. Pick task Block and wait for a suitable message to arrive or for a timeout alarm to go

off. When one of these triggers occurs, the associated activity is executed, and the pick completes.

While task Define a group of tasks that should be repeated while a condition is satisfied.

Flow task Indicate that a collection of steps should be executed in parallel (links can be used to define execution order within a particular flow).

WS-BPEL treats all state uniformly as a collection of WSDL message types. A collection of messages that constitute the state of a business process is called a container. The messages held in a container are often those that have been received from Web services partners or that are to be sent to Web services, but WS-BPEL does not require this. Containers can hold messages that act as temporary variables for computation and that are never exchanged with partners.

WS-BPEL includes the idea of a container for each task in the flow, each of which has a schema definition. A message is given correspondence to a container, which is basically a Web service with additional information about how to process it, how to prepare it for processing (any pre-conditions), and what to do after processing it (any post-conditions); this container then determines the next task or step in the activity to be executed (which could be the result of a conditional expression).

All data access and data handling in WS-BPEL is defined using standards such as XPath and XSLT and is based on the WSDL service contracts (and the underlying WSDL message definitions, WSDL part definitions, and XML Schema definitions) of the services being composed as part of the process.

A WS-BPEL variable identifies the specific data exchanged in a process. When a WS-BPEL process receives a message, it populates the appropriate variable so that subsequent requests can access the data. The assignment task is used to create new messages or to modify existing ones, using parts of other messages, XPath expressions, XSLT expressions, or literal values. Therefore, the assignment task allows messages received from one service to be transformed and used as input to operations of another.

WS-BPEL provides the ability for activities to be scoped and for fault handlers and compensation handlers to be defined for these scopes. Fault handlers and compensation handlers are like catch clauses in object-oriented programming languages such as Java and C++ and can be triggered when a throw task is executed.

During its lifetime, a business process instance typically holds one or more conversations with partners involved in its work. In such cases, it is often necessary to provide application-level mechanisms to match messages and conversations with the business process instances for which they are intended. WS-BPEL addresses correlation scenarios by providing a declarative mechanism to specify correlation sets. Each correlation set in WS-BPEL is a named group of properties that, taken together, serve to define an application-level conversation within a business protocol instance.

Consider the usual supply-chain situation where a buyer sends a purchase order to a seller. The seller needs to asynchronously return an acknowledgment for the order, and the acknowledgment must be routed to the correct business process instance at the buyer. The obvious and standard mechanism to do this is to carry a business token in the order message (such as a purchase order number) that is copied into the acknowledgment for correlation. The token can be in the message envelope in a header or in the business document (purchase order) itself. In either case, the exact location and type of the token in the relevant messages is fixed and instance-independent. Only the value of the token is instance-dependent. Therefore, the structure and position of the correlation tokens in each message can be expressed declaratively in the business process description. The WS-BPEL notion of a correlation set allows a WS-BPEL-compliant infrastructure to use correlation tokens to provide instance routing automatically.

In this example, WS-BPEL defines the process flow. WSDL describes the Web service endpoint to which the customer can submit the PO document. WS-Policy defines the security, reliability, and transactional requirements the service requester must use in communicating with the provider. The document is sent using SOAP and formatted using XML according to a predefined XML Schema shared between the customer and the supplier so that the supplier can determine whether the order is valid. WS-Security can be used to check the authorization of the customer to submit purchase orders and decrypt the document so that it can be processed. WS-Addressing provides the callback address for the customer so that the order can be reconfirmed once the supplier knows it can be filled and shipped by a certain date. The WS-Composite Application Framework drives the compensating transactions to undo the work of specific tasks or to cancel the entire process. WS-ReliableMessaging guarantees that the PO document is received by the supplier and that the invoice or cancellation message is received by the customer.

WS-BPEL can be used to define both orchestrations (called executable processes) and choreographies (called abstract processes). In an executable process, the orchestration defines the specific activities to be carried out and the specific services to be invoked to complete the business process. In an abstract process, the choreography specifies the public message exchanges between two or more parties the choreography is not executable and does not define the process flow's internal details. The interface of the choreography is defined by the set of all receive and reply activities present in the process.

Although a WS-BPEL process is defined based on the portTypes defined in one or more WSDL documents, a WS-BPEL process is defined in the abstract by referencing only the portTypes of the services involved in the process, not their possible deployments. Defining business processes in this way allows the reuse of business process definitions over multiple deployments of compatible services.

WS-BPEL is currently defined to work with WSDL 1.1, and the examples in this section are based on WSDL 1.1. WS-BPEL should also be compatible with WSDL 2.0, however, because the basic constructs are the same. WSDL 2.0 offers several extensions to WSDL 1.1 that might be beneficial to WS-BPEL, such as the definition of several new message exchange patterns and a features and properties extension for messages, interfaces, and operations that allows assertions such as security and transaction requirements to be included directly into the WSDL file instead of in associated policy schemas. But because this is all XML, the real consequence of where things are defined has more to do with how the various pieces of XML are assembled together and processed rather than in which file they are defined.

What follows is a set of examples using pseudo-code generic enough to illustrate the way in which WSDL and WS-BPEL are related and work together to achieve the goals and objectives of business process automation using Web services. The examples below follow the process flow illustrated in Figure 6-2.

First, the messages are defined:

<xs:element name="opanA:CustomerInfo" type="openA:tCustomerInfo"/> <xs:complexType name="openA:tCustomerInfo"> <xs:sequence> <xs:element name="AccountNumber" type="xs:double"/> <xs:element name="CustomerName" type="xs:string"/> <xs:element name="CustomerAddress" type="xs:string"/> <xs:element name="CustomerType" type="xs:string"/> </xs:sequence> </xs:complexType>

This example illustrates a very simple definition of a customer information record that might be used in the initial step of the process flow. The record structure can be defined in the WSDL file itself or in an associated file that's included by reference or actually imported into the file. (WSDL 2.0 supports Document Type Definitions (DTDs) and RelaxNG schemas in addition to XML Schemas for message type definitions.) Definitions such as these are typically assigned to messages. Namespaces are used to qualify the element and attribute names of imported data types and structures.

The association of application data to messages in WSDL V2 is accomplished within the <types> section. In WSDL 1.1, there's an explicit mapping of message names to schema data. For example:

<message name="CustomerMessage"> <part name="CustomerInfo" type="openA:tCustomerInfo"/></message>

This associates the CustomerInfo schema data type with the CustomerMessage WSDL message type.

A namespace definition is also required for using the CustomerInfo data type. For example:

xmlns:openA="http://www.bank.com/xsd/AccountManagement"

Then the portTypes (called Interfaces in WSDL 2.0) are defined for the messages, including the names of the operations and their input and output messages. For example:

<portType name="CollectAccountInfo"> <operation name="CheckInfo"> <input message="openA:CustomerInfo"/> <output message="openA:ValidInfo"/> <fault name="InvalidData" message="openA:CustomerDataError"/> </operation></portType>

The bindings are in the physical part of WSDL, and they are omitted here because they use SOAP, SMTP, HTTP, or other communications transport without affecting the logical part of WSDL or WS-BPEL definitions. Structures called partner links are added below the WSDL port types to link the WS-BPEL process definitions to the port types. For example:

<plnk:partnerLinkType name="CheckCustomer"> <plnk:role name="AccountManagement"> <plnk:portType name="openA:CollectAccountInfo"/> </plnk:role></plnk:partnerLinkType>

<plnk:partnerLinkType name="ValidateAccount"> <plnk:role name="ValidRequest"> <plnk:portType name="openA:ApproveApplication"/>

</plnk:role> <plnk:role name="InvalidRequest"> <plnk:portType name="openA:RejectApplication"/> </plnk:role></plnk:partnerLinkType>

These partner links relate WSDL operations to steps within a WS-BPEL process and serve to bridge the description of the service and its interfaces to the description of the process flow defined to consume those services. The WS-BPEL portion of the extended WSDL is identified using a process name. For example:

<process name = "OpenAccount" targetNamespace="http://www.bank.com/wsdl/accountManagement xmlns=http://www.bank.com/2005/05/schemas/AccountService.xsd xmlns:openA=http://www.bank.com/wsdl/OpenAccount abstractProcess="no"

An abstract process is not directly executable, and the abstractProcess field is set to yes when WS-BPEL is used to define choreography rather than orchestration. Any additional namespaces required for the definitions in this section are typically included here. Following the process name, the partner links for this particular flow are referenced to point back to the particular part of the link to the WSDL that this specific flow needs to use. For example:

<partnerLinks> <partnerLink name="CollectAccountInformation" partnerLinkType="openA:GetAccountInfo" <partnerLink name="ValidateAccountInformation" partnerLinkType="openA:CheckAccountInfo" <partnerLink name="OpenAccount" partnerLinkType="openA:OpenAccountOk" <partnerLink name="SendConfirmation" partnerLinkType="openA:ConfirmOpen" <partnerLink name="RepairAccountInformation" partnerLinkType="openA:RepairInformation" <partnerLink name="DeclineAccountApplication" partnerLinkType="openA:DeclineApplication"</partnerLinks>

This example illustrates that six partner links are needed for the six steps in the flow, including CollectAccountInformation, ValidateAccountInformation, OpenAccount, SendConfirmation, RepairAccountInformation, and DeclineAccountApplication.

Following the list of partner links is the declaration of variable names that is, XML Schema, XML Simple Type, and/or WSDL message definitions that are needed for this process. For example:

<variables> <variable name="customerData" messageType="openA:CustomerRecord"/> <variable name="validData" messageType="openA:CustomerRecord"/> <variable name="accountData" messageType="openA:AccountRecord"/> <variable name="confirmationData" messageType="openA:ConfirmationRecord/> <variable name="faultData" messageType="openA:FaultRecord"/></variables>

If any fault handlers are required for the process, those are defined next. For example:

<faultHandlers> <catch faultName="openA:InvalidCustomer" faultVariable="BadData"> <reply partnerLink="ValidateAccountInformation" portType="openA:RejectApplication" operation="sendRejectionMessage" variable="CustomerData" faultName="cannotOpenAccount"/> </catch></faultHandlers>

This fault handler is set up to catch any problem with validating customer data when trying to open an account, such as bad credit data or past problems with the bank. Finally, the process flow sequence is defined to put the operations into the execution relationship. For example:

<sequence> <receive partnerLink="CollectAccountInformation" interface="openA:AccountManagement" operation="InputData" variable="customerData"/> <assign> <copy> <from variable="customerData"/> <to variable="accountData"/> </copy> </assign>

<invoke partnerLink="ValidateAccountInformation" interface="openA:AccountManagement" operation="ValidateData" variable="accountData"/> <assign> <copy> <from variable="accountData"/> <to variable="validData"/> </copy> </assign>

<receive partnerLink="openAccount" interface="openA:AccountManagement" operation="openAccount" variable="validData"/><sequence>

This example illustrates how the process flow would first receive the customer data input from the collect customer information function and next invoke the validate account information function to check the data. Depending on the results of the validation, the flow would continue toward approval or toward trying to clean up the bad data, if possible. WS-BPEL offers several conditional verbs for this kind of branching, including switch, pick, and while commands. WS-BPEL correlation sets identify data shared by the execution of multiple Web services in the process flow and a compensation handler within the fault handler executes any compensation logic that might be able to undo the results of a previous step, such as closing an account that was improperly opened. Aside from the complexities of incorporating WS-BPEL syntax into WSDL files, the relationship to the process flow construct of other technologies such as reliability, security, and transactions may have to be separately understood and individually defined to get an overall flow design to work correctly.

Choreography Description Language

The Web Services Choreography Working Group at W3C is developing the Web Services Choreography Description Language (WS-CDL). WS-CDL is designed to complement WS-BPEL and other extended Web services technologies by defining the executable processes needed to implement a piece of a business choreography or business-to-business (B2B) scenario.

A typical B2B scenario such as that defined within RosettaNet's Partner Information Process (PIP) and ebXML's Business Process Specification Schema (BPSS) involves the submission of an XML document such as a purchase order from one trading partner to one or more other trading partners for execution. WS-BPEL could define the flow of execution, messages in the flow, and other actions such as fault handlers and compensations. While WS-BPEL's abstract processes are intended for B2B interactions, WS-CDL provides additional capabilities beyond WS-BPEL, including how different business process engines might talk to each other, such as a trading partner scenario involving a WSBPEL engine on one side and a RosettaNet engine on another, or a RosettaNet engine on one side and a plain application server on the other (i.e., without a business process management engine).

Metadata such as trading partner name, security information to be shared, policy information on non-repudiation, acknowledgment policy, human approval policies, and so on cannot be defined with WS-BPEL alone when WS-BPEL is used in conjunction with other technologies in a wide-business process collaboration across multiple companies, such as in an extended supply-chain scenario.

WS-CDL is intended for use in B2B scenarios in which it isn't possible to define a single controlling entity for the entire interaction, and it may be necessary to define the rule for sharing control of the overall flow. WS-CDL defines how and when to pass control from one trading partner to another.

WS-CDL provides a "global" definition of the common ordering conditions and constraints under which messages are exchanged that can be agreed upon by all the Web services participants involved in the interaction. Each participant can then use the global definition to build and test solutions that conform to it. Business and government agencies may not want to cede control to an external business process engine and may want to use WS-CDL for negotiating a smooth handoff of control. WS-CDL is not an executable language but rather a declarative language for defining interaction patterns to which multiple parties can agree.

A WS-CDL document is a named set of definitions that can be referenced parties, using a package element as a root that contains one or more collaboration type definitions.

The syntax of the package construct is as follows:

<package name="SupplyChain" author="Ericn" version="1.1" targetNamespace=www.iona.com/artix/examples xmlns="http://www.w3.org/2004/04/ws-chor/cdl"> importDefinitions* informationType* token* tokenLocator* role* relationship* participant* channelType* Choreography-Notation*</package>

The package model defines the participants in collaboration and their respective roles and relationships. Once agreed upon, packages are exchanged a cross trust boundaries among the collaborating companies to share explicit definitions.

The package construct allows aggregating a set of choreography definitions, where the elements informationType, token, tokenLocator, role, relationship, participant, and channelType are shared by all the choreographies defined within this package.

Example of Web Services Composition

In this section, we'll compare and contrast the different approaches to using WS-BPEL to define the flow illustrated in Figure 6-2. In general, there are two approaches to implementing the same business process:

Orchestration-centric. Choreography-centric.

These approaches are described in further detail in the following subsections.

Orchestration-Centric Approach

This approach is called orchestration-centric because it defines the entire process in a top-down manner, with the top-level flow being an orchestration, each task in the orchestration being either a Web service or a sub-orchestration that is called by the top-level orchestration, and each task in the suborchestrations being either a Web service or an orchestration that is called by the sub-orchestrations, and so on.

The following example shows the WS-BPEL pseudo-code for the OpenAccount process (this pseudo-code shows the essential logic of the Web services orchestration using WS-BPEL keywords but without the XML syntax):

receive 'OpenAccountRequest'

invoke CollectAccountInfoinvoke ValidateAccountInfoassign AccountInfoInvalid = ValidateAccountInfoResponsewhile AccountInfoInvalid = true invoke RepairAccountInfo pick onRepairAccountInfoCB invoke ValidateAccountInfo assign AccountInfoInvalid = ValidateAccountInfoResponse otherwise // timeout - assume AccountInfo can't be repaired invoke DeclineAccountApplication terminate end pickend whileinvoke OpenAccountinvoke SendConfirmation

Figure 6-14 shows a drawing of the OpenAccount process in terms of how it orchestrates the execution of a series of Web service requests.

Figure 6-14. OpenAccount process using Web services orchestration.

In this approach, the OpenAccount process is implemented as a WS-BPEL orchestration that has the following characteristics:

The orchestration is initiated when an OpenAccountRequest is received. The orchestration invokes Web services (such as OpenAccount and

CollectAccountInformation) to fulfill the steps in the orchestration.

The orchestration defines the business logic for the OpenAccount process, including control logic (e.g., control of the while loop that handles invalid account information) and data flow.

Loops and conditional processing constructs are not shown but are assumed to exist and to be handled by the orchestration control point rather than within any of the individual services.

Choreography-Centric Approach

This approach is called the choreography-centric approach because it links together all the business tasks in the top-level business process using a series of choreographies, with no single engine being in control. In this approach, the interactions are peer-to-peer (each choreography operates as a peer to the other choreographies), instead of the more command-and-control style of approach typified by the orchestration-centric approach.

Figure 6-15 shows a drawing of the OpenAccount process using the choreography-centric approach.

Figure 6-15. OpenAccount process using Web services choreography.

For instance, the interaction between each pair of tasks is defined as a choreography: CollectAccountInformation and ValidateAccountInformation. ValidateAccountInformation and RepairAccountInformation. ValidateAccountInformation and OpenAccount. OpenAccount and SendConfirmation. RepairAccountInformation and DeclineAccountApplication.

Comparing Orchestration-Centric and Choreography-Centric Approaches

In general, the choreography-centric approach is more loosely coupled. It is particularly well suited when portions of the process span administrative and organizational boundaries, which

makes it difficult (if not impossible) to synchronize internal processes; however, it is much more important to define and specify the business protocol linking the partners (even if the "partners" are simply departments in the same company).

One key difference is that the orchestration approach assumes a single, central point of control over the entire scope of the process execution, while the choreography approach assumes that execution control is shared, potentially across multiple business process engines or various other technologies.