ogsa/ogsi, wsrf & globus - university of chicagoborja/lectures/towards_service... · eventually...
TRANSCRIPT
Towards a service-oriented Grid
OGSA/OGSI, WSRF & Globus
Towards a service-oriented Grid
Borja Sotomayor
June 16th 2004
Towards a service-oriented Grid
Abstract
The Open Grid Services Architecture (OGSA), set to become the standard architecture for most grid applications, depends on Web Services as the underlying middleware. OGSA first spawned the Open Grid Services Infrastructure which, despite improving Web Services in several ways, failed to converge with existing Web Services standards. The Web Services Resource Framework (WSRF), introduced last January, improves on OGSI and will eventually replace it. The presentation will cover the evolution and current state of OGSA, OGSI, WSRF, and the next version of the Globus Toolkit (GT4), which will be the first implementation of the WSRF specification.
Towards a service-oriented Grid
Contents
OGSA (briefly)Web Services and Grid ServicesWhere does GT3 fit in?WSRF and GT4
Towards a service-oriented Grid
Contents
OGSA (briefly)Web Services and Grid ServicesWhere does GT3 fit in?WSRF and GT4
Towards a service-oriented Grid
OGSA (I)
A Grid systems is built with several different subsystems.For example...
Towards a service-oriented Grid
OGSA (II)
Job Submission and Management
Virtual Organization Management
Security
Resource Discovery and Monitoring
WorkflowData Management
Towards a service-oriented Grid
OGSA (III)
Virtual Organization Management
Security
Resource Discovery and Monitoring
WorkflowData Management
Job Submission and Management
Towards a service-oriented Grid
OGSA (IV)The Open Grid Services Architecture (OGSA) aims to standardize the different services that are commonly found in a Grid application.
Job management, security, VO management, data management, workflow, deployment, etc.
OGSA was introduced in the classic paper “Physiology of the Grid” (I.Foster, C.Kesselman, J.Nick, y S.Tuecke)The actual standardization process is being carried out by the Global Grid Forum (GGF)
http://www.ggf.org/
Towards a service-oriented Grid
OGSA (V)
What exactly does OGSA define?“A set of core interfaces and behaviours that address key concerns in Grid systems.”
Each particular service can be accessed in the same fashion, regardless of vendor, organization, internal implementation, etc.
Still a work in progress!
Towards a service-oriented Grid
OGSA (VI)
What underlies this?How are the interfaces defined? How does a client request a particular operation from a service?
OGSA relies on (and aims to improve) web services technologies
Broader context: Service-Oriented Architectures (SOA)
Towards a service-oriented Grid
Contents
OGSA (briefly)Web Services and Grid ServicesWhere does GT3 fit in?WSRF and GT4
Towards a service-oriented Grid
Web Services (I)
What are Web Services?Yet another distributed middleware technology (just like CORBA, RMI, EJBs, etc.)
What sets it apart:Clean separation between interface (what the service does) and implementation (how it does it).Based on standard interoperable languages (XML).Widespread use and abundant software available
Towards a service-oriented Grid
Web Services (II)
� ������������� A web service 'publishes' the operations it is capable of performing through its interface. The interface is written in a specific language.
�� ���� �� ����������� ��� The implementation and the interface are kept separate. The implementation is done using a programming language (Java, C++, ...)
��������� �������� �� �!���� "����� Both the implementation and the interface are placed in a running environment, which is in charge of handling all incoming calls, crafting the responses, etc.
Separation of interface and implementation
Towards a service-oriented Grid
Web Services (III)
Separation of interface and implementationInterface is defined in an XML language called WSDL (Web Services Description Language). WSDL is language and platform-neutral, and allows the interface to be defined separately from the particular transport protocol or data encoding used in the actual message passing.
e.g. A GNU/Linux client can access a web service in a Windows server using protocol A, while a different client using Solaris might use protocol B.
Towards a service-oriented Grid
Web Services (IV)
We can use web services to build SOAs (Service-Oriented Architectures)
Architecture in which an application uses several independent services (or loosely coupled services) that cooperate to undertake a common task.
“loosely coupled”: A change in the implementation of one service doesn't affect the other services.
SOAs improve interoperability and reusability.
Towards a service-oriented Grid
Web Services (V)
Why are Web Services ideal for OGSA and, in general, for Grid systems?
Can easily cope with heterogeneous systems (different programming languages, platforms, etc.)Common interface language (WSDL) allows:
Virtualization: from a pool of services (with the same interface) I can access any service in the same fashion regardless of vendor, platform, etc.Dynamic service indexing and discovery.Dynamic access to services.
Towards a service-oriented Grid
Grid Services (I)
Despite being the best option for OGSA, Web Services still have important disadvantages:
StatelessNon-transient ('Persistent')No supporting services (notifications, lifecycle management, etc.)
OGSA defines the concept of a Grid Service to overcome these limitations.
Grid Service = improved Web ServiceGrid Services are compatible with WS
Towards a service-oriented Grid
Grid Services (II)
OGSA is based on Grid ServicesGrid Services are specified in a separate spec spawned by OGSA: Open Grid Services Infrastructure (OGSI).All the services in OGSA (Job management, security, etc.) will be based on (and implemented with) Grid Services.
Towards a service-oriented Grid
Grid Services (III)
Towards a service-oriented Grid
Grid Services (IV)
OGSI
OGSA
#%$'&)(*$,+.-,/ 0�$21
Applications
Towards a service-oriented Grid
Contents
OGSA (briefly)Web Services and Grid ServicesWhere does GT3 fit in?WSRF and GT4
Towards a service-oriented Grid
Globus Toolkit 3 (I)
The Globus Toolkit is probably the best-known software package for Grid programming.However, there seems to be an ongoing confusion regarding the relationship between GT3 and OGSA + OGSI...
GT3 == OGSA?GT3 == OGSI?Is GT3 a magical toolkit which will allow me to program Grid systems out-of-the-box?
Towards a service-oriented Grid
Globus Toolkit 3 (II)
The Globus Toolkit 3 (GT3) is a complete implementation, in Java, of the OGSI spec.
Not the only implementation out there, but the most complete one.
Very important: GT3 isn't only an OGSI implementation.
Includes OGSA-defined servicesIncludes its own non-OGSA services (which have become a de facto standard)Also includes non-WS components (GT2.4)
Towards a service-oriented Grid
GT3 Architecture
GT3 CoreOGSI: Grid Services, Service Data, Notifications, Transient Services (Factory/Instance), Service Groups.
GT3 Security Services GSI (Grid Security Infrastructure), SSL, WS-Security, SOAP, ...
GT3 Base ServicesJob Management (MMJFS), Monitoring and Discovery Services (MDS), Reliable File Transfer (RFT)
GT3 DataServices
Management of large volumes of data (Replica Management)
Other Grid Services Non-GT3 services based on the GT3 architecture
Towards a service-oriented Grid
OGSA, OGSI, and GT3 (I)
Towards a service-oriented Grid
OGSA, OGSI, and GT3 (II)
OGSI
OGSA
#%$'&3(4$,+.-,/ 0�$21
Aplicaciones
576 8:9<;=8:> ;@? ACB=;'D E�FHGJI8@9K;'? LNMPO B:L�B@9P6 B=;'D�M:Q B.R�QTS�MK8=UPV<BWSYX@? ZPI
576 8H9C;=8H> ;=? ACB@;'D [�[2\HI8=9K;'? LNMKO BHL�B=9P6 B=;'D [^]_F:I
` 9�Z.6 8=9P;=8=> ;H? AK8P6�? aH9NM=> aKU<B@Z<Z�D [W[W\bIcHdfe�g 8=9K8@hKB:L�BH9<6c 5iB@UPjK>k? 6 lcim BKZ<a:j@> U<BN8:O O aKU<8@6 ? aH9c:n aHoNL�8:9C8@h=B=L�BH9<6cip 8P6 8'L�8:9C8@h=B=L�BH9P6c Eqa=>�r�sO aPtc BK6 U@Q
Towards a service-oriented Grid
Not the panacea...
Bottom line: GT3 can be an essential part of a Grid system, but not the only component.
GT3 covers a lot of the work, but each individual project will need to implement its own services, integrate with existing applications, etc.Not a turnkey solution.GT3 is for programmers, not users.Highly recommended:
“Putting the Globus Toolkit in its Place”http://www-unix.mcs.anl.gov/~liming/ggf11/
Towards a service-oriented Grid
Contents
OGSA (briefly)Web Services and Grid ServicesWhere does GT3 fit in?WSRF and GT4
Towards a service-oriented Grid
WSRF (I)
Despite being generally accepted as a good change within the Grid community, OGSI has not caught the eye of the Web Service community.
GGF had hoped that Web Services standards and OGSI would converge, but that convergence is not happening.
Towards a service-oriented Grid
WSRF (II)
uwv�xzy
{}|�~
Started far apart in apps & tech
�,�N�^����i�� ���
�f� �W����^�,����"�,���
���^�,�q� ��"� �,�
Have beenconverging
�
�T�z���z������� ���Y�z�z�!� �� ¡ �:�z¢ £ ���z�b£ �¤ ¢ ��¥z¦��!§��� ¢ �b¨�©�©�ª
Towards a service-oriented Grid
WSRF (III)
Objections to OGSI:Dense specificationDoesn't work well with existing Web Services toolingToo object-oriented
Web Services are not supposed to be object-oriented, despite the fact that most Web Services are implemented using object-oriented languages. This specially refers to the fact that OGSI Services are stateful (Web Services are supposed to be stateless)
Towards a service-oriented Grid
WSRF (IV)
To achieve Web Service & Grid Service convergence, a new standard was announced during GlobusWORLD 2004 (January 2004)This new standard will supersede OGSI.WSRF – Web Services Resource Framework
Towards a service-oriented Grid
WSRF (V)
uwv�x«y
{}|�~
{¬¯®±°Started far apart in apps & tech
�,�,� �� � �� � �
� � ����"� �,� �� �,�«�
� �^�,�q� �� � � �
Have beenconverging
�T�z���z������� ���Y�z�z�!� �� ¡ �:�z¢ £ ���z�b£ �¤ ¢ ��¥z¦��!§��� ¢ �b¨�©�©�ª
Towards a service-oriented Grid
WSRF (VI)
OGSI
OGSA
#%$'&)(*$,+.-,/ 0�$21
Applications
Web Services
e [W5_S�t�a:jPO ;'oKB'oK8PZ<B=;;@? > B=U.6 O l�a@9�t^B@o�Z<B:> ²@? U<BPZK³? 9KZ.6 B=8=;Na<s=t�a:>�r<? 9<h�t^? 6 VN8;@? s s�B@> B:9P6H´ ? LNM=> a<²PB=;�²PB:> ZP? a@9@´a<s=t�B:o�Z<B:> ²@? U<B=Z@Q Eµ5 m \2t�a@j=O ;'o<B�8'M<8:> 6Ha<sH6�VCBEµ5�Z.6 8H9C;=8H> ;KZK³@? 9CZC6 B=8K;NaPso<B:? 9<hN8,´ MK8P6 UPV@´�a<²@B=>:BCX@? Z.6 ? 9<hZ.6 8:9<;=8:> ;PZND�O ? rTB e [�5 ` I
Towards a service-oriented Grid
WSRF (VII)How WSRF deals with OGSI's problems:
“Dense specification”WSRF is divided in five documents plus a complementary specification (WS-Notification)
“Doesn't work well with existing Web Services tooling”WSRF harmonizes with Web Services: less aggressive use of XML Schema, use of pure WSDL 1.1 for interface description (instead of GWSDL, a 'patched' version of WSDL fit for OGSI)
“Too object-oriented”WSRF explicitly separates the service (which will always be stateless) from the state (which is called resource in WSRF lingo). In a typical interaction, the client will have to specify what resource (i.e. what state information) must be used during that particular interaction.
Towards a service-oriented Grid
WSRF (VIII)
Don't panic! WSRF isn't a radical change. Conceptually the same thing as OGSI.
Syntactic changed.OGSI refactored into several standards (instead of one single monolithic document)
In theory, the transition from OGSI to WSRF will be simple.Direct mapping from OGSI features to WSRF.
What about OGSI/GT3? Is it still worth looking into it?Depends! If you've already started working with GT3, all that OGSI know-how will certainly come in handy when migrating to GT4 (plus GT3 will continue to be supported by Globus). However, if you have to choose a tool right now, bear in mind that a truly stable GT4/WSRF is still far off.
Towards a service-oriented Grid
WSRF/GT4
Why is WSRF more likely to succeed? Harmonizes with Web ServicesBacked by IBM and HP
First, full, free implementation: GT4IBM will include support for WSRF in some of its tools.
More WSRF details: http://www.globus.org/wsrf
Towards a service-oriented Grid
GT3/GT4 Evolution
�T�«�«�«������� ���Y�«�z�!� �� ¡ �:�z¢ £ ���«�b£ �¤ ¢ ��¥z¦«�¶§J�� ¢ ��¨�©z©�ª
·�¸�¹º«»½¼_¾!¿HÀ_Á:¯¾!¿7Ã7Ä:ÅCÆ�ÇHÁ=ÅKÅ@ÈÅ<ÉKÊ7Ë Ê7Ã7Ì Ë Ì Æ�Í7ÈJ¼@Á7¾¶Î!¿7¾z»ÏÊ7Ç:ÉPÁbÈÄHÅ<ÊYÃ:Ì Ë Ì Æ�Í
ÐNÑ�ÒÓ½Ô�ÕPÖY× ØÑÙ
βÚqÒ ØÑkÙÚµÐ
ØÑ�ÒÚÜÛÞÝ�ÙNß
ØÑ�Ò
βÚØ
à�Ä7»�Á_¾!¿7ÄbÅ*Ç:ÁHá�â¯ã�äfåKæ.Ã:Ê:Å<Á:½Å<Á7¾¶À�Ì ÉPÁ:Åç ¸�¹
ç ¸zèâ¯ã�ä�å:é^Å<¿7»�ÁqÇHÁHáÎ!Ä�Ç:É.Æ�Ì ¿�Ç:Ê7Ë Ì Æ�Í7éJÎ!Ä7¾¶Æ�ê:Á7¾Ä:ÅPÊ7Ã:Ì Ë Ì Æ�Í7ȼ:Á:¾!ζ¿7¾z»ÏÊ7Ç:ÉPÁÁ7Ç7êHÊiÇHÉKÁ:»�ÁiÇ=Æ!Å
ëbìbì_í ëbì7ìiî
Towards a service-oriented Grid
First impressions on WSRF
So far, Globus has made two development releases of the WSRF Java Core.
3.9: May 21st 3.9.1: June 11th http://www-unix.globus.org/toolkit/downloads/development/
First (personal) impressions after trying out development releases:
The jump from OGSI to WSRF really does seem simple.The development methodology in GT3.9 isn't all that different from the one in GT3.Usability needs to be improved.
Towards a service-oriented Grid
Summing up...
“Grid Computing” is undergoing an intense standardization process.
OGSA: Still work-in-progress (some parts finished)OGSI: Promising start, but didn't quite make itWSRF: Will it achieve true Grid/Web convergence?
Until OGSA is truly stable, the Globus Toolkit remains the de facto standard, and one of the most important pieces of software in Grid system development.
Towards a service-oriented Grid
Questions?
ï4ðNñ!òTó"ô*ð�õ�ð,ö÷ó�ø�ð�ñùbúiûbü�ý þÿ���������� ������ � ���������� ������� ���� ��� þ¶ÿ��������Yü �bþ!�"�#Jð�õ�ð�ö�ó�ø�$&%�#('*)+%�,-)+%�.�#�õ�ð/,*%�#