development of distributed metbroker toward information grid jedsada phengsuwan, sornthep vannarat,...
TRANSCRIPT
![Page 1: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/1.jpg)
Development of Distributed MetBroker toward Information Grid
Jedsada Phengsuwan,
Sornthep Vannarat, Piyawut Srichaikul
Computer Technology Research and Development Division (R-DC)
National Electronics and Computer Technology Center (NECTEC), Thailand
![Page 2: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/2.jpg)
Agenda
Objective
Distributed MetBroker
Discovery Service
Progress of Distributed MetBroker
Summary
Information Grid
![Page 3: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/3.jpg)
Objective
Collaborative work between NECTEC, HAII (Thailand) and NARC (Japan)
Extend NARC’s Centralize MetBroker to distributed System
Based on Web Services and Grid Technology
Consist of 2 main components
MetBroker
Discovery Service
Applies for other project (Multiple Broker, Info. Grid)
![Page 4: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/4.jpg)
Distributed MetBrokers Scenario
MetBroker
data
Discovery Service
discovery result
DS
DS
DS
DS
DS
![Page 5: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/5.jpg)
Discovery Service
Discover MetBroker
analyze user’s data request
return suitable MetBroker
Smart Discovery Service
Registry
MetBroker registry services
Monitor MetBroker
status (running, shutdown)
![Page 6: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/6.jpg)
What are information required by DS?
Metadata
Database name, Region, station
type of data (wind, rain, humidity)
System Resource Information (Server Information)
CPU (Speed, cache size)
Memory (used, free and total of memory and virtual machine memory)
OS
Network (server response’s time)
Amount of User
![Page 7: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/7.jpg)
Discovery Service
The best MetBroker
Used for Multiple Broker project
SiMB = i
MB x iRsrc x (Wi
region + Wiusers + Wi
net + WiCPU + …)
n
Sbest = Max (S1MB, S2
MB, …, SNMB)
J.G. Wang (NARC)
![Page 8: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/8.jpg)
Progress of Distributed MetBroker project
Recently
Add Ozone Object Database to MetBroker
MetBroker Web Services
New Progress
Discovery Service System resource information Service
![Page 9: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/9.jpg)
Technologies related
Open Grid ServicesArchitecture
OGSA
Web ServicesTechnology
Grid Services
OGSI
grid Technology
GT 3.2
Open Grid ServiceInfrastructure
Impl
emen
tsSpecifies
defines
Integrates
![Page 10: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/10.jpg)
Service Data
Set of structured data to any services
State information
Service Metadata
Server 3
Server 1
Server 2
SDE: MathSpeed: 2Cost : 0Type : PC
SDE: MathSpeed: 6Cost : 5$Type : Cluster
SDE: MathSpeed: 10Cost : 10$Type : Mainframe
Client
Which Server is good for me?
![Page 11: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/11.jpg)
Service Data for Discovery Service
Used to provide System Resource Information
DS
BrokerSystemInfo SDE- CPU - OS- Memory- Network- Number of User
DS2BrokerStatus SDE-BrokerStatus-DSStatus-LastCall-LastResponse
![Page 12: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/12.jpg)
Design
Grid environment
SDE(BrokerSystemInfo )
SDE(DS2BrokerStatus)
MetBroker DSServices
grid service
DS
Services
grid service
MetBroker
MetBroker
DS
Services
grid service
SDE(BrokerSystemInfo )
SDE(DS2BrokerStatus)
SDE(BrokerSystemInfo )
SDE(DS2BrokerStatus)
![Page 13: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/13.jpg)
DS remoteinterface
MetBroker
System ResourceEngine
System Info.
Grid environment
Grid Service Container
DiscoveryServiceFactory
How does it work?
ds-instanceServices
SDE(BrokerSystemInfo )
SDE(DS2BrokerStatus)
updater
DS2BrokerTimerTask
Connectionstarter
Sta
rt ta
sk
RMI
SOAP
Create grid service
instance
update
update
![Page 14: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/14.jpg)
Summary
MetBroker can provide server’ system resource
CPU, Memory, OS Information
other information : network, amount of user
use RMI to access these information
Share information to grid environment
we can get information from SDE
using SOAP protocol to connect and get information
Monitor MetBroker status
ALIVE, NOT_RESPONSE
![Page 15: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/15.jpg)
Information Grid
Objective
build frame work and infrastructure for integrating public information sources to support a problem solving environment
Homogeneous information sources
Other products like IBM’s DB2II, Avaki
![Page 16: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/16.jpg)
Components
Marker Directory
Information Broker
Discovery Service
Marker Description Language IB IB
IBIB
DS
DS
Data
Data
Data
Data
Data
Data
Data
Data
Data
Application process
MD
Person
![Page 17: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/17.jpg)
Information Grid
Implements
Marker Directory
Information Broker
Discovery Service
Application
Standard
Information Grid Framework
Marker Definition Language
![Page 18: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/18.jpg)
Technologies related
Grid
globus 4.0
grid services
Web Services
Semantic web
Resource Description frame work (RDF)
Ontology
Distributed MetBrokers
![Page 19: Development of Distributed MetBroker toward Information Grid Jedsada Phengsuwan, Sornthep Vannarat, Piyawut Srichaikul Computer Technology Research and](https://reader035.vdocuments.net/reader035/viewer/2022062805/5697c0081a28abf838cc6ccb/html5/thumbnails/19.jpg)
Thank you