grid information services - ut · ldap database top giis top giis giis ee giis fi giis se site giis...
TRANSCRIPT
Grid Information Services
Week #3Basics of Grid and Cloud computing
Hardi [email protected]
University of TartuFebruary 27th 2013
Basics of Grid and Cloud computing 2/28
Overview
● Grid information services● ARC CE and its services● Information indexing● Accounting records● Service monitoring● Authorization services
Basics of Grid and Cloud computing 3/28
Grid acronyms
● EGI Glossary● http://www.egi.eu/about/glossary/ ● Goole search helps
● EGI Security Policy Glossary of Terms● https://documents.egi.eu/public/ShowDocument?docid=71
Basics of Grid and Cloud computing 4/28
Grid
Grid is securely share distributed resources (computation, storage, etc) so that users can collaborate within Virtual Organisations (VO):
Basics of Grid and Cloud computing 5/28
GRID
MIDDLEWARE
Visualization
Supercomputer, PC-Cluster
Data-storage, Sensors, Experiments
Internet, networks
Desktop
Mobile Access
Basics of Grid and Cloud computing 6/28
Grid foundations
Basics of Grid and Cloud computing 7/28
Information services
● Maintains information about hardware, software, services and people participating in a Virtual Organization– Should scale with the Grid´s growth
– Sharing jobs
– Logging and accounting
– Monitoring
Basics of Grid and Cloud computing 8/28
Real Life - Services in ARC CE
Basics of Grid and Cloud computing 9/28
Batch system
● “Batch processing is execution of a series of programs ("jobs") on a computer without manual intervention.” Wikipedia.org
● Many users● Different priorities● Different resources
● Condor, LoadLeveler, LSF, PBS/Torque + maui, Grid Engine, SLURM
Basics of Grid and Cloud computing 10/28
ARC Computing Element (CE)
● Universal frontend for different batch systems
● Standard and custom interfaces
● Status information publishing
● File handling
Basics of Grid and Cloud computing 11/28
ARC CE internals
● All services are only in the frontend
● Grid users are mapped to local identities
Basics of Grid and Cloud computing 12/28
Information Indexing
● GIIS – Nordugrid
● BDII – gLite
1
Basics of Grid and Cloud computing 13/28
SITE GIISSITE GIIS
GIIS DK
TOP GIIS
Grid Index Information service (GIIS)
● Tree-like hierarchy
● Three levels● Top level● Country level ● Site level
● LDAP database
TOP GIIS TOP GIIS
GIIS EE GIIS FI GIIS SE
TOP GIIS
SITE GIIS
GIIS EE
SITE GIISSITE GIISSITE GIISSITE GIISSITE GIISSITE GIIS
Basics of Grid and Cloud computing 14/28
NorduGrid monitor
● Information about all sites available at TOP level GIIS.
● Participating countries
● Site info
● Jobs info
Basics of Grid and Cloud computing 15/28
Estonian Grid monitor
● http://monitor.grid.ee/
● Information from Estonian top level GIIS
● Faster than NG monitor
Basics of Grid and Cloud computing 16/28
Accounting records
● SGAS for “local” accounting
● EGI central accounting portal
2
Basics of Grid and Cloud computing 17/28
SGAS
● SGAS – SweGrid Accounting System
● Originally developed for SweGrid
● Now used also for other NGIs
● For local/NGI accounting
Basics of Grid and Cloud computing 18/28
EGI accounting
● EGI accounting portal● accounting.egi.eu● Global view● VO manager/member view● Site admin view● User view
Basics of Grid and Cloud computing 19/28
Service monitoring
● GOCDB portal
● SAM portal● Nagios tests
3
Basics of Grid and Cloud computing 20/28
Service monitoring
● Grid Configuration Database (GOCDB)
● Contains general info about the sites participating to the production Grid
● https://goc.egi.eu ● NGI information● Contacts of sites and
services
Basics of Grid and Cloud computing 21/28
Service monitoring
● GOCDB site view● Contacts● Project info● Networking info● Location info● List of services● List of people
Basics of Grid and Cloud computing 22/28
Service monitoring
● MyEGI – Service Availability Monitoring Portal
● grid-monitoring.cern.ch/myegi/
●
Basics of Grid and Cloud computing 23/28
Service monitoring
● NAGIOS monitoring● SAM test● Site status● Trouble tickets
Basics of Grid and Cloud computing 24/28
Authorization service
● VOMS service
● ARGUS – is a system meant to render consistent authorization decisions for distributed services
4
Basics of Grid and Cloud computing 25/28
arcinfo
● ARC client tool for site info
Basics of Grid and Cloud computing 26/28
Services in ARC CE
Basics of Grid and Cloud computing 27/28
References
● I used several pictures from Oxana Smirnova's presentation
● http://www.nordugrid.org/slides/20111207-oxana.pdf
● More information about information services:● https://wiki.egi.eu/wiki/Tools ● http://www.nordugrid.org/papers.html
Basics of Grid and Cloud computing 28/28
Thank you● More information from:
● Hardi Teder [email protected]
● http://courses.cs.ut.ee/2013/cloud