wp6: infrastructure & application-oriented services for user communities work plan and roadmap

www.gisela-grid.eu

Grid Initiatives for e-Science virtual communities in Europe and Latin America

WP6: Infrastructure & Application-oriented Services for User Communities

Work Plan and Roadmap

Francisco Brasileiro

Universidade Federal de Campina Grande – UFCG (Brazil)

Vanessa Hamar

Centre de Physique des Particules de Marseille – CNRS/CPPM (France)

Kick-off Meeting, 21st – 24th September, 2010

San Luis Potosí (Mexico)

www.gisela-grid.eu

Outline

• Goals

• Success Metrics

• Team

• Modus Operandi– Management– Development– Support

• Service Portfolio

• Internal Milestones for 1st Year

2KoM – 23/09/2010 – San Luis de Potosí, Mexico

www.gisela-grid.eu

WP’s Goals as Described in the DoW

• The objective of … [WP6] is to enhance the grid experience of both users and system administrators by providing them with a portfolio of application-related and infrastructure-related Grid Services and the appropriate support to allow them to use these services adequately.

• The portfolio of services is mainly formed by the services developed in the context of the EELA-2 project and new services to be developed in the context of GISELA.


www.gisela-grid.eu

Success Metrics

• As stated in the DoW

KoM – 23/09/2010 – San Luis Potosí, Mexico 4

www.gisela-grid.eu

Success Metrics• As should always be in the minds of WP6

team– Provide the services that will facilitate as much

as possible The growth, management and monitoring of the

e-infrastructure The porting and execution of applications

KoM – 23/09/2010 – San Luis Potosí, Mexico 5

www.gisela-grid.eu

WP’s Team

• UFCG (28 PM)– Francisco Brasileiro (WP manager), Nazareno Andrade,

Guilherme Santos, Tarciso Oliveira, Rodolfo Viana

• CPPM/CNRS (26 PM)– Vanessa Hamar (WP deputy manager),

Andrei Tsaregorodtsev

• UNIANDES (20 PM)– Harold Castro, Mario Villamizar, Germán Sotelo, Claudia

Jiménez

• INFN (6 PM)– Diego Scardaci


www.gisela-grid.eu

WP’s Management Modus Operandi

• One management meeting per month (normally via skype) with one representative from each institution involved– First one took place yesterday

• Summary of activities sent by institution representative to management by e-mail every fortnight

• Technical meetings will be schedule as required with the people concerned


www.gisela-grid.eu

WP’s Development Modus Operandi

• Development– Common tracking tool

Redmine• Issues• Task management

– Distributed repositories EELA-2 services (maintained by INFN) OurGrid middleware (maintained by UFCG) DIRAC (maintained by CERN) Customized virtual clusters (maintained by UFCG)


www.gisela-grid.eu

WP’s Support Modus Operandi (1/2)

• Support tools– Project web page and service specific web

pages FAQ Service description, manual and documentation

– Mailing lists Support for application-oriented services Support for infrastructure-oriented services Existing lists for more established services (eg.

OurGrid, DIRAC)

– Online assistance Mainly for speeding up service deployment


www.gisela-grid.eu

WP’s Support Modus Operandi (1/2)

• Work in close cooperation with WP3 and WP4– Define priorities and common actions– Help in training activities– Share tools

Ticket system for reporting issues with production software Mailing lists for announcing new services

• WP3 help to WP6– Prospect VRCs to identify the need for new services– Validate new services

• WP4 help to WP6– Collaborate in the installation and test of new services

developed


www.gisela-grid.eu

Service Portfolio (1/3)

• Application-related Services– Data Management

Digital archives Secure storage Cooperative annotation of data

– Job management DIRAC (better match making and customised scheduling) OurGrid (scheduling of bag-of-tasks jobs) Workflow for OurGrid jobs WatchDog (monitoring and control of job execution on the gLite

Worker Node)

– Catalogue and file management lcg-rec toolkit (recursive version of the lgc-* suite of commands)


www.gisela-grid.eu


• Infrastructure-related Services– Support for resource centre deployment

OurGrid middleware Interoperation gateways gLite over Microsoft Windows platforms VO compliant virtual machine environments DIRAC

– Support for grid operation SAGE (Storage Accounting for Grid Environments) Dashboard (Monitoring)


www.gisela-grid.eu


• The portfolio is completed with services that are being developed in the context of GISELA

• New services already identified– Aggregation of spare disk space in multiple desktops in a single

Storage Element (UFCG and UNIANDES)– Efficient execution of data-intensive applications based on the

MapReduce paradigm (UFCG)– Seamless execution of applications in hybrid

e-Infrastructures augmented with the capability of interfacing with cloud computing providers (UFCG)

– Customized virtual clusters (UNIANDES)

• Others services under evaluation– MAGOS (UNIANDES)– Montera (CIEMAT)


www.gisela-grid.eu

Milestones for the 1st Year (1/2)

• By end of October, 2010 (M2)– Complete the setup of the development and

support tools (redmine, wiki, mailing lists, etc.)

• By November, 2010 (M3)– Deploy replicated DIRAC servers installed at

UFRJ, CPPM and UFCG– Establish procedures to feed WP4 with

monitoring and accounting information for non-gLite sites

– Deploy at least one site running Secure Storage– Test a deployment of BeeFS at UNIANDES


www.gisela-grid.eu

Milestones for the 1st Year (2/2)

• By the end of December, 2010 (M4)– Deliver first version of tool to deploy customized clusters

• By the end of February, 2011 (M6)– Deploy several sites running Secure Storage– Upgrade gLite application-oriented services to gLite 3.2

• By the end of April, 2011 (M8)– Deploy at least one production site running BeeFS and

BashReduce

• By the end of July, 2011 (M11)– Deploy version of customized virtual clusters with single

image deployment and dynamic IP assignment– Deploy Secure Storage in all gLite production sites


www.gisela-grid.eu

Thanks for your attention

Any questions?


wp6: infrastructure & application-oriented services for user communities work plan and roadmap

Documents