virtualizing lifemapper for pragma: step 2 - the computational tier by aimee stewart, cindy zheng,...

9
Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity Institute University of California, San Diego http://www.lifemapper.org

Upload: ainsley-bizzle

Post on 01-Apr-2015

216 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity

Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier

ByAimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady

University of Kansas Biodiversity InstituteUniversity of California, San Diego

http://www.lifemapper.org

Page 2: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity

Lifemapper

• Data– Climate Data– Species Archive• Input: points • Output: potential habitat maps

• Tools– LmSDM: Species Distribution Modeling– LmRAD: Range and Diversity

GBIF

Page 3: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity

Lifemapper Tiers

Web Tier Client TierManagement Tier

Pipeline

Data updaterJob generator

Job trackerMetadata manager

Lm Web siteREST Web Services

Job submissionData request

Result request

Desktop clientBrowser client

Experiment management,

Result visualization, exploration, analysis

Compute Tier

Virtual clusters request Jobs

Species Distribution Modeling

Range and DiversityAnalysis

Data Tier

Species Sensors

Result archives

Models

Page 4: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity

Virtual Biodiversity ExpeditionStep 1: Species Distribution Modeling

Species Occurrence Data

Landsat Data

Potential Habitat

1

2

3

3

4

5

Page 5: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity

Adding a PRAGMA Compute Tier

LM Compute

LM Management

LM Data

LM Compute

Page 6: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity

DEMO

Page 7: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity

Preparation

Web Tier Client TierManagement Tier

Pipeline

Data updaterJob generator

Job trackerMetadata manager

Lm Web siteREST Web Services

Job submissionData request

Result request

Desktop clientBrowser client

Experiment management,

Result visualization, exploration, analysis

Compute Tier

Virtual clusters request Jobs

Species Distribution Modeling

Range and DiversityAnalysis

Data Tier

Species Sensors

Result archives

Models

Page 8: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity

Execution

• Specialization– Resources request subset of available jobs– Based on data, users, computation type

• Scaling– Management - Increased job speed– Compute – increased data replication

Page 9: Virtualizing Lifemapper for PRAGMA: Step 2 - The Computational Tier By Aimee Stewart, Cindy Zheng, Phil Papadopoulos, C.J. Grady University of Kansas Biodiversity

Lifemapper funded by:

U.S. National Science Foundation

NSF EPSCoR 0553722

NSF EPSCoR 0919443

EHR/DRL 0918590

BIO/DBI 0851290

OCI/CI-TEAM 0753336

http://[email protected]