GEMINI

Indiana University, University of Kentucky

Overview

• Combine U. Kentucky’s INSTOOLS, perfSONAR and Periscope

• Support scalable, high-rate measurement across layers– Including infrastructure

Measurement Points

• Produce measurement data• Send data to a Measurement Store• Send metadata to UNIS• Standard perfSONAR and INSTOOLS MPs• BLiPP (Basic Lightweight Periscope Probes)

– High rate host monitoring– Adjustable frequency

• NetLogger and Calipers for application monitoring– Addressing scalability with in-line analysis and summarization– Example: system call monitoring to determine file transfer

bottleneck

Measurement Store

• Stores Measurement data (I know you didn’t see that coming)

• Supports high-rate data transfers• Publish/Subscribe interface• Multiple tiers with different characteristics– Surge tank near the source– Bottom of rack– Parallel storage for slice-wide data

MAP

• Measurement/Management and/Analysis Presentation Service

• Configuration GUI• Visualize data (from MS)• Visualize topology (obtained from UNIS)

Portal

• “One stop shop” to integrate various MAP services

MC

• Measurement controller/coordinator• Initiates measurement collection• Coordinates measurements• Fetches data from some MPs

UNIS

• Directory service• Topology data– As well as changes

• Service data• Measurement metadata

Cross cutting

• RESTful interface to perfSONAR (Periscope)• GEMINI Event Messaging Service (GEMS)– High rate data with JSON/BSON

Portal Login Windowing Standard Views Prefs

Operator

User

CF Control

FLACK

GUSH

Other…

IM Control

INSTOOLS

UNIS

Other…

MeasurementGraphs/Tables

INSTOOLSPeriscope MAP

Other…

CMS Interface

Drupal

Runtime Interface

-VNC

Archive Interface

Control Framework

Services

Archive

MP1

MP2

MP3

MPn……

CM

SA

Storage

Services…

VM to run

archiveCH

MCC MS

Local/Private Storage

Control And

(Data) Collection

AuthN/Z

UNIS

INSTOOLSGMOC

iRODS- ShellsLab Book

Management and Presentation (MAP)

I&M Services

GENI Resources

GEMINI ArchitectureGEMINI Global Registry (UNIS)

GENI I&MArchive

Portal and MAP

✓✓✓

Event Messaging Service

perfSONAR (REST and SOAP)

MPMeasurement

Points

BLiPP MP

NEW(Openflow, Layer2, Virtual Machine)

Meas. Stores

MA

GENI AuthN/Z

Instrumentize

GENIRACKS

GEMINISLICE

MCMeasurement

Controller /Collector

Network

MS

Status

• Initial merger of INSTOOLS, Periscope and perfSONAR (LAMP)

• MC functionality running together– Some duplicate functionality

• Development workflow• Migration to github• Jira• Collection of “user stories”

Demo Topology

Bottleneck Detection