Logistical Networking

Alessandro BassiLoCI lab

University of Tennessee

RIPE 45 meeting, Barcelona, 14th May 2003

5/15/03 14:06 2

Logistical Networking

» Logistical Networking: global scheduling andoptimisation of data movement, storage andcomputation.

» High-perf networking capabilities enableddistributed computing innovations such asexplicit control of computation resources (I.e.,Computational Grid)

» Application driven storage control -> lesscommon

5/15/03 14:06 3

Logistical Networking

» Technology for shared network storage thatcan scale in terms of» the size of the user community,» the aggregate quantity of storage that can

be allocated, and» the breadth of distribution of service nodes

across network borders» Parallels layered IP networking stack» The lowest globally accessible network layer in

the network storage stack should» Enable scalable Internet-style resource

sharing» Expose underlying storage resources

5/15/03 14:06 4

The Network Storage Stack

Communication

Data / Link /Physical

Network

Transport

Application

Storage

Access /Physical

IBP Depot

exNode

LoRS

Application

L-Bone

5/15/03 14:06 5

Internet Backplane Protocol

» Middleware formanaging and usingremote storagethrough allocation ofprimitive “byte arrays”available to clients

» Byte arrays are notblocks (more abstract)» Network capabilities

(primitive security)» Variable extents

» Byte arrays are notfiles (weakersemantics)» Size & duration are

limited» “Volatile” allocations» Best effort reliability

and availability» No directory

structure,accounting

» No caching,replication

5/15/03 14:06 6

IBP API

» Main goal: keep it simple!» 7 calls divided in three areas:

» Depot management (IBP_status)» Storage area management (IBP_allocate,

IBP_manage)» Data movement (IBP_store, IBP_load,

IBP_copy, IBP_mcopy)

5/15/03 14:06 7

IBP- SW current versions

» C code for Solaris/Linux(i686,ia64)/DECalpha/AIX/OS X» Server 1.3.0 (today) (previous 1.2.2)» Client 1.1.1

» C code for Win32» Server 1.0 (beta)» Client DLL 1.1.1 (beta)

» Java» Client 1.1.1

5/15/03 14:06 8

The Big Picture

IBP - Allocating andManaging Network Storage

exNode - Data Structure for Aggregation

Logistical Run-Time System

Data Mover

L-Bone - Resource Discovery and Proximity Queries

Applications

5/15/03 14:06 9

Ex-Node

» A unix inodeaggregates diskblocks on a singledisk volume toimplement a file

» An external Node(exNode) aggregatesstorage allocationson the internet toimplement a“network file”

5/15/03 14:06 10

L-Bone

» The L-Bone is an LDAP-based directory ofavailable IBP depots.

» The client library allows users to query the L-Bone for depots that meet certainrequirements

5/15/03 14:06 11

Logistical Runtime System

» Aggregation for:» Capacity» Performance (striping)» More performance (caching)» Reliability (replication)» More reliability (ECC)» Logistical purposes (routing)

5/15/03 14:06 12

IPv6 and IBP

» IBP software works on IPv6

» IBP as an overlay service has problems withwith NAT and firewalls (incoming trafficrestriction)

» Thus, IPv6 enables a transparent environmentin which all network elements are addressable

5/15/03 14:06 13

IBP deployment over the Italian6net testbed

5/15/03 14:06 14

Secure IBP

» Project carried on by J. Laganier (ENS Lyon -SUN Grenoble)

» Based on IPv6 only.» Innovative distributed scheme for

authorisation» Based on Cripto-Based ID and Simple Public

Key Infrastructure.» CBID are generated using the IPv6 Network

Prefix

5/15/03 14:06 15

Conclusions

» The Internet Backplane Protocol provides afabric for network state management

» Scalable and ubiquitous sharing are enabledby weak semantics & minimal accounting

» Evaluation and integration of IPv6 advancedfeatures with IBP (Mobile, Source Routing)

» To know more … loci.cs.utk.edu