http:// bill boas, sujal das, matt leininger, hal rosenstock, tom tucker, johann george, bob...

12
http:// www.openfabrics.o Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics Developer Summit at SC06, Tampa Nov. 16,17

Upload: grant-moody

Post on 18-Jan-2016

217 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

http://www.openfabrics.org/

Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George,

Bob Woodruff, Pramod Srivatsa

OpenFabrics Developer Summit at SC06, Tampa Nov. 16,17

Page 2: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

2http://www.openfabrics.org/

Strawman AgendaStrawman AgendaThursday Nov 16 Room 17 see attached Tampa Convention Center layout13.30 Introductions of Attendees and Roles, Process, Agenda, Goals, timelines, etc…14.00 Share OFED ( Linux and Windows) experience from customers, IB vendors, OEMs14.45 Break15.00 Overview feature list and developers for OF-Linux Rel. 2.O – IB and iWARP together17.00 Overview feature list and developers for OF-Windows Rel. 2.018.00 Processes for development, engineering test, bug fix and commit to OF trunk18.30 Working Supper19.30 – 21.00 Component by component review of features, task sizing, time requirements along with prioritization and strawman assignment to developers so as to producean ordered list of features and an assessment/estimate of commitment for the items that are candidates to be included in Release 2.0 development for both Linux and Windows.Friday November 17 Room13 Tampa Convention Center, 08.00 Breakfast08.30 Continue Component Review as described above until 10.00 Break10.30-12.00 Complete the ordered list, “draw the line”, finalize developer assignments.12.00-13.00 Working Lunch13.00-13.30 Development, engineering test, bug fix, commit and documentation for Rel 2.013.30-14.30 OF-OFED handoff and OFED-EWG testing processes review and update etc.14.30-15.00 OFED 1.x feature road map till OFED 2.015.00-15.15 Break15.15-16.00 Customer, IB Vendor and OEM feedback and contribution discussion 16.00-16.30 Outstanding Issues and follow up activities, wrap-up.

Page 3: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

3http://www.openfabrics.org/

Purposes of Meeting

Identify the possible list of features that are candidate items for development for Release 2.0 of the OpenFabrics Stack (note this is not an OFED candidate list);

Identify the developers/contributors/maintainers that are candidates to participate in the development team and their prerequisites before commitment to participate can be assured;

Recognize these developers as the “OF Release 2.0 Developers Working Group” (OF 2.0 DWG)

Allocate developer candidates to items agreed for development and “swag” timelines, engineering test procedures and other resources;

Identify Alliance member product managers and customers who will participate in the item prioritization and inclusion process (which also needs to be agreed)

Discuss and reach consensus on the agreed development item list, confirm responsible contributor/developer swagged timelines, level of engineering test and trunk commitment process

Discuss and agree with the Enterprise Working Group (who are responsible for OFED 1.x and 2.x) the OFED candidate deposition and SVN branching process for OFED 2.0

Review and agree bug identification, logging in Bugzilla, assigning to developer and bug resolution for both DWG and EWG

Page 4: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

4http://www.openfabrics.org/

Attendance Criteria & Company Commitment

Meeting attendance is encouraged from OpenFabrics members and selected individuals that can contribute to the negotiation of and commitment to: 1) - the features and components of Release 2.0; 2) - the engineering processes and resources necessary to ensure that Release 2.0 is developed for hand-off to the EWG for OFED quality assurance; 3) – improving the OFED processes to assure that OFED 2.0 meets Enterprise quality and robustness criteria as well as HPC performance and feature requirements; 4) readiness for Interoperability testing.

Companies and members participating need to send developers and product managers that can commit (at the meeting) company resources, developer’s time and effort and regression test suites and systems that can engineering test OF 2.0 so that every company believes meet its customers needs with 2.0 after the EWG has put it thru OFED and drop their proprietary competing software stacks.

The paragraph above implies that companies must plan their participation and commitment in advance as well as interact with collaborating member companies to workout in advance a strawman division of feature commitment, responsibilities and resources.

Linux distros, ISVs Tier 1 and 2 OEMs and Customers who are invited to participate should also understand that they will be expected to participate in detailed technical implementation discussion and prioritization of features. Participation in this meeting is also an indication by the customer that significant testing will be done by qualified customer personnel utilizing significant customer resources sufficient to contribute to the enterprise readiness of OFED 2.0 when it is released

Page 5: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

5http://www.openfabrics.org/

Suggested Attendees

Current Developers/Contributors/Maintainers Additional Developers and Contributors particularly from

iWARP and Storage communities Engineering and Product Managers from Member

companies as well as VPs Make effort to get planning participation from Dell, HP,

IBM, Sun, Appro, Linux Networx, PANTA, Rackable, Tyan, LSI Logic, DDN, Novell, Redhat, Oracle, NetApp

Designated representatives from XWG, IPWG, EWG, IWG and HSIR (add Oil and Gas, Mfg, EDA, ISVs,etc. to Wall St.)

Special Effort to invite participation by qualified European and Asian attendees at SC, e.g. IBM Germany, CEA, HLRS, Bull, CERN, Fujitsu, NEC, Hitachi

Page 6: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

6http://www.openfabrics.org/

OpenFabrics Software Stack

SA Subnet Administrator

MAD Management Datagram

SMA Subnet Manager Agent

PMA Performance Manager Agent

IPoIB IP over InfiniBand

SDP Sockets Direct Protocol

SRP SCSI RDMA Protocol (Initiator)

iSER iSCSI RDMA Protocol (Initiator)

RDS Reliable Datagram Service

UDAPL User Direct Access Programming Lib

HCA Host Channel Adapter

R-NIC RDMA NIC

Common

InfiniBand

iWARP

Key

InfiniBand HCA iWARP R-NIC

HardwareSpecific Driver

Hardware SpecificDriver

ConnectionManager

MAD

InfiniBand OpenFabrics Kernel Level Verbs / API iWARP R-NIC

SA Client

ConnectionManager

Connection ManagerAbstraction (CMA)

InfiniBand OpenFabrics User Level Verbs / API iWARP R-NIC

SDPIPoIB SRP iSER RDS

SDP Lib

User Level MAD API

Open SM

DiagTools

Hardware

Provider

Mid-Layer

Upper Layer Protocol

User APIs

Kernel Space

User Space

NFS-RDMARPC

ClusterFile Sys

Application Level

SMA

ClusteredDB Access

SocketsBasedAccess

VariousMPIs

Access to File

Systems

BlockStorageAccess

IP BasedApp

Access

Apps & Access

Methodsfor usingOF Stack

UDAPL

Ker

nel b

ypas

s

Ker

nel b

ypas

s

Page 7: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

7http://www.openfabrics.org/

Linux Components and Maintainers (and Most Active Participant)

Component Maintainers

Chief maintainer Roland Dreier (Cisco)

Core Sean Hefty (Intel), Roland Dreier (Cisco), Hal Rosenstock (Voltaire)

IB drivers - mthca Roland Dreier (Cisco), Michael Tsirkin (Mellanox)

IB drivers – iPath Bryan O’Sullivan (QLogic), Robert Walsh (QLogic)

IB drivers - eHCA Hoang-Nam Nguygen (IBM), Marcus Eder (IBM), Christoph Raisch (IBM)

ULPs – IPoIB Roland Dreier (Cisco)

ULPs – SRP Roland Dreier (Cisco), Ishai Rabinovitz (Mellanox), Madhu Lakshmanan (SilverStorm)

ULPs – iSER Or Gerlitz (Voltaire), Erez Zilber (Voltaire)

ULPs - NFSoRDMA Tom Talpey (NetApp)

ULPs – Lustre NAL Eric Barton (Cluster File Systems)

Page 8: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

8http://www.openfabrics.org/

Linux Components and Maintainers (and Most Active Participant)

Component Maintainers

ULPs – SDP Michael Tsirkin (Mellanox)

ULPs – RDS Zach Brown (Oracle)

ULPs – VNIC Ramachandra K (SilverStorm)

OpenMPI Jeff Squyres (Cisco), Gleb Natapov (Voltaire)

MVAPICH DK Panda (OSU)

ULPs - uDAPL Arlin Davis (Intel), James Lentini (NetApp)

OpenSM Hal Rosenstock (Voltaire), Eitan Zahavi (Mellanox)

DIagnostics Hal Rosenstock (Voltaire), Eitan Zahavi (Mellanox)

iWARP Tom Tucker (Open Grid Computing), Krishna Kumar (IBM), Venkata Jagana (IBM)

Page 9: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

9http://www.openfabrics.org/

Windows Architecture

SRPMiniport

StorPort

SDP**

SDPSPI**

Applications

Use

rK

ern

el

Windows

Applications

OF Windows

Hardware

* Windows Compute Cluster Server 2003** Will be available in the future

WSD SAN Provider

ManagementTools

HCA Hardware

Access Layer

Verbs Provider Driver

Verbs Provider Library

Access Layer Library

Ker

nel

Byp

ass

Winsock Socket Switch

WinSockProvider

MPI2*

IPoIB

NDIS

TCP/UDP/ICMPIP

VNIC**

Page 10: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

10http://www.openfabrics.org/

Windows Components & Maintainers

Component Maintainers

Bus Drivers/Access Layer Yossi Leybovich (Mellanox)

HCA driver Leonid Keller (Mellanox)

IPoIB Yossi Leybovich (Mellanox)

Winsock Direct Provider* Tzachi Dar (Mellanox)

SRP Initiator** Alex Estrin (SilverStorm), Yossi Leybovich (Mellanox)

SDP*** ?

OpenSM Eitan Zahavi (Mellanox)

uDAPL --

VNIC*** Alex Estrin (SilverStorm)

* Not available on Windows XP

** Not available on Windows XP 32 bits

*** Will be available in the future

Page 11: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

11http://www.openfabrics.org/

Candidate Component and Feature Description

iWARP integration Windows interoperability IPoIB

Connected modeBondingNAPI

SDPzcopynetstatAIO

uDAPL 2.0 provider for OpenFabrics(Note these are placeholders to get the real list started by contribution from the attendees before the meeting)

Page 12: Http:// Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa OpenFabrics

12http://www.openfabrics.org/

Node Description changed trap support Event subscriptions and event handling support Performance Manager Quality of Service Other HA, performance, and scalability enhancements Additional IBA 1.2 verb support Some IB routing support (enablement) Asynchronous get_user_pages ? Tools Other PathForward stage 3 items ?

Candidate Component and Feature Description

(Note these are placeholders to get the real list started by contribution from the attendees before the meeting)