purdue-tivoli partnership: exploiting purdue’s technological prowess
DESCRIPTION
Purdue-Tivoli Partnership: Exploiting Purdue’s Technological Prowess. Walid G. Aref Associate Professor, CS. Dept. XML Databases and Data Mining. Database Systems Research. The objective of my research is: Build efficient database engines for new data types: - PowerPoint PPT PresentationTRANSCRIPT
Purdue-Tivoli Partnership 1
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Walid G. Aref
Associate Professor, CS. Dept.
XML Databases and Data Mining
Purdue-Tivoli Partnership 2
Database Systems Research
The objective of my research is:1. Build efficient database engines for new data
types:1. spatial/geographical databases
2. semi-structured/unstructured web databases
3. multimedia databases
2. Develop algorithms to answer new database query types:1. data mining algorithms
2. spatial query processing algorithms
Purdue-Tivoli Partnership 3
Proposed Projects
Building an XML-based Database System Prototype
Data Mining of Event Traces in a Distributed System
Purdue-Tivoli Partnership 4
XML &Web Databases
XML as the Internet uniform language for information interchange
Target: Seamless integration of databases/non-information
sources view/query the web as a huge database
Querying web structure and contents
personalize/adapt based on customer’s needs/patterns
Purdue-Tivoli Partnership 5
XML/Web Databases: Phase 1
Design data model for XML document database Design algebra and query language for XML
data model Build prototype XML database engine Design and prototype XML views for
legacy relational database systems HTML pages
Purdue-Tivoli Partnership 6
XML &Web Databases: Phase 2 Develop indexing techniques in XML databases Develop query processing and optimization techniques
for XML queries Maintenance of user profiles for personalized views and
query answers Some applications:
Web mining: Clustering web users based on access patterns Web/site searching and mapping to an XML database modeling distributed system’s topology and resources using
XML
Purdue-Tivoli Partnership 7
XML &Web Databases: Project Plan Phase 1 deliverables (duration: 18 months)
prototype XML database system search capability + views to relational db/HTML documents End-of-Phase-1 project report + possible publications/patent filings
Phase 2 deliverables (duration: 18 months) efficient prototype XML database system with indexing/query
processing and optimization capabilities web site mapping into an XML database and db/web query engine
with user profiling and web mining capabilities Final project report + possible publications/patent filings
Estimated dollar value: $150K
Purdue-Tivoli Partnership 8
Data Mining of System Event Traces
Target: Find common event sequences detect irregular event patterns predict future events and attempt to prevent them
Mining common event sequence patterns Mining user actions and responses Take into consideration system topology and
structure
Purdue-Tivoli Partnership 9
Data Mining of System Event Traces: Phase 1 Develop understanding of the Tivoli suite of
Enterprise Management Software Get sample traces of events, user actions, along
with the corresponding sample system/network topologies
Analyze the data and design the needed structures and schemas
Build a prototype data warehouse for event traces, actions, and topologies
Purdue-Tivoli Partnership 10
Data Mining of System Event Traces: Phase 2
Apply existing data mining techniques Develop new algorithms for mining the traces
given the system/network topologies Developing incremental data mining techniques
of event traces Analysis of the data mining results Iterate through the above process
Purdue-Tivoli Partnership 11
Data Mining of System Event Traces: Project Plan Phase 1 deliverables (duration: 18 months)
prototype data warehouse of distributed system event/action traces and system topologies
Phase-1 project report + possible publications/patent filings
Phase 2 deliverables (duration: 18 months) prototype data warehouse with data mining capabilities new incremental algorithms for mining traces considering
topologies sample study, results of mining the traces, and recommendations Final project report + possible publications/patent filings
Estimated dollar value: $110K
Purdue-Tivoli Partnership 12
Past Research Projects
Distributed Scalar Storage Servers Using Network-Attached Storage Devices (NASD) Design and prototype of a distributed real-time file
system (multimedia server) Past research with Panasonic/Matsushita (1 European patent granted, 3 U.S. patent filings) Several journal and conference publications
Data mining in time-series databases in collaboration with IBM Almaden, San Jose two patent filings
Purdue-Tivoli Partnership 13
Ongoing Research Projects Multimedia database systems (On-going)
indexing techniques textual/caption annotation retrieval by content
data mining of multimedia data ACM SIGMOD 95, IEEE ICDE 95, 3 U.S. patents
Spatial database systems (On-going) Prototype systems
Sand: Prototype spatial database system (University of Maryland, College Park, 1990)
Spatial index attachment in Starburst extensible DBMS (IBM Almaden Research, San Jose, CA, 1992)
Program committee member VLDB 2000 (Intl. Conf.)
Purdue-Tivoli Partnership 14
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Elisa Bertino
Professor
Access control mechanisms for XML document sources
Purdue-Tivoli Partnership 15
Long Term Objectives
The objective of my research is: Development of tools supporting the
specification of access control policies for XML documents
Development of access control mechanisms for XML documents
Development of automatic classification tools for XML documents
Purdue-Tivoli Partnership 16
Impact
The system we develop will support the access control administration for heterogeneous sources of XML documents
The system will support a language for a high-level definition of access control policies
The system we develop will support import/export of XML documents among different sources
It will allows one enable selective distribution of documents to large user communities
Purdue-Tivoli Partnership 17
Research Methodology
We plan to develop the access control system and the administration environment on top of a DBMS supporting XML
Purdue-Tivoli Partnership 18
Research Plan
Definition of an access control model for XML documents Definition of an XML library for the encoding of access
control policies and authorizations Integration of the Access Control Model with User Credentials
mechanisms Implementation of the Access Control Model Secure Dissemination of XML Documents Extension of the Access Control Model to deal with
Multimedia Data Development of Access Control Policies for Specific
Applications (such as workflow systems).
Purdue-Tivoli Partnership 19
Past Research
Formal definition of an authorization model for XML documents. Automatic classification of semi-structured and XML documents Relevant papers:
E.Bertino, et Al, “An Approach to Classify Semi-Structured Objects”. Proc. ECOOP 99.
E.Bertino, et Al. “Controlled Access and Dissemination of XML Documents”. Submitted for publication.
E.Bertino, et Al. “An Approach for the Specification and Enforcement of Authorization Constraints in Workflow Management Systems", ACM Trans. On Information and Systems Security, Vol.2, No.1, pp.65-104, February 1999.
Purdue-Tivoli Partnership 20
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
William J. McIver, Jr.
Visiting Assistant Professor*
Souk Nets: A Component-based Database Integration Paradigm
Purdue-Tivoli Partnership 21
Long Term Objectives
The objectives of my research are to: Develop a component-based paradigm
tailored to database integration. Design a language to use within this
paradigm. Develop a set of components for implementing
database integration solutions. Optimize component container approaches for
database applications.
Purdue-Tivoli Partnership 22
Impact
Allow data integrators to leverage benefits of component-based software construction: Allow prefabricated functionality to be reused. Perform more robust reuse. Perform modular checking in the face of evolution.
Produce a Component-based Paradigm tailored to data source integration: Current component-based approaches (e.g. EJBs) are lacking
in this domain. Too low-level Imperative & tedious Current containers are inefficient for database access.
Purdue-Tivoli Partnership 23
Impact
Enable better construction of database integration solutions: Rapid Robust Reusable Analyzable Fault Tolerant Evolvable
Enable the construction of more efficient component-based database applications.
Purdue-Tivoli Partnership 24
Research Methodology
Conceptual Identify canonical use cases for this technology. Factor the domain of data integration solutions.
Federation & Schema Integration, Global Query Language Approaches, Point Solutions, etc.
Design a covering set of components to implement these solutions.
Explore use of reflection, contracts, design patterns, and meta-data approaches. Build in reasoning capabilities for composition, changes to
interfaces, fault situations.
Design a high-level, cross-platform language.
Purdue-Tivoli Partnership 25
Research Methodology
Theoretical Extend the LINDA notion of Tuple Space (Gelertner &
Carriero) Accomodate complex objects Object Spaces
Employ WoFNets Semantics (Ellis & Keddara 1999) to interconnect Object Spaces. A Variant of Colored Petri nets Provides a formal semantics Supports dynamic change Applicable to handling evolution of requirements Possible applicability to the active networks paradigm
Purdue-Tivoli Partnership 26
Research Methodology
Theoretical (continued) Transitions in Souk nets constitute components.
Structural and value transformations Filters Control flow Event subscription, notification and handling User defined transitions
Purdue-Tivoli Partnership 27
Research Methodology
Experimental Evaluate modeling capabilities of paradigm and language.
Employ selected use cases. Conduct performance evaluations of run-time system. Iterate on language design and system implementation.
Purdue-Tivoli Partnership 28
Research Plan
Schedule & Milestones Year 1
Identify a canonical set of use cases for database integration.
Implement baseline prototypes of use cases for analysis.
Complete the first version of the component paradigm.
Year 2 Implement an environment based on the component paradigm.
Begin an iterative evaluation process (through Year 3).
Year 3 Implement a revised environment.
Purdue-Tivoli Partnership 29
Research Plan
Deliverables Software artifacts from each milestone
Results of each milestone reported in appropriate publications and conferences
Software demonstrations
Staffing & Budget (estimated) Principal investigators: 1 to 2 FTE. Graduate students: 3 to 4. Budget: $800,000.
Purdue-Tivoli Partnership 30
Past Research
The Sanctuary Project A mediator-based database integration environment for CORBA and
DCOM-based heterogeneous data sources. Supported by NSF grant IRI-9632595.
Used to perform data migration from Unidata/VMARK CODASYL databases to O2 object-oriented databases; construct object-oriented applications atop CODASYL applications; support the integration of the object-oriented Catalyst software engineering environment with ODBC-compliant DBMSs.
John Todd, Roger King, William J. McIver, Jr., Richard Osborne, Christian Och, Nathan Getrich, Brian Temple. “Building Mediators from Components.” (To appear) Proceedings of The International Symposium on Distributed Objects and Applications (DOA’99). Edinburgh, Scotland. September 5 - 6, 1999.
Purdue-Tivoli Partnership 31
Past Research
Souk nets (preliminary work) Development of initial analytic/conceptual framework for
component-based database integration. (Since April 1999)
William J. McIver, Jr., Karim Keddara, Christian Och, Roger King, Clarence A. Ellis, John Todd, Nathan Getrich, Richard M. Osborne, Brian Temple. “An Overview of Souk Nets: a component-based paradigm for data source integration." (To appear) The Seventh International Workshop on Database Programming Languages (DBPL 1999). Kinloch Rannoch, Scotland. September 1st - 3rd, 1999.
Purdue-Tivoli Partnership 32
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
W. Kent Fuchs
Head & Professor
Electrical & Computer Engineering
Dependable Distributed & Mobile Computing
Purdue-Tivoli Partnership 33
Long Term Objectives
The objectives of my research are: Rapid recovery from failures
Hardware and software faults Clusters of networks Mobile notebooks and hand-held devices
Accurate and preventive diagnosis of faults
Purdue-Tivoli Partnership 34
Impact
Highly reliable computation and communication in changing environments
Wired network
Mobilesupportstation
Mobilehosts
Homogeneous environment Heterogeneous environment
Mobile environment
Purdue-Tivoli Partnership 35
Research Methodology
RENEW –– Recoverable Networks of Workstations
User requiring dependable computing
* Rapid prototyping of new FT techniques
ApplicationUser
WORK
W O R KP1 P2 P3 P4
* Simple application development* Good performance* Transparent fault recovery
* Standard benchmarks
* Representative environments
Purdue-Tivoli Partnership 36
Application
MPI
Ckp. & Rec. protocol
JobManagem.
Fault
Detection Ckp.
Process
MessagePassingModule
Operating System
Server
Ckp.
Computing nodes File servers
Operating System
Ethernet, ATM
Purdue-Tivoli Partnership 37
0
500
1000
1500
2000
2500
3000
3500
4000
BT LU SP PCCM2 Seismic1 Seismic4
NO Ckp
Coordinated
Comm-Induced
Mesg-Logging
NOTE: Ckp period 5 min.
Exec.Time[sec]
Purdue-Tivoli Partnership 38
X X
Local Disk(sec)
Remote Disk(sec)
Backup(sec)
Checkpoint Size(KB)
Program
btreeflops20nsieveswimtfftdptomcatvmgrid
1.5410.0070.0070.3781.6770.0650.219
5.6680.0200.0181.4016.0330.2630.857
3.87e-43.85e-43.83e-43.86e-43.85e-43.83e-44.34e-4
586535252
1450065595
21357517
PREACHES (Portable Recovery and Checkpointing in Heterogeneous Systems)
Purdue-Tivoli Partnership 39
Research Plan
Recoverable Mobile Distributed Systems High availability and reliability Power and bandwidth conservation
Checkpoint
MSS2
MSS3
MSS1
MSS1-MSS2-MSS3Checkpoint MSS2
HA
Purdue-Tivoli Partnership 40
Past Research
RENEW (Recoverable Network of Workstations) N. Neves and W. K. Fuchs, “RENEW: A Tool for Fast and Efficient
Implementation of Checkpoint Protocols,” IEEE Fault-Tolerant Computing Symposium, pp. 58-67, June 1998.
PREACHES (Portable Recovery and Checkpointing in Heterogeneous Systems) K.-F. Ssu and W. K. Fuchs, “PREACHES –– Portable Recovery and
Checkpointing in Heterogeneous Systems,” IEEE Fault-Tolerant Computing Symposium, pp. 38-47, June 1998.
RAMs (Recoverable Mobile Systems) B. Yao, K.-F. Ssu, and W. K. Fuchs, “Message Logging in Mobile
Computing, IEEE Fault-Tolerant Computing Symposium,” pp. 294-301, June 1999.
Purdue-Tivoli Partnership 41
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Shimon Y. NofProfessor of Industrial Engineering
Design of Middleware Protocolsfor e-Business Interactions
Purdue-Tivoli Partnership 42
Long Term Objectives
The objectives of our research are:
Develop a set of collaborative workflow protocols for guiding and optimizing the performance of e-business interactions in heterogeneous, autonomous and distributed environments, e.g. network of ERPs, HelpDesks
Develop complex problem-solving scheme/protocol via interactions among distributed knowledge-based systems
Purdue-Tivoli Partnership 43
Long Term Objectives (continue)
Design recommendations for knowledge-based protocols customized for the needs of particular enterprises and markets
Design of an executable specification-tool for protocol development, which will translate interactions and flow definition of particular protocols into executable code, subject to the needs of the users and the organization
Purdue-Tivoli Partnership 44
Impact In the emerging global e-business market, effective
service availability, e.g., 24x7; Tivoli’s Service Desk, is a key to success. The collaborative work protocol is a task administration protocol which will provide: Automation among interactions that include decision activities;
automation of the process to provide service at minimum cost and maximum quality
From our experimental results, specification and working environment of protocols will be identified, to design/select the right protocol for the right situation
In complex decision-making processes, human interactions are required, e.g Help desk application. The protocol will reduce decision-making time/cost by extracting the right information
Purdue-Tivoli Partnership 45
Research Methodology The research will employ a new version of TIE, Teamwork
Integration Evaluation developed previously with NSF support. TIE’s purposes: Compute performance measures of protocols
completion time, e.g. transaction processing, negotiation penalty measures, e.g. # of aborted (time-out) connections messages queue of each party relative cost-quality model of the service system
Model the interactions among parties in both synchronous and asynchronous mode. TIE is based on the MPI technique, it provides true parallelism analysis of the interaction behavior.
Purdue-Tivoli Partnership 46
Research Methodology (Continue)
With MPI, TIE can run on both parallel machine like Paragon, Origin2000; or network of computers e.g., Suns, PC windows-
NT
To compare protocols’ performance, experiments will be conducted under different environments with variable # of participants and service demand
Use traditional e-business protocol “Contract Net” as base-line protocol
Use IBM’s Situation Manager to coordinate conditional, triggered actions
Purdue-Tivoli Partnership 47
Research Plan for Three Years Develop specifications of protocols for e-business requirements, based
on previous research (4 Months)
Modify TIE for protocol evaluation, conduct protocol performance experiments, analysis (8 Months)
Develop TIE description language for general modeling purpose; implement for target application (12 Months)
Develop TIE conversion program for executable protocol code; apply for target application (12 Months)
DELIVERABLES: Protocol models, TIE, Language, Converter
BUDGET: Advisor + 2 students @ $50,000/ year
Purdue-Tivoli Partnership 48
Past Research DPIEM -- Distributed Parallel Integration Evaluation Model
Organizing/reorganizing resources among distributed networked organizations, based on parallelism theory of computing & communication
(Ceroni and Nof, 1999, Research Memo No. 99-04, School of IE, Purdue University)
ABMS -- Agent-based Manufacturing System
General model of cooperation & collaboration among autonomous agents, resources and tasks. Shows the need to use workflow protocol to coordinate agents’ tasks
(Huang and Nof, 1998, Int’l Journal of Production Research)
Purdue-Tivoli Partnership 49
Past Research (continue)
DAF-Net -- Data Activity Flow Net ; and AIMIS -- Agent-based Integration Model of Information Systems
A collaboration scheme and coordinated execution for distributed, heterogeneous CIM data activities (Kim and Nof, 1998, Int’l Journal of Industrial Engineering)
Active database coordination of multiple CIM databases
Monitors events/situations of interest and, when given conditions are met, an appropriate action is triggered.
(Etzion, Dori and Nof, 1995, Int’l Journal of CIM)
Purdue-Tivoli Partnership 50
Concluding Thought “Many companies view each negotiation as a separate
situation, but companies that take a more coordinated approach are making better deals and forging stronger relationships”
(Harvard Business Review, May-June, 1999)
Analogy for our research: We can significantly improve performance by interactions among participants if an effective, customized protocol is used to coordinate the interactions needed for particular environments
Purdue-Tivoli Partnership 51
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Arif Ghafoor
Professor, School of ECE
Design and Development of Distributed Multimedia Systems
Purdue-Tivoli Partnership 52
Long Term Objectives
Design and development of models, tools, and techniques for multimedia information management including documents consisting of text, images, video and audio data
Design and development of internetworking technology for QoS-sensitive distributed multimedia applications
Analyzing the impact of multimedia technology on enterprise IT infrastructure
Purdue-Tivoli Partnership 53
Impact
The research will generate powerful multimedia information management and workflow models impacting flexibility, portability, and user-configurabiliy
The research will provide framework for the development of heterogeneous multimedia information systems and applications based on: workflow models QoS-sensitive resource management techniques integration across multiple platforms
Purdue-Tivoli Partnership 54
Impact
The generic Distributed Multimedia System (DMS): will allow the creation, sharing, management, secure and
efficient access and delivery of multimedia documents will have potential utility in enterprise-wide IT
infrastructures used for HIS, distributed manufacturing, business, CSCW environments etc.
Experience with the system will allow to assess the effectiveness of workflow models, resource management techniques and network protocols
This research has the potential to significantly enhance the current state-of-the-art of IT in terms of developing advanced multimedia applications and systems
Purdue-Tivoli Partnership 55
Generic Layered Software Architecture for DMS
Multimedia Applications(workgroup, messaging, interactive)
Distributed Information and Directory Management
Configuration Management(broadcasting, multicasting, point-to-point)
OS for End-System Architecture
Network Layer
Qo
S M
anag
emen
t:
Sp
ecif
icat
ion
Tra
nsl
atio
nN
ego
tiat
ion
Heterogeneity
Purdue-Tivoli Partnership 56
R&D Challenges for DMS Architecture
Multimedia QoPMultimedia QoPSpecificationSpecification
- Reliability - Resolution- Rate of Presentation- Display Area- Temporal Synchronization ( Intra/Inter )
Workgroup, Messaging, Interactive
TranslationTranslation- End-to-End Delays- Jitter Delay- Bandwidth- Packet Loss Rate
- Storage Throughput/ Bandwidth - Storage Delays - Distributed Database Coordination
- CPU Throughput- Memory Overflow and Reliability
- Intrusion Detection - Access Control
Database SecurityOSNetwork
NegotiationNegotiation Dependency Model Analysis and QoS Adjustment
Run Time Run Time ResourceResourceSchedulingScheduling
System-wide Resource Allocation and Scheduling
Purdue-Tivoli Partnership 57
Proposed Prototype for DMSMultimedia Applications
(Authoring, Browser, CSCW)
TextDB
ImageDB
VideoDB
AudioDB
Object ManagerCentralized Directory
Object ManagementAgent
PresentationAgent
QueryProcessor
Oracle DB
Network (ATM, Fast Ethernet)
Network API
Network APINetwork API
Video DBMS
Multiple PC Platforms
Distributed Multimedia
Servers(SUN)
. . .
Purdue-Tivoli Partnership 58
Research Tasks and Deliverables
Task 1 and Deliverable 1: Development of networked distributed multimedia database servers
Task 2 and Deliverable 2: Development of workflow model(s) and CSCW environment for a selected application domain (distributed manufacturing is a potential candidate)
Task 3 and Deliverable 3: Development and experimentation of different QoS-sensitive resource management protocols
Purdue-Tivoli Partnership 59
Research Plan Overall duration of the project: 3 years Tasks 1 and 2 will commence simultaneously and will
continue for 1.5 years. Task 3 will follow these tasks and will continue for one year. Experimentation and system tuning will take six months. Deliverables 1 and 2 will be submitted after 1.5 year. Deliverable 3 will be submitted at the end of the project along with the complete software and final report.
Two GRA’s each year and one PI with 25% AY with two months summer each year
Approximate Cost: $100K/year
Purdue-Tivoli Partnership 60
Past Research
The PI has established Distributed Multimedia Systems Laboratory, housed in the School of ECE, in 1992.
A large number of research projects have been sponsored in the area of multimedia databases, multimedia networking and distributed multimedia systems by several government and industrial organizations.
Detail of these projects and research publications can be found at the following URL: http://shay.ecn.purdue.edu/~dmultlab
Purdue-Tivoli Partnership 61
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Jose Fortes
Professor
Wide-area network computing
Purdue-Tivoli Partnership 62
Long Term Objectives Demand-driven identification, aggregation,
management, and use of wide-area networked computing resources Address usage policy and performance issues Predictive application-performance modeling
Metacomputing and wide-area distributed computing
Resource management system for a production network-computer (PUNCH) used for real-world applications
Purdue-Tivoli Partnership 63
Impact
Enable sharing of resources (software, hardware, and personnel) across departments and institutions
Provide resource management capabilities crucial to the long-term viability of community-specific virtual computers enabled by PUNCH (e.g., DesCArtES, NETCARE)
Purdue-Tivoli Partnership 64
Impact
Allow diverse resource management systems (e.g., Condor, Globus) to be accessed and used transparently via a web-accessible virtual computer
Improve utilization and cost-effectiveness of high-performance machines by dynamically adapting resource management policies on the basis of estimated (predicted) application performance
Purdue-Tivoli Partnership 65
Research Methodology Objective:
Demand-driven resource management in a wide-area networked environment
Challenges: Usage policies and performance issues intertwined dynamic, heterogeneous environment; multiple
administrative domains A priori estimates for resource-usage required Interoperation with existing resource management
systems
Purdue-Tivoli Partnership 66
Research Methodology
Approach: Metaprograms; application management Run-time cost/performance tradeoff decisions Predictive performance modeling via machine
learning techniques
Purdue-Tivoli Partnership 67
Research Methodology
Purdue-Tivoli Partnership 68
Research Methodology
Purdue-Tivoli Partnership 69
Research Plan Milestones:
General-purpose performance-modeling system Core resource-management system design Language for scheduling queries and usage policies Deployment in PUNCH; initial evaluation Scalable, hierarchical architecture for resource
management system Interoperation protocols for Condor and Globus Evaluation of system and policies in a production
environment (500+ users and 50,000+ runs per semester)
Purdue-Tivoli Partnership 70
Research Plan Deliverables:
Predictive performance-modeling system Scalable, hierarchical resource management system Scheduling query and usage policy language module Interoperability module for external mgmt. Systems
Staffing: Two graduate students, one research scientist, one
professor
Cost: $200k/year
Purdue-Tivoli Partnership 71
Past Research The Purdue University Network-Computing
Hubs -- a WWW-accessible network computer that allows unmodified software to be used via standard WWW browsers. To date, 2,000+ users have generated more than 2 million hits and have initiated 100,000+ simulations On the Design of a Demand-Based Network-Computing
System: The Purdue University Network-Computing Hubs. Nirav H. Kapadia and Jose’ A. B. Fortes. 7th IEEE International Symposium on High Performance Distributed Computing. July 1998. Pages 71-80.
Purdue-Tivoli Partnership 72
Past Research Predictive Application-Performance Modeling in
a Computational Grid Environment -- an initial prototype of a machine-learning system that dynamically constructs models for tool resource-usage characteristics with respect to the user-supplied tool input Predictive Application-Performance Modeling in a
Computational Grid Environment. Nirav H. Kapadia, Jose’ A. B. Fortes, and Carla E. Brodley. 8th IEEE International Symposium on High Performance Distributed Computing. August 1999.
Purdue-Tivoli Partnership 73
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Alok R. Chaturvedi Associate Professor
Shailendra Raj Mehta Director, Entrepreneurship Initiative
SEAS - Synthetic Environments for Analysis and Simulations
Purdue-Tivoli Partnership 74
Long Term Objectives
The objective of our research is to: Conduct an interdisciplinary program of
research related to business and economic modeling and simulation
Create realistic virtual representations of firms, markets and economies
Develop and evaluate computational models of human behavior
Collaborate with government, industry, and academic institutions at national and international levels.
Purdue-Tivoli Partnership 75
Impact SEAS is a synthetically created economy with
integrated goods and services, stock, bond, labor, and currency markets.
In these markets two types of agents interact live: people acting as firms, regulators, intermediaries. virtual: artificially intelligent software agents behave
like human agents in a narrow domain.
This environment combines breadth (through artificial agents) and depth (through human agents)
Purdue-Tivoli Partnership 76
Navy C4I SystemUSMC C4I System
Army C4I SystemAir C4I System
DoD’s Synthetic Terrain for War Gaming ..
Mix of Live, Virtual, Constructive Simulations Mix of Live, Virtual, Constructive Simulations Units, Platforms, Weapons & SensorsUnits, Platforms, Weapons & Sensors
Purdue-Tivoli Partnership 77
Government System Government System
Industry SystemIndustry System University SystemUniversity System
SEAS War Gaming SEAS War Gaming EnvironmentEnvironment
Consumer SystemConsumer System
Mix of Live, Virtual, Constructive Mix of Live, Virtual, Constructive Simulations: Simulations: Economies, Markets, Industries, FirmsEconomies, Markets, Industries, Firms
LaborLabor
Goods &Goods &ServicesServices StockStock
BondBond CurrencyCurrency
Purdue-Tivoli Partnership
SEAS: Architecture
USER
IMPLEMENTATIONIMPLEMENTATION AQUISITIONAQUISITION
Sce
nar
ios
Vis
ual
izat
ion
UPDATE
REQUEST
RESPONSE
LAN
QUERY
RESPONSE
EXTERNAL DATA•Rueters•Dow Jones•IDCSEAS
Goods MarketsFinancial Markets
Labor MarketsCurrency Markets
•Human or•Intelligent - Agents
The InternetDecision Enabling Env.
Mod
elin
gT
ools
KNOWLEDGE BASESCommercial, Commercial, Academic &Academic &GovernmentGovernment
OrganizationsOrganizations
Commercial, Commercial, Academic &Academic &GovernmentGovernment
OrganizationsOrganizations
Netcasting
SEASGoods Markets
Financial Markets
Labor Markets
Currency Markets SEASGoods Markets
Financial Markets
Labor Markets
Currency Markets
SEASGoods Markets
Financial Markets
Labor Markets
Currency Markets
Purdue-Tivoli Partnership 79
Research Plan
In the next three years we intend to refine the the computational models to incorporate more complex human behaviors. We would further develop the global economy and develop validation methods for large scale business simulations.
We would request approximately $125,000 a year for three years. This money will primarily be used to fund a lab assistant, graduate students, and to acquire data from companies like IDC, Yankee Group, etc.
Purdue-Tivoli Partnership 80
Past Research
SEAS is an ongoing project. The initial Infrastructure is already developed through funding from the Department of Defense, Intel, Ameritech, SAP, and the Institute for Defense Analyses. We have already developed some basic computational models of human behavior.
Chaturvedi, A.R., and Mehta, S. R., “Simulations in Economics and Mangement,” Communications of the ACM, March 1999
Purdue-Tivoli Partnership 81
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Sonia Fahmy
Department of Computer Sciences
Design of Multi-Service Networks with Multicast Support
Purdue-Tivoli Partnership 82
Long Term Objectives
The research aims at developing protocols for: Traffic management for various services
required for multimedia/real-time applications and bulk data to co-exist
Multicast support for multi-service networks and feedback control mechanisms (e.g., explicit congestion notification and reliable multicast transport protocols)
Purdue-Tivoli Partnership 83
Impact
The traffic management mechanisms and QoS architecture will allow multimedia/real-time applications and bulk data to share the same networking infrastructure, giving throughput and delay guarantees
Multicasting capabilities will efficiently support collaborative applications, conferencing applications, distance learning, searching, and data distribution applications, even for large numbers of users
The architecture and system developed can affect the services offered in the future Internet and intranets, improve their performance and support more complex applications
The simulation tools and prototypes developed will provide a basis for the deployment of real-time multicast networks and applications
Purdue-Tivoli Partnership 84
Research Methodology
QoS support: Simulation tools will be developed and
experiments will be performed to assess the throughput, fairness, buffer and link utilization, and packet loss for a set of carefully selected network configurations
Selective buffer management policies will be designed and their performance evaluated
Purdue-Tivoli Partnership 85
Research Methodology
End system response to network state (including explicit feedback) will be designed and evaluated
Mapping services to network element behaviors will be designed and evaluated
Control and pricing issues will be investigated
Prototypes will be built to conduct real experiments
Purdue-Tivoli Partnership 86
Research Methodology
Multicast support: Inter-receiver and inter-sender fairness will
be defined within and among multicast groups
= group member
Purdue-Tivoli Partnership 87
Research Methodology
Mechanisms for flow/congestion control will be designed for providing certain levels of reliability depending on the application type
Services and explicit feedback notification will be supported for multicast sessions
Purdue-Tivoli Partnership 88
Research Plan
Milestones: 12 months: Buffer management study, response to
feedback study 18 months: Fairness issues for multicasting 24 months: Control and pricing issues, service
mapping study 32 months: Reliable multicast issues 36 months: Multicast extensions to
feedback/services
Purdue-Tivoli Partnership 89
Research Plan
Deliverables: Architecture, pseudocode and performance studies
for multi-service networks Architecture, pseudocode and performance studies
for multicast support Prototype implementations
2-3 graduate research assistants required for 3 years
Purdue-Tivoli Partnership 90
Past Research
ATM-ABR traffic management: A rate allocation algorithm with delay control ABR parameter study and the effect of link
bandwidth and round trip time on parameter values
“The ERICA switch algorithm for ABR traffic management in ATM networks,” Revised version submitted to IEEE/ACM Transactions on Networking, May 1999.
Purdue-Tivoli Partnership 91
Past Research Multicast support for ATM networks:
A feedback consolidation algorithm and performance comparison for point-to-multipoint connections
Fairness definitions, a rate allocation and a feedback regulation mechanism for multipoint-to-multipoint connections
“Feedback consolidation algorithms for ABR point-to-multipoint connections in ATM networks,” IEEE INFOCOM 1998, pp. 1004-1013, and J. Computer Communications, 1999.
Purdue-Tivoli Partnership 92
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Babak Falsafi
Assistant Professor, School of ECE
Impetus: Designing Next-Generation Distributed Enterprise Servers
Purdue-Tivoli Partnership 93
Long Term Objectives
Distributed Enterprise Server Architectures Shared-Memory Multiprocessors Server computing: Web, Databases, etc.
Network-Aware Architectures Low-Overhead Integrated Network Interfaces Router Processor/Memory Architectures
Distributed Discrete-Event Simulators Evaluating Large-Scale Distributed Systems
Purdue-Tivoli Partnership 94
Impact: Distributed Enterprise Servers
Problem Shared-memory programming, but non-uniform memory access latencies Complicates server programmability e.g., remote-to-local latencies factor of 5~10!
Innovation Memory access prediction & speculation Places data next to consumer before access Remote latency => local latency Enhances large-scale distributed computing
Purdue-Tivoli Partnership 95
Impact: Network-Aware Architectures
Problem Architectural innovations do not benefit network
applications! Static packet processing model Inflexible network hardware and protocol
Innovation Network-aware proc/memory architectures Programmable network interface & routers Application-specific network protocols
Purdue-Tivoli Partnership 96
Impact: Detailed Machine Simulators
Problem: Simulating large servers Is both memory and compute intensive Detailed simulation => 10,000 slowdown Platform-specific solutions to speed up
Innovation Fast, accurate, portable simulation Parallel & distributed simulation on a cluster Code sampling => reduce workload Dynamic refinement => model required detail Direct execution => run at native speeds
Purdue-Tivoli Partnership 97
Research: Big Picture
Distributed Simulator
PC PC PC….
Network
Server Application
Network Protocol
P P P…..
Network Interface
Shared Memory
Network Switch/Router
Ent
erpr
ise
Ser
ver
Purdue-Tivoli Partnership 98
Research Methodology Experimental evaluation
Detailed simulation models Measurements using H/W monitors
Software Distributed simulator of large-scale servers Network switch/router simulators Application-specific network protocols
Hardware A cluster of desktops/servers Fast, high-bandwidth interfaces & switches
Purdue-Tivoli Partnership 99
Research Plan
Request funding 3 students for 3 years 3 years of PI salary for 2 summer months A cluster of desktops/servers
Deliverables Designs for simple-to-program large-scale
distributed servers Designs for network-aware systems Fast, accurate, & portable distributed simulators
Purdue-Tivoli Partnership 100
Past Research Enterprise server design
Reactive NUMA => Sun Microsystems WildFire Published in ISCA 1997 Speculative Distributed Shared Memory Published in ISCA 1999
Cost-Effective Parallel Simulation Published in ACM TOMACS, 1997
Network architectures Application-specific Coherence Protocols Published in Supercomputing 1994 Coherent Network Interfaces => ISCA 1996
Purdue-Tivoli Partnership 101
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Kihong Park
Assistant Professor (CS)
DUNES
Purdue-Tivoli Partnership 102
Long Term Objectives
The objective of my research is: Efficient/scalable distributed system design Transparent dependency maintenance Off-the-shelf Integrated computation/communication
control QoS-sensitive scheduling
Purdue-Tivoli Partnership 103
Impact
Development of software system support & tools Communication-sensitive load balancing library User-level push/pull caching library Distributed real-time scheduling library QoS-sensitive scheduling library
resource contention resolution/arbitration
Prototype System Deployment DUNES (Distributed UNix ExtenSion) SBS (Stratified Best-Effort Service) AFEC (Adaptive Forward Error Correction)
Purdue-Tivoli Partnership 104
Impact (Cont.)
Fundamental understanding of distributed resource scheduling Integrated computation/communication control Distributed real-time scheduling Integrated network/end system scheduling QoS-sensitive scheduling Resource economy Fault-tolerance, security, and QoS
Purdue-Tivoli Partnership 105
Research Methodology
Top-Down Top: Modeling & Analysis
framework, qualitative properties
Middle: Simulation quantitative controlled study
Bottom: System Building implementation, ultimate test, “buck stops here”
Purdue-Tivoli Partnership 106
Research Plan
Distributed real-time scheduling Integrated network/end system scheduling Computational resource economy Fault-tolerance, security, and QoS Implement as extensions to DUNES
Purdue-Tivoli Partnership 107
Research Plan (Cont.)
Investigate applicability of existing systems (e.g., DUNES) to Tivoli environment
Investigate research Tivoli’s research requirements w.r.t. novelty
Purdue-Tivoli Partnership 108
Past Research
DUNES NSF ESS-9806741; J. Cruz, C. Gong Prototype DUNES system (UNIX) Recent publications
Towards performance-driven system support for distributed computing in clustered environments, Journal of Parallel & Distributed Computing, ‘99
DUNES: A performance-oriented system support environment for dependency maintenance in workstation networks, IEEE HPDC, ‘99
Purdue-Tivoli Partnership 109
Past Research (Cont.)
Network QoS Architecture NSF ANI-9875789 (CAREER); S. Chen, H. Ren Prototype SBS system Recent publications
An architecture for noncooperative QoS provision in many-switch systems, IEEE INFOCOM, ‘99
QoS provision in noncooperative networks with diverse user requirements, Decision Support Systems, ‘99
Purdue-Tivoli Partnership 110
Past Research (Cont.)
Multimedia Traffic Control NSF ANI-9714707; T. Tuan, A. Balakrishnan Prototype AFEC system for real-time MPEG
video/audio transport Recent publications
Multiple time scale congestion control for self-similar traffic, Performance Evaluation, ‘99
Self-Similar Network Traffic and Performance Evaluation, Wiley, ‘99
Purdue-Tivoli Partnership 111
For More Information
Network Systems Lab
www.cs.purdue.edu/homes/park/nsl.html
Purdue-Tivoli Partnership 112
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Sunil Prabhakar
Assistant Professor
Latency reduction in parallel and distributed systems.
Purdue-Tivoli Partnership 113
Long Term Objectives
The objective of my research is: Develop techniques for overcoming network
and I/O latency in distributed systems. This will be achieved through
efficient data placement techniques effective replication techniques.
Purdue-Tivoli Partnership 114
Impact
The proposed research will result in the development of data placement, replication, and access techniques that significantly improve the performance of distributed applications.
Due to the high (network and I/O) latency associated with distributed applications, these improvements will have a very direct impact on overall system performance.
Purdue-Tivoli Partnership 115
Research Methodology
The nature of our work is experimental. We will implement proposed placement
and replication schemes on a collection of PCs with local disks, connected via various types of network interfaces such as 100Mb ethernet, Gigabit ethernet, and across the internet.
Purdue-Tivoli Partnership 116
Research Methodology
The distribution and placement of data on the disks will be controlled and we will populate the system with data from real applications.
Performance will be measured using this setup based upon the execution of real applications.
Purdue-Tivoli Partnership 117
Research Plan
Year 1: identify and analyze a set of distributed applications to determine their data access patterns.
Year 2: design and implement alternative placement and replication schemes
Year 3: evaluate the alternatives Deliverable: The end product of the project will
be a set of techniques, and tools for their implementation
Purdue-Tivoli Partnership 118
Research Plan
Resources: Graduate students Equipment: PCs, magnetic disks, high speed
local area networks Estimated budget
$150,000
Purdue-Tivoli Partnership 119
Past Research
Parallel I/O for relational and multimedia databases. We have developed state-of-the-art declustering
methods for improved parallel I/O for range and similarity queries, as well as for multiresolution image browsing.
“Efficient Disk Allocation for Fast Similarity Searching”, S. Prabhakar, D. Agrawal and A. El Abbadi. 10th Annual ACM Symposium on Parallel Algorithms and Architectures (SPAA 98),
Puerto Vallarta, Mexico, June 28 - July 2 1998, pages 78-87.
Purdue-Tivoli Partnership 120
Past Research
Tertiary storage management We have developed highly efficient I/O
scheduling algorithms for robotic storage libraries. We have also developed a novel mechanism for reliability of tertiary data.
“Tape Group Parity Protection”, T. Johnson and S. Prabhakar. 16th IEEE Mass Storage Systems Symposium
MSS'99, San Diego, California, USA, 15-18 March 1999.
Purdue-Tivoli Partnership 121
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Catherine Rosenberg
Associate Professor
Multimedia Networks, Traffic Engineering and Mobility
Purdue-Tivoli Partnership 122
A Diversified Experience August 1999 - Present: Associate Professor, Department of Electrical and
Computer Engg., Purdue University. Consultant to Nortel Networks on Broadband Satellite Network.
January 1998 - July 1999: Head, Department of Broadband Satellite Networking, Nortel Networks, Harlow, UK. Twice awarded an Award of Merit. Expert for the European Commission.
Sept. 1996 - Dec. 1997: Head, Department of Traffic Engineering, Nortel Harlow, UK.
June 1988 - Aug. 1996: Assistant and then Associate Professor, Department of Electrical Engineering, Ecole Polytechnique de Montréal, Canada. Consultant to France Telecom.
March 1987 - May 1988: Member of Technical Staff, AT&T Bell Laboratories, Holmdel, N.J., USA. Twice awarded an Exceptional Contribution Award.
Oct. 1984 - Oct. 1986: Engineer, ALCATEL, Lannion, France.
Purdue-Tivoli Partnership 123
Long Term Objectives
The objectives of my research are: Multimedia Broadband Networks (System
Integration, Resource Management, Technologies)
Traffic Engineering (QoS, Charging, Dynamic Provisioning, Design, Routing)
IP Mobility
Purdue-Tivoli Partnership 124
Impact and Research Plan Multimedia Broadband Networks
System Integration: One of the real challenges of tomorrow’s IT/Telecommunications is in the integration of technologies for providing seamless services. This can only be achieved by a ‘system’ team having an in-depth understanding of the issues at stake and a vision of the ‘global picture’.
Resource Management: Network Management is of utmost importance in today’s world of IT/Telecommunications. At the heart of it is Resource Management which is key to provide cost-effective usage of the system while providing QoS. The Network Management paradigm has to be revisited in the context of wireless technologies including satellite.
Purdue-Tivoli Partnership 125
Impact and Research Plan Traffic Engineering
QoS: QoS is key but its introduction in a IP network will have a tremendous impact on the complexity of the network management and network dimensioning.
Charging: in a competitive environment where services cannot be subsidized, there is a need for better understanding the engineering cost of QoS and GoS as well as designing tools for dynamic charging to be used between Network Operators and ISPs.
Design and Dynamic Provisioning: Tools are needed to measure the right performances and take automatic decisions to provision IP networks. This requires an in-depth knowledge of IP networks and their design and routing.
Purdue-Tivoli Partnership 126
Impact and Research Plan Horizontal Integration for IP Mobility
The question is: How to offer seamless IP mobility everywhere (indoor/outdoor, urban/rural, nationwide/global coverage) ?
The answer being: By taking advantage of the full range of technologies in an integrated way (wireless, satellite, terrestrial) by combining micro mobility with macro mobility and managing them in an integrated and efficient manner.
Purdue-Tivoli Partnership 127
Research Methodology Team work, close links with industry and standardization
awareness. Starting from a detailed and precise problem formulation
to achieve a clear understanding of the solution space and create the most appropriate set of solutions.
Innovative system/protocol/algorithm design. Use of analysis as much as possible. Use of simulation to assess performance impact of
solutions. Development of testbed if appropriate.
Purdue-Tivoli Partnership 128
Past Research: Papers A. Girard, A. Meddeb and C.R; Design of Broadband Networks with Multipoint
Connections, IEEE/ACM Trans. on Networking, submitted 7/99. C.R, End-to-End Resource Management Integrating Multiple Access, Bandwidth on
Demand and Call Admission Control for ATM Geostationary Satellite Systems, IEEE Com Magazine, submitted 4/99.
A. Conway and C.R; Weighted Fair Blocking Mechanisms, Performance Evaluation, submitted 3/99.
S. Delas, R. Mazumdar and C.R, Cell Loss Asymptotics for Finite Buffers with HOL Priorities, IEEE/ACM Trans. on Networking, submitted 5/99.
H. Yaiche, R. Mazumdar and C.R; A Game Theoretic Framework for Rate Allocation and Charging of Elastic Connections in Broadband Networks; IEEE/ACM Trans. on Networking, submitted 12/98.
R. Mauger and C.R; QoS Guarantees for Multimedia Services on a TDMA-based Satellite Network, IEEE Com. Magazine, 7/97.
S. Ramesh, C.R and A. Kumar; Revenue Maximization in ATM Networks Using the CLP Capability and Buffer Priority Management, IEEE Trans. on Networking, 12/96.
Purdue-Tivoli Partnership 129
Past Research: PatentsTitle Status/Date InventorsConnection Oriented Routing Disclosure Filed, 18/4/97 CR et alConnectionless CommunicationsNetwork
Disclosure Filed 1/8/97 CR et al
Connectionless Network Disclosure Filed 2/2/98 CRIntegrated Connection AdmissionControl And Bandwidh On DemandFor Multiple Access ATM LikeNetwork
Disclosure Filed 16/7/98 CR et al
Integrated Signalling for ATM likeNetworks
Disclosure Filed 16/7/98 CR et al
Satellite Communications RoutingAlgorithm
Disclosure Filed 11/1/99 CR et al
Fairness and Aggregation inTelecoms Networks
Disclosure Filed 30/6/99 CR
West Early Bird Disclosure Filed in France CR et alSpaceWEB Disclosure Filed 7/99 CR et alMethod and Apparatus forDistributed, Hierarchical SatelliteNetwork Control
Disclosure Filed 7/99 CR et al
Purdue-Tivoli Partnership 130
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Aditya P. MathurProfessor
Testing, Monitoring, and Controlling
CORBA-based Distributed Systems
Purdue-Tivoli Partnership 131
Long Term Objectives
Provide a commercially viable methodology for testing CORBA compliant applications.
Provide a methodology for monitoring and control of CORBA compliant applications.
Provide a tool to support the above methodologies.
Purdue-Tivoli Partnership 132
Impact (1)
TDS 1.1, developed at Purdue, will allow measurement of test adequacy for components and systems and assist in assuring high quality distributed applications. TDS is the only tool of its kind available today.
Tivoli, BT Labs (UK), and Telcordia have indicated their willingness to use TDS 1.1 in ongoing projects.
TDS 2.0 will allow distributed monitoring and control of distributed applications. TDS 2.0 is expected to be available for use in May 2000.
Purdue-Tivoli Partnership 133
Impact (2)
Our research has the potential to create new jobs in the state of Indiana. A start-up company is considering commercialization of TDS 1.1 and its forthcoming versions.
Availability of TDS 2.0 will provide a unique opportunity to entrepreneurs in the state of Indiana to set up commercial ventures such as Distributed Systems Test and Monitoring Laboratory, On-line Software Rental House, Component Quality Assurance, and Commercial Data Bank.
Purdue-Tivoli Partnership 134
Research Methodology (1)
Develop new criteria to evaluate the adequacy of testing: Completed in May 98.
Experimentally evaluate the adequacy criteria: Scheduled for completion in December 99. Collaboration with Tivoli.
Develop a methodology for monitoring and control: Completed July 99. Collaboration with Telcordia and Tivoli.
Purdue-Tivoli Partnership 135
Research Methodology (2)
Develop a method for the dynamic extraction of application architecture: Scheduled for completion in December 99. Collaboration with Telcordia and Tivoli.
Develop a commercially usable tool that incorporates the above criteria and methodologies: Version 1.1 available in August 99, Version 2.0 available in May 2000.
Purdue-Tivoli Partnership 136
Research Plan (1)
Implement a monitoring and control methodology: August 99-December 99.
Implement dynamic extraction of architecture: August 99-December 99.
Integrate the above into TDS 1.1, evaluate performance, refine/tune tool, and release TDS 2.0: January 00-May 00.
Purdue-Tivoli Partnership 137
Research Plan (2)
Develop requirements coverage criteria, implement in TDS 3.0, evaluate it experimentally: August 00-December 00.
Develop, implement, and evaluate tracing and test execution in TDS 3.0: August 00-December 00.
Prepare TDS 3.0 release: January 01-May 01.
Purdue-Tivoli Partnership 138
Budget
Staffing, Equipment, and Software: Graduate students: 4
Programmer: 1
PI: 1
Equipment and software
Estimated cost: $400K over 2 years.
Purdue-Tivoli Partnership 139
Past Research
Experimental evaluation of white-box coverage criteria. Sponsors: NSF, Telcordia, SERC.
New methods for the estimation of software reliability. Sponsors: NSF, Telcordia, SERC.
Listen Project to investigate the use of sounds in program monitoring. Sponsor: NSF.
Use of parallel machines in testing software for ultra high quality. Sponsor: SERC, NSF.
Purdue-Tivoli Partnership 140
Past Research
Over 70 publications have resulted from the above research. Technical reports are available in Technical Report Reading Room at:
http://www.cs.purdue.edu/serc Sponsors have invested over $2M over 10 years
in our research during 1988-1998. Lessons learned from past research are helping
us direct the course of the ongoing research.
Purdue-Tivoli Partnership 141
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Jens Palsberg
Associate Professor
Software Security in Distributed Systems
Purdue-Tivoli Partnership 142
Long Term Research Objectives
Build safe, secure, and highly-optimized mobile code.
Prevent mobile programs from leaking a host computer’s secrets.
Protect the intellectual property contained in mobile code.
Purdue-Tivoli Partnership 143
Potential Impact
Safer web-based commerce. More secure wireless connections for
laptop computers. Safer dynamically-configurable mission-
critical networks. Mobility of platform-independent code
without compromise of proprietary secrets.
Purdue-Tivoli Partnership 144
Research Directions (I)
Typed Assembly Languages for compiling Java: to address security in low-level code. Can we optimize method calls to improve
execution speed while retaining guarantees of memory safety?
Can we have effective type-checking while retaining the expressiveness necessary to write useful programs?
Purdue-Tivoli Partnership 145
Research Directions (II)
Secure Information Flow Model: to prevent the leaking of secrets. Can we formulate a useful confinement
property for distributed and concurrent systems?
Can we devise an effective way of checking such a confinement property?
Purdue-Tivoli Partnership 146
Research Directions (III)
Software Obfuscation and Watermarking: to protect intellectual property. Can we make a quantitative and qualitative
assessment of current software obfuscation techniques and tools?
Can we embed a watermark in a Java program which is resilient to the standard attacks?
Purdue-Tivoli Partnership 147
Research Methodology
Our methodology is mostly experimental, and based upon earlier theoretical work.
Completed preliminary experiments: A Typed Assembly Language for Java is up
and running. The next version is underway. Two watermarking systems for Java 1.1 have
been completed. Large-scale experiments are in progress.
Purdue-Tivoli Partnership 148
Research Plan
Milestones: A certifying compiler from Java to a Typed
Assembly Language. A confinement checker for concurrent and
distributed processes. An efficient and resilient Watermarking System for
Java.
Staffing: 1professor, 1 post-doc, 5 students. Budget: $150,000 per year.
Purdue-Tivoli Partnership 149
Technical Reports (Summer 1999)
Dennis Brylow and Jens Palsberg. “A Typed Assembly Language for Java.”
Sowmya Krishnaswamy, Minseok Kwon, Di Ma, Jens Palsberg, Qiuyun Shao, Christina Yi Zhang. “Experience with Software Watermarking for Java.”
Current Funding: NSF, IBM, CERIAS, etc.
Purdue-Tivoli Partnership 150
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Jan VitekAssistant Professor
SECURE MOBILE OBJECT SYSTEMS
Purdue-Tivoli Partnership 151
Long term goals of the research:
Technologies for engineering distributed objects applications
adaptive location-aware high-assurance
Purdue-Tivoli Partnership 152
Impact
Facilitate the construction of large distributed information systems, e.g. workflow management in a large corporations.
These systems are designed and implemented in a decentralized fashion, but some enterprise wide security policies must be enforced. Leverage object-oriented principles of reusability to reduce design and implementation effort.
Purdue-Tivoli Partnership 153
Research Methodology
Sound formal basis Security properties must be studied in a
formal setting. Concurrent process calculi and notions of
behavioral equivalence Identify relevant security properties Properties preserved under composition Widely applicable language mechanisms for
enforcement of security
Purdue-Tivoli Partnership 154
Research Methodology
... backed by real systems SecureJava: Secure Composition of Untrusted Code
High-assurance Java for composing untrusted or partially trusted classes. Type systems and compositional security properties.
FOAM: Featherweight Objects and Agent Mobility Compact object and byte code formats and data
compression tool integrated with RMI/JINI. Lightweight virtual machine design.
Purdue-Tivoli Partnership 155
Research Methodology
... backed by real systems DIGIDOC: Digital Protection for Active Electronic
Documents Distributed infrastructure for the exchange and
protection of active documents (workflow) incorporating protection mechanisms for policy enforcement.
Purdue-Tivoli Partnership 156
Past Research
JavaSealSecure mobile agent system implemented in Java. Support for the delivery of self-contained distributed application. [10 man years, Swiss SPP]
Vitek and Bryce, “The JavaSeal Mobile Agent Kernel”, In Agent Systems and Application’99.
HyperNews Commercial digital content delivery system built with JavaSeal.
Konstantas, Morin, Vitek, “MEDIA: A Platform for the commercialization of electronic documents.
Purdue-Tivoli Partnership 157
Past Research
JAZZ High-density Java bytecode format and compression software.Horspool, Bradley, Vitek, “JAZZ: Tailored Compression of Java bytecode”, IBM CASCON’98.
SPLSecure object-oriented programming technology.
ECOOP’98, OOPSLA’99, CSFW’99
Purdue-Tivoli Partnership 158
Past Research
SEALProgramming language for mobile computation.WIPL’97, JFLA’99, ERSAD’97
Language implementation and static analysis
OOPSLA’97, ECOOP’97, JLMC’97, CC’97, ECOOP’95, ECOOP’94, CC’92, ICCL’92
Purdue-Tivoli Partnership 159
Purdue-Tivoli Partnership:Exploiting Purdue’s Technological Prowess
Bharat Bhargava and Sanjay Madria
Experimental Studies in Adaptable Distributed System Software
www.cs.purdue.edu/faculty/bb
160Purdue-Tivoli Partnership
Long Term Objectives Investigate and develop adaptable distributed system
architecture/implementation and conduct experiments that provide a single point of management and control for the myriad of interconnected components; applications, software, middleware, databases, and evolutionary platforms
Investigate adaptable replica management schemes for version control, change management, consistent updates of software and data files
Scalability experiments - horizontal (geographical distribution) and vertical (number of sites)
Purdue-Tivoli Partnership 161
Experimental studies - network behavior, reliability, interoperability , integration, and monitoring. Impact on quality of service (QoS) in emerging distributed applications such as e-commerce
Software support for data compression , checkpoint/restart (recovery) and user authentication
Solutions embedded in ESM and Galileo at Tivoli
Purdue-Tivoli Partnership 162
Impact Our research will impact in development, evaluation,
and experiments with enterprise support management (ESM) product for asset, change and network system management. Specifically, we will contribute to expert evaluation, expert views and expert mail agent in ESM.
Our research on nested and workflow transactions will contribute to the efforts of Galileo at Tivoli. The integration of business process automation with other Tivoli products will be enhanced.
Experience with collaborative software development and information systems reliability mechanism to deal with various types of failures (RAID)
Purdue-Tivoli Partnership 163
Our results are applicable to systems software used in electronic commerce transactions, trading of stocks, collaborative software, distributed file systems, multimedia/video conferencing.
Our system will allow non-stop access to a customer to place an urgent order even if network router is down or sites have failed. We assume that a single transaction must travel across multiple unsecured networks that are not visible to network administrator or customer
Automatically distribute updates of software or data across the multiple sites. Good for view maintenance in case of multiple business partners are involved.
164Purdue-Tivoli Partnership
Centrally manage and monitor all network, application and system activity and adapt to various types, extent, and duration of anomalies
Replication and version management of software under various anomalies to provide optimum availability
Purdue-Tivoli Partnership 165
Research Methodology We develop, implement and experiment with
algorithms, models and system software tools (Raid, O-Raid, P-Raid, MM-Raid, AVC, WANCE, active network engine, etc).
We build prototype systems and software tools, develop bench-marks to evaluate distributed software performance/capability and transition to commercial grade embedded software
We conduct a series of experiments over LAN and WAN using sites across the world using WANCE tool
Purdue-Tivoli Partnership 166
Sample Experiments Replicated copy control (version management)
experiment - to study the effect of copier transactions and mechanisms for refreshing out-of-date copies. Examine effects of partial replication. Study availability vs degree of replication using Raid system and TP benchmark
Adaptability/Embedding experiment Identify cost of reconfiguration and adaptation. Is throughput reduced during adaptation? Overheads due to Embedding Vary failure parameters (frequency, duration, type, extent,
timing) Measure cost of adaptation and benefits in terms of
availability, response time, etc.
Purdue-Tivoli Partnership 167
Research Plan Extend embedded capabilities in distributed system
(Raid) and conduct experiments to deal with adaptability in update management (replica control) and remote software management.
Algorithms to deal with site failures, network partitioning, and security.
Measurement of reliable communication over communication software for replica management (change management), non-stop availability and transmission of large software objects over WAN/LAN
Operating system changes for improving communication software support for embedded systems
Purdue-Tivoli Partnership 168
Performance of adaptability and reliability schemes to deal with failures, constraints in system resources, heterogeneity and communication (LAN, WAN, MAN, Mobile)
Deal with various traffic patterns of transactions, multiprogramming level, scalability to number of sites and distance among sites (WANCE tools)
Experiment with distributed, collaborative and cooperative execution of business transactions
Integration in the framework of ESM and Galileo Development of policies for adaptability at the
application, system and network layer to meet varying QoS requirements.
Purdue-Tivoli Partnership 169
Deliverables Guidelines for change management system adaptability,
cost-benefits analysis and evaluation. (June 2000) Prototype implementation and experiments with
technology transfer for various components of distributed software (ESM) (Dec. 2000)
Software Tools (ANE, WANCE, mini-Raid) for experiments in scalability, wide area network, reliability, active networking and security (June 2001)
Recovery and adaptation to failures of various types, duration, extent, timing in context of embedded ESM and Galileo (June 2001)
Purdue-Tivoli Partnership 170
Past Research/Accomplishments Awards -
Best Paper Award on Adaptability in Distributed Systems IEEE Fellow Award IEEE Technical Achievement Award for work on
Distributed Systems
14 Ph.D., 20 MS and 15 undergraduates have worked on our projects.
Projects (and student fellowships) are supported by various funding agencies NSF, Army, NASA including industries like IBM, AT&T, Unisys etc.
IBM supported project - Integrated Analysis and testing of Distributed Software
Purdue-Tivoli Partnership 171
RAID Distributed System - Reliability, Adaptability, Interoperatibility, Distributed Systems - IEEE Transactions on Software Engineering
Reliability - models, performance, implementation (book - Advanced Replication Techniques for Distributed Systems, 1996) Integrity - TSE, TKDE’99
Site failures- TKDE’99 Network partitioning- Computer Journal’98, Recovery- DEXA’97 Checkpointing- SRDS’98, TKDE’99
Purdue-Tivoli Partnership 172
Adaptability Failures (VLDB) Formal models - IEEE TKDE’99, Information
Systems,97 Adaptable communication software - ASSET’98,
multimedia’96, Adaptable commit - IEEE RQD’99 Dealing with multiple heterogeneous data,
algorithms, data models - Journal of Multimedia Systems’99
Interoperability Degree of autonomy Degree of consistency- IEEE TKDE’99 CORBA
Purdue-Tivoli Partnership 173
Distributed systems Transaction processing - TKDE,99 Operating system support Communication software - Multimedia, 99 World Wide Web data management (Sp.
Issue of WWW journal), DASFAA’99, FODO’98, IDEAS’99
Purdue-Tivoli Partnership 174
Budget/staff Staff - Bharat Bhargava, Sanjay Madria, five
graduate students and three undergraduates Budget - Direct costs $150,000 per year for 3
years - total $ 450,000