Automated Analysis and Measurement of Open-Source

Software @ OW2con'13 RISCOSS Convention

Alessandra Bagnato

Softeam R&D

Issy-les-Moulineaux, 12th November 2013

1

Selecting OSS

Is a challenging task

Time, cost of error, stress

Approaches

Use over-simplified selection criteria

Try to avoid making a decision altogether

Choose arbitrary default options

Overestimate their expertise

Become highly risk averse

Selecting OSS

Is a challenging task

Time, cost of error, stress

Approaches

Use over-simplified selection criteria

Try to avoid making a decision altogether

Choose arbitrary default options

Overestimate their expertise

Become highly risk averse

Selecting OSS

Many OSS projects with similar/overlapping functionality

Adopters are looking for OSS that is … of high quality (fast, secure, extensible etc.)

supported by a substantial team of developers

• questions answered

• bugs fixed

• new requirements implemented

backed by a company

used by other people

going to be around for a while

Monitoring OSS

The health of OSS needs to be monitored after initial selection has taken place The company behind an OSS project may

fold/switch focus

OSS developers may change jobs (or simply lose interest)

A newer/better OSS may make the project obsolete

Adopters need to be warned early enough to set up a transition plan

OSSMETER Vision

Develop a platform that will support decision makers in the process of discovering, comparing, assessing and monitoring the health, quality, impact and activity of open-source software

Late/no replies to questionsInfrequent source code updates

Bugs not fixedInfrequent releases

Small number of downloadsFew external references

Quick replies to questionsFrequent source code updates

Bugs fixed quicklyFrequent releases

Large number of downloadsMany external references

Qua

lity/M

atu

rity

?

Sources of Information

OSS forge metadata

Source code repositories

Issue/bug tracking systems

User communication channels

Newsgroups, forums

OSS Project

Communication channel (Newsgroup/forum/

mailing list)

Source CodeRepository

Bug Tracking System

OSS ForgeMetadata

Expected Results

Metamodels for capturing meta-information relevant to OSS projects (e.g. types and details of source code repositories, communication channels and bug tracking systems, types of licences, number of downloads etc.)

OSS Project

Communication channel (Newsgroup/forum/

mailing list)

Source CodeRepository

Bug Tracking System

OSS ForgeMetadata

Expected Results

OSS analysis based on advances in language-agnostic and language-specific methods for code analysis, state-of-the-art Natural Language Processing (NLP) and text mining techniques

Source Code Analysis

Current state of practice: Language-Agnostic Analysis

#LoC vs. comments

File extensions

OSSMETER contribution: Language-Aware Analysis

Integrate current state-of-the-art in source code analysis

Tailored metrics for source code

Bug Tracking and Communication Channel Analysis

Current state of practice # of bugs # of messages

OSSMETER contributions Thread analysis

• How many people ask/answer questions? • How do users feel about the support they

receive? • How does this evolve over time?

Bug lifecycle analysis • Are bugs fixed? How long does it take on

average?

…

OSS Project

Communication channel (Newsgroup/forum/

mailing list)

Source CodeRepository

Bug Tracking System

OSS ForgeMetadata

Expected Results

Extensible cloud-based platform enabling users to discover and compare OSS projects, which can also support quality analysis and monitoring of in-house software development projects

OSSMETER Platform

Platform Storage, analysis

API Interoperability

Web application Presentation

Available both as a service and as a platform that can be deployed in-house to monitor internal projects for local deployment

Beneficiaries

Developers and Project Managers who are responsible for deciding on the adoption of OSS, will be able to make decisions on hard facts and uniform quality indicators

Developers of OSS will be able to monitor the quality of the OSS projects they contribute to and promote the projects using independently calculated and trustworthy quality indicators, and identify related projects for establishing synergies

Funding Bodies supporting projects which produce OSS will be able to monitor the quality and assess the impact of the produced software even after the end of the projects

Current state of platform

Data Persistence

Object Mapper

OSSMETER Platform

Metrics Connectors

Project Analysis and Management

Front-end

OSSMETER Browse

OSSMETER Monitor & Compare

Partners (1/2)

Industrial Partners

The Open Group (UK)

Tecnalia (ES)

Softeam (FR)

Uninova (PT)

Unparallel Innovation (PT)

Partners (2/2)

Academic Partners

CWI (NL)

• Expertise in source code analysis

University of Manchester (UK)

• Expertise in text mining

University of York (UK) & University of L’Aquila (IT)

• Expertise in Model Driven Engineering

Inter-Project Collaboration

Future services to facilitate FLOSS development and adoption by EU research and business communities http://ec.europa.eu/digital-agenda/events/cf/ict2013/item-display.cfm?id=10341

Participants from MARKOS project - n 317743 "Global level view of open

source software on the web" RISCOSS project - n.318249 "Risk management of OSS

development in the cloud" OSSMETER project - n. 318736 "Measurement and

analysis of open source software: a big data challenge" PROSE project - n. 318218 "OSS development support

tools: how a software forge can sustain H2020 innovation"

Contacts

Alessandra Bagnato

SOFTEAM | ModelioSoft

Alessandra.bagnato@softeam.fr

OSSMETER Web Site:

http://www.ossmeter.eu @ossmeter

SOFTEAM R&D Web Site:

http://rd.softeam.com

Modelio UML Open Source Modeling Tool Web Site :

http://www.modelio.org

www.modeliosoft.com 22