(in)formal concept analysis

Lecture Notes : (In)Formal concept analysis 30/03/2009

Formal Concept AnalysisProf. Kim Mens

Louvain School of EngineeringDepartment of Computing Science and Engineering

UCL

http://www.info.ucl.ac.be/~km

(In)



/ 48Lecture Notes : (In)Formal concept analysis 30/03/2009Prof. Kim Mens – UCL, Belgium

Information explosion

IT advances in the last decade(s) have caused an explosion of information

E.g., growth of the internet

This leads to a real information overload

How to manage (i.e., search, structure) all that information?

2


(Small) example

Dataset = someone’s iTunes™ music library

≥ 5000 songs each having a name, artist, rating, genre, ...

How to manage all that data

How to find a song we like?

Can we find interesting relations between songs?

which songs are similar?

in what way are they similar?

3


Managing large data sets

Given a data set with many thousands of elements:

web pages, text or other documents

data libraries (books, songs, movies, ...)

customer and personnel databases

having certain properties:

indexes, relevant keywords, tags, genres, ...

In general ...

4


Managing large data sets

Given a data set with many thousands of elements:

web pages, text or other documents

data libraries (books, songs, movies, ...)

customer and personnel databases

Questions

1. How to find relevant data?

2. How to discover (hidden) structure in that data?

5


Running example (revisited)

Songs Genres

6


Running example

How to manage all those songs?

Three concrete applications

1. Finding a song based on its genre

2. Discover (un)expected dependencies between genres

• as well as absence of expected dependencies

3. Discover a user profile

• e.g., what songs does she like most

7


A Google-like search engine for songsGalois

Genres (separated by spaces) :

search

party dance

8




search

party dance

Search results [ party, dance ] :

• Technologic – Daft Punk• Whole Again - Atomic Kitten• Get Busy - Sean Paul• Destination Calabria – Alex Gaudino• Rock This Party – Bob Sinclar

Refine search by genres :

• [ slow, pop, soft ]• [ beat ]

Remove genres from search :

• party• dance

9




search

party dance beat

Search results [ party, dance, beat ] :

• Technologic – Daft Punk• Get Busy - Sean Paul• Destination Calabria – Alex Gaudino• Rock This Party – Bob Sinclar


• [ electronic ]• [ reggae ]


• party• dance• beat

10




search

party dance beat reggae

Search results [ party, dance, beat, reggae ] :

• Get Busy - Sean Paul


• party• dance• beat• reggae

11




search

party reggae

Search results [ party, reggae ] :

• Could You Be Loved – Bob Marley


• [ dance, beat ]


• party• reggae

12


Running example


Three concrete applications:





• what songs does she like most

13


Structure of the world-wide music scene

http://sixdegrees.hu/last.fm/index.html

?14




Dependencies between genres

New wave is so eighties

Dance music is party music

Disco is from the seventies

Classical music and slows are for softies

...

15


Running example








16


Discover a user profile

To analyse the preferred genres of a user

for match-making or publicity purposes

For example,

most of her music is party music

she likes background music

she’s not such a big fan of classical

none of her music is hard

17


Running example








So how can we

achieve all this?

18


Formal concept analysis...

... may be of help

FCA was invented around 1980 in Darmstadt as a mathematical theory for modelling the notion of a “concept”

Since then it has been applied in many domains of computer science dealing with large data sets

data analysis

knowledge discovery

software engineering

19


Data set is represented by a “context”

Objects Attributes

Relation

20



Starts from a context C

a set G of objects

a set M of attributes

a relation I between the objects and the attributes

Determines concepts

Maximal groups of objects and attributes

Plus hierarchical relationships

Subset relationships between those groups21


A “concept” represents a group of related objects and attributes

Intuitively, we look for maximal “rectangles” in the binary relation I

22


A conceptAlice - Sisters of Mercy

A Forest - The Cure

New Wave Party Eighties

Objects Attributes

A concept is a maximal group of objects and attributes

Group:

Every object of the concept has those attributes

Every attribute of the concept holds for those objects

Maximal

No other object (outside the concept) has those same attributes

No other attribute (outside the concept) is shared by these objects23


Not a concept

Need to include thisNeed to include this as well

Intuitively, we look for maximal “rectangles” in the binary relation I

24



... derives hierarchies of concepts from data sets

It generates and visualizes hierarchies of concepts on a mathematically founded basis

FCA

25


A concept hierarchy

26


Yet another concept

27


A subconcept

The blue concept is a subconcept of the green one.

28


A subconcept

is subconcept of

TechnologicIn Da ClubGet Busy

Destination CalabriaRock This Party

Party Dance Beat

Party Electronic Dance BeatTechnologic


is subset of is subset of

29


Concept lattice

For a given context, the set of all formal concepts, together with the partial order “is subconcept of” form a lattice

A lattice is a mathematical structure with some interesting properties:

for any two concepts there is always a greatest common subconcept and a least common superconcept

it is even a complete lattice, i.e. a unique top (least common superconcept) and bottom element (greatest common subconcept) exist

30


A concept lattice

31


A concept lattice

Alice – Sisters of Mercy

Forest – The Cure

New Wave Party Eighties

TechnologicIn Da ClubGet Busy


Party Dance Beat

Party Electronic Dance BeatTechnologic


is su

bcon

cept

of

32

Tool support : Concept Explorer


A concept lattice in detail(sparse labelling)

34


Running example revisitedHow does it work?








35




search

party dance

Search results [ party, dance ] :

• Technologic – Daft Punk• Whole Again - Atomic Kitten• Get Busy - Sean Paul• Destination Calabria – Alex Gaudino• Rock This Party – Bob Sinclar


• [ slow, pop, soft ]• [ beat ]


• party• dance

36




search

party dance beat

Search results [ party, dance, beat ] :

• Technologic – Daft Punk• Get Busy - Sean Paul• Destination Calabria – Alex Gaudino• Rock This Party – Bob Sinclar





37




search

party dance beat reggae

Search results [ party, dance, beat, reggae ] :

• Get Busy - Sean Paul





38




search

party reggae

Search results [ party, reggae ] :

• Could You Be Loved – Bob Marley


• [ dance, beat ]


• party• reggae

39










40


Implications

New wave is from the eighties



Slows are soft

Classical music is soft

41


Implications

Slows are soft

Classical music is soft



New wave is from the eighties

42


Associations

Most dance music has a beat

Most of her music is party music

A lot of music from the eighties is party music

43










44


Concept lattice(with number of objects)

Preferred music is party music

Also likes some background music

Not such a big fan of classical

and so on ...

45


Some problems...

Concept lattice can get very dense for large data sets

Concept lattice can grow exponential in size of context

Attributes are not always binary

What if data is incomplete or imprecise

False positives and negatives

...

(Some solutions have been proposed to overcome these problems)

46


Conclusion

FCA is an interesting technique to analyse large data sets

especially to discover interesting concepts, relations and structures in the data

Can be applied to many application domains

Based on a formal mathematical theory

Yet easy to use and understand intuitively

Quality of results depends on size and quality of the data

47

Lecture Notes : (In)Formal concept analysis 30/03/2009Prof. Kim Mens – UCL, Belgium / 48

SourcesB. Ganter, R . Wille: Formal Concept Analysis –Mathematical Foundations. Springer, Heidelberg 1999

Uta Priss’ Formal Concept Analysis Homepage

http://www.upriss.org.uk/fca/fca.html

Gerd Stumme’s course “Formale Begriffsanalyse”

http://www.kde.cs.uni-kassel.de/lehre/ss2005/formale_begriffsanalyse

Context Explorer (ConExp)

http://conexp.sourceforge.net/

J. Fallon: Application des treillis de Galois à la recherche d’informations. Master’s thesis, Université catholique de Louvain, Département d’Ingénierie Informatique, 2004

48





http://conexp.sourceforge.net

http://conexp.sourceforge.net

(in)formal concept analysis

Technology