1 echo - european chronicles on-line pasquale savino i.e.i. - c.n.r. via alfieri, 1 - 56127 pisa...

13
1 ECHO - European Chronicles On- line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: [email protected] http://www.iei.pi.cnr.it/People/Savino.html ECHO Web-site: http://pc- erato2.iei.pi.cnr.it/echo/

Upload: nicholas-cannon

Post on 27-Mar-2015

212 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

1

ECHO - European Chronicles On-line

Pasquale SavinoI.E.I. - C.N.R.Via Alfieri, 1 - 56127 PisaE-mail: [email protected]://www.iei.pi.cnr.it/People/Savino.html

ECHO Web-site: http://pc-erato2.iei.pi.cnr.it/echo/

Page 2: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

Starting date: February 1, 2000

Duration: 30 months

Total effort: 475.8 p/m

Project Figures

Page 3: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

Make possible to access and search by content over the net, large and inter-operating audio visual archives. Management of historical documentaries Definition and adoption of an appropriate metadata

format Support of multiple languages Integration of manual and automatic indexing Creation of automatic video summaries Validation through testbeds of documentary film

archives

Project Objectives

Page 4: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

ECHO System Overview

Digital Compression

LLiibbrraarryy CCrreeaattiioonnOffline

SpeechRecognition

ImageExtraction

Natural Language Interpretation

IndexedTranscript

Segmented Compressed

Audio/Video

Indexed Video Database

Segmentation

VideoMetadata

LLiibbrraarryy EExxpplloorraattiioonn

Requested Video Segment

Interactive Story Selection

Online

Semantic-expansionTranslation

IndexedTranscript

Segmented CompressedAudio/Video

Indexed Video DatabaseUser Request

Page 5: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

Content providersIstituto Luce (I) Institut National de l’Audiovisuel (F) Stichting Nederlands Audiovisueel Archief (NL)Memoriav (CH)

The Partners

Project coordinationIEI-CNR (I)

Page 6: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

Industrial partnersTecmath (D)Media Site (GR)Eurospider Information Technology (CH)

The Partners (cont.)

Research institutionsIEI-CNR (I)Istituto Trentino di Cultura (I)Centre National de la Recherce Scientifique (F)University of Mannheim (D)Carnegie Mellon University (USA)

Page 7: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

User requirements collection and analysis Content selection and preparation Metadata format definition and acquisition System architecture design and detailed

specification System development and test System Evaluation Field Trials

Project Activities

Page 8: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

Content ProvidersContent Providers

Industrial Partners

Industrial Partners

Research InstitutionsResearch

Institutions

System Architecture

System Development

Speech Recognition Video Summaries

Advanced indexing & search

User Requirements

Field trials

Content selection

Partner’s roles

Page 9: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

Project Milestones

Phase 1 Collection and analysis of user requirements Collection analysis and selection Film metadata model definition System Functionality and Global Architecture

Completed by September 2000

Page 10: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

Project MilestonesPhase 2

Specification and development of ECHO first prototype Automatic indexing of documentary filmsAdaptation and integration of four speech

recognition engines for mono-lingual content-based indexing and retrieval.

Completed by April 2001

Page 11: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

Project MilestonesPhase 3

Specification and development of the ECHO final prototype. Metadata editorIndexing of the complete ECHO collectionRetrieval based on audio transcripts and

metadataInteroperability of digital film collection.Automatic film summary.

Completed by December 2001

Page 12: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

Project MilestonesPhase 4

Evaluation Validation Dissemination

Completed by August 2002

Page 13: 1 ECHO - European Chronicles On-line Pasquale Savino I.E.I. - C.N.R. Via Alfieri, 1 - 56127 Pisa E-mail: savino@iei.pi.cnr.it

Vienna, 30 June 2000 ECHO – European CHronicles On Line P. Savino – IEI-CNR

Some key technical issuesMetadata format InteroperabilityIntegration of automatic and manual indexingAutomatic speech recognition of old

documentary materialCross Language RetrievalAutomatic abstractingImage “understanding” for face, text and

object recognition