WIR VERSTEHENDIE ZEICHEN DER ZEIT

KEEPING PACEWITH THE SIGNAL OF TIME

Approaches to the EvaluationApproaches to the Evaluationof Intelligence Dataof Intelligence Data

Workshop IST-036/RWS-005Workshop IST-036/RWS-005

Massive Military Data Fusion and Massive Military Data Fusion and Visualisation: Users Talk with Visualisation: Users Talk with DevelopersDevelopers

Definitions Definitions

VisualisationVisualisation should generate an should generate an environment supporting the perception environment supporting the perception process of presented information.process of presented information.

VisualisationVisualisation should help average users should help average users to produce better results and help the to produce better results and help the ”artist” to become more creative.”artist” to become more creative.

SIGINTSIGINT makes contributions to describe makes contributions to describe the situation for military and political the situation for military and political decision-makers on the basis of decision-makers on the basis of information intercepted from information intercepted from communication and signal distribution communication and signal distribution processes.processes.

OverviewOverview

Data modelData model Information processing tasksInformation processing tasks Visualisation examplesVisualisation examples Further aspectsFurther aspects

Data Data archivearchive

VisualisatioVisualisationn

Tolerable access time

old

actual

ArchiveClean up

VisualisationAnalysisEvaluation

Raw DataAudio Text Fax ...

DataLink

AggregationAggregation

ClG S

MD

TMGarbage Target / mission data base

Sensor / source

Add valuable meta data•Technical operational parameters•Feature extraction results

Data Data reductionreduction

Pre-Pre-processinprocessingg

ClassificationClassification

AcquisitionAcquisition

Signal InputSignal Input

Data Data ModelModel

Rep...

Link

ReportReportColl

SEL SelectionSelection

CollectioCollectionn

...

Data fusionData fusion

Information Processing TasksInformation Processing TasksTaskTask OperationOperation ResultResult ExampleExample

AcquisitionAcquisition Sensor Signal Sensor Signal Processing in Processing in RealtimeRealtime

Raw Raw SignalSignalFileFile

AudioAudio TextText FaxFax

ClassificatiClassificationon

Determining Determining targets of interest targets of interest in respect of in respect of target/mission target/mission data basedata base

Signal ofSignal ofInterestInterest

GarbageGarbage

Pre-Pre-processingprocessing

Adding technical Adding technical operational operational parameters and parameters and additional featuresadditional features

AdditionalAdditionalFeatureFeature

FileFile

Time, durationTime, duration Frequency ...Frequency ... Language, Language, speaker,speaker, topic, ... topic, ...

SelectionSelection Interactive Interactive selection of a selection of a relevant signal relevant signal collectioncollection

Signals within a Signals within a window defined in window defined in parameter spaceparameter space

ReportingReporting Fillout a form or Fillout a form or edit a result file !edit a result file !

S F

R

Aggregation: Data Fusion – ReportingDrill Down: ~ confidence, security, permission

*** Visualisationneeded !

***

***

Visualisation Examples:Visualisation Examples: Raw Signal - Raw Signal - AudioAudio

Traditional 2Drepresentationof signal analysisresults incl.audio processing

Visualisation Examples:Visualisation Examples: Raw Signal - Raw Signal - TextText

VIDA – Visual Document Analysis Dr. Michael Towsey, MEDAV

• Keyword Analysis• Feature vector generation for

automatic classification processes• Grafical summary• Textual summary

• Example: the Arthur Enderson / enron story

The full displayThe full display

Information text box

Menu Bar Information panel

List of topics in document

Selected topic

Movable panel divide

List of word associations

Redraw arcsbutton

Hide ArcsButton

Slider

Graph panel

Analysis Tool Bar

Automatic Keyword ExtractionAutomatic Keyword Extraction

n-gram analysisn-gram analysis

Association Analysis Association Analysis – ”Arthur – ”Arthur Anderson”Anderson”

Visualisation Examples:Visualisation Examples: Collection –Collection – E-mail E-mail

Command & Control Command & Control structuresstructures

Using statistical Using statistical methods of pattern methods of pattern recognitionrecognition

Visualisation Examples:Visualisation Examples: Collection –Collection – Radio Radio network Inetwork I

Visual terrain modelsVisual terrain models Fusion of communication Fusion of communication

eventsevents Drill-Down into the raw Drill-Down into the raw

datadata Additional information by Additional information by

background projectionbackground projection Use of virtual reality Use of virtual reality

projection methodsprojection methods

Background Information:

Simulated radio wave propagation

Network: 4711TOA: 010700B Apr 01Frequency: 5815Location: alpha

Comment: Increased communication activity after event Yankee

COMINT-Situation displayed in a COMINT-Situation displayed in a terrain modelterrain model

Visualisation Examples:Visualisation Examples: Collection - Collection - Radio Radio network IInetwork II

Trans-mitter

Time

Receiver

• technical technical parameters:parameters:• Call sign senderCall sign sender• Call sign receiverCall sign receiver• Time of ArrivalTime of Arrival

Frequency of contact Frequency of contact is described by the is described by the size of the spheresize of the sphere

Communication- one transmitter / one receiver- gaps- unequal intensity

Activities of a transmitter

Activities of a receiver

Further Aspects:Further Aspects: Archive Archive

• The archive contains the complete data set – including:• Raw data• Definitions of collections• Reports• All links from aggregated data to original raw

data

Raw DataAudio Text Fax ...

Rep...

Coll...

Models for the automatic generation

of reports can be trained and tested

using archived operational data sets

Thank youThank you