B3AS

Joseph Lewthwaite1 Dec, 2005

ARL Knowledge Fusion COE Program

2

Brigade and Below Battlefield Awareness Overview

Introduction The Sensor to Shooter Objectives Components Current State Intelligent Systems Security

3

Introduction

B3AS – Brigade and Below Battlefield Awareness System.

A framework upon which to build the sensor to shooter environment, providing the warrior with the necessary information to prosecute their mission.

4

Sensor to Shooter Problem

Fusion Node

SIPs

SIPs &Fusion Nodes

5

B3AS Objectives To provide the warrior at the edge a seamless stream of

knowledge answering their attack questions in a sharp and informative manner.

Enable the system to intelligently and automatically index, categorize and fuse sensor output, automatically forwarding appropriate information to interested parties.

Fusion level 1/2. Present non-visual streams of information to the warrior on the

edge in contextually informative ways. Enable the 3rd person. To fuse and disseminate information while minimizing network

and computer resources. To have a system that intelligently tracks and predicts the

coverage requirements and allows users at all echelons to deploy sensors in the most efficient manner.

To secure the information while maintaining accessibility.

6

B3AS – Components

Composed of three major components : Source Integration Point (SIP), Fusion Node (FN) and Client

SIP – Point where external data, sensor or database, is pulled into the B3AS domain, standardization.

FN – Intelligent nodes used to collect and combine raw streams of data into information streams to answer clients questions.

Client – Agents interacting with the fusion nodes to disseminate relevant information.

7

Architecture

Fusion Node

Private TransformChain

Transform n

Real-timeCache

IntelligenceAnalysis

AgentClient

Enhanced VideoIndividualFrame,

AssociatedData

Archive

Transform 1

StandardizedVideo (RGB)

Associated DataID, Position, Type,Security…(XML)

Subscription

Notification

StandardizedVideo (RGB)

Associated DataID, Position, Type,Security…(XML)

AssociatedVideo Data

ID, Position, Type,Security…(XML)

System dataAvailable sensors...

Intelligence(XML)

Source Integration Point

Global Transform Chain

Global Filter Chain

Global FilterSampler

Sensor

Auto-Annotation

Digitized Data SensorOperator

Global Filter...

Transform Transform...n

DigitizedData

Associated DataID, Position, Type,

Security...

StandardizedVideo (RGB)AssociatedData (XML)

SampledVideo & Data

Intelligent SensorManagement

8

B3AS Current State

Discovery – no discovery, static implementation Automated sensor management Output – current service stream is video based. SIP – B3AS Video Feeder, Windows application,

translates heterogeneous video to standard 24-bit RGB associates metadata w/ individual video frames. Exposes input stream to filters

Fusion Node – Windows web service dynamic real-time query capability. Intelligent sensor management

Client – Web page with Windows Media control embedded. HTTP control used for real-time communication with service using SOAP.

9

B3AS – Implementation

Local Connectivity

Remote Connectivity

Windows MediaEncoder

<<Component>>

Windows MediaPlayer

<<Control>>

B3AS FusionClient

<<Web Page>>

XMLHTTP<<Control>>

B3ASVideoStreamer

<<Web Service>>

Embeds

BORG SharedMemory

<<Component>>

B3AS BroadcastDMO

<<Component>>

Embeds

Uses

Uses

Video Feeder<<Application>>

Uses

Video SourceDirectX Graph

<<Component>>

Source Integration Point

B3AS FilterGlobal Transforms

Fusion Node Internet Explorer Client

Collection PointDirectX Graph

<<Component>>

Uses

HTTP/SOAP

HTTP/WMV

Embeds

B3AS BroadcastDMO

<<Component>>

Windows MediaEncoder

<<Component>>

Uses

Embeds

Bidirectional HTTP

HTTP/WMV

Uses

10

Intelligent Systems (BORG://) Current web protocols (HTTP, FTP) are static, single

points of failure (web-sites, portals). Peer-2-peer allows real-time discovery, distributed. BORG protocol combines capabilities of web services

with the discovery services of a P2P network. Discovery includes machine state: location, load. Richer dynamic content description, including both

current needs and contents Enables real-time clustering, system restructuring and

repair, intelligent load balancing. Dynamic indexing and categorization An intelligent system.

11

Example uses

12

Soldier :Sensitive

PredatorNational Asset

Classified Top Secret

CypherPlatoon asset

Classified Sensitive

Event A

Security Today, failing the warrior Applying current security fails to

protect or provide in a sensor to shooter environment

Platform/hardware-centric Sensors at lower classification will

release information collected at higher levels. Protection failure.

When information isn’t classified why shouldn’t sensors at higher levels contribute to general situational awareness.

13

Security for Sensor to Shooter

Framework needs to be able to describe the need to know.

Information needs to move and exist at different levels simultaneously, maybe transformed.

Temporal – Closer to the edge shortens the applicability

Spatial – Closer to the edge reduces the area of concern.

Command and Control – how do you describe the need to know of commanders

Support – How do you associate fire support with the warrior at the edge.

14