SMART RESOURCE-AWARE MULTI-SENSOR NETWORK INTERREG IV RESEARCH PROJECT

PAOLO OMERO SABRINA LONDERO MASSIMILIANO VALOTTO

1  

Autonomous complex event detection in scenarios with limited infrastructure  

%

2  

Designing a smart resource-aware MULTISENSOR NETWORK capable of autonomously DETECTING and LOCALIZING various EVENTS such as screams, animal noise, tracks of PERSONS and more COMPLEX HUMAN BEHAVIOURS."      

MAIN GOAL : SMART MULTISENSOR NETWORK

RESEARCH AREAS

%

3  

1. NETWORK RECONFIGURATION

Due  to  limited  resources,  the  sensors  network  should  be  able  to  reconfigure  itself  in  order  to  limit  consumes  (for  example  switching  off  cameras  when  nothing  happens  in  that  area).  

2. AUDIO/VIDEO ANALISYS Video  frames  and  audio  signals  are  analyzed  in  order  to  recognize  objects  and  sounds.  We  can  idenEfy  for  example  the  type,  speed,  direc2on  and  the  coordinates  of  a  moving  object.  It  is  possible  to  recognize  different  classes  of  objects  such  as  humans,  cars,  dogs  and  cows.  

3. COMPLEX EVENT DETECTION

Seman2c  analysis  is  performed  over  data  extracted  during  audio  and  video  analysis,  in  order  to  detect  complex  events,  such  as  for  example      <people  shoo2ng  to  deers>    <person  walking  in  a  restricted  area>  <dog  figh2ng  with  person>      For  this  purpose  we  use  an  ontological  model  and  a  rules  engine.  

NETWORK

ACQUISITION

ANALYSIS

COLLECTING

DATA MINING

SOUND DETECTION OBJECT RECOGNITION LOCALIZATION

SEMANTIC ANALISYS

MULTIMEDIA & EVENTS ARCHIVE COMPLEX EVENT DETECTED

SOLAR POWERED AUTO RECONFIGURABLE

VIDEO AUDIO PICTURES

NETWORK CONFIGURATION.

The network configurator can define new sensors pointing them directly on the map and specifying their data. The installed sensors are then visible on a map, that shows also their coverage.

The configurator interface allows also to define a mapping of zones, specifying for example forbidden areas, playfield for children, etc. To define a new zone the configurator should simply draw the area on the map, give it a name and decide a color for the visualization.

POWER SEARCH.

6  

The user interface allows users to perform powerful retrieval operations over the collected data and advanced statistical analysis to get knowledge from the archive. The basic access metaphor used for querying the archive is a what/where/when three dimensional space.

EVENTS. The search results are visualized and can be navigated following an event/place/network three dimensional approach. The events view shows the list of events resulted from the search. For each event we can see the date, the involved subjects, the action and, if defined, the zone where it happened. We can also see a map showing the exact position of the event and any related multimedia content (videos, images or audio).

DATA MINING.

8  

The application offers to the user also some advanced statistical analysis, useful to get knowledge from the archive. Some examples regard the distribution of events of different types over time/in specific periods or the trend of the activity of sensors.

MOBILE ACCESS.

9  

MONITORING.

10  

The main goal of the monitoring interface is to support the security operator in monitoring what happens in the environment. The monitor interface is divided in two views: cameras view and events view. The camera view allows the operator to watch all the cameras in real-time. The operator can also select to follow a specific camera.

MONITORING EVENTS.

11  

The events view alerts the operator of any new event, allowing him to immediately switch and look at that event. The operator can also look at all the recorded events, even after they are finished.