Are You Smarter Than Your Video System? Functionality and Technology of Video Surveillance Systems

Presented By Jeffrey A. Slotnick CPP, PSP & James Marcella, Director, Technical Services, Axis Communications

> Transit

> Loss prevention

> Educational campuses

> Banking

> Urban surveillance

> Public arenas

> Residential

> Gaming

> Public safety

Video surveillance use cases

System classifications

Observation Lower resolution

High refresh rates

Forensic review Excellent coverage

HDTV great for evidence

Recognition High pixels

High bandwidth

> If the system is primarily used for observation or surveillance, design emphasis is placed on the viewing refresh rate

> Minimizing the control latency (both camera control delay and switching delay) is extremely important and one benefit that an analog system offers

> It is challenging for a surveillance operator to follow a subject using a PTZ camera on a network-based video system that was not designed with a fast control response in mind

Analog systems overview

> Video over IP is best defined as the deployment of video information over a network that conforms to the OSI layer model. This includes support of cameras and encoders transmitting using various protocols including TCP/IP, UDP and FTP. Devices that “stream” video over IP Networks transmit frames and packets of video data to a single location or multiple locations for different purposes.

IP systems overview

> Lower total cost of ownership for life cycle of the system

> IP video system devices often require less maintenance and system downtime

> IP video is deployed and expanded future devices are connected to the nearest network access location

> Live or recorded video viewed anywhere at anytime, permitting a better use of the video system investment

Benefits of IP video

> Open” infrastructure permits integration of devices from different manufacturers

> Higher-end imaging like Megapixel & Progressive Scan are available

> Direct Attached Storage and Storage Area Networks are easily scalable and provide future growth

Benefits of IP video

Camera system technologies

> When you consider camera technology, functionality, and use, there are several major classifications;

– Fixed

– Fixed-zoom

– Pan-tilt-zoom(PTZ)

– Unitized dome

– Board cameras and miniature cameras

Cameras

> Today’s analog cameras are actually fully digital inside as they contain a DSP (digital signal processor) that allows for various image processing technologies to be applied

> Mature technology with broad product portfolio

> Challenges: – Interlaced sensors

– A/D conversion

– TCO includes encoding

Analog cameras

> Fully digital solution from image capture to storage

> Offers higher resolution with HDTV options and progressive scan sensors for surveillance professionals

> Takes advantage of mature network standards that are proven across all markets

> Embedded processing for intelligence at the edge

> Challenges: – Disruptive technology

– Understanding TCO

IP cameras

Verify your camera has the following features > Wide Dynamic range

> C/CS lens mount options

> Day / Night capability if required

> CCD or CMOS

> SMPTE compliant HDTV

> 802.3af POE

> Capacity for onboard storage and/or analytics

Camera feature set

> Converts video from analog cameras into multiple video streams that may be accepted by the Network Video Recorder or Control Command Center

> Encoders support one or a number of types of PTZ camera control protocols that are multiplexed over the coaxial cable or connected via serial

IP video encoders

> Three encoding techniques – MJPEG

– MPEG-4

– H.264

> Situational use of all three defined by the application deployed or compliance doctrines.

> H.264 rapidly becoming standard of choice due to storage and bandwidth savings

> Compression levels often overlooked

Encoding technology overview

100 Mb/s @ 0

40 Mb/s @ 20

M-JPEG

33 Mb/s @ 40

25 Mb/s @ 60

18 Mb/s @ 80

10 Mb/s @ 100

H.264

20 Mb/s @ 0

5 Mb/s @ 20

2,5 Mb/s @ 40

1,6 Mb/s @ 60

1,1 Mb/s @ 80

0,7 Mb/s @ 100

Inter-frame video codec – H.264

GOV-Lenght

> Have the capability of viewing near-IR light, usually in the range of 850 ~ 880 nm

> Incandescent-based IR lights present danger due to the heat and infrared radiation

> LED based illuminators do not have this problem

> Auto and manual color-to-black & white capability

Day/Night capability

> Capture heat or temperature values of a scene and not light

> These cameras are especially useful in viewing dark scenes for activities that have heat signatures

> This type of camera can be used to supplement visual and physical perimeter facility patrols

Thermal cameras

> Photography vs. Surveillance cameras – Megapixel

> Significant factor for image quality rendered

> Advances in lens technology: – P-Iris

– Megapixel resolutions

– Remote focus vs. remote back focus

– Remote zoom

Lenses

> Lighting requirements depend on: – Sensitivity of the imager, lux

– Functional use of the video surveillance system

– Color temperature of existing lighting

> Requires image processing in camera that includes: – White balance

– Gain

– Shutter speed

> Challenges: – No industry standard for defining sensitivity

Lighting

> White vs. infrared light

> Depends on the needs of the scene

> Infrared Illumination is an excellent tool to add directional and flood lighting to key areas

> Challenges: – Matching camera specification to scene

Supplemental illumination

> Imager vs. pixel size

> The smaller the pixel the more light is needed to activate an individual pixel element.

> Imagers improve dramatically year over year

> Challenges: – Lens technology cannot keep up with sensor

improvements

– CCD vs. CMOS

Pixels, imager sizes and sensitivity

> Consumer electronics advances benefit the other industries

> HDTV has positively impacted the video surveillance industry and therefore guarantees the expectation of video quality, frame rate and color fidelity

> Provides a convenient and economical solution for observation, forensic review and recognition

HDTV

> HDTV provides up to five times higher resolution than standard analog TV

> The two most important HDTV standards today are SMPTE 296M and SMPTE 274M, which are defined by the Society of Motion Picture and Television Engineers, SMPTE

> HDTV broadcast systems are identified with four major parameters:

– Frame size in pixels

– Frame rate

– Color Fidelity

– Aspect Ratio 16:9

HDTV, continued

> Higher the resolution the more storage and bandwidth is required

> Marketing terminology vs. SMPTE compliance – Hi-Def imagery

– HD cameras

Challenges with HDTV

Recording Options

> Digital Video Recorders (DVR)

> Network Video Recorders (NVR)

> Video Management Systems

Recording systems

> Typically associated with hybrid or analog installations

> PC platform but considered “proprietary” by IT professionals

> Most are networked but not all accept IP camera video streams.

> Challenges: – Defined channel density

– IT compliance testing

– “Forklift” upgrade

Digital video recorders

> Typically associated with “IP” systems

> PC based systems that are application specific – Transportation

– Law enforcement

– Military

Network video recorders

> Associated with IP systems

> PC platform independent due to industry standards

> Camera independent, truly open platform

> Challenges: – VMS feature creep

– Not a “Boxed” solution

– Requires integration

Video management systems

> Cloud Computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction

– This definition is from the latest draft of the NIST Working Definition of Cloud Computing published by the U.S. Government's National Institute of Standards and Technology.)

Cloud computing

> Private, Enterprise, and Public Cloud

> There are significant benefits for deploying these solutions:

– No Software upgrades or Anti-virus software required for duration of service

– Mobile and Remote devices like Blackberry, Android, iPhones, iPads and Laptops are supported directly from internet site: you still get alarms, real time and recorded video even if local storage is damaged

– Reduced installation time

– Works with existing infrastructure

Cloud computing

> Public Cloud – Characterized as being available to clients from a third

party service provider via the Internet

> Private Cloud – Same features as above but managed within the

organization

> Community Cloud – A community cloud is controlled and used by a group of

organizations that have shared interests

> Hybrid Cloud – A combination of a public and private clouds that

interoperate

Cloud definitions

Video Intelligence

Industry transformation

CCTV Today: inefficient, expensive

Smart Video: Real-Time, Relevant = high value

The challenge

> Video surveillance is a booming business, and installations become larger and larger

> Studies from Sandia N. Lab, US, concluded that personnel can only watch one monitor for 20 minutes before losing focus

> So why do we expect a high attention span for hours on multiple monitors?

> And how do we turn video surveillance from a reactive tool to a pro-active instrument?

The solution – Intelligent Video

> “Intelligent video is a collection of technical solutions that makes it possible for systems and people to efficiently cope with large amount of video data.”

Some capabilities of Intelligent Video

> Automatically analyzes and tags surveillance video in real-time

> Detects suspicious activities

> Initiates video recording, alarms or other actions

> Alerts operators or field personnel

Main benefits of Intelligent Video

> Available 24/7/365 – Relieves burden from operators

– Information when you need it

– Minimizes human errors

> Creates new business possibilities – Store optimization in retail, cue management in

transportation, etc.

> Enables users to be proactive – Preventing crime rather than reacting after the fact

> Lowers the total cost – More efficient use of staff

– Reduced network load and storage needs

– Faster return-on-investment

Example – Video Motion Detection

> Why record hours of video where nothing happens?

> With Intelligent Video, the system will only record when there’s motion in the scenery

Example – Active Tampering Alarm

> If somebody has redirected or painted your camera, how will you know?

> With Intelligent Video, the system will tell you

Example – Auto-tracking

> How do you ensure enough image detail of activities even when monitoring large areas?

> With Intelligent Video, the camera will automatically zoom in and follow moving persons or vehicles

Example – People counting

> Want to know the number of visitors to your store?

> With Intelligent Video, the camera can do the counting for you

Example – Real estate protection

> How can you know when someone is approaching?

> With Intelligent Video, a “digital fence” can be set up that sends an alert when security is breached

> These are specialized cameras that are specifically designed to capture license plate information, for processing by a License Plate Recognition (LPR) system

> LPC represents an excellent opportunity to perform access control and visitor tracking in a passive manner

Example: License plate capture

> Detects, classifies, and tracks multiple objects simultaneously

– Not affected by changes in illumination, or weather

> Detects Events – Motion: move in wrong direction, enter/exit,

running, loitering

– People interaction: people merge, people talked

– Traffic rules: illegal parking, illegal U-turn, pulled off road

– Object interaction: object left unattended, object removed

– Video events: video lost/restored, camera blocked, etc.

> User Assigned Alarm Levels – Sort alarms/events by significance

– Raise real-time alarms

> Fast Search and Retrieval – By object, by event, by camera, by

date and/or time

> Remote Accessibility – Configuring, monitoring, forensics

Video analytics core functionality

FENCE CLIMBING SETUP EARLY WARNING RESTRICTED ZONE SETUP

DIRECTIONAL TRESPASS LINE SETUP

> Add multiple protective elements in each scene

> Set severity levels to alarm or just to store in the database

> CAMERA VIEWS and RULES can be set up on site or remotely

How it works

CLASSIFIED INTERIOR RESTRICTED ZONE

Will detect a person or vehicle entering inside the fence line, and ignore animals,

rain, snow, birds, etc.

EARLY WARNING ON COUNTY ROAD

Will detect the presence of a loitering or stopped vehicle, based on rules

selected

Multi-zone camera setup

> Entering / exiting a restricted zone

> Loitering – People or Objects

> Trespassing – Crossing a virtual “trip wire”

> A person climbing a fence

> Objects merged – Meeting an accomplice

> Traveling in the wrong direction (vehicles or people)

> Illegal U-turns

> Failure to stop

> Objects split

> Object started/stopped moving

> Person began running

Video analytics

Detects, classifies, tracks, logs, and alarms on events or behaviors that you specify

System Design

> Plan the solution

> Select camera types and imaging requirements

> Determine initial system selection type

> Calculate bandwidth and storage values

> Develop bandwidth/network routing maps

> Verify infrastructure compatibility

> Apply topology requirements

> Encourage “convergence”

> Make resolution adjustments

> Verify recording, control and management system design

Video surveillance design

> Check common network usage scenarios

> Develop a comprehensive performance specification for a video-based surveillance system

> Publish a network video commissioning statement

> Pre-project diagram development

> Develop master bill of material

> Project diagram development

> Project management

> Testing

> Acceptance test based on specified expectation of video surveillance system performance

> Framework for continuous performance verification

Video surveillance design

> The Video surveillance designer should consider the life cycle of the solution and always keep track of technology refreshes available and their possible savings

> When to and how to upgrade can have great impact on the design process

Upgrades

> The path to an IP video upgrade leads to great benefits and can work over virtually any infrastructure with the appropriate media converters

> Should the upgrade include Interoperate, Integrate or Interface to various systems

> Should the user postpone interoperability, and what are the ramifications

> Should the running of concurrent systems be a consideration

> Is Quality of Service and Fault Tolerance improved with the upgrade

> Logical and Network Security Issues for the Integration upgrade

Upgrade considerations

> Both financial and operations efficiencies can be realized through legacy system upgrade and a technology refresh. Keep what works and enhance/replace with solutions and devices that contribute directly as relevant tools for the end user.

Legacy systems

> There is always a continuing, controversial discussion about whether technology should be used to replace or enhance the security guard force, and how can video surveillance can specifically be used

> There are multiple, global case studies showing that manned security has been significantly enhanced and in some cases replaced with video-based technology

> Will the balance of manpower and technology change in the next ten years?

Manpower and video surveillance

Video surveillance continues to be a sensitive issue in many workplaces

> Use video surveillance only when justified by a legitimate business purpose

> Limit video surveillance to the least intrusive time, place, and method

> Use only visible cameras

> Obtain written employee consent to video surveillance for legitimate business purposes.

> Do not use video surveillance in areas where employees have a reasonable expectation of privacy

Privacy and legal

> Do not use video surveillance devices that capture or record sound without complying with federal and state wiretap laws

> If the workplace is unionized, comply with any provisions in the collective bargaining agreement concerning video surveillance

> Do not use video surveillance in connection with union activities

> Do not select employees for video surveillance in a manner that might be considered discriminatory

> Do not select employees for video surveillance in retaliation for exercising rights under any law

Privacy and legal, continued

> Determine whether the company is subject to a state or local law dealing with video surveillance and comply with that law

> Train supervisors in the legal issues involved in video surveillance

> Treat information obtained through video surveillance as confidential, and limit access

> Adopt procedural safeguards to avoid unintended or improper use of work-related video recordings

Privacy and legal, continued

> It’s always fun to imagine what will be useful to users of video surveillance systems in the future

– One possibility might be in the way cameras communicate with each other. Cameras that not only become intelligent by way of small programs or specialized algorithms written for them will, when multiplied, become an intelligent "Security Net" or "Intelligent Hive" that can communicate in a peer to peer manner, analyzing and tracking potential threats, dynamically reallocating collective computing power and learning from the results. The collective "intelligence" of years of metadata and event results will work for the end user and be pro-active in providing the most appropriate response to a given situation.

– The use of the cloud to support all of these efforts is evolutionary, not revolutionary

The future

Thank you! network video

innovation

glob

al

HD

TV

partn

er n

etw

ork

leader

camera

protect outdoor

image usability

leader

safe

ther

mal

easy installation

inte

llige

nt

open

integration ease of use

competence

megapixel

environment

worldwide

H.264

focus

Axis

video encoder

conv

erge

nce

Get the Axis picture. Stay one step ahead.