acti camera technology blueprint confidential. agenda camera block diagram video processing...

26
ACTi camera technology blueprint Confidential

Upload: blaze-thornton

Post on 16-Dec-2015

221 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

ACTi camera technology blueprint

Confidential

Page 2: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

Agenda

•Camera block diagram

•Video processing conditions

•Sensor overview

•Sensor + Camera ISP overview

•Codec overview

•ACTi 1.3MP Product matrix

•ACTi multi-megapixel Product matrix

Page 3: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

NVRIP Cam

IP surveillance System overview

CaptureVideo Encoding

Streaming

Decoding Display VideoRecording

Page 4: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

Camera block diagram

SensorSensor

CameraISP

CameraISP

CodecCodec

Sensor: An image is formed on the sensor, and digital video data is sent to the Camera ISPCamera ISP: Video processing functions such as BLC, AGC etc.Video enhancer: Further additional video processing such as WDR, DNR, skin tone enhancement, 3D de-interlacingCodec: Compress the video data into smaller file format and send to the network

Videoenhancer

Page 5: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

Sensor overview

Resolutioncategory

Pixel count Applied product

VGA / D1 640 * 480 Box, Dome, Zoom, PTZ

1.3MP 1280 * 1024 Box, Dome, zoom, PTZ

2.0MP 1920 * 1080 Box, Dome, Zoom, PTZ

3.0MP 2048 * 1536 Box, Dome, Zoom, PTZ

5.0MP 2592 * 1944 Box, Dome, Cylindrical

10.0 MP 3856 * 2764 Panorama

• ACTi multi megapixel trend 2 ~ 10MP• High megapixel camera applications

Page 6: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

Multi megapixel

10 Megapixel 3856 x 2764

2 Megapixel 1920 x 1080

3 Megapixel 2048 x 1536

Page 7: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

Camera ISP overview

Resolution

Frame rate

Day & Night

WDR / DNR

Optical zoom ratio

ePTZ Video crop

VGA / D1 30 fps Yes Yes 10, 18, 35x n/a n/a

1.3MP 30 fps Yes Yes 10, 18, 35x n/a n/a

2.0MP 30 fps Yes Yes 10, 18, 35x n/a Yes1 stream

3.0MP 22 fps Yes n/a 10, 18, 35x n/a Yes1 stream

5.0MP 12 fps n/a n/a Yes Yes4 streams

10.0 MP 6 fps n/a n/a Yes Yes4 streams

• 2.0 MP with full camera technologies • Support Special functions of high megapixel

cameras- ePTZ- video cropping

Page 8: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

Mechanical IR cut filter

IR illumination

Sense up Digital Slow Shutter

Existing technologies

Wide Dynamic Range

IRIS Control for CMOS

Digital Noise Reduction

3D De-interlacing

2009 New technologies

Video enhancement overview

Page 9: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

• Day & Night Solution– IR LED and Mechanical IR Cut Filter

See clearer in the dark

Page 10: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

• Wide Dynamic Range Processing

See clearer in strong background lighting

Page 11: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

• Digital Noise Reduction

Reduced noise speckles in low light conditions

Page 12: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

• Low Light Image Enhancement

7 Lux Color Mode

1 Lux B/W Mode

See clearer in dim background lighting

Page 13: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

Day: Without low light enhancement

Day: With low light enhancement

Night: Without low light enhancement

Night: With low light enhancement

Night: With low light enhancement & IR LED

• ACTi real camera demo

Page 14: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

• High megapixel - Wide FOV

Panorama/Cylindrical Application

CylindricalFOV: 170Deg

Video is digitally wrapped (flattened) on edges due to curvature effect from lens

Page 15: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

• Megapixel with zoom

Better clarity and detail when zooming in on objects

VGA zoom

Megapixel zoom

Page 16: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

• Video cropping with independent streaming

Video cropping is used for indoor application – shopping store => 1 camera replacing 4 camerasFor scenery that is close, it is effective. For scenery that is far, the object appears to be smaller and hence not so effective under cropping

Page 17: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

• Electronic PTZ

Beneficial with Wide FOV/High megapixel cameras:1.Do digital pan, tilt, zoom without moving mechanical parts

2. Wide FOV + ePTZ => A large field of view is constantly present, but for example when MD in one regions happens the view can auto ePTZ to the MD region, while the other camera view is still being monitored and recorded

Page 18: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

FAQ

• Why is optical zoom only available up to 3MP?

Ans: 3 A’s are the key to good video: Auto white balance, Auto focus & Auto exposure. All three A’s require frame to frame comparison for video algorithm to take place. Having 30fps for video image processing is a key factor.

When >3MP, the frame rate is reduced and therefore the amount of data required for video processing will not be enough, or time taken will be too long to achieve a good picture that meets the 3 A’s.

For higher megapixel cameras beyond 3MP, the pixel count is high enough so digital zoom is considered instead.

ACTi is not chasing a multi megapixel resolution only, rather ACTi is focusing to adopt full camera technologies in addition to just higher resolution.

Page 19: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

FAQ

• Why is Day & Night only available up to 3MP?Ans: Under such a large picture, the ability to do D&N correctly is a challenge. Focus shift, noise levels at night mode vary within the larger picture. Another reason is because peripheral components such as lens, IR cut filter etc will need to be able to support >3MP resolutions as well, and there is a technical barrier. Of course if these barriers at the peripheral components can be resolved, then ACTi will adopt D&N into >3MP cameras.

• Why is WDR/DNR only available up to 2MP?Ans: The main reason is because the video data beyond 2MP is too much for the ISP processing engine to handle calculations intended for WDR & DNR. Another reason is the reduced frame rates at >2MP means that the frame to frame comparison is not highly efficient.

• Why is ePTZ only available at 5/10MP?Ans: This is because the FOV is wide enough to allow significant space/movement for ePTZ.

• Why is video cropping with 4 streams only available at 5/10MP?Ans: This is because the overall picture size is large enough to allow significant use of video cropping at 4 different regions within this picture. If the picture size is small, then transmitting the entire picture rather than 4 separate pictures makes more sense.

Page 20: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

Codec overview

Compression Algorism

Compression Scheme

Resolution

Typical Bit-rate

D1 @ 15fps 1.3MP @ 15fps

H.264 BP Moving Picture HD / D1 / CIF 0.5 Mbps 2.0 Mbps

MPEG-4 Moving Picture SXGA / D1 / CIF 1.0 Mbps 4.0 Mbps

(M)JPEG Still ImageSXGA / XGA / D1 / CIF

5.0 Mbps 20 Mbps

H.264 compression schemes

Page 21: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

Codec structure: SoC vs. DSPStructure Performance Application

FlexibilityCost

DSP AVERAGE EXCELLENT FAIR

SoC EXCELLENT FAIR EXCELLENT

•SoC (System on Chip) has dedicated performance for IP camera applications - ACTi adoption - To achieve multi megapixel, the algorithms are highly complicated so a dedicated processor with full computing power is necessary

•DSP (Digital signal processor) are based for multi purpose applications, not necessarily for IP surveillance - H.264 baseline profile at most

•Key performance differentiators:-Maintaining good video quality under compression-Able to achieve high frame rates at high megapixel resolution-Network streaming with low latency and jitter-Overall firmware stability in varied working environments

Page 22: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

Codec & Camera ISP integration?

SensorSensor

CameraISP

CameraISP

CodecCodec

Videoenhancer

•The camera ISP is in charge of video processing, while Codec for video compression - They are doing completely different functions, putting them into one chip may limit overall performance and stability

•Each technology to be developed separately - Separate development will allow greater technology improvement in their specific fields - ACTi is following a separate development trend until both technologies are mature

Page 23: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

FAQ

• Why type of H.264 compression is ACTi using and why?Ans: ACTi is adopting baseline for initial product phase with VGA ~ 2.0MP, and will move to high profile (skip main profile) for second phase from 2.0MP ~ 10.0MP. High profile includes more intelligent encoding with added features, so it means that less information decoding (as compared to baseline) is required by the NVR system, hence less CPU resources are required by the NVR server.

• Can ACTi achieve multiple streaming?Ans: Yes, dual streaming can be achieved at all video resolutions. For example, it can be two H.264 streams, or one H.264 stream + one MJPEG stream.At 5/10MP cameras, up to 4 independent video streams can be outputted from 4 different regions within the picture.

Page 24: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

1.3Megapixel offering1.3 megapixel

H.264 / MPEG-4 / MJPEG

Box Bullet DomePTZ

Speed domeCube

Main stream High end Main stream High end Main stream High end High end Main stream

TCM-56xx TCM-5211TCM-5311

TCM-1511TCM-1231

TCM-1611TCM-2111

TCM-34xxTCM-35xxTCM-7411

TCM-3911TCM-7811

TCM-8600 seriesTCM-6900 series

TCM-4301

Triple codec Triple codec Triple codec Triple codec Triple codec Triple codec Triple codec Triple codec

Dual stream Dual stream Dual stream Dual stream Dual stream Dual stream Dual stream Dual stream

D&N D&N D&N D&N D&N D&N D&N  MIR MIR MIR MIR MIR MIR MIR      IR LED IR LED IR LED IR LED IR LED          Vandal proof Vandal proof        IP66 IP66 IP66 IP66    

DIO DIO DIO DIO DIO DIO DIO DIO

PoE PoE PoE PoE PoE PoE PoE PoE

      2.7x, 10x, 18x, options      2.7x, 10x, 18x,

35x options 

  DC Iris   DC Iris   DC Iris DC Iris    WDR   WDR   WDR WDR    DNR   DNR   DNR DNR  

Page 25: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

2MP / 3MP / 5MP / 10MP

H.264/MPEG-4/MJPEG

Box Zoom lens DomePTZ

Speed dome

Cube/Cylindrical camera

(FOV 170Deg)

360 Deg Panaroma

camera(FOV 360Deg)

2MP ~ 5MP 2MP ~ 3MP 2MP ~ 5MP 2MP ~ 3MP 2MP ~ 10MP 10MP only

D&N D&N D&N D&N    

  10x, 18x, 35x zoom

  10x, 18x, 35x zoom

   

        ePTZ ePTZ

Video crop with streaming

(1 stream output)

Video crop with streaming

(1 stream output)

Video crop with streaming

(1 stream output)

Video crop with streaming

(1 stream output)

Video crop with streaming

(4 stream output)

Video crop with streaming

(4 stream output)

WDR/DNR(2MP only)

WDR/DNR(2MP only)

WDR/DNR(2MP only)

WDR/DNR(2MP only)

   

Multiple streaming

Multiple streaming

Multiple streaming

Multiple streaming

Multiple streaming

Multiple streaming

IR LED IR LED IR LED IR LED        Vandal proof Vandal proof   Vandal proof

    IP 66 IP 66   IP 66

DIO DIO DIO DIO DIO DIO

PoE PoE PoE   PoE PoE

Multi-Megapixel offering

Page 26: ACTi camera technology blueprint Confidential. Agenda Camera block diagram Video processing conditions Sensor overview Sensor + Camera ISP overview Codec

End to end integration

• Long term commitment to focused technologies related to IP surveillance• Streamline advanced camera technologies to our high stability NVR

=> Total end to end solution leading to mutual business profit !