audio video coding standard (avs) – technology and opportunitywkcham/iee04605yulu.pdf · short...

1

Audio Video coding Standard (AVS) – Technology and Opportunity

Prof. YU, Lu (虞露)

Zhejiang UniversityInstitute of Information and Communication Engineering

[email protected]

June 5. 2004

IEE HK Workshop June 5, 2004 2

OutlineWhytarget and purpose of AVS

Howwork style of AVS experts group

Whattechnical characteristics of AVS-video

FutureAVS-M


Why


Digital television system

Customer site Customer site AA

HPA

Customer site Customer site BB

Harmonic

Enterprise 1

HPA

Customer site Customer site CC

satellite

cable

Channel coding

subscriber

Capture、editing、storage、coding

Terrestrial

Front end


Technical standards in digital television systems

Channel coding technical standardTerrestrial（Tsinghua Univ. And Shanghai Jiaotong Univ.）Cable（Zhejiang Univ.）Satellite

Source coding technical standard (AVS)System (data and command)VideoAudio

Subscriber management and copyright management standardManagement of paymentEncryption and decryption


Applications require digital audio video coding standard

Core technology of:

Digital Television

Storage Media (DVD, HD-DVD)

Broadband Network Multimedia Applications (Video Conferencing, Video on Demand)

New Generation of Mobile Communication

Surveillance system


Vertical & Horizontal StandardsVertical

Digital television broadcasting (DVB, ATSC)Streaming (ISMA)Visual disk (DVD forum)Multimedia service (MMS) and I-mode (JP)

HorizontalDigital audio-visual coding standard (MPEG, H26x, AVS)

AVSAVS

DTVDTVStorage MediaStorage Media StreamingStreaming Mobile multimediaMobile multimedia

SystemSystem SystemSystemTCP/IPTCP/IP

SystemSystem

Source codingSource coding

SystemSystemWirelessWireless

Source codingSource coding Source codingSource coding Source codingSource coding

S/T/C DTVS/T/C DTVStorage MediaStorage Media


MPEG — domination standard of AV coding

VCD: MPEG-1 (ISO/IEC 11172)MP3

DVD: MPEG-2 MP@ ML (ISO/IEC 13818)

SDTV: MPEG-2 MP@ ML (ISO/IEC 13818)

HDTV: MPEG-2 MP@ HL (ISO/IEC 13818)

Multimedia applications: MPEG-4 (ISO/IEC 14496)

MPEG-4 AVC / H.264

Multimedia search engine: MPEG-7 (ISO/IEC 15938)

Multimedia framework: MPEG-21 (ISO/IEC 18034)


No free lunchVCD: MPEG-1 (ISO/IEC 11172) Loyalty free

MP3

DVD: MPEG-2 MP@ ML (ISO/IEC 13818) Patent License

SDTV: MPEG-2 MP@ ML (ISO/IEC 13818) Patent License

HDTV: MPEG-2 MP@ HL (ISO/IEC 13818) Patent License

Multimedia applications: MPEG-4 (ISO/IEC 14496)Patent License

MPEG-4 part 10 /MPEG-4 AVC / H.264 Patent License

Multimedia search engine: MPEG-7 (ISO/IEC 15938) NA

Multimedia framework: MPEG-21 (ISO/IEC 18034) NA


MPEG and it’s Patent PoolsMPEG (Motion Picture Expert Group)

Technical experts group of ISO/IEC JTC1 / SC29 / WG11

MPEG LA (www.mpegla.com)an independent licensing administrator companyone-stop technology standards licensing with a portfolio of essential patents in the standard

Via Licensing (www.vialicensing.com)an independent subsidiary of Dolby Laboratoriesprovides patent licensing services for third-party intellectual-property owners


Licensing terms of MPEG-2 (MPEG LA)

For MPEG-2 encoding products in hardware or software$2.50 from January 1, 2002

MPEG-2 decoding products in hardware or software set-top boxes, DVD players and computers equipped with MPEG-2 decode units $2.50 from January 1, 2002

Consumer Products camcorders, read/write DVD players, computers and/or software$2.50 from January 1, 2002

MPEG-2 Transport or Program stream products file servers, multiplexers, demultiplexers$4.00 x the greater of the input or output transport or program streams

MPEG-2 distribution encoding products real time terrestrial, cable, satellite etc. broadcast and/or distribution$2.50 from January 1, 2002 x the number of channels in parallel

MPEG-2 Packaged Media $0.03 from March 1, 2003 for the first MPEG-2 Video Event (up to and including 133 minutes )plus $0.01 for each additional 30 minutes


Main patent holders of MPEG Company name country No.

SONY JP 130

THOMSON LICENSING S.A. USA 99

PHILIPS NL 88

GE TECHNOLOGY DEVELOPMENT, INC. USA 56

MITSUBISHI JP 50

MATSUSHITA JP 36

VICTOR COMPANY OF JAPAN, LIMITED (JVC) JP 32

GENERAL INSTRUMENT CORPORATION USA 21

SAMSUNG ELECTRONICS CO., LTD. KR 14

SCIENTIFIC ATLANTA USA 13

Updated in 1 July, 2003Updated in 1 July, 2003

From Prof. From Prof. GaoGao


Licensing terms of AVC(Via Licesing)

Apr. 2004Who must sign a License⌧Manufacturers of end-user products⌧replicators (for physical media) and companies conducting transactions

(for non-physical distribution) of Content subject to the Replication Fees

Encoder/ decoder⌧US$0.25 per Licensed Product⌧US$0.0025 per Temporary Decoder (expire after not more than 20

decodes & not more than 30 days)Encoder/Decoder Royalty Cap ⌧US$2.5 Million per year per enterprise for sale of all products

Replication Fees ⌧permanent basis

• Length of Title Rate• 90 Minutes or more $ 0.02531• Minutes to 89 Minutes $ 0.01530 • Minutes or less $ 0.005

⌧Temporary basis• $ 0.0025 per Title Replicated/Sold


Licensing terms of AVC(Via Licesing)

Initial feeUS$15,000 Free of initial fee for Enterprises with revenues of less than US$2 Million per year Free of initial fee for Enterprises with up to 50,000 end user products, and generate less than $500,000 in revenue

The companies who have participated in the development of the terms are:

Apple Computer Dolby Laboratories FastVDO Fraunhofer-Gesellschaft eV IBM LSI Logic Microsoft Motorola Polycom RealNetworks


Loyalties per year US$ 100 million per year

DVD production of a year in China is more than 30 million

set-top-box production of a year in China is no less then 10 million

MPEG — A golden key not in our hands


Technical reason –necessity & possibility

MPEG-2 (1992)More than 10-years oldCompression efficiency⌧4.7GB DVD – 2 hours movie (5.3Mbps)⌧18GB – 2 hours high definition movie (20Mbps)

MPEG-4 AVC / H.264 (2001-2002)Advanced coding techniques⌧Multiple –reference frame inter-frame prediction⌧Content-based adaptive binary arithmetic coding⌧…

High compression efficiency ⌧1.5~2Mbps for SD, 6-8Mbps for HD)⌧Save of storage space, save of channel bandwidth, save of

frequency spectrum resource


Short history of AVSMar18-21. 2002

178th Xiangshan Science Conference, Beijing, “Broad-band Network and Security Stream Media Technology”

June 11, 2002Science and Technology Department of MII released a bulletin about setting up “Audio Video Coding Standard Workgroup” on China Electronics News

June 21, 2002“Audio Video Coding Standard Working Group” was set up in Beijing.

Aug 23-24, 2002first meeting of AVS, AVS united with MPEG-China. Website of AVS opened to the members formally.

Dec 9, 2002Department of Science and Technology of Ministry of Information Industry issued the notice of Setting up “Audio Video Coding Standard Working Group” and assigned the task of the group

Dec 19, 2003On the 7th AVS meeting, AVS-video (1.0) and AVS-system (1.0) was finalized.


Authorization document


AVS members (May 2004)

1. LG电子（中国）研究开发中心有限公司2. LSI Logic Corporation3. TCL集团股份有限公司4. UT斯达康（中国）有限公司5. WIS Technologies, Inc6. 安凯（广州）软件技术有限公司

7. 北京长信嘉信息技术有限公司

8. 北京阜国数字技术有限公司

9. 北京工业大学

10. 北京广播学院

11. 北京海尔集成电路设计有限公司

12. 北京航空航天大学

13. 北京三星通信技术研究有限公司

14. 北京时代互动传媒技术有限公司

15. 北京世纪豪杰计算机技术有限公司

16. 北京算通科技发展有限公司

17. 北京拓普凌科科技有限责任公司

18. 北京影立驰技术有限公司

19. 北京永新同方信息工程有限公司

20. 北京邮电大学

21. 北京中星微电子有限公司

22. 成都东银信息技术公司

23. 成都威斯达芯片公司

24. 德国弗劳恩霍夫协会北京代表处

25. 德加拉（成都）数码科技发展有限公司

26. 德州仪器半导体技术（上海）有限公司

27. 杜比实验室北京代表处

28. 法国电信北京代表处

29. 飞利浦东亚研究室

30. 福建星网锐捷通讯有限公司

31. 广州金鹏集团有限公司

32. 桂林羽田集成电路设计公司

33. 哈尔滨工业大学

34. 海信集团有限公司

35. 杭州海康威视数字技术有限公司

36. 杭州英卓网络科技有限公司

37. 湖南创智数码科技股份有限公司

38. 华为技术有限公司

39. 华中科技大学

40. 环旭电子（上海）有限公司

41. 科胜讯宽带通讯有限公司

42. 联想集团有限公司

43. 美国On2技术公司44. 摩托罗拉中国电子有限公司

45. 南京邮电学院

46. 诺基亚（中国）投资有限公司


AVS members (May 2004)

70. 武汉武大方略数码科技有限公司

71. 厦门华侨电子股份有限公司

72. 厦门夏新电子股份有限公司

73.73. 香港科技大学香港科技大学

74.74. 香港应用科技研究院有限公司香港应用科技研究院有限公司((ASTRI)ASTRI)75.75. 香港中文大学香港中文大学

76. 新加坡资信通信研究所

77. 信息产业部电子第五研究所

78. 亿世电子科技（深圳）有限公司

79. 英特维数码科技（深圳）有限公司

80. 浙江大华信息技术股份有限公司

81.81. 浙江大学浙江大学

82. 浙江华鼎数码科技有限公司

83. 浙江南望图像信息产业有限公司

84. 中国电子技术标准化研究所

85. 中国科学技术大学

86. 中国科学院计算技术研究所

87. 中国科学院声学研究所

88. 中国科学院研究生院

89. 中国科学院自动化研究所

90. 中国泰尔实验室

91. 中山大学

47. 普诚科技（深圳）有限公司

48. 清华大学

49. 泉州恒通电脑有限公司

50. 瑞尔公司

51. 上海大学

52. 上海高清技术创新中心

53. 上海广电（集团）有限公司

54. 上海奇码数字信息有限公司

55. 深圳国微电子股份有限公司

56. 深圳兰光电子集团有限公司

57. 深圳清华大学研究院

58. 深圳清华同方股份有限公司

59. 深圳市中兴通讯股份有限公司

60. 世宏科技（苏州）有限公司

61. 世意法（北京）半导体研发有限责任公司

62. 松下电器研究开发（中国）有限公司

63. 索尼（中国）有限公司

64. 腾讯科技（深圳）有限公司

65. 天津大学

66. 天津通广三星电子有限公司

67. 微软亚洲研究院

68. 武汉大学

69. 武汉精伦电子股份有限公司


How


National standard advanced and practical technologies low-licensing-cost (conceptual loyalty fee 1.0 ￥)

Strategy Based on international mainstream technologiesBased on AVS member institutions’ own technologiesIP management with one-stop patent pool

MaximSuperiorityPracticalityCompatibilityIndependence


Subgroups in AVS

Requirement and testSystemVideoAudioImplementationDigital Rights ManagementIntellectual Property Rights


Time table


AVS working styleRequirement Call for proposal & common test conditionTechnical proposal with technical explanation and experiment result (under common test condition)Review and cross checkAdopt or not

256 technical proposals in all 8 meetings

Four full meetings per year, with some additional group meetings1. 2002年8月23-24日，北京，黄铁军

2. 2002年10月23-24日，上海，曾勇勤

3. 2002年12月19-20日，北京，杨士强

4. 2003年3月27-28日，武汉，朱光喜，周敬利

5. 2003年7月28-29日，北京，李波

6. 2003年10月9-10日，杭州，虞露

7. 2003年12月18-19日，北京，黄铁军

8. 2004年3月30-31日，深圳，熊联欢

9. 2004年6月18-20日，北京，黄铁军


What


MPEG-2 Video

IQ/IT

Motion compensation

Control Data

Coeff.

Inter/Intra

Decoder

-

0

Control

Trans./Quant

Entropy Coding

MV

Motionestimation


IQ/IT

Motion compensation

Control Data

Coeff.

Inter/Intra

Decoder

-

Deblock

Intra-frame

Prediction

AVS video version 1 (AVS-HD)Control

Trans./Quant

Entropy Coding

MV

Motionestimation


AVS video toolsAccept 42 technical proposals from more than 200.

Major tools Transform – 16bit-implemented 8x8 integer transformQuantization and scaling - scaling only in encoderMotion compensation – 16x16/16x8/8x16/8x8 modesQuarter-pel interpolation – 4-taps interpolation filterIntra prediction – 5 modesDeblockingEntropy coding

Minor toolsMotion vector predictionSkipped mode and Coded block patternAlternative scanWeighted prediction4:2:2


Profile and Level

1 Profile (JiZhun Profile) 基准4 level⌧4.0 : up to Standard Definition with 4:2:0⌧4.2 : up to Standard Definition with 4:2:2⌧6.0 : up to High Definition with 4:2:0⌧6.2 : up to High Definition with 4:2:2


Video document editing

Editing meeting

2003.8.25-30 北京凤山蟒山温泉旅游渡假村

2003.11.7-9 河北香河天下第一城

AVS reference software

ICT, Tsinghua, ZJU


Performance- HD (1280 x720)

Harbour

29

31

33

35

37

39

41

1000 6000 11000 16000 21000 26000 31000 36000

Bitrate(kbits/s)

PSNR(dB)

H.264 Main

H.264 Baseline

AVS

MPEG-4

MPEG-2


Performance- HD (1280 x720)

Flamingo

26

28

30

32

34

36

38

40

10000 40000 70000 100000 130000

Bitrate(kbits/s)

PSNR(dB)

H.264 Main

AVS

MPEG2


Next step?


AVS-MStage 1

Dec. 2004Local decoding with non-real-time transmissionLow resolution (up to VGA), low complexityCompression performance and complexity of decoder

Stage 2Apr. 2006Bi-direction communicationLow latencyError resilience toolsCompression performance and complexity of both encoder and decoder


ConclusionAdvantages of AVS

Based on self-owned Intellectual Property⌧Lower loyalty fee (1.0 ￥)

Advanced compression efficiency⌧Similar performance with H.264⌧2 times to MPEG-2

Well-defined applications⌧Simplify and clear

Chances300-500 million Chips and end-user productsEarly join, early benefit from

Website: www.avs.org.cn


Thank you!

audio video coding standard (avs) – technology and opportunitywkcham/iee04605yulu.pdf · short...

Documents