international organisation for … · web viewthe list of input documents is given in annex 3....

INTERNATIONAL ORGANISATION FOR STANDARDISATIONORGANISATION INTERNATIONALE DE NORMALISATION

ISO/IEC JTC 1/SC 29/WG 11CODING OF MOVING PICTURES AND AUDIO

ISO/IEC JTC 1/SC 29/WG 11 N3459June 2000

Source: Leonardo Chiariglione – ConvenorTitle: Report of 53rd WG 11 meetingStatus:

1 OpeningThe 52nd WG11 meeting was held inBeijing, CN on 00/07/17-21 at the kind invitation of the Chinese National Body.

2 Roll call of participantsThe attendance list is given in annex 1.

3 Approval of agendaThe approved agenda is given in annex 2.

4 Allocation of contributionsThe list of input documents is given in annex 3.

5 Communications from ConvenorThere were no communications.

6 Report of previous meetingThe report of the previous meeting could not be approved because its drafting had not been completed.

7 Processing of NB Position PapersPapers from the National Bodies of CH, CN, FI, FR, JP, KR, NL, US were considered and responses drafted.

8 MPEG Phase 2

8.1 StandardNo work was done

8.2 AmendmentsThe following documents were approved

1

Text of ISO/IEC 13818-6 FPDAM 3 N3558Request for Amendment 1 on 13818-1:2000 N3559

8.3 CorrigendaText of ISO/IEC 13818-1:2000/DCOR 1 N3560

8.4 WorkplanThis was approved

9 MPEG Phase 4

9.1 Version 1No work was done

9.2 Version 2The following documents were approvedRequest for amendment 1 to ISO/IEC 14496-4 N3504Text of 14496-4/FPDAM 1 N3506

9.3 Version 3The following documents were approvedISO/IEC 14496-2 Studio Profile Amendment FPDAM 3 N3516Request for ISO/IEC 14496-4/Amd 2 N3570WD 2.0 of ISO/IEC 14496-4/Amd 2 N3571

9.4 Version 4The following document was approvedText of ISO/IEC 14496-2/FPDAM4 N3518

9.5 CorrigendaThe following documents were approvedWD of ISO/IEC 14496-1/COR2 N3563Text of ISO/IEC 14496-2/DCOR2 N3512Text of ISO/IEC 14496-5/DCOR1 N3509


10 MPEG Phase 7

10.1 Working DraftsThe following documents were approvedWD of 15938-1 (Systems) N3576WD of 15938-2 (Description Definition Language) N3575WD of 15938-3 (Visual) N3522WD of 15938-4 (Audio) N3489WD of 15938-5(Multimedia Description Schemes) N3465WD of 15938-6 (Reference SW) N3614


11 MPEG phase 21

11.1 Requirements

2

Work continued with a view to develop the Technical Report

11.2 Technical ReportThis was approved as MPEG-21 Proposed Draft Technical Report N3500


12 Overall WG11 workplan This was approved

13 Explorations The work on “Problem Definition for open access to content” produced a Call for Proposals in

the framework of MPEG-4 Systems The work on “Study on standard Digital Watermarking technology” was merged with the

ongoing MPEG-21 work The work on “Multi-user applications” produced a Call for Proposals in the framework of

MPEG-4 Systems The work on “MPEG-4 Content on MPEG-2 Systems and IP Network”was continued in an ad

hoc group The work on “Digital Cinema Requirements” produced a Call for content and a draft Call for

Proposals and was continued in an ad hoc group The work on “Evidence on new Video coding” produced a draft Call for Proposals New work on “Evidence on new Audio coding” produced a Call for Evidence

14 Liaison mattersInput documents were considered and responses provided.

15 Administrative matters

15.1 Schedule of future MPEG meetingsThe meeting schedule was approved.

15.2 Promotional activitiesThe planned MPEG-7 Awareness Event was suspended

16 16. Organisation of this meeting

16.1 Tasks for subgroupsTasks were assigned

16.2 Joint meetingsThe following joint meetings were heldGroup 1 Group 2 What Where WhenMDS ISG XM software MDS Tue 09:00-10:00MDS DDL, Audio, Video, ISG DDL Video Tue 10:00-12:00Requirem ISG Streaming video prof Req Tue 10:00-12:00Video ISG XM software Video Tue 12:00-13:00Systems Req, Audio Audio BIFS profile Systems Tue 14:00-15:00Systems Req Multiuser Systems Tue 15:00-16:00Audio ISG XM software Audio Tue 15:00-16:00

3

SNHC Systems 3DMC Systems Tue 16:00-17:00Systems ISG DDL implementation ISG Tue 16:00-17:00Requirem Systems MPEG-21 Systems Wed 11:00-12:00Requir MDS Miscellanea MDS Wed 11:30-15:00SNHC Req Animation Fram Req Thu 08:00-09:00Systems MDS Architecture Systems Thu 09:00-10:00Systems Video, Audio Test sets for binary Systems Thu 10:00-11:00Audio ISG, MDS XM integration Audio Thu 10:00-11:00SNHC Systems IM1 Systems Thu 11:00-11:30Requirem MDS MPEG-21 MDS Thu 11:00-12:00Video MDS Spatial temporal conn. Video Thu 14:00-14:30Systems Req MPEG-7 API Systems Thu 14:00-14:30ISG MDS Review of XM guidel. MDS Thu 15:00-16:00Audio ISG Schedule, guidel Audio Thu 16:00-17:00

17 Planning of future activitiesThe following ad hoc groups were established

No. Title3503 AHG on 3DMC conformance3498 AHG on Audio call for Evidence3496 AHG on Audio part of MPEG-4 Conformance3479 AHG on Audio, Video, MDS harmonization3581 AHG on binary and dynamic MPEG-7 data representation3551 AHG on Call for Proposals for IPMP Solutions3532 AHG on Call for Proposals for new tools to further improve video coding efficiency3480 AHG on Conceptual Modeling 3527 AHG on conformance in MPEG-4 video3530 AHG on core experiments for visual descriptors in MPEG-73550 AHG on Digital Cinema 3531 AHG on editing the document of the MPEG-7 Visual part of XM and WD3477 AHG on Editing the MDS XM & WD3501 AHG on FBA conformance3528 AHG on Fine Granularity Scalability in MPEG-4 video3585 AHG on IM13482 AHG on Metadata Integration3557 AHG on MPEG-21 Calls for Proposals3555 AHG on MPEG-21 PDTR Editing3554 AHG on MPEG-21 PDTR Study3556 AHG on MPEG-21 Use Case Scenarios3495 AHG on MPEG-4 Audio Reference Software 3497 AHG on MPEG-4 Audio second edition3583 AHG on MPEG-4 BIFS3582 AHG on MPEG-4 Conformance3586 AHG on MPEG-4 Content on MPEG-2 Systems and IP Network3584 AHG on MPEG-4 Textual Format3552 AHG on MPEG-7 Applications & Promotion to Industry3499 AHG on MPEG-7 Audio Core Experiments3580 AHG on MPEG-7 DDL

4

No. Title3588 AHG on MPEG-7 Intellectual Property Management & Protection (IPMP)3478 AHG on MPEG-7 MDS Core Experiments 3579 AHG on MPEG-7 Systems3587 AHG on multi-user applications3526 AHG on software integration and verification in MPEG-4 video3553 AHG on Study of MPEG-7 Mobile Applications3502 AHG on study of the generic animation framework3529 AHG on the Studio Profile in MPEG-4 video3525 AHG on the study of MPEG-2 Video elementary stream supplemental information3481 AHG on the TV-Anytime Application3511 AHG on XM Development

18 Resolutions of this meeting These were approved

19 A.O.BThere were no other businesses

20 ClosingThe meeting was closed at 22:50 on Friday 21 July.

5

Annex 1Attendance list

No. NAME COMPANY NB1. David Walsh Australian National University AU2. Ernest Wan CISRA AU3. Uma Srinivasan CSIRO AU4. Dr Jane Hunter DSTC Pty Ltd AU5. Mikael Bourges-Sevenier Ivast Inc. AU6. Lei Ye Motorola AU AU7. Mark Pickering The University of New South Wales AU8. King Ngi Ngan Univ. of Western AU AU9. Clement Leung Victoria university AU10. Rik Van de Walle Ghent University BE11. Jan Bormans IMEC BE12. Caterina Saraceno Starlab SA/NV BE13. Witold Reichhart Starlab SA/NV BE14. Jean-Pierre Evain EBU CH15. Marco Mattavelli EPFL CH16. Touradj Ebrahimi EPFL CH17. Yousri Abdeljaoued EPFL CH18. Xin Xing Beijing Polytechnic Univ. CN19. Kebin Jia Beijing Polytechnic Univ. CN20. Lifang Wu Beijing Polytechnic Univ. CN21. Bo Li Beijing Univ. Of Aero. & Astro. CN22. Xiaoming Yang CEPREI, CN CN23. Baoai Wang Chinese Electronic Standardization Inst. CN24. Xuxia Zhao CVIC Software Eng. Co., Ltd., CN CN25. A. Tourapis Hong Kong Univ. of Sci. & Tech. CN26. Oscar Au Hong Kong Univ. of Sci. & Tech. CN27. Bo Liu Huazhong Univ. Of Sci. & Tech. CN28. Wen Gao Inst. Of Computer Tech CN29. Wei Qi Microsoft Research CN CN30. Jing Li Microsoft Research CN CN31. Feng Wu Microsoft Research CN CN32. Shipeng Li Microsoft Research CN CN33. Kongqiao Wang Nokia (CN) R&D Center CN34. Yongqin Zeng Shanghai Com.Tech. Center CN35. Zijie Xu Shanghai Information Industry Co., Ltd. CN36. Hui Song Shanghai Information Industry Co., Ltd. CN37. Jia Wang Shanghai Jiaotong Univ. CN38. Jun Zhou Shanghai Jiaotong Univ. CN39. Ming Qian Shanghai NETSEA CN40. Zhaoyang Zhang Shanghai Univ. CN41. Manyuan Shen Shenzhen DIC Information Technology Co. Ltd. CN42. Icheen Yuan Shenzhen DIC Information Technology Co. Ltd. CN

6

43. Hongyuan Wang Shenzhen Huawei Technologies,Co.,Ltd CN44. Jing Wang Shenzhen Huawei Technologies,Co.,Ltd CN45. Zhong Luo Shenzhen Huawei Technologies,Co.,Ltd CN46. Lenan Wu Southeast Univ., CN CN47. Cheng W. Gao Stellar One Corporation CN48. Xin Yao Tsinghua Univ. CN49. Yun He Tsinghua Univ. CN50. Yujin Zhang Tsinghua Univ. CN51. Weibei Dou Tsinghua Univ. CN52. Shiqiang Yang Tsinghua Univ. CN53. Lu Yu Zhejiang Univ. CN54. Zhiqian Li ZTE Corporation CN55. Zhao Xin ZTE Corporation CN56. Wang Ning ZTE Corporation CN57. Chengji Zhao ZTE Corporation CN58. Olivier Avaro FR Telecom R&D DE59. Juergen Herre Fraunhofer IIS DE60. Frank Klefenz Fraunhofer IIS – AEMT DE61. Ralph Sperschneider Fraunhofer Institute for Integrated Circuits DE62. Thomas Sikora Heinrich Hertz Institut DE

63. Jens-Rainer Ohm Heinrich-Hertz-Institut DE64. Stephan Herrmann Munich University of Technologie, LIS DE65. Michael Wollborn Robert Bosch GmbH DE66. Joerg Heuer Siemens AG, Corporate Technology DE67. Andre Kaup Siemens AG, Corporate Technology DE68. Bernhard Feiten T-Nova Deutsche Telekom Innovationsgesellschaft

mbH BerkomDE

69. Bernd Edler University of Hannover DE70. Paul Christ University of stuttgart DE71. Yanxiang Chen University of Stuttgart DE72. Rosario Isabel Ruiloba Quecedo ASIM/LIP-6 UPMC ES73. Paulo Villegas Telefónica I+D ES74. Jose Maria Martinez Universidad Politecnica de Madrid ES75. Philippe Salembier Universitat Politecnica de Catalunya ES76. Mauri Vaananen NOKIA FI77. Jyri Huopaniemi Nokia Research Center FI78. Jean-Claude Dufourd Ecole Nationale Superieure des Telecommunica tions FR

79. Yuval Fisher Fisher Consulting FR80. Dominique Curet FR Télécom FR81. Jean-bernard Rault FR Telecom R&D FR82. Pierrick Philippe FR Telecom R&D FR83. Alain Le Guyader FR Telecom R&D FR84. Bertrand Foulonneau FR Telecom R&D FR85. Bogdan Titus Zaharia Institut National des telecommunications FR

7

86. Francoise Preteux Institut National des telecommunications FR87. Tobias Plamann IRCAM FR88. Yves Ramanzin PHILIPS FR89. Benoit Mory PHILIPS LEP FR90. Vucher Guez Marc SCPP/IFPI FR91. Cedric Thienot University / LIP6 FR92. Michael Strintzis Aristotle University of thessaloniki GR93. Yoel Zvi Lifshitz Optibase Ltd. IL94. Roberto Flaiani Aethra Telecomunicazioni IT95. Guido FRschini CSELT IT96. Michele Fusco Granolla CSELT IT97. Marco Gandini CSELT IT98. Gianluca De Petris CSELT IT99. Leonardo Chiariglione CSELT IT

100. Bugatti Alessandro University of Brescia, DEA IT101. Itaru Kaneko ASCII Corporation JP102. Tsutomu Ando Canon Inc. JP103. Yasuo Fukuda Canon Inc. JP104. Mikio Sasaki Denso Corporation JP105. Sugihara Yoshinori Electric Industries Association of JP JP106. Kimihiko Kazui Fujitsu Laboratories Ltd. JP107. Takehiro Fujita Hitachi,Ltd. JP108. Masaru Sugano KDD R&D Laboratories Inc. JP109. Koichi Emura Matsushita Electric Industrial JP110. Takanori Senoh Matsushita Electric Industrial Co., Ltd. JP111. Takuyo Kogure Matsushita Electric Indutrial Co. Ltd. JP112. Tokumichi Murakami Mitsubishi Electric Corporation JP113. Kotaro Asai Mitsubishi Electric Corporation JP114. Hirofumi Nishikawa Mitsubishi Electric Corporation JP115. Kazuo Sugimoto Mitsubishi Electric Corporation JP116. Hiroshi Itoh Mitsubishi Electric Corporation JP117. Masahiro Iwadare NEC JP118. Akio Yamada NEC Corp. JP119. Hitoshi Koyama NEC Corporation JP120. Masahiro Shibata NHK (Japan Broadcasting Corporation) JP121. Yoshiaki Shishikui NHK(Japan Broadcasting Corporation) JP122. Hideki Sakamoto NTT JP123. Takehiro Moriya NTT JP124. Yoichi Takashima NTT JP125. Tetsuro Fujii NTT JP126. Sanae Hotani NTT DoCoMo JP127. Shun-ichi Sekiguchi NTT DoCoMo Inc. JP128. Yasuaki Tokumo Sharp Corporation JP129. Shuichi Watanabe Sharp Corporation JP130. Yoshiaki Shibata Sony JP131. Toby Hamilton Walker Sony JP

8

132. Peter Kuhn Sony JP133. Frank Bossen Sony JP134. Yoichi Yagasaki Sony Corp. JP135. Masayuki Nishiguchi Sony Corporation JP136. Toguri Yasuhiro Sony Corporation JP137. Teruhiko Suzuki SONY CORPORATION JP138. Tadaaki Bandoh System Development Laboratory of Hitachi Ltd. JP

139. Aoki Terumasa The University of Tokyo JP140. Nakata Mayumi The University of Tokyo JP141. Hiroshi Yasuda The University of Tokyo JP142. Toshiaki Watanabe Toshiba JP143. Hisashi Yamada Toshiba JP144. Osamu Hori Toshiba Corporation JP145. Yoshihiro Kikuchi Toshiba corporation JP146. Toshimitsu Kaneko Toshiba Corporation JP 147. Toshinori Odaka Toshiba Corporation JP148. Tomoo Yamakage Toshiba R&D Center JP149. Azami Tomohiro Victor Company of JP, Limited JP150. Chee Sun Won Dongguk University KR151. Munchurl Kim ETRI KR

152. Young-Kwon Lim ETRI KR

153. Jin Woong Kim ETRI KR

154. Jun Geun Jeon ETRI KR

155. Wook Joong Kim ETRI KR

156. Soo Jun Park ETRI KR

157. Sung Hee Park ETRI KR

158. Whoi-Yul Yura Kim Hanyang University KR159. Dong Gyu Sim Hyundai Electronics Industries, Co., Ltd. KR160. Yong Man Ro Information & Communication University KR161. Yong Ju Jung Information & Communications University KR162. Nam-Yong Lee Kangwon National University KR163. Hyong Joong Kim Kangwon National University KR164. Sanghoon Sull KR University KR165. Seoung-Jun Oh KwangWoon University KR166. Doug Suh Kyung Hee University KR167. Kyoungro Yoon LG Electronics Institute of Technology KR168. Jungmin Song LG Electronics Institute of Technology KR169. Heon Jun Kim LG Electronics Institute of Technology KR170. Jin-Soo Lee LG Electronics Institute of Technology KR171. Daijin Kim Postech KR172. Hyun Sung Chang Radio & Broadcast. Tech. Lab., Electronics and KR

9

elecommunications Research Institute173. Mahn Jin Han Samsung AIT KR174. Do Kyoon Kim Samsung AIT KR175. Sang Wook Kim Samsung AIT KR176. Dae Sung Cho Samsung AIT KR177. Sung Hee Park Samsung AIT KR178. Euee Seon Jang Samsung AIT KR179. Yung-Lyul Lee Samsung Electronics KR180. Yanglim Choi Samsung Electronics KR181. Hae-Kwang Kim Sejong University KR182. Yoonsik Choe Yonsei University KR183. Gwang Hoon Park Yonsei University KR184. Peter Mulder Dutch Broadcast services corporation NL185. Rob Koenen KPN Research NL186. W.G.P. Mooy Mindport NL187. Jean H.A. Gelissen Philips Research Laboratories NL188. Mihaela van der Schaar Philips Research Labs. US NL189. Johannes Andreas Erik Oltmans TELEMATICA INSTITUUT NL

190. Ms Lena Pedersen Telenor R&D NO191. António Ernesto Silva Santos INESC Porto PT192. Fernando Pereira INSTITUTO SUPERIOR TÉCNICO PT193. Morgan. Lindqvist Ericsson SE194. Charilaos Christopoulos Ericsson Radio System AB SE195. Ms Marie Dahlqvist Teracom AB SE196. Ged Powell Infineon Technologies Asia Pacific Pte Ltd. SG197. Bo Lan JVC ASIA Lab. of SG SG198. Yasuhiro Yamada JVC ASIA Pte Ltd. SG199. Kai-Kuang Ma Nanyang Tech. Univ. SG200. Lim Chong Soon Panasonic SG Lab. Pte Ltd. SG201. Wang Lei Panasonic SG Lab. Pte Ltd. SG202. Neo Sua Hong Panasonic SG Lab. Pte Ltd. SG203. Tan Ah Peng Panasonic SG Lab. Pte Ltd. SG204. Oliver Morgan Avid technology Inc. UK205. Jason Charlesworth CANON RESEARCH (EUROPE) LTD. UK206. Simon Rowe Canon Research Centre Europe Ltd UK207. Philip N. Garner Canon Research Centre Europe Ltd. UK208. Panagiotis Koudoumakis Central Research Labs UK209. Alvar Bray Computer Consultant UK210. Mr.Paul Jessop IFPI SECRETARIAT UK211. Niels Rump InterTrust Technologies International UK212. Douglas Armati Intertrust Technology UK213. Adam Lindsay Lancaster University UK214. M. Bober Mitsubishi Electric Infor. Tech. Center Europe UK215. Leszek Cieplinski Mitsubishi Electric ITE-VIL UK216. Catherine Grant Nine Times Networks Ltd UK217. Keith Hill Rightscom Ltd. UK

10

218. Yi Liu Advanced Micro Devices, Inc. US219. John Mantegna America online Inc. US220. Michel Rynderman Avid technology Inc. US221. Mukta L. Kar Cable Television Laboratories US222. Hain-Ching Liu Cisco Systems, Inc US223. Ana Benitez Columbia University US224. Allan Peach DemoGraFX US225. Gary Zhang Diamondback Vision Inc. US226. William E. Severson DiamondBack Vision, Inc. US227. Donald Mead Digital Electronics Cinema Inc US228. Matthew S. Goldman DIVICOM /HARMONIC US229. Toshio Miki DoCoMo Communications Laboratories US, Inc.

(DoCoMo US Labs)US

230. Rajiv Mehrotra Eastman Kodak Company US231. Alexander Loui Eastman Kodak Company US232. Christopher Wendt E-Vue Inc. US233. Eric Petajan Face2Face US234. Mark Rowe Hewlett-Packard,Co. US235. Thomas McFarland Hewlett-Packard,Co. US236. Ronnie Burns HRL, Hughes Electronics Company US237. Chao-Kung Yang Hughes Electronics Company US238. Michelle Kim IBM US239. Peter Schirling IBM Research US240. John R. Smith IBM T. J. Watson Research Center US241. Stephen Wood IBM T. J. Watson Research Center US242. Vaughn Iverson Intel Corporation US243. Chen Yen-Kuang Intel Corporation US244. Mark Buxton Intel Corporation US245. Jeffrey McVeigh Intel Corporation US246. Hong Jiang Intel Corporation US247. Ramesh Pendakur Intel Corporation US248. Jordan Isailovic JRI Technology US249. Zachary Coffin KPMG Consulting US250. Andrew G. Tescher Lockheed Martin US251. Tao Lin Luxxon Corp. US252. Anthony Vetro Mitsubishi Electronics America US253. Huifang Sun Mitsubishi Electronics America US254. Tihao Chiang Mitsubishi Electronics America US255. Ajay Luthra Motorola US256. Mandayam Narasimhan Motorola US257. Hsueh-Mong Hang National ChiaoTung Univ. US258. Mike (Myron) Rubinfeld National Institute of Standards & Technology US259. Wo Chang National Institute of Standards & Technology US260. Kwok Chau NJR Corporation US261. Jani Lainema Nokia Research Center US262. Ming Lee Oracel Corporation US

11

263. Jiangtao Gene Wen Packet Video US264. Maximilian H. Luttrell PacketVideo Corporation US265. Sylvie Jeannin Philips Research US US266. Qunshan Gu Picture Tel Corp. US267. Gary Greenbaum Real Netwoks, Inc US268. Bruce Block Recording Industry Assn of America US269. Michael McGinty Red Dot Net US270. Howard Edinger Sarnoff Corporation US271. Si Jun Huang Scientific Atlanta, Inc. US272. Xiaobing Lee Seachange Intl. Inc. US273. Dean Messing Sharp Labs of America US274. Peter Van Beek Sharp Labs of America US275. Ibrahim Sezan Sharp Labs of America US276. Ali Tabatabai Sony Electronics,Mediasoft lab, US277. Hawley Rising Sony Electronics,Mediasoft lab,. US278. Chien-Min Huang Sorenson Technologies, Inc. US279. Viswanthan Swaminathan Sun Microsystems Inc. US280. Jiuhuai Lu Tektronix, Inc. US281. Jake Yang TeleCruz Technology, Inc. US282. Corinne Jorgensen University at Buffalo, State U. Of New York US283. Ms Sho Long Chen Vweb Corporation US284. Weiping Li WebCast Technologies, Inc. US

12

Annex 2Input documents

No. Source Title6119 Pete Schirling Document Register for 53rd meeting in Beijing, CN6120 SC 29 Secretariat Table of Replies on 13818-4/FDAM 3 (SC 29 N 3655)6121 Jean-Claude Dufourd Candidates for Systems COR26122 NB of US Revised Comments on ISO/IEC 13818-2:2000/PDAM 1

(SC 29 N 3660)6123 Zvi Lifshitz IM1s Decoder Development Kit version 2.06124 Jean-Claude Dufourd Update of the MP4 File Producer6125 Zvi Lifshitz FlexTime Implementation with Core 5.06126 Jean H.A. Gelissen DNB Comments6127 Jan van der Meer Response to the call for contribution on the carriage of

metadate over MPEG-2 Transport6128 Kristof Denolf, Christophe

De Vleeschouwer, Jan Bormans

AC Prediction complexity analysis and concerns about FGS implementation

6129 Jean-Claude Dufourd, Guido Francheschini

Modification to the MuxHint file format

6130 Panos Kudumakis Liaison to MPEG concerning version 1.1 of the OPIMA Specification

6131 Marc Emerit, Yannick Mahieux, Jean Bernard Rault, Marco Mattavelli

Advanced Audio Profile

613261336134 The National Body of

SwitzerlandSwiss National Body Position on Profiles for version 3 of MPEG-4 Systems (14496-1 PDAM 2)

6135 ITTF Table of Replies on ISO/IEC 14496-6/FDAM 1 (SC 29 N 3692)




6139 Lifang Wu, Lansun Shen Variable scale wavelet shape descriptor6140 Zvi Lifshitz A proposal for media control in ISO/IEC 14496-16141 Pierrick Philippe Request for a "Call for evidence justifying the testing of

audio coding technology"6142 David Singer Proposed Initial Framework for MPEG-7 Systems6143 Sang-Youn Lee, Young-Sik

Choi, Sang-Hong Lee, Hae-Kwang Kim

Cross-check on Core Experiments CT-4 (edge histogram descriptors)

6144 Xin Xing,, Lansun Shen,, Kongqiao Wang,, Kebin Jia

Automatic Human Face Detection

6145 Lei Wang*, Thiow Keng Tan*, Mark Pickering**

Experimental Results of Face Description (CT3)

6146

13

No. Source Title6147 Mahnjin Han, Gabriel

Taubin, Sungjin Kim3D Mesh Coding Reference Software

6148 Mikio SASAKI Adaptive Media Processing using Dependency Information

6149 Mikio SASAKI A Proposal for Mobile Profile6150 David Singer A Framework for the delivery of MPEG-4 over IP-based

Protocols6151 Niels Rump MPEG-7 IPMP AHG Report6152 German National Body Comments on ISO/IEC 14496-2:1999/PDAM46153 A. G. Tescher for USNB USNB Contribution: MPEG-4 Video Amendment 46154 Yaming Tu, Bo Li Fast Motion Estimation using Advanced Motion Vector

Field Adaptive Search Technique (AMVFAST)6155 P. van Beek, A.B. Benitez, J.

Heuer, J. Martinez, P. Salembier, J. Smith, T. Walker

MPEG-7 Multimedia Description Schemes XM (Version 3.1)

6156 P. van Beek, A.B. Benitez, J. Heuer, J. Martinez, P. Salembier, J. Smith, T. Walker

MPEG-7 Multimedia Description Schemes WD (Version 3.1)

6157 P. van Beek, A.B. Benitez, J. Heuer, J. Martinez, P. Salembier, J. Smith, T. Walker

Ad Hoc Group Report on Editing the MDS XM and WD

6158 Neil Day, Witold Reichhart, Caterina Saraceno

Report of the AHG for MPEG-7 Applications and Promotion to Industry

6159 Takehiro Moriya, Masami Suzuki, Kazuaki Chikira

Proposed corrections to MPEG-4 Audio (14496-3) subpart 4

6160 Jane Hunter, Jose M. Martinez, Erik, Oltmans

MPEG-7 harmonisation with Dublin Core: current status and concerns.

6161 D.Curet FNB comment for Beijing6162 D.Girault, E.Le Gall, D.Curet SDP syntax for MPEG-4 payloads6163 E.Le Gall, D.Curet XML syntax for some descriptors6164 C.Roux, D.Curet, E.Le Gall RTP payload for FlexMux streams6165 C.Roux, D.Curet, E.Le Gall 4on2, a missing descriptor?6166 D.Curet, C.Roux deterministic DMIF6167 M.Veillard, E.Le Gall,

D.Curet, C.Rouxanother FlexMux tool with longer PDUs

6168 Anthony Vetro, Peter Kuhn, Teruhiko Suzuki, John R. Smith, Ana B. Benitez, Charilaos Christopoulos

CE Report on Media Transcoding Hint DS

6169 D.Curet update to N3381, "a Framework for the delivery of MPEG-4 over IP-based Protocols"

6170 D.Curet update to the Graphical representation of object descriptor and sync layer syntax

6171 Gary S. Greenbaum, Karl Lillevold, Jeff McVeigh, Ram R. Rao

A Response for Evidence Justifying the Testing of Video Coding Technology

14

No. Source Title6172 Michel Rynderman, Rosa

RuilobaVideo Editing DS Requirement Clarification

6173 Timo Sorsa, Jyri Huopaniemi Evaluation results of Melody CE6174 Soo-Jun Park, Chee Sun

Won, Dong Kwon ParkCore Experiments on MPEG-7 Edge Histogram Descriptor

6175 Tsutomu Ando, Masahiko Takaku, Hiroshi Inoue

DMIF support for advanced IPMP systems

6176 DVD Forum Liaison statement from DVD Forum on MPEG-2 amendment for video supplemental information

6177 Jani Lainema, Marta Karczewicz, Bogdan Dobrin, Joni Vahteri

A Response to N3318: Nokia MVC codec


A Response to N3318: Nokia MVC Encoder Description


A Response to N3318: Nokia MVC Decoder Description

6180 Rosa Ruiloba, Michel Rynderman, Philippe Joly

First results of CE on VideoEditing DS

6181 Akio Yamada Results on core experiment MS-3: Region-based shape descriptor

6182 Akio Yamada, Eiji Kasutani A Proposal of new Core Experiment to optimize default values for Color Layout

6183 Gwang Hoon Park, Young-Kwon Lim, Yoon Jin Lee, Seung Tae Kim, Jung Hwan Yoon, Myoung Ho Lee, Chieteuk Ahn

Water ring scan order for improving subjective quality of MPEG-4 FGS

6184 Jean-Bernard RAULT, Jean-Marc JOT

Proposed changes for corrigendum of 14496-1 Amd1- Advanced Audio BIFS

6185 Jean-Bernard RAULT, Jean-Marc JOT

Draft text for Advanced AudioBIFS Conformance testing - Perceptual Approach

6186 Juergen Herre, Frank Klefenz Check Site Report on MPEG-7 Core Experiment on Melody Similarity

6187 C. Saraceno, Y. Shibata, P. Garner, L. Cieplinski

AHG Report on Audio, Video, MDS Harmonization

6188 N.Ito, E.Morimatsu, W.Li, Y.Yagasaki

Report on the Ad Hoc group on Software Integration and Verification in MPEG-4 Video

6189 N.Ito, E.Morimatsu, W.Li, Y.Yagasaki

Report on the Ad Hoc group on Software Integration and Verification in MPEG-4 Video

6190 Karsten M³ller, Jens-Rainer Ohm, James Cooper ,Miroslaw Bober

Results of 2D/3D Shape Core Experiments MS-4

6191 Ralph Sperschneider Report of the Ad-hoc Group on the Audio part of MPEG-4 Conformance

6192 Ralph Sperschneider Study on audio part of 14496-4 PDAM 16193 Ralph Sperschneider Status and Workplan for V1 and V2 Audio Conformance6194 Alexis M. Tourapis, Oscar. Implementation of the Predictive Motion Vector Field

15

No. Source TitleC. Au, Ming. L. Liou Adaptive Search Technique (PMVFAST) algorithm in

the Optimization Model 1.06195 Jose M. Martinez, Oscar

Fernandez, Clara, Garcia, Masahiro Shibata, Corinne Joergensen, Kyoungro Yoon

Report on the CE on the Controlled Term D

6196 Jose M. Martinez MPEG-7 Overview Lite6197 Ana B. Benitez, Toby

Walker, Peter MulderReport of the AHG on MPEG-7 DS Core Experiments

6198 Keith Hill Report from the AHG on MPEG-21 Multimedia Framework

6199 Peter Westerink, Steve Wood ESM specification issues6200 Peter Westerink, Steve Wood BIFS specification issues6201 Ralph Justus Request for a liaison with respect to technical activities

for specifying carriage of metadata in MPEG-2 Transport Streams

6202 Steve Wood, Geraud Boyer, Patrice Bazerque, Michelle Kim, Peter Westerink

IM1 Implementation of the FlexTime Model

6203 Peter Westerink, Michelle Kim, Steve Wood

Conformance for the FlexTime Model

6204 Michelle Kim, Jeff Boston, Lai-Tee Choek, Bill Luken, Etienne Roy, Steve Wood

Authoring in the Extensible MPEG-4 Textual Format (XMT)

6205 Do-Kyoon Kim, Sang O. Woo, Seok Yoon Jung, Sungjin Kim, Mahnjin Han, Euee S. Jang

Study of the Upstream Technique for MPEG-4 BIFS Scene

6206 Mahnjin Han, Olivier Avaro Report of the AHG on 3DMC Conformance6207 Rong Yan, Feng Wu,

Shipeng Li, Ya-Qin Zhangeerror resilience methods in the FGS enhancement bitstream

6208 Patty Gray, Katsumi Tahara Report of AHG on the study of MPEG-2 Video Content Description Data proposed amendment.

6209 I. Sezan, K. Yoon, P. van Beek, Y. Tomioka

Results of CE on User Preference DS

6210 I. Sezan, G. Vaithilingam, J-P. Evain, C. Herpel

Report of AHG on TV-Anytime Application

6211 Young-Kwon LIM, Myoung Ho LEE, Chieteuk AHN

Draft integration of MPEG-4 system specifications (V1, COR1, and AMD1)

6212 Whoi-Yul Kim, Jae-Ho Kwak

Cross-verification result on CT2

6213 Whoi-Yul Kim, Yong-Sung Kim

Cross-verification result on MS-5

6214 Whoi-Yul Kim, Jong-Min Kim, Suk-Hwan Shin, So-Hee Kim

Cross-verification result on CT-5

6215 Whoi-Yul Kim, Yong-Sung Kim

CE result on MS-3

6216 Alexis M. Tourapis, Oscar C. Verification Results of the Feature-based Fast and Robust

16

No. Source TitleAu Global Motion Estimation Technique (FFRGMET) for

Sprite Coding6217 J. Errico, P. van Beek, I.

SezanUpdate of MPEG-7 XM Software for User Preference DS: A Content Filtering Agent

6218 D. Messing, P. van Beek, I. Sezan

Results of MPEG-7 CE CT1

6219 Shiguang Shan, JiYong Ma, Wen Gao

Verification Results on the error resilience methods in the FGS enhancement bitstream

6220 Yasuo FUKUDA The proposal for MPEG-7 Color Layout descriptor6221 Wen Gao CN NB comment on FGS6222 Yoshiaki Shibata, Toby

WalkerGuideline for DDL representation of MPEG-7 tools ver.0.1

6223 Yoshiaki Shibata Syntax Extension for Vector/Matrix Datatypes and Normative Behavior of MPEG-7 Parser

6224 Yoshiaki Shibata Report on Core Experiment for the Affective DS6225 Tetsurou Fujii, Mitsuru

Nomura, Tatsuya Fujii, Sadayasu Ono

Super High Definition Digital Video System for Digital Cinema

6226 Yuwen He, Wei Qi, Shiqiang Yang, Yuzhuo Zhong

Feature-based Fast and Robust Global Motion Estimation Techni

6227 Alessandro Bugatti, Riccardo Leonardi, Benoit Mory, Yoshiaki Shibata, Kyoungro Yoon

CE report on Weight DS

6228 Itaru Kaneko Possible table structure to evaluate for IPMP proposal6229 Itaru Kaneko Economy of renewability6230 Leszek Cieplinski Cross-verification Results for Core Experiment CT26231 Leszek Cieplinski Cross-verification Results for Core Experiment CT36232 S. R. Quackenbush Report of the AHG on MPEG-7 Audio Core Experiments6233 Jane Hunter Report of the MPEG-7 DDL AHG6234 Euee S. Jang, Michael

Bourges-SevenierAHG report on study of generic animation coding

6235 Euee S. Jang SNHC meeting report of the 51st MPEG meeting in Noordwijkerhout

6236 Toby Walker, Hawley Rising, Ana Benitez, Koiti Hasida, Ajay Divakaran

Report on the CE on Entity Relationship Graph DSs

6237 Toby Walker Proposal for Representing Key Items6238 Yoshiaki Shishikui, Shinichi

Sakaida, Wentao ZhengLens distortion parameters for sprite coding in MPEG-4 Studio Profile

6239 Masahiro Shibata Report of CE on Structured Textual Description (For the part of Dependency Structure)

6240 Masahiro Shibata, Audrey Tam, Clement Leung, Koiti Hasida, Ana Benitez, Alejandro Jaimes

Report of CE on Structured Textual Description

6241 Yoichi Yagasaki Ad hoc Group Report on the Studio Profile in MPEG4 Video (N3331)

6242 The National Body of JP JNB Comments on on ISO/IEC 14496-2 AMD1

17

No. Source Title(JNB)

6243 The National Body of JP(JNB)

JNB comment on ISO/IEC 14496-2 PDAM3 ballot

6244 Ralf Funken, Masahiro Serizawa

Revision of MPEG-4 Version 2 CELP Conformance bitstreams

6245 Frank Bossen, Rob Koenen Report of AHG on Content Access Problem Statement6246 Frank Bossen, Rob Koenen Report of AHG on Content Access Problem Statement6247 The National Body of JP

(JNB)Comments on Streaming Video Profile

6248 Frank Bossen, Rob Koenen Report of AHG on Content Access Problem Statement6249 Tomohiro Azami, Ichiro

Ando, Masahito TsutsumiDividing methods for MPEG-7 Description

6250 Doug Young Suh, Young Kwon Lim, Myung Ho Lee

Proposal of Traffic Descriptors for Use of VBR Channels for VBR Traffic

6251 Ernest Wan, Joerg Heuer, Yoshihisa Gonno

Delivering MPEG-7 Descriptions - a preliminary analysis

6252 The national body of JP Comments on 14496-3 and 13818-76253 The national body of JP Comments on 14496-3 and 13818-76254 Heon Jun Kim, Jungmin

Song, Jin-Soo LeeResult of CT5

6255 Heon Jun Kim, Jungmin Song

Result of CT2


Cross-Check Result of CT1


Cross-Check Result of MS3

6258 Jin-Soo Lee, Jungmin Song The result of core experiment on Matching Hint DS6259 Kyoungro Yoon Proposal of USge History DS6260 ITU-R WP 6P Liaison Statement from ITU-R WP 6P (formerly WP

11A) on EHRI ÕSC 29 N 3709þ6261 Akira Inoue, Yuji Maeda,

Masayuki NishiguchiER_HVXC related modifications in MPEG-4 version2 conformance PDAM

6262 ITU-R WP 6P Liaison Statement from ITU-R WP 6P on Digital Television Receivers for Multiple Physical Delivery Systems ÕSC 29 N 3710þ

6263 Minhua Zhou, Hong Jiang, Weiping Li

Further Study on Complexity of AC Prediction

6264 Peter Kuhn Cross verification results on the CE on Spatial Localized Motion Activity

6265 Heiko Purnhagen, Bodo Teichmann

Report of AHG on MPEG-4 Audio Reference Software

6266 Heiko Purnhagen, Nikolaus Meine, Bernd Edler

Comments on audio/HILN part of 14496-4 PDAM 1

6267 Sanghoon Sull,, Keansub Lee Improving the Media Transcoding Hint DS by adding an attribute for spatial resolution reduction

6268 Jean-Claude Moissinac,, Gabriel Dubois,, Jean-Claude Dufourd

Preliminary results of USge of MPEG-4 for cartoons

6269 Paul Christ, Christine Delivery of MPEG-4 streams over RTP

18

No. Source TitleGuillemot

6270 KNB KNB Comment on 14496-5:2000/FPDAM16271 KNB KNB Comment on 14496-1/AMD16272 KNB KNB Comment on 14496-2/AMD16273 Frank Bossen Studio Profile: Coding of RGB source material6274 Frank Bossen Studio Profile: Compressing the uncompressed mode6275 Shuichi Watanabe, Yasuaki

TokumoDetail Descriptions on Spatial Localized Motion Activity

6276 Yasuaki Tokumo, Shuichi Watanabe

Results of CE on Spatial Localized Motion Activity (CE MS1)

6277 Giorgio Zoia Suggested changes to N3067 subpart 56278 Guido FRschini Report of AhG on systems conformance6279 Jose M. Mart� Proposal for an Availability DS6280 Jose M. Martinez Proposal for an Availability DS6281 Stephan Herrmann Report of AHG on XM Development6282 Bernhard Feiten Query By Humming: State of the Art6283 Yoshihiro Kikuchi,

Yoshinori Matsui, Toshiyuki Nomura, Hidenobu Harasaki, Yoshihiro Miyamoto, Hideaki Kimata, Shigeru Fukunaga, Toshiro Kawahara

Comments on N3381A Framework for the delivery of MPEG-4 over IP-based Pro

6284 Jens-Rainer Ohm, Michael Frater

Report of AHG on Fine-Granularity Scalability in MPEG-4 Video

6285 Jens-Rainer Ohm, Bela Makai, Aljoscha Smolic

Results on CE CT5 on scalable representation of color histograms

6286 Guido Heising, Detlev Marpe, Hans Cycon

HHI's Response to MPEG's Call for Evidence (w3318)

6287 Oliver Morgan et al. Incoming liaison from SMPTE6288 Oliver Morgan et al. MPEG-7 Integration with SMPTE EBU etc AHG Report6289 Oliver Morgan MPEG-7 Systems AHG Report6290 Oliver Morgan MPEG-7 Systems Potential API Requirement6291 Oliver Morgan et al MPEG-7 Systems V0.6 Input6292 Oliver Morgan MPEG-7 Bin-Sys Comparison of Binary Encodings6293 Miroslaw Bober, Wayne

PriceReport on results of the Core Experimen on contour-based shape descriptor (MS-5)

6294 Yuji Maeda, Akira Inoue, Masayuki Nishiguchi

ER_HVXC related reference software modifications for the new error concealment management and frame concatination mode

6295 Neil Day, Witold Reichhart, Caterina Saraceno

Press Release of the MPEG-7 Awareness Event

6296 Osamu Sunohara, Yoichi Yagasaki, Hiroyuki Imaizumi, Shinichi Sakaida, Yoshiaki Shishikui

Report of bitstream exchange for MPEG-4 Core Studio Profile

6297 Koichi Emura, Yoshiaki Shibata, Jin-Soo Lee

Report on Core Experiment for the PointOfView DS

6298 John R. Smith, Hawley K. Rising III

Report of the AHG on Conceptual Modeling

19

No. Source Title6299 John R. Smith on behalf of

MPEG-7 Conceptual Modeling AHG

MPEG-7 Principal Concepts List (V0.95)

6300 John R. Smith, Blaise Lugeon, Ana Benitez

Report on Core Experiment on Package DS

6301 Neil Day, Witold Reichhart, Caterina Sareceno

MPEG-7 Applications, Demos and Projects vs. 0.1

6302 Yen-Kuang Chen, Hideki Sakamoto

AHG Report on Study on Standard Digital Watermarking Technology

6303 Skip Macy Non-IP-Protection Digital Watermarking Applications6304 Frank Bossen, editor Content Access Problem Statement6305 Frank Bossen, editor Draft Call for Proposals for an advanced IPMP system6306 P N Garner, J P A

CharlesworthStatus of Spoken Content D/DS

6307 Jan Bormans Report of the AHG on complexity evaluations of video tools

6308 Corinne Jorgensen A Conceptual Structure for an Image Indexing Template and Validation Examples

6309 Corinne Jorgensen, Deborah J. Karpuk

The Concept of Authority Control and its Relevance for "Names" in MPEG-7

6310 JP National Body Comments on Streaming Video Profile6311 Zon-Yin Shae Proposal for SceneGraphEvent DS6312 Ryuta Suzuki, Minoru Wada,

Kohtaro Asai, Tokumichi Murakami

Request for Digital Cinema Profile

6313 French National Body FNB comment on request for carriage of metadata over MPEG-2

6314 Jacques GUICHARD Declaration of intents concerning MPEG-4 Advanced Audio BIFS

6315 Titus Zaharia, Francoise Preteux

Results of 3D Shape Core Experiment

6316 Titus Zaharia, Francoise Preteux

The influence of the quantization step on the 3D shape spectrum descriptor performances

6317 Jeff McVeigh Sample bitstreams containing Content Description Data6318 AHG on binary and dynamic

MPEG-7 data representationReport of AHG on binary and dynamic MPEG-7 data representation

6319 Karsten M³ller Cross Verification of CE on Contour Shape (MS-5)6320 Michael Wollborn Efficient binary and dynamic MPEG-7 data

representation6321 S. Fukunaga, S.H. Son, T.

NagumoReport of Ad Hoc Group on MPEG-4 version 2 Video VM editing

6322 Yves Ramanzin, Mihaela van der Schaar

Philips proposal for SVP profile

6323 Frank Bossen, Don Mead Report of AHG on Digital Cinema Requirements6324 Frank Bossen, Don Mead,

eds.Draft of Requirements for Digital Cinema

6325 Tobias Plamann, Geoffroy Peeters, Perfecto Herrera, Xavier Amatriain

Third Party Validation Procedure and Status of the CE on Timbre Similarity

20

No. Source Title6326 Web 3D Consortium Lisaion from Web3D: Clarification on the textual format

XMT6327 Web 3D Consortium Lisaion from Web3D: Clarification on Media Control

and the DMIF/Systems interface6328 Web 3D Consortium Lisaion from Web3D: MatteSurface X3D node proposal6329 Web 3D Consortium Lisaion from Web3D: Miscellaneous clarifications on

14496-16330 Web 3D Consortium Lisaion from Web3D: Clarifications on Flex Time6331 Miroslaw Bober Further results on the contour shape descriptor6332 German National Body Comment on second edition of MPEG-4 Audio6333 Miroslaw Bober, Sylvie

JeanninReport of the AHG on Motion and Shape Core Experiments

6334 P. van Beek, I. Sezan Proposal for Extensions to MediaLocator DS6335 Ajay Divakaran Report on CE for Spatial Location of Motion Activity6336 Viswanathan Swaminathan MPEG-J AHG Report6337 Viswanathan Swaminathan,

Gerard FernandoMPEG-J Implementation Status and Workplan

6338 Philippe Hoogvorst Retrieval rate cross-check of the 3D shape spectrum descriptor

6339 Chih-Wei Tang, Hsueh-Ming Hang, and Tihao Chiang

A Proposal for Some Non-Security Watermarking Applications

6340 Teng Sing Wang, Pao-Chi Chang, Chih-Wei Tang, Hsueh-Ming Hang and Tihao Chiang

An Error Detection Scheme using Data Embedding for H.263 Compatible Video Coding

6341 Youngmoo Kim Status of Core Experiment on Melody DS6342 Mauri Vaananen Finnish NB comments on MPEG-4 ver. 2 Conformance6343 Sylvie Jeannin, Leszek

Cieplinski, Jens Rainer Ohm, Munchurl Kim

Report of the AHG on editing the MPEG-7 Visual XM and WD documents

6344 Sylvie Jeannin, Leszek Cieplinski, Jens Rainer Ohm, Munchurl Kim

MPEG-7 Visual Part of Experimentation Model, Version 6.1

6345 Sylvie Jeannin, Leszek Cieplinski, Jens Rainer Ohm, Munchurl Kim

MPEG-7 Visual Part of Working Draft, Version 3.1

6346 Eric Petajan, Tolga Capin Report of FBA Conformance adhoc6347 Zvi Lifshitz Study of ISO/IEC 14496-1/FPDAM26348 Zvi Lifshitz IM1 software platform AHG report6349 Zvi Lifshitz Comments on N3381 (framework for delivery of MPEG-

4 over IP)6350 Zvi Lifshitz IM1 Core code + authoring tools version 5.06351 P. van Beek, I. Sezan Proposal for an Electronic Program Guide description

scheme6352 Olivier Avaro AHG report on multi-user applications6353 Olivier Avaro (on behalf of

the IST SoNG Project and Eurescom Venus project)

Proposed changes on the Requirements for Multi-users Worlds

6354 Jiuhuai Lu, Michel Report of Core Experiment on MediaQuality DS

21

No. Source TitleRynderman, John R. Smith

6355 Alessandro Bugatti, Ana Benitez, Rajiv Mehrotra, Koiti Hasida, Hawley Rising, Corinne Joergensen, Riccardo Leonardi, Ed Hartley, Murat Tekalp

Report of CE on Semantic DS

6356 P. van Beek, I. Sezan Notes and proposals on MPEG-7 description access6357 Takehiro Fujita, Takafumi

MiyatakeComparison with textual descriptions of ColorLayout descriptors

6358 Euee S. Jang Proposal of New MPEG SNHC Homepage6359 Hawley K. Rising III, Ali

TabatabaiProposed Syntax for Synchronized Commands Execution

6360 Hawley K. Rising III Report on the Core Experiment on Entropy6361 Hawley K. Rising III, Ali

TabatabaiA Two-stage Mapping for Application Specific Markup and Binary Encoding

6362 Hawley K. Rising III, Ali Tabatabai, Toby Walker

Fuzzy Relations and Graph Structures for Compact Description and Modification

6363 Youichi Takashima, Hideki Sakamoto

The possibility of the meta-watermark

6364 T. Ellerbrock, T. Meiers, T. Sikora

Comments on 2nd order Eigenface Method

22

Annex 3Agenda

1. Opening2. Roll call of participants 3. Approval of agenda4. Allocation of contributions 5. Communications from Convenor 6. Report of previous meeting 7. Processing of NB Position Papers 8. MPEG Phase 28.1 Standard8.2 Amendments8.2.1 Systems8.2.2 Video8.3 Corrigenda8.4 Workplan9. MPEG Phase 49.1 Version 19.1.1 Standard9.1.2 Corrigenda9.2 Version 29.2.1 Reference software9.2.2 Conformance Testing9.2.3 Corrigenda9.3 Version 39.3.1 Requirements9.3.2 Tools9.3.2.1 Systems9.3.2.2 Video9.3.2.4 SNHC9.3.3 Verification Models9.3.4 Amendments9.4 Version 49.4.1 Requirements9.4.2 Tools9.4.2.1 Systems9.4.2.2 Video9.4.3 Verification Model9.4.4 Amendments9.5 Version 59.5.1 Requirements9.5.2 Tools9.5.2.3 SNHC9.5.3 Verification Model9.6 Workplan

23

10. MPEG Phase 710.1 Requirements10.2 Tools10.2.1 Systems10.2.2 Description Definition Language10.2.3 Video10.2.4 Audio10.2.5 Description Schemes10.2.6. Reference software10.3 Working Drafts10.4 Workplan11. MPEG phase 2111.1 Requirements11.2 Technical Report11.3 Workplan12. Overall WG11 workplan 13. Explorations14. Liaison matters15. Administrative matters 15.1 Schedule of future MPEG meetings 15.2 Promotional activities16. Organisation of this meeting 16.1 Tasks for subgroups16.2 Joint meetings17. Planning of future activities 18. Resolutions of this meeting 19. A.O.B20. Closing

24

Annex 4Requirements Group Report

Source: Rob Koenen, Keith Hill

MPEG-2

MPEG-7 Over MPEG-2m6290 Oliver Morgan - MPEG-7 Systems Potential API Requirement In a joint meting with systems, the requirements for carriage of metadata in MPEG-2 where reviewed. The requirements where laid down in N3533 Requirements for carriage of Metadata and Descriptions on MPEG-2 Transport Streams (‘7 on 2’) Further work will be done in the System Group. One requirement (on the fragmentation of descriptions) was added to the MPEG-7 Requirements document.

MPEG-4

MPEG-4 RequirementsThe new requirements document is N3534

m6205 Do-Kyoon Kim, Sang O. Woo, Seok Yoon Jung, Sungjin Kim, Mahnjin Han, Euee S. Jang - Study of the Upstream Technique for MPEG-4 BIFS Scene.

User initiated retransmission of objects is useful can provide error-resilience to applications. Requirements already support error resilience in general. This specific notion fits in very well with MUW requirements. A requirement will be added to the MUW specific requirements in the requirements document.

m6328 Web 3D Consortium - Liaison from Web3D: MatteSurface X3D node proposal The Systems and Requirements groups agreed that the proposed node is useful. Systems will now proceed to implement it.

Animation Framework

New requirements for the Animation Framework were discussed. Many of them were no requirements on MPEG-4, but on the transport. Other ones we would like to update, but while the Call for Proposals is in effect, requirements cannot be changed. Hence, a study on the requirements was made. An attempt to add the requirements for the animation framework failed; these requirements, as they can be found in the Cal for Proposals or the Animation Framework, will be added tot the next version.

Multi-user worldsm6353 Olivier Avaro et.al. - Proposed changes on the Requirements for Multi-users Worlds m6352 Olivier Avaro - AHG report on multi-user applications Requirements for multi-user worlds where iscussed, approved and included in the MPEG-4 Requirements Document. These requirements were also included in the Call for Proposals for MUW. (A Systems document.)

ProfilesAudio Compositionm6314 J. Guichard - Declaration of intents concerning MPEG-4 Advanced Audio BIFS

25

m6134 Swiss NB - Position on Profiles for version 3 of MPEG-4 Systems m6131 M.Emerit, Y. Mahieux, J.-B. Rault, M. Mattavelli - Advanced Audio Profile 3D Audio Scene Graph

and 3D Graphics Profiles The support for 3D Audio Profiles is enough to warrant addition of these new, very broadly USble profiles, but they cannot be added now, as the specification is under ballot. Therefore a new version of Profiles under Consideration is made available including an updated definition of these profiles, and this is referenced in the Study on 14496-1 FPDAM 2. A resolution asks NBs to request for these profiles to be included in MPEG-4 Systems V.3

Studio Profiles

The FPDAM for the Studio Profile was issued and the Profiles definitions where as proposed in the Profiles under Consideration document. The FPDAM contains the Core Profile, which, in contrast to the Simple Studio Profile, has multiple objects in the scene, and also sprites. Proponents of the Profiles confirmed that verification testing will take place before FDIS stage.

Streaming Video Profilesm6368 SC 29 Secretariat - Summary of Voting on ISO/IEC 14496-2/PDAM 4 (SC 29 N 3729) m6307 Jan Bormans - Report of the AHG on complexity evaluations of video tools m6128 Kristof Denolf et.al.- AC Prediction complexity analysis and concerns about FGS m6152 German National Body - Comments on ISO/IEC 14496-2:1999/PDAM4 m6263 Minhua Zhou, Hong Jiang, Weiping Li - Further Study on Complexity of AC Prediction m6247 The National Body of JP (JNB) - Comments on Streaming Video Profile m6153 A. G. Tescher for USNB - USNB Contribution: MPEG-4 Video Amendment 4 m6322 Yves Ramanzin, Mihaela van der Schaar - Philips proposal for SVP profile

ISG has met and discussed the results of the AHG studies. As a result, two options were proposed.1. Restrict encoder to restrict AC prediction with fixed Qp2. Restrict % of I MB in the VCV for level 3 (25%) and 4 (50%) when AC prediction has been

switched on.

Only the second option maintains compatibility, so this option was chosen, as three NBs requested this compatibility. It is understood that this did not remove al complexity concerns, but the Requirements Group believes that the compromise is reasonable and all members agreed to this.

The names were discussed. Several NBs had remarked that the current names are not adequate, as: they refer to applications rather than functionality there are more streaming profiles than just these two.Hence, the names were changed as follows: Simple Streaming video Profile Advanced Simple profile (a good name as, like Simple, it

does not contain arbitrary shape objects) Fine Granularity Scalability

It was also decided that in possible future revisions of the profile definitions Advanced Simple will remain a superset of Simple Both Simple and Advanced Simple can serve as a base layer or FGS.

NBs had requested the addition of tools that can improve performance. It was agreed that this is desirable, but there was uncertainty about potential syntax conflicts. So, a resolution was adopted to add ¼ pel and GMC if by the next ballot phase verification results are available showing that this is not the case. This is the only condition There were no complexity concerns about these two tools.

26

The use of interlaced tools was restricted to higher levels of the Advanced Simple Profile, in spite of the fact that it not completely in line with the rule in the profiling policy, which states that tools can only be excluded in the context of profiles, not levels. The alternative, creating yet another profile, was considered more undesirable (and is also in conflict with the policy). Furthermore, a precedent exists in the form of error resilience for Audio V.2 Profiles.

A Level 0 wws created for the Advanced Simple Profile, with only one object. This satisfied the request from the USNB.It is compatible with the anticipated request for further restrictions to the Simple Profile (see below)

A Level 0 for the Simple Visual Profile?

Andre Kaup, liaison between MPEG and the 3rd Generation Partnership Project, told that 3GPP wants to request a Level in the Simple Profile that further restricts its complexity, tailored to mobile terminals. 3GPP could unfortunately not approve the request in time for the MPEG meeting, The requirements group is sympathetic towards such a request, and will act as soon as it arrives.

FBA Nodes in Profiles

The question was raised where 3DMC and FBA nodes should be: in Graphics or Visual profiles. This will be discussed at next meeting, provided that a good analysis is present in the form of an input contribution. The question has been raised before, and in fact the Profiles under Considerations document (N3537) shows this in the form of the proposed 3D profiles.

IPMP m6248 Frank Bossen, Rob Koenen - Report of AHG on Content Access Problem Statement m6305 Frank Bossen, editor - Draft Call for Proposals for an advanced IPMP system m6228 Itaru Kaneko - Possible table structure to evaluate for IPMP proposal

The ‘Call for Proposals for IPMP Solutions’, that was drafted by the AHG, was further refined and then approved. It was decided that an initial evaluation of the submissions will take place in the weekend before the MPEG meeting, in the context of a new AHG.

There were some concerns about the coordination with MPEG-21. The CfP now calls for solutions in the context of MPEG-4. The CfP points to MPEG-21 (the PDTR of which is annexed) and notes that submissions may become a part of MPEG-21. It is anticipated that some responses to the CfP have wider applicability than the scope of the CfP itself, and may go further towards MPEG-21’s goals. This was considered an advantage rather than a problem, and there will be MPEG delegates that are involved in both the evaluation of the IPMP CfP and the MPEG-21 work.

m6304 Frank Bossen, editor - Content Access Problem Statement The Content Access Problem Statement has served its purpose, and the relevant material has been transformed into the requirements that are now included in the CfP. No output document will be produced, as this would duplicate what is already in the CfP.

m6175 T. Ando, M.Takaku, H. Inoue - DMIF support for advanced IPMP systems This concerns a proposal for DMIF support to set-up of secure channels. There is agreement that this may be a piece in a (much bigger) puzzle. It was only discussed briefly; a more thorough discussion will take place at he next meeting, as this proposal will most probably be part of a submission to the Call for Proposals.

m6130 P. Kudumakis - Liaison to MPEG concerning version 1.1 of the OPIMA Specification

27

A brief introduction to OPIMA was given. The OPIMA specification uses a secure virtual machine and well-defined API’s to IPMP Systems and to Application Services. This allows many scenarios. A more elaborate explanation will be given at the next meeting, as OPIMA will answer to the IPMP Call for Proposals.

m6229 Itaru Kaneko - Economy of renewability The meeting agreed with the author of this contribution that not all elements in infrastructure need renewability. Matters like these will be considered when evaluating responses to the Call for Proposals

Software PolicyN3535 documents MPEG-4’s software policy. Until now, this policy had not been available in an output document.

MPEG-4 OverviewThe MPEG-4 Overview has issued in a new version (N3536), notably adding information on the new and upcoming versions,

MPEG-7

Requirements A new version of the MPEG-7 Requirements Document was issued. (N3611)

m6151 Niels Rump - MPEG-7 IPMP AHG Report The AHG recommended to delete the following requirement from the MPEG-7 Requirements Document:, that was there without consensus and for further discussion:¬MPEG-7 shall not by design facilitate access/acquisition/use of pirated content, or:¬MPEG-7 functionality shall not be designed to exclusively facilitate access/acquisition/use of pirated content,or:¬MPEG-7 functionality shall not be deliberately designed to be used to exclusively access/acquire/use pirated content,or:¬something else still,or¬no such requirement at all

However, during the meeting, there was opposition to doing this without further modifications. To address the concerns from the rights holders communities, the following requirement was added:

Requirement (a) MPEG-7 shall support applications that distinguish between legitimate and illegitimate content(b) The MPEG-7 standard shall be constructed so as to allow clear and unambiguous reference, in external specifications, agreements and in legislation, to the clauses in the MPEG-7 standard that address the requirement (a) above.Note¬The ability to reference the relevant part of the MPEG-7 standard in contracts, laws etc., will allow the enforcement of this feature where appropriate.

28

The statement under (a) was already in the Requirements Document, while (b) and the note were added.This satisfied the concerns of all participants.

m6210 I. Sezan et.al. - Report of AHG on TV-Anytime Application It was decided to create a dictionary for MPEG-7, with a goal to see if there is overlap between descriptors. For the moment, the dictionary is viewed as an informative annex. There will be a DS dictionary, and then a D ictionary with definitions. It is still clear that TVA needs only some Ds DSs and not the entire set, and hence probably a profile. But no progress was made on the real question in defining the profiles is: which ones are not needed?It is required to define normative behavior in the context of TVA. Te next step will then be to define which part f the definition of normative behavior belongs to MPEG-7 and which to the application domain.

m6361 Hawley K. Rising III, Ali Tabatabai - A Two-stage Mapping for Application Specific Markup and Binary Encoding

Conclusions from the discussion: bi-directional mapping between binary and textual is not always required. (The same applies to XMT). Also, some applications need only subset of the DDL. The question is whether we should define application-specific subsets of the DDL. The contribution proposed Application Definition Languages, a subset of the DDL which can be expanded in the context of an application. The adopted approach was that proponents would joint the CEs on binary encoding, to see whether there is advantage is having application-specific binary encodings. There was some concern about adverse effects on interoperability. Some interoperability would be maintained by using XSLT (eXtensible Style Language Transform)

m6298 John R. Smith, Hawley K. Rising III - Report of the AHG on Conceptual Modeling m6299 John R. Smith for MPEG-7 CM AHG - MPEG-7 Principal Concepts List (V0.95) The work continues well. The results were integrated into the MPEG-7 Requirements Document, were they clarify the distinction between D and DS. The whole model is annexed to the Requirements Document as well. Also, the Requirements Group recommended to have the Conceptual Model as an Informative annex to Systems (the part that contains the MPEG-7 Architecture), including a description on how to use it.

The list of unaddressed concepts was used to make a table, showing if these topics were:1) addressed2) not yet addressed but there is interest3) not addressed and no interest exists

At the next meeting, we should use this for a check on whether all requirements are met. |This is a good exercise at CD stage.

m6149 Mikio SASAKI - A Proposal for Mobile Profile m6148 Mikio SASAKI - Adaptive Media Processing using Dependency Information

A Dependency Code for Media was proposed, that defines on what factors the media needs of a consumer depend (weather, location, time, etc.). Also, a specific profile for Mobile applications was requested. For the DCM, a Core Experiment should be defined in the MDS group. For the profile request, an AHG was created to study this interesting question, for mobile and similar applications. The results can be reviewed together with the results on the TVA AHG, but it was decided to keep the two issues separate to retain the focus on the mobile applications.

29

m6172 Michel Rynderman, Rosa Ruiloba - Video Editing DS Requirement Clarification The Requirements and MDS groups agree that MPEG-7 tools should not just be geared towards analysis of completed audiovisual material, but that an equally important application area is editing, and requirement 1 in section 4.4.1 was changed to make this clear.

m6356 P. van Beek, I. Sezan - Notes and proposals on MPEG-7 description access The Requirements and MDS groups agreed that it is necessary to signal the temporal validity and relevance of a description Also, it was agreed that the requirements for dynamic updates developed for the binary format also applies to the textual form. The requirement for access to partial descriptions was already covered in 4.5.1

Promotion to Industrym6158 Neil Day, Witold Reichhart, Caterina Saraceno - Report of the AHG for MPEG-7 Applications and

Promotion to Industry m6295 N. Day, W. Reichhart, C. Sareceno - Press Release of MPEG-7 Awareness Event m6196 Jose M. Martinez (UPM-GTI) – MPEG-7 Overview Lite m6301 N. Day, W. Reichhart, C. Sareceno - MPEG-7 Apps, Demos and Projects vs. 0.1

Several Documents have been written to explain MPEG-7 to the non-initiated. It is very good that this work has happened. There are now:

Introduction to MPEG-7 (N3545) MPEG-7 Applications, Demos and Projects (N3546) The MPEG-7.com website (see N3547 - MPEG-7.COM Website Structure and Design’ –

and the website itself. It was agreed that the structure of the website will be slightly adapted to have a less prominent presence of the sponsor)

Also available in Draft form were: MPEG-7 Awareness Event Press Release MPEG-7 Awareness Event Programme MPEG-7 Awareness Event Flyer

The Press Release, already well developed was modified a bit further to incorporate principles for a good press release. After discussion it was decided to not pay speakers, unless sponsor money was available. The main goal of the workshop is advertising MPEG-7 and explaining to interested people what MPEG-7 is, what it is good for and in broad lines what it contains.The program was considered not yet complete enough to proceed with a publicity event of this visibility. The decision was to postpone the awareness event to July 2001, when MPEG-7 will be finalized. In SG, an intermediate event will be organized, together with the SG host. This event will be more internal, but still open to anyone interested.

MPEG-21

AHG Pre-Meetings Attended:A telephone conference was arranged and held on 23rd June for which there were approximately 15 participants to assess progress and to have a first discussion about the proposals and recommendations which would result from the preparation of the Technical Report.

30

An ad-hoc group meeting took place in Beijing on Sunday 16th July starting at 4.00pm. The purpose of the meeting was to agree the work plan for the week, prioritise tasks and agree the allocation of responsibilities.

Input document reporting on the activities of the ‘ad-hoc’ group – M6198 The ongoing working document for the Beijing meeting was the MPEG-21 Technical Report

(currently N3400)

20.1 Summary of Activities:The Technical Report has been substantially revised during the Beijing meeting and now provides a more mature description of the requirements for a multimedia framework and proposals for future standardisation. After a final editing period of 4 weeks (up to 1st Sept) the Proposed Draft Technical Report will be distributed by the SC29 secretariat to National Bodies for review. One month later they will be balloted so that the Technical Report can continue to the next phase which will lead to a Committee Draft (CD) status.

One concept introduced early on in the Technical Report is the MPEG-21 Digital Item. This entity has the following definition: An MPEG-21 Digital Item is a structured digital object with a standard representation, identification and meta-data within the MPEG-21 framework. This entity is also the fundamental unit of distribution and transaction within this framework. An MPEG-21 Digital Item can be regarded as a 'compound' (using chemical formulae as an analogy) rather than an 'element' and so an item can be a collection of things that need to be identified and described. Hence, MPEG-21 is looking beyond existing systems for the identification and description of content. For example, it is likely to consider the identification and description of 'transactions' in the sense of event reporting, and the identification of the items themselves.

The Technical Report is introduced by a problem statement and a solution statement. The vision statement for such a multimedia framework is “to enable transparent and augmented use of multimedia resources across a wide range of networks and devices”. This is accompanied by goals which will lead to the attainment of this vision. A more detailed description of a multimedia framework follows which sets out the functionalities of such an architecture, grouped into seven architectural elements. Inevitably it is recognised that there will be some overlap between the elements but it is considered that a sufficient distinction can be made for the purposes of standardisation. In addition, the user requirements within a multimedia framework are described separately as they impact upon each of the seven architectural elements. In summary the elements comprise:

1. Multimedia content representation (how the data is represented as different media)2. Content management and USge (the provision of interfaces and protocols that enable creation, manipulation,

storage, delivery and (re)use of content across the content distribution and consumption value chain)3. Digital Item Declaration (a uniform and flexible abstraction and interoperable schema for declaring digital

items)4. Digital Item Identification and Description (a framework for identification and description of any entity

regardless of its nature, type or granularity)5. Intellectual Property Management and Protection (the means to enable content to be persistently and reliably

managed and protected across a wide range of networks and devices)6. Terminals and networks (the ability to provide interoperable and transparent access to content across networks

and terminal installations)7. Event reporting (the metrics and interfaces that enable Users to understand precisely the performance of all

reportable events within the framework)

In creating its definition of a multimedia framework and in making its proposals and recommendations for further standardization, it is necessary for MPEG-21 to take account of other related multimedia activities. The Technical Report identifies other multimedia initiatives which are currently in progress that should be considered as candidates for future interaction and collaboration with the standards work plan agreed by MPEG-21.

The Technical Report sets out the requirements of the User in the multimedia framework. A User is any entity that interacts in the MPEG-21 environment or makes use of an MPEG-21 digital item. Such Users include individuals,

31

consumers, communities, organisations, corporations, consortia, governments and other standards bodies and initiatives around the world.

Section 5 of the Technical Report elaborates the elements in the framework identified above. For each element, an overview of the current situation is given. Subsequently, the existing shortcomings, problems and issues associated with each element are identified. Finally, the opportunities for innovation and standardisation are highlighted.

The final section of the Technical Report sets out the proposals and recommendations for the future work plan to standardise components of the architecture to support a multimedia framework.

The work on the further refinement of the PDTR will continue up to the next MPEG meeting in La Baule, FR in October, following which a Study on the PDTR will be produced. It is also planned to issue the first Calls for Proposals related to MPEG-21. The precise scope and areas to be addressed by each Call is to be decided in the intervening period.

Assessment of progress:In general the work to develop the vision of MPEG-21 as expressed in the Technical Report has been supported by the participants in the group and by the WG11 Plenary. This is probably because the TR is still reaching a sufficient level of maturity and understanding by those who are not directly contributing to its development.

One area that did cause a reaction during the final plenary was the language that expressed the proposals and recommendations for the future standardization of IPMP. The notion of a trusted framework for IPMP, the development of languages to express the codification of norms and rules, and the expansion of these languages to allow the expression of public policies and rules stemming from sources other than Rights Holders, such as governments and other relevant rule-making bodies, caused a vigorous debate. No conclusions were reached but these issues will no doubt be the focus of much discussion at future meetings in the definition of their requirements.

‘Ad-hoc’ groups established:Four new ‘ad-hoc’ groups have been formed for the period leading up to the La Baule meeting. These are:N3554 – Ad-hoc group on PDTR StudyN3555 – Ad-hoc group on PDTR EditingN3556 – Ad-hoc group on MPEG-21 Use Case Scenarios and User RequirementsN3557 – Ad-hoc group on MPEG-21 Calls for Proposals

The Reflector for the AHGs are: [email protected]

The output documents from the Beijing meeting are: N3500, MPEG-21 Proposed Draft Technical Report, which will be publicly available following

an editing period from 1st September. A first draft Use Case Scenario document N3549 which will also be publicly available.

Studies

Digital CinemaRequirements were discussed on Video, Graphics, Systems and Audio. The requirements are found in the document Digital Cinema Requirements (N3539). Requirements differ for the archive and the Distribution applications.

32

Audio requirements are not critical for this application, and Audio and Systems requirements are most probably already supported by MPEG-4 Systems and AAC. Therefore, we only anticipate a Video CfP. Theis CfP was drafted (N3542), and will be issued at the next meeting. The intention is to have an evaluation meeting in San Jose, the week before the SG meeting.

Testing is a difficult issue. Proper procedures do not exist, we will have to improvise and invent procedures ourselves. Thoughts are expressed in Evaluation procedure for Digital Cinema, N3540.Also the content is not yet available, and hence a Call for Content was issued, both for Audio and Video: ‘Call for Content for Digital Cinema Evaluation’, N3541.

Watermarking

m6302 Y-K Chen, H. Sakamoto - AHG Study on Standard Digital Watermarking Technology The AHG recommended two applications that could warrant standarisation:

Meta-watermark Error resilience

m6363 Youichi Takashima, Hideki Sakamoto - The possibility of the meta-watermark The Requirements Group understood the application, but did not fully comprehend the problem that the application was trying to solve. This is not a small question, but its definition of this is ongoing in MPEG-21 effort. We will address this first, and then ask for proposals. The meta-watermark can be part of the solution to the problem that MPEG-21 is defining in the area of content identification, management and protection.

m6303 Skip Macy - Non-IP-Protection Digital Watermarking Applications A number of application are mentioned that involve carrying metadata-like information. MPEG-7 and MPEG-4 define this type of data, and watermarking could be a way to carry that information. MPEG-4 and MPEG-2 have ways of carrying metadata (including MPEG-7 info). The question is: is there a need for additional ways? E.g. a channel that is still present when content is carried in the analogue domain?

m6339 C-W Tang, et.al. - Proposal for Some Non-Security Watermarking Applications m6340 Teng Sing Wang, et.al.- An Error Detection Scheme using Data Embedding for H.263 Compatible

Video CodingThe idea seems interesting: error resilience tools that are aided by watermarks. Error resilience is an MPEG-4 requirement. There were many questions about the effectiveness, also in comparison with other ways of conveying the same information. More evidence is needed to see whether it really works, and, if it does, whether there is enough support to pursue it.

The discussion after having heard all presentations: There was a general concern about watermarking, voiced by people from the rights

communities: there are many purposes, and they will interfere with one another, and all of them will degrade signal quality. Please be careful in standardizing the USge of the available bandwidth for data embedding.

While the Requirements Group currently sees no reason for MPEG to standardize watermarking specifically for a particular application, it could be worthwhile investigating the benefits of standardizing watermarking as an additional datachannel. The Requirements group welcomes contributions and NB positions on the desirability of such a standardization effort. The Requirements Group also welcomes contributions on requirements for such a generic watermarking technology.

33

Potential use of watermarking in IPMP-related areas is dealt with in the context of MPEG-4 IPMP and MPEG-21.

34

Annex 5Systems Group Report

Source: Olivier Avaro

OverviewThe main results of the meeting from the Systems Sub-group perspective are:

MPEG-2 No.Text of 13818-6 FPDAM 3 N3558Request for Amendment 1 on 13818-1:2000 N3559Text of ISO/IEC 13818-1:2000/DCOR 1 N3560MPEG-4 No.Draft text of ISO/IEC 14496-1:2000 N3561Draft text of ISO/IEC 14496-6:2000 N3562WD of ISO/IEC 14496-1/COR2 N3563DoC of 14496-5/FPDAM 1 N3507Text of 14496-5/FDAM 1 N3508Text of ISO/IEC 14496-5/DCOR1 N3509Request for amendment 1 to ISO/IEC 14496-4 N3504DoC of 14496-4/PDAM 1 N3505Text of 14496-4/FPDAM 1 N3506Systems Software Version 2 Status N3564Systems Software Version 2 Implementation Workplan and Demo Pack N3565Draft proposal for core experiment on RTP mapping schemes N3567Bitstream Exchange workplan for Version 2 and 3 N3568Study of ISO/IEC 14496-1/FPDAM 2 N3569Request for ISO/IEC 14496-4/Amd.2 N3570WD 2.0 of ISO/IEC 14496-4/Amd. 2 N3571Potential items for a possible Amendment 2 to 14496-6 N3572WD 3.0 of ISO/IEC 14496-1 Amd. 3 N3573Call for Proposal for Multi-users Worlds technology N3574MPEG-7 No.MPEG-7 DDL WD 4.0 N3575MPEG-7 Systems WD 1.0 N3576Core Experiment Process for the evaluation of MPEG-7 Binary and Dynamic Descriptions

N3577

General No.FAQ Revision 15.0 N3578

A detailed report can be found below.

General issuesThe following contributions have been reviewed:

N° Title6370 Systems March 2000 Meeting Report

35

M6370: The document was a late report from the Geneva meeting. It was presenting on Monday and approved at the end of the week.Systems FAQ have been updated (contributions on MPEG-J, DMIF).

MPEG-2 Systems

GeneralThe MPEG-2 Systems 2000 edition has been reviewed during the week by Dominique Curet, Matt Goldman, Sam Narasimhan and Peter Schirling. No errors have been noticed in this new edition of the MPEG-2 standard.

Corrigendum 1

The following contribution has been reviewed :

N° Title6165 4on2, a missing descriptor?

M6165 : This document highlights a mistake made during the specification of Amd 7 to MPEG-2 Systems: one descriptor was forgotten. A new COR to MPEG-2 Systems has been produced, proposing the inclusion of the said descriptor.

Amendment 1

The following contributions have been reviewed :

N° Title6313 FNB comment on request for carriage of metadata over MPEG-26126 DNB Comments (Metadata on MPEG-2)6287 Incoming liaison from SMPTE6201 Request for a liaison with respect to technical activities for specifying carriage of metadata in MPEG-2

Transport Streams6127 Response to the call for contribution on the carriage of metadate over MPEG-2 Transport

M6313, M6126 : Request from NB to produce specification for the transport of MPEG-7 on MPEG-2 and to M6127 as a starting point.

M6287 : Request from SMPTE to produce specification for the transport of MPEG-7 on MPEG-2. Reserved judgement on 6127. There is also a binary encoding proposed that has been discussed in the appropriate group. Informal information from the SMPTE liaison: there is on-going work in SMPTE on these issue. There will be an input document in La Beaule discussing in particular SMPTE position on mapping of metadata time to MPEG-2 time. No proposal was made in Beijing.

M6201 : Liaison from ATSC asking information exchanges on these matters. Relevant documents will be sent to them. The Systems sub-group expects that the SMPTE proposal will be based on the attached ATSC standard that covers a broader scope.

M6127 : This document contains (1) requirements on the carriage of metadata over MPEG-2 Systems. They were discussed, and an agreement was found on a modified text. Agreed text is an output from the requirement sub-group (“Requirements for the carriage of metadata over MPEG-2 Systems”); and (2) technical solutions. There were not discussed so far.

A request of amendment for the carriage of metadata over MPEG-2 Systems was produced. The rational for the request refers to the requirements described above. The timeline for the amendment is:

PDAM in October 2000FPDAM in March 2001

36

FDAM in July 2001IS in September 2001

Technical content of the amendment will be discussed on the MPEG-7 Systems reflector.

MPEG-2 DSM-CC

Amendment 3Extensive changes to formatting (template), grammar, spelling have been made to the document which is now at the stage of FPDAM. All modifications are editorial. No changes in the technical content. Since their were no comment, no DoC was produced.

MPEG-4 Systems

General

The following contribution has been reviewed :

N° Title6211 Draft integration of MPEG-4 system specifications (V1, COR1, and AMD1)

M6211: The Systems sub-group acknowledge the progress of MPEG-4 Systems and DMIF editors to provide an integrated document for the Version 1, Version 2 and corrigendum 1 of the MPEG-4 Systems and DMIF specification and thank them for their sustained efforts. The status and planning delivery of these specifications is as follows :

- July 2000 : WD of integration of IS14496-1 Amd1 into IS14496-1 and COR1 and WD of integration of IS14496-6 Amd1 into IS14496-6 and COR1;- October 2000 : Final text of integration of IS14496-1 Amd1 into IS14496-1+COR1 and final text of integration of IS14496-6 Amd1 into IS14496-6+COR1.

Young-Kwon Lim is appointed as editor of IS14496-1:2000. The following reviewing committee : Olivier Avaro, Paul Christ, Yuval Fisher, Carsten Herpel, Young-Kwon Lim, David Singer, Vishy Swaminathan, will review the current draft text of IS14496-1:2000 (N3561) until the La Baule meeting.Guido FRschini is appointed as editor of IS14496-6:2000. The following reviewing committee : Olivier Avaro, Paul Christ, Guido FRschini, Carsten Herpel, Javier Zamora, will review the current draft text of IS14496-6:2000 (N3562) until the La Baule meeting.Draft text of ISO/IEC 14496-1:2000 and ISO/IEC 14496-6:2000 have been produced.For the promotion of the Systems specification, it was decided to make content available in the Web Site. Olivier Avaro will provide a template (Description, Snapshot, link to mp4 files). The following companies : IBM, ENST, face2face, E-vue, have agreed to provide content streams. Some conformance streams will be used as well. More inputs are welcomed.

Corrigendum 2


N° Title6199 ESM specification issues6200 BIFS specification issues6121 Candidates for Systems COR26329 Lisaion from Web3D: Miscellaneous clarifications on 14496-16184 Proposed changes for corrigendum of 14496-1 Amd1- Advanced Audio BIFS6271 KNB Comment on 14496-1/AMD1 (3DMC)

37

M6199, M6200, M6121, M6184 : Comments have been studied. Approved comments have been documented in COR2 WD of ISO/IEC 14496-1/COR2.M6329 : The Systems sub-group thanks Web3D for their valuable technical comments on the specification. All have been discussed and most have been agreed. Agreed comments will be part of WD of ISO/IEC 14496-1/COR2 (Corrigendum of MPEG-4 Systems).In particular :- Comments on Hierarchical3D mesh. Agreed. Yuval to modify the template and report needed

modification to the table.- IndexedValue BIFS-Update Delete. Agreed.- NULL values for SFNodes. Agreed.

M6271: Clarification of the use of IFS node and 3DMC. The result of the discussion is documented in the WD of OR2. Partitioning of scene containing compressed and non compressed IFS can be done by putting different BIFS streams under the same OD. Profile and levels using this compressed IFS need to be defined. Special care needs to be given to BIFSV2config. For future functionality (ex: animation framework), it would preferable to have new nodes. In addition, it was mentioned that we may need an IETF draft that specifies the fragmentation of a BIFS scene for RTP transport (including fragmentation of 3DMC streams).M6184: The AABIFS corrigenda proposed by Jean-Marc and Jean-Bernard were incorporated to Systems COR2 WD document.As the Corrigendum 2 for Systems is currently in Working Draft stage, changes and additions can be introduced via normal input contributions in La Baule.MPEG-J Issues : Channel ID in Net APIs: These have to be changed to ESIDs. This has to be verified by implementation and incorporated into the Corrigendum-2 on 14496-1. This is still pending. Locking Mechanism for the BIFS scene is a requirement. However, this problem is not particular to MPEG-J as it is true for BIFS updates and other forms of scene updates too. The following changes to the COR-2 are recommended from the MPEG-J break out group:Remove 2.1 subclause on MPEG-J Node Creation, remove 2.4 subclause on using int[] for getScreenSize() of Capability of APIs, remove 2.6 subclause Terminal Profile APIs does not include version 2 profiles. The above subclauses are not relevant as the Amendment was fixed on the latest version.

Transport of MPEG-4 over IP Networks


N° Title6150 A Framework for the delivery of MPEG-4 over IP-based Protocols6349 Comments on N3381 (framework for delivery of MPEG-4 over IP)6283 Comments on N3381A Framework for the delivery of MPEG-4 over IP-based Protocol6169 Update to N3381, "a Framework for the delivery of MPEG-4 over IP-based Protocols"6269 Delivery of MPEG-4 streams over RTP6162 SDP syntax for MPEG-4 payloads6164 RTP payload for FlexMux streams

The goal of the framework for the delivery of MPEG-4 over IP-based protocol has been discussed and the following has been agreed :- The framework should provide a specification for an end-to-end solution with a minimal set of

mandatory technology so that base line interoperability is ensured;- The framework should be complete and should propose some default tools for all the

technologies that are needed to achieve 4 on IP. This does not restrict to MPEG-4 Systems, but to MPEG-4 at large;

38

- There should not be different tools for the same functionality in a given application areas; in case there are similar tools for a given functionality, the group will decide for a process and a timeline to reach a decision;

- When finalized, the whole framework will be approved by MPEG and recommended to IETF.During the meeting, the process has been to take the last meeting output as the reference, to start with document M6150 and highlight points of disagreement, then to browse through the other contributions and to solve “solvable” issues. The framework document has been updated.Most of the issues in the framework has been solved, but the packing format. A process to reach consensus on the definition of the packing format is defined in the AHG of N3586. The process consists in identifying requirements and to develop a solution matching these requirements starting from the Vancouver consensus. The goal is to finalize requirements by the 11th of August 2000, and to finalize the framework by the La Baule MPEG meeting in October 2000. In the meantime, we recommend MPEG members not to propose any new draft to IETF and ITU on carriage of MPEG-4 on IP protocols.M6150: The document has been used as a reference for the discussion. The output document, which provides the framework for 4onIP issues, is the result of the editing occurred on top of M6150. Most of the discussion concentrated on the RTP mapping issue, with two objectives: identify a default scheme to make mandatory in all cases; identify MPEG-4 requirements for more advanced/efficient schemes. The identified requirements are, among others which are already satisfied by all the known proposals: ability to add redundancy to protect the content, through FEC, Interleaving, etc; low overhead; grouping. Note that grouping relates to low overhead: for certain Ess it is possible that a great number of small Aus are produced in a very short time: it should be possible to group all of them into a single RTP packet without altering their timing information.M6349: This document proposed a couple of ideas for the IP Multicast scenario: as a result, a new section 6 was introduced in the framework document, incorporating the idea of using URLs in the ESD to directly access Ess in a multicast session.M6283: This document requested that the framework for 4onIP concentrates on Systems issues only, while management of ‘pure’ audio and video streams would have been covered by a separate Internet Draft, already in an advanced stage. The feeling of the majority of the group was instead that the framework document should act as a reference for all 4onIP issues, providing pointers to the appropriate specifications. The main point of disagreement occurred when discussing a default RTP mapping scheme, that the majority of the group would have liked to have common among ‘pure’ and ‘SL-packetized’ streams. The proponents of the Internet Draft for ‘pure’ Audio and Video refused to consider updating that specification to make it compatible with a possible variation of one of the current proposals for SL-Packetized streams. Attempts to study mechanisms to enhance/update the Civanlar et al. proposal for SL-Packetized streams in order to make it an actual superset of the current specification for ‘pure’ Audio and Visual streams failed. Another point of disagreement related to MIME types, since the above mentioned Internet Draft defines ‘MP4A’ and ‘MP4V’ for ‘pure’ audio and video streams, whereas such strings seems to imply the USge of the MP4 File Format (which, in fact, is a possible option). It was decided however that this is a matter of taste, and that it is not worth to modify the current situationM6169: This document proposed some updates to the framework document, most of which were accepted. The changes were mostly covering the flexmux related issues.M6269: This document contained the Internet Draft for the carriage of MPEG-4 ESs over RTP – Generic Payload. The advantages of the proposed technique were highlighted, and this lead to some revisions of the text in the framework document.M6162: This document proposed some updates to the framework document, which were basically accepted. The changes were covering the flexmux related issues in SDP.M6164: This document contained the Internet Draft for the carriage of flexmux stream over RTP. No particular action had to be taken.

39

Finally, the need of more advanced packing was identified, in particular to be more error resilient and to support streams grouping. MPEG intends to define one or more advanced packing that will solve this needs. A process to define this packing it is under specification in core experiment.

Miscellaneous ESM/DMIF issues


N° Title6170 Update to the Graphical representation of object descriptor and sync layer syntax6166 Deterministic DMIF6167 Another FlexMux tool with longer PDUs6250 Proposal of Traffic Descriptors for Use of VBR Channels for VBR Traffic

M6170 This document provides the corrected informative Annex J for Systems, which contains a graphical representation for ODs. This Annex was not updated with COR1. One more mistake was identified. This corrected Annex J.M6166 : This contribution proposed two modifications: one new additional channelDescriptor at the DAI, for a future DMIF amendment, and one fix to a table for a future Systems corrigendum. The first proposal in particular addressed the ability to enable flexmux streams to be generated offline at the transmitter side while still using the DAI. The problem arose since the flexmux tool is modeled to be internally managed by the DMIF layer, thus no provision for a pre-recorded flexmux stream is specified at the DAI. It was observed that this kind of optimization is more in the realm of implementation issues, and should therefore be left out of the scope of the specification. Also, CSELT has already made a similar implementation and has faced problems in making just exactly the addition proposed: CSELT may check how the problem was solved in its implementation, but doubts on the legitimization of the proposed addition remain.M6167 : This document proposes the definition of a new flexmux tool, with enhanced features. It is said to be more efficient in certain cases, but no quantitative evidence was made for some concrete scenario. The proposed tool will not be considered for inclusion in a future Amd to Systems until such figures will be made available.M6250 : This document presented a proposal to add new QoSdescriptor in both the ESD (Systems) and at the DAI, as well as enabling a more sophisticated mapping of QoSparameters into ATM Signalling (DMIF). The entire QoS framework built in MPEG-4 aims at enabling the definition of appropriate descriptors, but only a incomplete list of them has been specified so far. The framework was designed to be easily extendible in future, when better knowledge of QoS parameters was achieved. This contribution tries exactly to fill the hole. The proposed additions will become (potential) items for future amendments in both Systems and DMIF. Text for the DMIF part has been provided and included in N3572.

Amendment 2


N° Title6140 A proposal for media control in ISO/IEC 14496-16327 Lisaion from Web3D: Clarification on Media Control and the DMIF/Systems interface6347 Study of ISO/IEC 14496-1/FPDAM2 (Segment Descriptor)6330 Lisaion from Web3D: Clarifications on Flex Time

M6327 : The Systems sub-group thanks the Web3D for their technical comments mostly addressing the media sensor and media control specifications. Comments have been taken into account, in particular DMIF issues, Node Interface issues, Buffer and PreRoll issues. The Systems group thinks that reasonable compromises have been documented in the study of ISO/IEC 14496-1/FPDAM 2.

40

More precisely, on Media sensors, most of the comments have been agreed. Concerns have been raised that only the time is “sense” from the OD and segment and not other properties that may be useful in the scene (segment available, OCI, MPEG-7 data).M6140 and M6347 : The documents have been discussed and served as the basis of the documentation of the study document.M6330 : The Systems sub-group thanks the Web3D for their comments. The main issue is the children field that brings lot of complexity in the specification. The concern is acknowledged but the functionality is requested by some companies in the MPEG community. The specification will be clarified, highlighting practices that should be followed to use this technology safely. Flextime can be subset in some profiles and levels if less functionality are needed in some application domain.

Amendment 3


N° Title6204 Authoring in the Extensible MPEG-4 Textual Format (XMT)6326 Lisaion from Web3D: Clarification on the textual format XMT6163 XML syntax for some descriptors

M6204 : The XMT specification has been reviewed and updated. The timeline for XMT has been aligned with MPEG-7. This means that only a WD has been output in Beijing and that the specification will go to CD in La Baule.M6326 : The Systems-subgroup thanks the Web3D for this contribution. A detailed answer can be found in the Liaison document.M6163 : Proposal for Flexmux descriptors to be included in XMT. Proposal accepted.

MPEG-4 Conformance and bitstream exchange

Profiles and Levels


N° Title6131 Advanced Audio Profile6134 Swiss National Body Position on Profiles for version 3 of MPEG-4 Systems (14496-1 PDAM 2)6314 Declaration of intents concerning MPEG-4 Advanced Audio BIFS6329 Lisaion from Web3D: Miscellaneous clarifications on 14496-1 (OD L1)

M6131, M6134, M6314 : Based on the Swiss NB request, the 3D Audio Profile has been considered for MPEG-4 Systems v.3 (14496-1/FPDAM2). This amendment is currently under ballot (until end of September), so the National Bodies should take this into account when the voting is done. The profile definition will be document in the “Profile under consideration” document. It contains a 3D Audio Scene Graph and a 3D Audio Graphics profile.M6329 : The Systems sub-group thanks the Web3D for their technical comment. The contribution states that there is no Core Profile Level 1 OD ID and proposes one. Still, levels without parameters restriction are useless and some levels will be defined in V3 Profile and Level. The proposition is therefore rejected.

Conformance Amendment 1


41

N° Title6342 Finnish NB comments on MPEG-4 ver. 2 Conformance (Audio BIFS conf.)6185 Draft text for Advanced AudioBIFS Conformance testing – Perceptual Approach

M6185 and M6342 : Conformance changes to AABIFS physical approach and the text to AABIFS perceptual approach were integrated in the conformance document. The MPEG-4 version 2 conformance document has gone to FPDAM, there is still a possibility to introduce changes via NB comments to the La Baule meeting.MPEG-J Conformance : The verification mechanism decided in the Noordwijkerhout meeting (found in the systems report of Noordwijkerhout) has been adopted in the Conformance document.

Conformance Amendment 2


N° Title6203 Conformance for the FlexTime Model

M6203 : The document will be included in the WD of Version 3 conformance.

Bitstream Exchange

The work plan for production of test streams for MPEG-4 Systems conformance as been updated. The group acknowledged the commitments of the following companies to provide test streams and/or test tools for MPEG-4 Systems conformance: AT&T, CSELT, ENST, EPFL, Face2Face, FT R&D, HUT, IBM, Optibase, Philips, and Sun Microsystems inc., according to the work plan described in N3287 and encourage other companies to join this effort.

The following technology : DiscSensor, PointSet2D, ProximitySensor2D shall be removed from ISO/IEC 14496-1 if commitments for producing test streams are not made by the La Baule meeting.

MPEG-J Bitstreams Exchange: It was decided that the same plan for bitstream exchange decided in Maui is still active. The listed parties are urged to release the bitstreams as soon as possible and positively by the October 2000 MPEG meeting. It is understood that some bitstreams have been released but not in MP4 format. The following companies agreed to bitstream exchange for different API categories:

API Responsible Companies DatePERSONAL PROFILE

Resource Sun, CSELT OctoberDecoder Sun,

AT&T (Verification) October

Scene FR Telecom, IBM OctoberMAIN PROFILE

Net CSELT, Sun OctoberSI and SF Philips, CSELT October

MPEG-4 Reference Software

General

The following document has been reviewed:

42

N° Title6125 FlexTime Implementation with Core 5.06202 IM1 Implementation of the FlexTime Model6337 MPEG-J Implementation Status and Workplan6350 IM1 Core code + authoring tools version 5.06123 IM1 Decoder Development Kit version 2.06124 Update of the MP4 File Producer6129 Modification to the MuxHint file format

The usual documents on Im1 status and implementation work plan have been produced

MPEG-JGeneral

The following action items are still pending for the reference software:

Scene Samples for verification of the Scene APIs. Cleaning up the directories in the CVS server and removing the unwanted files and directories. Care should be taken to ensure easy implementation, compilation and installation. Making a snapshot available with the latest APIs and implementations in the Systems FTP site after the integration

is complete.It was agreed that MPEG-J would not be obliged to move with new versions of the core. However, it was also agreed that the individual contributors would give test cases that could be used to test the implementation by whoever updates the core.

Implementation Status Updates: MPEG-J Decoding Engine Clean Handling of MPEG-J Streams. Eliminated the need for a fake video node. Handles Compressed Zip Files . (Demo/Test bitstreams uploaded). APIs: Resource: Attach/Detach of Elementary Streams and changing Decoders (Demo/Test bitstreams uploaded). SI/SF: Ported to Core 4.0 and integrated with the rest of the codebase. Currently being tested. Muxer: Cleanly handles filesizes. JavaStreamHeader: Handles Compressed Zip files.

API/Work Item

Status Responsible Person(s) (Affiliation)

Integration with last Core version

PENDING Zvi/Vishy

SI and SF Porting to Core 4.0 and Integration DONE.

Viswanathan Swaminathan and Praveen Alavilli (Sun).

Testing and Verification: PENDING

Jean Gelissen(Philips)

Scene APIs Integration: COMPLETE, BEING TESTED

Bob Schmidt (AT&T),Yuntai Kyong (Columbia Univ.), Viswanathan Swaminathan (SUN)

USENAMES, insert/delete ROUTES: Pending

Alex MacAulay(FR Telecom R&D)

Resource APIs Done Yuntai Kyong (Columbia

43

API/Work Item


(Feature Enhancements)

Univ.) Viswanathan Swaminathan (Sun).

Java Stream Header(Feature Enhancements)

Done. USge of Time Stamps (Pending).

Yuntai Kyong (Columbia Univ.) Viswanathan Swaminathan (Sun).

Class Loading extensions, Renderer extensions, and Scene Extensions

Integration: Pending Alex MacAulay(FR Telecom R&D).

Implementation Work plan

API/Work Item (Module)


Schedule

Integration with last Core version

Pending Zvi/Vishy Sep 15

SI and SF APIs Testing and Verification

Jean Gelissen(Philips)

La Beaule

Scene APIs Testing and Verification

Viswanathan Swaminathan (Sun/Columbia)Robert Schmidt (AT&T)Alex MacAulay(FR Telecom R&D)

Aug 15

USENAMES, insert/delete ROUTES: Pending (COR 2)

Alex MacAulay(FR Telecom R&D)

La Beaule

MPEG-J Decoder USge of Time Stamps (Pending).

Viswanathan Swaminathan (Sun/Columbia).

La Beaule

Renderer Frame Events/Using non-class Data

Pending Alex MacAulay(FR Telecom R&D).

Aug 15

Demonstrations

Checked-in samples/DemoNew samples that demonstrate the attaching/detaching Elementary Streams of the Resource Manager APIs, Decoder APIs were checked in to the CVS server. This being a technology demo was shown the MPEG-J break out group only. Demo work plan It was agreed that a compelling demo has to be shown in the La Beaule meeting.

MPEG-4 Exploratory activities

Multi-user application

The following contributions have been reviewed:

44

N° Title6328 Lisaion from Web3D: MatteSurface X3D

node proposal6353 Proposed changes on the Requirements for

Multi-users Worlds6205 Study of the Upstream Technique for MPEG-

4 BIFS Scene

M6328: The Systems sub-group thanks Web3D for their proposal on MatteSurface. The technology has been found useful (as already evaluated in Maui) and is already supported by the MPEG-4 requirements document. However, it is too late to include this functionality in the Version 3 of the standard according to MPEG-4 rules. Still, there are many opportunities to standardize this functionality further. The multi-user framework is one. Moreover, some concerns were raised that this functionality is already supported by the MPEG-4 standard at the Visual level. An Ad Hoc Group will therefore study how the technology compares with already standardized technology.M6353 : The changes have been studied and the approved ones included in the requirement document.M6205 : The functionality is has been discussed and the conclusion is that it is indeed needed. A requirement has been added to the multi-user requirement document.

The Call for Proposal on MPEG-4 Multi-users functionality has been issues.

Usage of MPEG-4 for Cartoons


N° Title6268 Preliminary results of USge of MPEG-4 for cartoons

M6268 : The contribution provides information on the performances of a tool that converts Schockwave files in MPEG-4 mp4 files. It also provides a preliminary analysis on the tools that maybe missing in MPEG-4 to achieve this application. Final results are expected before further action.

MPEG-7 Systems

General


N° Title6356 Notes and Proposals on MPEG-7 Description Access6249 Dividing methods for MPEG-7 Description6290 MPEG-7 Systems Potential API Requirement6291 MPEG-7 Systems V0.6 Input6251 Delivering MPEG-7 Descriptions – a preliminary analysis

M6356 : This contribution describes requirements and concepts for MPEG-7 Systems (ex : notion of top elements, textual and dynamic representation, random access to description). It proposes the notion of containers (header + data) to structure the description and form access units. Relevant information have been introduced in the Systems WD 1.0. DS that shall be visible at the Systems layer (ex : AccessUnit DS, Containers, Hint DS, …) will be defined in Systems while other

45

structuring constructs (ex : Root Elements, High level description structure DS) will remain at the MDS level.M6249 : This contribution proposes dividing methods for MPEG-7 Description. In particular, there may be a need to extend the reference DS to reference entity in external document. This is to be discussed with the MDS group. Other functionality proposed in this contribution needs to be check with the AHG on binary and dynamic description.M6290 : This contribution proposes requirement to manage descriptions and multiple access to description. The requirement has been adopted. Technical contributions these areas of work are encouraged. Depending on the received contributions, a Version 2 of MPEG-7 Systems may be started.M6291, M6251 : These documents were used to produce version 1.0 of the MPEG-7 WD.

Binary Description


N° Title6361 A Two-stage Mapping for Application Specific Markup and Binary Encoding6142 Proposed Initial Framework for MPEG-7 Systems6359 Proposed Syntax for Synchronized Commands Execution6292 MPEG-7 Bin-Sys Comparison of Binary Encodings

M6142, M6359, M6292 : These contributions addresses the binary representation for MPEG-7 descriptions. Work on the AHG will be carried on to harmonize them and produce and integrated document in La Baule.M6361 : This contribution proposes to define binary representation based on MPEG-7 profiles. How much gain can be obtained by scoping the DS/D to be encoded by application domain is to be evaluated in the core experiment. Known limitations : loss of interoperability between application at the binary level.

The Systems sub-group welcome the future submission of further contributions on binary and dynamic MPEG-7 data representation. A core experiment process for evaluating such technology has been documented in N3577 and should be followed by the proponents of new technology on this issue. The deadline for submitting new proposals is set to be the 54th MPEG meeting (00/10/17). Proponents should be aware that work on this topic is ongoing in the “Adhoc Group on binary and dynamic MPEG-7 data representation” (N3581) and that they are kindly invited to participate in the work of this Adhoc Group.

DDL

The following topics have been addressed during the meeting : Clarification of MPEG-7 extensions to XML Schema : issues on variable length arrays, matrices and typed

references have been finalized. Production of DDL WD 4.0. The DS and D groups will be notified of changes which affect them.

Concerning the DDL implementation, the simplest approach for adding MPEG-7 extensions to Xerces Java XML Schema was determined as well as the simplest approach for integrating parser(s) into the XM.

The objective of the DDL experts is to have an MPEG-7 Java parser ready by La Baule.

MPEG-21

46

A joint meeting was held between the Requirements sub-group and the Systems sub-group on MPEG-21. Presentation of areas of joint interest have been made : Network and terminal APIs (MPEG-21 TNET, MPEG-4 DMIF and MPEG-J); Content management; Content representation (MPEG-21 Digital items, MPEG-4 XMT, MPEG-7 description).Several action points to exchange further information have been taken. Interaction between both groups on this topic should continue in La Baule. Systems experts are encouraged to participate to the MPEG-21 project definition.

47

Annex 6Multimedia Description Schemes Group Report

Source: Philippe Salembier, John Smith, Ana Benitez, Toby Walker, Yoshiaki Shibata

Overview:The main activity during the week has been to: 1. Review the results of the core experiments approved during the Geneva meeting,2. Select the DSs for inclusion in the XM and in the WD,3. Define the workplan for software integration of the DS promoted to the XM,4. Review input contributions, 5. Define new Core experiments.

Kick-off of the workDuring the kick-off session, the workplan for the week was discussed and approved. Furthermore, the following points were discussed: Creation of an end-to-end description using a large number of DSs (also known as the "Monster

description"). John Smith reported on the selection of the content and on the current status of the description. A fairly high number of people volunteered during the week to contribute to this description creation. Further work will be done on the AHG on MDS XM & WD editing.

In order to improve the quality of the MDS XM & WD documents, reviewers have been assigned to specific sections. The following people have agreeded to review the MDS XM and WD (version 4.0): Basic Elements: Yoshi Shibata, Perfecto Herrera Content Description: Rosa Ruiloba, Fernando Pereira Content management: Uma Srinivasan, Erik Oltmans, Michael Wollborn Navigation and Access: Munchurl Kim, Charis Christopoulos Content Organization: Benoit Mory, Josep R. Casas User preferences: Dulce Ponceleon Schema tools: Masahiro Shibata, Alessandro Bugatti, Cedric Thienot

After discussing the various AHG recommendations, it was decided to create 3 breakout groups for the week: Semantic DS: Chair: Ana Benitez, Mandate: to finalize the specification of the Semantic

DS based on the CE results. Root, top level elements: Chair: John Smith, Mandate: to discuss the Package CE results

(mainly the section on top level elements) and the various input contributions; to define a set of "Schema tools" addressing the root element(s) and the top level entities.

Schema and Dictionary: Chair: Peter Mulder, Mandate: to discuss the difference between the schema and the dictionary approaches for metadata. Recommend a working plan for metadata harmonization.

Review of Validation and Core Experiments results

Num. Contributions6168 CE Report on Media Transcoding Hint DS6180 First results of CE on VideoEditing DS6195 Report on the CE on the Controlled Term D6209 Results of CE on User Preference DS6224 Report on Core Experiment for the Affective DS

48

Num. Contributions6227 CE report on Weight DS6236 Report on the CE on Entity Relationship Graph DSs6239 Report of CE on Structured Textual Description (For the part of

Dependency Structure)6240 Report of CE on Structured Textual Description6258 The result of core experiment on Matching Hint DS6297 Report on Core Experiment for the PointOfView DS6300 Report on Core Experiment on Package DS6354 Report of Core Experiment on MediaQuality DS6355 Report of CE on Semantic DS6360 Report on the Core Experiment on Entropy

All these contributions were discussed in the AHG meeting during the Sunday before the meeting and the AHG made recommendations for promotion to the XM and WD.

Basic elements:m6227 CE report on Weight DS

Alessandro Bugatti, Riccardo Leonardi, Benoit Mory, Yoshiaki Shibata, Kyoungro YoonThe goal of the CE was to improve the Weight DS syntax which, to demonstrate the benefit of having such a component as a basic entity to provide a large variety of functionalities and to accommodate the ordering-key functionality. After presentation of the results and discussion with the group, it was decided to drop the weight DS as a basic entity and to define a specific syntax for the ordering-key DS. This specific syntax was evaluated during the week and promoted to the XM. The CE will continue to further check and improve the ordering-key DS specification.

m6195 Report on the CE on the Controlled Term DJose M. Martinez, Oscar Fernandez, Clara Garcia, Masahiro Shibata, Corinne Joergensen, Kyoungro YoonThis CE proposed an improved specification of the Controlled Term D and investigated the use of Classification Schemes (dictionaries) in particular for "Content management" entities (Med/Met). It was decided to update the section about Controlled Term in the WD following the CE recommendation. The Classification Scheme was promoted to the XM.

m6236 Report on the CE on Entity Relationship Graph DSsToby Walker, Hawley Rising, Ana Benitez, Koiti Hasida, Ajay DivakaranThe goal of this CE was to produce a new specification of the basic graph structure and to study a possible set of normative relations. The CE recommended a simplified syntax for graph structures (more compact and readable). Relations between entities are also expressed in a simplified form as links. After discussion, it was decided to update all graph structures to comply with the new syntax (Entity-, Segment-Relationship graphs and the Collection Structure). These updated entities were included in the XM and will be promoted to WD in the future after update of the corresponding XM software (to be decided at the La Baule meeting). The old specifications of the graph structures were removed from the WD.

m6240 Report of CE on Structured Textual DescriptionMasahiro Shibata, Audrey Tam, Clement Leung, Koiti Hasida, Ana Benitez, Alejandro Jaimes

m6239 Report of CE on Structured Textual Description (For the part of Dependency Structure)Masahiro ShibataThis CE was focussing on the definition of a unified syntax for text-based description on the basis of following DS: Linguistic DS, Structural Annotation DS, Structured Annotation DS, and Multilevel Indexing Pyramid. (The unified DS is called “Text Annotation DS”). The CE also analyzed the descriptive power of this DS and compared it with free-text annotation. It was decided to update the Text Annotation section of the WD and to promote the dependency structure to the XM. The linguistic and the Structured text DSs will continue under CE. For the Linguistic DS, it was recommended to investigate the applications addressed by this DS and whether these are within the scope of MPEG-7. For the Structured text, although some CE results were presented as part of the Linguistic DS, it was considered useful to consider this DS independently and to

49

incorporate elements from work done on the Conceptual Structure for an Indexing Template. The new DS under CE has been renamed Structured Index.

Content Management:m6168 CE Report on Media Transcoding Hint DS

Anthony Vetro, Peter Kuhn, Teruhiko Suzuki, John R. Smith, Ana B. Benitez, Charilaos ChristopoulosThis core experiment validated the Media Transcoding Hint DS in a video content delivery and transcoding application based on network conditions and user preferences. During the Geneva meeting, the Motion Hint DS, Difficulty Hint DS and Important Hint DS were shown to be valid, hence recommended to the XM. Further experiments have been conducted since the Geneva meeting to validate the Shape Hint DS and additions to the Motion Hint DS. After discussion, it was decided to update the WD for the Motion Hint DS and to promote the Shape Hint DS to the XM.

m6354 Report of Core Experiment on MediaQuality DSJiuhuai Lu, Michel Rynderman, John R. SmithDuring the presentation of the CE results, the group felt that the DS was indeed useful to characterize the quality of the media to support functionalities such as content browsing and retrieval or control of content recording and displaying functions. However, the proponents were asked to harmonize their syntax with the one used for the Media Review DS. This was done during the week. The final syntax was reviewed by the MDS group and the Media Quality DS was promoted to the XM.

Content Description: m6180 First results of CE on VideoEditing DS

Rosa Ruiloba, Michel Rynderman, Philippe JolyThis document presented the intermediary results of the CE on Video editing. The CE will continue until the La Baule meeting and will address both the analytic and the synthetic parts of the DS.

m6258 The result of core experiment on Matching Hint DSJin-Soo Lee, Jungmin SongThis CE has studied the efficiency of the Matching Hint DSs, which was promoted to the XM during the Geneva meeting. This work was felt necessary because in Geneva it was decided to define the DS independently from the weight DS. The CE confirmed the syntax of the matching Hint DS and improved the semantic of some entities. The DS was promoted to the WD.

m6297 Report on Core Experiment for the PointOfView DSKoichi Emura, Yoshiaki Shibata, Jin-Soo LeeThis CE has studied the efficiency of the PointOfView DSs, which was promoted to the XM during the Geneva meeting. This work was felt necessary because in Geneva it was decided to define the DS independently from the weight DS. The CE recommended minor updates of the syntax and semantic. The DS was promoted to the WD.

m6224 Report on Core Experiment for the Affective DSYoshiaki ShibataThis CE has studied the efficiency of the Affective DSs, which was promoted to the XM during the Geneva meeting. This work was felt necessary because in Geneva it was decided to define the DS independently from the weight DS. Some minor updates of the syntax were proposed and accepted in the XM (no software has been integrated yet). Moreover, the CE made recommendations about root elements and the adoption of an AudioVisual Segment DS. The issue of root elements was further discussed in a breakout group taking into account the output of CEs and various input contributions. The AudioVisual segment was accepted as fifth segment describing the structural aspect of the content.

m6355 Report of CE on Semantic DSAlessandro Bugatti, Ana Benitez, Rajiv Mehrotra, Koiti Hasida, Hawley Rising, Corinne Joergensen, Riccardo Leonardi, Ed Hartley, Murat TekalpThis CE has made good progress towards the definition of the Semantic DS but cannot be considered as finalized. During the week, a breakout group was created with the mandate to define a subset of stable entities for promotion to the XM. As a result of this work, Semantic, Object, Event, Person Object, State, SemanticTime, SemanticLocation, USge Label, Media Occurrence, Semantic relations DSs were promoted to the XM. The CE will continue to further improve the DS.

50

User interaction:m6209 Results of CE on User Preference DS

I. Sezan, K. Yoon, P. van Beek, Y. TomiokaThis CE validated the specifications of the USge preference elements for Media Format and Parental Guidance. These updates of the USge Preferences were promoted to the XM. Moreover, some minor updates of the syntax of some DSs of the WD were also approved.

Schema tools:m6300 Report on Core Experiment on Package DS

John R. Smith, Blaise Lugeon, Ana BenitezThis CE addressed the issue of Package DS and of top level elements. The Package DS was promoted to the XM after analyzing the CE results and the Requirements document (to confirm that the functionalities provided by the package DS are indeed supported by specific requirements). The issue of top-level elements was further discussed in a breakout group. At the end of the week, the breakout group recommended to adopt the top-level DSs defined by the CE in the XM. A new section has been created in the XM and WD with the title: "Schema tools". It covers Packages, Root and Top Level DSs.

Entropy measurement: m6360 Report on the Core Experiment on Entropy

Hawley K. Rising IIIThis CE reported on the status of the work on entropy measurement. The work mainly focussed on image classification tasks. The CE concluded that the results from this study are useful, both in the methodological considerations and in the use of the entropy measure. The study could be included in the standard as a non-normative example of methodology for picking suitable D and DS for classification tasks. In view of the progress of the standard, it was felt difficult to introduce this methodology in CE processes. It inclusion as non-normative annex should be further discussed since no consensus was reached.

Description Schemes Promoted to XM and WDThe following table summarizes the group decision with regard to promotion to XM and WD (note that some promotions to WD result from XM Software integration between the Geneva and the Beijing meeting).

Description Scheme Section in MDS

Decision Comments

ER Graph CE: (new) Graph EntityRelationshipGraph SegmentRelationshipGraph

CollectionStructure

Basic elementsContent descriptionContent organization

Promote to XMRemove from WDMove from WD to XMMove from WD to XM

Segment, Segment Relationship Graph, and Collection Structure are moved to XM waiting for updates in XM software.Remove old Entity Relationship Graph from WD

VideoEditing Content description

Continue CE

Text Annotation LeveledText DependencyStructure Linguistic StructuredText

Basic elements

Promote to WDContinue CEPromote to XMContinue CEContinue CE

The Linguistic DS will continue in CE. The CE will investigate the applications addressed by this DS and whether these are within the scope of MPEG-7. It is recommended to define

51

Linguistic DS as broader than text annotations.

PointOfView Content description

Promotion to WD Updates to syntax and semantics were reviewed and accepted.Integrated in XM software.Updates needed for XM software.

Affective

AudioVisual Segment

Content description

Stay in XM

Promote to WD

The promotion of the Affective DS to WD will happen when software is provided for the XM.

MatchingHint Content description

Promote to WD Clarifications provided for semantics.Integrated in XM software.

MediaTranscodingHint CE: SpatialHint Updated MotionHint SpatialResReductionHint Updated DifficultyHint

Content management Promote to XM

Promote to XM/WDPromote to XMPromote to WD

The part of the Motion Hint DS integrated into XM software is promoted to WD.

Controlled Term / TermClassificationScheme

Basic elements

Update WDPromote to XM

Issues regarding the use of enumeration lists and normative classification schemes in MPEG-7 should be further discussed.

MediaQuality Content management

Promote to XM Syntax was reorganized as in MediaReview DS.

User Preferences CE: ParentalGuidance MediaFormat Small modifications PublicationDate MediaURL

User interaction

(Basic elem.)

Promote to XMPromote to XMPromote to XMPromote to WDPromote to WD

Package CE Root element: MPEG7Main MPEG7Unit Top-level elements: Image Video Audio AudioVisual Collection User World Package

Schema tools

Promote to XMPromote to XM

Promote to XMPromote to XMPromote to XMPromote to XMPromote to XMPromote to XMPromote to XMPromote to XM

Specific requirements were identified to be met by Package DS.

Weight CE OrderingKey

Content description

There is a CE on Ordering Key DS to improve and

52

Promote to XM(remove Weight DS from the XM)

refine the syntax for the next meeting.

Semantic, Object, Event, Person Object, State, SemanticTime, SemanticLocation, USge Label, Media Occurrence, Semantic relations

Content description

Promote to XM The CE on Semantic DS continues to validate specification and new additions.

Temporal Interpolation DS Basic elements

Promote to WD Integrated in XM software.

Importance Hint DS Content management


Difficulty Hint DS Content management


Media Review DS

Media Review Preference DS

Content managementUser Preferences


KeywordPreferencesDatePeriod

User preferences


Summary DS(Sound Property)

Summarization


Summary DS(Text Property)

Summarization


(updated) MediaLocator Basic elements

Promote to XM

Availability DS Content management

Promote to XM

Description Schemes Promoted to XM or WD.

Basic elements

Num. Contributions6308 A Conceptual Structure for an Image Indexing Template and Validation Examples6309 The Concept of Authority Control and its Relevance for "Names" in MPEG-76334 Proposal for Extensions to MediaLocator DS6362 Fuzzy Relations and Graph Structures for Compact Description and Modification

m6308 A Conceptual Structure for an Image Indexing Template and Validation ExamplesCorinne JorgensenThis contribution described a template that reflects how users are used to describe images. The template is important to help the user during the annotation process. It can also be used to check the description range (the set of feature currently under consideration). The proposer was asked to check the current features included in the WD and report on any missing item. Collaboration with the Structured Text annotation CE was also encouraged.

53

m6309 The Concept of Authority Control and its Relevance for "Names" in MPEG-7Corinne Jorgensen, Deborah J. KarpukThis contribution discussed how "names" are generally represented by documentalists and the potential application for the Person DS (also corporate names, places, conference names, etc). It suggested to follow the guidelines proposed by the library of congress and illustrated the interest of "Authority Control" which maintain consistency among name representation. The author of the contribution was asked to collaborate with the editor (Toby Walker) of the "basic element" section to improve the non-normative sections of the Person DS (in particular to provide guidelines on how to instantiate the Person DS).

m6334 Proposal for Extensions to MediaLocator DSP. van Beek, I. SezanThe medialocator in the MDS XM (3.1) only allows URL and/or time specification. This contribution proposed extensions to locate individual streams or tracks, to embed mediadata and to allow byte-offset for localization within a file without time stamps. The MDS group recommended to update the XM. However, in view of the potential System implications of the medialocator, the MDS group has asked (through a resolution) the Systems group to analyze the new specification.

m6362 Fuzzy Relations and Graph Structures for Compact Description and ModificationHawley K. Rising III, Ali Tabatabai, Toby WalkerThis contribution proposed an extension to the GraphType to describe fuzzy relations. The proposal was difficult to assess because it built on top of the recent modifications of the graph DS. The proposers were asked to make an evaluation of the interest of this proposal in a CE involving the Graphs, for example the Semantic DS CE. This work was actually included in the new CE on semantic DS (N3474).

Content Management

Num. Contributions6351 Proposal for an Electronic Program Guide description scheme6267 Improving the Media Transcoding Hint DS by adding an attribute for spatial resolution

reduction6280 Proposal for an Availability DS6160 Harmonisation with Dublin Core: current status and concerns.

m6351 Proposal for an Electronic Program Guide description schemeP. van Beek, I. SezanThis contribution motivated the need of EPG (which is also included in the requirements document). To address this issue, it proposed 3 DSs: 1) ProgramInformation: Core program identifier and locator, basic information about the program itself. 2) ChannelInformation: Information about the channel and 3) ProgramGuide DS: Connect one channel to multiple programs. During the discussion, the notion of "Bouquet" where a single program may be broadcasted by several channels at different time was raised. As a result, the ProgramGuide may have to relate multiple programs to multiple channels. A CE on EPG was launched at the end of the week.

m6267 Improving the Media Transcoding Hint DS by adding an attribute for spatial resolution reductionSanghoon Sull, Keansub LeeIn this proposal, a possible problem with the current transcoding operations in Media Transcoding Hint DS was described. The issue was related to resolution reduction in transcoding. The proposers presented a simple solution relying on an optional attribute for providing the information on the perceptible maximal resolution reduction hint of each region in an image. The group felt that the functionality was indeed useful and the solution very simple. The attribute is included in the new version o the XM.

m6280 Proposal for an Availability DSJose M. MartinezThis document proposed a new DS for the USgeMetaInformationDS, the AvailabilityDS. The DS specifies information about when and from where the AV content is to be available for use (once used, the use is to be recorded in the USgeRecordDS). This information was previously covered by the Publication DS which was dealing with both the past use (currently described in the USge Record DS) and future use (the Availability DS) of the content. The DS is included in the new version of the XM.

54

m6160 Harmonisation with Dublin Core: current status and concerns.Jane Hunter, Jose M. Martinez, Erik OltmansThis contribution made an overview of 15 elements for simple resource description defined by the Dublin Core Metadata Initiative. A mapping has been done with MPEG-7. This document will be used by the Editor of the "Content Management" section to improve the terminology and maybe the semantic of some entities. This contribution also highlighted that in order to get access to the MPEG-7 equivalent of some DC entities, it was sometimes necessary to go down several hierarchical levels. Several solutions were highlighted including: 1) creating an MPEG-7 “flat” Dublin Core Description Scheme, 2) using the XML namespace to import the DC element set into an MPEG-7 DS and assign values to each element, 3) using the Package DS or 4) relying on XSLT to implement mappings from MPEG-7 to Dublin Core and vice versa. These possible solutions will be investigated by the proponents in the future.

Content Description

Num. Contributions6237 Proposal for Representing Key Items

m6237 Proposal for Representing Key ItemsToby WalkerThis document showed that the key-item requirement is not adequately addressed by existing MPEG-7 specification. To address this requirement, an approach based on conceptualizing key-items as a relation between two segments was proposed. The existing Graph Relationship description tools can represent key-items if a new relation “keyFor” is introduced. This new relation was accepted as an update of the relation in the EntityRelation Graph.

User Preferences

Num. Contributions6259 Proposal of USge History DS

m6259 Proposal of USge History DSKyoungro YoonThis document proposed a redesign of the USge History. In this version, no metadata is recovered with the history. After discussion, it was proposed to launch an exploratory CE to analyze the issues related to the storage of metadata with the history and its evolution overtime.

Review of the individual section of the MDS XM & WD documents

Before the Beijing meeting, individual reviews per section of the MDS XM & WD were collected. They can be found in document M6157. During the week, the editors, the reviewers and the MDS group discussed the various elements of the reviews and agreed on the best way to handle the reviewers' recommendations. The discussion output are reflected in the new version of the MDS XM and WD.

Joint meeting with ISG on Software integration

Num. Contributions6281 Status of Software integration for DS

6281 Review of the DS software integration workStephan Herrmann The ISG group has received the software corresponding to entities promoted to the XM in Geneva with the exception of the VideoText DS and the Affective DS. These two DSs will not be promoted to the WD.

55

Moreover, the ISG requested some collaboration to update the document describing the guidelines for Software integration. For the MDS group, Toby Walker and Charis Christopoulos will contribute.

Workplan for software integrationAna Benitez, Toby WalkerThe following workplan for software integration was approved by the ISG and MDS groups:

Software Tool Revision Schedule. The following table shows the schedule for updates to existing XM MDS tools (due to revisions in the corresponding DSs).

Description Scheme

Organization ExtractionTool

Search Tool Integration Due Date

Entity-Relation Graph DSCollection Structure DSSegment Relation Graph DS

Columbia (A. Benitez)Sony (H. Rising )

N/A Update to application for new syntax.

September 6, 2000

Point Of View DS Matsushita (K. Emura)

N/A Revisions for syntax.

October 1, 2000

Matching Hint LG-Elite (J. Lee) Revisions for syntax.

Revisions for syntax.

October 1, 2000

Motion Hint DS Sony (T. Suzuki, P. Kuhn)

Revision for syntax.

Revision for syntax.

September 6, 2000

User Preferences DS

ParentalGuidanceMediaFormat

Sharp Labs (I. Sezan)LG-Elite (Y. Kyongro)

N/A Update to filtering agent for modifications.

October 1, 2000

Software Tool Integration Schedule: The following table shows the schedule for MDS tool integration.

Description Scheme



Dependency Structure DS

NHK (M. Shibata) N/A Search application.

October 1, 2000

Shape Hint D Mitsubishi (A. Vetro)

Hint extraction tool.

Object-based transcoder (simulation).

October 1, 2000

Motion Intensity D

Mitsubishi (A. Vetro)

Hint extraction tool (modified MPEG-2 decoder).

Transcoder(modified MPEG-2 encoder).

October 1, 2000

Motion UncompensatabilityD

Sony (T. Suzuki, P. Kuhn)

Hint extraction tool (modified MPEG-2 decoder).

Transcoder(modified MPEG-2 encoder).

September 6, 2000

Spatial Resolution Hint

U. of KR (Sanghoon)

N/A Image transcoding

October 13, 2000

56

D application.Media Quality DS

Tektronix (M. Liu) Objective hint extraction tool (PSNR).

Selection of content based on hint.

October 1, 2000

Video Text DS IBM (C. Dorai)Philips (L. Agnihotri, N. Dimitrova)

Video Text DS Extraction for MPEG-2 Video(Text Detection only—no OCR)

Video classifier using videotext DS.

October 1, 2000

Affective DS Sony (Y. Shibata) N/A Segment Filter Tool generating summary DS.

October 1, 2000

Ordering Key U. of Brescia (Alessandro)

N/A Search application with ordering key.

October 1, 2000

Semantic DS(parts in CE)

Columbia (A. Benitez)Sony (H. Rising)U. of Brescia (A. Bugatti)

N/A Matching application for Semantic DS.

October 1, 2000

Package DS IBM (J. Smith) N/A Description filtering (subset extraction) using Package DS.

September 1, 2000

Software Tool Integration Schedule for DSs in Core Experiment. The following table shows the schedule for software integration for DS that are currently in CE and not in either the XM or WD (see document N3466).

Description Scheme



Structured Index DS (in CE)

U. of Victoria (A. Tam, C. Leung)

N/A Search application.

October 1, 2000

Multilevel Pyramid(in CE)

Columbia (A. Benitez)

N/A Search application using levels.

October 1, 2000

Video Editing DS (in CE)

AVID (M. Ryndermann)U. of Paris 6 (Rosa)

Description generation for cuts and gradual transitions.

Search application using description data.

October 1, 2000

Electronic Program Guide DS (in CE)

Sharp (I. Sezan) N/A User preference matching for EPG.

October 1, 2000

Joint meeting with DDL, Audio, Video on XML Schema design

Num. Contributions6222 Guideline for DDL representation of MPEG-7 tools ver.0.1

57

Num. Contributions6223 Syntax Extension for Vector/Matrix Datatypes and Normative Behavior of MPEG-7

Parser

m6222 Guideline for DDL representation of MPEG-7 tools ver.0.1Yoshiaki Shibata, Toby WalkerThe guidelines for DDL specification has been reviewed jointly with the DDL, audio and video groups. As a result of the groups discussion, a new version of this document was created at the end of the week (N3467).

m6223 Syntax Extension for Vector/Matrix Datatypes and Normative Behavior of MPEG-7 ParserYoshiaki ShibataThis contribution reviewed the problems of the current specification of Vectors and Matrices and proposed a possible solution. The DDL group also proposed a solution. This last solution is easier to implement in terms of parser implementation and was adopted. It has been included in the DDL WD (4.0) (N3575) and the corresponding section of the MDS WD will be removed.

Typed References, Body/headerPhil GarnerThe DDL WD (N3575) will describe a specific MPEG-7 extension to support typed references.

AudioVisual SegmentYoshi ShibataThe AudioVisual segment was presented to the video and to the audio groups. It will be included in the MDS WD.

Joint meeting with Requirements

Num. Contributions6151 MPEG-7 IPMP AHG Report6210 Report of AHG on TV-Anytime Application (Profile aspects)6298 Report of the AHG on Conceptual Modeling6299 MPEG-7 Principal Concepts List (V0.95)6148 Adaptive Media Processing using Dependency Information6149 A Proposal for Mobile Profile6172 Video Editing DS Requirement Clarification6356 Notes and proposals on MPEG-7 description access6361 A Two-stage Mapping for Application Specific Markup and Binary Encoding

m6151 MPEG-7 IPMP AHG ReportNiels RumpReview of the work. IPMP AHG. Concerning the MDS WD, it was concluded that most of the IPMP requirements are fulfilled by the current MDS specification.

m6210 Report of AHG on TV-Anytime Application (Profile aspects)Ibrahim SezanReport on the study of profile. TVA was used as a concrete example. The main difficulty encountered in this activity was to define the normative behavior of the decoder: possible normative behaviors include parsing or syntax validation or even specifying a behavior of the MPEG-7 device. In this last case, the normative behaviors belonging to MPEG-7 and to TVA should be clearly separated. The Work should be continued trying to define the normative TVA box.

m6298 Report of the AHG on Conceptual ModelingJohn R. Smith, Hawley K. Rising III

m6299 MPEG-7 Principal Concepts List (V0.95)John R. Smith

58

Between the Geneva and the Beijing meeting, 9 new concepts were added. The report also highlighted some concepts where no work is carried out. In the future, the MPEG sub-groups should be contacted to see whether they consider that this lack of activity should be corrected or whether these concepts are not within the scope of the normative part of MPEG-7. Moreover, the AHG produced a new text defining the distinction between D / DS. It has been added to the new version of the Requirements document. It was also suggested to include the conceptual model in the standard as an informative annex of the Systems part. It also constitutes an annex of the Requirements document.

m6148 Adaptive Media Processing using Dependency InformationMikio SASAKIThis contribution proposed a dependency code for Media. This code specifies the factors influencing the consumer needs (weather, location, time, etc.). It was suggested to propose in the future a CE on this issue.

m6149 A Proposal for Mobile ProfileMikio SASAKIA profile for mobile applications was requested. As a result, an AHG was created to study this issue.

m6172 Video Editing DS Requirement ClarificationMichel RyndermanThis document requested a clarification of the Requirements group about the Video editing. Currently, the Video Editing DS under CE only addresses the analysis of video from a post-broadcast point of view, in other words, “analysis after the fact”. The proponents believed that a complementary DS was needed, allowing for the production stage of Video Editing. The question was to know whether the complementary DS was still within the scope of MPEG-7. The answer from the requirements group was clearly positive and the Requirements doc will be updated. Finally, the new version of the Video Editing CE includes this complementary DS.

m6356 Notes and proposals on MPEG-7 description accessP. van Beek, I. SezanThis contribution was presented during a joint meeting with requirements and also during a joint meeting with Systems. This document discussed requirements about the Scope and validity of descriptions, dynamic updates of description, random access, root DS, body / header organization of the description. All requirements have been accepted and have been included in the new version of the Requirements document. The technical aspects of the paper about root, and top level elements were discussed in the corresponding Breakout group. During the joint meeting with System, it was also decided to make a distinction between DSs that define the starting points of the description (root and top level elements) and DSs that structure the description for Systems aspects (Containers, Access units, Hint). The first set of DSs will be defined in the MDS WD whereas the remaining ones will be specified in the Systems WD.

m6361 A Two-stage Mapping for Application Specific Markup and Binary EncodingHawley K. Rising III, Ali TabatabaiThis contribution was presented during a joint meeting with requirements and also during a joint meeting with Systems. The contribution suggested that a single mapping between DDL (textual format) and BiM (binary format) is not going to be efficient and that Application Specific Descriptions should be created. The proposal was to use XSLT to transform a generic description into an application specific description and to add some application specific features. Then, this textual description could be binarized. The contribution proposed a new notion of profiles where not only a sub-set of the tools is used but also where new application specific features may be added. The proposers were encouraged to join the CE on Binary encoding to provide evidences that this strategy is indeed more efficient than a generic mapping between DDL and BiM. This work should in particular analyze the tradeoff compression gain / loss of interoperability.

Joint meeting with System

Num. Contributions6356 Notes and proposals on MPEG-7 description access6361 A Two-stage Mapping for Application Specific Markup and Binary Encoding6249 ividing methods for MPEG-7 Description

m6356 Notes and proposals on MPEG-7 description accessP. van Beek, I. Sezan

59

See report in the previous section.

m6361 A Two-stage Mapping for Application Specific Markup and Binary EncodingHawley K. Rising III, Ali TabatabaiSee report in the previous section.

m6249 Dividing methods for MPEG-7 DescriptionT.Azami, I.Ando and M.TsutsumiThis document addressed the method for dividing MPEG-7 description data into multiple files to meet for example dynamic updating of a part of description data. The proposal consists of two new DSs: Temporary DS and Connection DS. The Temporary DS is used to constitute the root element of divided description fragment while the Connection DS provides a method to connect the fragments. The Connection DS was discussed from the viewpoint of "extension of the reference DS" and decided to have further study in the BiM AHG. This proposal was also discussed in the breakout group on root elements. In the break-out group, the importance of description fragment was well acknowledged and thus decided to recommend <Mpeg7Unit> as a root element of MPEG-7 fragment.

During this joint meeting, the need of description examples for the Binary description CE was also discussed. The MDS group will contribute the following examples: Hierarchical Segments with video descriptors (Contact: Ana Benitez) Collections of AV documents (Contact: Ana Benitez) Segment decomposition on very long video files (Contact: Rosa Ruiloba) Summaries (Contact: Peter van Beek) The "Monster" description: a description that uses almost all DSs (Contact: John Smith).

Joint meeting with MPEG-21

This joint meeting was mainly informative. The goal was to make the MDS group aware of the content of the Technical Report created by the MPEG-21 sub-group, in particular for the item "Digital Item Identification and Description", and to get some feedback. The main requirements included in the report were reviewed and discussed. The framework for identification and description should provide: Accuracy, reliability, uniqueness of the identification Seamless identification of an entity regardless its nature, type or granularity Persistent and efficient identification Security and integrity of the identification Automatic processing of right, and localization. (Currently most of the requirements address identification issues)This presentation generated a discussion about the meaning of the content and in particular of the notion of "Digital Item" (Is it a model, does it include Content, Does it also include Content Description?). It was felt that the report should clarify the notion of "description" in "Digital Item Definition" and "Identification and Description". As a result of the discussion, it was decided to create a new section about Content representation.

Output of the Breakout groups: Semantic DS: Chair: Ana Benitez,

Mandate: to finalize the specification of the Semantic DS based on the CE results. Output: The breakout group recommended at the end of the week a specification to be introduced in the XM. This Specification was reviewed and approved by the MDS group. Further work will be continued in the CE on semantic DS.

Root, top level elements: Chair: John Smith,

60

Mandate: to discuss the Package CE results (mainly the section on top level elements) and the various input contributions; to define a set of "Schema tools" addressing the root element(s) and the top level entities. Output: The breakout group recommended at the end of the week a specification to be introduced in the XM in a new section called "Schema tools". This Specification was reviewed and approved by the MDS group. Further work will be continued in Conceptual modeling and the Audio-Video-MDS Harmonization AHGs.

Schema and Dictionary: Chair: Peter Mulder, Mandate: to discuss the difference between the schema and the dictionary approaches for metadata. Recommend a working plan for metadata harmonization.Output: The recommendation of the group was to create an MPEG-7 dictionary. The MPEG-7 dictionary is a list of Ds and DSs names with their definition and where they are used. The potential interest of this dictionary are as follows: It is a useful way of organizing the access to MPEG-7 for people that want to study it. This

shall therefore ease the analysis of the semantic for comparison with e.g. definitions used in existing dictionaries. For that reason, it is also considered as a valuable first step towards future growing harmonization with other metadata standards.

It is a useful way of avoiding the use of different Descriptors that have the same meaning or of similar descriptors used in different DS’s with different meaning.

It can simplify the writing of new DSs because people have access to a library of clearly defined descriptors that should preferably be used to enhance internal MPEG-7 interoperability.

The creation of this dictionary has been introduced as a mandate of the Metadata integration AHG.

New Core & Validation experiments:

The following experiments were approved during the Beijing meeting:

DSs Organizations Application Related documentsVideo Editing DS

LIP6/UPMC Avid Technology University of Brescia EPFL Ericsson

Video editing and browsing document structure

Report: M6180Workplans: M5994, N3417Proposals: M5992, M5993

Linguistic DS ETL NHK

Structured description of text data in a search scenario

Reports: M6079, M6240Workplans: M5952, N3418Proposal: M5794

Multi-Level Indexing Pyramid

Columbia University

SUNY/Buffalo

Categorization of textual attributes of video and audio content

Reports: M6113, M6240Workplans: N5855, N4418Proposals: M4754, M5251, M5593

Electronic Program Guide DS

Sharp Labs Sharp Corporation NHK ETRI

Navigation and filtering of audio-visual content based on EPG descriptions

Proposal: M6351

61

Ordering Key DS

University of Brescia

Sony Lab Electronique

Philips

Efficient browsing of segments and objects, among other, based on ordering criteria

Reports: M6027, M5440, M5460, M5464, M5618, M5822, M6227Workplan: N3429

Semantic DS ETL Sony University of

Brescia Columbia

University SUNY/Buffalo

Retrieval and browsing of multimedia material based on semantic descriptions

Reports: M6062, M5936, M5781, M6355Workplan: N3424Proposals: M5941, M5937

Structured Index DS

Victoria University of Technology

SUNY/Buffalo NHK

Discovery and recovery of multimedia data based on structured textual descriptions

Reports: M6079, M6240Workplans: M5952, N4418Proposal: M5738

USge History DS

LG-Elite Sharp

Accessing content based on USge history of content

Proposals: M5748, M6259

Description Schemes in Core Experiments.

List of Output documents:

Number TITLE

3464 MPEG-7 Multimedia Description Schemes XM (v4.0)3465 MPEG-7 Multimedia Description Schemes WD (v4.0)3466 Workplan for DS Software integration3467 Guideline for DDL representation of MPEG-7 tools (v1.0)3468 MPEG-7 MDS Core Experiments3469 Workplan for CE on Video editing DS3470 Workplan for CE on Linguistic DS3471 Workplan for CE on Multilevel Indexing Pyramid3472 Workplan for CE on Electronic Program Guide DS3473 Workplan for CE on Ordering Key3474 Workplan for CE on Semantic DS3475 Workplan for CE on Structured Index DS3476 Workplan for CE on USge History

(Note: Documents N3464 and N3465 will be released on the 18th of August 2000)

List of AHG approved by the MDS group:

Number TITLE3477 AHG on Editing the MDS XM & WD3478 AHG on MPEG-7 MDS Core Experiments 3479 AHG on Audio, Video, MDS harmonization

62

3480 AHG on Conceptual Modeling 3481 AHG on the TV-Anytime Application3482 AHG on Metadata Integration

Next targets for the la Baule meeting: Perform the software integration of the DSs that have been promoted during the Beijing meeting

to XM and WD. Perform the Core experiments approved during the Beijing meeting and review the results. Continue the harmonization and integration work with relevant standards. Harmonization of Audio, Visual and MDS entities. Update the XM and WD (study in particular the massive use of "ControlledTerm" and possible

solutions to improve interoperability). Define and plan new core experiments.

63

Annex 7Video Group Report

Source: Thomas Sikora

MPEG-4

Version 2 Reference Software

Work on software /bitstream verification was discussed. Only marginal bugs were found and further integration will continue in the context of FGS and Studio profile.

Version 1 and 2 Encoder Optimization

The Optimization Model (OM) includes tools which optimize MPEG-4. Further progress was made towards harmonisation of solutions. New tools under consideration include fast global motion estimation techniques.

Version 3 Studio Application

A number of technical details are still under consideration for the definition of the studio profile. Lossless coding, shape and sprite coding will be supported by this part of the standard. At the meeting a FPDAM was issued. A DAM is targeted for January or March 20001.

Fine Granularity Scalability

New technology was evaluated at the meeting but as a result the algorithms remained unchanged. As an extension error resilience techniques were included. At the meeting FPDAM as well as VM 17.0 of the standard was released. DAM is targeted for January 20001.

Call for Evidence

HHI, Nokia and Real Networks/Intel submitted results of their technology. Results indicate, that there may be technology available to improve coding efficiency. As a result MPEG will issue a Call for Proposals at the January meeting. At the Bejing meeting a Preliminary Call for Proposal was issued.

MPEG-7

This MPEG-7 report summarises work and conclusions of the video group in 5 sections: Review of the Results of Core Experiments and decisions Joint Meetings of video with other groups. Other contributions, work items Other issues discussed:

Review of the CE results in Colour/Texture

64

CT-1

M6218, M6256Full inter-operability of the colour structure histogram was achieved by changing the extraction procedure (fixed number of bin and scaling after extraction). All other issues were properly addressed.CE concluded successfully. The descriptor was promoted to the WD, to be used in conjunction with the HMMD colour space.

CT-2 Confidence Measure for Dominant Colour

M6255, M6212, M6230Objective of this CE was to optimise Spatial Coherence measure for the dominant colour. Comparison between one-per confidence per dominant colour and one per descriptor was performed. Two different extraction methods were used. Modules were taken from the XM and run outside the XM environment. The results were not obtained using the XM due to bugs in the XM software, and hence no conclusion could be reached on the results presented. The XM bug should be fixed within two weeks after the meeting, otherwise the technique will be removed from the WD. CE to continue until the next meeting.

CT-3 Face descriptor

M6145, M6231Two proposals from Geneva meeting successfully merged, but results presented on the same database due to the delay in provision of the new database. The descriptor was promoted to the XM, but it is required that results on the extended database are presented before the technique is promoted to the WD. CE to continue. The proposed technique uses 8 prime-order and 44 second-order eigenfaces, and a contribution M6364 was commented on the equivalence of the first and second order eigenface methods.

CT-4 Edge Histogram Descriptor

M6174, M6143Objective of this CE was to reduce the descriptor size (at Geneva meeting the descriptor size was 480 bits). Optimised using Lloyd-max Quantisation, 3bits per bin, size reduced to 240. The results were cross-verified by Korea Telecom M6143. The descriptor with the new quantisation scheme was promoted to the WD.

CT-5 CE on scalable representation of colour histograms

M6285, First experiment concerned scalable encoding of HSV colour histogram using Haar transform. Results were cross-verified by Siemens. Shown improvement on the performance/Second experiment concerned Inverse 16 Haar transform coefficients. Non-normative issue. Interesting results but cross-verified and therefore could not be considered during the meeting.

M6254, M6214Issues successfully addressed: Non-uniform bin value quantisation on HMMD colour histogramProgressive matchingScalable encoding of the HMMD histogram1,2,4,6 bits/bin; 184, 120, 64, 32 bins; Significant improvement due to non-linear quantisation

65

Review of the CE results in Motion/Shape

MS-1 CE on the spatial localisation of the motion activity

M6275, M6276, M6264, M6335CE on Spatial Localised Motion ActivityObjectives of the CE was to: get consensus on the data, clarify the details of the technique used and to use XM software. The objectives were achieved (a bug was solved during the meeting). The technique promoted to the XM.

MS-2 3D shape descriptor

M6315, M6316, M6338Full results reported on the combined data set (SNHC Data Set + Letters+ 3D Café agreed after the Geneva meeting), 1300 models in total. Mean score of 85%. Quantisation of the descriptor studied, recommended 12 bits/bin, 50bins. Descriptor promoted to XM.

MS-3

M6215, M6181The objective of this CE was to obtain full set of cross-verified results for the new region-based shape descriptor called ART. The descriptor was fully integrated into XM and results cross-verified.Compared with the current XM descriptor (Zernike moments) the results for the new descriptor are: CE-1 almost the same, CE-2 improvement of 3-6%. The ART descriptor was included into WD.

MS-4 2D/3D Descriptor M6190, A new DS, Multiple-Views, to carry several visual descriptors, which can be applied on Still Region DS, is evaluated on the extended 3D dataset. The AHG agreed that the functionality of this DS, 2D to 3D matching, has not provided by any existing descriptors, but is very important and useful for many applications. No impacts are expected not only for semantics but also for extraction and matching on the current XM/WD because the proposal is just a carrier of the descriptors. Valid results are provided by proposers and successfully cross-verified on XM platform. The Multiple-Views DS should be promoted into XM.

MS-5 Optimisation of the Contour Shape Descriptor M6293, M6213An improvement to the quantisation of the contour-based shape descriptor were proposed during the Geneva meeting. The results shown at the Geneva meeting were cross-verified by three participants both on Windows and Linux platform. The proposed changes to the quantizaton were approved for the WD.

New contributions considered by the video group

M6220 – A proposal for MPEG-7 Colour layout Descriptor This contribution argues (and live demo shown) that the current colour-layout descriptor with default quantisation 6/3/3 fails in certain situations (e.g. object in the center of the image). This is shown by subjective evaluation on the CCQ dataset and by an experiment (single query) on augmented colour dataset. Current syntax allows user defined number of bits, but at an

66

additional cost of 6 bits overhead. Decision is to carry out a Core Experiment to determine if it is necessary to change the default quantisation of the colour layout descriptor.

M6182 – A proposal of new Core Experiment to optimise default values for colour layout

The contribution suggests that a new CE is needed to determine the best default values, a consensus with M6220. Both authors defined a new CE.

M6357 Comparison with Textual descriptions of Colour Layout Descriptions This paper explores the best temporal representation of colour layout descriptor. It argues that using the standard DS mechanism introduces too large overhead either in terms of descriptor size, search efficiency of both. It is agreed by the video that a further study needs to be done (CE) to investigate the problem and to find a solution which can be generalised to other visual descriptors. A new CE approved to investigate the issue.

M6139 Variable scale wavelet shape descriptor A new technique for shape descriptor is proposed, but no results using the MPEG data sets are available.

Decisions on promotion to XM/WD

The following descriptors were promoted to the WD: Colour Structure descriptor (combined with the HMMD colour space) Scalable colour descriptor (colour histogram combined with Haar transform and HSV) Compact Colour Descriptor (as part of the new Scalable colour descriptor) Colour histogram (as part of the new Scalable colour descriptor) Colour Space Quantisation Group of Frames Colour Histogram Edge Histogram Region Based Shape Contour based shape (changes to quantisation) Camera Motion Motion Trajectory Parametric motion RegionLocator SpatioTemporal Locator DS

The following descriptors were promoted to the XM: 3D shape descriptor Face Recognition descriptor 2D/3D descriptor Spatial localised motion activity

In order to facilitate comparison between techniques and further experimentation on existing descriptors, the video group approved the following resolution:All MPEG-7 proposers are required to verify before the next meeting that their XM software runs and performs as reported in the Core Experiments. They are also requiredto provide the test data-sets used for the Core Experiments, with the exceptions specifically approved by the video group. The data should be provided within three weeks after the meeting.

67

Current exceptions are: the Brodatz texture database and the Corel-draw database, View-point database (including the derived images).

Joint Meetings of video with other groups.

Discussions with AHG on Audio, Video, MDS HarmonizationThe meeting took place on Saturday before the main meeting. The following points were discussed:

Type refs, type inheritance of refs, could use MPEG-7 extension rather than schema parser

Distinction between float/double and decimal types, related to bit representation Vectors and matrix as extended datatypes Histogram and uniform quantization syntax Review of MDS XM/WD basic elements First draft of guideline for DDL representation Header/Body issue, what and where should header part be Terminology established, should be used consistently (MPEG-7 parser, root element,

etc.)

Joint Video/Audio/MDS/DDL meeting: key points

Guidelines for DDL design (consistency) reviewed jointly.Issues discussed: Attribute vs Elements – attribute is used to characterise elements Namespaces: - <schema>. specification and mpeg7:prefix What is top level element. Element Cardinality – Explicit specification of maxOccurs/minOccurs. Tips how to avoid xsi:type in instances Unique identifiers: id attribute for Top ElementM6223 – proposal on Vector/Matrix – another proposal by the DDL group will be developed furtherVisual needs to check is it requires squared matrices and/or synchronised vectors.

Joint Video/MDSExtension to the spatial and spatio-temporal region proposed by the MDS was discussed, but no conclusion was reached. However, the discussions resulted in much better understanding of the issues and the discussions are to continue on the reflector. Also the issue of efficient representation of the visual descriptors was raised.

Joint Video – ISG Discussion on the current state of the XM – all current descriptors were successfully integrated Deadlines for contributions of the video XM software set with the ISG group Usage template applications – an additional software to demonstrate how visual descriptors

can be used Data used for Experiments to be collected and made available to MPEG-7 community (with the

exceptions of items where copyright restrictions prohibit)

Joint meeting Video – SNHCIt was agreed that visual MPEG-7 and SNHC could benefit from more interactions. Both groups are encouraged to review the current work and contribute more. For example SNHC could contribute

68

more in the area of face recognition CE’s, which is currently running. A meeting will be held in La Baule to further this issue.

69

Annex 8Audio Group Report

Source: S. Quackenbush, Chair Audio Subgroup

Opening of the meetingThe MPEG Audio Subgroup meeting was held during the 53rd meeting of WG11 in Beijing, China, July 17 – 21, 2000. The list of participants is given in Annex A-1. Jurgen Herre opened the meeting as acting chair – the Audio Chair arrived shortly after the opening of the Audio meeting.

Administrative matters

Approval of agendaThe agenda, as presented in Annex A-II, was discussed, edited and approved.

Geneva meeting reportThe Audio Subgroup Geneva meeting report, May, 2000, had been previously distributed by email and was approved.

Allocation of contributionsAll contributions (see Annex A-IV) were allocated to the agenda and were discussed either in the task groups or in Audio plenary. The Chair brought other relevant documents from Test, Systems, and Requirements to the attention of the group.

Communications from the ChairThe acting Chair summarised the issues raised at the Sunday evening Chair’s meeting.

Joint meetingsMany of the joint meetings over the course of the week are listed here and are reported on below.Day Time Meeting With Topic LocationTuesday 10AM DDL DDL DDLTuesday 2PM Sys and Req AudioBIFS

profileSystems

Tuesday 3PM ISG XM integration AudioThursday 4PM ISG XM integration AudioThursday 10AM Systems Video test set for binary

representationSystems

Received National Body Comments and Liaison mattersThere were two Liaison documents, shown below.Document Title Source Author of Response5970 Method for Subjective Listening Tests… ITU-R S. R.

Quackenbush5981 Interface for non-linear PCM encoded audio

bitstreams … according to MPEG-2 AACIEC S. R.

Quackenbush

70

Task GroupsSix task groups were convened for the duration of the MPEG meeting, as shown in ANNEX-III. Results of task group activities are reported below.

Record of Audio plenary, joint meetings and task group activities

Audio plenary discussions

Call for evidenceA Call for Evidence for Audio Testing was written. It was agreed that MPEG-4 encoders and encoded materials will use “reference quality” encoders similar in quality to those tested in the MPEG-4 Audio verification tests. The “reference quality” encoder technolgy will be made available by those companies that have such technology. The final document contains an explicit description of the materials to be submitted and a detailed schedule for those submissions. Evidence will be evaluated at the January MPEG meeting.

Software re-writeThere was an extensive discussion of the contract for sponsoring the MPEG-4 software framework re-write. The contract was edited to reflect the consensus of the discussions. It was very helpful to have a dynamic face-to-face discussion as opposed to attempting such a discussion via email. The edited contract will be submitted to the software contractor for review. If work proceeds on schedule, work will begin August 31, 2000 and be completed January 31, 2001.

Joint meeting discussionsISG on XM integration

There were actually several joint discussions with ISG on how to best integrate the spoken content CE into the XM. The final consensus was that the extraction portion of the spoken content CE would write the instantiated normative data as a textual DDL file. This DDL file would also contain MDS description scheme instantiations. The query portion of the XM would read this file and a similar query target file and load the normative data into the spoken content CE’s own internal C++ data structures. Query processing would be done using these data structures.

Task group discussionsMPEG-4 Audio conformance

The task group worked on the following three items: PDAM ballot DoC FPDAM text Review of bitstream status

Details of th

MPEG-4 V1 Corrigenda or 2nd Edition

MPEG-7 Audio WD

MPEG-7 core experiments

Melody CEWe need more evidence to satisfy CE process, specifically we need the ability to hear the query results. We debated at length the tradeoff between compact meta data (e.g. simple melodic coutour) that has demonstrated application (e.g. query by humming) and less compact (e.g. musical note) that has no current demonstrated application.

71

Recommendations: Must be able to hear the items returned from the query and to identify the actual MIDI

sequence. It should be tested so that query begins on a phrase boundaries (i.e. a “proper melody”) Continue to investigate actual representation of meta-data (i.e. melodic contour or exact note).

MPEG-7 discussions and promotion

Meeting deliverables

Press statementThe Chair prepared the Audio part of the press statement with the assistance of Adam Lindsay

Dispositions of CommentsThe Audio-related MPEG-4 Version 2 Conformance DoC were reviewed and approved.

Responses to Liaison and NB commentsThe responses to the IEC Liaison, m5981, and the ITU-R Liaison m5970, were prepared and approved.

Recommendations for final plenaryA list of Audio recommendations were reviewed and approved.

Establishment of new Ad-hoc GroupsThe following ad-hoc groups were established:Title Chair No. MeetingAHG on MPEG-4 Audio Reference Software

H. Purnhagen,Co-chair B. Teichmann

3495 No

AHG on Audio part of MPEG-4 Conformance

R. Sperschneider 3496 Sunday before 54th meeting

AHG on MPEG-4 Audio second edition T. Moriya,Co-chair B. Grill

3497 No

AHG on Audio call for Evidence S. Quackenbush 3498 NoAHG on MPEG-7 Audio Core Experiments A. Lindsay,

Co-chair:,J. Mantegna, T. Plamann, J. Herre, Y-M Kim

3499 Sunday before 54th meeting

Approval of output documentsAll output documents, shown in Annex-IV, were presented in Audio plenary and were approved.

Future activities

Schedule of future meetingsAd Hoc group meetings that may be held immediately prior to the next MPEG meeting, are shown in the table listing the Ad Hoc groups.

Agenda for next meetingThere was not time to review the agenda for the October MPEG meetings.

All other businessThere was none.

Closing of the meeting

72

The chair thanked the participants for attending this MPEG meeting and especially for giving the “Call for Audio Evidence” and the MPEG-4 Software re-write arrangements their careful attention.

73

Annex A-I: ParticipantsName First

NameCountry Affiliation e-mail address

Charlesworth Jason UK Canon [email protected] Weibei CN Tsinghua

[email protected]

Edler Bernd DE Univ. Hannover

[email protected]

Feiten Bernhard DE T-Nova [email protected] Bekand FR France

Telecom R&D

Bekand.foulonneau @francetelecom.fr

Garner Philip UK Canon [email protected] Bernhart DE FhG-IIS [email protected]

Herre Jürgen DE FhG-IIS [email protected] Sanae JP NTTDoCoMo [email protected] Jyri FI Nokia Res

[email protected]

Iwadare Masahiro JP NEC [email protected] Sang-

WookKR Samsung [email protected]

Klefenz Frank DE Frannhover [email protected] Jin CN Microsoft

[email protected]

Lindqvist Morgan SE Ericsson [email protected] Adam UK Lancaster

[email protected]

Le Guyader Alain FR France Telecom R&D

[email protected]

Mantegna John US AOL [email protected] Toshio US DoCoMo

USA [email protected]

Moriya Takehiro SG NTT [email protected] Hezi IL Geo [email protected] Sua-Hong JP Panasonic [email protected] Masayuki JP Sony [email protected] Sung-

HeeKR Samsung [email protected]

Pierrick Philippe FR France Telecom R&D

[email protected]

Plamann Tobias FR IRCAM [email protected] Schuyler US AT&T [email protected] Jean-

BernardFR France

Telecom R&D

[email protected]

Sperschneider Ralph DE FhG [email protected] Yasuhiro JP Sony [email protected]äänänen Mauri FI Nokia Res. [email protected]

mailto:[email protected]


mailto:sheba@sait


mailto:Shneo@psl


mailto:Moriya.takehiro@lab

mailto:Miki@dcl









mailto:Douwb@ee


Name First Name

Country Affiliation e-mail address

Center

75

Annex A-II: Agenda for the Beijing Audio MeetingAgenda Item Contributions1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of Noordwijkerhout and Genevea meeting

reports2.3. Allocation of contributions2.4. Communications from the Chair2.5. Joint meetings2.6. Review of AhG reports 6191 6232 6265 2.7. Review of task group mandates2.8. Received national body comments and liaison matters 6118(Geneva) 6161R

6252 6332 6342 2.9. Ballot responses 6120 61372.10. New MPEG profiles 6149R 6314R 2.11. Call for evidence of new audio technology 5981(Geneva) 61412.12. MPEG-4 reference software

2.12.1. Revisions 62942.12.2. Status of framework re-write

3. Task group activities3.1. MPEG-4 V2 conformance, 14496-4/Amd 1 (FPDAM

Jul 00)3.1.1. Doc and text 6185S 6192 6193 6261

6266 62773.1.2. Bitstream status 6244

3.2. MPEG-4 V1 Corrigenda or 2nd Edition3.2.1. Workplan for editing 6159

3.3. MPEG-7 Audio 15938-3 (CD Oct 00)3.3.1. Text editing, WD syntax, DDL syntax

consistency3.4. MPEG-7 Audio core experiments

3.4.1. Review progress 6173 6186 6282 6306 6325 6341

3.5. MPEG-7 discussions and promotion 3.5.1. Low-level audio descriptors3.5.2. Completeness of MPEG-7 Audio3.5.3. Candidate application demos 6295R 6301R3.5.4. MPEG-7 Audio overview document 6196R

4. MPEG Audio web page / FAQ / FTP site / press statement5. Discussion of unallocated contributions6. Meeting deliverables

6.1. Press statement6.2. Dispositions of comments6.3. Responses to NB comments6.4. Liaison statements6.5. Recommendations for final plenary6.6. Establishment of new Ad-hoc groups6.7. Approval of output documents

7. Future activities7.1. Agenda for next meeting

8. A.O.B.9. Closing of the meeting

77

Annex A-III: Task Groups

1. MPEG-4 V2 conformance, 14496-4/Amd 1 (FPDAM Jul 00)Chair Ralph SperschneiderMandates:1.1. Produce PDAM ballot DoC1.2. Produce FPDAM text 1.3. Review bitstream status

2. MPEG-4 V1 Corrigenda or 2nd EditionChair Bernhard GrillMandates:2.1. Describe scope of work

2.1.1. fix errors (see N3232)2.1.2. roll V1 and V2 into one document

2.2. Create workplan2.3. Begin DCorr

3. MPEG-7 Audio 15938-3 (CD Oct 00)ChairMandates:3.1. Revise WD text

3.1.1. New features3.1.2. WD syntax and DDL syntax consistency

4. MPEG-7 Audio core experimentsChair Schuyler Quackenbush and Jurgen HerreMandates:4.1. Review progress4.2. Select technology for inclusion in WD4.3. Revise "Status of MPEG-7 Audio Core Experiments," N34024.4. Revise Audio Core Experiments Methodology, N????

5. MPEG-7 discussions and promotion Chair Adam LindsayMandates:5.1. Discuss current support for low-level audio descriptors5.2. Discuss completeness of MPEG-7 Audio5.3. Identify candidate application demos5.4. Review and edit Audio part of MPEG-7 overview document (m6196)

6. Call for Evidence of Audio TechnologyChair Schuyler QuackenbushMandates:6.1. Agree on goals of Audio Call6.2. Agree on methodology for Audio Call6.3. Write Call for Evidence Justifying the Testing of Audio Coding Technology

Annex A-IV: Input and Output Documents

Contributed documentsThe following documents were contributed to the Audio Subgroup and were considered during this meeting:Number Section Source Title6120 General SC 29 Secretariat Table of Replies on 13818-4/FDAM 3 (SC

29 N 3655)6137 General ITTF via SC 29 Secretariat Table of Replies on ISO/IEC

14496-3/FDAM 1 (SC 29 N 3697)6141 Audio Pierrick Philippe Request for a "Call for evidence justifying

the testing of audio coding technology"6149 Requirements Mikio SASAKI A Proposal for Mobile Profile6159 Audio Takehiro Moriya, Masami Suzuki,

Kazuaki ChikiraProposed corrections to MPEG-4 Audio (14496-3) subpart 4

6161 Requirements D.Curet FNB comment for Beijing6173 Audio Timo Sorsa, Jyri Huopaniemi Evaluation results of Melody CE6185 Audio Jean-Bernard RAULT, Jean-Marc

JOTDraft text for Advanced AudioBIFS Conformance testing - Perceptual Approach

6186 Audio Juergen Herre, Frank Klefenz Check Site Report on MPEG-7 Core Experiment on Melody Similarity

6191 Audio Ralph Sperschneider Report of the Ad-hoc Group on the Audio part of MPEG-4 Conformance

6192 Audio Ralph Sperschneider Study on audio part of 14496-4 PDAM 16193 Audio Ralph Sperschneider Status and Workplan for V1 and V2 Audio

Conformance6196 Requirements Jose M. Martinez (UPM-GTI) MPEG-7 Overview Lite6232 Audio S. R. Quackenbush Report of the AHG on MPEG-7 Audio Core

Experiments6244 Audio Ralf Funken, Masahiro Serizawa Revision of MPEG-4 Version 2 CELP

Conformance bitstreams6252 Audio The national body of Japan Comments on 14496-3 and 13818-76261 Audio Akira Inoue, Yuji Maeda, Masayuki

NishiguchiER_HVXC related modifications in MPEG-4 version2 conformance PDAM

6265 Audio Heiko Purnhagen, Bodo Teichmann Report of AHG on MPEG-4 Audio Reference Software

6266 Audio Heiko Purnhagen, Nikolaus Meine, Bernd Edler

Comments on audio/HILN part of 14496-4 PDAM 1

6277 Audio Giorgio Zoia Suggested changes to N3067 (14496-4) subpart 5

6282 Audio Bernhard Feiten Query By Humming: State of the Art6294 Audio Yuji Maeda, Akira Inoue, Masayuki

NishiguchiER_HVXC related reference software modifications for the new error concealment management and frame concatination mode

6295 Requirements Neil Day, Witold Reichhart, Caterina Saraceno

Press Release of the MPEG-7 Awareness Event

6301 Requirements Neil Day, Witold Reichhart, Caterina Sareceno

MPEG-7 Applications, Demos and Projects vs. 0.1

6306 Audio P N Garner, J P A Charlesworth Status of Spoken Content D/DS6314 Requirements Jacques GUICHARD Declaration of intents concerning MPEG-4

Advanced Audio BIFS6325 Audio Tobias Plamann (IRCAM),

Geoffroy Peeters (IRCAM), Perfecto Herrera (IUA/UPF), Xavier Amatriain (IUA/UPF)

Third Party Validation Procedure and Status of the CE on Timbre Similarity

6332 Audio German National Body Comment on second edition of MPEG-4 Audio

6341 Audio Youngmoo Kim Status of Core Experiment on Melody DS

79

Number Section Source Title6342 General Mauri Vaananen Finnish NB comments on MPEG-4 ver. 2

Conformance

Output DocumentsThe following output documents were produced in whole or part by the Audio Subgroup. Those shown in Italics were approved for public release.

Title NoCall for Evidence Justifying the Testing of Audio Coding Technology 3483MPEG-4 Version 2 Audio Contribution to Conformance FPDAM text 3484Proposed corrections to MPEG-4 Version 1 and Version 2 Audio text 3485Proposed corrections to MPEG-4 Version 1 and Version 2 Audio Conformance 3486Status and Workplan for MPEG-4 Audio Conformance 3487Status and Workplan for MPEG-4 Audio Reference Software 3488MPEG-7 Audio WD 3489MPEG-7 Audio CE Methodology 3490Status of MPEG-7 Audio Core Experiments 3491Workplan for MPEG-7 Timbre Description Core Experiment 3492Workplan for MPEG-7 Melody Core Experiment 3493Workplan for MPEG-7 Silence Descriptor Core Experiment 3494

80

Annex A-V: Agenda for the La Beaule Audio MeetingAgenda Item Contributions1. Opening of the meeting2. Administrative matters

2.1. Approval of agenda2.2. Approval of Beijing meeting reports2.3. Allocation of contributions2.4. Communications from the Chair2.5. Joint meetings2.6. Review of AhG reports2.7. Review of task group mandates2.8. Review status of Audio Call for Evidence2.9. Report status of MPEG-4 reference software framework

re-write2.10. Received national body comments and liaison

matters3. Task group activities

3.1. MPEG-4 V2 conformance, 14496-4/Amd 1 (FDAM Dec 00)

3.1.1. Edit text 3.1.2. Bitstream status

3.2. MPEG-4 V1 Corrigenda and 2nd Edition3.2.1. Workplan for editing

3.3. MPEG-7 Audio 15938-3 (CD Oct 00)3.3.1. Text editing: WD syntax, DDL syntax

consistency3.4. MPEG-7 Audio core experiments

3.4.1. Review progress3.5. MPEG-7 discussions

3.5.1. Harmonization and completeness of MPEG-7 Audio

3.5.2. Candidate application demos3.5.3. MPEG-7 Audio Overview document

3.6. MPEG Audio web page / FAQ / FTP site / press statement

4. Discussion of unallocated contributions5. Meeting deliverables

5.1. Press statement5.2. Dispositions of comments5.3. Responses to NB comments5.4. Liaison statements5.5. Recommendations for final plenary5.6. Establishment of new Ad-hoc groups5.7. Approval of output documents

6. Future activities6.1. Agenda for next meeting

7. A.O.B.8. Closing of the meeting

81

Annex A-VI: Task Group on the Audio part of MPEG-4 Conformance

Input papers:

Version 1:M6277 – Suggested changes to N3067 subpart 5

Version 2:M6185 – Draft text for Advanced AudioBIFS Conformance testing - Perceptual ApproachM6192 – Study on audio part of 14496-4 PDAM 1M6244 – Revision of MPEG-4 Version 2 CELP Conformance bitstreamsM6261 – ER_HVXC related Modifications in MPEG-4 Version 2 Conformance PDAMM6266 – Comments on audio/HILN part of 14496-4 PDAM 1M6332 – Comment on second edition of MPEG-4 AudioM6342 – Comment on MPEG-4 ver. 2 Conformance

General:M6191 – Report of the Ad-hoc Group on the Audio part of MPEG-4 Conformance M6193 – Status and Workplan for V1 and V2 Audio Conformance

Work Details:

PDAM ballot DoC N3229 was used as starting point. PDAM ballot Disposition on PDAM ballot Comments have been prepared.

DoC on NBC DoC on M6342, M6161 (referring to M6185) and M6332 have been drafted.

Audio part of 14496-4 FPDAM 1 M6192 has been used as starting point. Comments made in M6185 have been reviewed and incorporated. Comments made in M6244 have been reviewed and incorporated. Comments made in M6261 have been reviewed and incorporated. Comments made in M6266 have been reviewed and incorporated. Comments made in M6332 have been reviewed. Comments made in M6342 have been reviewed and incorporated.

Conformance work plan M6193 has been used as starting point. The table reflecting the Version 2 test sequences has beenupdated based on the

produced FPDAM. The time schedules have been revised.

Corrigenda work A document has been set-up collecting correction requests (V1) and open points

(V2) Comments made in M6277 have been incorporated. Comments from FhG have been incorporated.

82

Annex 9SNHC Group Report

Source: Euee S. Jang

SNHC Meeting SummarySNHC objectives were:

to check the conformance status of Version 2 tools (i.e., FBA and 3DMC), to discuss the integration issue of 3DMC in Systems, to discuss the generic animation coding and review pre-registrations on the generic

animation framework, to review the proposal to change the SNHC homepage, to clarify if there is any overlap between MPEG-4 SNHC tools and MPEG-7 Video, and to review the FAQ of SNHC.

SNHC Objectives & Work ItemsAn outline of more detailed meeting objectives and work is given below:MPEG-4 Version 2A. 3D Model Coding

1. Integration issue in Systems2. Conformance

Reference S/W (with maintenance)B. Face and Body Animation

1. Integration to IM-1 MP-4 file format

2. Part 5 Reference Software

MPEG-4 Version 4A. Generic 3D Animation

1.Review of pre-registrations2.Draft of study document on the animation framework

MPEG-71. Any link between SNHC and MPEG-7?

SNHC Homepage1. http://www.sait.samsung.co.kr/snhc

FAQ of SNHC1. Review and update

SNHC Contributions & Related ReviewNo. Group Title

Section Source6147 MPEG-4 3D Mesh Coding Reference Software

SNHC Mahnjin Han et. al.6205 MPEG-4 Study of the Upstream Technique for MPEG-4 BIFS Scene

SNHC/Systems Do-Kyoon Kim et. al.6206 MPEG-4 Report of the AHG on 3DMC Conformance

SNHC M. Han6234 MPEG-4 AHG report on study of generic animation coding

SNHC E. S. Jang6235 MPEG-4 SNHC meeting report of the 51st MPEG meeting in Noordwijkerhout

83

http://www.sait.samsung.co.kr/snhc

SNHC E. S. Jang6270 MPEG-4 KNB Comment on 14496-5:2000/FPDAM1

SNHC KNB6271 MPEG-4 KNB Comment on 14496-1/AMD1

SNHC/Systems KNB6329 MPEG-4 Lisaion from Web3D: Miscellaneous clarifications on 14496-1

Systems/SNHC Web 3D Consortium6346 MPEG-4 Report of FBA Conformance adhoc

SNHC Eric Petajan, Tolga Capin6348 MPEG-4 IM1 software platform AHG report

Systems/SNHC Zvi Lifshitz6358 MPEG-4 Proposal of New MPEG SNHC Homepage

SNHC Euee S. Jang

Output Document EditorsDocument EditorMinutes of the Meeting Mikael Bourges-SevenierV2 3DMC Conformance Mahnjin HanDraft of Study of the generic animation framework Mikael Bourges-SevenierFAQ update Eric Petajan

SNHC & Joint MeetingsThe following schedule of joint meetings and SNHC work was agreed:

Joint in Monday Tuesday Wednesday Thursday FridayWG11 9:00am-

1:30pm WG11

Plenary

9-11:00am WG11

Plenary

2-10:00pm WG11 Plenary

SNHC 3-5pm SNHC Plenary – Roll Call,

SNHC deliverables, Workplan,

FAQ discussion,

3DMC conformance

9am–12pm SNHC

Plenary – V2 issues

11– 6pm SNHC Plenary – Version 5 Issues

9am-11pm SNHC Plenary –General Issues

9-11:30 SNHC- Plenary approval

Systems 1:30-2:10pm SNHC & Systems –

XMT

4-5pm SNHC & Systems –

IFS node using 3DMC

11-11:30am SNHC & IM-1

–IM-1

Requirements

8am-9pm SNHC & Requirements

84

Joint in Monday Tuesday Wednesday Thursday Friday–The generic Animation Framework

MPEG-7 Video

2:15pm –3:15pm

SNHC & MPEG-7 Video -

MPEG-7 Visual

Meeting Work & Results

Version 2 – FBA ConformanceThe reference S/W is in good shape and delivered. For the conformance of FBA tools in Version 2, the integration to IM-1 is found not to be complete: a slow decoding problem. The conformance text for FBA is promoted to FPDAM. Further actions will be taken to consolidate the maturity of IM-1 3D player concering FBA tools with the updated workplan till La Baule (N3565).

Version 2 – 3DMC ConformanceThe utilization of 3DMC on top of the IndexedFaceSet node in MPEG-4 BIFS has been a major issue for 3DMC conformance. Based on the input contributions as well as KRn NB comments, SNHC and Systems worked out together to find a reasonable solution without necessarily bringing any new corrections to MPEG-4 Systems Version 2 specification.For 3D model coding, we have also found some minor bugs in the text of version 2 Visual. However, the corrections will be taken into consideration in July, since a complete description of bugs and corresponding solutions is anticipated at the time. 3D model coding is also being considered to be a part of Systems Graphics profile. Structural solutions to attach 3D model coding to IndexedFaceSet node in Systems are also expected by July with NB support. And the solutions will be discussed in the AHG of 3DMC conformance.The major issues noted are: The IndexedFaceSet node may or may not be compressed with 3DMC. (In Version 1, it is not

compressed.) There has to be a way to signal whether 3DMC is used or not. 3DMC provides extended functionalities: compression, error resilience, non-manifold treatment,

etc. For efficient handling of the functionalities, it is required to have 3DMC contained in a separate bit stream from the scene graph bitstream.

Backward compatibility between versions has to be maintained.The reached recommendations are: Clarification on the USge of V2 IFS node is required as a Systems (informative) corrigendum. Through the use of ScalableBIFS architecture, separate bit streams can be provided. Profiles and levels have to be defined with special care on IFS node.Based on the above recommendations, a working draft has been issued at Beijing. Further work will be sought as an AHG activity of 3DMC AHG.

Version 5 – the generic animation frameworkAs of July 1, 2000, we have received three pre-registrations. The detailed information is attached in the annex. The pre-registrations can be categorized as follows. Proposal from Superscape: Subdivision surfaces Proposal from Samsung AIT: Interpolator compression Proposal from iVast: General framework

85

After reviewing the pre-registrations, the group spent some time to draft a document titled ‘study of the generic animation framework’(N3538). The discussion on the animation framework will continue until La Baule with the following schedule:Item Schedule Meeting StatusCall for Proposals (N3341) March - COMPLETEPre-registration 1 July 2000 No COMPLETEJoint meeting with Web3D 28 July 2000 Yes (New Orleans, US) PLANNEDFinal Proposal 15 September 2000 No PLANNEDEvaluation meeting 22 October 2000 Yes (La Baule, FR) PLANNEDMPEG-4 Committee Draft July 2000 TENTATIVEMPEG-4 Final CD March 2002 TENTATIVEMPEG-4 Version 5 FDIS July 2002 TENTATIVEThe group acknowledged a need of coordination between Web3D and MPEG. As a positive sign of collaboration between MPEG and Web3D, a joint meeting is planned during the period of SIGGRAPH 2000.

MPEG-7?In Beijing, MPEG-7 was brought to attention in SNHC. Particularly, it was noted that there might be relevance in MPEG-4 FBA descriptors and MPEG-7 face description. No particular decision has been made at Beijing. It, however, was decided that we need to study more on MPEG-7 face description as well as FBA descriptions. It is anticipated that MPEG-7 and SNHC will meet together in La Baule for discussing issues related to synthetic elements in MPEG-7.

Change of SNHC HomepageTo accelerate the USge of SNHC homepage, a new hompage was kindly proposed by Samsung. And it has been accepted as new SNHC official homepage: http://www.sait.samsung.co.kr/snhc.

SNHC FAQ updateFAQ of SNHC was reviewed by SNHC members and got fixed with 3 new Q&As. It was decided not to officially update the FAQ this time due to the marginal changes to the FAQ. Dr. Eric Petajan is currently in charge of maintaining the FAQ draft

Output DocumentsRefer to Clause 7.

Ad Hoc GroupsRefer to Clause 7.

ParticipantsMany thanks to the following individuals who participated in SNHC meetings in Beijing:Name Company Cou

ntry

E-mail

James D. Kim Samsung AIT KR [email protected] Rowe Canon (CRE) UK [email protected] Petajan face2face animation US [email protected] S. Jang Samsung AIT KR [email protected] Jin Han Samsung AIT KR [email protected] Bourges-Sevenier iVast Inc. US [email protected] Zhong Shenzhen Huawei CN [email protected]

86








Technologies Co., Ltd.Lu Yu Zhejiang University CN [email protected]

Annex -Pre-registrations for the generic animation framework

Superscape proposalName Andy WildeCompany Superscape PlcContact Address Cromwell House, Bartley Wood Business Park, Hook,

Hampshire, RG27 9XA, United Kingdome-mail [email protected] of Proposal Subdivision Surface techniques for the representation and animation

of synthetic objects in MPEG-4

Superscape intends to submit a proposal in response to the MPEG working group CFP for a generic animation framework for synthetic objects.

The proposal will be based on work undertaken in the area of subdivision surface techniques for efficient delivery of interactive real-time 3D content on the world wide web.

Use of subdivision surface techniques has, until now, been limited to creation of high-end animation sequences where each frame is rendered and recorded, the recorded sequence of frames being replayed at a later time as prerecorded animation. Such use is exemplified by Pixar in their animated films. Superscape has made advances in subdivision surface algorithms that make the technique highly suitable for use in delivering real-time interactive 3D content across low bandwidth connections to receiving devices with a range of capabilities.

The benefits of subdivision surface technology include:

Content sizes up to two orders of magnitude smaller than the equivalent tri-mesh representation, and up to one order of magnitude smaller than other geometry compression techniques.

High levels of accuracy and realism, as detail is generated rather than being recovered from (potentially) “lossy” compression algorithms. Lighting normals and texture coordinates are created at the same time as new vertices are generated during the subdivision process, again ensuring accuracy and realism.

Highly scalable on the viewing device to accommodate wide variety of viewing devices, and rapid rescaling to accommodate very dynamic content or content manipulation on slower devices.

Staightforward polygonal modelling for content creation.

Small animation datasets, as only the subdivision control hull needs to be animated.

Use of this technology in Superscape’s current product set, SeV, can be seen by visiting the web site www.superscape.com . The gallery pages show sample content and the technology pages give further insight into the benefits of subdivision surfaces. Samsung Proposal

Proponent Information

NameDo-Kyoon Kim,Sungjin Kim,Mahnjin Han

Company Samsung AIT

87

http://www.superscape.com/



Contact AddressSignal Processing Lab, SAITP.O.Box 111, Suwon, 440-600, KRemail: [email protected]

Title of Proposal Compression of Interpolator nodes in MPEG-4 BIFS

Short Description of the Proposal

ObjectiveSamsung AIT is planning to submit a proposal on the method to efficiently compress

the interpolator node data that represent enormous amount of motion information produced for animation in MPEG4 BIFS.

FunctionalityFor the graphics applications with animation, a large amount of data is generated to

meet the quality of service. Huge data size is a burden not only for fast delivery, but also for efficient storage. For animation, modeling and animation data comprise the most part of the bit stream. While there have been considerations to compress the model data in MPEG-4, little attention is given to animation data compression.

Among the various animation nodes in MPEG-4 BIFS that include animation parameter, this paper considers 6 Interpolator nodes (Color, Coordinate, Normal, Orientation, Position and Scalar) for compression. The animation is represented in each node with key and keyValue fields. The animation data represented by the given node syntax show a very strong correlation within consecutive field values, which leaves a room for high compression.

Very high compression of animation data will enable high quality animation services through network with minimal storage requirement. The proposed coding scheme will incorporate additional features such as scalability and error robustness.

Compression method In this proposal, various compression methods are applied according to the

characteristics of each interpolator node. For example, position interpolator node may be differentially coded with p-th order linear or non-linear prediction.

iVast proposal

Proponent InformationName Mikaël Bourges-Sévenier

Aaron E.WalshCompany iVAST Inc.

Mantis Development Corp.Contact Address 4699 Old Ironside dr.

Santa Clara, CA 95050USemail: [email protected], [email protected]

Title of Proposal Definition of a generic framework of animation toolsShort Description of the Proposal

88



ObjectiveiVAST Inc. intends to submit a proposal for a generic framework of animation tools for MPEG-4

BIFS scenes.

FunctionalityA framework is by definition an integrated collection of components that collaborate

to produce a reUSble architecture for a family of related applications. Such frameworks have been specified in MPEG-4. For animation, however, we have only a set of limited tools and not a more powerful, coherent framework.

To cite Frank Thomas and Ollie Johnston, “animation comes from ‘animus’ which means ‘life or to live’. Making it move is not animation but the mechanics of it”. The current mechanic tools in MPEG-4 for animation are interpolators, and their compressed streaming version is BIFS-Anim.

We view the animation framework as a set of tools to make a static scene description come to life by combining behaviors. This framework should support new behaviors such as, but not restricted or limited to, the following:For modeling:

NURBS, subdivision surfaces, patch surfaces, other parametric surfacesImplicit surfaces such as blobs, level setsParticles systems

For texturing:Projection maps, environment maps, procedural textures (1D, 2D and 3D)Multi-layered texturing

For deformations and animation:FFDs, morphing, Alan Barr’s deformations: twist, taper, bend, stretch, skew…B-spline based animation path, procedural animationGeneric inverse kinematicsGeneric dynamics (ex: physics for collision, flags in the wind…)

Simpler interactivity support: buttons, windows, dialog boxes, editable text fields…Transitions and special effects: wipe, dissolve…

The framework should also provide means to support new behaviors as needed, such as proprietary behaviors created by 3rd party developers.

Compression method In this proposal, a compressed description of a behavior will be proposed as well as

how components can interact with each others and how to support custom proprietary behaviors.

89

Annex ISG Report

OverviewTwo main topics have been the subjects of the Implementation Subgroup activity in Beijing:

1. MPEG-7 XM development for video/audio descriptors and Descriptor Schemes,2. Complexity of video tools:

- AC prediction complexity for the Video Streaming Profile.- Analysis of “Fine Granular Scalability” specification, implementation issues.

Input contributions w.r.t. the above items are summarized according to the following table:

MPEG-7 XM developmentM6281 Report of AHG on XM Development. Stephan Herrmann

Complexity of video toolsM6307 “Report of Ad Hoc Group on Complexity

evaluations of video tools”.Jan Bormans

M6128 ”AC Prediction complexity analysis and concerns about FGS implementation”

Kristof Denolf, Christophe De Vleeschouwer

M6263 ”Further Study on Complexity of AC Prediction”

Minhua Zhou, Hong Jiang, Weiping Li

Detailed Report

MPEG-7 XM developmentSeveral joint meetings have been taken place during the week between the ISG team involved in the XM development and the audio, video and MDS groups. Discussions have started with the MDS group with the review of the current status of the integration of the XM. The main outcomes of the discussions can be summarized as follows:

Joint Meeting ISG-MDS

All DSs have been submitted between meetings according to the planned schedule, due to short time not all of them has been integrated, or not all the code could be integrated without further modifications. Only three DS codes were apparently missing (some of them were actually sent late to the ftp site). Situation has been clarified and updated.The format of the submitted code was not OK in most of the cases, for that it was decided to carefully update the guideline document. The summarization DS will be used as example for the code integration. Another modification of the guidelines will include the update of the structure of the media data. The document will be ready two weeks after the end of the meeting so as to provide a complete and accurate guide for the integration. The document will include templates to guide the introduction of comments and explanation to the code already integrated and for the one that will be integrated in future. ISG has requested the collaboration from the MDS group to check consistency

90

of section 4 with section 3, and to update the data structure of the “generic DS”. Revision will be in two steps, one week to restructure and then indicate what is missing, and then a task group from MDS will complete the document. Another point discussed is the documentation that needs to be included in the XM by all DS proposers (for all DSs, the one already integrated in the XM and the ones still to be integrated) for its use. A new schedule for the integration of 19 new normative DSs has been agreed (see output document M3510). The integration of a complete MPEG-4 decoder for media data is still in discussion and no decision or commitments have been taken.

Joint Meeting ISG-Video

A complete review of the integration of video descriptors has been done during the joint meeting, most of them are already integrated, the last ones left out of the XM will be integrated soon. So as to facilitate the heavy integration task, the new rule is that for new submission the submitted code that does not comply with the guidelines concerning the code structure and form, will be rejected and submission of code (condition for the tool to be included in the Working Draft) will be considered as not valid. Such drastic measure has been agreed with the video group.Three new descriptors are scheduled for the integration before next meeting (see output document M3510).

Joint Meeting System DDL – ISG

A review of the status of DDL parsers integration in the XM has been the subject of a joint ISG-System meeting. A Java XML parser with the necessary extensions for MPEG-7 could be ready in two months and could be integrated in the XM by next meeting. Dead lines for the integration has been agreed but no firm commitment have been taken by the developers of the parser. A problem discussed was how to develop the interface between the parser and the XM written in C++, as well as the platforms to be supported (Solaris, Linux and PC NT). It was decided to develop a simple interface carrying just the information that gives the OK if a description is valid or an error signal with the error information to be dumped on a log file.A discussion has clarified for all groups the statis of the parsers in the XM. Validation will be done by the Java parser, the C++ parser presently integrated in the XM provides the DOM API.Although such solution employing two parser could it be a viable solution since the interface work is greatly facilitated, it is certainly not desirable and the final objective is to integrate in the XM a single parser able to validate and to generate an MPEG-7 description so covering all required functionalities.

Joint Meeting ISG-Audio

Long, but fruitful, discussions have taken places between ISG and Audio. Finally a schedule for the integration of 11 new low levels audio descriptors has been agreed (see output document M3510). Finally a clarification came out about the problem of integrating the “Spoken Content” descriptor. Actually the “Spoken Content” is neither a descriptor nor a DS, but it is what in MPEG-7 it is called an application. Therefore, the problem is reduced to how to support in the XM different applications than the simple “extraction and matching” applications already supported in the current XM architecture. A further discussion has clarified how to correctly partition the “Spoken Content” and how to map in the XM. An open problem in the XM put in evidence by this application remains: how to combine a C++ description representation coming from an extraction tool with a description coming from a DS and represented in DOM in the XM? Such problem can be solved fully implementing the application by means of a full DDL representation. The problem is how to do that when such full DDL implementation results impractical (too much code rewriting!) such as it occurs for the “Spoken Content” software.

91

Meeting outcomes about XM development

In conclusion main achievements of the meeting concerning the XM development are: The definition of new Work schedules for the XM integration (video tools, audio tools and

DS) The detailed exchange of information about the existing structure of the XM software with

Video, Audio, MDS, and DDL groups The improvement and update of the XM documentation and guidelines for integration,

(available 15 days after the end of the meeting)

Complexity of video tools

AC/DC prediction complexity for the Stream video profile

ISG has carefully reviewed the recommendations of the ad-hoc group and the two contributions on AC prediction complexity:

- M6263 bases its analysis on profiling the number of cycles that AC prediction on Intra macroblocks requires comparing it to the number of cycles of a half pel motion compensated B macroblock

- M6128 bases its analysis on memory USge showing that data exchanges are not relevantly affected by AC prediction.

The two contributions shows that on one side the implementation of the AC prediction in Intra MB can cause difficulties on some specific DSPs, but on the other that such complexity does not affect the data flow that is the real bottleneck on most implementations. Two solutions aiming at reducing the overall complexity of the SVP seem possible, of which only the first one maintains the compatibility with the simple profile:

1) To limit the maximum number of Intra MBs for the SVP for the different levels according to the scheme: Level 1: 100%, Level 2: 100%, Level 3: 50%, Level 4: 25%,

2) To forbid the change of QP in a frame so that AC prediction does not require divisions without limits in the maximum number of Intra MB

Joint meeting with Requirements

The two solutions have been presented to the Requirement group. A clarification of the possibility of using 100% Intra while not using AC prediction has been asked.Objections were still raised about the complexity of keeping compatibility with the SP. Solution 1 has been taken by the Requirement group. A resolution from the Requirement Group explaining the reasons of the taken decision has been issued.

FGS Implementation Concerns

Some concerns expressed in contribution M6128 has been discussed within the ISG.Encoder side: FGS is inherently a frame based processing at encoder side: the number of encoded bitplanes depends on the maximum DCT residual coefficient of the frame. Proposal: start encoding based on previous frame and stop if it is finished or add a new bitplane if necessary. This optimisation could need to change the syntax.Decoder side: two propositions of previous meeting have not been accepted, so the problem is not in the final CD. Water ring scan order raise some concerns but is not yet included in the CD so a detailed analysis will be carried out only in case of inclusion in the standard.

92

AnnexLiaison Group report

Source: Douglas Armati

Approval of the Liaison documents listed below

Title No.Liaison about MPEG-21 to ITU Study Group 16 (Multimedia Services and Systems) regarding Mediacom 2004

N3590

Response to liaison statement from DVD Forum on MPEG-2 amendment for video supplemental information

N3591

Response to Liaison from OPIMA N3592Response to ATSC on transport of MPEG-7 metadata on MPEG-2 transport streams N3593Response to ITU-R WP 6P (formerly WP 11A) on EHRI N3594Response to ITU-R WP 6P (formerly WP 11A) on Digital Television Receivers for Multiple Physical Delivery Systems

N3595

Response to SMPTE on 1. Digital Cinema and MPEG Studio Profile 2. MPEG-2 for video elementary stream supplemental information 3. Request for amendment to ISO 1318-1 MPEG-2 for the carriage of Metadata over MPEG-2 transport and 4. Possible use of KLV in MPEG-7

N3596

Response to CEN on New work item on data privacy N3597Liaison to EBX on version 0.8 of their Specification N3598Response to Content ID Forum liaison proposal N3599Liaison to OEBF on the work of their Digital Rights Management Working Group N3601Response to Liaison Statement from ITU-R JWP 10-11Q to SC 29/WG 11 on Draft New Recommendation of Method for Subjective Listening Tests of Intermediate Audio Quality [10-11Q/TEMP/31-E, Attachment: 10-11Q/TEMP/30-E]

N3602

Response to IEC NP (61937-6): Interface for non-linear PCM encoded audio bitstreams applying IEC 60958 -- Part 6: Non-linear PCM bitstreams according to the MPEG2 AAC format(s) [100/149/NP]

N3603

Response to Liaison Document of IEC TC 100 Advisory Group on Strategy N3604Liaison to JPEG 2000 on MPEG-7 N3605Response to submissions from Web3D N3606Liaison on MPEG-21 PDTR N3608Liaison on MPEG-4 CfP for Intellectual Property Management and Protection Solutions

N3609

Liaison about MPEG-21 to ITU Study Group 16 (Multimedia Services and Systems) regarding Mediacom 2004

N3590

Liaison to Dublin Core Metadata Initiative (DCMI) N3610Liaison to IETF on the carriage of RTP over MPEG-4 N3611

Discontinuation of the following liaisons

Organisation From WG11 To WG11OCLC, Inc. Jane Hunter

Approval of the following liaison officers

Organisation From WG11 To WG11DCMI Jane Hunter

94