METADATA

1. METADATA IST Concertation Meeting Brussels March 5th 2001 Everything we (You?) always wanted to know but were afraid to ask Paul Walland(MetaVision) Pierre Pleven (Enrevi) Presentation inspired by IAB seminar 25-27 Feb 2001 in Montreux

2. What People say ... • Metadata is data about data (John Doe) • Lifeblood of e-commerce and broadband (A silicon Valley VC) • An item of metadata is a relationship someone claims exists between two entities (A British mathematician)

3. Metadada: The Definition! • The Essence:Sound, Image, Text • Ex: Captions, Graphics,Moving image,Subtitles,Music.. • The Metadata: Data about the essence • Ex: Title, Credits, Sampling rate, Aspect ratio, Supplier phone no, Archive reference • Content=Essence+Metadata. • Content is what is being traded • Trading creates value.

4. Metadata: The value... • Value : better control of production process. • Value : more revenue from existing content. • Value: New contents and new services • Metadata changes content into assets

5. Better control of production process • Metadata exists throughout production process: • Design, Pre-production, production,post-production, on air mgmt, archives, audience data. • Metadata belongs to several classes: • Technical, Rights, Administrative, Content description. • Value is created through Consistency, Coherence and Conservation of metadata

6. More revenue from existing content. • Archives can be better valorised. • Content has built-in re-purposing facilities. • Rights can can be valorised through traceability. • Technical quality can be maximized through traceability. Metavision Metavision

7. New services! • Management of Metadata is key to: • EPG : Content description • TV-Anytime : Content description, Client profile • VOD: Content description, rights management • Media Interactivity: Objects description • Media Personalisation: Objects description, client profile Enrevi

8. Metadata: Technical aspects • Standards and Bodies • Metadata types • Metadata granularity • Metadata logistics • Metadata of metadata • My_metadata

9. Standards and Bodies • SMPTE: • SMPTE 319M (MPEG re-coding data) • SMPTE 330M (UMIDs) • SMPTE 336 (KLV coding) • SMPTE 335 & RP 210 (Metadata Dictionary)

10. DVB and Metadata... • MHP 1.0 Local Interactivity • Metadata in SI • MHP 2.0 Internet Profile (XML) • MHP 2.x Local storage (TVAnytime) • MHP 3.0? 3D, Personalisation, avatar (MPEG4?)

11. And the rest ... • ISO (MPEG-7, MPEG-21) • W3C (XML) • AAF • Pro-MPEG (MXF) • BBC (SMEF) • EBU (P-Meta) • TV-Anytime • Librarian Community (Dublin Core)

12. Contents Description Administrative Rights Scene description Client profile Informative Technical Historical “Intimate” metadata Metadata types: Non exhaustive…

13. Descriptive Metadata • Title, • Identification • Contributors (“credits”) • General scene description • etc.

14. Technical Metadata • Data that assists in the handling of the essence - coding decisions, bit-rates, frame types and so on. • Data that describes objects inside essence: • Camera position, camera movement, Camera id • 3d model, objects position and shape.

15. Historical Metadata • The “memory” of the content • What has happened to the material in the past - format conversion, compression types and parameters etc.

16. Rights Metadata • Dangerous area! • All information pertaining to ownership of material and rights payments conditions • Can also include legal information

17. “Intimate” Metadata • Content in the form of data but intimately connected with the essence • Data which is captured with the essence in order to augment its value • … to be discussed further by MetaVision. • ... to be discussed further by Enrevi.

18. Pictorial representation

19. Granularity and Validity of Metadata • Metadata can be relevant to an entire sequence, or shot, or may be only relevant to a particular frame or portion of a frame • Metadata may only be valid over a particular range (even if it is present outside that range)

20. Availability of Metadata • The timing of the metadata may not be critical, or it may need to be synchronised with frames or pixels • Metadata may need to be repeated every frame, or it may only need to be sent whilst it is valid

21. The carriage of Metadata • Unique identification of each logical segment (UMID) • Synchronisation of metadata with relevant essence • Enclosing of essence within metadata “wrappers” • Handling of “streams” and “files”

22. XML and KLV • XML selected by MPEG-7 • SMPTE considering using DTDs (Document Type Definition) to allow transformation of KLV encoded metadata into XML • KLV language independent, XML is not • Essence difficult to handle in XML, easy in KLV • XML easy to process in IT systems, KLV is not

23. XML : Metadata of metadata ? TV-Anytime Common framework based on W3C ’s XML family EBU P/META Dublin Core MPEG-7 SMPTE Source : EBU TECHNICAL REVIEW - September 2000 J.-P. Evain

24. My_Metadata • Worksession at ___ in ___ • My_Metadata(Metavision) • My_Metadata(Enrevi) • My_Metadata (X,Y,Z)

25. My_Metadata (Enrevi) • Enrevi: Enhanced reality for the video • Strong emphasis on production costs and operability. • Broadcast : Camera tracking, graphics creation, keying, real time . • Broadband: Mpeg4 scene description. • Broadband: Mpeg7 metadata.

26. My_Metadata (Enrevi) • Enrevi: Enhanced reality for the video • Strong emphasis on production costs and operability. • Broadcast : Camera tracking, graphics creation, keying, real time . • Broadband: Mpeg4 scene description. • Broadband: Mpeg7 metadata.

27. My_metadata(Enrevi):Camera • x,y,z, pan, tilt, zoom, focus. • Multicamera: Camera id. • Generated by proprietary technology... • Stored VBI, Audio, Tapes... • Mpeg4 encoding.

28. My_metadata(Enrevi):3D scene • 3D objects • 3D scene reconstruction • Today VRML • Tomorrow MPEG4 3D?

29. My_metadata(Enrevi):objects in scene • Players tracking • Encoding of trajectory and id. • Broadcast enhancement • 3D reconstruction.

30. My_Metadata Enrevi Demos. • Profiled scene composition • 3D scene reconstruction