Networked Audiovisual Systems and Home Platforms

Information Society Technologies 6th Framework Programme Networked Audiovisual SystemsandHome Platforms February 2003 INFSO D2Augusto De Albuquerque http://www.cordis.lu/ist/ka4/vision

INFSO D2 in a nutshell The Unit D2 will support the innovation and development of technologies for end-to-end interoperable audio-visual networks, services and applications. Key R&D aspects address innovation in the processing and delivery of audio-visual materials, cross media platforms and devices, including broadcast, home platforms and new visual systems and devices (displays).

INFSO D2 in a nutshell Mid-term to longer-term research the will prepare the next steps Support standardisation Awareness of ongoing work on regulation of digital AV networks and services Key criteria Vision from information to experience Industrial strength in phase with Europe's strongest industrial assets Need for intervention at EU level focus on synergy between innovation and Industrial exploitation (standardisation has a key role) Expected impact next wave of innovation in Audio-Visual systems

Policy drivers Innovation in R&D to allow wise investors to make wise decisions and contribute to Audiovisual/Information Society markets to development Support to European standards for interoperability and affordability to make a success of eEurope 2005 objectives, in particular for DTV platforms ‘Internet services must be accessible through mobile and TV’, Liikanen, le Figaro, 04/11/02 3G and DTV are key component to widen the broadband access to Information Society Services. (Commission communication on “Barriers to widespread access to new services and applications of the information society through open platforms in digital television and third generation mobile communications”)

Networked AV Systems and Home PlatformsScope: essential elements of convergence… Activators Elements in Convergence Rich Media Motion picture Music, Sound, Voice Still image, Graphics, Text Digitalization TV, Telephone Interactive/Passive E-mail, E-commerce (transactional) Information Streamed in Real-Time/Cached Personalized/General Public Service Advances in Technology Transport Analog & Digital Broadcasting Networks (Terrestrial/Satellite/Cable) Telecom Networks (Fixed-line/Mobile) Dedicated Networks Affordability of Technology Terminal TV, PC, PDA Fixed-line phone Mobile phone Glasses, Watches USERS

Landscape of IST projects (1999-2002)(Networked AV Systems and Home Platforms) NexTV, WEBKIT End-User Platforms Service Provider ICE-CREAM, MUFFINS OCCAMM, MOSES METAVISION, ASSET SoNG, GMF Standards DVB (MHP, IP,…) MPEG4, MPEG7, MPEG21 OPIMA, TV-Anytime W3C family (…) SAMBITS, SAVANT ARDOR, ISIS TP-MHP ENREVI,VISIRE FUTURE HOME PISTE PISTE SAMBITS SPATION OPENISE, VIRTUE CISMUNDUS, CONFLUENT SHARE-IT myTV SOQUET UP-TV SHARE-IT

Last IST/FP5 Call Results End-to-end Networked Audiovisual Systems and Services co-operative networking Rich Media Production Displays (Open) Multi -User - Platforms ISIS ASSET CONFLUENT E-NET MUFFINS STEPLED

IST/FP6: … challenges

A bright Future for Audiovisual Communications ?… we hope IST/FP6 can help in that direction... • from MULTIMEDIA to RICH MEDIA: ENJOYABLE… no limits!? • from POTS to ADSL to BB+: FASTER • from FIXED to MOBILE: ANYWHERE • from THIN to FAT: ANYTIME • from MONOLITIC to SCALABLE: PORTABLE • from DIFFICULT to EASY: FRIENDLY • from EXCLUSIVE to INCLUSIVE: AFFORDABLE • from COMPLEX to SIMPLE: INTELLIGENT • from SEPARATE to CO-OPERATIVE: SUSTAINABLE • from CLOSE to OPEN: INTEROPERABLE We want ALL !

SO: Networked Audiovisual Systems and Home Platforms Trusted free choice environments for more intuitive access and interaction with hybrid 3D multimedia signals and objects. Rich media objects representation, identification, location and description Seamlessly co-operating IP (Internet Protocol) audiovisual (AV) networks, storage, new middleware protocols and architectures for real time and consistent multimedia routing, storing and distribution, load and balancing control mechanisms, P2P, datacasting and streaming of audio-visual rich media. Adaptive Quality of Services for scalable audio-visual flows on heterogeneous networks, AV internetworking, network traffic engineering, interactive AV service management, and simulation.

SO: Networked Audiovisual Systems and Home Platforms Home server portals, interoperability between home networking technologies and their integration with global networks, as a means for access to, and generation of combined applications and services. AV portals with storage, management and repackaging appliances, including extended home distribution. Advanced retrieval methods and business models to support access to streamed and stored audiovisual media from anywhere in the home and car environment from any device. Research will strongly concentrate on enabling technology for error-resilient representation, slicing and handling of rich audio-visual signals.

SO: Networked Audiovisual Systems and Home Platforms It concerns basic research, structuring and federating the best groups in Europe from the communication areas. It also concerns research in high potential, industry-driven domains such as next generation 3D-TV, electronic cinema, virtual & tele-presence and future mixed-reality-based mobile personal communication services. A strong requirement will be that these activities should be centred around a communication and storage infrastructure and should aim at exploiting the outstanding European potential developed over several Programmes in this area. Active contribution to world-wide standard setting will be a prerequisite.

Who is Who • This area has been successful in exploiting INDUSTRY LED initiatives with European and Global impact: • ISO MPEG standards… 1, 2, 4, 7, 21 • DVB… network, terminal, convergence, copy protection, MHP • IETF Communication Remove Barriers(…)interoperability is a need for a dynamic industry associated to AV Technology Infrastructure and ServicesTelecom Operators, Broadcasters, CE Manufacturers, Software Suppliers, AV Hardware manufacturers, Research Labs and Universities

… structuring the area in IST in FP6 RICH MEDIA TECHNOLOGIES SERVICE / APPLICATIONS Virtual presence e-learning, games, VoD Virtual and Mixed Reality Complex AV Scenes Coding, Graphics Interactive TV 2D and 3D audio/video Rich AudioVisual Services Terminal APIs Advanced Rendering and Visualization Server, set top box, broadband access Digital Rights Management Home Networked Appliaces network QOS, streaming MPEGx enabled Players DVB-Networks CATV Home networks IP Multicasting AV NETWORKING BROADBANDTERMINAL/ SERVER

Audiovisual Flow in a Broadband World Content Producers Distributors Broadcasters Service Providers Broadband Internet IP-Network Operators trad. Dig. TV MPEG2-Network Operators Consumers Networked Homes

Networked AV Systems and Services • “low cost access network equipment,…optimized as function of the operation environment, including …interactive broadcasting. • new concepts for network management,…to provide enhanced intelligence and functionality in the access network for delivery of new services, and end-to-end network connectivity. • multi-service capability: (i.e. e.g. for cable operators: VoIP, fast internet access, multi-site games, video-communication). • Increase bandwidth capacity,…commensurate with the expected evolution in user requirements … (depends on services, coding …) • a generalized introduction of BB services (..scalability..) • …the access portion of the next generation network.. • …regulatory aspects...

Proposing New Work

R&D is a serious business ! • Targets should be well dimensioned • Targets should be clear and focused • Should bring competitive advantage for your company/partnership and the European Industry • It must respects citizens legitimate hopes to improve quality of life IT MUST EFFICIENTLY USE AVAILABLE RESOURCES !

R&D is a serious business ! • Clear Technical Description • state of the art • innovative aspects • who does what • Clear Deliverables • Clear Time Plan

R&D is a serious business ! • DEADLINE FOR SUBMISSION: 24 April • (read carefully the conditions… time of closure) • EVALUATION: in Brussels from 12 to 23 May • A number of administrative and management steps follow to have the final adoption of the evaluation results

Evaluation Criteriaexample of IP

1. Relevance • What is the extent to which the proposal addresses the scientific, technical, socio-economic and policy objectives of the Workprogramme in the areas open in the call ?

2. Potential impact • Is the proposal suitably ambitious in terms of strategic impact on reinforcing competitiveness or solving societal problems ? Are the innovation activities, exploitation and dissemination plans adequate to ensure optimum use of the project results ? Is there demonstrated added-value in carrying out the work at a European level and does the proposal take account of research activities at national level and under European initiatives (e.g. Eureka) ?

3. Scientific and technical excellence • Does the project have clearly defined objectives ? Do they represent clear progress on the current state-of-the-art ? Is the proposed S&T approach likely to enable the project to achieve its objectives in research and innovation ?

4. Quality of the consortium • Are the participants collectively a consortium of high quality ? Are the participants well suited and committed to their tasks ? Is there good complementarity between the participants ? Is there adequate industrial involvement to ensure exploitation of results ? Has the opportunity to involve SMEs been adequately addressed ? If additions to the consortium are foreseen in the lifetime of the project, is the profile of the new participants clearly described ? Is the proposed expansion credible ?

5. Quality of the management • Is the organisational structure matched to the complexity of the project ? Is the project management of high quality ? Is there is a satisfactory plan for the management of knowledge, IPR and innovation-related activities arising in the project. If the addition of participants during the lifetime of the project is foreseen, will the management structure adaptable for this ?

6. Mobilisation of resources • Will the project mobilise the critical mass of resources (personnel, equipment, finance etc) necessary for success ? Are the resources convincingly integrated to form a coherent project ? Is the overall financial plan for the project adequate ?

Networked Audiovisual Systems and Home Platforms