Building a great Metro style device app for your camera

1. HW-715T Building a great Metro style device app for your camera Khurram Zia Program Manager Mehmet Kucukgoz Program Manager Microsoft Corporation

2. Agenda • What are Metro style camera device apps? • How to create Metro style camera device apps? You’ll leave with examples of how to • Incorporate your differentiated experience into Windows built-in experiences and Metro style apps that use your camera

3. Windows 8 enables you to offer a differentiated device experience for your cameras.

4. And Windows 8 makes your differentiated device experience available to all Metro style apps.

5. demo Personalize your system with an account picture Default camera options experience Customized settings experience for LifeCam Studio

6. Deconstructing the Metro style device experience for cameras

7. Building a Metro style camera experience app driver MFT + + Driver MF Transform Metro style app A great camera device! Device Metadata

8. Building a Metro style camera experience Camera Options Experience driver MFT app + Camera Driver MFT Start Experience Metro style app Device Metadata

9. Build the Start experience

10. Start ExperienceWhat is it? • Metro style app with unique functionality for the device • Activated by clicking on the app tile in start • Opportunity to differentiate on brand and functionality • Related merchandise (headsets, microphones) • User guides and support • Download additional effects • Specialized capture services (e.g. postcards, photo strips)

12. Build the camera options experience

13. demos Metro style apps with customizedcamera options

14. Camera options experienceWhat is it? • Experience that shows up in context to apps using cameras • Activated by apps via a call to ‘CameraOptionsUI’ API • It’s your experience and you own every pixel • Opportunity to differentiate yourselves for your customers • Color Effects • Face tracking effects • Scene modes • Image stabilization

15. How apps use your camera options ISV Metro Apps Windows APIs Metro Device App App LifeCam Camera Options Camera Capture UI more options App App App CameraOptionsUI API Call App

16. How apps use your camera options ISV Metro Apps Windows APIs Windows UX App Default Camera Options Camera Capture UI more options App App App CameraOptionsUI API Call App

17. Camera options What you need to add to your app • Add a camera options experience to your app • Subscribe for camera options contract to show up in all Metro style apps

18. Subscribing to the camera options contract <?xml version="1.0" encoding="utf-8"?> <Package xmlns="http://schemas.microsoft.com/appx/2010/manifest"> ... <Applications> <Application Id="lifecamsettings.App" Executable="lifecamsettings.exe“ EntryPoint="LifeCamSettings.App"> ... <SplashScreen Image="SplashScreen.png" /> </VisualElements> <Extensions> <Extension Category="windows.cameraSettings" Executable="lifecamsettings.exe" EntryPoint="LifeCamSettings.App" /> </Extensions> </Application> </Applications> ... </Package>

19. Recap - Building a Metro style camera experience Camera Options Experience driver MFT app + Camera Driver MFT Start Experience Metro style app Device Metadata

20. Building the camera driver MFT

21. Camera Driver MFTWhat is it? • Extension of the camera driver • Enables communication between your camera options Experience and your device • Provides rich and unique functionality for your camera • Installed and delivered as part of your driver package • Implemented as a Media Foundation Transform (MFT)

22. What is an MFT? Windows Metro style app Windows Runtime Playback/Preview Streaming Capture … Media Foundation Video Sink Camera Source Video MFT(1) Video MFT(N) Driver MFT

23. How does it all work? Metro style Device App Metro style app Camera Options UI LifeCam Camera Options IHV Driver MFT UVC Class Driver or IHV Driver

24. Camera driver MFT What you need to do • Author your driver MFT as a user mode driver extension • Implement COM class • Expose it as a Windows Runtime class • Register the driver MFT through camera installer • Driver MFT works with any AvStream compliant driver including the UVC class driver

25. Recap - Building a Metro style camera experience Camera Options Experience app driver MFT + Camera Driver MFT Start Experience Metro style app Device Metadata

26. How to tie this all together: metadata

27. Metadata What you need to do • Create device metadata package • Associate your device to your metro style device app • Submit your app to the Store

30. Extra requirements for internal cameras • Set camera location information in ACPI • Set model ID of the internal cameras as registry keys • Create device metadata package • Associate your device to your metro device app • Stage device metadata package (and the app) on the system

31. Takeaways

32. Building a Metro style camera experience Camera Options Experience app driver MFT + Camera Driver MFT Start Experience Metro style app Device Metadata

33. Opportunity • Windows 8 enables you to offer unique features and a differentiated device experience for your cameras. • And Windows 8 makes your differentiated device experience available to all Metro style apps.

34. Related sessions • [HW-745T] Reimagining the experience for connecting with devices • [HW-283T] Introducing Metro style device apps • [HW-275T] Building and delivering a great Metro style app for your device • [PLAT-777T] Capturing personal photos, video, and audio in Metro style apps • [PLAT-905C] Under the hood: installation and updates for Metro style apps

35. Further reading and documentation • Developing Metro style device apps for cameras • The Device Software Lifecycle – Deployment, Acquisition, Uninstall and Update Process • Windows Dev Center home  

36. thank you Feedback and questions http://forums.dev.windows.com Session feedbackhttp://bldw.in/SessionFeedback

37. © 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

38. Camera recommendations for optimizing user experience

39. Camera and System Recommendations • Support >= 720P @ 30 fps ; • Front / Back Cameras • 2 MP for front and 5 MP for back; • Latency requirements: • H.264 hardware encoders and decoders