Advancing Virtual Viewpoint Reality for Sports Analysis and Player Insights
This research project aims to develop a Virtual Viewpoint Reality (VVR) system that enables users to observe sporting events from diverse perspectives, such as behind the goal or as a player. By analyzing video footage, constructing 3D models, and providing high-level commentary and statistics, the project seeks to enhance understanding of plays, human movement, and player modeling. Leveraging cutting-edge techniques from tomography and real-time 3D reconstruction, the initiative will refine algorithms and integrate multiple camera systems to analyze and visualize complex human movements in sports.
Advancing Virtual Viewpoint Reality for Sports Analysis and Player Insights
E N D
Presentation Transcript
Virtual Viewpoint Reality: Overview • Research directed toward a system that will allow a user to observe any viewpoint of a sporting event. • E.g. From behind the goal, as a participating player • Research Questions: • Analysis of video from sporting events • Construction of 3D models • Provide high level commentary/statistics • Analyze plays • Modeling of players & the human form in general • Including human movement • Visualization/Presentation of VVR information
Virtual Viewpoint Reality: Progress • Further definition of goals (with NTT investigators) • Soccer as the demonstration sport • Setup new VVR laboratory • 14 computers with framegrabbers • Real-time parallel software system • Constructed a 3D scanner - to acquire test data • Research • New approach to 3D reconstruction using techniques from Tomography - paper forthcoming • Further refinement of this approach using a probabilistic interpretation • Adaptation of human tracking system for VVR
Virtual Viewpoint Reality: 6 month goals • Setup a system of 12-20 cameras working in real-time to construct coarse 3D models • Using intersection of silhouettes. • Further refine our 3D reconstruction algorithms • Study the integration of real-time silhouette system with 3D tomographic systems • Investigate graphics/rendering of 3D information • Begin to analyze 3D human movements