View Cart

Topics

Production Advancements: Avatars and Immersive Content

  • Hidden Depths: Disguise’s Integration of Depth and Volumetric Capture Workflows for Virtual Production - $15

    Date: March 21, 2025
    Topics: ,

    The ability to capture a volumetric representation of performers in a production environment would enable a multitude of novel on-set and post-production workflows. Current methods are impractical due to their reliance on large numbers of cameras and consistent lighting conditions. We propose a framework for creating 2.5D assets from a single monocular video, allowing digitised performers to be viewed from a range of angles with the appearance of depth. An application processes the video offline, using depth and segmentation AI models to create a packaged 2.5D asset. This is then loaded into Disguise Designer for pre-visualisation of the performers within the virtual stage. Analysis of state-of-the-art depth inference models, using videos captured to represent the challenges of production environments, shows that it is possible to obtain coherent video depth maps in these conditions. However, metric models do not always identify absolute depth values accurately, and it is necessary to use models specifically tailored for video to ensure temporal consistency in the result. This work is intended to act as a foundation for more comprehensive 3D volumetric capture of performers in real production environments.

    Chris Nash, Nathan Butt, Andrea Loriedo, Robin Spooner, Taegyun Ha, Phillip Coulam-Jones, James Bentley | Disguise | London, United Kingdom
    Aljosa Smolic | Lucerne University of Applied Arts and Sciences | Lucerne, Switzerland

    Add to cart Details


  • Transforming Team Collaboration with Avatars: Enhancing Productivity in Content Creation in Broadcasting - $15

    Date: March 21, 2025
    Topics: ,

    In the fast-paced world of broadcast and media, teams must collaborate efficiently and create content quickly to remain competitive. Avatar technology offers an innovative solution, enabling team members to stay connected even when they are unable to be physically present. By stepping in to summarize past meetings and capture key insights, avatars bridge communication gaps and ensure continuity, allowing teams to resume their work without the need for lengthy catchups. This approach enhances decision-making and streamlines workflows, keeping teams aligned and productive. In addition to avatars, the integration of intuitive tools for video editing, content creation, and subtitling empowers teams to produce high-quality content without specialized skills. These tools support multiple languages, enabling broadcasters to reach a diverse, global audience. With simplified video clipping, merging, and subtitling processes, teams can adapt and release content more quickly, making their workflows more efficient and responsive to industry demands. This combination of avatar-driven collaboration and user-friendly content tools optimizes production time, enhances engagement, and ensures a smooth workflow, even when team schedules do not align. It allows broadcasters to work smarter, integrating technology into the creative process. This approach empowers teams to create exceptional content, collaborate seamlessly, and meet the growing demands of today’s dynamic media landscape.

    Ira Sharma, Kaushal Dadi, Anesh Madapoosi, Shyam Kapur | TipTop Technologies | Sunnyvale, Calif., United States

    Add to cart Details


  • TSENet Video Super Resolution for Broadcast Television  - $15

    Date: March 21, 2025
    Topics: ,

    The emergence of Video Super Resolution (VSR) has advanced the media industry. It holds great potential for enhancing broadcast and streaming, improving visual quality, and boosting user engagement. While there are benefits, applying VSR technology to broadcast presents challenges, as it requires a high-quality solution that maintains consistent quality across diverse broadcast standards, handles live content with minimal latency, and ensures compatibility with existing broadcast infrastructure. This demands sophisticated AI models, often needing high-performance GPUs, which can increase costs. In this paper, we introduce a method to upscale low-resolution, compressed video frames based on an enhanced version of Equivalent Transformation and Dual Stream Network (ETDS)[1], called a Temporally Stabilized ETDS Network (TSENet) that performs equivalent or better compared to more compute extensive solutions. This paper examines various VSR models, emphasizing the key performance indicators identified by the AIM2024 Challenge for Efficient VSR[2]. The focus is on deploying these models in workflows, considering visual quality through both subjective and objective analyses, compression artifact reduction, and real-time processing capabilities.

    Surbhi Madan | Intel Corp | San Diego, Calif., United States
    Onur Barut | Intel Corp | Berlin, Mass., United States
    Anand V Bodas | Intel Corp | Bangalore, India
    Christopher A. Bird | Intel Corp | Chandler, Az., United States
    Jerry Dong, Lin Xie | Intel Corp | Beijing, China

    Add to cart Details