Alibaba tests AI-enhanced replays for Paris 2024 Olympics

Alibaba Cloud, a key digital technology and intelligence arm of Alibaba Group, in collaboration with Olympic Broadcasting Services (OBS), has begun testing its latest AI-enhanced multi-camera replay service at the Olympic Qualifier Series in Shanghai. This development is part of the preparations for the upcoming 2024 Olympic Games in Paris.

The innovative AI service is designed to revolutionise sports broadcasting by providing a dynamic and vivid viewing experience. Utilising advanced machine learning and deep neural networks, along with Alibaba Cloud's robust computing architecture, the multi-camera replay system captures footage from various strategically positioned cameras around the venue. This footage is then processed in near real-time, leading to high-precision 3D reconstruction and video rendering. This process creates virtual frames from new perspectives, making actions such as rotation smoother and more realistic, which contributes to a more immersive viewing experience.

Selina Yuan, President of International Business at Alibaba Cloud Intelligence, expressed enthusiasm over the collaboration with OBS. "We are thrilled to collaborate with OBS to expand the use of our cutting-edge cloud-based AI technology, aiming to elevate sports broadcasting to new levels of immersion and engagement," she said. Yuan added that Alibaba Cloud, as a pioneer in delivering intelligent sports solutions, aims to redefine how global sports enthusiasts experience and engage with the Olympic Games. She also highlighted the company's commitment to contributing to the Paris 2024 experience with their advanced cloud technologies.

The system's capabilities were first showcased at the Olympic Winter Games Beijing 2022 for curling and speed skating events, where it provided viewers with immersive experiences from various optimal angles. For Paris 2024, the AI-enhanced replay system is scheduled to be deployed at 12 competition venues, covering sports such as beach volleyball, tennis, judo, and rugby. This multi-angle replay content will be integrated into OBS's production system, thereby enriching the coverage of the Olympic Games with dynamic and lifelike replay footage for global Media Rights Holders (MRH).

The sophisticated 3D reconstruction facilitated by Alibaba Cloud's robust infrastructure is achieved through specialised video processing within both edge and cloud environments. Cameras positioned strategically around the competition venues capture high-quality footage, which is transformed into cloud-based 3D models. These models enhance the realism of the virtual frames, ensuring smoother and more lifelike motions, thus significantly boosting viewer engagement.