Lost in Resolution – 16K Video and 3D Audio Playback for Large-Screen Immersive Spaces

In this session we will present the work performed in the European project Immersify which is dedicated to researching and developing tools, content, and spaces for immersive media. We will start with a presentation summarizing the work on video codecs, media players, and game engines plugins for highly immersive and interactive media. The next-generation of immersive media applications demand ultra high quality video beyond 8K resolution, combined with interactive capabilities, and 3D and immersive audio, which have been the focus of the Immersify project during its almost 3 years of research and development.

After this introduction we will showcase three new content pieces that highlight the capabilities of the new immersive and interactive formats. They feature video in 16K resolution in 360° format, with a view port (visible part of the 360° video) in 8K resolution at the Ars Electronica’s Deep Space 8K immersive environment. All content has been produced in the context of Immersify by using different techniques including high-resolution 360° video made of custom-made 360° camera systems, and point clouds video rendering coming from laser scannings.

The video will be accompanied by 3D and immersive audio based on the high-order-ambisonics format. Spectators at the Deep Space will be able to interact with the content rotating and zooming the audio and video for a complete immersive and interactive experience.

Presenter: Mauricio Alvarez-Mesa (CO/DE), Spin Digital Video Technologies GmbH

Credits

Presentation

Mauricio Alvarez-Mesa is the CEO and co-founder of Spin Digital, a German company specialized in video compression for ultra-high-quality media. He has been part of several international research projects combining the media industry and the ICT sector. He holds a PhD degree in Computing Engineering from UPC (Barcelona) and an Electronic Engineering degree from U. of Antioquia (Medellin). Mauricio was the technical director of the Immersify project.

Video and audio encoding and preparation

Sergio Sanz (Spin Digital)

Software

Spin Digital immersive media player (Spin Digital team)

Video Content

General coordination: Maciej Głowiak (PSNC)

Fallout Shelter
Jacek Walczak – Scanning, Edit
Maciej Jaśkiewicz – Scanning
Jan Skorupa – Ambisonic sound, effects
Wojciech Raszewski – sound
Błażej Oczkowski – voice-over
Maciej Głowiak – coordination

Krambabula
Maciej Jaśkiewicz – Cameraman, Coordinator, Edit
Eryk Skotarczak – Camera assistant, Recording
Leszek Nowak – Camera assistant, Edit
Paweł Rybarczyk – Assistant
Jacek Walczak – Assistant
Wojciech Raszewski – Sound
Jan Skorupa – Sound
Joanna Koza – Coordinator

The Noise and the structure
Eryk Skotarczak – Cameraman
Leszek Nowak – Cameraman, Edit
Maciej Jaśkiewicz – Cameraman, Edit
Wojciech Raszewski – Sound
Jan Skorupa – Sound
Magdalena Madaj – Photo documentation
Maciej Stróżyk – assistance
Bartłomiej Idzikowski – assistance
Maciej Głowiak – assistance