Framework for web delivery of immersive audio experiences using device orchestration

White Paper WHP 346

Download
Published: 29 August 2019

Abstract

This demonstration introduces the use of orchestrated media devices and object-based broadcasting to create immersive spatial audio experiences. Mobile phones, tablets, and laptops are synchronised to a common media timeline and contribute one or more individually delivered audio objects to the overall mix. A rule set for assigning objects to devices was developed through a trial production—a 13-minute audio drama called The Vostok-K Incident.

The same timing model as in HbbTV2.0 media synchronisation is used, and future work could augment linear television broadcasts or create novel interactive audio-visual experiences for multiple users. The demonstration will allow delegates to connect their mobile phones to the system. A unique mix is created based on the number and selected locations of connected devices.

This document was originally published in the Adjunct Proceedings of TVX 2019, Salford, UK.

As of publication of this white paper, The Vostok-K Incident is available to hear online.

Tweet This - Share on Facebook

BBC R&D - How we made the Audio Orchestrator - and how you can use it too

BBC MakerBox - Audio Orchestrator

BBC R&D - Vostok K Incident - Immersive Spatial Sound Using Personal Audio Devices

BBC R&D - Vostok-K Incident: Immersive Audio Drama on Personal Devices

Financial Times - BBC pioneers immersive sound using phone speakers

The Telegraph - BBC develops system to turn household objects into surround sound

What Hi-Fi - BBC 3D audio technology aims to revolutionise home entertainment

Aberdeen Evening Express - Nowhere safe from Daleks thanks to new surround sound technology

BBC R&D - Evaluation of an immersive audio experience

BBC R&D - Exploring audio device orchestration in workshops with young people

BBC R&D - Exploring audio device orchestration with audio professionals

BBC R&D - Producing audio drama content for an array of orchestrated personal devices

S3A Project - The Vostok-K Incident

BBC R&D - Better Radio Experiences

BBC R&D - Designing Navigation for Smart Speakers and Voice Devices

BBC R&D - The Unfortunates: Interacting with an Audio Story for Smart Speakers

BBC R&D - Emotional Machines: How Do People Feel About Using Smart Speakers and Voice-Controlled Devices?

White Paper copyright

© BBC. All rights reserved. Except as provided below, no part of a White Paper may be reproduced in any material form (including photocopying or storing it in any medium by electronic means) without the prior written permission of BBC Research except in accordance with the provisions of the (UK) Copyright, Designs and Patents Act 1988.

The BBC grants permission to individuals and organisations to make copies of any White Paper as a complete document (including the copyright notice) for their own internal use. No copies may be published, distributed or made available to third parties whether by paper, electronic or other means without the BBC's prior written permission.

Authors

  • Jon Francombe (BMus Ph.D.)

    Jon Francombe (BMus Ph.D.)

    Lead Research & Development Engineer
  • Kristian Hentschel

    Trainee Research Technologist

Rebuild Page

The page will automatically reload. You may need to reload again if the build takes longer than expected.

Useful links

Theme toggler

Select a theme and theme mode and click "Load theme" to load in your theme combination.

Theme:
Theme Mode: