Mẹo What is Spatial Audio with dynamic head tracking on AirPods?
Thủ Thuật Hướng dẫn What is Spatial Audio with dynamic head tracking on AirPods? Mới Nhất
Lê Minh Sơn đang tìm kiếm từ khóa What is Spatial Audio with dynamic head tracking on AirPods? được Update vào lúc : 2022-12-21 03:32:04 . Với phương châm chia sẻ Kinh Nghiệm về trong nội dung bài viết một cách Chi Tiết Mới Nhất. Nếu sau khi Read Post vẫn ko hiểu thì hoàn toàn có thể lại phản hồi ở cuối bài để Admin lý giải và hướng dẫn lại nha.Since the establishment of VR glasses as serious playback devices in the entertainment industry, head tracking technology has found a wide range of applications.
Nội dung chính Show- Headphones
with tracking like a VR headsetHead tracking: the dynamic head movementTechnology is fun … when it worksSpatial Audio for Apple from the AppstoreHardware and software requirementsUser Experience Apple 3D AudioOverview of
compatible apps for AirPods Pro and AirPods Max360 Audio for Samsung from Google PlaystoreYoutube, Meta, LinkedIn, etc.?Apps with 3D audio but without head trackingSynctuitionAudible RealityArtist ConnectionMusic streaming servicesRecap and action!What is spatial head tracking AirPods?What's the point of head tracked spatial audio?How does AirPods dynamic head tracking work?Is spatial audio AirPods worth it?
That the potential of 360° sound is far from exhausted can be seen in the latest developments in the field of spatial audio. With the introduction of head tracking enabled headphones and pods, the two big players Apple and Samsung are taking a giant step towards establishing 3D audio in the consumer market – out of its niche existence.
The following article will give an overview of the currently most important apps for the playback of spatial audio via handheld devices such as smartphones and tablets.
Update
- 21/04: M1 MNTR CTRL (Mach2 Spatial) has been added to the list of apps for Apple Airpods Pro and Bose AR.21/06: Sony WF-1000XM4 true wireless headphones for 360 audio reality added.21/08: Netflix now supports Spatial Audio with Airpods Pro
Headphones with tracking like a VR headset
First of all, I think it’s important to lay out the basic way these applications work. Not just from a technological perspective, but from a conceptual one. This is to prevent the ‘wrong’ use of this technology and accompanying disappointments.
Also, the terminology surrounding immersive audio technology is currently being thrown around wildly. Apple talks about 3D spatial audio with dynamic head tracking. Samsung talks about a 360 audio function with an intelligent motion-tracking sensor. Bose AR even talked about Augmented Audio Reality (ARR) back then.
But everyone is ultimately talking about immersive, cinema-like surround sound that detects the direction of the headphones’ gaze. A spoiler directly related to the topic of movies: the manufacturers currently activate the function almost exclusively in combination with moving images. However, there are great applications that also work without pictures, for example 3D podcasts and audio plays. Or immersive 3d music with Dolby Atmos that I will talk about later.
Head tracking: the dynamic head movement
For head tracking to work in terms of freedom of movement in a virtual sound scene, a reference point is needed. Additionally to the audio device, this framework is provided by the smartphone or tablet. The headphones, therefore, know from the position of the playback device from which direction the sounds should come.
But be careful, this does not mean that the sound only comes from the direction of the cell phone; as just mentioned, this only serves to calibrate the sound scene. This way you can make sure that, for example, sounds that should come from the left really do come from the left.
Technology is fun … when it works
The crucial aspect for using said headphones is the software, i.e. the smartphone apps and the right operating system. Even if standard headphones are sufficient for a static, spatial 3D audio impression. For head tracking, it must be ensured that the corresponding apps also support spatial audio.
In the use case, these are mostly various streaming platforms. During my research, I had the feeling in some user reports that it is not always clear that there has to be compatibility here. To avoid such discrepancies for the loyal reader of this blog, the following should provide clarity about the hardware and software components. So that nothing stands in the way of a 3D audio experience.
Learn directly about new updates and apps
Spatial Audio for Apple from the Appstore
Apple pioneered spatial audio with head tracking for handheld devices with the introduction of the AirPods Pro and AirPods Max. With Apple, surround sound formats like 5.1 and 7.1, as well as Dolby Atmos, are supported. However, this does not mean that every streaming provider that offers surround sound or Atmos is also compatible with Apple. The following video gives a short overview of the AirPods Pro. It gets interesting starting 0:57.
Hardware and software requirements
Apart from the streaming services, the hardware and operating system must also be right. In terms of hardware, you need an iPhone 7 or newer, or an iPad. Also, the operating system iOS 14 or iPadOS 14 is required, but how the technical requirements look in detail you can read here.
User Experience Apple 3D Audio
It’s always a bit difficult to describe how the sound sounds. Regardless, here a short conclusion from my perspective as a spatial audio engineer:
- The dynamic head detection works well and has an
imperceptible latency. This is despite Bluetooth a positive surprise.The usability is very good. You know immediately from the icons whether the function is activated. There even is a small demo to get hooked. If an app supports head tracking, this is also visually reinforced. Samsung has to improve this, but more later. If 3D audio is enabled, the loudness is increased a bit. In addition, the sound is given an artificial room with even more reverb. This might be critical for
the sound engineer, but good for the consumer.Although the AirPods Pro sit in the listening channel, the impression of envelopment seems successful. You have the feeling that the sound comes from outside the earphones. The so-called externalization is thus good.
Overview of compatible apps for AirPods Pro and AirPods Max
AppDescriptionAir Video HD The app that lets you stream your own videos from your Mac or MacBook to your phone or tablet supports Spatial Audio. Apple TV App The in-house streaming service offers a wide range of movies and series in Spatial Audio formats. Discovery+ The streaming service for friends of non-fictional entertainment also offers Spatial Audio content in combination with AirPods. Disney+ Disney Plus also offers spatial audio experiences in combination with AirPods, for example with the blockbuster Avengers: Endgame or the hit series The Mandalorian. File Explorer This data management app works like a cloud and thus allows data playback on different devices. For audiovisual content, Spatial Audio formats are supported, and was able to successfully create a 5.1 surround demo as a video Foxtel Go The Australian Internet TV service, which offers some live channels as well as some video-on-demand content, also works with Apple’s Spatial Audio feature. HBO Max The video-on-demand service provider HBO Max also uses Spatial Audio support. Hulu The now very popular streaming provider Hulu offers content in the Dolby Digital Plus 5.1 surround sound format supported by Apple. Plex Plex is a client-server truyền thông playback system that can access different content like video, audio, and photos. For the Spatial Audio feature to work here, "Old Video Player" must be enabled in the preferences. Peacock The streaming service Peacock also uses spatial audio content. Paramount+ The recently renamed streaming service from CBS All Access to Paramount Plus also supports Apple’s Spatial Audio feature. Vudu The video-on-demand service provider offers content in Apple-supported spatial audio formats Dolby Digital Plus 5.1 Surround Sound and Dolby Atmos. Spatial Scenes The Spatial Scenes app offers a variety of spatial soundscapes. Designed for the iPad, the app also supports spatial audio playback via AirPods. Tidal The premium music streaming service Tidal offers high-resolution music in stereo as well as some tracks mixed in 3D audio (see Music Streaming Blog). Corresponding songs are also supported by Apple. Netflix Actually, Netflix doesn’t belong on this list (yet?). Earlier this year, the rumor emerged that Netflix and Apple were working on 3D audio support for the AirPods. However, this has since been revised again. Update 21/08: Now the time has come, 3D Audio is slowly being rolled out by Apple. Dolby Atmos already provided the basis as I saw coming, yeah! M1 MNTR CTRL Mach2 Spatial enables head-tracking for Apple wearables and Bose AR
360 Audio for Samsung from Google Playstore
Shortly after Apple’s AirPods, Samsung sent the Galaxy Buds Pro into the race. They are using Dolby Head Tracking technology (TM). What is Spatial Audio for Apple is 360 Audio for Samsung – two terms for the same concept.
However, the devil is in the details. Currently, the Spatial Audio works automatically with every video. This means that even if the video only contains mono or stereo sound, the sound is artificially virtualized. Thus, you can hear the sound clearly directed from the cell phone. But it’s not an immersive, enveloping sound like the Apple Airpods manage. So it doesn’t benefit from multi-channel surround – or 3D sound. Which is a pitty that I feel like will be fixed in the future.
Of course, to take advantage of this technology in the first place, the hardware and software have to be right. 360 Audio works on Samsung Galaxy phones and tablets with the latest One UI 3.1 operating system. How to listen to the 360 Audio function can be found here.
The feature was initially announced exclusively for new models like the Galaxy S21. However, shortly after, the new operating system was also rolled out for my S10 and I can now also listen to truyền thông in 360 audio.
Youtube, Meta, LinkedIn, etc.?
As mentioned, the Galaxy Buds do not enable 3D audio in the sense of 360° sound. The general advantage of this approach is that sound virtualization works with all sound sources. Thus, the function is activated as soon as audio or video content is consumed on Meta, LinkedIn, YouTube, or wherever.
For example, I was on my phone listening to a podcast and scrolling through social truyền thông. As soon as a video popped up in my news feed, the 360 audio automatically activated. Then I heard the podcast suddenly switching from stereo to spatial audio. As well as the video that was then spatialized playing simultaneously. This is a good way to hear what the function does with truyền thông in the first place.
However, there is a good chance that this will be improved. Basically, the Galaxy Buds Pro have the same hardware like the Apple Airpods. The platforms also usually use Dolby Atmos or comparable multi-channel audio formats in the backend. So, we can be curious.
Apps with 3D audio but without head tracking
Although the focus of this article is on head tracking, a few more apps should be mentioned here that do not support head tracking, but can still provide immersive listening experiences.
This is the soft entry into immersive 3D audio, for all standard stereo headphones. The sound here is binaural, accessible for everybody.
Headspace
This app offers guided meditations and mindfulness exercises. Also, there are sound worlds with 3D recordings of the "most beautiful places in the world". e.g. stream, rain, mountain stream, forests, oceans, and so on.
Unfortunately, the recordings are huge files with 45-500 minutes. So most of the time 800MB have to be downloaded first, which definitely gets in the way of relaxation.
Synctuition
Similar to Headspace, Synctuition is an app for relaxation and meditation. But here they didn’t just use dummy head recordings for the binaural sound. Music was also added and mixed into the space using spatialization tools.
So an entire sound experience was created and combined with binaural beats, which I will take a closer look some point. These audio experiences take 25 minutes and also a significant loading time. This could also be done better. But we are getting there.
Audible Reality
Audible Reality offers the possibility to play stereo music, for example via Spotify, in a different spatial context. The music is played in a virtual space, which is called "vibes" in the app. The whole thing is reminiscent of the YouTube hype around 8D Audio. Similar sound colorations can be found here, such as bass-boosted music.
I think the sound personalization aspect is great, but unfortunately, the stereo suffers a lot here. Phasing artifacts can be heard. Sonarworks’ approach with Sound-ID is better thought out here.
Waves NX
Even though we’ve just ticked off the topic of head tracking, there’s a little oddball. The audio software manufacturer has its own app that can be combined with any headphones. So you can not only connect the hardware head tracker with the computer. Via Bluetooth, this is ready for use with the smartphone.
Finally, you can listen to music or your own audio in the app. Matching the Nx Virtual Mixing Room, the stereo sound now sounds as if you were sitting in Abbey Road Studio 3. However, multi-channel 5.1 surround sound has not been implemented here, as it is in the DAW plugin.
There are even dedicated headphones that have the head tracker built into the device. The Audeze Mobius 3D Headphones. So in principle, exactly what Apple did with the Airpods Max – only years later 😉
Artist Connection
Here, too, a small special role for Sony 360 Reality Audio. Again, the idea is to immerse and directly dive into the sound. More precisely into music, because here artists are also in the foreground. This is produced with Sony 360RA ‘s own tools, the Creative Suite, as it is also used on TIDAL. There are also dedicated headphones here to further enhance the sound experience: The Sony 1000XM2, wireless headphones with noise canceling. Or the Sony WF-1000XM4 in-ears true wireless headphones.
Music streaming services
Meanwhile, some music streaming platforms offer music in Dolby Atmos or 360 Reality Audio. Here, we would like to refer to this blog entry.
Recap and action!
As you can see, there are now really many ways to enjoy spatial audio content. Fortunately, most of the already very popular streaming services recognize the potential of immersive listening experiences. Hopefully, head tracking compatible headphones will find favor. Because in combination with the streaming hype, this could be the biggest chance yet for 3D audio to finally find its rightful recognition in the market!
But the right technology also needs the right content. No matter whether Apple Airpods-Pro or Samsung Galaxy Buds-Pro. Up to now, existing material has often been "converted" into corresponding spatial audio formats, or upmixed.
But the true potential of spatial audio lies in creating content specifically to get the best out of the technology with creativity. And that’s exactly my job here VRTonung, if you want to learn more about it or even already have ideas in mind, don’t hesitate to get in touch!
Get in touch more 3D audio for everyone
What is spatial head tracking AirPods?
When you watch a supported show or movie, make a FaceTime call, or listen to supported music on your device, AirPods (3rd generation), AirPods Pro (all generations), and AirPods Max use Spatial Audio and head tracking to create an immersive theater-like environment with sound that surrounds you.What's the point of head tracked spatial audio?
The head tracking aspect of spatial audio uses motion sensors built into earphones or headphones to actively pan the mix based on how you move your head, to give the impression that all of the audio sources are anchored specific points around you. It's perhaps a bit gimmicky, but it works.How does AirPods dynamic head tracking work?
Apple introduced Dynamic Head Tracking alongside Spatial Audio on the iPhone to create a more immersive audio experience. Essentially, it uses sensors in your AirPods to track your head movement, then adjusts the audio so it always sounds like it's coming from the direction of your iPhone.Is spatial audio AirPods worth it?
There appears to be a slight drop off in terms of directness and punch, but it's not huge and, broadly speaking, spatial audio so far appears to be a very worthwhile upgrade. To quote our AirPods Max review, "All told, the effect is superb. Tải thêm tài liệu liên quan đến nội dung bài viết What is Spatial Audio with dynamic head tracking on AirPods? Spatial Audio Personalized Spatial Audio Find AirPod
Post a Comment