Opus Audio Codec on YouTube
This article explains what the Opus audio codec is and how YouTube uses it.
What is the Opus Audio Codec?
Opus is an audio codec designed to efficiently compress digital audio data. It was adopted as a standard by the Internet Engineering Task Force (IETF) in 2012 and is supported by numerous applications and platforms such as WebRTC, Skype, WhatsApp, Discord, Mozilla Firefox and Google Chrome. Capable of covering a wide range of audio frequencies, including speech and music, the Opus codec offers high audio quality at low bit rates. It uses a combination of linear and non-linear predictive filters and variablesampling rateto allow efficient compression. This allows high quality audio data to be transmitted at bit rates as low as 6 to 510 kbps. Another advantage of the Opus codec is its adaptability to different network conditions. It supports variable bitrates and can adapt its encoding speed and quality in real time to the available network bandwidth. This ensures that the audio quality remains stable during transmission and that there are no interruptions or delays.
How does YouTube use the Opus audio codec?
YouTube supports the Opus codec for audio transmission in its videos and live streams. Since 2013, YouTube has been using the Opus codec as the default codec for its web media players and has also adopted it for its mobile apps and streaming devices like Chromecast and Google Home. The Opus codec is used by YouTube in a number of ways. For example, YouTube uses the Opus codec to extract audio data from video content and store it in separate audio streams. Also, YouTube uses the Opus codec to transmit live audio. Audio during live streams. YouTube supports the Opus codec in various bit rates including 128 kbps, 160 kbps and 192 kbps. YouTube automatically adjusts the bit rate of the Opus codec based on the available network bandwidth and the user's device capabilities to ensure optimal audio quality and smooth playback. Overall, the Opus codec has helped improve the audio quality of YouTube videos and optimize playback on different devices and network conditions. You want the best possible, distortion-free playback of your song on all platforms?
What bitrates does the Opus audio codec use?
The Opus audio codec can use different bitrates for audio encoding. It was designed to deliver high audio quality at low bitrates, while also supporting higher bitrates when better audio quality is needed. Typical bitrates for the Opus codec range from 6 kbps to 510 kbps. The codec can also support bitrates of up to 768 kbps if even higher audio quality is required. Opus uses variable bitrate encoding (VBR), allowing the bitrate to adapt in real time to the audio content. This means the codec can use higher bitrates for more complex material and lower bitrates for simpler material to balance audio quality and compression. In practice, this makes Opus suitable for a wide range of audio applications, from low-bitrate speech transmission to higher-bitrate music streaming. The YouTube app itself often usessignificantly lower bit ratesthan the browser version on the smartphone. Can the use of the Opus audio codec cause distortion?
Yes, there may be some distortion when using the Opus codec. Distortions can occur if the codec is used at bit rates that are too low, or if the audio material is too complex for the selected bit rate. In these cases, the codec cannot store enough information about the audio, which can result in degraded audio quality and distortion. Another factor that can cause distortion is the way the codec has been implemented. If the codec has not been correctly implemented or is incompatible with the software or hardware used, distortion can also occur. However, it is important to note that the Opus codec is generally optimized for high audio quality at low bitrates. If the codec is used with a sufficient bitrate and the audio is not too complex, the audio quality should be good and distortion can be avoided. How do I avoid codec distortions?
To avoid distortion, theStreaming Services SpecificationsAs a rule of thumb, master your song so that it sounds good. If integrated loudness is higher than -14 LUFSis, better leave 2 dB true peak headroom, umIntersample peak distortionto avoid. You want to know if your song works on all platforms? We'll tell you in our professional mix analysis.
Opus Codec gets AI update
The new version 1.5 or 1.5.1 of the license-free audio codec Opus has received an AI update. Machine learning (ML) is intended to improve the coding so that the data stream remains compatible with existing decoders. But the decoder also receives artificial intelligence to improve the sound.
AI for better sound quality
A technology called "Neural Vocoder" is designed to compress speech particularly efficiently. Compared to the LPCNet vocoder, the CPU cores of laptops or smartphones are only loaded by about one percent. The developers call the algorithm Framewise AutoRegressive Generative Adversarial Network (FARGAN). They plan to publish a paper on this later.
They optimize signal processing with the Linear Adaptive Coding Enhancer (LACE) and a nonlinear variant (NoLACE). LACE behaves like a classic postfilter, in which a deep neural network (DNN) adjusts the coefficients on the fly with all available data - but the audio signal itself does not pass through the DNN. The result is a small DNN with very low complexity that also works on older phones. The NoLACE variant requires more computing power, but is also significantly more powerful due to the non-linear signal processing. Both significantly improve the voice quality.
The Opus codec noticeably shapes YouTube sound — how you prepare your mastering for it is explained in the article.Mastering Guideinto the streaming context.
Opus codec: Bitstream remains standards compatible
Instead of programming a completely new codec based on ML, Opus remains completely compatible. This ensures that Opus continues to run on older and slower devices while providing an easy upgrade path. While deep learning is often associated with powerful GPU accelerators, the Opus project has optimized everything so that it runs on most processors, including smartphone CPUs.
Most users shouldn't notice the higher load, but those using microprocessors or smartphones that are more than five years old might notice it. The new functions are therefore still deactivated by default and must be activated during compilation and at runtime, for example via command line parameters.
Improve packet loss
Packet loss leads to missing sound fragments. Codecs usually try to prevent this through packet loss concealment (PLC). This is usually a kind of decoder-side interpolation with "plausible audio" inserted at the loss points. Machine learning could be particularly helpful here - the Opus developers are tackling this with a deep neural network (DNN), which increases the codec's binary file by around 1 MByte and leads to one percent more load on a laptop CPU core in the event of severe packet loss.
Tip:Listen to how your master sounds after using the YouTube Opus codec.– free in the browser with codec preview in the loudness meter.
