Objective
The objective is to demonstrate how to use the Vonage Media Processor library to apply transformations to audio and video streams.
Applies To
- Video API
- Audio Transformation
- Video Transformation
The Vonage Media Processor is supported by both the Unified and OpenTok platforms. To determine which environment you are using, please check the following link for guidance:
Procedure
This guide includes using basic, moderate, and advanced methods to apply transformations to audio and video streams. It covers predefined filters, leveraging the Vonage ML transformers library, and implementing custom transformer classes.
Basic
To apply predefined transformations, you can use the following methods:
- Video Filters: Apply predefined filters such as background blur or background replacement.
- Audio Filters: Apply predefined filters such as advanced noise suppression.
These methods require only a few configuration settings.
Moderate
To implement transformers using the Vonage ML transformers library:
-
Configure the Transformer: Set up the configuration for the transformer, specifying the type and any required parameters.
-
Create the Media Processor: Instantiate the media processor with the configured transformer.
-
Connect the Media Processor: Connect the media processor to the publisher to apply the transformations.
Refer to the documentation below for details on specific transformers and their configuration.
Advanced
To create a custom transformer class:
-
Implement the Transformer Class: Define your transformer class and implement the transformation logic.
-
Create an Instance of the Transformer and Media Processor: Instantiate your custom transformer and media processor.
-
Set the Transformer to the Media Processor: Add your custom transformer to the media processor.
-
Create a Media Processor Connector and Connect: Instantiate a media processor connector and connect it to the publisher to apply your custom transformations.
This approach allows for highly customized transformations to suit specific needs. The documents below provide more details.
Additional Information
For more comprehensive guides and documentation, you can refer to the following resources for both the Unified and OpenTok environments:
For opentok Environment
- OpenTok.js Audio and Video Filters
- Vonage Media Processor for JavaScript
- Vonage Media Processor for IOS
- Vonage Media processor for Android
- Vonage Media Processor for Windows
- Vonage Media Processor for MacOS
- Vonage Media Processor for React Native
For Unified Environment
Related to:
Articles in this section
- Android SDK 2.28.2 error when using the application context
- What happens if your session lasts more than 8 hours?
- Updates to using the Vonage Media Library in Native SDKs from version 2.27.x onwards
- React-Native Zoom In/Out Feature
- Why has the size of the iOS/Android SDKs increased so much from version 2.25.2?
- Integrating Picture-in-Picture with Vonage Video Web
- How to Use the Vonage Media Processor Library for Audio and Video Transformations
- Screen Sharing Support on Mobile Devices
- How to change the strength of the Background Blur?
- What are the minimum system requirements to use Video Filters or Transformers?