How to Use the Vonage Media Processor Library for Audio and Video Transformations How to Use the Vonage Media Processor Library for Audio and Video Transformations

How to Use the Vonage Media Processor Library for Audio and Video Transformations

Vonage API Support

Objective

The objective is to demonstrate how to use the Vonage Media Processor library to apply transformations to audio and video streams.

Applies To

  • Video API
  • Audio Transformation
  • Video Transformation

The Vonage Media Processor is supported by both the Unified and OpenTok platforms. To determine which environment you are using, please check the following link for guidance:

How to recognize if I’m using Vonage Video API Unified Environment or Vonage Video API OpenTok environment

Procedure

This guide includes using basic, moderate, and advanced methods to apply transformations to audio and video streams. It covers predefined filters, leveraging the Vonage ML transformers library, and implementing custom transformer classes.

Basic

To apply predefined transformations, you can use the following methods:

  • Video Filters: Apply predefined filters such as background blur or background replacement.
  • Audio Filters: Apply predefined filters such as advanced noise suppression.

These methods require only a few configuration settings.

Moderate

To implement transformers using the Vonage ML transformers library:

  • Configure the Transformer: Set up the configuration for the transformer, specifying the type and any required parameters.

  • Create the Media Processor: Instantiate the media processor with the configured transformer.

  • Connect the Media Processor: Connect the media processor to the publisher to apply the transformations.

Refer to the documentation below for details on specific transformers and their configuration.

Advanced

To create a custom transformer class:

  • Implement the Transformer Class: Define your transformer class and implement the transformation logic.

  • Create an Instance of the Transformer and Media Processor: Instantiate your custom transformer and media processor.

  • Set the Transformer to the Media Processor: Add your custom transformer to the media processor.

  • Create a Media Processor Connector and Connect: Instantiate a media processor connector and connect it to the publisher to apply your custom transformations.

This approach allows for highly customized transformations to suit specific needs. The documents below provide more details. 

Additional Information

For more comprehensive guides and documentation, you can refer to the following resources for both the Unified and OpenTok environments:

For opentok Environment 

For Unified Environment