Skip to content

Open Source Implementation of Neural Voice Cloning with Few Audio Samples (Baidu Research)

Notifications You must be signed in to change notification settings

VisionBrain/Neural_Voice_Cloning

Repository files navigation

Neural_Voice_Cloning

  1. Baidu Research Link
  2. Tested Speaker Audio Link

Abstract :

  • Voice cloning is a highly desired feature for personalized speech interfaces. We introduce a neural voice cloning system that learns to synthesize a person’s voice from only a few audio samples. System that learns to synthesize a person’s voice from only a few audio samples. We study two approaches: speaker adaptation and speaker encoding.
  • Speaker adaptation is based on fine-tuning a multi-speaker generative model. Speaker encoding is based on training a separate model to directly infer a new speaker embedding, which will be applied to a multi-speaker generative model. Speaker adaptation can achieve slightly better naturalness and similarity, cloning time and required memory for the speaker encoding approach are significantly less, making it more favorable for low-resource deployment.

Steps :

Image

Audio :

Tested Speaker Audio Link

  • But don't expect anything right.
  • I won't make an official complaint.
  • They make a selective perception process.

Made By-