suno/bark
๐
kevinwang676/Bark-with-Voice-Cloning
๐ถ
PeepDaSlan9/Bark-Voice-Cloning
๐
rahgadda/bark-voice-generator
๐
dmeck/RVC-Speakers
๐
michellelychan/bark_voice_clone
๐
RafaelJaime/SherezIAde
๐
NoahIsDaBomb/Bark-with-Voice-Cloning
๐
amendolajine/OPIT
๐
eaysu/text_to_turkish_speech
โก
ajit282/AISongsStreamlit
๐ข
Deepakraj2006/News_Scraper_TTS
Bark is a transformer-based text-to-audio model created by Suno. Bark can generate highly realistic, multilingual speech as well as other audio - including music, background noise and simple sound effects. The model can also produce nonverbal communications like laughing, sighing and crying. To support the research community, we are providing access to pretrained model checkpoints ready for inference.
The original github repo and model card can be found here.
This model is meant for research purposes only. The model output is not censored and the authors do not endorse the opinions in the generated content. Use at your own risk.
Two checkpoints are released:
ExampleTry out Bark yourself!
You can run Bark locally with the ๐ค Transformers library from version 4.31.0 onwards.
pip install --upgrade pip
pip install --upgrade transformers scipy
Text-to-Speech
(TTS) pipeline. You can infer the bark model via the TTS pipeline in just a few lines of code!from transformers import pipeline
import scipy
synthesiser = pipeline("text-to-speech", "suno/bark")
speech = synthesiser("Hello, my dog is cooler than you!", forward_params={"do_sample": True})
scipy.io.wavfile.write("bark_out.wav", rate=speech["sampling_rate"], data=speech["audio"])
from transformers import AutoProcessor, AutoModel
processor = AutoProcessor.from_pretrained("suno/bark")
model = AutoModel.from_pretrained("suno/bark")
inputs = processor(
text=["Hello, my name is Suno. And, uh โ and I like pizza. [laughs] But I also have other interests such as playing tic tac toe."],
return_tensors="pt",
)
speech_values = model.generate(**inputs, do_sample=True)
from IPython.display import Audio
sampling_rate = model.generation_config.sample_rate
Audio(speech_values.cpu().numpy().squeeze(), rate=sampling_rate)
Or save them as a .wav
file using a third-party library, e.g. scipy
:
import scipy
sampling_rate = model.config.sample_rate
scipy.io.wavfile.write("bark_out.wav", rate=sampling_rate, data=speech_values.cpu().numpy().squeeze())
For more details on using the Bark model for inference using the ๐ค Transformers library, refer to the Bark docs.
Suno UsageYou can also run Bark locally through the original Bark library:
First install the bark
library
Run the following Python code:
from bark import SAMPLE_RATE, generate_audio, preload_models
from IPython.display import Audio
preload_models()
text_prompt = """
Hello, my name is Suno. And, uh โ and I like pizza. [laughs]
But I also have other interests such as playing tic tac toe.
"""
speech_array = generate_audio(text_prompt)
Audio(speech_array, rate=SAMPLE_RATE)
To save audio_array
as a WAV file:
from scipy.io.wavfile import write as write_wav
write_wav("/path/to/audio.wav", SAMPLE_RATE, audio_array)
Model Details
The following is additional information about the models released here.
Bark is a series of three transformer models that turn text into audio.
Text to semantic tokensApril 2023
Broader ImplicationsWe anticipate that this model's text to audio capabilities can be used to improve accessbility tools in a variety of languages.
While we hope that this release will enable users to express their creativity and build applications that are a force for good, we acknowledge that any text to audio model has the potential for dual use. While it is not straightforward to voice clone known people with Bark, it can still be used for nefarious purposes. To further reduce the chances of unintended use of Bark, we also release a simple classifier to detect Bark-generated audio with high accuracy (see notebooks section of the main repository).
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4