Site logo
AI Tools - Best AI Tools Directory logo
    • Featured
    • Popular Tools
    • Fun Tools
    • Productivity
    • Coding & Development
    • Copywriting
    • Home
    • Explore AI Tools
    • Blog
    Suggest A Tool
    Sign in or Register
    Suggest A Tool
    Free AI music generator tool - Riffusion

    Riffusion AI: Generating Music from Text Prompts

    • Website
    • Details
    • Reviews 0
    • prev
    • next
    • Website
    • Bookmark
    • Share
    • prev
    • next
    Info

    Riffusion is a new tool that generates music from text prompts. Using the latest in AI technology, Riffusion allows users to explore the latent space of sound by experimenting with different styles, instruments, modifiers, genres, and sounds.

    Categories
    • Audio
    • Entertainment
    • Fun Tools
    • Music
    Tags
    • music
    • web application
    More Info

    How Riffusion Works

    The technology behind Riffusion is based on the open-source AI model known as Stable Diffusion. The model has been fine-tuned to generate images of spectrograms, which can then be converted into audio clips. The current version (at time of writing) is the v1.5 stable diffusion model, with no modifications other than being fine-tuned on images of spectrograms paired with text. The audio processing happens downstream of the model.

    Spectrograms

    An audio spectrogram is a visual representation of the frequency content of a sound clip. The x-axis represents time, and the y-axis represents frequency. The color of each pixel gives the amplitude of the audio at the frequency and time given by its row and column.

    The spectrogram can be computed from audio using the Short-time Fourier transform (STFT), which approximates the audio as a combination of sine waves of varying amplitudes and phases. The STFT is invertible, meaning the original audio can be reconstructed from a spectrogram.

    Image-to-Image

    With Riffusion, it is possible to condition the generated audio not only on a text prompt but also on other images. This allows users to modify sounds while preserving the structure of an original clip they like. The denoising strength parameter can be used to control how much the generated audio deviates from the original clip.

    Looping and Interpolation

    Riffusion also allows users to generate infinite AI-generated jams by looping and interpolating between prompts and seeds in the latent space of the model. This preserves the key properties of the clips, and the interpolation allows for a smooth transition between clips.

    Overall, Riffusion is an exciting new tool that allows users to experiment and explore the latent space of sound, with endless possibilities for creating unique and original music.

    Useful Links

    Web app: https://github.com/riffusion/riffusion-app

    Inference server: https://github.com/riffusion/riffusion

    Model checkpoint: https://huggingface.co/riffusion/riffusion-model-v1

  • No comments yet.
  • Add a review

    Leave a Reply · Cancel reply

    Your email address will not be published. Required fields are marked *

    Overall Rating

    Pricing

    Service

    You May Also Be Interested In

    UberDuck: AI Rap & Music Production

    UberDuck is on an entirely different level when it comes to AI voices. With the tool you'll be able to create…
    • text-to-speech, web application, YouTube
    Freemium

    DesignsAI: All-in-One Creative AI Platform

    Designs.ai is a comprehensive creative platform that uses artificial intelligence (AI) technology to help…
    • logo design, web application, multi purpose, YouTube
    Freemium

    Adobe Premier Pro: AI Video Editing Features

    Adobe Premiere Pro is a popular video editing software that recently started incorporates the latest in AI…
    • YouTube
    Freemium

    © Made by an A.I. (just kidding..., or am I?)

    Cart

      • Featured
      • Popular Tools
      • Fun Tools
      • Productivity
      • Coding & Development
      • Copywriting
      • Facebook
      • X
      • WhatsApp
      • Telegram
      • LinkedIn
      • Tumblr
      • Reddit
      • VKontakte
      • Mail
      • Copy link
      • Share via...
      • Threads
      • Bluesky