OpenAI is engaged on a brand new device that might generate music primarily based on textual content and audio prompts, in keeping with a report in The Data.
Such a device may very well be used so as to add music to current movies, or so as to add guitar accompaniment to an current vocal observe, sources mentioned. It’s not clear when OpenAI plans to launch such a device or whether or not it could be accessible as a standalone product (versus integrating with OpenAI’s ChatGPT and video app Sora).
One supply instructed The Data that OpenAI is working with some college students from the Juilliard College to annotate scores as a manner to supply coaching information.
Whereas OpenAI has launched generative music fashions previously, they predate the launch of ChatGPT; extra not too long ago, the corporate has been growing audio fashions centered on text-to-speech and speech-to-text. Different firms with generative music fashions embrace Google and Suno.
TechCrunch has reached out to OpenAI for remark.