Reading Assignment 12: Differentiable Digital Signal Processing (DDSP)

• Read the original paper, listen to audio examples and have a look at the code provided on the official website DDSP: Differentiable digital signal processing

Optional Reading

There are several interesting follow-up works that are worth checking out:

• Differentiable Wavetable Synthesis
• MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling
• Real-time Timbre Transfer and Sound Synthesis using DDSP
• Latent Space Explorations of Singing Voice Synthesis using DDSP

Furthermore, this paper contains an interesting discussion on shortcomings of the loss commonly used for DDSP:

• I’m Sorry for Your Loss: Spectrally-Based Audio Distances Are Bad at Pitch

Feel free to share additional papers or other resources you come across!