Open the Apple Music app
Go to your Library
Find the song you want to remove
Tap and hold the song
Tap Remove
Tap Remove Download
On iPhone or iPad, you can also tap the three dots next to the song and choose Remove Download
On Mac, right-click the song and choose Remove Download
On Windows, right-click the song and choose Remove Download
To remove all downloaded music, go to Settings
Tap Music
Tap Downloaded Music
Swipe left on songs or albums and tap Delete
On Mac, select the downloaded item and press Delete
On Windows, select the downloaded item and choose Delete from Library or Remove Download