Thanks Mozilla Firefox for making what we knew impossible possible. All you need to do is go to YouTube on Firefox on your Android Phone, play whatever video you want to play and then switch between apps. You’ll continue listening to YouTube even when the screen of the device is off. And so there we have YouTube Music!
Here’s a video demonstration: