It depends on various factors. The only way to really verify whether you may make a cover of a song would be to look at YouTube's audio Library or to direct the artist or Label directly. In the audio library it shows here:
Please note that covers may also be monetised by a Record Label...