He hasn`t been following music lately.
He hasn`t followed music lately.
He has not been following music lately is correct because of the time indication lately.
another example: the question "How are you doing lately?" It is something totaly different but I just try to indicate that with the time indication "lately" the continious form is the better option.