The adverb slowly modifies the verb to take [= to do].
What would the adjective slow be modifiying or in reference to?
Take it easy is a very idiomatic phrase. It is very colloquial and I am not sure how you would explain it clearly in grammatical terms. Take it easily seems to stray even further from what the phrase is taken to mean (i.e. relax).
Student or Learner