Numbers are usually adjectives because they give information about nouns. Therefore, you think correctly.
Remember adverbs can add to the meaning of the whole sentence. You do not necessarily need to search for just a word to refer it to.
- For Teachers