CAUTION: NOT A TEACHER
(1) Here is another example that may help you:
(a) Tom: Do you have panda bears in your country?
Mona: No, we don't. We have go all [of] the way to China if we want to see
those cute little animals.
(2) That is, there is a way (distance) between Mona's country and China. If she
wants to see panda bears, she cannot stop somewhere between her country and
China. She must go the whole way (the complete distance) between her country
and China if she wants to see some of those adorable bears.
(3) Here's another example. In the United States, many bookstores are closing.
Many people no longer buy books that are printed on paper. So if you want to buy a
book in many areas of the United States, you must go all the way downtown to find
a bookstore. There may be no bookstores between your home and the downtown
area. So you must go the complete distance between your home and downtown if you
want to find a bookstore.
(4) Now back to your original question:
Tom: Is the new restaurant near our home?
Mona: No, it [the restaurant] isn't.
Tom: Well. where is it?
Mona: You have to go all the way downtown to find it.