Very few Latin words crossed over into English during the Roman occupation, which suggests that there was little contact between the Roman rulers and the rest of the people in the country. Most Latin used in English cam later with the Normans after 1066.
