Is this a sentence?
First the umbrella was used in Egypt.
It is a sentence.
If your meaning is that the umbrella originated in Egypt, it is better as "The umbrella was first used in Egypt".
If you mean that an umbrella [a specific umbrella] was used in Egypt for the first time, then your sentence is fine.