[CAUTION: I am not a teacher:take the advice and or corrections offered in this post at your own risk.
If you doubt the information, please get a qualified opinion from one of the teachers on these forums.]
"Taste" in this sense originally referred to one's preference for works of art, clothing and pretty much anything visible that you could buy or appreciate. Remember, it just meant your preference, what you liked. You can easily tell the difference between the "sense" of taste and this concept of "taste" by watching for the preposition or "in".
He has great taste in clothing.
Later on it came to mean "refined taste" meaning you could appreciate fine things, this lead to claims that people had "good" or "bad" taste, "had taste" or "did not have taste".
However, in your example you say "it took too long for my taste", this means that an action took too long to be completed, but this (in my mind) is not something we normally make taste judgements about. Although someone could conceivably say such a thing.
I think that the suggestions which have been offered sound more natural.
"It took to long for my liking.
"It took to long, in my opinion."
We often talk about someone's taste in art, or taste in decoration, but rarely their taste in well, length of events.