A. They have left.
B. When did they leave?
A. They left a few minutes ago.
The final line would be perfectly acceptable as simply "A few minutes ago". "They left" is understood because it's the answer to the preceding question.
If you have a question about the English language and would like to ask one of our many English teachers and language experts, please click the button below to let us know: