"We are going to get what we need and leave. We are not going to hang up there much more than needed"
You know with the modification in red, your sentence is right. But if you want to paraphrase it, you could say:
"We are going to buy what we need and after that we will leave. We are not going to wait and waste the time."