First, it is a common mistake to use although and but in the same sentence
Although John is very old, he is still active.
He won the match although he didn't practiced well.
In this sentence, you can't use although because it may sound a bit odd.Although the factory has accepted the charge finally, but we also appreciate for your help
You can simply say,
The factory has accepted the charge finally and we appreciate your help.
If you want to use although, you can say
Although the factory accepted the charge late, we thank you.
I hope I answered you question, buddy
Student or Learner