[Grammar] Have been or have gone

[mrmvp]

Which one should I use? Why?

They have been to the castle today or they have gone to the castle today?

They haven't gone to any other sights yet or they haven't been to any other sights yet ?

 

[Tdol]

Which one should I use? Why?

Where are they now? That will affect the sentence.