You do not use the past perfect tense as you use the past tense. The past perfect is only used to refer to an earlier event in the past, which I would call it the "past within the past".
You went to London in 1999. Your previous trip to London was 1995.
When you refer to your trip in 1999, you say you had been to London once.