I'm a little rusty on "adverbial objectives". Sorry.
But Tom didn't visit an extent of weeks. He might have only visited an hour. It was weeks ago that it happened.
That's an interesting word -- ago -- isn't it? I suppose it could be replaced by "in the past". My guess at its etymology is that it come from something Anglo-Saxon like "at gone".