If you have further questions about this matter, please just let me know and I will address them for you.

Does just, here, mean only?just = only?

I think just should be "right away" or "at once" and so on. But the definition about "just" is not in any dictionary.