That's not your individual feeling. Everyone who is not English native speaker has the same difficulty as yours.
The best solution is that talk to native speakers. If you can't do that, talk to your friends, related people (may be they don't understand you, but at least you can talk), think about every situation in English as much as posible.
Self-confidence and diligence will help you. Certainly, you will make mistakes, but you'll learn alot from your mistakes.
Post questions here at this forum is a good way, too. Many people willing to help us.
I'm a Vietnamese. I'm very poor, I don't have money to study at University.
So, I study myself at home, but I believe I will get used to speaking English in someday. I've been learning English over one year and I can get 630 score of TOEIC test. I'm really believe in myself.
I hope that my opinion can give you some ideas.
And if I make any mistake in this article, everyone who is reading, please correct it for me. Thanks.