I think you have a different problem than many language learners have.
Many of us learn some grammar and vocabulary and are able to make ourselves understood. The big problem is that native speakers then speak very fast and use words that we don't know or recognize, so we don't understand what they are saying.
I think your problem is an easier one to solve. Speak boldy but don't try to be perfect; do the best you can and concentrate on making yourself understood. You will gradually improve, especially if you can find someone willing to help you learn English. Listen to many English conversations.