Practice, practice, practice!
Build your vocabulary by learning new words each day. Make flashcards to practice new words and common phrases.
If possible, listen to English TV shows. Have you checked to see if there are learning materials at your library. I am learning Spanish and I listen to Pimsleur Language CDs. I play them over and over until I feel confident enough to go to the next lesson. Good luck!