The "underworld" usually refers to unsavory or criminal activity. "The detective used a disguise to try and blend in with the underworld of drug dealers." In some religions and mythology, the underworld refers to the afterlife.
"Outside world" refers to life outside of a cloistered or segregated area. "The prisoners looked forward to the daily newspaper, so that they could keep up with the outside world."