Jerry Larabee (Richard Barthelmess)is a gangster who can play piano and sing, mostly to entertain his girl Alice (Betty Compson), who is quite visibly thrilled by his crooning. But as the result of a gangland shootout he had with rival mobster Spadoni (Louis Natheaux), Larabee must do a stretch in prison. The kindly warden (William Holden) sees a potential for redemption in him, and talks Mary into giving him up, so he will break all contact with his previous life. Through his musical talents, Jerry is soon doing radio broadcasts with the prison orchestra, and one of his own compositions, "Weary River" is a smash hit with listeners. In no time, he's released, with a concert tour lined up. unfortunately, hecklers cause the overly sensitive ex-gunman to lose his confidence and he's a flop. Down on his luck, he drifts back to his old gang buddies and Mary, who's never stopped loving him.