The game releases the current track when you leave it. Don't do this! Keep the most recent track in memory even if the player leaves.

Track loading is very slow, and most of the time, when a player leaves a track, he returns to the same one. If you retain the track, then second and subsequent loads will be that much faster.