The title of this episode is in reference to the antiquated belief (as well as a passage in Stephen Hawking's book "A Brief History of Time") that the world is flat and positioned on the back of a turtle. When a believer of this theory is asked what the turtle is standing on, the reply is to say that it's "turtles all the way down".
Last show of the series.