We consider some of the epistemic benefits of exploring "theory space" in the context of modifications of general relativity with intended applications in cosmology. We show how studying modifications of general relativity can help in assessing the robustness of empirical inferences, particularly in inaccessible regimes. We also discuss challenges to sharply distinguishing apparently distinct directions in theory space.