Windowless Basement Rooms

I'm looking at an apartment where the second "bedroom" is a windowless basement. Given that my wife and I would use it as a nursery, I'm concerned about how cool it would be in the stuffy summers. Anyone have experience with this? Are subterranean rooms generally cooler so that a fan is sufficient? Assuming the mgmt company would allow it, we could install a split AC unit, which would entail drilling through walls. But is this needed? We love the space, but for these concerns, so I'd really love to hear how people manage to live in these windowless basement rooms. Thanks.