How can I cover my wall furnace to prevent the summer heat coming through from the roof?

I live on the top floor of an older apartment building- I can feel the heat coming from the roof through my wall furnace (pilot light is off).