Quick Question on Game Cache

Does it affect the loading time of your map? Does it affect anything else?

No. No.
I suppose if you consider the need for a global cache variable an impact on load time, maybe it does, but certainly not significantly.

Granted, too much of anything isn't healthy for a map.
So please, use in moderation. :P