Longwood in spring is amazing, and they have lots of fun kids stuff in the fall too, iirc. Even Christmas season is nice in the conservatory, and the lights. A mom I know always brings her kids to one of their breakfast with Santa events, although, as Asians we're not really that into Santa, so I haven't tried that.
Summer is pretty but very stinkin hot, as you now know. :)