Busch Gardens is a theme park in southern VA, might offer a diversion for the baby. It is lovely. You could also think about the seaside resorts - Duck in NC, Ocean City Maryland. Annapolis on the Chesapeake Bay east of DC is a lovely Harbour town. Drive the chesaspeake bay bridge to Norfolk - 18miles long with two tunnels in included if I recall.