I visted Varadero/Havana in Dec/Jan and the weather was perfect then. I think it gets very humid from May - Sept.
I loved the trip and would recommend it to anyone. It's cheap, has a charming culture, always sunny and a mixture of city/beaches to see within reasonable proximity to each other.