We usually hire in Spain and drive to France.
Hertz covers this without an extra charge, but some of the other hire companies either do not allow their vehicles to be taken out of the country of hire or they will charge you an extra amount per day.
Check their terms and conditions online.