This is a very interesting name. In the span of more than 150 years the name is found in France with relative scarcity. It does indeed come from
Tarn and Garonne from the twon of Lavardac.
I suspect that the surname, DURRUA, probably came from the town of
Duras also in
Tarn et Garonne. Could it be that a lady of
Duras was called a "Durrua", the feminine form of
Duras? This will need some some further investigation into the spoken gascon of the area.