Love to us can be viewed in different ways, love simply means having an affection towards someone, who be anybody in quote, might be you mother siblings, father, wife etc.
But in this case, we are actually talking about love that had to do with affairs, i.e having an opposite gender as a lover.