Whether you like it or not, diet and exercise have to play a part of you getting rid of your love handles. However, the objective is to help you do so in a more simplified manner. The amount your love handles hang over the top of your underwear, belt or dress is fairly proportionate with how much you exercise as well as what you are eating. Yes, diet