As long as he is still getting enough to eat, it doesn’t sound like elder abuse. It’s hard to find a balance between helping someone and forcing them against their will! Neglect, or not feeding a person who is dependent on you to feed them, would certainly be considered elder abuse. You’ll have to assess the situation to make sure that you are not being neglectful as his caretaker.