There is no question here. Love isn't a vitamin or bitter pill that you must force yourself to swallow because you know it's good for you. You cannot force yourself to feel attraction when you do not. You say you don't even like this man. If you felt affectionAffection is defined as fond attachment, devotion or love. Couples are most compatible when they are equally matched in terms of their needs for displays or expressions of affection. for him, you might have been able to be this man's friend but you cannot be his lover or life partner. That wouldn't be fair to you or him.
Keep in mind that no life decisions should be driven by the word "should." Should is a word that comes out of the conscience or "superego" portion of the psyche. Should is an expression of a feeling of guilt. You must always makes choices out the healthy part of the psyche, which we call the ego (not to be confused with the lay usage of the word which refers to conceit). You know you're coming from the ego portion of the psyche when you hear yourself say "I want x, y or z." You don’t want this man. You would only stay with him out of guilt and the feeling that you should.
It's important that you become aware of your tendency to make choices for the wrong reasons. Figure out why you do this. Was your mother a person who was selfless and sacrificed her own needs? Were you raised in a very religious environment? Whatever the reason, it's not healthy for you. Focus on making ego choices and you will have a more successful and contented life.