How can I deal with someone who I don't want to ociate with but I really don't want to hurt their feelings?

I realize the severity of the question but it's just that I really don't want to talk to someone that I know yet I don't want to tell them at the same time because I feel really guilty even telling this someone that. Please don't yell at me or bash me for it. I just want to know.