Am I racist if I think we should cut down on welfare?

I was talking to my friend about politics and said I think we should cut down on welfare so that people would be encouraged to get jobs and make a living rather than be taken care of by the government. My friend told me that was racist, I guess because a lot of people on welfare are black. I don't have any problem with people of a different race though, I would say the same thing no matter what race was on welfare. So am I racist for saying this? Please don't leave comments arguing about my view on this, just answer the question.