Williams was performing at the Celebrity Theatre in Phoenix when he had a 10-minute exchange with a Latino audience member. The exhange was posted on YouTube and Williams' publicist quickly released an apology - but Williams himself has disavowed the statement and is sticking by his material.
"I meant what I said and I said what I meant," Williams told CNN.
In the video, Williams asks the audience member if he is Mexican.
"Do you remember when white people used to say 'Go back to Africa,' and we'd have to tell them we don't want to? So if you love Mexico, [expletive], get the [expletive] over there!" Williams told the man.
Williams also said, "We were slaves, [expletive]. You just work like that as landscapers."
But what was not captured on film, according to Williams, was the beginning of the exchange, with the audience member firing the first salvo.
"If a person starts their heckling with 'f' America, then that gives me the right to defend my country," Williams said. "I don't think I need to apologize for being pro-American."
Williams said he could not be anti-Mexican, considering how many of his fans are of Mexican decent.
"The guy said that all of [Arizona] is still Mexico, and I was giving him geography."
As for the statement, Williams said he had nothing to do with it, recalling that, when he was in jail, business associates released a DVD featuring him without permission.
Arizona activist the Rev. Jarrett Maupin wants Williams to return to the state to show commitment to the Latino community much like how Morgan followed up anti-gay remarks during a performance at Ryman Auditorium by returning to Nashville.
Williams, however, says he cannot apologize for his uncensored remarks.
"That's for the Tracy Morgans of the world," he told CNN.