Violet Gray, a character in the Peanuts comic strip, was a bit of a snob:
She often looks down on people who fail to meet her social standards, especially Charlie Brown, to whom she once stated flatly, “It simply goes without saying that you are an inferior human being.” His adroit reply to that was, “If it goes without saying, why did you have to say it?!”
It goes without saying, a simple colloquial phrase is used to mean something should be generally understood, accepted. “It goes without saying,“ we say.
And most of the time, it just goes without saying, and we go on without looking, without watching, not noticing. It’s understood.
But what if it went with saying. We’d say instead, “it goes with saying.” And we’d mean it.