From a central point, yes. Not from all points within. There is an edge to the universe, this is why we have "background" radiation, which you mention. The edge cannot be the center, actually what you imply, the idea that all is the center, would negate the theory of the big bang, which is contingent upon the nature of the expansion and background radiation.

I'll admit I don't care much for theories than cannot be tested or evidenced and I do not view abstract maths as evidence.