Ontology can be 1) a discipline of knowledge, 2) the set of entities targeted by a branch of knowledge. The former is not really the problem here, but the latter, the ontology of mathematics.
A formal ontology, in a specific domain (case 2) is necessarily a formal system (see Wikipedia: formal system), where (domain) concepts and axioms are specified. Axioms essentially define relationships between concepts of the domain, but such concepts are never entities defined from scratch. So, they are never isolated.
Even if it is said that "a gwigwi is a wugwug" (a definition from scratch), it is assumed that both are objects, that both have boundaries, so, that they can be counted and organized in groups or systems. For a domain ontology, such definition already presupposes a subjective bias (e.g. arbitrary time and space scales, in addition to the human capability of bounding, of discriminating portions of nature one from the other, even if all nature is made of atoms interacting, where boundaries don't exist), and a dependency (preventing a possible conceptual isolation). So, both terms are not isolated concepts.
Domain concepts have strong dependencies on language, ergo, on subjective concepts. In addition, even if we consider that the object exists per se (e.g. according to Aristotle's approach of form and matter, circles would exist in nature as pure forms, and apples would be kind of evolved version of circles, expressed with matter), then in such case, perhaps, self-references would be possible: "for a gwigwi to be a wugwug, a wugwug must be a gwigwi". But no entities in mathematics are defined in such way. But if it's said that "a gwigwi is a flower that...", then the concept is useful; but the domain of knowledge becomes dependent on the domain of knowledge of flora.
Notice that in final terms, the dictionary is a circular set of references. Although it sounds funny, in order to understand words in the dictionary, recent life experience as a human is required. Ergo, not even the set of words in the dictionary is isolated. Words in a language depend on other languages, onomatopoeia, feelings, movement, a specific capability of memory, ability of inference, intuition of causality, etc. Kant: concepts without intuitions are empty.
Therefore, the ontology of mathematical objects can't be independent (isolated) at all. It is largely dependent on multiple human subjectivities. Moreover, it is interdependent on ontologies from other domains of knowledge, which might not necessarily be formal.