Theoretical physicists accept the need for mathematical beauty as an act of faith... For example, the main reason why the theory of relativity is so universally accepted is its mathematical beauty.
What makes the theory of relativity so acceptable to physicists in spite of its going against the principle of simplicity is its great mathematical beauty. This is a quality which cannot be defined, any more than beauty in art can be defined, but which people who study mathematics usually have no difficulty in appreciating.
It is more important to have beauty in one's equations than to have them fit experiment... It seems that if one is working from the point of view of getting beauty in one's equations, and if one has really a sound insight, one is on a sure line of progress. If there is not complete agreement between the results of one's work and experiment, one should not allow oneself to be too discouraged, because the discrepancy may well be due to minor features that are not properly taken into account and that will get cleared up with further developments of the theory.