I've turned down a lot of trades where I might have gotten a better player, but I wasn't totally sure of the chemistry of that new player coming in. Even though he might possess golden ability, his personality and the way he gets along with teammates might be things you just don't want to cope with.
Everyone is born with a certain potential. You may never achieve your full potential, but how close you come depends on how much you want to pay the price.