I think something that would make people fear changing gender is sociaties lack of acceptance of new halfs.
not actually fearing the operation itself.
It could also be the idea of the finality of the operation, because once you do it, I'd imagine it'd be quite difficult and painful to return.