I sometimes had this feeling, though no one said it, when I left being a missionary. One friend did challenge me as to whether I was abandoning God's will. However, I discovered that God can use our lives just fine without our being pigeonholed as "special" servants.