Left Behind: letting go of your friends from an abusive church

When you leave a spiritually abusive church or organization, you are leaving behind friends as well. How do you handle that?