You have a choice in recovery- you’re getting rid of a toxic influence (your e.d.) in your life. It’s also important to get the toxic people out of your life, too.
Recovery is a tough thing, especially when you feel people are going to use it against you.
Just remember how strong you are- you’re choosing to recover. The negative people in your life who want to use that against you are simply cruel. You don’t need them in your life at all. Hold your head high and fight.