I believe this option already exists. You just remove them from your organization, but they retain their personal (free account) that can be rejoined .. correct me if I'm wrong.

co-signing this - while I don't have this specific issue, holding onto conversations is absolutely necessary.