Google Calendar has this feature: we can add a note when declining an invitation, and we have the option to not send a notification when we make changes to an invite.