Go to
for your project, then Mattermost Settings.
Click
to delete the notification policy.