To edit, pause, or delete an alert, go to the Alerts section.
For each alert set, 3 actions can be performed: Edit, Pause/Play, Delete.
EDIT
Click Edit if you want to make changes to a current alert.
Once you click here, a pop-up like the one below will appear, where you can perform the changes you need.
PAUSE/PLAY
Click Pause if you want to disable an alert temporarily. While the alert is paused, no alert notifications will be sent. If you want to enable it afterward, click on Play.
DELETE
Click Delete if you want to delete an alert that you have. Deleting the alert means no more mentions will be sent for that alert.