With Priority-Based Alerting, you can set different notification rules for high and low priority incidents.

Keep it quiet during maintenance. With maintenance windows, you can temporarily disable one or multiple alert sources for a set period of time. An alert source with an ongoing maintenance will not create any incidents.