7
votes
Accepted
Is it a good idea to have a secondary person on call for production operations?
I can't imagine having only one person on-call at a given time. There are several reasons that the primary person could be unable to handle an issue - perhaps they are unable to receive alerts, they ...
- 311
4
votes
Is it a good idea to have a secondary person on call for production operations?
Yes!
And consider a third and a forth person if you're large enough. Folks can get sick. Their phone might have run out of battery. They might be dealing with a major local power outage. Folks go ...
- 1,838
4
votes
How to change PagerDuty incident name?
Within the CloudWatch integration in PagerDuty, you can change the "Derive name from" field to something like "Alarm Description".
2
votes
Accepted
What do you tell someone new to going oncall or PagerDutyl?
There are a number of things that I think it's important to know before going on-call:
How to triage an issue. There should be a defined list of priorities with examples so that you can identify how ...
- 2,761
2
votes
Trigger PagerDuty alert after a number of incidents
The easiest way to build this would be to have some sort of metrics-based alerting system like Prometheus, datadog, etc. Those systems allow you to have a counter that gets incremented and you can ...
- 1,838
2
votes
How to change PagerDuty incident name?
Based on the PagerDuty documentation on Cloudwatch, it doesn't look like it's configurable:
https://www.pagerduty.com/docs/guides/aws-cloudwatch-integration-guide/
- 406
2
votes
Accepted
How do we get notified when PagerDuty services are disabled?
3-4 years experience with PD here.
PagerDuty will not monitor itself in the way you want, it's made to push notifications, calls, alerts and etc. As mentioned in the comments you should use ...
- 334
2
votes
Pagerduty API integration and auto-resolution
PD has a lot of native integrations that can do auto-resolve but for those that don't you can use the API and/or rulesets to do that.
Here is a link to the ruleset documentation: https://support....
- 21
2
votes
Accepted
Is there any way to get New Relic or PagerDuty to not alert during nightly maintenance?
We ended up creating a new PagerDuty service with a schedule attached to it. That schedule only had anybody assigned for half of the day. This ended up duplicating some info from the service we ...
- 1,838
1
vote
What do you tell someone new to going oncall or PagerDutyl?
Here's my two pieces of advice:
Work out schedules so that you're not on-call 24 hours a day. There should be a hand-off between daytime operations and after-hours support. I encourage people to ...
- 998
Only top scored, non community-wiki answers of a minimum length are eligible