PD has a lot of native integrations that can do auto-resolve but for those that don't you can use the API and/or rulesets to do that.
Here is a link to the ruleset documentation: https://support.pagerduty.com/docs/rulesets
And here is documentation on the incident resolution API:
Here's my two pieces of advice:
Work out schedules so that you're not on-call 24 hours a day. There should be a hand-off between daytime operations and after-hours support. I encourage people to split half their regular time between support weeks and project weeks; after-hours support should come during a project week.
Get in the habit of taking notes ...