Configure monitoring

[ojongerius]

How is monitoring set up at the moment, what do other freeCodeCamp project do? Can and if so, are we happy to re-use this?

/cc @freeCodeCamp/open-api

[raisedadead]

see #92 (comment)

[ojongerius]

While we figure out a perfect solution, this serverless plugin could add a lot of value for very little effort or cost: https://github.com/ACloudGuru/serverless-plugin-aws-alerts

We specify which alarms to look for, and where notifications need to go. Destinations can be email, webhooks, SMS or other Lambda functions.
Happy to hook this up and initially use email as a destination. We could deliver to Gitter using a webhook, until Protobot is ready, or instead of Protobot.

If there is a way to page at the moment, and I'm not sure if there is, that service would probably be capable of receiving webhooks.

[ojongerius]

I'll do a little spike and set up CloudWatch based alerts with email and Gitter as a destination tomorrow morning.

[ojongerius]

We had our meeting, current outcome I'll configure Cloudwatch alarms.

Once we deploy and run in the freeCodeCamp AWS account, I'll hook it up to the freeCodeCamp Datadog account so we can have pretty dashboards and integrations with all the things.

[ojongerius]

Alarms are there, going to my email address. Just need to set up Datadog integration, which is pending of me moving things over to the freeCodeCamp AWS accounts.

[ojongerius]

I've moved the app to the freeCodeCamp account, and have set up the Datadog integration.

This has generated a few automatically created dashboard that may be of interest, for instance the Lambda one at https://app.datadoghq.com/screen/integration/98/aws-lambda

[ojongerius]

Interesting metrics to alert on and or graph:

• api gateway -aws.apigateway.*
• lambdas - aws.lambda*
• SES - aws.ses.*
• SNS - aws.sns.*
• MongoDB - mongodb.*