AWS Email Wrangler

Solution Diagram

Overview

AWS serverless solution to extract document attachements from e-mails sent to SES mailbox. The solution relies on integration of following AWS services: SES + S3 + Lambda + EventBridge + CloudWatch.

How it works?

Solution walkthrough:

User sends an e-mail with attachments to SES Email Retrieval endpoint (receiving mailbox)
SES Receipt Rule saves messages as EML files to S3 bucket in the incoming/ folder
SES Receipt Rule invokes the Lambda function and passes metadata about EML file in context
Lambda function loads the EML file from S3 bucket, extracts document attachments (selected content type), and saves them back to S3 bucket in the attachments/ folder.
Lambda execution logs are streamed to a dedicated CloudWatch Log Group
EventBridge custom Bus is configured as Lambda Destination to collect events emitted on Lambda function's successful and failed executions
EventBridge Rule target is configured to stream the events to a dedicated CloudWAtch Log Group
CloudWatch Dashboard uses CloudWatch Log Insights to query for execution and destination logs to show number of successfull or failed Lambda function executions, as well as number of extracted document attachments from the EML files.

How to make it fancy?

EventBridge Bus receives events from Lambda Destinations for successfull and failed executions of Lambda function. You can create an extra Event Rule to catch only the successful executions.

Make sure to input the $.detail.documents (JSON Path) to the Event Rule Target. This is to pass to the target service only part of the event: output of the Lambda function. You can then pass it to any service suported as Event Rule Target for further processing, for example: Step Functions workflow.

AWS CDK App: