AWS services in this solution
The following AWS services are included in this solution:
| AWS service | Description |
|---|---|
| Amazon CloudFront | To distribute the frontend web UI assets. |
| Amazon S3 | To store the static web assets (frontend user interface), and also uses it as a data buffer for log shipping. |
| Amazon Cognito | To authenticate users (in AWS Regions). |
| AWS AppSync | To provide the backend GraphQL APIs. |
| Amazon DynamoDB | To store the solution related information as backend database. |
| AWS Lambda | To interact with other AWS Services to process core logic of managing log pipelines or log agents, and obtain information updated in DynamoDB tables. |
| AWS Step Functions | To orchestrate on-demand AWS CloudFormation deployment of a set of predefined stacks for log pipeline management. |
| AWS CloudFormation | To provision the AWS resources for the modules of pipelines and the solution web console. |
| AWS Systems Manager | To manage log agents for collecting logs from application servers, such as installing log agents (Fluent Bit) for application servers. |
| Amazon Kinesis Data Streams | To subscribe to logs from a CloudWatch Log Group or as a data buffer for log shipping, and then initiate the Log Processor Lambda to run. |
| Amazon Kinesis Data Firehose | To subscribe the logs from CloudWatch Log Group and then put logs into Amazon S3. |
| Amazon SQS | To receive Amazon S3 Event Notifications and then initiate the Log Processor Lambda to run. |
| AWS Athena | To build the Light Engine. |
| AWS Glue | To build the Light Engine. |