AWS services in this solution

The following AWS services are included in this solution:

AWS service Description
Amazon CloudFront To distribute the frontend web UI assets.
Amazon S3 To store the static web assets (frontend user interface), and also uses it as a data buffer for log shipping.
Amazon Cognito To authenticate users (in AWS Regions).
AWS AppSync To provide the backend GraphQL APIs.
Amazon DynamoDB To store the solution related information as backend database.
AWS Lambda To interact with other AWS Services to process core logic of managing log pipelines or log agents, and obtain information updated in DynamoDB tables.
AWS Step Functions To orchestrate on-demand AWS CloudFormation deployment of a set of predefined stacks for log pipeline management.
AWS CloudFormation To provision the AWS resources for the modules of pipelines and the solution web console.
AWS Systems Manager To manage log agents for collecting logs from application servers, such as installing log agents (Fluent Bit) for application servers.
Amazon Kinesis Data Streams To subscribe to logs from a CloudWatch Log Group or as a data buffer for log shipping, and then initiate the Log Processor Lambda to run.
Amazon Kinesis Data Firehose To subscribe the logs from CloudWatch Log Group and then put logs into Amazon S3.
Amazon SQS To receive Amazon S3 Event Notifications and then initiate the Log Processor Lambda to run.
AWS Athena To build the Light Engine.
AWS Glue To build the Light Engine.