A simple serverless architecture on AWS ecosystem for data ETL and visualisation

A simple step by step architecture for building an ETL process and then displaying that data back to the enduser by only using serverless service from AWS.

End user uploads data file into the S3 (This can be done manually by logging onto the console…


This content originally appeared on DEV Community and was authored by metacollective

Serverless architecture
A simple step by step architecture for building an ETL process and then displaying that data back to the enduser by only using serverless service from AWS.

  • End user uploads data file into the S3 (This can be done manually by logging onto the console or via an API accessible through a frontend application)

  • S3 triggers a Lambda function on receiving a create object event

  • Lambda function receives S3 event object and processes the data from file into a relational database on AWS's Aurora database (ETL)

  • End user can now access this data from database by accessing the web application statically hosted on S3 & served via the Cloudfront

  • This web application will make relevant API calls via ApiGateway (attached to Lambda functions) to fetch data


This content originally appeared on DEV Community and was authored by metacollective


Print Share Comment Cite Upload Translate Updates
APA

metacollective | Sciencx (2022-02-06T15:36:53+00:00) A simple serverless architecture on AWS ecosystem for data ETL and visualisation. Retrieved from https://www.scien.cx/2022/02/06/a-simple-serverless-architecture-on-aws-ecosystem-for-data-etl-and-visualisation/

MLA
" » A simple serverless architecture on AWS ecosystem for data ETL and visualisation." metacollective | Sciencx - Sunday February 6, 2022, https://www.scien.cx/2022/02/06/a-simple-serverless-architecture-on-aws-ecosystem-for-data-etl-and-visualisation/
HARVARD
metacollective | Sciencx Sunday February 6, 2022 » A simple serverless architecture on AWS ecosystem for data ETL and visualisation., viewed ,<https://www.scien.cx/2022/02/06/a-simple-serverless-architecture-on-aws-ecosystem-for-data-etl-and-visualisation/>
VANCOUVER
metacollective | Sciencx - » A simple serverless architecture on AWS ecosystem for data ETL and visualisation. [Internet]. [Accessed ]. Available from: https://www.scien.cx/2022/02/06/a-simple-serverless-architecture-on-aws-ecosystem-for-data-etl-and-visualisation/
CHICAGO
" » A simple serverless architecture on AWS ecosystem for data ETL and visualisation." metacollective | Sciencx - Accessed . https://www.scien.cx/2022/02/06/a-simple-serverless-architecture-on-aws-ecosystem-for-data-etl-and-visualisation/
IEEE
" » A simple serverless architecture on AWS ecosystem for data ETL and visualisation." metacollective | Sciencx [Online]. Available: https://www.scien.cx/2022/02/06/a-simple-serverless-architecture-on-aws-ecosystem-for-data-etl-and-visualisation/. [Accessed: ]
rf:citation
» A simple serverless architecture on AWS ecosystem for data ETL and visualisation | metacollective | Sciencx | https://www.scien.cx/2022/02/06/a-simple-serverless-architecture-on-aws-ecosystem-for-data-etl-and-visualisation/ |

Please log in to upload a file.




There are no updates yet.
Click the Upload button above to add an update.

You must be logged in to translate posts. Please log in or register.