Build a Data Lake using Lake Formation on AWS

What is a Data Lake? A Data Lake is a centralized repository for large amounts of structured and unstructured data to enable direct analytics. The above image illustrates multiple functions of a data lake, such as data ingestion, data indexing, data processing, machine learning, and data visualization. Data Lakes provides the ability to harness more … Continue reading Build a Data Lake using Lake Formation on AWS

Securely transfer database backups to Amazon S3

Problem When taking native database backups for EC2 everyone prefers to store the backups in Amazon S3 as it is durable and cost effective but the questions you need ask yourself while transferring the backups are the following, Are the backups going to S3 over internal backbone network?Are you using temporary credentials to authenticate to … Continue reading Securely transfer database backups to Amazon S3

Build a CI/CD pipeline using AWS developer tools

Building and delivering software isn't easy. Everyone wants to have a consistent quality and to be able to deliver new functionality quickly. In this write-up, I will demonstrate Continuous Integration and Continuous Delivery for a Simple .NET application using AWS Developer tools. Assumptions - I  am assuming that you have prior working knowledge of AWS … Continue reading Build a CI/CD pipeline using AWS developer tools