What is a Data Lake? A Data Lake is a centralized repository for large amounts of structured and unstructured data to enable direct analytics. The above image illustrates multiple functions of a data lake, such as data ingestion, data indexing, data processing, machine learning, and data visualization. Data Lakes provides the ability to harness more … Continue reading Build a Data Lake using Lake Formation on AWS
Tag: AWS
How I hosted my portfolio website on Amazon S3?
Background I was looking to build my own portfolio website for some time now but the problem was that I am not a UI Developer and I always wanted a kick-ass website. Long story short, I got nowhere with it until recently, when I was working with a customer to help them move their e-commerce … Continue reading How I hosted my portfolio website on Amazon S3?
Securely transfer database backups to Amazon S3
Problem When taking native database backups for EC2 everyone prefers to store the backups in Amazon S3 as it is durable and cost effective but the questions you need ask yourself while transferring the backups are the following, Are the backups going to S3 over internal backbone network?Are you using temporary credentials to authenticate to … Continue reading Securely transfer database backups to Amazon S3
Build a CI/CD pipeline using AWS developer tools
Building and delivering software isn't easy. Everyone wants to have a consistent quality and to be able to deliver new functionality quickly. In this write-up, I will demonstrate Continuous Integration and Continuous Delivery for a Simple .NET application using AWS Developer tools. Assumptions - I am assuming that you have prior working knowledge of AWS … Continue reading Build a CI/CD pipeline using AWS developer tools