Migration to a new data platform can be a complex and time-consuming process. To ensure a successful migration, it's important to have a well-defined plan and a checklist in place. In this blog, I will outline my own Snowflake migration checklist created based on my experience helping customers migrating their workloads to Snowflake, a cloud-based … Continue reading The ultimate Snowflake migration checklist
T-SQL to create a SQL Server Database Inventory
Problem I had to work on Inventory Management System and log details for various SQL instances in my support. The old way to do that was to log into every instance check the details and copy paste that into excel. Well I am a lazy person and I had to find an easier way to … Continue reading T-SQL to create a SQL Server Database Inventory
Determine the last database backup in SQL Server with T-SQL
Problem: T-SQL code to obtain the last database backup time, the last backup location, the last backup size and check if the file exists on the disk or not. Note: Result will only include database backups that were taken on disk. SELECT A.[Server], A.database_name, A.last_db_backup_date, B.backup_size/1024/1024 as backup_size, B.physical_device_name , 'Yes' as 'file_exists' into dbo.##BackupReport … Continue reading Determine the last database backup in SQL Server with T-SQL
SQL Server In-Place Upgrade Failed – Wait on the Database Engine Recovery Handle Failed
Issue Few weeks ago I was performing an in-place upgrade from SQL Server 2014 to SQL Server 2017. I followed each and every pre-check before performing an in-place upgrade, but got this error message at the end of the installation: The following error has occurred: Wait on the Database Engine recovery handle failed. Check the … Continue reading SQL Server In-Place Upgrade Failed – Wait on the Database Engine Recovery Handle Failed
Build a Data Lake using Lake Formation on AWS
What is a Data Lake? A Data Lake is a centralized repository for large amounts of structured and unstructured data to enable direct analytics. The above image illustrates multiple functions of a data lake, such as data ingestion, data indexing, data processing, machine learning, and data visualization. Data Lakes provides the ability to harness more … Continue reading Build a Data Lake using Lake Formation on AWS
Online Data Migration from SQL Server to Cloud Spanner using Striim
This post will focus on the implementation of a continuous migration from SQL Server to Cloud Spanner using Striim. The explanation will include steps for configuring and initial load and a continuous data replication using Change Data Capture. this is enablement post and doesn't talk about a full scale database migration and its challenges. This … Continue reading Online Data Migration from SQL Server to Cloud Spanner using Striim
Automated Database Backups for Cloud Spanner using Terraform
This post shows how to use cloudspannerecosystem/scheduled-backups to configure scheduled backups for your cloud spanner database. The setup of the required resources (cloud scheduler, pub\sub and cloud function) will be done by using terraform in this tutorial. The Architecture is as follows: We will provision the following GCP services using terraform: Cloud Scheduler: trigger tasks … Continue reading Automated Database Backups for Cloud Spanner using Terraform
SQL Server Always On Availability Groups on Google Kubernetes Engine
This tutorial shows you how to configure SQL Server AlwaysOn availability groups (AG) using DH2i DxEnterprise and Google Kubernetes Engine (GKE). This offering helps you achieve high availability for your SQL Server databases running on containers in Kubernetes. Infrastructure Design GCP Resources that will be created for this demonstration VPC Network named network-1privatenet subnetpublicnet subnetPrivate … Continue reading SQL Server Always On Availability Groups on Google Kubernetes Engine
Running SQL Server 2019 on Google Kubernetes Engine
Have you tried to run a SQL Server deployment on Google Kubernetes Engine yet? Here is a complete guide to create and run SQL Server 2019 on GKE. You will be creating the following resources to successfully host SQL Server on GKE. A namespace to host resources for SQL Server deploymentA secret for 'sa' accountPersistent … Continue reading Running SQL Server 2019 on Google Kubernetes Engine
Custom Email Notification In Azure Data Factory
Problem How to send an email from Azure Data Factory pipeline with a custom message body using gmail as email provider? Azure Data Factory does not allow us to send emails. It is possible to send alerts (emails) in ADF but these do not provide any clarity\customization on the message subject and body. Recently, I … Continue reading Custom Email Notification In Azure Data Factory