Enforce Data Integrity with Delta Lake Tables using Azure Synapse
In this article, we look at ways to enforce data integrity when working with Delta Lake tables when using Azure Synapse Analytics.
Fikrat Azizov (MCSE Data Platform and MCSE Azure Solutions Architect) has been working with SQL Server since 2002. Fikrat's main passions are SQL Server performance optimization, cloud data technologies and machine learning. Fikrat is currently working as a Solutions Architect at Slalom Canada.
- MSSQLTips Awards: Author of the Year Contender - 2019-2022 | Rising Star (50+ tips ) - 2021
Reporting from Lakehouse data using Azure Synapse Analytics
In this tip we explore ways to build reporting based on the Lakehouse data when using Azure Synapse Analytics.
Delta Lakes Time Travel Functionality for ETL logging
In this article I demonstrate how to use Delta Lake's time travel functionality for ETL logging along with steps to take to implement.
Late Arriving Dimensions on Data Lakehouse using Azure Synapse
In this article we discuss ways to handle late-arriving dimensions when working with a Lakehouse and Azure Synapse Analytics.
Azure Synapse Analytics Fact to Dimension Mapping
In this article we cover a common fact processing task which is fact-to-dimension mapping and how this can be done with Azure Synapse Analytics.
Incremental Ingestion for Large Fact Tables on Lakehouse
Learn about the incremental processing challenges related to fact tables for Azure Synapse Analytics and how to solve.
Incremental Processing for Fact Tables with Azure Synapse Analytics
In this article we discuss the incremental processing challenges related to fact tables for Azure Synapse Analytics and how to solve.
Time Dimensions for Data Modeling in Azure Synapse Analytics
In this article we discuss time dimensions for data modeling in Azure Synapse Analytics and how to design time dimensions and use flowlets.
Slowly Changing Dimensions on Lakehouse with Synapse Mapping Data Flow
This article looks at building Slowly Changing Dimensions (SCD) logic to build end-to-end Lakehouse solutions based on Azure Synapse Analytics.
Create Surrogate Keys in Azure Synapse Analytics for Data Warehousing
In this article we cover how to create surrogate keys in Azure Synapse Analytics to simplify your data warehouse and allow you to track changes easier
Dimension Denormalization with Synapse Mapping Data Flow
In this article we discuss dimensional denormalization when working with Azure Synapse Analytics to reduce joins and improve performance.
Missing Values in Lakehouse using Azure Synapse Mapping Data Flow
Learn how to handle missing data values in your data set and things that can be done with Azure Synapse to generate the missing values.
Data Enrichment in Lakehouse using Synapse Analytics Mapping Data Flow
In this tip we explore another common Lakehouse transformation, data enrichment, when using Azure Synapse Analytics.
Data Deduplication for Azure Synapse Analytics with Mapping Data Flows
Learn how to perform data deduplication for Azure Synapse Analytics using Azure Mapping Data Flows.
Data Ingestion into Delta Lake Bronze tables using Azure Synapse
Learn how ingestion reads data from the landing zone and pushes data into the Bronze layer of the Delta Lake tables for Azure Synapse Analytics.
Copy Data Tool in Azure Synapse Analytics Studio
Learn about data ingestion and the steps to load data into Synapse Analytics using the copy data tool in Synapse Analytics Studio.
Data Warehouse Development Challenges Uncovered
This article is dedicated to building the new generation data warehouse called lakehouse and we discuss common data warehouse building challenges.
Scalable Lakehouse Solutions for Azure Synapse Analytics
Learn about the challenges of implementing Data Lakes and the lakehouse concept to build scalable solutions capable of handling large data volumes.
Analyze real-time data streams Azure Synapse Analytics and Cosmos DB
Learn how to analyze real time data from Azure Cosmos DB with Spark Structured Streaming functionality in Azure Synapse Analytics.
Data pipelines with Azure Event Hub, Stream Analytics and Cosmos DB
Learn how to ingest Twitter Feeds into Azure Event Hubs and deliver them to Azure Cosmos DB using Azure Stream Analytics.
Process Real Time Data Streams with Azure Synapse Analytics
In this tip we show how real-time data can be ingested and processed, using the Spark Structured Streaming functionality in Azure Synapse Analytics.
Analyze data skew issues with Azure Synapse Analytics
In this article learn how to determine if your Spark job running on Azure Synapse Analytics is impacted by data skew issues.
Azure Synapse Analytics Dashboard Reporting
In this article we cover how to use Azure Synapse Analytics and Power BI to create dashboards for data analysis.
Azure Synapse Analytics vs Azure Data Factory for Building a Pipeline
In this article we are going to look at the similarities and differences between Synapse Analytics and Azure Data Factory then we will build a sample Synapse pipeline.