By: Koen Verbeeck
In this video tutorial series we will look at how to move data around in Azure. We will look at various tools and options to move data in the cloud in each of the different videos in this tutorial. This first video provides an overview of what we will and will not cover in these tutorials.
Recommended Reading
Video Transcript
Welcome to this video series about moving data around in Azure, where I'll be explaining some services in Azure, of course, that you can use to move data from one location to another. But let's first introduce myself. My name is Koen Verbeeck and I work as a Senior Business Intelligence Consultant for the company AE. I'm also a Microsoft Data Platform MVP, I write some articles for MSSQLTips.com, and I have some certifications. If you have any questions, you can post them in the comments section, or you can reach me at Twitter, LinkedIn, or my blog.
Let's start with the introduction. So, the goal of this session, we have some data at some location can be CSV files, flat files, and a database, which we want to move using a pipeline to another location, for example, a database, Azure Blob Storage, a data lake, whatever. We want to use a pipeline in the cloud. So we want to use only cloud tools. So the video series is about, which services can we use in Azure to get this done.
AAll right, there are a lot of different options in Azure. And all of them are very useful for every scenario. So, some of them are very specific use case, So, I'm gonna explain a little bit about what we'll not be talking about in these videos. So as I mentioned, very specific use cases, these are out of scope. So Azure Machine Learning IoT has Data Lake analytics, Stream Analytics, Azure SQL Data Warehouse, those are all very specific use case and if you use these tools, it's immediately clear what you want to do, how you want to move data around.
For example, it's Azure SQL Data Warehouse, we're probably gonna use PolyBase to get data into Azure SQL Data Warehouse. So PolyBase is not gonna be in these videos, because it's too specific for Azure SQL Data Warehouse. I'm also not gonna discuss anything that runs in a virtual machine be it Windows, be it Linux, because it's a little bit like cheating. That means you can run every possible on-premises application also in a virtual machine, and I'm only going to focus on cloud solutions. I also not gonna talk about any backup or migration services like Azure Data Box, EasyCopy, Azure Database Migration Services, because again, this is another specific use case running in data from the cloud to on-premises or the other way around. So again, I'm not gonna discuss this.
So what we will be talking about in the coming videos, are some Azure data services, and I'll split them into two categories. On the left, where you have to write code, PowerShell, or C Sharp or something else, then the right side where you do not have to write any code at all, or maybe some light expressions. So, on the left side we have for example, Azure Automation, which is gonna be a very short video, because it's not a real data service. On the right side, for example, you have Logic Apps, on the left side, again, we have Azure Functions And we also have Azure Databricks. And on the right side, we have maybe the most important data surfaces, which is Azure Data Factory, which also has the Azure SQL service integration run time, the Mapping Data Flow, and Wrangling data flow. So, all of those services are going to be covered in the coming videos, and we'd like to thank you for listening.
