Build a data warehouse on Azure Data Platform for $150

On-demand Webcast Abstract

When you watch some conference sessions, or read some blog posts, it always seems like everyone is drowning in petabytes of (streaming) data. They’re proclaiming you need the fastest, best, most scalable, distributed shared-nothing (or everything?) multi-parallel system that can also get coffee.

But guess what?

  • Not every company has to deal with a scale that businesses like Google, Amazon, or Tiktok have to deal with.
  • Not every company needs streaming data with Kafka, Spark Streaming or Event Hubs.
  • Not every company has complex unstructured data that you need to deal with in a data lake with tools like Databricks.

Some companies have just a couple of gigabytes of data (or even less). Maybe a terabyte if we’re pushing it. They don’t need fancy streaming real-time dashboards, they just want to analyze their financial and sales data. It’s ok if it just runs once a day. Their source systems are regular databases, maybe some Excel files and a SharePoint list.

In this session, you’re going to learn how you can build a data analytics platform in Azure that is dirt cheap.

We’re going to cover the following technologies and patterns:

  • Cheap ingestion with Azure Data Factory using a metadata-driven framework, in combination with Azure Logic Apps and Azure Functions
  • A data warehouse implementation in Azure SQL Database. We’ll cover design best practices and scaling options.
  • A Power BI model for presenting the data to the end users

In each section, we’ll look at how costs can be contained.

After all, we want a data warehouse which doesn’t cost more than $150 per month!

Note: it’s assumed you have basic knowledge of Azure Data Factory, databases and SQL.

Speaker

presenter 1

Koen Verbeeck is a seasoned business intelligence consultant working at AE in Belgium. He has over a decade of experience in the Microsoft Data Platform, both on-premises as in Azure. Koen has helped clients in different types of industries to get better and quicker insights in their data. He holds several certifications, among which the Azure Data Engineer cert. 

Sponsored by

MSSQLTips logo
Name(Required)

2 Comments

    • Yes, it will be recorded. If you can’t make the live event you can register and we will send you a link to the recording after the event.

Leave a Reply

Your email address will not be published. Required fields are marked *