Blog

Azure Data Platform

Learnings, findings and fun of an Azure Data Platform Consultant

I have presented at Power BI Fest on November 20th 2021. It was an honor to be part of a conference with many great speakers.

For the resources used in the presentation and more details please have a look at my previous blog post.

You find the deck here: 201910SQLSaturdayDevOps.pdf.

I will be speaking at the Power BI Fest next weekend.

The topic will be how to analyze your Azure Cost with Power BI. This gives many benefits compared with the native functionality in the Azure portal, for example speed and options to customize.

The result of this can look like the following:...

Continue Reading

On Azure most data services offer a firewall. Unfortunately, at the moment the details of those firewalls differ. As soon as a firewall is switched on for any storage service (e.g. Azure Data Lake Gen2, Azure Synapse, Azure Key Vault), Azure Data Factory cannot access the resources by default anymore and must be configured accordingly.

In this blog post, I want to demonstrate how to demonstrate how to connect ADF and Synapse pretty securely without going with a full Managed VNet Runtime of ADF which would incur extra cost.

Continue Reading

Yesterday Microsoft has announced and made available a new type of ingestion. It is named the metadata-driven copy task. With this new task, one can within minutes create a pipeline that loads data from a wide variety of data sources into a many of the ADF supported data sources.

Continue Reading

The WHO has published a success story about our project. The world health data hub is an Azure Data Platform. Leveraging Synapse, Azure ML and Azure Data Factory teams can work with data they ingest and share in an Azure Data Lake gen2.

We have published a success story about the recent project conducted with thyssenkrupp.

In the following video, I am presenting together with the thyssenkrupp stakeholders some more insights in what we have built.