On Azure most data services offer a firewall. Unfortunately, at the moment the details of those firewalls differ. As soon as a firewall is switched on for any storage service (e.g. Azure Data Lake Gen2, Azure Synapse, Azure Key Vault), Azure Data Factory cannot access the resources by default anymore and must be configured accordingly.

In this blog post, I want to demonstrate how to demonstrate how to connect ADF and Synapse pretty securely without going with a full Managed VNet Runtime of ADF which would incur extra cost.

Yesterday Microsoft has announced and made available a new type of ingestion. It is named the metadata-driven copy task. With this new task, one can within minutes create a pipeline that loads data from a wide variety of data sources into a many of the ADF supported data sources.

The WHO has published a success story about our project. The world health data hub is an Azure Data Platform. Leveraging Synapse, Azure ML and Azure Data Factory teams can work with data they ingest and share in an Azure Data Lake gen2.

We have published a success story about the recent project conducted with thyssenkrupp.

In the following video, I am presenting together with the thyssenkrupp stakeholders some more insights in what we have built.

Very honoured that Satya Nadella has posted today some information about the alfred project on LinkedIn.

This project has been my main activity for the last year. See more in the following post.