Categories
Azure

Elevating Teams Notifications using Adaptive Cards

Last week we looked at utilising Teams to make notifications more collaborative. This week I want to show how we can add more visual and interactive elements by adopting Adaptive Cards. What are Adaptive Cards? Adaptive Cards are structured messages which can be used across various Microsoft services as alternatives to plain text. They use JSON […]

Categories
Azure

Better Pipeline Notifications using Teams

Whether running Data Factory, Synapse, or Fabric pipelines, things go wrong – and the de facto response is to send an email. We’ve looked at sending emails from pipelines before, but at scale they can become noise and are easy to ignore. A more effective option is to surface alerts where collaboration already exists, such as Teams. […]

Categories
Azure Data Factory

Sending Emails from Data Factory Pipelines

Not all pipelines in Azure have native options for sending emails. The lucky Fabric folks have an Office 365 connection ready to rock. Data Factory and Synapse don’t have email capability built-in and need another option to send messages. So for everyone who wants more emails for their inbox rules to handle (delete), we’ll build and call […]

Categories
Azure Data Factory

Calling Logic Apps from Data Factory Pipelines

Last week we looked at calling a Data Factory Pipeline from a Logic App. This week I thought we’d balance it out by taking a look at calling a Logic App from an Azure Data Factory (ADF) Pipeline. When building the Logic App last week we had to create our own polling mechanism to check for […]

Categories
Logic Apps

Running Data Factory Pipelines in Logic Apps

When building Azure Logic Apps we can use the Azure Data Factory connector to start a pipeline. However that action simply triggers a pipeline and doesn’t wait for it to finish. If your downstream logic depends on the output – for example to collect a file – this can cause issues. In this post I’ll demonstrate how […]

Categories
Azure Data Factory

Debugging Failed Function Calls in Data Factory

I recently ran into an issue when trying to call a function from an ADF pipeline. The function returned a generic Internal Server Error with no details exposed. Here we’ll look at how to dig into the logs to identify the true cause of the failure. In this instance the function was performing PGP encryption […]