Categories
Azure Data Factory

Debugging Failed Function Calls in Data Factory

I recently ran into an issue when trying to call a function from an ADF pipeline. The function returned a generic Internal Server Error with no details exposed. Here we’ll look at how to dig into the logs to identify the true cause of the failure. In this instance the function was performing PGP encryption […]

Categories
Azure

Retaining Job History in Managed Instances

In a Managed Instance, the SQL Agent job history is fixed at 1000 records or 100 records per job. This isn’t configurable like a regular SQL Server install. So how can we maintain a history of these if we want to retain those records? There are 3 approaches which could be worth considering. Two of […]

Categories
SSIS

Securing SSIS Configuration with Sensitive Parameters

Configuring SSIS projects or packages can necessitate parametering information which may include sensitive values such as authentication details. Parameters are stored as plain text in the database by default. We’ll demonstrate how to protect these values using Sensitive parameters. The problem With a SSIS project deployed, our parameters are stored in plain text in the […]

Categories
SSIS

Configuring SSIS with Environment Variables

Yep it’s more SSIS again this week. Here we’ll be looking at using Environment configuration within the SSIS catalog. This allows sets of parameters to be defined and used across multiple projects and packages which share common values. This approach can either be used as a central point for configuration, or you could use multiple […]