Categories
SSIS

Solving Sort Transformation Blocking in SSIS

Last time out we discussed blocking transformations, what they are, the impact of them, and touched on how to deal with them. In this post we’re going a step further to tackle one of them head on. Here we’ll demonstrate the impact of blocking caused by the Sort transformation, and look at two options for solving […]

Categories
SSIS

Beware Blocking Transformations in SSIS Data Flows

We have a platter of transformations to use when constructing data flows in SSIS packages. Not all transformations are equal though, and some can catch us out with performance impact as data volumes scale. In this post we’ll look at blocking transformations which can trip us up if we’re not careful with them (or avoid […]

Categories
SSIS

Elevating SSIS Package Configuration with Environment Variables

Package configuration allows us to retrieve variable values from a variety of sources. We recently looked at storing the values in a SQL database. We can elevate the database configuration a step further by using system level Environment Variables. In this post we’ll walk through that process. Using environment variables Where we previously looked at storing […]

Categories
SSIS

Handling Optional Carriage Returns in Flat Files

When ingesting files in SSIS via Flat File Connections, a consistent format is key. Sometimes that isn’t the case. Here we’ll look at an example where the carriage return (CR, \r) may or may not be included in the file. The problem A file format can change as easy as tweaking the file in an editor […]