Medallion architecture is the go-to for handling analytical data, particularly with the prominence of lakehouses in Databricks and Fabric. Whilst the layers are well defined, their definitions don’t tell you where particular tasks belong. So here I wanted to present my view from a more practical perspective of what goes into each layer. Layering Let’s start by […]
Fragmented data estates usually share a trait – there’s no consistent representation of core business entities. It’s a common thread I’ve seen – system-centric entities and attributes, then another solution which recreates these in its own unique way. Different systems talking different languages make integrations messy and bespoke. It’s a technical mess, and it doesn’t […]
This month the invitation from Koen asks what would happen if we came back from the cloud. Back to On-Prem. Cloud solutions have sliders which magically reduce downtime, performance issues, and account credit. When you build it, infrastructure and platforms are your challenge, and you get one shot to right-size it. Capacity, resilience, capabilities. They’re your challenges to solve. […]
Deadlocks are an enduring feature of SQL Server. They’ve been a source of pain for many over the years and there are various ways to diagnose, mitigate or resolve them. Here I want to demonstrate approach I haven’t seen discussed – using an application lock to segregate processes. An example where I’ve used this effectively […]
