Bernd Wessely

Here’s how your data retains its business relevance as it travels through your enterprise Bernd Wessely · Follow Published in Towards Data Science · 13 min read · 2 days ago — A giant task for data and application engineer ing— Image created by DALL-E I have previously written about the need to redefine the current data engineering discipline. I looked at it primarily from an organizational perspective and described what a data engineer should

Why tailored, decentralized data quality trumps the medallion architecture Bernd Wessely · Follow Published in Towards Data Science · 8 min read · 6 hours ago — DALL-E generated I’ve seen too many articles praising the medallion architecture as the go-to solution for enterprise data quality. At first sight, the structured, three-layered approach sounds like a no-brainer — organize your data into neat bronze, silver, and gold layers, and you have established a perfect data

How recognizing cross-discipline commonalities not only enhances recruitment strategies but also supports adaptable IT architectures. Bernd Wessely · Follow Published in Towards Data Science · 7 min read · 15 hours ago — DALL-E generated I’ve noticed an ongoing trend toward over-specialization in IT departments. However, one of my key lessons learned over the years is the negative impact of this siloed specialization. While it’s primarily an organizational issue, the trend towards the mindless embrace

What is the difference and how should we treat data in the enterprise? Bernd Wessely · Follow Published in Towards Data Science · 7 min read · 7 hours ago — Unfortunately, we still have a big confusion about what exactly operational and analytical data is. As a result, we are still struggling to find the right approach to handling data from an overarching enterprise perspective. What has been identified as the ‘great divide of

Three important lessons I have learned on my journey as data engineer and architect Bernd Wessely · Follow Published in Towards Data Science · 10 min read · 2 hours ago — Photo by Michael SKOPAL on Unsplash It’s only been a few months since I once again had to experience what I sometimes refer to as the “self-satisfaction of IT.” That may sound a bit harsh, but unfortunately I experience this time and again.

Exploiting the full potential of universal data supply Bernd Wessely · Follow Published in Towards Data Science · 8 min read · 10 hours ago — Photo by NASA on Unsplash There is a lot of talk about the value of data being the new gold. Many companies are therefore pouring large sums of money into becoming data-driven. It is sold as a completely new way of doing business, almost as if business has never

Why articles about ‘Building a Data Platform’ are mostly misleading Bernd Wessely · Follow Published in Towards Data Science · 13 min read · 15 hours ago — Photo by Patrick Tomasso on Unsplash You might think there’s no value in reading about what not to build. But the proliferation of data and analytical platform tools, the fact that the Modern Data Stack (MDS) is losing traction, and the many articles about ‘building a data

Lessons from 30+ years in data engineering: The overlooked value of keeping it simple Bernd Wessely · Follow Published in Towards Data Science · 8 min read · 12 hours ago — Image by author We have a straightforward and fundamental principle in computer programming: the separation of concerns between logic and data. Yet, when I look at the current data engineering landscape, it’s clear that we’ve strayed from this principle, complicating our efforts significantly

How to address the shortcomings of shallow, outdated models and future-proof your modeling strategy Bernd Wessely · Follow Published in Towards Data Science · 11 min read · 10 hours ago — Photo by Justin Chrn on Unsplash I have been involved in modeling data for over 30 years, creating a variety of data models (3NF, dimensional, ensemble (anchor, data-vault), graphs, etc.) mainly for analytical systems. However, many of these have also gradually become outdated

How data engineering is practiced today and why we should redefine it Bernd Wessely · Follow Published in Towards Data Science · 7 min read · 1 day ago — What is the Problem with Data Engineering Today? If you search for a clear definition of what data engineering actually is, you’ll get so many different proposals that it leaves you with more questions than answers. But as I want to explain what needs to