Reading Time: 4 minutes Software systems designers often structure their thinking around the underlying functional and data/information components of their desired applications. This approach—analogous to the scientific method of breaking a system into its smallest sub-parts in order to understand how it works—forms the…
Reading Time: 2 minutes The world is becoming more and more digital, isn’t it? But do you wonder what the future of data strategy looks like? Data exploration and analysis can bring enormous value to a business. End consumers and institutions can both benefit…
Reading Time: 3 minutes The pandemic has forever changed the way we live and do business. Practically overnight, organizations have been forced to adapt by modernizing their data architecture to support new types of analysis and new ways to connect to data. To gain…
Reading Time: 3 minutes The market for data lakes has recently seen an impressive wave of new-generation engines that provide highly efficient processing of very large data volumes stored in distributed file systems, like S3, ADLS and others. With low cost of storage in…
Reading Time: 5 minutes In my previous post, I described the data fabric architectural pattern. Before turning to the data lakehouse, let’s first look at what I mean by an architectural pattern. The Power of a Pattern An architectural pattern, or logical architecture, describes…
Reading Time: 7 minutes In the last few years, data virtualization technology has experienced tremendous growth, emerging as a key component for enabling modern data architectures such as the logical data warehouse, data fabric, and data mesh. Gartner recently named it “a must-have data…
Reading Time: 5 minutes Consider a business scenario in which a user wants to determine the sales per month at a product level, and the filter conditions vary for different cases and across different users (So it would require multiple ad hoc queries). If…
Reading Time: 2 minutes Agile processes and automation are on the rise, causing companies to increasingly seek data virtualization solutions, which offer several important benefits: First, maintenance is cheaper compared to traditional tools, and data virtualization, which does not rely on data replication, eliminates…
Reading Time: 4 minutes Since its first incarnation almost 35 years ago in my IBM Systems Journal article, the data warehouse (DW) has remained a key architectural pattern for decision-making support. By decision-making support, I mean everything from simple reporting and querying to AI-based…
Reading Time: 2 minutes Public and private organizations around the world are opening doors to their data, and to data geeks like me, this is a very good thing. Data that was once locked within inaccessible corporate databases, flat files. or perhaps even spreadsheets…
