Sudoku Solving Algorithm
This post will deal from another point of view with one of the most popular games that can be played on paper, the Sudoku. The objective will be to explain an algorithm for solving it, together with the code that…
DBT Models, Snapshots and Materializations
In other discussion spaces we elaborated a comparison between DBT, Pentaho and Spark to perform data transformations. In this post, we will look at some of the key concepts of DBT: models, snapshots and materializations. In the context of DBT…
Introduction to Fuzzy Linear Programming
In two previous posts we introduced the basic concepts of Fuzzy Logic and linear programming with the Simplex method. As promised, in this post we are going to join these two concepts and introduce fuzzy linear programming. In many real-world…
Cost optimization best practices in BigQuery
BigQuery has become in recent years a powerful tool for data storage and analysis in the cloud. Its size, scalability and all the features it offers would be difficult for a user or company to replicate from scratch due to…
Price elasticity of demand
Modeling and explaining the consumer behavior of a product is very important to know what factors affect their behavior, price being one of these important factors. Let’s take as an example a company X that sells clothing. It is a…
Introduction to software testing
Software tests are tests that are performed on a piece of code or an entire software to validate that the behavior of the software is as expected. The main purpose of testing is to detect errors in the code in…
Linear regression with elastic net: implementations in Python
A linear regression is a model that is used to approximate the linear relationship between a dependent variable Y and a set of independent variables X. In matrix format it can be expressed as where ε is a vector of…
Differences between DBT, Pentaho and Spark for transforming data
We know that there is a large number of products in the data engineering ecosystem to perform the data processing of a company and that most of them provide the necessary tools to be able to perform many types of…
Text Embeddings: The basis of modern NLP
Introduction All graphics in this article are interactive due to the nature of trying to represent text graphically. To see which sentence each point represents, simply hover the mouse over it. The results obtained have been generated on the “STS…
DBT integration with Apache Spark
In this post we are going to talk about how DBT integrates with Spark and how this integration can be useful for us. DBT is a framework that facilitates the design of data modeling throughout the different data modeling cycles.…