Tutorial DataHub 3 – Main concepts
In this post, we will talk about the main concepts of DataHub at a functional level and we will study the fundamental elements by taking a tour of the application. To be able to follow it, you can use the DataHub…
Tutorial DataHub 2 – QuickStart and Deployment
In the Tutorial DataHub I we analysed the architecture of this platform. In this post, we are going to see a guide on how to deploy DataHub and start working with this tool. DataHub can be deployed in two ways:…
Tutorial DataHub 1 – Architecture
We begin a collection of tutorials on the use and operation of DataHub, a Data Governance platform that we already mentioned in the post What is a Data Catalog and what does it consist of. In this series, we explore…
Introduction to Apache APISIX
The growing demand for applications and services has created a great need to more efficiently manage the APIs that communicate them. To meet this need, Apache APISIX is a high-performance, scalable, open source API management platform that acts as a…
Explainability of Machine Learning Models: SHAP Values
In the field of Machine Learning there are multiple models whose internal structure makes it non-trivial to understand the why behind the decisions it makes. This set of models are widely known as black box models and are usually very…
Record Linkage with Machine Learning
Imagine you are a data scientist working for a company that has decided to merge the databases of two of its departments into one. There is no common index between the two sources and the task is to ‘deduplicate’ the…
The most difficult challenges of optimal Dynamic Pricing
The main objective of revenue management teams is to implement a pricing policy that maximises revenue (or profit, if they have integrated cost information in their systems). However, identifying such a pricing policy is complicated by the many different factors…
What is and what does the Data Catalog consist of?
What is a Data Catalogue seems very intuitive and that anyone minimally initiated in this world would understand. But putting it into practice and implementing it is a bit more complicated. For those who are not familiar with this concept,…
CUDA Tutorial – Introduction to Blocks and Grids
In the first part of the CUDA Tutorial, we mentioned the GPU’s smallest unit of execution, warps, the equivalent of a kernel on a CPU. However, warps alone cannot harness the full power of the GPU; you need to make…
Apache Spark Structured Streaming: Practical examples
In a previous article, we gave a theoretical introduction to Spark Structured Streaming where we analysed in depth the high-level API that Spark provides for processing massive real-time data streams (Structured Streaming). There, we looked at the essential theoretical concepts…