Tutorial DataHub 4 – API
In this new part of the DataHub tutorial saga, we are going to work on the connectivity with the platform through the API. As data engineers, the goal is to incorporate DataHub as a Data Governance tool in our ecosystem.…
Sensitive data management in BigQuery
Among all the tools we can access in Google Cloud, one of the most powerful and widely used is undoubtedly BigQuery. Its versatility as a DWH (Data Warehouse) has positioned it as one of the main cloud solutions for data…
Trigger rules in Apache Airflow
Airflow is an open source framework for developing, orchestrating and monitoring batch workflows. In case you are not familiar with it, and to better understand the content of this article, it is recommended to review the basics of Apache Airflow…
What’s new in Apache Spark 4.0
The arrival of Apache Spark 4.0 is a long time coming, but to encourage the community, the famous foundation has released a preview access of the version. A few months ago, the Databricks developers gave us a small preview of…
Dynamic Pricing: Avoiding inefficient implementations
The Revenue Management (RM) departments of companies have the objective of maximising revenue (ideally it should be profit, but this is something we will talk about in another article) through optimal pricing management. There are many considerations that these teams…
Team building: Training and team work
At Damavis we continue to add moments and experiences together through team building activities and events. With the aim of promoting the integration of all members, we organise these actions that allow us to get to know our colleagues better…
Process Discovery: Methods and practical example
Process Discovery is a family of techniques used to obtain information from event logs and reconstruct the underlying model they have generated. This model can then be used for different tasks such as identifying bottlenecks, monitoring deviations from an ideal…
What are generics in Golang?
Go or Golang is an object-oriented programming language, published by Google in 2009. It is characterized by being compiled, its concurrency support, goroutine and channel based and, precisely the latter, makes it a popular choice when creating distributed systems. First…
Tutorial DataHub 3 – Main concepts
In this post, we will talk about the main concepts of DataHub at a functional level and we will study the fundamental elements by taking a tour of the application. To be able to follow it, you can use the DataHub…
Tutorial DataHub 2 – QuickStart and Deployment
In the Tutorial DataHub I we analysed the architecture of this platform. In this post, we are going to see a guide on how to deploy DataHub and start working with this tool. DataHub can be deployed in two ways:…