Category Software

Testing in Apache Airflow

Testing in Apache Airflow

Today we are going to talk about two ways of testing in Apache Airflow. Historically, testing in Airflow has been something that has been a headache for all users of the famous framework. The coupling of the code with the…

Apache Airflow with LocalStack

Apache Airflow with LocalStack

Usually, when we start working on a new integration where it is necessary to connect to AWS services in the early stages of development, it is easier and faster to work only locally. For this, we can make use of…

Introduction to Pycharm Templates

Introduction to Pycharm Templates

PyCharm is an IDE developed by JetBrains for Python. As an IDE, its goal is to provide the programmer with a set of features that make code development in this language more efficient. For example, it automatically writes import lines…

Overloading functions in Python

Function overloading is a very interesting tool that allows several different functions to share the same identifier, improving the readability and interpretability of our code in some scenarios. This tool is available by default in many of today’s most widely…

Apache Airflow sensors in detail

Apache Airflow sensors in detail

Apache Airflow is an open source tool for workflow orchestration widely used in the field of data engineering. You can take a look at this other blog post where we made an introduction to Basics on Apache Airflow.  In this…

Improving our code with pre-commit

Introduction When reviewing code, we often spend time going over small bugs or stylistic details that distract us from what’s really important. In this post we will introduce pre-commit, a tool that attacks this problem by automatically correcting our code.…