Tag etl

Data Engineering, Software

Apache Hop plugin for Apache Airflow

Introducción Since our Pentaho PDI plugin for Apache Airflow release, we have seen an industry shift towards the usage of Apache Hop for data processing. What is Apache Hop? Apache Hop started (late 2019) as a fork of Kettle PDI,…

Pere Alzamora
2022-09-30

Data Engineering

Apache Kafka + Apache Spark: Leveraging Streaming technologies for Batch Processing

ETL process. Central piece of the Big Data project Collecting, ingesting, integrating, processing, storing and analyzing large volumes of information are the fundamental activities of a Big Data project. It is the union of these tasks that provides a solid…

Antonio Boutaour
2021-12-16

Data Engineering

Deploying Airflow: CeleryExecutor on Kubernetes

How to deploy the Apache Airflow process orchestrator on Kubernetes

Antonio Boutaour
2021-02-17