Data Engineer: Scalable Pipelines on Databricks

Auctane; Madrid; Presencial; EUR 43.000 - 52.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Private health insurance

26 days of holiday per year

Annual salary review

Up to €2000 training budget per year

Wellness program

Descripción de la vacante

Auctane is seeking a Data Engineer to design, build, and operate data pipelines and analytics for ShipStation Global. You will work with Databricks, Spark, and SQL to process large-scale data and enable data-driven decision making.

You will collaborate with product owners and stakeholders across teams to advance the data platform, promote engineering excellence, and ensure data quality and observability in a fast-paced environment in Madrid.

Formación

• A strong Data Engineering background in a lakehouse or data warehouse architecture.
• Experience developing and supporting robust, automated, and reliable data pipelines in Python and SQL.
• Mastered Python and SQL skills.

Responsabilidades

• Contribute to design, build, and operations of data pipelines and analytics using Databricks.
• Collaborate with stakeholders to implement ShipStation Global data strategy.
• Develop frameworks to acquire, process, monitor, and extract value from enterprise data.
• Contribute to design and architecture of ShipStation Global's data platform.
• Ensure data quality and observability, using Databricks Lakeflow and Spark.

Conocimientos

Python

SQL

Databricks

Spark

Airflow

dbt

Lakehouse

Data pipelines

Herramientas

Databricks Lakeflow

Terraform

Tableau

Looker

Power BI

Descripción del empleo

Auctane is seeking a Data Engineer to design, build, and operate data pipelines and analytics for ShipStation Global. You will work with Databricks, Spark, and SQL to process large-scale data and enable data-driven decision making.

You will collaborate with product owners and stakeholders across teams to advance the data platform, promote engineering excellence, and ensure data quality and observability in a fast-paced environment in Madrid.