Senior Data Engineer - PySpark, Databricks & Spark

Improving; México; Presencial; MXN 600.000 - 900.000; Jornada completa

Descripción de la vacante

Improving is seeking a seasoned Data & Analytics Engineer to build data ingestion, transformation, and analytics pipelines using Spark on Databricks. You will deliver Spark-based solutions and design Databricks workflows.

The role requires 5+ years of hands-on software development, Python with PySpark and Pandas, and a solid understanding of Parquet and Delta Lake. You will work across teams to optimize data processing and contribute to testing and reliability.

Formación

• 5+ years hands-on software development experience.

Responsabilidades

• Build data ingestion, transformation, and analytics pipelines.
• Deliver Spark-based solutions on Databricks.
• Design and manage Databricks workflows.
• Develop and maintain unit tests for Databricks workloads.
• Handle small to large data volumes, including performance tuning and optimizations.

Conocimientos

Apache Spark

Python / PySpark

Pandas

Delta Lake

Parquet

Data pipelines

Herramientas

Databricks

Delta Lake

Parquet

Descripción del empleo

Improving is seeking a seasoned Data & Analytics Engineer to build data ingestion, transformation, and analytics pipelines using Spark on Databricks. You will deliver Spark-based solutions and design Databricks workflows.

The role requires 5+ years of hands-on software development, Python with PySpark and Pandas, and a solid understanding of Parquet and Delta Lake. You will work across teams to optimize data processing and contribute to testing and reliability.