Senior Databricks Data Engineer – Spark & Delta Lake

Trinetix; Portugal; Presencial; EUR 55 000 - 75 000; Tempo integral

Resumo da oferta

Trinetix is seeking a skilled Databricks Developer to design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks, Spark, and Python. You will work on large-scale datasets, optimize performance, and ensure reliable data processing across the stack.

The ideal candidate has 5+ years in software development, strong PySpark and Pandas experience, Delta Lake familiarity, and a practical approach to testing, DevOps, and CI/CD for data workloads.

Qualificações

• 5+ years of hands-on software development experience.
• Strong expertise in Apache Spark and Databricks.
• Advanced Python with PySpark and Pandas.
• Experience with Delta Lake/Delta Tables and Parquet.
• Experience building data ingestion, transformation, and analytics pipelines.
• Experience with Databricks Workflows and unit testing for Databricks workloads.
• English (B2) and Ukrainian language skills.

Responsabilidades

• Design, develop, and maintain scalable data pipelines using Databricks.
• Develop data processing solutions with Spark and PySpark.
• Work with large-scale datasets and implement performance tuning.
• Design and maintain Delta Lake / Delta Table solutions.
• Develop and maintain unit tests for Databricks workloads.
• Implement and manage Databricks Workflows for data processing.
• Work with Parquet and optimize data processing and storage.
• Translate business requirements into data engineering solutions.
• Collaborate with cross-functional teams to meet requirements.
• Apply best practices to deliver maintainable, scalable data solutions.

Conhecimentos

Databricks

Apache Spark

Python

PySpark

Pandas

Delta Lake

Delta Tables

Parquet

Large-scale data processing

English (B2)

Ukrainian

Ferramentas

Databricks Workflows

CI/CD pipelines

Descrição da oferta de emprego

Trinetix is seeking a skilled Databricks Developer to design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks, Spark, and Python. You will work on large-scale datasets, optimize performance, and ensure reliable data processing across the stack.

The ideal candidate has 5+ years in software development, strong PySpark and Pandas experience, Delta Lake familiarity, and a practical approach to testing, DevOps, and CI/CD for data workloads.