Databricks Engineer: Spark, Delta Lake & Pipelines

Trinetix; Portugal; Presencial; EUR 70 000 - 90 000; Tempo integral

Resumo da oferta

Trinetix is seeking a skilled Databricks Developer with strong expertise in Apache Spark, Python, and modern data engineering practices to design, develop, and maintain scalable data pipelines. This role focuses on building ingestion, transformation, and analytics pipelines using Databricks and related technologies.

The ideal candidate will bring extensive experience with PySpark, Pandas, Delta Lake, and Delta Tables, along with hands-on work in performance tuning and data quality.

Qualificações

• 5+ years of hands-on software development experience.
• Strong expertise in Apache Spark, including hands-on experience delivering solutions on Databricks.
• Advanced Python and data engineering skills, including strong experience with PySpark, Pandas, and related libraries.
• Experience developing and maintaining unit tests for Databricks workloads.
• Solid understanding of columnar storage formats, such as Parquet.
• Hands-on experience with Delta Lake and Delta Tables.
• Proven experience working with small to large data volumes, including performance tuning and optimization.
• Experience building data ingestion, transformation, and analytics pipelines.
• Hands-on experience with Databricks Workflows.
• Strong analytical and problem-solving skills with close attention to detail.
• Conversational English — B2 level or higher
• Conversational Ukrainian

Responsabilidades

• Design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks
• Develop data processing solutions using Apache Spark and PySpark
• Work with large-scale datasets and implement performance tuning and optimization strategies
• Design and maintain Delta Lake / Delta Table solutions to support reliable and scalable data processing
• Develop and maintain unit tests to ensure the quality and reliability of Databricks workloads
• Implement and manage Databricks Workflows for data processing and pipeline orchestration
• Work with columnar storage formats such as Parquet and optimize data processing and storage solutions
• Analyze business and technical requirements and translate them into effective data engineering solutions
• Collaborate with cross-functional teams to ensure data pipelines and solutions meet technical and business requirements
• Apply data engineering and software development best practices to deliver maintainable, scalable, and reliable solutions

Conhecimentos

5+ years experience

Apache Spark

Python

Databricks

unit tests

Parquet

Delta Lake

Delta Tables

performance tuning

data pipelines

Databricks Workflows

English (B2)

Ukrainian

Ferramentas

Databricks

Apache Spark

PySpark

Pandas

Delta Lake

Delta Tables

Descrição da oferta de emprego

Trinetix is seeking a skilled Databricks Developer with strong expertise in Apache Spark, Python, and modern data engineering practices to design, develop, and maintain scalable data pipelines. This role focuses on building ingestion, transformation, and analytics pipelines using Databricks and related technologies.

The ideal candidate will bring extensive experience with PySpark, Pandas, Delta Lake, and Delta Tables, along with hands-on work in performance tuning and data quality.