Senior Databricks Engineer - Spark & Delta Lake Expert

OpenTalent; Poland; On-site; PLN 180,000 - 320,000; Full time

Job summary

Trinetix is seeking a skilled Databricks Developer with strong expertise in Apache Spark, Python, and modern data engineering practices. Design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks and related technologies.

The ideal candidate is analytical, detail-oriented, and experienced in working with large-scale data, performance optimization, and reliable data processing solutions.

Qualifications

• 5+ years of hands-on software development experience.
• Strong expertise in Apache Spark and Databricks.
• Advanced Python and data engineering skills with PySpark and Pandas.
• Experience writing unit tests for Databricks workloads.
• Experience with Delta Lake and Delta Tables.
• Proven experience with large data volumes, performance tuning.
• Experience building data ingestion, transformation, and analytics pipelines.
• Hands-on experience with Databricks Workflows.
• Conversational English — B2 level or higher.
• Conversational Ukrainian

Responsibilities

• Design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks.
• Develop data processing solutions using Apache Spark and PySpark.
• Work with large-scale datasets and implement performance tuning and optimization strategies.
• Design and maintain Delta Lake / Delta Table solutions to support reliable and scalable data processing.
• Develop and maintain unit tests to ensure the quality and reliability of Databricks workloads.
• Implement and manage Databricks Workflows for data processing and pipeline orchestration.
• Work with columnar storage formats such as Parquet and optimize data processing and storage solutions.
• Analyze business and technical requirements and translate them into effective data engineering solutions.
• Collaborate with cross-functional teams to ensure data pipelines and solutions meet technical and business requirements.

Skills

Python

PySpark

Apache Spark

Data engineering

Unit testing

Performance tuning

Large-scale data processing

Analytical thinking

English (B2+)

Ukrainian

Tools

Databricks

Delta Lake

Delta Tables

Parquet

CI/CD for data

Databricks Workflows

Job description

Trinetix is seeking a skilled Databricks Developer with strong expertise in Apache Spark, Python, and modern data engineering practices. Design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks and related technologies.

The ideal candidate is analytical, detail-oriented, and experienced in working with large-scale data, performance optimization, and reliable data processing solutions.