Senior Databricks Engineer — Spark, PySpark & Delta Lake

Talanto; Poland; Remote; PLN 120,000 - 180,000; Full time

Job summary

Talanto is seeking a skilled Databricks Developer to design, build, and maintain scalable data pipelines using Databricks, Spark, and PySpark. You will optimize performance for large datasets and ensure reliable processing with Delta Lake and Parquet.

Ideal candidates have 5+ years in software development, strong Python/PySpark skills, and experience with unit tests and Databricks Workflows. English (B2+) and Ukrainian language abilities are required.

Qualifications

• 5+ years of hands-on software development experience.
• Strong expertise in Apache Spark with Databricks delivery.
• Advanced Python with PySpark and Pandas experience.
• Experience developing and maintaining unit tests for Databricks workloads.
• Solid understanding of Parquet and Delta Lake / Delta Tables.
• Experience with large data volumes and performance tuning.
• Experience building data ingestion, transformation, and analytics pipelines.
• Experience with Databricks Workflows.
• Fluent English and Ukrainian language skills.

Responsibilities

• Design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks.
• Develop data processing solutions with Apache Spark and PySpark.
• Work with large-scale datasets, applying performance tuning techniques.
• Design and maintain Delta Lake / Delta Table solutions for reliability.
• Develop and maintain unit tests for Databricks workloads.
• Implement and manage Databricks Workflows for orchestration.
• Work with Parquet and optimize processing and storage.
• Collaborate with cross-functional teams to meet requirements.
• Apply data engineering best practices for maintainable, scalable solutions.

Skills

Spark expertise

Python

PySpark

Pandas

Unit tests

Performance tuning

Data ingestion/ETL

Analytics pipelines

English (B2+)

Ukrainian

Tools

Databricks

Delta Lake

Delta Tables

Parquet

Databricks Workflows

CI/CD for data workloads

Job description

Talanto is seeking a skilled Databricks Developer to design, build, and maintain scalable data pipelines using Databricks, Spark, and PySpark. You will optimize performance for large datasets and ensure reliable processing with Delta Lake and Parquet.

Ideal candidates have 5+ years in software development, strong Python/PySpark skills, and experience with unit tests and Databricks Workflows. English (B2+) and Ukrainian language abilities are required.