Databricks Data Engineer: Spark, PySpark & Delta Lake

Trinetix; España; On-site; PHP 5,643,000 - 8,150,000; Full time

Job summary

Trinetix is seeking a skilled Databricks Developer with strong expertise in Apache Spark, Python, and modern data engineering practices. You will design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks and related technologies.

The role focuses on building data processing solutions, implementing Delta Lake tables, and ensuring high-quality Databricks workloads through unit testing and workflows.

Qualifications

• 5+ years of hands-on software development experience
• Strong expertise in Apache Spark, including hands-on experience delivering solutions on Databricks
• Advanced Python and data engineering skills with PySpark and Pandas
• Experience developing and maintaining unit tests for Databricks workloads
• Solid understanding of Parquet and columnar storage formats
• Hands-on experience with Delta Lake and Delta Tables
• Experience with large-scale data volumes, performance tuning
• Experience building data ingestion, transformation, and analytics pipelines
• Hands-on experience with Databricks Workflows
• Strong analytical and problem-solving skills with attention to detail
• Conversational English — B2 level or higher
• Conversational Ukrainian

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks
• Develop data processing solutions with Apache Spark and PySpark
• Work with large-scale datasets and implement performance tuning
• Design and maintain Delta Lake / Delta Table solutions
• Develop and maintain unit tests for Databricks workloads
• Implement and manage Databricks Workflows for data processing
• Work with Parquet and optimize data processing and storage
• Analyze requirements and translate into data engineering solutions
• Collaborate with cross-functional teams to meet requirements
• Apply data engineering and software development best practices to deliver reliable solutions

Skills

Apache Spark

Python

Databricks

PySpark

Pandas

Unit testing

Parquet

Delta Lake

Delta Tables

Databricks Workflows

Troubleshooting

Education

Tools

Databricks

Delta Lake

Delta Tables

Parquet

CI/CD for data engineering

Job description

Trinetix is seeking a skilled Databricks Developer with strong expertise in Apache Spark, Python, and modern data engineering practices. You will design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks and related technologies.

The role focuses on building data processing solutions, implementing Delta Lake tables, and ensuring high-quality Databricks workloads through unit testing and workflows.