Senior Databricks Data Engineer

Internetwork Expert; Nashville (TN); On-site; USD 120,000 - 180,000; Full time

Job summary

Trinetix is seeking a skilled Databricks Developer to design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks and Apache Spark. The role focuses on performance tuning and reliable data processing for large-scale datasets.

Strong Python (PySpark, Pandas) and data engineering expertise are required, with experience in Delta Lake and Delta Tables, unit testing, and Databricks Workflows. English and Ukrainian language skills are valued.

Qualifications

• 5+ years of hands-on software development experience.
• Strong expertise in Apache Spark, including hands-on experience delivering solutions on Databricks.
• Advanced Python and data engineering skills, including strong experience with PySpark, Pandas, and related libraries.
• Experience developing and maintaining unit tests for Databricks workloads.
• Solid understanding of columnar storage formats, such such as Parquet.
• Hands‑on experience with Delta Lake and Delta Tables.
• Proven experience working with small to large data volumes, including performance tuning and optimization.
• Experience building data ingestion, transformation, and analytics pipelines.
• Hands‑on experience with Databricks Workflows.
• Strong analytical and problem-solving skills with close attention to detail.
• Conversational English — B2 level or higher
• Conversational Ukrainian

Responsibilities

• Design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks.
• Develop data processing solutions using Apache Spark and PySpark.
• Work with large-scale datasets and implement performance tuning and optimization strategies.
• Design and maintain Delta Lake / Delta Table solutions to support reliable and scalable data processing.
• Develop and maintain unit tests to ensure the quality and reliability of Databricks workloads.
• Implement and manage Databricks Workflows for data processing and pipeline orchestration.
• Work with columnar storage formats such as Parquet and optimize data processing and storage solutions.
• Analyze business and technical requirements and translate them into effective data engineering solutions.
• Collaborate with cross-functional teams to ensure data pipelines and solutions meet technical and business requirements.
• Apply data engineering and software development best practices to deliver maintainable, scalable, and reliable solutions.

Skills

Apache Spark

PySpark

Python

Databricks

Delta Lake

Delta Tables

Pandas

Unit tests

Databricks Workflows

Parquet

Performance tuning

Data ingestion

Data transformation

Tools

Databricks

Delta Lake

Job description

Trinetix is seeking a skilled Databricks Developer to design, develop, and maintain scalable data ingestion, transformation, and analytics pipelines using Databricks and Apache Spark. The role focuses on performance tuning and reliable data processing for large-scale datasets.

Strong Python (PySpark, Pandas) and data engineering expertise are required, with experience in Delta Lake and Delta Tables, unit testing, and Databricks Workflows. English and Ukrainian language skills are valued.