Senior Azure Databricks Data Engineer

Golden Technology; Cincinnati (OH); On-site; USD 100,000 - 130,000; Full time

Job summary

A local contractor company is seeking an experienced Senior Databricks Engineer in Cincinnati, Ohio. This role requires deep hands-on expertise in designing and implementing large-scale data solutions on Azure Databricks, managing Delta Lake architecture, and optimizing performance. Responsibilities include developing data pipelines, implementing CI/CD practices, and troubleshooting production issues. Candidates should have 5+ years of relevant experience with strong skills in PySpark and Delta Lake.

Qualifications

• 5+ years of experience as a Data Engineer with Azure Databricks and PySpark.
• Solid understanding of Delta Lake, including Z-ordering and partitioning.

Responsibilities

• Design, develop, and maintain data pipelines in Azure Databricks using PySpark.
• Implement data integration frameworks and API-based ingestion.
• Analyze, design, and deliver enterprise data architecture solutions.
• Implement automation tools and CI/CD pipelines.
• Troubleshoot production failures and performance bottlenecks.
• Manage Unity Catalog and enforce data security.
• Administer Databricks clusters, optimizing costs.
• Collaborate with cross-functional teams on data strategy.
• Create and maintain architectural diagrams and documentation.
• Mentor junior engineers on Databricks and Azure data best practices.

Skills

Azure Databricks

PySpark

Data pipeline development

Delta Lake

CI/CD automation

Tools

Jenkins

Ansible

Terraform

Apigee

Kong

Job description

A local contractor company is seeking an experienced Senior Databricks Engineer in Cincinnati, Ohio. This role requires deep hands-on expertise in designing and implementing large-scale data solutions on Azure Databricks, managing Delta Lake architecture, and optimizing performance. Responsibilities include developing data pipelines, implementing CI/CD practices, and troubleshooting production issues. Candidates should have 5+ years of relevant experience with strong skills in PySpark and Delta Lake.