Azure Databricks Engineer: Pipelines, Governance & CI/CD

Robotic Process Automation LLC

Cincinnati (OH)

On-site

USD 94,000 - 103,000

Full time

26 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robotic Technologies Automation in Cincinnati is seeking a data engineering professional to design and implement scalable data pipelines on Azure Databricks. You will govern data, ensure security, and collaborate using GitHub actions and CI/CD.

Requirements include strong Python/PySpark skills and experience with cloud data platforms; familiarity with AI-assisted tools like Copilot is a plus. This is a contract role with evolving extensions and a 10-month baseline.

Qualifications

  • Strong hands-on experience with Azure Databricks.
  • Experience managing data governance and Unity Catalog access control.
  • Strong proficiency in Python and PySpark for distributed data processing.
  • Experience designing, developing, and optimizing scalable data pipelines.
  • Good understanding of data architecture, data lineage, and metadata management.
  • Experience with GitHub, branching strategies, pull requests, and code reviews.
  • Hands-on experience with GitHub Actions and CI/CD pipeline implementation.
  • Familiarity with DevOps practices for data engineering deployments.
  • Understanding of data security and governance best practices.
  • Experience working with modern cloud-based data platforms.
  • Familiarity with AI-assisted development tools such as GitHub Copilot and Databricks Assistant.
  • Strong problem-solving, debugging, and performance optimization skills.

Responsibilities

  • Work with Azure Databricks to build scalable data pipelines.
  • Manage data governance and Unity Catalog access controls.
  • Develop Python and PySpark code for distributed processing.
  • Design and optimize data pipelines and architectures.
  • Implement CI/CD with GitHub Actions for deployments.
  • Collaborate using GitHub with PRs and code reviews.
  • Apply DevOps practices to data engineering projects.
  • Ensure data security and governance best practices.
  • Work with modern cloud-based data platforms.
  • Leverage AI-assisted tools like GitHub Copilot.

Skills

Python
PySpark
Azure Databricks
Data governance
CI/CD
GitHub
Data pipelines
Cloud platforms
Debugging
Performance optimization

Tools

GitHub Actions
Databricks
Azure

Job description

Robotic Technologies Automation in Cincinnati is seeking a data engineering professional to design and implement scalable data pipelines on Azure Databricks. You will govern data, ensure security, and collaborate using GitHub actions and CI/CD.

Requirements include strong Python/PySpark skills and experience with cloud data platforms; familiarity with AI-assisted tools like Copilot is a plus. This is a contract role with evolving extensions and a 10-month baseline.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Engineer - Data Pipelines & Unity Catalog
Azure Databricks Engineer - Data Pipelines & Unity Catalog

Robotic Process Automation LLC • Cincinnati (OH)

On-site
USD 120,000 - 180,000
Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

MACHINE LEARNING TECHNOLOGIES LLC • Cincinnati (OH)

On-site
USD 78,000 - 112,000
Lead Azure Databricks Engineer – Data Pipelines & Governance
Lead Azure Databricks Engineer – Data Pipelines & Governance

Robotics Technologies • Cincinnati (OH)

On-site
USD 91,000 - 124,000
Azure Data Engineer Lead: Pipelines, Databricks & Delta Lake
Azure Data Engineer Lead: Pipelines, Databricks & Delta Lake

Robotic Process Automation LLC • Houston (TX)

On-site
USD 120,000 - 170,000
Senior Azure Databricks Data Engineer: Scalable Pipelines
Senior Azure Databricks Data Engineer: Scalable Pipelines

Robotic Technologies Automation • Houston (TX)

On-site
USD 120,000 - 180,000
Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

Quantum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000
Azure Databricks Data Engineer - Lakehouse & Pipelines
Azure Databricks Data Engineer - Lakehouse & Pipelines

Robotic Process Automation LLC • Dallas (TX)

On-site
USD 120,000 - 160,000
Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 90,000 - 110,000
Azure Databricks Engineer - Data Pipelines & Governance
Azure Databricks Engineer - Data Pipelines & Governance

Ethereum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000
Azure Databricks Engineer: Governance, PySpark & Pipelines
Azure Databricks Engineer: Governance, PySpark & Pipelines

Quantum Technologies LLC • Cincinnati (OH)

On-site
USD 110,000 - 165,000