Lead Azure Databricks Engineer

Robotic Process Automation LLC

Cincinnati (OH)

On-site

USD 94,000 - 103,000

Full time

26 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Robotic Technologies Automation in Cincinnati is seeking a data engineering professional to design and implement scalable data pipelines on Azure Databricks. You will govern data, ensure security, and collaborate using GitHub actions and CI/CD.

Requirements include strong Python/PySpark skills and experience with cloud data platforms; familiarity with AI-assisted tools like Copilot is a plus. This is a contract role with evolving extensions and a 10-month baseline.

Qualifications

  • Strong hands-on experience with Azure Databricks.
  • Experience managing data governance and Unity Catalog access control.
  • Strong proficiency in Python and PySpark for distributed data processing.
  • Experience designing, developing, and optimizing scalable data pipelines.
  • Good understanding of data architecture, data lineage, and metadata management.
  • Experience with GitHub, branching strategies, pull requests, and code reviews.
  • Hands-on experience with GitHub Actions and CI/CD pipeline implementation.
  • Familiarity with DevOps practices for data engineering deployments.
  • Understanding of data security and governance best practices.
  • Experience working with modern cloud-based data platforms.
  • Familiarity with AI-assisted development tools such as GitHub Copilot and Databricks Assistant.
  • Strong problem-solving, debugging, and performance optimization skills.

Responsibilities

  • Work with Azure Databricks to build scalable data pipelines.
  • Manage data governance and Unity Catalog access controls.
  • Develop Python and PySpark code for distributed processing.
  • Design and optimize data pipelines and architectures.
  • Implement CI/CD with GitHub Actions for deployments.
  • Collaborate using GitHub with PRs and code reviews.
  • Apply DevOps practices to data engineering projects.
  • Ensure data security and governance best practices.
  • Work with modern cloud-based data platforms.
  • Leverage AI-assisted tools like GitHub Copilot.

Skills

Python
PySpark
Azure Databricks
Data governance
CI/CD
GitHub
Data pipelines
Cloud platforms
Debugging
Performance optimization

Tools

GitHub Actions
Databricks
Azure

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Duration: 10 Months + Extension

Bill Rate: $71/hour (C2C)

Job Type: W-2, 1099, C2C

Client: To Be Discussed Later

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:
  • Strong hands-on experience with Azure Databricks
  • Experience managing data governance and access control using Unity Catalog
  • Strong proficiency in Python and PySpark for distributed data processing
  • Experience designing, developing, and optimizing scalable data pipelines
  • Good understanding of data architecture, data lineage, and metadata management
  • Experience with GitHub, including branching strategies, pull requests, and code reviews
  • Hands-on experience with GitHub Actions and CI/CD pipeline implementation
  • Familiarity with DevOps practices for data engineering deployments
  • Understanding of data security and governance best practices
  • Experience working with modern cloud-based data platforms
  • Familiarity with AI-assisted development tools such as GitHub Copilot and Databricks Assistant
  • Strong problem-solving, debugging, and performance optimization skills
Preferred Skills
  • Databricks and/or Azure certifications
  • Experience with cloud platform Azure
  • Knowledge of modern data stack tools and frameworks
  • Excellent communication and documentation skills

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Azure Databricks Engineer
Lead Azure Databricks Engineer

Ethereum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000
Lead Azure Databricks Engineer
Lead Azure Databricks Engineer

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 90,000 - 110,000
Lead Azure Databricks Engineer
Lead Azure Databricks Engineer

Quantum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000
Lead Azure Databricks Engineer
Lead Azure Databricks Engineer

Robotics Technologies • Cincinnati (OH)

On-site
USD 91,000 - 124,000
Azure Databricks Engineer
Azure Databricks Engineer

Robotic Process Automation LLC • Charlotte (NC)

Remote
USD 96,000 - 138,000
Azure Databricks Engineer
Azure Databricks Engineer

Ethereum Technologies LLC • Charlotte (NC)

Remote
USD 95,000 - 136,000
Azure Databricks Engineer
Azure Databricks Engineer

Valiant Technologies LLC • Charlotte (NC)

Remote
USD 95,000 - 136,000
Azure Databricks Engineer
Azure Databricks Engineer

Quantum Technologies LLC • Charlotte (NC)

Remote
USD 98,000 - 134,000
Azure Databricks Engineer
Azure Databricks Engineer

MACHINE LEARNING TECHNOLOGIES LLC • Dallas (TX)

On-site
USD 72,000 - 102,000
Azure Data bricks Engineer
Azure Data bricks Engineer

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 120,000 - 155,000