Azure Data bricks Engineer

Robotic Process Automation LLC

Cincinnati (OH)

On-site

USD 120,000 - 180,000

Full time

23 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Robotic Technologies Automation in Cincinnati is seeking a data engineering professional to design, build, and optimize scalable data pipelines using Azure Databricks and PySpark. The role emphasizes governance with Unity Catalog, security, and metadata management, plus CI/CD deployment workflows with GitHub.

The candidate will work hands-on with Python, PySpark, and modern cloud data platforms, focusing on performance tuning and robust documentation in a fast-paced environment.

Qualifications

  • Strong hands-on experience with Azure Databricks.
  • Experience managing data governance and access control using Unity Catalog.
  • Strong proficiency in Python and PySpark for distributed data processing.
  • Experience designing, developing, and optimizing scalable data pipelines.
  • Good understanding of data architecture, data lineage, and metadata management.
  • Hands-on experience with GitHub, including branching strategies, pull requests, and code reviews.
  • Hands-on experience with GitHub Actions and CI/CD pipeline implementation.
  • Familiarity with DevOps practices for data engineering deployments.
  • Understanding of data security and governance best practices.
  • Experience working with modern cloud-based data platforms.
  • Familiarity with AI-assisted development tools such as GitHub Copilot and Databricks.
  • Strong problem-solving, debugging, and performance optimization skills.

Responsibilities

  • Design, develop, and optimize scalable data pipelines on cloud platforms.
  • Implement data governance and access controls using Unity Catalog.
  • Collaborate on CI/CD workflows with GitHub Actions.
  • Leverage PySpark and Python for distributed data processing and performance tuning.
  • Ensure data security, lineage, and metadata management best practices.

Skills

Problem solving
Python
CI/CD automation
Data governance
Distributed data processing
Data pipelines design
GitHub workflows
DevOps practices
Data security
Cloud data platforms
Databricks
Unity Catalog
PySpark

Tools

Azure Databricks
Unity Catalog
GitHub
GitHub Actions
CI/CD
Databricks
PySpark

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Key Required Skills
  • Strong hands-on experience with Azure Databricks
  • Experience managing data governance and access control using Unity Catalog
  • Strong proficiency in Python and PySpark for distributed data processing
  • Experience designing, developing, and optimizing scalable data pipelines
  • Good understanding of data architecture, data lineage, and metadata management Experience with GitHub, including branching strategies, pull requests, and code reviews Hands-on experience with GitHub Actions and CI/CD pipeline implementation
  • Familiarity with DevOps practices for data engineering deployments
  • Understanding of data security and governance best practices
  • Experience working with modern cloud-based data platforms
  • Familiarity with Al-assisted development tools such as GitHub Copilot and Databricks
  • Assistant
  • Strong problem-solving, debugging, and performance optimization skills.
Preferred Skills
  • Databricks and/or Azure certifications
  • Experience with cloud platform Azure
  • Knowledge of modern data stack tools and frameworks
  • Excellent communication and documentation skills
  • For this role, Databricks expertise is the most critical requirement, particularly around Unity Catalog, governance, platform administration, PySpark development, and CI/CD implementation. Candidates should be able to demonstrate strong hands-on experience rather than only theoretical knowledge.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data bricks Engineer
Azure Data bricks Engineer

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 120,000 - 155,000
Azure Data bricks Engineer
Azure Data bricks Engineer

Ethereum Technologies LLC • Cincinnati (OH)

On-site
USD 120,000 - 160,000
Azure Data bricks Engineer
Azure Data bricks Engineer

Robotics Technologies • Cincinnati (OH)

On-site
USD 120,000 - 180,000
Azure Data bricks Engineer
Azure Data bricks Engineer

Quantum Technologies LLC • Cincinnati (OH)

On-site
USD 110,000 - 165,000
Azure Data bricks Engineer
Azure Data bricks Engineer

MACHINE LEARNING TECHNOLOGIES LLC • Cincinnati (OH)

On-site
USD 78,000 - 112,000
Azure Data bricks Engineer
Azure Data bricks Engineer

Quantum Technologies LLC • Charlotte (NC)

On-site
USD 120,000 - 190,000
Lead Azure Databricks Engineer
Lead Azure Databricks Engineer

Ethereum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000
Lead Azure Databricks Engineer
Lead Azure Databricks Engineer

Quantum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000
Lead Azure Databricks Engineer
Lead Azure Databricks Engineer

Robotic Process Automation LLC • Cincinnati (OH)

On-site
USD 94,000 - 103,000
Lead Azure Databricks Engineer
Lead Azure Databricks Engineer

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 90,000 - 110,000