Azure Databricks Engineer: Data Pipelines and Unity Catalog

Ethereum Technologies LLC

Cincinnati (OH)

On-site

USD 120,000 - 160,000

Full time

27 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Ethereum Technologies in Cincinnati seeks a data engineer specializing in Azure Databricks and Unity Catalog to design and govern scalable data pipelines. You will implement PySpark jobs, manage access controls, and collaborate on cloud-native data platform solutions with CI/CD practices.

The role emphasizes hands-on execution, governance, and performance optimization within a modern data stack, using GitHub and Copilot enhancements to drive quality.

Qualifications

  • Strong hands-on experience with Azure Databricks.
  • Experience managing data governance and access control using Unity Catalog.
  • Proficient in Python and PySpark for distributed data processing.
  • Experience designing, developing and optimizing scalable data pipelines.
  • Good understanding of data architecture, data lineage and metadata management.
  • Hands-on experience with GitHub, including branching strategies, pull requests and code reviews.
  • Hands-on experience with GitHub Actions and CI/CD pipeline implementation.
  • Familiarity with DevOps practices for data engineering deployments.
  • Understanding of data security and governance best practices.
  • Experience working with modern cloud-based data platforms.
  • Familiarity with AI-assisted development tools such as GitHub Copilot and Databricks.
  • Strong problem-solving, debugging and performance optimization skills.

Skills

Azure Databricks
Unity Catalog
Python
PySpark
Data pipelines
Data architecture
Data lineage
Metadata management
GitHub
CI/CD
DevOps for data
Data security
Cloud platforms
GitHub Copilot
Problem solving
Debugging
Performance optimization

Tools

Azure Databricks
Unity Catalog
GitHub
GitHub Actions
CI/CD pipelines
Databricks
Azure

Job description

Ethereum Technologies in Cincinnati seeks a data engineer specializing in Azure Databricks and Unity Catalog to design and govern scalable data pipelines. You will implement PySpark jobs, manage access controls, and collaborate on cloud-native data platform solutions with CI/CD practices.

The role emphasizes hands-on execution, governance, and performance optimization within a modern data stack, using GitHub and Copilot enhancements to drive quality.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Engineer - Data Pipelines & Unity Catalog
Azure Databricks Engineer - Data Pipelines & Unity Catalog

Robotic Process Automation LLC • Cincinnati (OH)

On-site
USD 120,000 - 180,000
Azure Databricks Engineer: Unity Catalog, PySpark & CI/CD
Azure Databricks Engineer: Unity Catalog, PySpark & CI/CD

Robotics Technologies • Cincinnati (OH)

On-site
USD 120,000 - 180,000
Azure Databricks Engineer - Data Pipelines & Governance
Azure Databricks Engineer - Data Pipelines & Governance

Ethereum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000
Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

MACHINE LEARNING TECHNOLOGIES LLC • Cincinnati (OH)

On-site
USD 78,000 - 112,000
Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

Quantum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000
Lead Azure Databricks Engineer – Data Pipelines & Governance
Lead Azure Databricks Engineer – Data Pipelines & Governance

Robotics Technologies • Cincinnati (OH)

On-site
USD 91,000 - 124,000
Azure Databricks Engineer: Governance, PySpark & Pipelines
Azure Databricks Engineer: Governance, PySpark & Pipelines

Quantum Technologies LLC • Cincinnati (OH)

On-site
USD 110,000 - 165,000
Azure Databricks Engineer - Governance, PySpark & CI/CD Expert
Azure Databricks Engineer - Governance, PySpark & CI/CD Expert

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 120,000 - 155,000
Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 90,000 - 110,000
Azure Databricks Engineer: Pipelines, Governance & CI/CD
Azure Databricks Engineer: Pipelines, Governance & CI/CD

Robotic Process Automation LLC • Cincinnati (OH)

On-site
USD 94,000 - 103,000