Azure Databricks Engineer - Governance, PySpark & CI/CD Expert

Valiant Technologies LLC

Cincinnati (OH)

On-site

USD 120,000 - 155,000

Full time

26 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Valiant Technologies LLC is seeking a data engineer with hands-on Azure Databricks expertise to govern data using Unity Catalog and build scalable data pipelines.

The role requires strong PySpark development skills, familiarity with GitHub, CI/CD practices, and cloud platform experience. Candidates should demonstrate problem-solving and optimization abilities in a modern data environment.

Qualifications

  • Hands-on experience with Azure Databricks and Unity Catalog governance.
  • Strong Python and PySpark for distributed data processing.
  • Designing, developing and optimizing scalable data pipelines.
  • Knowledge of data architecture, lineage and metadata management.
  • GitHub workflows: branching, PRs and code reviews; CI/CD with GitHub Actions.
  • Familiarity with DevOps practices for data deployments and security best practices.
  • Experience with modern cloud-based data platforms.
  • Familiarity with AI-assisted tools like GitHub Copilot and Databricks.
  • Strong problem-solving, debugging and performance optimization skills.

Skills

Azure Databricks
Unity Catalog
Python
PySpark
Data pipelines
Data architecture
GitHub
CI/CD
DevOps for data
Data security
Cloud platforms
GitHub Copilot

Job description

Valiant Technologies LLC is seeking a data engineer with hands-on Azure Databricks expertise to govern data using Unity Catalog and build scalable data pipelines.

The role requires strong PySpark development skills, familiarity with GitHub, CI/CD practices, and cloud platform experience. Candidates should demonstrate problem-solving and optimization abilities in a modern data environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

Valiant Technologies LLC • Cincinnati (OH)

On-site
USD 90,000 - 110,000
Azure Databricks Engineer: Unity Catalog, PySpark & CI/CD
Azure Databricks Engineer: Unity Catalog, PySpark & CI/CD

Robotics Technologies • Cincinnati (OH)

On-site
USD 120,000 - 180,000
Azure Databricks Engineer: Governance, PySpark & Pipelines
Azure Databricks Engineer: Governance, PySpark & Pipelines

Quantum Technologies LLC • Cincinnati (OH)

On-site
USD 110,000 - 165,000
Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

MACHINE LEARNING TECHNOLOGIES LLC • Cincinnati (OH)

On-site
USD 78,000 - 112,000
Azure Databricks Engineer - Data Pipelines & Governance
Azure Databricks Engineer - Data Pipelines & Governance

Ethereum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000
Lead Azure Databricks Engineer – Data Pipelines & Governance
Lead Azure Databricks Engineer – Data Pipelines & Governance

Robotics Technologies • Cincinnati (OH)

On-site
USD 91,000 - 124,000
Azure Databricks Engineer: Data Pipelines & Governance
Azure Databricks Engineer: Data Pipelines & Governance

Quantum Technologies LLC • Cincinnati (OH)

On-site
USD 81,000 - 115,000
Azure Databricks Engineer - Data Pipelines & Unity Catalog
Azure Databricks Engineer - Data Pipelines & Unity Catalog

Robotic Process Automation LLC • Cincinnati (OH)

On-site
USD 120,000 - 180,000
Azure Databricks Engineer: Data Pipelines and Unity Catalog
Azure Databricks Engineer: Data Pipelines and Unity Catalog

Ethereum Technologies LLC • Cincinnati (OH)

On-site
USD 120,000 - 160,000
Azure Data Engineer: Cloud Data Pipelines & Spark Pro
Azure Data Engineer: Cloud Data Pipelines & Spark Pro

Valiant Technologies LLC • Austin (TX)

On-site
USD 110,000 - 160,000