Remote Senior Data Engineer: Azure Databricks

Hylant Group, Inc.; Toledo (OH); Remote; USD 110,000 - 150,000; Full time

Job summary

The Data Engineer will build, integrate, and operationalize Hylant’s enterprise data architecture on our Databricks and Azure platform. This role translates architectural designs and analytical requirements into reliable, scalable data pipelines and business-ready datasets.

Working closely with the Lead Data Architect, the position ensures data solutions align to defined standards, patterns, and governance requirements; you will own CI/CD for Databricks and Azure Data Factory and enable trusted

Qualifications

• Bachelor’s degree in computer science, engineering, data science, or related field; equivalent practical experience (desired).
• 5–7+ years of experience as a Data Engineer, designing, implementing production-grade pipelines.
• Hands-on with Azure Databricks, Azure Data Factory, Delta Lake, Unity Catalog, and core Azure services.
• Strong SQL and PySpark for data transformation and pipeline development.
• Experience owning or contributing to CI/CD pipelines for data platforms (Azure DevOps Pipelines preferred).

Responsibilities

• Design, build, and maintain data transformation logic, business rules, and analytics-ready datasets using Databricks notebooks, PySpark, and SQL.
• Develop, orchestrate, and monitor ETL/ELT pipelines with Azure Databricks and Data Factory; handle scheduling and dependencies.
• Create target schemas, curated tables, and data layers aligned to architectural designs; manage historical loads and backfills.
• Implement data governance, security, and access controls within Unity Catalog with role-based grants and ABAC policies.
• Conduct data profiling, validation, reconciliation, and testing; work with source owners and consumers to resolve discrepancies.
• Serve curated datasets through Databricks SQL and Power BI for reporting.
• Own the CI/CD process for Databricks and Azure Data Factory using Azure DevOps Pipelines.
• Monitor and optimize the data platform for performance and cost; participate in agile delivery.

Skills

Azure Databricks

PySpark

SQL

Data Governance

CI/CD

Education

Bachelor's degree in CS/Engineering/Data Science

Tools

Azure Data Factory

Delta Lake

Unity Catalog

Power BI

Job description

The Data Engineer will build, integrate, and operationalize Hylant’s enterprise data architecture on our Databricks and Azure platform. This role translates architectural designs and analytical requirements into reliable, scalable data pipelines and business-ready datasets.

Working closely with the Lead Data Architect, the position ensures data solutions align to defined standards, patterns, and governance requirements; you will own CI/CD for Databricks and Azure Data Factory and enable trusted