Lead Data Engineer: Scalable Azure Pipelines & Governance

Openkrill; United States; Teletrabalho; USD 150 000 - 190 000; Tempo integral

Resumo da oferta

Openkrill seeks a Lead Data Engineer to design and operationalize scalable data solutions for analytics and AI/ML initiatives using Databricks, Azure Fabric, PySpark, and SQL.

You will architect pipelines across data warehouses, data lakes, and real-time integration, mentor engineers, and partner with stakeholders to align data strategy with business goals.

Experience with Azure Data Factory, ADLS Gen2, Azure SQL, Power BI, governance (GxP, HIPAA/GDPR), and CI/CD is highly valued.

Qualificações

• Bachelor’s degree in computer science, information systems, engineering, or related field (Master’s preferred).
• 5–8 years of experience designing and developing enterprise-scale data solutions.

Responsabilidades

• Architect end-to-end data solutions across data warehouses, data lakes, and real-time pipelines.
• Design, build, and optimize data models and pipelines using Databricks, PySpark, and SQL.
• Lead automation, CI/CD, and production readiness of data workloads.
• Mentor junior engineers and align data initiatives with business goals.
• Collaborate with analytics and IT stakeholders to enable self-service analytics.

Conhecimentos

Leadership

Mentoring

Communication

Stakeholder management

Formação académica

Bachelor’s degree in CS/IS/Engineering

Master’s degree preferred

Ferramentas

Databricks

Azure Fabric

PySpark

SQL

Azure Data Factory

ADLS Gen2

Azure SQL Server

Azure DevOps

Power BI

Tableau/Looker

Git

Terraform

ARM/Bicep

Descrição da oferta de emprego

Openkrill seeks a Lead Data Engineer to design and operationalize scalable data solutions for analytics and AI/ML initiatives using Databricks, Azure Fabric, PySpark, and SQL.

You will architect pipelines across data warehouses, data lakes, and real-time integration, mentor engineers, and partner with stakeholders to align data strategy with business goals.

Experience with Azure Data Factory, ADLS Gen2, Azure SQL, Power BI, governance (GxP, HIPAA/GDPR), and CI/CD is highly valued.