Azure Data Engineer — Agile Pipelines & Lakehouse

Ampstek; Ohio; Sur place; USD 90 000 - 120 000; Plein temps

Résumé du poste

Ampstek is seeking a data engineering professional to design, build, and optimize scalable data pipelines and lakehouse architectures on Azure. You will work with Databricks, ADF, Delta Lake, and ADLS to deliver reliable data solutions for analytics teams.

Responsibilities include optimizing Spark workloads, orchestrating Databricks Jobs, ensuring data quality and governance, and collaborating with business and IT stakeholders in Scrum ceremonies. Experience with CI/CD is a plus.

Qualifications

• Experience designing scalable data pipelines and lakehouse architectures.
• Strong Scrum experience and ability to interact with stakeholders.
• Proficiency with Azure Databricks, ADF, Delta Lake and ADLS.
• Ability to optimize Spark workloads and Delta tables for performance.
• Familiarity with Git-based development and CI/CD processes.

Responsabilités

• Design, develop, and optimize scalable data pipelines and lakehouse architectures on Azure.
• Build ETL/ELT solutions using Databricks, ADF, and Delta Lake.
• Optimize data workloads for performance and scalability.
• Develop and orchestrate workflows with Databricks Jobs and schedulers.
• Ensure data quality, governance, security, and reliability.
• Collaborate with business, analytics, and engineering teams.
• Support CI/CD and deployment processes; interact with IT stakeholders in Scrum ceremonies.

Connaissances

Data pipelines

Scrum

Collaboration

Data quality

Outils

Azure Databricks

Azure Data Factory

Delta Lake

Azure Data Lake Storage

Spark

CI/CD

Description du poste

Ampstek is seeking a data engineering professional to design, build, and optimize scalable data pipelines and lakehouse architectures on Azure. You will work with Databricks, ADF, Delta Lake, and ADLS to deliver reliable data solutions for analytics teams.

Responsibilities include optimizing Spark workloads, orchestrating Databricks Jobs, ensuring data quality and governance, and collaborating with business and IT stakeholders in Scrum ceremonies. Experience with CI/CD is a plus.