Data Engineer

Ampstek; Ohio; Presencial; USD 90.000 - 120.000; Jornada completa

Descripción de la vacante

Ampstek is seeking a data engineering professional to design, build, and optimize scalable data pipelines and lakehouse architectures on Azure. You will work with Databricks, ADF, Delta Lake, and ADLS to deliver reliable data solutions for analytics teams.

Responsibilities include optimizing Spark workloads, orchestrating Databricks Jobs, ensuring data quality and governance, and collaborating with business and IT stakeholders in Scrum ceremonies. Experience with CI/CD is a plus.

Formación

• Experience designing scalable data pipelines and lakehouse architectures.
• Strong Scrum experience and ability to interact with stakeholders.
• Proficiency with Azure Databricks, ADF, Delta Lake and ADLS.
• Ability to optimize Spark workloads and Delta tables for performance.
• Familiarity with Git-based development and CI/CD processes.

Responsabilidades

• Design, develop, and optimize scalable data pipelines and lakehouse architectures on Azure.
• Build ETL/ELT solutions using Databricks, ADF, and Delta Lake.
• Optimize data workloads for performance and scalability.
• Develop and orchestrate workflows with Databricks Jobs and schedulers.
• Ensure data quality, governance, security, and reliability.
• Collaborate with business, analytics, and engineering teams.
• Support CI/CD and deployment processes; interact with IT stakeholders in Scrum ceremonies.

Conocimientos

Data pipelines

Scrum

Collaboration

Data quality

Herramientas

Azure Databricks

Azure Data Factory

Delta Lake

Azure Data Lake Storage

Spark

CI/CD

Descripción del empleo

Design, develop, and optimize scalable data pipelines and lakehouse architectures on Azure. someone with strong scrum experience

Build ETL/ELT solutions using Azure Databricks, Azure Data Factory (ADF), Delta Lake, and Azure Data Lake Storage (ADLS).

Optimize Spark workloads, SQL Warehouses, and Delta tables for performance and scalability.

Develop and orchestrate workflows using Databricks Jobs and scheduling frameworks.

Ensure data quality, governance, security, and operational reliability.

Collaborate with business, analytics, and engineering teams to deliver data-driven solutions.

Support Git-based development, CI/CD, and deployment processes.

Ability to interact with Business and IT stakeholders and drive Scrum ceremonies.