Data Engineer: Azure Fabric Pipelines & Delta Lake

Aptean; Alpharetta (GA); Presencial; USD 120.000 - 160.000; Jornada completa

Descripción de la vacante

Aptean is seeking a hands-on Data Engineer to build, test, and maintain scalable data ingestion and transformation pipelines on Microsoft Fabric and Azure technologies. This role emphasizes execution-focused delivery for enterprise reporting, analytics, and AI use cases.

You will work with the medallion data architecture (bronze/silver/gold), develop Python and PySpark notebooks, and ensure data quality, governance, and performance while collaborating with engineers, analysts, and business

Formación

• 3–5 years building data pipelines in production.
• Hands-on Python and PySpark experience.
• Experience with Azure Data Factory or similar tooling.
• Familiarity with Microsoft Fabric or SQL/Databricks with willingness to learn Fabric.
• Strong SQL, data modeling, and performance optimization knowledge.
• Knowledge of medallion architecture and Delta Lake concepts.
• Experience with data quality checks and basic SCD handling.
• Familiarity with Git, branching, and CI/CD practices.
• Exposure to Power BI and semantic models a plus.
• Understanding data governance concepts like schema versioning.

Responsabilidades

• Build data ingestion pipelines using Microsoft Fabric and Azure Data Factory.
• Develop Python and PySpark notebooks to cleanse, transform, and enrich data.
• Implement Delta Lake patterns including partitioning and schema evolution.
• Apply data quality checks and SCD logic.
• Develop reusable, metadata-driven pipeline frameworks.
• Troubleshoot pipeline failures and data discrepancies; root-cause analysis.
• Participate in code reviews, testing, and CI/CD workflows.
• Support gold-layer datasets and semantic models for Power BI.
• Monitor pipelines and resolve issues within SLAs; on-call rotations.
• Maintain data dictionaries, mappings, runbooks.
• Collaborate cross-functionally to deliver high-quality data solutions.

Conocimientos

Python

PySpark

Azure Data Factory

Microsoft Fabric

SQL modeling

Delta Lake

CI/CD

Power BI

Data governance

Descripción del empleo

Aptean is seeking a hands-on Data Engineer to build, test, and maintain scalable data ingestion and transformation pipelines on Microsoft Fabric and Azure technologies. This role emphasizes execution-focused delivery for enterprise reporting, analytics, and AI use cases.

You will work with the medallion data architecture (bronze/silver/gold), develop Python and PySpark notebooks, and ensure data quality, governance, and performance while collaborating with engineers, analysts, and business