Senior Data Engineer - Fabric & Lakehouse Pipelines

OwlSure; Missouri; In loco; USD 110.000 - 140.000; Tempo pieno

Descrizione del lavoro

OwlSure in Missouri seeks an experienced Data Engineer to migrate and optimize data platforms, focusing on Microsoft Fabric, PySpark notebooks, and Lakehouse architectures. You will design scalable ETL/ELT pipelines, ensure data quality, and collaborate with business teams to deliver analytics-ready datasets.

The role requires 5+ years in data engineering, strong SQL/T-SQL skills, and experience with CI/CD, Git, and production deployments. Preference for Databricks or Azure Synapse.

Competenze

• 5+ years of Data Engineering experience.
• Hands-on with Microsoft Fabric, Python/PySpark, Spark SQL, and SQL Server/T-SQL.
• Experience building data pipelines, Lakehouses, dimensional models, and ETL/ELT solutions.
• Knowledge of Spark performance tuning, incremental loads, data quality, and CI/CD.
• Experience with Git and production deployment processes.

Mansioni

• Migrate legacy SQL Server datamarts to Microsoft Fabric.
• Develop and optimize Fabric notebooks, pipelines, and Lakehouse solutions.
• Build scalable data transformation and ingestion processes.
• Ensure data quality, testing, reconciliation, and production support.
• Collaborate with business and technical teams to deliver analytics-ready data solutions.

Conoscenze

Data pipelines

Lakehouses

Dimensional models

ETL/ELT

CI/CD

Data quality

Spark performance tuning

Incremental loads

Collaboration with business teams

Strumenti

Microsoft Fabric

Python/PySpark

Spark SQL

SQL Server/T-SQL

Git

Databricks

Azure Synapse

Descrizione del lavoro

OwlSure in Missouri seeks an experienced Data Engineer to migrate and optimize data platforms, focusing on Microsoft Fabric, PySpark notebooks, and Lakehouse architectures. You will design scalable ETL/ELT pipelines, ensure data quality, and collaborate with business teams to deliver analytics-ready datasets.

The role requires 5+ years in data engineering, strong SQL/T-SQL skills, and experience with CI/CD, Git, and production deployments. Preference for Databricks or Azure Synapse.