Remote Data & AI Platform Engineer: Lakehouse Pipelines

OrderYOYO; United States; Remote; USD 110,000 - 140,000; Full time

Benefits offered by this job

Remote role

Quarterly in-person gatherings

Job summary

OrderYOYO is seeking a senior data platform engineer to design, build, and operate production-grade data solutions in Microsoft Fabric. You will run end-to-end data pipelines, manage lakehouse and platform cost, and lead migrations from legacy systems while ensuring governance and reliability.

You will work with executives and cross-functional teams to deliver AI-powered data products and insights, including RAG and Azure OpenAI integrations, across the business.

Qualifications

• 6+ years of relevant data experience and production-level data engineering responsibilities.
• Hands-on expertise with Microsoft Fabric, Synapse, Databricks or Delta in production environments.
• Strong SQL/T-SQL skills including complex modelling and tuning.
• Proficient in Python or PySpark for production data pipelines.
• Experience with lakehouse architectures, partitioning, and performance considerations.
• Knowledge of Azure components (ADLS/OneLake, RBAC, Key Vault) and governance concepts.

Responsibilities

• Design, build and operate production-grade data solutions in Microsoft Fabric.
• Build and run production pipelines in Fabric, Python and PySpark with testable code.
• Design scalable ingestion and transformation patterns and manage cost and capacity.
• Lead migrations from legacy to modern platforms with proper governance and decommissioning.
• Operate the platform in production: monitoring, incidents, data quality checks and lineage.
• Incorporate AI features (RAG, Azure OpenAI) and deliver AI-driven data products.

Skills

Microsoft Fabric

SQL/T-SQL

Python

PySpark

Data modeling

Azure data services

Delta Lake

Performance tuning

Cost optimization

AI engineering

Tools

Terraform

Bicep

Job description

OrderYOYO is seeking a senior data platform engineer to design, build, and operate production-grade data solutions in Microsoft Fabric. You will run end-to-end data pipelines, manage lakehouse and platform cost, and lead migrations from legacy systems while ensuring governance and reliability.

You will work with executives and cross-functional teams to deliver AI-powered data products and insights, including RAG and Azure OpenAI integrations, across the business.