Fabric Data Engineer: Modern Cloud Pipelines & AI

Arrivia, Inc.; Scottsdale (AZ); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Unlimited PTO

Exclusive employee travel rates

Travel discounts via Arrivia programs

Medical, dental, and vision insurance

401(k) with company participation

Job summary

Arrivia, Inc. is seeking an experienced Fabric Data Engineer to own complex data pipeline architectures within the Microsoft Fabric ecosystem.

You will design enterprise-scale data solutions, set technical standards, and mentor junior engineers while migrating on-prem data to a modern cloud environment. You will collaborate with analysts, data scientists, and stakeholders to deliver reliable, well-governed data platforms, using AI-assisted tools to accelerate delivery and raise engineering

Qualifications

• 3 to 5 years in data engineering, ETL/ELT development.
• Strong SQL across T-SQL and Spark SQL; Python with PySpark.
• Experience with Spark and lakehouse data at scale.
• Hands-on with Microsoft Fabric or a comparable cloud data platform such as Azure Synapse or Databricks.
• Experience mentoring junior engineers and leading technical initiatives.

Responsibilities

• Architect and optimize end-to-end pipelines with Microsoft Fabric Data Factory, Dataflows Gen2, and PySpark notebooks.
• Lead Lakehouse and Warehouse design on the Bronze, Silver, Gold pattern.
• Migrate on-prem relational data to OneLake and retire legacy warehouses.
• Build low-latency streaming pipelines with Fabric Eventstream.
• Write optimized T-SQL, Spark SQL, and PySpark; manage incremental loads and SLA monitoring.
• Design pipelines supporting Retrieval-Augmented Generation with embeddings and LLMs.

Skills

SQL

Python/PySpark

Mentoring/Leadership

Real-time streaming

Data governance

CI/CD

AI tooling

RAG (Retrieval-Augmented Generation)

Data modeling & DW

Spark/Lakehouse

Education

Bachelor's degree

Tools

Microsoft Fabric

Azure Synapse

Databricks

Git

Fabric deployment pipelines

Job description

Arrivia, Inc. is seeking an experienced Fabric Data Engineer to own complex data pipeline architectures within the Microsoft Fabric ecosystem.

You will design enterprise-scale data solutions, set technical standards, and mentor junior engineers while migrating on-prem data to a modern cloud environment. You will collaborate with analysts, data scientists, and stakeholders to deliver reliable, well-governed data platforms, using AI-assisted tools to accelerate delivery and raise engineering