Senior Data Platform Engineer — Microsoft Fabric & Delta Lake

Socket.dev; Dallas (TX); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health insurance

Health savings account

Dental insurance

Vision insurance

401(k) matching

Life insurance

Paid time off

Parental leave

Disability insurance

Childcare assistance

Education reimbursement

Fitness membership

Volunteer time off

Job summary

Aperia Solutions in Dallas, TX is seeking a Senior Data Engineer to own Bronze/Silver/Gold data architecture on Microsoft Fabric. You will design and optimized Delta pipelines, build Direct Lake models, and enable scalable risk analytics for high-volume payments data.

You'll collaborate with a small senior team, including a tech lead and DevOps, to ship production-grade pipelines and analytics surfaces, while emphasizing reliability and performance at scale.

Qualifications

• 5+ years data engineering experience with hands-on Spark development.
• Deep Delta Lake internals knowledge and Parquet expertise.
• Microsoft Fabric experience with lakehouses, Direct Lake, and semantic models.
• Strong Python data engineering skills and SQL performance tuning.
• Ability to communicate architecture clearly and work autonomously.

Responsibilities

• Design Bronze, Silver, and Gold Delta tables with PAN-safe layouts.
• Build Fabric Spark notebooks for feature pipelines across windows.
• Create per-flavor Silver adapters and canonical MERGE DAGs.
• Materialize Gold pipelines for risk scoring and analytics surfaces.
• Design Direct Lake semantic models and optimize for performance at scale.
• Configure OneLake layouts and cross-workspace lakehouse patterns.
• Implement idempotent Delta writes with delta-rs in Python containers.
• Collaborate with DevOps on Terraform and Fabric IaC.

Skills

PySpark

Delta Lake

Microsoft Fabric

SQL tuning

Python

Job description

Aperia Solutions in Dallas, TX is seeking a Senior Data Engineer to own Bronze/Silver/Gold data architecture on Microsoft Fabric. You will design and optimized Delta pipelines, build Direct Lake models, and enable scalable risk analytics for high-volume payments data.

You'll collaborate with a small senior team, including a tech lead and DevOps, to ship production-grade pipelines and analytics surfaces, while emphasizing reliability and performance at scale.