Hybrid Dallas: Senior Data Platform Engineer (AI-Driven Risk)

Aperiasolutions; Dallas (TX); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Health insurance

Health savings account

Dental insurance

Vision insurance

401(k) matching

Life insurance

Paid time off

Parental leave

Disability insurance

Childcare assistance

Education reimbursement

Fitness membership

Volunteer time off

Job summary

Aperia Solutions in Dallas, TX is seeking a senior data engineer to own end-to-end medallion data architecture. You will design Bronze/Silver/Gold tables, build Fabric Spark pipelines, and implement Direct Lake semantic models to support risk scoring and analytics.

You will collaborate with senior peers on a next-generation risk platform using Microsoft Fabric, Python, and Delta Lake, with hybrid work in a fast-paced environment.

Qualifications

• 5+ years data engineering experience with at least 2 years Spark development (PySpark preferred).
• Deep Delta Lake internals knowledge — logs, checkpoints, retention, VACUUM, OPTIMIZE.
• Parquet format expertise — footers, statistics, encoding, dictionary encoding.
• Microsoft Fabric hands-on experience — workspaces, lakehouses, semantic models, Direct Lake.
• SQL performance tuning for OLAP and OLTP workloads.
• Strong Python data engineering skills — pandas, PyArrow, delta-rs.
• Ability to communicate architecture clearly in writing and work autonomously on features.

Responsibilities

• Design Bronze, Silver, and Gold Delta table schemas with PAN-safe layout.
• Build Fabric Spark notebooks for feature pipelines and rolling features.
• Author per-flavor Silver adapters and canonical MERGE DAGs.
• Build Gold materialization pipelines for risk scoring data.
• Design Direct Lake semantic models and test performance at scale.
• Configure OneLake namespaces and cross-workspace relationships.

Skills

5+ years data engineering

Spark development

Delta Lake internals

Parquet format expertise

Microsoft Fabric hands-on

SQL performance tuning

Python data engineering

Architecture communication

Autonomy in work

Nice-to-have PCI/finance domain

Tools

PySpark

Delta Lake

Microsoft Fabric

Terraform

ClickHouse

OneLake

Job description

Aperia Solutions in Dallas, TX is seeking a senior data engineer to own end-to-end medallion data architecture. You will design Bronze/Silver/Gold tables, build Fabric Spark pipelines, and implement Direct Lake semantic models to support risk scoring and analytics.

You will collaborate with senior peers on a next-generation risk platform using Microsoft Fabric, Python, and Delta Lake, with hybrid work in a fast-paced environment.