Principal Data Engineer

XpertDox LLC; Scottsdale (AZ); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Relocation assistance

Stock options

Health, dental, vision, life insurance

401(k) matching

Unlimited PTO and parental leave

Wellness program

Job summary

XpertDox, Inc. is looking for a senior data platform engineer in Scottsdale, AZ to lead moving our data from batch processes to an AWS lakehouse architecture.

You will design, build, and govern the data layer feeding a self-serve analytics platform, collaborating across analytics and engineering teams. The role demands hands-on migration experience, deep AWS data services knowledge, and a track record of data architecture decisions in dynamic environments.

Qualifications

• Production migration experience to lakehouse, from start to finish.
• Hands-on AWS Glue, Athena, and S3 expertise.
• 8+ years in data engineering or data platform roles.
• Ability to make architecture decisions with incomplete information.

Responsibilities

• Design and migrate data lakehouse architecture from batch files.
• Design schema, partitioning and table layout for diverse client datasets.
• Build ETL pipelines in AWS Glue and PySpark with upsert and merge, scheduling and monitoring.
• Govern PHI data with access control and retention policies.
• Enforce engineering standards for code, deployment, docs and cost.
• Support self-serve analytics with natural-language querying.
• Handoff between batch outputs and the lakehouse.
• Provide technical leadership to data engineering and analytics staff.

Skills

Data architecture

Leadership

Mentorship

Tools

AWS Glue

Amazon Athena

Amazon S3

PySpark

Python

SQL

Apache Iceberg

Parquet

Job description

On-site or remote:

On-site, Monday through Friday

Reports to:

Chief Operating Officer

About XpertDox

XpertDox, Inc. is a physician-founded, venture-backed healthcare AI company headquartered in Scottsdale, Arizona, with a global delivery team in India. Our platform, XpertCoding, autonomously codes outpatient medical claims directly from clinical documentation using neural networks, machine learning, and natural language processing. We serve outpatient healthcare organizations in almost all 50 states, with deep expertise in Federally Qualified Health Centers (FQHCs), women’s health and OB/GYN practices, and behavioral health providers.

Position Summary

You will own the move of our data from a batch-oriented, file-based environment to an AWS lakehouse, and you will own the data platform that results. The target architecture is Apache Iceberg tables on Amazon S3, queried through Amazon Athena, with AWS Glue handling ETL and cataloging. This is a hands-on role: you will design the architecture, build the critical components yourself, and set the standards the data team follows. Our analytics team’s current pipelines remain the upstream source for the data you structure, and our self-serve analytics platform depends on the data layer you deliver. This role is not for someone who has designed a lakehouse but has never carried a production migration through to completion.

Key Responsibilities

In this role you will:

• Own the design and execution of the lakehouse migration, from source ingestion through the query and reporting layer.
• Design schema, partitioning, and table layout that hold up across many client datasets with varying structure.
• Build and harden ETL pipelines in AWS Glue and PySpark, including upsert and merge logic, scheduling, failure handling, and monitoring.
• Own data governance, access control, retention, and quality standards for protected health information (PHI).
• Set and enforce engineering standards for the data platform: code review, testing, deployment, documentation, and cost management.
• Own the data layer requirements for the self-serve analytics platform, so it supports natural-language querying and reporting.
• Define and own the handoff between the analytics team’s existing batch outputs and the lakehouse.
• Provide technical leadership and mentorship to data engineering and analytics staff.

Required Qualifications

• Led at least one production migration from legacy or file-based systems to a data lake or lakehouse architecture, carried through to completion.
• Deep hands-on experience with AWS Glue, Athena, and S3.
• 8+ years in data engineering or data platform roles, with demonstrated ownership of architecture decisions.
• Experience making architecture decisions with incomplete information.

Preferred Qualifications

• Strong working knowledge of open table formats, with Apache Iceberg preferred (Delta Lake or Apache Hudi also relevant), and columnar storage formats such as Parquet.
• Strong Python and SQL skills; PySpark experience strongly preferred.
• Experience designing for multi-tenant or multi-client data where schemas vary across sources.
• Experience with data governance and security in a regulated environment.

Location and Schedule

This is an on-site role at our Scottsdale, Arizona headquarters, Monday through Friday, 8:00 AM to 4:30 PM. It is not remote or hybrid. Candidates who live outside the Scottsdale area must relocate before their start date. No travel is required. The role works with protected health information; all staff complete HIPAA training and follow XpertDox data security policies.

Compensation

• Base salary of $150,000 to $190,000 per year, commensurate with experience.
• Incentive stock options.
• Relocation assistance, reimbursed against receipts.
• Health, dental, vision, and life insurance.
• 401(k) with matching.
• Unlimited PTO and parental leave.
• Wellness program, Friday lunch, and snacks.

XpertDox, Inc. is an equal opportunity employer.