Senior AI-Driven Data Engineer - Platform Owner

Total Performance Consulting; United States; Hybrid; USD 150,000 - 190,000; Full time

Job summary

Total Performance Consulting seeks a Senior Forward Deployed Data Engineer to own the data platform on Azure Databricks and to partner with business stakeholders. You will ship end-to-end solutions using Claude Code and agentic development patterns, driving data products from problem to production in a healthcare setting.

You will be a hybrid technical product owner, owning backlog, guiding architecture decisions, and ensuring data readiness for analytics, ML models, and operational systems

Qualifications

• BS in Computer Science, Data Science, or a related field.
• 6+ years in data engineering or hybrid data engineering/analytics role.
• Hands-on experience with Azure Databricks, Delta Lake, Unity Catalog, and production-scale pipelines.
• Strong Python and SQL, with PySpark and distributed data processing.
• Experience building data products serving analytics, ML models, and operational systems.
• Active use of AI coding tools (Claude Code) as a productivity multiplier.

Responsibilities

• Design, build, and operate the data platform on Azure Databricks (ingestion, transformation, storage, serving).
• Build and maintain pipelines across Salesforce, SQL Server, Snowflake, and new cloud-native platforms.
• Ensure data quality with validation checks, anomaly detection, and lineage tracking.

Skills

Python proficiency

SQL proficiency

AI coding tools usage

Communication skills

Product ownership mindset

Problem-solving

Education

BS in Computer Science, Data Science, or related field

Tools

Azure Databricks

Delta Lake

Unity Catalog

PySpark

Salesforce data models

Claude Code

Job description

Total Performance Consulting seeks a Senior Forward Deployed Data Engineer to own the data platform on Azure Databricks and to partner with business stakeholders. You will ship end-to-end solutions using Claude Code and agentic development patterns, driving data products from problem to production in a healthcare setting.

You will be a hybrid technical product owner, owning backlog, guiding architecture decisions, and ensuring data readiness for analytics, ML models, and operational systems