Senior Data Platform Engineer — AI-Powered Pipelines (Remote)

Transcarent; Seattle (WA); Remote; USD 140,000 - 210,000; Full time

Benefits offered by this job

Remote work

Optional Seattle office

Job summary

Transcarent is seeking a Senior Data Engineer to architect and build enterprise-scale data pipelines and platforms powering analytics for business and members. You will partner with engineering, analytics, and business stakeholders to drive modernization, reliability, and AI-driven automation across cloud-native systems.

In the first 6–12 months, you’ll own core data pipelines, advance platform modernization, and identify opportunities to apply AI/ML to real problems.

Qualifications

• BS or MS in Computer Science, Data Science, or related field (or equivalent practical experience)
• 5+ years of professional data engineering experience, with demonstrated technical leadership
• Expert-level proficiency in Python and SQL, including experience building enterprise-scale data processing applications and optimizing complex queries
• Advanced hands-on experience with Databricks (or similar platforms) and AWS data services (e.g., S3, Redshift, RDS, Glue, Lambda)
• Proven track record designing and implementing large-scale data warehousing solutions and complex ETL/ELT pipelines
• Experience with modern orchestration frameworks such as Airflow
• Strong grounding in data modeling and dimensional modeling best practices
• Demonstrated interest or experience applying AI/ML to data engineering problems
• Experience working in Agile environments with CI/CD practices
• Excellent written and verbal communication skills; ability to explain technical tradeoffs to both engineers and business stakeholders
• Comfort operating independently in a fast-paced, evolving environment

Responsibilities

• Architect, build, and maintain enterprise-scale data pipelines that process large volumes of data with high reliability and performance
• Own and evolve core components of our cloud-native data platform, built on modern tools such as Databricks and AWS
• Design and implement data integration solutions across internal and third-party systems, ensuring data quality and consistency end-to-end
• Apply AI/ML - including LLM-based agents and automation - to solve data engineering problems, reduce manual toil, and unlock new analytics capabilities
• Build and optimize data models across our AWS and Databricks environments
• Partner with cross-functional stakeholders to translate business requirements into scalable data solutions
• Implement and enforce data quality controls and observability practices across the pipeline lifecycle
• Diagnose and resolve complex production data issues with minimal oversight
• Mentor other engineers on the team, raising the technical bar for code quality, architecture, and operational excellence
• Research and evaluate emerging tools and techniques (AI, data platform, orchestration) and recommend adoption where it drives impact
• Other duties as assigned

Skills

Python

SQL

Agile

CI/CD

Communication

Mentorship

Education

BS or MS in Computer Science, Data Science, or related field

Tools

Databricks

AWS

Airflow

dbt

Job description

Transcarent is seeking a Senior Data Engineer to architect and build enterprise-scale data pipelines and platforms powering analytics for business and members. You will partner with engineering, analytics, and business stakeholders to drive modernization, reliability, and AI-driven automation across cloud-native systems.

In the first 6–12 months, you’ll own core data pipelines, advance platform modernization, and identify opportunities to apply AI/ML to real problems.