Remote Senior Data Engineer — AI-Driven Data Platform

Transcarent; United States; On-site; USD 140,000 - 200,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

401(k) plan with generous match

Flexible PTO

Mental health and wellness benefits

Job summary

Transcarent is seeking a Senior Data Engineer to architect and build data pipelines powering member analytics, partnering with engineering and analytics to deliver a scalable, cloud-native data platform on AWS and Databricks.

In this role you will implement AI/ML driven automation, own data quality, mentor engineers, and collaborate across teams. This position offers remote work with an optional Seattle office.

Qualifications

• BS or MS in CS, Data Science, or related field (or equivalent practical experience).
• 5+ years of professional data engineering experience with leadership.
• Expert-level Python and SQL; scalable data processing and optimized queries.
• Databricks and AWS data services experience (S3, Redshift, RDS, Glue, Lambda).
• Proven track record designing large-scale data warehousing and ETL/ELT pipelines.
• Experience with Airflow.
• Data modeling and dimensional modeling best practices.
• Interest or experience applying AI/ML to data engineering problems.
• Experience with CI/CD in Agile environments.
• Excellent written and verbal communication; independent in fast-paced env.

Responsibilities

• Architect, build, and maintain enterprise-scale data pipelines with high reliability.
• Own and evolve core components of cloud-native data platform (Databricks, AWS).
• Design and implement data integration across internal and third-party systems.
• Apply AI/ML, including LLM-based agents, to automate data engineering tasks.
• Build and optimize data models in AWS and Databricks.
• Translate business requirements into scalable data solutions.
• Implement data quality controls and observability across the pipeline lifecycle.
• Diagnose and resolve production data issues with minimal oversight.
• Mentor engineers on code quality and architecture.
• Research emerging tools and recommend adoption.
• Other duties as assigned.

Skills

Python

SQL

Databricks

AWS

Data warehousing

ETL/ELT pipelines

Airflow

AI/ML in data eng

CI/CD

Leadership

Communication

Education

Bachelor's or Master's in CS/Data Science

Tools

dbt

Job description

Transcarent is seeking a Senior Data Engineer to architect and build data pipelines powering member analytics, partnering with engineering and analytics to deliver a scalable, cloud-native data platform on AWS and Databricks.

In this role you will implement AI/ML driven automation, own data quality, mentor engineers, and collaborate across teams. This position offers remote work with an optional Seattle office.