Senior Data Platform Engineer - AI Pipelines (Remote)

Transcarent; Poland; Remote; PLN 558,000 - 707,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) with company match

Flexible PTO and holidays

Job summary

Transcarent is seeking a Senior Data Engineer to architect and build enterprise-scale data pipelines powering analytics across the business. You will partner with engineering, analytics, and business stakeholders to deliver a modern, cloud-native data platform, increasingly powered by AI-driven automation.

In 6–12 months, you’ll own core pipelines, contribute to platform modernization, and identify AI/ML application opportunities while mentoring other engineers and shaping data strategy for

Qualifications

• BS or MS in Computer Science, Data Science, or related field (or equivalent practical experience)
• 5+ years of professional data engineering experience with demonstrated technical leadership
• Expert-level proficiency in Python and SQL, including building enterprise-scale data processing apps and optimizing queries
• Advanced hands-on experience with Databricks and AWS data services (S3, Redshift, RDS, Glue, Lambda)
• Proven track record designing and implementing large-scale data warehousing and ETL/ELT pipelines
• Experience with modern orchestration frameworks such as Airflow
• Demonstrated interest or experience applying AI/ML to data engineering problems
• Experience in Agile environments with CI/CD practices
• Excellent written and verbal communication; able to explain tradeoffs to engineers and business stakeholders
• Comfort operating independently in a fast-paced environment

Responsibilities

• Architect, build, and maintain enterprise-scale data pipelines with high reliability and performance
• Own and evolve core components of a cloud-native data platform built on Databricks and AWS
• Design and implement data integration across internal and third-party systems with end-to-end data quality
• Apply AI/ML, including LLM-based agents, to reduce manual toil and unlock analytics capabilities
• Build and optimize data models across AWS and Databricks environments
• Collaborate with cross-functional stakeholders to translate business requirements into scalable data solutions
• Implement data quality controls and observability across the pipeline lifecycle
• Diagnose and resolve production data issues with minimal oversight
• Mentor engineers on code quality, architecture, and operational excellence
• Evaluate emerging tools (AI, data platform, orchestration) and drive adoption where impactful
• Contribute to data platform modernization efforts and AI-powered tooling

Skills

Python

SQL

Data modeling

Cloud architecture

AI/ML integration

Communication

Leadership

Education

BS or MS in Computer Science, Data Science, or related field

Tools

Databricks

AWS

Airflow

dbt

Job description

Transcarent is seeking a Senior Data Engineer to architect and build enterprise-scale data pipelines powering analytics across the business. You will partner with engineering, analytics, and business stakeholders to deliver a modern, cloud-native data platform, increasingly powered by AI-driven automation.

In 6–12 months, you’ll own core pipelines, contribute to platform modernization, and identify AI/ML application opportunities while mentoring other engineers and shaping data strategy for