Remote Senior Data Engineer — AI-Driven Data Platform

Transcarent; Polska; Ibrido; PLN 551.000 - 748.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical, dental, vision coverage

401(k) with company match

Paid time off and holidays

Life Insurance and Disability

Descrizione del lavoro

Transcarent is seeking a Senior Data Engineer to architect and build enterprise-scale data pipelines powering member analytics. You will partner with engineering, analytics, and business stakeholders to modernize a cloud-native data platform, leveraging Databricks and AWS, and pushing AI-powered automation.

In 6–12 months, take ownership of core pipelines, contribute to platform modernization, and pursue AI/ML opportunities to solve real data problems.

Competenze

• BS or MS in Computer Science, Data Science, or related field (or equivalent practical experience).
• 5+ years of professional data engineering experience with leadership.
• Expert-level Python and SQL for enterprise-scale processing and query optimization.
• Hands-on Databricks and AWS data services experience (S3, Redshift, RDS, Glue, Lambda).
• Proven track record designing large-scale data warehousing and ETL/ELT pipelines.
• Experience with Airflow and modern orchestration frameworks.
• Interest or experience applying AI/ML to data engineering problems.

Mansioni

• Architect, build, and maintain enterprise-scale data pipelines with high reliability and performance.
• Own core components of a cloud-native data platform on Databricks and AWS.
• Design and implement data integration across internal and third-party systems; ensure data quality end-to-end.
• Apply AI/ML, including LLM-based agents, to automate data engineering tasks and unlock analytics capabilities.
• Build and optimize data models across AWS and Databricks environments.
• Collaborate with stakeholders to translate requirements into scalable data solutions.
• Impose data quality controls and observability across the pipeline lifecycle.
• Diagnose and resolve production data issues; mentor engineers on code quality and architecture.
• Research and evaluate new tools, advising on adoption where impactful.

Conoscenze

Python

SQL

AI/ML experimentation

CI/CD practices

Cross-functional collaboration

Architectural thinking

Communication

Formazione

BS or MS in Computer Science or related field

Strumenti

Databricks

AWS

Airflow

Descrizione del lavoro

Transcarent is seeking a Senior Data Engineer to architect and build enterprise-scale data pipelines powering member analytics. You will partner with engineering, analytics, and business stakeholders to modernize a cloud-native data platform, leveraging Databricks and AWS, and pushing AI-powered automation.

In 6–12 months, take ownership of core pipelines, contribute to platform modernization, and pursue AI/ML opportunities to solve real data problems.