Remote Senior Data Platform Engineer & Tech Lead

EXL; New York (NY); Remote; USD 85,000 - 140,000; Full time

Job summary

EXL is seeking a Senior Full-Stack Data Engineer to lead architecture, development, and optimization of a next-generation data platform. You will mentor engineers, define roadmaps, and collaborate with data scientists to deliver scalable data solutions.

The role requires deep expertise in SQL, Python, PySpark, and cloud-native data pipelines with emphasis on ingestion, transformation, and real-time streaming using AWS services and modern tooling.

Qualifications

• 10+ years of hands-on data engineering or related full-stack data roles.
• Strong SQL, Python, and PySpark; expertise in data platforms.
• Experience building petabyte-scale cloud data pipelines.
• Insurance industry experience preferred but not mandatory.

Responsibilities

• Define the architectural roadmap for end-to-end data pipelines.
• Mentor engineers and drive project velocity to deliver data products.
• Collaborate with Data Scientists and ML Engineers to enable model development.
• Design and optimize ingestion, transformation, and real-time data streams.

Skills

SQL

Python

PySpark

AWS

Data Modeling

Tools

dbt Core

Iceberg

AWS Glue Catalog

Snowflake

Redshift

Athena

Dagster

Splunk

Git

Talend

Job description

EXL is seeking a Senior Full-Stack Data Engineer to lead architecture, development, and optimization of a next-generation data platform. You will mentor engineers, define roadmaps, and collaborate with data scientists to deliver scalable data solutions.

The role requires deep expertise in SQL, Python, PySpark, and cloud-native data pipelines with emphasis on ingestion, transformation, and real-time streaming using AWS services and modern tooling.