Data Engineer - AWS Spark Pipelines for Healthcare

sourcemeridian; Medellín; On-site; COP 129,475,000 - 226,581,000; Full time

Benefits offered by this job

Health and well-being benefits

Job summary

Source Meridian in Colombia is seeking a Data Engineer to design and operate an AWS-native data platform for healthcare claims data. You will build Spark-based pipelines on S3, implement tokenization workflows, and ensure data integrity while interfacing with US stakeholders.

This role emphasizes privacy, security, and cost optimization, with orchestration via Airflow and dbt collaboration. You will work with a team to deliver reliable ETL/ELT processes and scalable data models in a fast-paced

Qualifications

• 2+ years of professional experience in Data Engineering.
• Strong experience with Apache Spark (PySpark or Scala) including joins and performance tuning.
• Excellent SQL skills and solid data modeling fundamentals.
• Advanced English level to lead technical discussions with US stakeholders.
• Hands-on experience with the AWS data stack: S3, Athena, Glue Catalog, Lake Formation, Airflow.

Responsibilities

• Build and maintain Spark pipelines to process large-scale Parquet datasets on S3.
• Implement tokenization workflows and dataset intersection logic.
• Process healthcare claims data with accurate identity mapping and data integrity.
• Orchestrate data pipelines using Airflow and AWS-native tooling.
• Develop reliable ETL/ELT processes with monitoring and reprocessing.
• Optimize performance and cost across Spark, S3, and Athena.
• Contribute to dbt models when applicable.
• Collaborate with cross-functional stakeholders with emphasis on privacy.

Skills

Data engineering

Apache Spark

SQL proficiency

English proficiency

Tools

AWS data stack

S3

Athena

Glue Catalog

Airflow

dbt

Job description

Source Meridian in Colombia is seeking a Data Engineer to design and operate an AWS-native data platform for healthcare claims data. You will build Spark-based pipelines on S3, implement tokenization workflows, and ensure data integrity while interfacing with US stakeholders.

This role emphasizes privacy, security, and cost optimization, with orchestration via Airflow and dbt collaboration. You will work with a team to deliver reliable ETL/ELT processes and scalable data models in a fast-paced