Data Engineer: AWS Spark Pipelines for Healthcare Data

Source Meridian; Kolumbien; Remote; COP 120.000.000 - 180.000.000; Vollzeit

Benefits dieser Stelle

Permanent contract

Learning and growth environment

Health and well-being benefits

Salary based on experience

Zusammenfassung

Source Meridian in Colombia seeks a Data Engineer to build and operate an AWS-native data platform for healthcare claims. You will design Spark pipelines on S3, implement tokenization workflows, and ensure data integrity while working with cross-functional teams.

Qualifying candidates bring 2+ years in data engineering, strong Spark/SQL skills, and experience with Airflow and dbt. The role emphasizes privacy, security, and cost-aware optimization in a fixed-term, permanent contract environment.

Qualifikationen

• 2+ years of professional experience in Data Engineering.
• Proficient with Apache Spark (PySpark/Scala) and big data processing.
• Hands-on AWS data stack experience: S3, Athena, Glue Catalog, Lake Formation a plus.
• Experience building and operating pipelines with Airflow.
• Excellent SQL and data modeling fundamentals.
• Advanced English: able to lead technical discussions with US-based stakeholders.

Aufgaben

• Build and maintain Spark pipelines to process large-scale Parquet datasets on S3.
• Implement tokenization workflows and dataset intersections.
• Process and deliver healthcare claims datasets with accurate identity mapping.
• Orchestrate data pipelines using Airflow or AWS-native tools.
• Develop reliable, testable ETL/ELT processes with monitoring and retries.
• Optimize Spark, S3 partitioning, and Athena query patterns for cost and performance.
• Contribute to dbt models and data quality checks.
• Collaborate with cross-functional stakeholders while ensuring privacy and secure data handling.

Kenntnisse

Apache Spark

SQL

English

Data Modeling

Leadership / Stakeholder Communication

Tools

AWS S3

Athena

Glue Catalog

Lake Formation

Airflow

dbt

EMR

Jobbeschreibung

Source Meridian in Colombia seeks a Data Engineer to build and operate an AWS-native data platform for healthcare claims. You will design Spark pipelines on S3, implement tokenization workflows, and ensure data integrity while working with cross-functional teams.

Qualifying candidates bring 2+ years in data engineering, strong Spark/SQL skills, and experience with Airflow and dbt. The role emphasizes privacy, security, and cost-aware optimization in a fixed-term, permanent contract environment.