Senior Data Ingestion Engineer - AWS Pipelines

ML arteka; Toronto; Híbrido; CAD 110.000 - 150.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Discounts on shopping & gym

Insurance plans

Office perks & coffee

Descripción de la vacante

ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You will own the design from S3 landing to Silver records, including provenance, schema enforcement, and quarantine handling.

You will collaborate with client data engineers in a joint codebase, review their connector code, and ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards.

Formación

• Strong Python production-quality coding skills.
• Experience building AWS data ingestion pipelines.
• Familiar with Apache Iceberg and schema evolution.
• Ability to collaborate in a co-development model with client teams.

Responsabilidades

• Design, build, test, and own source connectors from S3 landing to Silver records.
• Translate mapping specifications into connector logic with field mappings and derivations.
• Investigate source data behavior and document data issues.
• Implement bad-record quarantine with contextual reasons.
• Build source arrival monitoring, SLA alerts, and health dashboards.
• Collaborate with client data engineers in a co-development model.
• Participate in reconciliation runs and provide root-cause statements.
• Write connector unit and integration tests.

Conocimientos

Python

Data ingestion

AWS

Data quality

Code quality

Herramientas

S3

Glue ETL

Apache Iceberg

Airflow

MWAA

Descripción del empleo

ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You will own the design from S3 landing to Silver records, including provenance, schema enforcement, and quarantine handling.

You will collaborate with client data engineers in a joint codebase, review their connector code, and ensure production readiness with tests and observability across the pipeline, including CloudWatch dashboards.