Data Platform Engineer — Remote/Hybrid, AWS & ETL

Ellkay, Llc; Idaho; Hybrid; USD 180,000 - 200,000; Full time

Benefits offered by this job

Medical, Dental, and Vision benefits

Remote work options

401k with matching

Job summary

ELLKAY is seeking a software/data engineering professional to build and optimize data ingestion pipelines, transformation components, and orchestration across cloud platforms. You will collaborate with architects, QA, and product teams to deliver production-ready data solutions that scale across laboratories and ambulatory organizations.

The role emphasizes Python/SQL proficiency, experience with AWS, Snowflake, Spark, and strong CI/CD practices.

Qualifications

• Proficiency in Python and SQL.
• Experience developing production data pipelines and integrating databases, files, or APIs.
• Experience with a major cloud platform, preferably AWS.
• Understanding of data modeling, ETL/ELT, orchestration, and data quality.
• Experience with Git, automated testing, CI/CD, and production troubleshooting.

Responsibilities

• Build reusable ingestion pipelines and connectors for files, relational databases, and APIs.
• Develop transformation and source-to-target mapping components for shared data models.
• Implement schema validation, data profiling, quality checks, and source-to-target reconciliation.
• Build workflow orchestration with dependency management, retries, checkpoints, and controlled reprocessing.
• Develop backend services and APIs for processing requests, execution status, and delivery integration.
• Implement cloud storage and processing patterns for raw, staged, curated, and archived data.
• Add logging, lineage, metrics, alerts, and audit evidence to support troubleshooting and operational reporting.
• Improve pipeline performance, infrastructure utilization, and processing costs.
• Collaborate with architects, DME, QA, security, and product teams to deliver production-ready components.
• Maintain automated tests, deployment pipelines, technical documentation, and operational runbooks.

Skills

Python

SQL

Data pipelines

AWS

CI/CD

Git

Tools

Snowflake

Spark

Job description

ELLKAY is seeking a software/data engineering professional to build and optimize data ingestion pipelines, transformation components, and orchestration across cloud platforms. You will collaborate with architects, QA, and product teams to deliver production-ready data solutions that scale across laboratories and ambulatory organizations.

The role emphasizes Python/SQL proficiency, experience with AWS, Snowflake, Spark, and strong CI/CD practices.