Cloud Data Platform Engineer | Python, ETL & Pipelines

Ellkay, Llc; Indiana; Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Ellkay, Llc is seeking a skilled Senior Data Engineer to build and optimize data ingestion pipelines and reusable components. You will transform and map data across sources, implement quality controls, and orchestrate workflows that power analytics and downstream delivery.

You will collaborate with architects, QA, security, and product teams to deliver robust, production-ready solutions, while maintaining tests and runbooks in a hybrid-office environment.

Qualifications

• Proficiency in Python and SQL.
• Experience developing production data pipelines and integrating databases, files, or APIs.
• Experience with a major cloud platform, preferably AWS.
• Understanding of data modeling, ETL/ELT, orchestration, and data quality.
• Experience with Git, automated testing, CI/CD, and production troubleshooting.

Responsibilities

• Build reusable ingestion pipelines and connectors for files, relational databases, and APIs.
• Develop transformation and source-to-target mapping components for shared data models.
• Implement schema validation, data profiling, quality checks, and source-to-target reconciliation.
• Build workflow orchestration with dependency management, retries, checkpoints, and controlled reprocessing.
• Develop backend services and APIs for processing requests, execution status, and delivery integration.
• Implement cloud storage and processing patterns for raw, staged, curated, and archived data.
• Add logging, lineage, metrics, alerts, and audit evidence to support troubleshooting and operational reporting.
• Improve pipeline performance, infrastructure utilization, and processing costs.
• Collaborate with architects, DME, QA, security, and product teams to deliver production-ready components.
• Maintain automated tests, deployment pipelines, technical documentation, and operational runbooks.

Skills

Python

SQL

AWS

Data modeling

ETL/ELT

CI/CD

Tools

Snowflake

Spark

Lakehouse tech

IaC / containers

Job description

Ellkay, Llc is seeking a skilled Senior Data Engineer to build and optimize data ingestion pipelines and reusable components. You will transform and map data across sources, implement quality controls, and orchestrate workflows that power analytics and downstream delivery.

You will collaborate with architects, QA, security, and product teams to deliver robust, production-ready solutions, while maintaining tests and runbooks in a hybrid-office environment.