Data Platform Engineer - Cloud & Data Engineer

Ellkay, Llc; Indiana; Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Ellkay, Llc is seeking a skilled Senior Data Engineer to build and optimize data ingestion pipelines and reusable components. You will transform and map data across sources, implement quality controls, and orchestrate workflows that power analytics and downstream delivery.

You will collaborate with architects, QA, security, and product teams to deliver robust, production-ready solutions, while maintaining tests and runbooks in a hybrid-office environment.

Qualifications

• Proficiency in Python and SQL.
• Experience developing production data pipelines and integrating databases, files, or APIs.
• Experience with a major cloud platform, preferably AWS.
• Understanding of data modeling, ETL/ELT, orchestration, and data quality.
• Experience with Git, automated testing, CI/CD, and production troubleshooting.

Responsibilities

• Build reusable ingestion pipelines and connectors for files, relational databases, and APIs.
• Develop transformation and source-to-target mapping components for shared data models.
• Implement schema validation, data profiling, quality checks, and source-to-target reconciliation.
• Build workflow orchestration with dependency management, retries, checkpoints, and controlled reprocessing.
• Develop backend services and APIs for processing requests, execution status, and delivery integration.
• Implement cloud storage and processing patterns for raw, staged, curated, and archived data.
• Add logging, lineage, metrics, alerts, and audit evidence to support troubleshooting and operational reporting.
• Improve pipeline performance, infrastructure utilization, and processing costs.
• Collaborate with architects, DME, QA, security, and product teams to deliver production-ready components.
• Maintain automated tests, deployment pipelines, technical documentation, and operational runbooks.

Skills

Python

SQL

AWS

Data modeling

ETL/ELT

CI/CD

Tools

Snowflake

Spark

Lakehouse tech

IaC / containers

Job description

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Engineering Shared Services Full Time IN

2 days ago Requisition ID: 1412

ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY’s solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting-edge technologies and solutions that drive their growth and interoperability strategies. Today, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today’s data-rich world. ELLKAY's experience, customer-focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy.

Job Description:

Key responsibilities

• Build reusable ingestion pipelines and connectors for files, relational databases, and APIs.
• Develop transformation and source-to-target mapping components for shared data models.
• Implement schema validation, data profiling, quality checks, and source-to-target reconciliation.
• Build workflow orchestration with dependency management, retries, checkpoints, and controlled reprocessing.
• Develop backend services and APIs for processing requests, execution status, and delivery integration.
• Implement cloud storage and processing patterns for raw, staged, curated, and archived data.
• Add logging, lineage, metrics, alerts, and audit evidence to support troubleshooting and operational reporting.
• Improve pipeline performance, infrastructure utilization, and processing costs.
• Collaborate with architects, DME, QA, security, and product teams to deliver production-ready components.
• Maintain automated tests, deployment pipelines, technical documentation, and operational runbooks.

Required qualifications

• Proficiency in Python and SQL.
• Experience developing production data pipelines and integrating databases, files, or APIs.
• Experience with a major cloud platform, preferably AWS.
• Understanding of data modeling, ETL/ELT, orchestration, and data quality.
• Experience with Git, automated testing, CI/CD, and production troubleshooting.

Preferred qualifications

• Snowflake, Spark, lakehouse technologies, or large-scale data processing.
• Infrastructure as code, containers, and event-driven architectures.

At ELLKAY, we are committed to operating as a hybrid workplace, offering employees flexibility in how they structure their time between in-office and remote work. We recognize the significance of fostering connections, collaboration, and creativity within our office culture and its positive impact on our business. Our philosophy of operating as a hybrid workplace underscores our dedication to enabling employees to tailor work-life balance to their individual preferences. For those who do not live within 40 miles of one of our offices, we are open to considering remote work for candidates whose skills and experience strongly align with the role. While we prioritize a hybrid work environment for most roles, we understand the importance of flexibility and are open to remote work for specific positions and specialized skill sets.

For more information on our company, visit www.ELLKAY.com.

ELLKAY LLC is a Smoke-Free Workplace.

ELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.