Staff Data Engineer- Cloud Data Platform

Ellkay, Llc; United States; On-site; USD 120,000 - 180,000; Full time

Benefits offered by this job

Smoke-Free Workplace

Job summary

ELLKAY is seeking a Staff Data Engineer – Cloud Data Platform to design, develop, and operate scalable cloud-based data pipelines and processing capabilities for its Data Platform and Data Lake. The role is hands-on, collaborating with directors, staff engineers, architects, and product teams to onboard healthcare workloads using reusable patterns.

You will build batch, streaming, and near-real-time pipelines, create ingestion capabilities for diverse data sources, and implement data layers with

Qualifications

• Strong hands-on experience in data engineering and cloud data platforms.
• Experience developing production-grade ingestion and transformation pipelines.
• Strong SQL and Python skills.
• Experience with AWS, Snowflake, Spark, or equivalent modern data technologies.
• Understanding of data quality, reconciliation, metadata, monitoring, and CI/CD.
• Experience working with large, complex, or regulated datasets.

Responsibilities

• Design, develop, and operate scalable cloud-based data pipelines and processing capabilities.
• Convert Data Platform architecture into production-ready ingestion, transformation, data-quality, and data-serving capabilities.
• Onboard healthcare data workloads through reusable platform patterns.
• Build scalable batch, incremental, streaming, and near-real-time data pipelines.
• Develop ingestion capabilities for databases, files, SFTP, APIs, healthcare messages, events, and partner data.
• Implement raw, standardized, curated, and product-serving data layers.

Skills

SQL

Python

AWS

Snowflake

Spark

Data pipelines

Cloud data platforms

Tools

CI/CD

Job description

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Full Time IN

3 days ago Requisition ID: 1370

ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY’s solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting‑edge technologies and solutions that drive their growth and interoperability strategies.

Today, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today’s data‑rich world.

ELLKAY's experience, customer‑focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy.

Job Description:

The Staff Data Engineer – Cloud Data Platform will design, develop, and operate scalable cloud‑based data pipelines and processing capabilities for ELLKAY’s shared Data Platform and Data Lake.

This is a hands‑on engineering position responsible for converting the Data Platform architecture into production‑ready ingestion, transformation, data‑quality, and data‑serving capabilities. The engineer will work with the Director, Staff Engineers, Architects, and product teams to onboard healthcare data workloads through reusable platform patterns.

Build scalable batch, incremental, streaming, and near‑real‑time data pipelines.

Develop ingestion capabilities for databases, files, SFTP, APIs, healthcare messages, events, and partner data.

Implement raw, standardized, curated, and product‑serving data layers.

Preserve original source data and maintain traceability between source and transformed records.

Develop transformation, normalization, mapping, reconciliation, and validation workflows.

Implement data‑quality rules, exception handling, lineage, metadata, and audit controls.

Build solutions using AWS, Snowflake, SQL, Python, Spark or equivalent cloud data technologies.

Develop reusable pipeline templates, libraries, configuration patterns, and CI/CD components.

Implement automated unit, integration, regression, reconciliation, and performance tests.

Establish monitoring, logging, metrics, alerting, dashboards, and operational runbooks.

Optimize data‑processing performance, storage utilization, and cloud cost.

Support healthcare migration, LKOasis, LKOpera, eMPI, interoperability, analytics, and AI/ML use cases.

Participate in design reviews, code reviews, production support, root‑cause analysis, and performance tuning.

Produce clear technical documentation and onboarding instructions for reusable platform components.

Mentor junior and mid‑level data engineers without direct employee‑management responsibility.

Qualifications:

Strong hands‑on experience in data engineering and cloud data platforms.

Experience developing production‑grade ingestion and transformation pipelines.

Strong SQL and Python skills.

Experience with AWS, Snowflake, Spark, or equivalent modern data technologies.

Understanding of data quality, reconciliation, metadata, monitoring, and CI/CD.

Experience working with large, complex, or regulated datasets.

Healthcare data experience is preferred but not required.

Additional Information:

ELLKAY is committed to fostering a collaborative and high‑performance work environment that supports innovation, teamwork, and professional growth. Most roles are designed to operate from our office locations to encourage effective collaboration and engagement across teams.
Any alternative work arrangements may be considered at the company’s discretion based on role requirements and business needs.
For more information about our company, please visitwww.ELLKAY.com .
ELLKAY is a Smoke‑Free Workplace.

ELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.