Sr. Cloud Data Engineer

Ellkay, Llc; Elmwood Park, Northern (NJ, KY); Hybrid; USD 125,000 - 150,000; Full time

Benefits offered by this job

Medical, Dental, and Vision benefits

Employer-paid Life and LTD

401k with matching

Work/life balance

Remote work options

Employee Discounts

Gym membership / stipends

Job summary

ELLKAY is seeking a Senior Cloud Data Engineer in Elmwood Park, NJ to design, build, and operate cloud-native data pipelines for clinical data at scale.

You will collaborate with architecture, governance, QA, and product teams to modernize integrations into a secure, observable, reusable data platform. Strong cloud experience and healthcare data knowledge are essential.

Qualifications

• 5+ years in data engineering and cloud data platforms
• 2+ years building cloud-native solutions on AWS, Azure, or GCP
• Experience with Spark or Databricks
• Experience with Airflow, dbt, Prefect, or Dagster
• Experience with cloud storage/lakehouse technologies (S3/ADLS, Delta Lake, Iceberg, Hudi)
• Experience with Snowflake/Redshift/BigQuery/Synapse
• Experience with streaming/event-driven tech (Kafka, Kinesis, SQS/EventBridge)
• Familiarity with Docker, Kubernetes, Terraform, CI/CD, automated testing
• Understanding of data quality, de-duplication, governance

Responsibilities

• Build scalable data pipelines for batch and streaming workloads using Spark, Databricks, Airflow, and dbt
• Process healthcare data formats HL7, FHIR, X12/EDI, CCD/CCDA, and flat-files
• Build cloud lakehouse solutions with S3/ADLS, Delta Lake, Iceberg, or Hudi, plus Snowflake/Redshift
• Improve data quality via automated validation, cleansing, de-duplication, and schema validation
• Support MPI/EMPI data integration for patient/provider data
• Modernize legacy integrations into reusable, event-based patterns
• Ensure production reliability with monitoring, auditing, security, and observability
• Collaborate with teams to translate architecture into production-grade solutions meeting healthcare security

Skills

Python

SQL

Spark

Databricks

Airflow

dbt

Kafka

Kubernetes

Docker

Terraform

CI/CD

Data governance

Tools

Spark

Databricks

Airflow

dbt

Snowflake

Redshift

BigQuery

Synapse

Kafka

Kinesis

S3

ADLS

Delta Lake

Iceberg

Hudi

Docker

Kubernetes

Job description

Full Time Elmwood Park, NJ, US

Salary Range: $125,000.00 To $150,000.00 Annually

ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY’s solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting-edge technologies and solutions that drive their growth and interoperability strategies. Today, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today’s data-rich world. ELLKAY's experience, customer-focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy.

Job Description:

We are seeking a Senior Cloud Data Engineer to help build and scale our modern healthcare data platform. This hands-on role will design, build, and operate cloud-native data pipelines that ingest, cleanse, normalize, and deliver clinical and operational healthcare data at scale.

You will work closely with architecture, engineering, data governance, QA, and product teams to modernize legacy point-to-point integrations into a secure, scalable, observable, and reusable data platform.

• Build scalable data pipelines for batch and streaming workloads using technologies such as Spark, Databricks, Airflow, and dbt.
• Process healthcare data including HL7, FHIR, X12/EDI, CCD/CCDA, and flat-file formats.
• Build cloud lakehouse solutions using S3/ADLS, Delta Lake, Apache Iceberg, or Hudi, along with modern cloud data warehouses i.e. Snowflake, Redshift
• Improve data quality through automated validation, cleansing, de-duplication, schema validation, and quarantine workflows.
• Support identity resolution and master data by integrating patient/member, provider, subscriber, and reference data with MPI/EMPI capabilities.
• Modernize legacy integrations into reusable, configuration-driven, event-based, streaming, and API-based patterns.
• Build for production reliability with monitoring, alerting, audit logging, data lineage, security, and operational observability.
• Collaborate across teams to translate architecture into well-tested, production-grade solutions that meet healthcare security and compliance requirements.

Qualifications:

• 5+ years of data engineering experience, including 2+ years building cloud-native solutions on AWS, Azure, or GCP.
• Strong experience with Python and SQL and distributed data-processing technologies such as Apache Spark or Databricks.
• Experience with orchestration and transformation tools such as Airflow, dbt, Prefect, or Dagster.
• Experience with cloud storage/lakehouse technologies such as S3, ADLS, Delta Lake, Apache Iceberg, or Hudi.
• Experience with a modern data warehouse such as Snowflake, Redshift, BigQuery, or Synapse.
• Experience with streaming/event-driven technologies such as Kafka, Kinesis, SQS/EventBridge, RabbitMQ, Amazon MQ, or Azure Event Hubs.
• Familiarity with Docker, Kubernetes, Terraform, CI/CD, and automated testing.
• Understanding of data quality, de-duplication, master/reference data, security, and governance.

Technology Environment

Candidates do not need experience with every technology listed. Strong data-engineering fundamentals, cloud experience, and the ability to learn new technologies are most important.

ELLKAY offers a comprehensive and competitive benefit package that starts day one!

Including:

• Medical, Dental, and Vision benefits
• Employer-paid Life and LTD
• 401k w/ matching – once eligibility is met
• Work/life balance
• Generous FTORemote work options
• Employee Discounts
• Gym membership / Exercise class stipends

Our awesome culture includes:

• Working with talented, collaborative, and friendly people who love what they do
• Professional growth within
• Innovation environment
• On site in HQ Free daily lunches

Awards:

• 2025 Top Workplaces Employee Appreciation
• 2025 Top Workplaces Employee Well-Being
• 2025 Top Workplaces Professional Development
• 2026 NJ Top Workplaces

Additional information

At ELLKAY, we are committed to operating as a hybrid workplace, offering employees flexibility in how they structure their time between in-office and remote work. We recognize the significance of fostering connections, collaboration, and creativity within our office culture and its positive impact on our business. Our philosophy of operating as a hybrid workplace underscores our dedication to enabling employees to tailor work-life balance to their individual preferences. For those who do not live within 40 miles of one of our offices, we are open to considering remote work for candidates whose skills and experience strongly align with the role. While we prioritize a hybrid work environment for most roles, we understand the importance of flexibility and are open to remote work for specific positions and specialized skill sets.

For more information on our company, visit www.ELLKAY.com.

ELLKAY LLC is a Smoke-Free Workplace.

ELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.