Sr. Cloud Data Engineer

Socket.dev; Elmwood Park (NJ); Hybrid; USD 130,000 - 170,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

Life insurance

Long-term disability

401k matching

Work-life balance

Volunteer program

Flexible hours

Remote work options

Employee discounts

Parental leave

Gym stipend

Job summary

ELLKAY is seeking a Senior Cloud Data Engineer to design, build, and operate cloud-native data pipelines that ingest, cleanse, normalize, and deliver healthcare data at scale. You will collaborate with architecture, engineering, data governance, QA and product teams to modernize legacy point-to-point integrations into a secure, scalable data platform.

You will lead batch and streaming workloads with Spark, Databricks, Airflow and dbt; process HL7, FHIR, X12/EDI data; and implement lakehouse

Qualifications

• 5+ years of data engineering experience, including 2+ years building cloud-native solutions on AWS, Azure, or GCP.
• Strong experience with Python and SQL and distributed data-processing technologies such as Apache Spark or Databricks.
• Experience with orchestration and transformation tools such as Airflow, dbt, Prefect, or Dagster.
• Experience with cloud storage/lakehouse technologies such as S3, ADLS, Delta Lake, Apache Iceberg, or Hudi.
• Experience with a modern data warehouse such as Snowflake, Redshift, BigQuery, or Synapse.
• Experience with streaming/event-driven technologies such as Kafka, Kinesis, SQS/EventBridge, RabbitMQ, Amazon MQ, or Azure Event Hubs.
• Familiarity with Docker, Kubernetes, Terraform, CI/CD, and automated testing.
• Understanding of data quality, de-duplication, master/reference data, security, and governance.

Responsibilities

• Build scalable data pipelines for batch and streaming workloads using Spark, Databricks, Airflow, and dbt.
• Process healthcare data including HL7, FHIR, X12/EDI, CCD/CCDA, and flat-file formats.
• Build cloud lakehouse solutions using S3/ADLS, Delta Lake, Apache Iceberg, or Hudi, along with modern cloud data warehouses i.e. Snowflake, Redshift.
• Improve data quality through automated validation, cleansing, de-duplication, schema validation, and quarantine workflows.
• Support identity resolution and master data by integrating patient/member, provider, subscriber, and reference data with MPI/EMPI capabilities.
• Modernize legacy integrations into reusable, configuration-driven, event-based, streaming, and API-based patterns.
• Build for production reliability with monitoring, alerting, audit logging, data lineage, security, and operational observability.
• Collaborate across teams to translate architecture into well-tested, production-grade solutions that meet healthcare security and compliance requirements.

Skills

Python

SQL

Spark/Databricks

Airflow

dbt

FHIR/HL7

Cloud (AWS/Azure/GCP)

Docker/Kubernetes

Data governance

Security/compliance

Tools

Snowflake

Redshift

Delta Lake

Iceberg

S3/ADLS

Kafka

Kinesis

Job description

ELLKAY started out providing connectivity solutions to laboratories and within a few years, grew to also provide data management solutions to ambulatory organizations. ELLKAY is now a trusted data management partner in five healthcare segments. ELLKAY's solutions continue to serve laboratories and ambulatory practices and have expanded to empower hospitals and health systems, healthcare IT vendors, ambulatory practices, health plans, and other healthcare organizations with cutting-edge technologies and solutions that drive their growth and interoperability strategies.

Today, ELLKAY remains true to our core values, building strong partner relationships and offering unparalleled service and support while providing innovative, scalable solutions to the challenges our customers face in today’s data-rich world.

ELLKAY's experience, customer-focused approach, and reputation for innovation, speed, and accuracy differentiate ELLKAY as a premier partner for your interoperability needs and data management strategy.

Job Description

We are seeking a Senior Cloud Data Engineer to help build and scale our modern healthcare data platform. This hands-on role will design, build, and operate cloud-native data pipelines that ingest, cleanse, normalize, and deliver clinical and operational healthcare data at scale.

You will work closely with architecture, engineering, data governance, QA, and product teams to modernize legacy point-to-point integrations into a secure, scalable, observable, and reusable data platform.

Essential Duties & Responsibilities

• Build scalable data pipelines for batch and streaming workloads using technologies such as Spark, Databricks, Airflow, and dbt.
• Process healthcare data including HL7, FHIR, X12/EDI, CCD/CCDA, and flat-file formats.
• Build cloud lakehouse solutions using S3/ADLS, Delta Lake, Apache Iceberg, or Hudi, along with modern cloud data warehouses i.e. Snowflake, Redshift
• Improve data quality through automated validation, cleansing, de-duplication, schema validation, and quarantine workflows.
• Support identity resolution and master data by integrating patient/member, provider, subscriber, and reference data with MPI/EMPI capabilities.
• Modernize legacy integrations into reusable, configuration-driven, event-based, streaming, and API-based patterns.
• Build for production reliability with monitoring, alerting, audit logging, data lineage, security, and operational observability.
• Collaborate across teams to translate architecture into well-tested, production-grade solutions that meet healthcare security and compliance requirements.

Qualifications

• 5+ years of data engineering experience, including 2+ years building cloud-native solutions on AWS, Azure, or GCP.
• Strong experience with Python and SQL and distributed data-processing technologies such as Apache Spark or Databricks.
• Experience with orchestration and transformation tools such as Airflow, dbt, Prefect, or Dagster.
• Experience with cloud storage/lakehouse technologies such as S3, ADLS, Delta Lake, Apache Iceberg, or Hudi.
• Experience with a modern data warehouse such as Snowflake, Redshift, BigQuery, or Synapse.
• Experience with streaming/event-driven technologies such as Kafka, Kinesis, SQS/EventBridge, RabbitMQ, Amazon MQ, or Azure Event Hubs.
• Familiarity with Docker, Kubernetes, Terraform, CI/CD, and automated testing.
• Understanding of data quality, de-duplication, master/reference data, security, and governance.

Technology Environment

AWS / Azure / GCP Python SQL Spark Databricks Airflow dbt Kafka SQS/EventBridge S3 / ADLS Iceberg / Delta Lake Snowflake / Redshift / BigQuery Docker Kubernetes Terraform HL7 FHIR X12/EDI

Candidates do not need experience with every technology listed. Strong data-engineering fundamentals, cloud experience, and the ability to learn new technologies are most important.

Benefits

ELLKAY offers a comprehensive and competitive benefit package that starts day one!

Including

• Medical, Dental, and Vision benefits
• Employer-paid Life and LTD
• 401k w/ matching - once eligibility is met
• Work/life balance
• Paid Volunteer Program
• Flexible working hours
• Generous FTO
• Remote work options
• Employee Discounts
• Parental Leave
• Gym membership / Exercise class stipends

Our awesome culture includes

• Working with talented, collaborative, and friendly people who love what they do
• Professional growth within
• Innovation environment
• On site in HQ Free daily lunches

Awards

• 2025 Top Workplaces Employee Appreciation
• 2025 Top Workplaces Employee Well-Being
• 2025 Top Workplaces Professional Development
• 2025 Top Workplaces Leadership
• 2026 USA Today Top Workplaces
• 2026 NJ Top Workplaces

Additional information

At ELLKAY, we are committed to operating as a hybrid workplace, offering employees flexibility in how they structure their time between in-office and remote work. We recognize the significance of fostering connections, collaboration, and creativity within our office culture and its positive impact on our business. Our philosophy of operating as a hybrid workplace underscores our dedication to enabling employees to tailor work-life balance to their individual preferences. For those who do not live within 40 miles of one of our offices, we are open to considering remote work for candidates whose skills and experience strongly align with the role. While we prioritize a hybrid work environment for most roles, we understand the importance of flexibility and are open to remote work for specific positions and specialized skill sets.

For more information on our company, visit www.ELLKAY.com.

ELLKAY LLC is a Smoke-Free Workplace.

ELLKAY, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.