Senior Data Engineer: AI-Powered Data Pipelines (Remote)

Ensemble Health Partners; United States; On-site; USD 101,600 - 175,200; Full time

Benefits offered by this job

Healthcare benefits

Tuition reimbursement

Professional certifications

Job summary

Ensemble Health Partners is seeking a Senior Data Engineer in the United States to build scalable data pipelines and platforms for analytics, reporting, and innovation across the organization.

You will collaborate with peers to influence engineering standards and deliver high-quality data solutions. This role requires expertise with SQL, Spark, Python, and Azure, and may involve travel to client sites or corporate offices as needed.

Qualifications

• 6+ years building solutions with Microsoft SQL.
• 3+ years with big data tools (Databricks, Spark, Python, Azure).
• Strong fundamentals: automated testing, code reviews, telemetry, DevOps.
• Experience with relational, columnar, key-value, graph storage.
• Delta Lake tables and Parquet data on ADLS experience.
• Experience building distributed, componentized apps using event-driven patterns.

Responsibilities

• Develop, test, deploy, monitor, and improve scalable data pipelines and API integrations.
• Apply generative AI tools to speed development and improve quality.
• Translate product concepts into incremental, high-quality technical deliverables.
• Contribute through design sessions and thorough code reviews.
• Implement data quality monitoring for reliable production data.
• Review architectural patterns aligned with enterprise platforms and best practices.
• Use generative AI to accelerate development and troubleshoot complex systems.

Skills

Microsoft SQL

Databricks

Apache Spark

Python

Azure (ADF/Functions)

Data quality monitoring

Software architecture

DevOps

HL7/EDI familiarity

Communication

Data storage architectures

Tools

Delta Lake

Parquet

ADLS

Event-driven patterns

Job description

Ensemble Health Partners is seeking a Senior Data Engineer in the United States to build scalable data pipelines and platforms for analytics, reporting, and innovation across the organization.

You will collaborate with peers to influence engineering standards and deliver high-quality data solutions. This role requires expertise with SQL, Spark, Python, and Azure, and may involve travel to client sites or corporate offices as needed.