Senior Data Engineer: Scalable Pipelines & AI

Humana Inc; Trenton (NJ); Remote; USD 118,000 - 162,000; Full time

Benefits offered by this job

Health benefits

401K

Paid time off

Work-life balance

Job summary

Humana Inc. is seeking a Senior Data Engineer to design and maintain scalable data pipelines and data-driven solutions. You will work with cross-functional partners to ingest data from internal and external sources using cloud-native platforms and best practices.

The role emphasizes high data quality, reliability, and performance while enabling AI/ML initiatives to transform data into actionable insights for members. This remote role offers opportunities to impact healthcare data strategy.

Qualifications

• Bachelor’s degree in a science, engineering, or computing related discipline or equivalent practical experience.
• 8+ years of experienced designing and building production grade batch data pipelines for data ingestion and transformation.
• 8+ years of overall experience in data engineering or related roles.
• Strong proficiency in SQL, Databricks, Python, Apache Spark, Git, Azure Services (Synapse, Azure ADLS Gen 2).
• Strong understanding of relational database principles, data modeling, database management, and data warehousing.
• Strong knowledge of Big Data querying tools.
• Experience optimizing large-scale data pipelines and ETL workflows.
• Excellent communication and interpersonal skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines and workflows using Azure Databricks.
• Develop and maintain SAS programs and SSIS packages for intermediate and downstream data processing.
• Write, optimize, and maintain complex SQL queries to support data transformation and analytical use cases.
• Design and build ETL/ELT pipelines integrating data from multiple internal and external source systems.
• Select, implement, and support Big Data tools and frameworks for data processing and integration.
• Monitor, troubleshoot, and resolve complex data processing issues, applying root cause analysis and preventative fixes.
• Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
• Recommend and support infrastructure improvements to meet evolving data volume and processing demands.
• Partner with product management and SRE teams to define requirements and translate them into actionable engineering work.
• Collaborate with engineers, stakeholders, and cross functional teams to ensure alignment on data strategy, architecture, and outcomes.

Skills

SQL

Databricks

Python

Apache Spark

Git

Azure Services

Big Data querying tools

Education

Bachelor’s degree in science/engineering/computing or equivalent

Tools

SAS

SSIS

Azure Databricks

Job description

Humana Inc. is seeking a Senior Data Engineer to design and maintain scalable data pipelines and data-driven solutions. You will work with cross-functional partners to ingest data from internal and external sources using cloud-native platforms and best practices.

The role emphasizes high data quality, reliability, and performance while enabling AI/ML initiatives to transform data into actionable insights for members. This remote role offers opportunities to impact healthcare data strategy.