Remote Data Engineer - AI/ML Data Pipelines

Humana; Louisville (KY); Remote; USD 98,000 - 134,000; Full time

Job summary

Humana is seeking a Data Engineer 2 to join our team and help us improve member health outcomes through data-driven insights. You will ingest data from diverse sources, build AI and ML enabled data pipelines, and apply best practices for reliability and performance.

You will work with Azure Data Factory, Synapse, ADLS, Databricks, and CI/CD in a remote US setting, with up to travel for meetings as needed. The role requires collaboration and problem solving.

Qualifications

• Bachelor's degree or 5 years of technical experience.
• 5 years of experience with Databricks, Spark, and Scala.
• Knowledge of SQL and relational database models.
• Document processes related to database design, configuration, and performance.
• Experience designing, developing, and testing software applications and/or infrastructure.
• Experience with APIs to expose large datasets to applications and data analytics solutions.
• Experience with Azure Cloud: Azure Data Factory, Pipelines, Azure Synapse Analytics, and ADLS.
• Experience with development, release and support of data processing pipelines.
• Experience with test automation frameworks and tools.
• Experience with Agile, CI/CD.

Responsibilities

• Ingests data from internal and external sources utilizing cloud native platforms and software development best practices and patterns.
• Develops software tools that leverage AI, ML, and big-data techniques to cleanse, organize, and transform data into insights and actions.
• Understands department, segment, and organizational strategy and operating objectives.
• Makes decisions regarding own work methods, occasionally in ambiguous situations, and requires minimal direction.
• Follows established guidelines/procedures.
• Must be passionate about contributing to an organization focused on continuously improving consumer experiences

Skills

Databricks

Spark

Scala

SQL

APIs

Azure Cloud

CI/CD

Test automation

Agile methodologies

Data pipelines

Education

Bachelor's degree or 5 years of technical experience

Tools

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake Storage

Terraform

Job description

Humana is seeking a Data Engineer 2 to join our team and help us improve member health outcomes through data-driven insights. You will ingest data from diverse sources, build AI and ML enabled data pipelines, and apply best practices for reliability and performance.

You will work with Azure Data Factory, Synapse, ADLS, Databricks, and CI/CD in a remote US setting, with up to travel for meetings as needed. The role requires collaboration and problem solving.