Remote Data Engineer: AI-Driven Pipelines

Talentify; Louisville (KY); Remote; USD 98,000 - 134,000; Full time

Benefits offered by this job

Bonus eligibility

Job summary

Humana is seeking a Data Engineer 2 to join our data platform team. You will design and implement data pipelines, ingest data from diverse sources, and build tools that leverage AI/ML and big-data techniques to transform data into actionable insights.

You will work within an Agile environment, following CI/CD practices to deliver reliable data solutions. The role emphasizes collaboration with stakeholders, adherence to guidelines, and supporting initiatives to improve member experiences through

Qualifications

• Bachelor's degree or 5 years of technical experience.
• 5 years of experience with Databricks, Spark, and Scala.
• Knowledge of SQL and relational database models.
• Document processes related to database design, configuration, and performance.
• Experience designing, developing, and testing software applications/infrastructure.
• Experience with APIs to expose large datasets to apps and analytics solutions.
• Experience with Azure Cloud: ADF, Synapse, ADLS; CI/CD and test automation.
• Experience with Agile methodologies and CI/CD pipelines.

Responsibilities

• Ingests data from internal and external sources using cloud-native platforms.
• Develops tools leveraging AI, ML, and big-data to cleanse and transform data.
• Aligns work with department strategy and operating objectives.
• Makes decisions about work methods with minimal direction.
• Follows established guidelines and procedures.
• Contributes to improving consumer experiences through data engineering.

Skills

Databricks

Spark

Scala

SQL

API design

Azure Data Factory

Azure Synapse

Azure Data Lake Storage

CI/CD

Terraform

Agile

Education

Bachelor's degree

Tools

Azure Data Factory (ADF)

Azure Synapse Analytics

Azure Data Lake Storage

Terraform

Job description

Humana is seeking a Data Engineer 2 to join our data platform team. You will design and implement data pipelines, ingest data from diverse sources, and build tools that leverage AI/ML and big-data techniques to transform data into actionable insights.

You will work within an Agile environment, following CI/CD practices to deliver reliable data solutions. The role emphasizes collaboration with stakeholders, adherence to guidelines, and supporting initiatives to improve member experiences through