Generative AI Data Engineer - Remote

The Hartford; Columbus (OH); Remote; USD 123,000 - 185,000; Full time

Job summary

Join a forward-thinking insurance company as a Staff Data Engineer, where you'll build innovative solutions to support Generative AI applications. This role offers the chance to design fault-tolerant infrastructure and develop data pipelines that drive innovation at scale. Collaborate with diverse teams to turn research into scalable solutions, while enjoying a hybrid work arrangement. If you have a passion for technology and a knack for problem-solving, this is the perfect opportunity to make a significant impact in a dynamic environment.

Qualifications

• 4+ years of AWS experience and 8+ years in data-intensive solutions.
• Strong programming skills in Python and Java with a focus on AI applications.

Responsibilities

• Design and build fault-tolerant infrastructure for Generative AI applications.
• Collaborate with cross-functional teams to develop scalable solutions.

Skills

Python

Java

Problem-solving

Natural Language Processing

Deep Learning

Distributed Computing

Agile Methodologies

Data Engineering

Education

Bachelor's degree in Computer Science

Bachelor's degree in Computer Engineering

Tools

AWS

Terraform

Jenkins

GitHub Actions

OpenSearch

ECS/Docker

Job description

Staff Data Engineer - GE07CE

We’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals – and to help others accomplish theirs, too. Join our team as we help shape the future.

At the Hartford, we are seeking a GEN AI Data Engineer who is responsible for building fault-tolerant infrastructure to support the Generative AI applications, and also designing, developing, and deploying data pipelines to solve complex problems and drive innovation at scale.

This role requires versatility and expertise across a wide range of skills. Someone with a diverse background/experience and an engineer at heart will fit into this role seamlessly.

The Generative AI team is comprised of a multiple cross-functional group that works in unison and ensures a sound move from our research activities to scalable solutions. You will collaborate closely with our cloud, security, infrastructure, enterprise architecture, and data science teams to conceive and execute essential functionalities.

This role has a Hybrid work arrangement. Candidates who live near one of our office locations (Hartford, CT, Charlotte, NC, Chicago, IL, Columbus, OH) will have the expectation of working in an office 3 days a week (Tuesday through Thursday).

Candidates must be eligible to work in the US without sponsorship now or in the future.

Responsibilities:

• Design and build fault-tolerant infrastructure to support the Generative AI architecture (RAG, Summarization, Agent etc).
• Ensure code is delivered without vulnerabilities by enforcing engineering practices, code scanning, etc.
• Build and maintain IAC (Terraform/Cloud Formation), CICD (Jenkins) scripts, CodePipeline, uDeploy, & GitHub Actions.
• Partner with shared service teams like Architecture, Cloud, Security, etc., to design and implement platform solutions.
• Collaborate with the DS team to develop a self-service internal developer Generative AI platform.
• Design and build the Data ingestion pipeline for Fine-tuning LLM Models.
• Create templates (Architecture As Code) implementing Ref architecture application’s topology.
• Build a feedback system using HITL for Supervised fine-tuning.

Qualifications:

• Bachelor's degree in Computer Science, Computer Engineering, or a technical field.
• 4+ years of experience with AWS cloud.
• At least 8 years of experience designing and building data-intensive solutions using distributed computing.
• 8+ years building and shipping software and/or platform infrastructure solutions for enterprises.
• Experience with CI/CD pipelines, Automated Testing, Automated Deployments, Agile methodologies, Unit Testing, and Integration Testing tools.
• Experience with building scalable serverless applications (real-time / batch) on AWS stack (Lambda + Step Function).
• Knowledge of distributed NoSQL database systems.
• Experience with data engineering, ETL technology, and conversation UX is a plus.
• Experience with HPCs, vector embedding, and Hybrid/Semantic search technologies.
• Experience with AWS OpenSearch, Step/Lambda Functions, SageMaker, API Gateways, ECS/Docker is a plus.
• Proficiency in customization techniques across various stages of the RAG pipeline, including model fine-tuning, retrieval re-ranking, and hierarchical navigable small-world graph (HNSW) is a plus.
• Strong proficiency in embeddings, ANN/KNN, vector stores, database optimization, & performance tuning.
• Extensive programming experience with Python and Java.
• Experience with LLM orchestration frameworks like Langchain, LlamaIndex, etc.
• Foundational understanding of Natural Language Processing and Deep Learning.
• Excellent problem-solving skills and the ability to work in a collaborative team environment.
• Excellent communication skills.
• Candidate must be authorized to work in the US without company sponsorship. The company will not support the STEM OPT I-983 Training Plan endorsement for this position.

Compensation:

The listed annualized base pay range is primarily based on analysis of similar positions in the external market. Actual base pay could vary and may be above or below the listed range based on factors including but not limited to performance, proficiency, and demonstration of competencies required for the role. The base pay is just one component of The Hartford’s total compensation package for employees. Other rewards may include short-term or annual bonuses, long-term incentives, and on-the-spot recognition. The annualized base pay range for this role is:

$123,280 - $184,920

Equal Opportunity Employer/Females/Minorities/Veterans/Disability/Sexual Orientation/Gender Identity or Expression/Religion/Age

About Us | Culture & Employee Insights | Diversity, Equity and Inclusion | Benefits