Lead Data Engineer - Real-Time & GenAI Pipelines

The Hartford; Hinoba-an; On-site; PHP 1,979,000 - 2,969,000; Full time

Job summary

The Hartford is seeking a Lead Engineer, Data to head our data engineering and GenAI initiatives. You will oversee real-time streaming pipelines, design data products, and drive RAG architectures across multiple data domains.

Collaboration with cross-functional teams and governance practices are essential. Ideal candidates have strong Python, cloud, and AI model integration experience, with a track record in scalable data systems and mentoring junior engineers.

Qualifications

• Bachelor's or Master's degree in Computer Science, AI or related field.
• Data engineering with SQL/NoSQL, Snowflake, ETL/ELT, CICD, Big Data and cloud tech.
• Experience with cloud platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes).
• Experience with GenAI data solutions and building data/AI pipelines.

Responsibilities

• Lead data engineering and AI pipelines across large data ecosystems.
• Design, build and maintain real-time data streaming pipelines.
• Develop data domains and data products for reporting, analytics, and AI/ML.
• Implement Retrieval-Augmented Generation (RAG) architectures and integrate with enterprise data.

Skills

Real-Time Data Streaming

Kafka

AWS Kinesis

Spark Streaming

RAG pipelines

Neo4j

Python

GenAI

Data Governance

Cloud platforms

Education

Bachelor's or Master's in CS/AI

Tools

Kafka

Neo4j

Amazon Neptune

Spark

Langchain

Job description

The Hartford is seeking a Lead Engineer, Data to head our data engineering and GenAI initiatives. You will oversee real-time streaming pipelines, design data products, and drive RAG architectures across multiple data domains.

Collaboration with cross-functional teams and governance practices are essential. Ideal candidates have strong Python, cloud, and AI model integration experience, with a track record in scalable data systems and mentoring junior engineers.