Senior Data Engineer - AI Data Infra & RAG (Remote)

Eigenblue; New York (NY); Remote; USD 100,000 - 250,000; Full time

Benefits offered by this job

Health insurance

401(k) plan with company match

Annual learning & development budget

Generous PTO

Remote work with travel to HQ in EU

Job summary

eigenblue is assembling a world-class data engineering team to build scalable data infrastructure for its AI product. You will architect data platforms, implement RAG pipelines, and partner with AI engineers to bring advanced reasoning models to life.

You will design batch and real-time data processing, leverage cloud platforms, and mentor peers while delivering high-quality data solutions for diverse applications.

Qualifications

• BS/BA in CS, Software Eng, Data Science or related, with 4+ years in agile projects.
• Experience with data engineering for ML/AI production deployment/MLOps using cloud platforms (Azure, AWS and/or GCP) and designing architectures for data platforms and data processing pipelines, building batch and real-time streaming solutions (e.g., PySpark, Kafka).
• Experience with data warehousing services (AWS Redshift, Snowflake), LLM data stores, SQL/no-SQL tools and data management processes.
• Strong analytical and problem solving skills, comfortable with ambiguity and rapid changes common in early-stage product development.
• Expertise with AI tools and LLM providers, implementing advanced RAG pipelines (GraphRAG), multi-agent architectures, ML model training, LLM fine-tuning, RLHF, and LLM-as-a-judge metrics.

Responsibilities

• Build scalable data and analytics platforms including data stores/warehouses and RAG pipelines for AI systems.
• Collaborate with AI Engineers to design and test advanced AI reasoning solutions.
• Visualize data with dashboards and mentor engineers on data engineering best practices.
• Improve data ingestion and quality assurance with new tools and frameworks.
• Collaborate with stakeholders to integrate AI features into user-facing products.

Skills

4+ years agile development

Data engineering

ML/AI deployment

Analytical thinking

Communication

Education

CS/Software Engineering/Data Science degree

4+ years in agile projects

Tools

PySpark

Kafka

AWS

Azure

GCP

Redshift

Snowflake

LLM data stores

Job description

eigenblue is assembling a world-class data engineering team to build scalable data infrastructure for its AI product. You will architect data platforms, implement RAG pipelines, and partner with AI engineers to bring advanced reasoning models to life.

You will design batch and real-time data processing, leverage cloud platforms, and mentor peers while delivering high-quality data solutions for diverse applications.