Senior Data Engineer GenAI on AWS, RAG & AI Agents

BlackCube Labs

United States

Remote

USD 160,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

BlackCube Labs is seeking a Senior Data Engineer to design and build scalable data pipelines on AWS for GenAI workloads. You will implement document-processing workflows, vector indexing, and semantic search, while developing AI agents and knowledge bases to support Retrieval-Augmented Generation (RAG).

Proficiency in Python and cloud data architectures is essential. The role involves deploying AI agents with Claude SDK on Bedrock, crafting robust CI/CD pipelines, and ensuring security and

Qualifications

  • 14+ years of experience in data engineering or cloud data platforms.
  • Expertise with AWS data services and serverless architectures.
  • Experience building CI/CD pipelines.
  • Experience with GenAI, RAG and vector databases.
  • Strong Python development skills.

Responsibilities

  • Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
  • Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
  • Implement document chunking, embeddings, vector indexing, and semantic search.
  • Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
  • Integrate knowledge bases with AI agents for contextual information retrieval.
  • Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
  • Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
  • Optimize data pipelines for scalability, reliability, security, and performance.

Skills

Python
Data engineering
RAG
Vector databases
Knowledge bases

Tools

AWS Step Functions
AWS Lambda
Amazon S3
Textract
Comprehend
Bedrock AgentCore
Claude Agent SDK
GitHub Actions

Job description

BlackCube Labs is seeking a Senior Data Engineer to design and build scalable data pipelines on AWS for GenAI workloads. You will implement document-processing workflows, vector indexing, and semantic search, while developing AI agents and knowledge bases to support Retrieval-Augmented Generation (RAG).

Proficiency in Python and cloud data architectures is essential. The role involves deploying AI agents with Claude SDK on Bedrock, crafting robust CI/CD pipelines, and ensuring security and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior GenAI Data Engineer | AWS Pipelines & AI Agents
Senior GenAI Data Engineer | AWS Pipelines & AI Agents

Nexiva • Los Angeles (CA)

Hybrid
USD 140,000 - 180,000
Senior Data Engineer - GenAI & AWS (Remote/Hybrid)
Senior Data Engineer - GenAI & AWS (Remote/Hybrid)

BlackCube Labs • United States

Hybrid
USD 180,000 - 240,000
GenAI Data Engineer on AWS - AI Pipelines & Agents
GenAI Data Engineer on AWS - AI Pipelines & Agents

Unknown • United States

Remote
USD 180,000 - 260,000
Senior Data Engineer (GenAI / AWS) (Fully Remote)
Senior Data Engineer (GenAI / AWS) (Fully Remote)

Unknown • United States

Remote
USD 180,000 - 260,000
GenAI Data Engineer - AWS, RAG, Vector DB & Bedrock
GenAI Data Engineer - AWS, RAG, Vector DB & Bedrock

ZealHire Inc. • Los Angeles (CA)

Hybrid
USD 140,000 - 190,000
Senior Data Engineer (GenAI / AWS) | Claude Agent SDK | Amazon Bedrock | Python | 14+ years of experience
Senior Data Engineer (GenAI / AWS) | Claude Agent SDK | Amazon Bedrock | Python | 14+ years of experience

TMS • United States

Remote
USD 160,000 - 210,000
GenAI DevOps Engineer — AI Agent on AWS Bedrock
GenAI DevOps Engineer — AI Agent on AWS Bedrock

Nexiva • Los Angeles (CA)

On-site
USD 120,000 - 180,000
Senior AI Agent Engineer - Bedrock, Claude & Langfuse
Senior AI Agent Engineer - Bedrock, Claude & Langfuse

Nexiva • Los Angeles (CA)

On-site
USD 140,000 - 230,000
Senior Agentic AI Engineer: Bedrock/Claude & Langfuse
Senior Agentic AI Engineer: Bedrock/Claude & Langfuse

Nexiva • Los Angeles (CA)

On-site
USD 152,000 - 207,000
AI-Driven Cloud Data Engineer (AWS GenAI)
AI-Driven Cloud Data Engineer (AWS GenAI)

Innovative Solutions • United States

On-site
USD 130,000 - 180,000