Senior Data Engineer (GenAI / AWS) | Claude Agent SDK | Amazon Bedrock | Python | 14+ years of experience

TMS

United States

Remote

USD 160,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

BlackCube Labs is seeking a Senior Data Engineer to design and build scalable data pipelines on AWS for GenAI workloads. You will implement document-processing workflows, vector indexing, and semantic search, while developing AI agents and knowledge bases to support Retrieval-Augmented Generation (RAG).

Proficiency in Python and cloud data architectures is essential. The role involves deploying AI agents with Claude SDK on Bedrock, crafting robust CI/CD pipelines, and ensuring security and

Qualifications

  • 14+ years of experience in data engineering or cloud data platforms.
  • Expertise with AWS data services and serverless architectures.
  • Experience building CI/CD pipelines.
  • Experience with GenAI, RAG and vector databases.
  • Strong Python development skills.

Responsibilities

  • Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
  • Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
  • Implement document chunking, embeddings, vector indexing, and semantic search.
  • Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
  • Integrate knowledge bases with AI agents for contextual information retrieval.
  • Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
  • Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
  • Optimize data pipelines for scalability, reliability, security, and performance.

Skills

Python
Data engineering
RAG
Vector databases
Knowledge bases

Tools

AWS Step Functions
AWS Lambda
Amazon S3
Textract
Comprehend
Bedrock AgentCore
Claude Agent SDK
GitHub Actions

Job description

Job Description

Senior Data Engineer (GenAI / AWS)

Duration: 3+ Months (Extension Possible)

Experience: 14+ years Cloud Platform: AWS Primary Language: Python

Key Responsibilities
  • Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
  • Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
  • Implement document chunking, embeddings, vector indexing, and semantic search.
  • Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
  • Integrate knowledge bases with AI agents for contextual information retrieval.
  • Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
  • Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
  • Optimize data pipelines for scalability, reliability, security, and performance.
Additional Information

All your information will be kept confidential according to EEO guidelines.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Role: Senior Data Engineer (GenAI / AWS) | Amazon Bedrock | Claude Agent SDK | Python | 14+ years of experience
Remote Role: Senior Data Engineer (GenAI / AWS) | Amazon Bedrock | Claude Agent SDK | Python | 14+ years of experience

TMS LLC • United States

Hybrid
USD 150,000 - 210,000
Remote Role: Senior Data Engineer (GenAI / AWS) | Amazon Bedrock | Claude Agent
Remote Role: Senior Data Engineer (GenAI / AWS) | Amazon Bedrock | Claude Agent

TMS, LLC • United States

Hybrid
USD 96,000 - 165,000
Senior Data Engineer (GenAI / AWS)
Senior Data Engineer (GenAI / AWS)

ZealHire Inc. • Los Angeles (CA)

Hybrid
USD 140,000 - 190,000
Senior Data Engineer (GenAI / AWS) (Fully Remote)
Senior Data Engineer (GenAI / AWS) (Fully Remote)

Unknown • United States

Remote
USD 180,000 - 260,000
Sr. Data Engineer (GenAI & AWS) Remote/Hybrid with Travel
Sr. Data Engineer (GenAI & AWS) Remote/Hybrid with Travel

Simple Solutions • United States

Hybrid
USD 180,000 - 240,000
GenAI DevOps Engineer
GenAI DevOps Engineer

ZealHire Inc. • Los Angeles (CA)

Remote
USD 83,000 - 165,000
GenAI Data Engineer on AWS - AI Pipelines & Agents
GenAI Data Engineer on AWS - AI Pipelines & Agents

Unknown • United States

Remote
USD 180,000 - 260,000
ZR_3091_JOB
ZR_3091_JOB

Simple Solutions • Jacksonville (FL)

Hybrid
USD 150,000 - 190,000
Senior Data Engineer GenAI on AWS, RAG & AI Agents
Senior Data Engineer GenAI on AWS, RAG & AI Agents

BlackCube Labs • United States

Remote
USD 160,000 - 210,000
Senior Agentic AI Engineer - AWS Bedrock/Claude (Contract, PST Remote)
Senior Agentic AI Engineer - AWS Bedrock/Claude (Contract, PST Remote)

Tech Junction Ltd • Los Angeles (CA)

Hybrid
USD 180,000 - 260,000