Gen AI platform Engineer

DATAECONOMY Inc; Boston (MA); On-site; USD 150,000 - 190,000; Full time

Job summary

DATAECONOMY Inc. in Boston, MA is seeking a Senior GenAI Platform Engineer to design and operate an enterprise AI agent platform.

You will work hands‑on in code, building durable asynchronous orchestration, RAG pipelines, and secure multi‑agent workflows on AWS as an individual contributor. Responsibilities include creating backend services with FastAPI, implementing idempotent dispatch, writing Terraform, and integrating with vector DBs and messaging systems.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5–8 years of professional software engineering experience.
• 2+ years of hands‑on GenAI/Agentic AI applications in production.

Responsibilities

• Build AI agents and multi‑agent workflows using Amazon Bedrock, Bedrock Agents, AgentCore, LangChain, and LangGraph.
• Design and implement RAG pipelines, prompt engineering strategies, and AI guardrails.
• Build backend services in FastAPI for agent submission, execution, lifecycle state machines, and status tracking.
• Implement queue‑based dispatch and durable state stores, ensuring idempotency, retries, and failure recovery.
• Write Infrastructure as Code (Terraform) to provision and manage agent infrastructure on AWS.
• Integrate agents with vector databases, enterprise messaging systems, and internal workflow tools.
• Instrument services for observability — structured logging, tracing, metrics.
• Participate in code reviews and architecture discussions as a peer contributor.
• Write clear technical documentation (design docs, runbooks) for systems you build.

Skills

Python expert

REST API design

Distributed systems

Education

Bachelor's degree in CS/IS/Engineering

5-8 years software engineering

2+ years GenAI production

Tools

FastAPI

Terraform

Docker

AWS

Kafka/SQS

LangChain

Bedrock

Vector DBs

Job description

GenAI Platform Engineer

Boston, MA

Full-time role

Experience: 10+yrs

About The Role

We''''''''re looking for a Senior GenAI Platform Engineer to build and operate our enterprise AI agent platform — hands‑on, in the code, every day. This is an individual contributor role with no direct reports. You''''''''ll design and build durable asynchronous orchestration, RAG pipelines, and secure multi‑agent workflows on AWS, working alongside a small team of peer engineers. You''''''''ll participate in architecture discussions and code reviews as a strong technical contributor, not as a manager.

Education & Experience

• Bachelor’s degree in computer science, Information Systems, Engineering, or equivalent practical experience.
• 5–8 years of professional software engineering experience.
• 2+ years of hands‑on experience building GenAI/Agentic AI applications in production.

What You''''''''ll Do

• Build AI agents and multi‑agent workflows using Amazon Bedrock, Bedrock Agents, AgentCore, LangChain, and LangGraph.
• Design and implement RAG pipelines, prompt engineering strategies, and AI guardrails.
• Build backend services in FastAPI for agent submission, execution, lifecycle state machines, and status tracking.
• Implement queue‑based dispatch and durable state stores, ensuring idempotency, retries, and failure recovery.
• Write Infrastructure as Code (Terraform) to provision and manage agent infrastructure on AWS.
• Integrate agents with vector databases, enterprise messaging systems, and internal workflow tools.
• Instrument services for observability — structured logging, tracing, metrics.
• Participate in code reviews and architecture discussions as a peer contributor.
• Write clear technical documentation (design docs, runbooks) for systems you build.

Required Qualifications

• Expert‑level Python, with strong experience building REST APIs (FastAPI preferred).
• Hands‑on experience with LLMs, Amazon Bedrock (Agents & AgentCore), LangChain, LangGraph, RAG, and vector databases.
• Strong experience with core AWS services: Lambda, ECS/EKS, API Gateway, S3, RDS/PostgreSQL.
• Working proficiency in Terraform and Docker.
• Experience with CI/CD pipelines (GitHub Actions, GitLab CI, or Jenkins).
• Solid understanding of asynchronous programming and event‑driven architectures (Kafka or SQS).
• Experience with modern authentication patterns (OAuth2, OIDC, JWT) and AWS IAM.

Technical Skills

• Programming: Python , FastAPI
• Generative AI: Amazon Bedrock, Bedrock Agents, AgentCore, LangChain, LangGraph, Prompt Engineering, Retrieval-Augmented Generation (RAG), AI Guardrails, Multi‑Agent Systems
• Vector Databases: Pinecone, Amazon OpenSearch Vector Engine, FAISS, ChromaDB, pgvector
• Infrastructure as Code: Terraform, AWS CloudFormation (preferred exposure)
• Containers & Orchestration: Docker
• Databases: PostgreSQL, DynamoDB
• Event-Driven Architecture: Amazon SQS, Apache Kafka
• Authentication & Security: OAuth 2.0, OpenID Connect (OIDC), JWT, AWS IAM, Enterprise Identity Integration (Microsoft Entra ID)
• CI/CD & DevOps: Git, Automated Deployment Pipelines
• Observability: AWS Observability
• Software Engineering: System Design, Microservices Architecture, Backend Development, API Design, Code Reviews, Technical Documentation, Design Documents, Runbooks
• Development Practices: Unit Testing, Integration Testing, Code Quality, Secure Coding Practices, Agile/Scrum

Preferred Qualifications

• AWS Associate or Professional certification.