Senior AI Software Engineer - Production ML & LLM

Hda Institute; Dedham (MA); Hybrid; USD 140,000 - 210,000; Full time

Job summary

Health Data Analytics Institute (HDAI) in Dedham, MA is hiring a Senior AI Software Engineer to bridge Data Science and production software. You will own the AI/ML backend, including a high-throughput inference engine and generative LLM pipelines on Amazon Bedrock, powering clinical summaries and diagnostic discovery.

You will work across the backend stack, building production Python services on AWS and integrating with FastAPI and legacy systems during migration to serverless.

Qualifications

• 7+ years of experience building production systems.
• Strong Python proficiency for production service development.
• Experience with AWS services (Lambda, API Gateway, DynamoDB, SQS, S3).
• Experience in ML engineering or LLM engineering with willingness to grow across the other.

Responsibilities

• Inference engine: scale and optimize hundreds of models in production.
• ML productization: deploy model artifacts and ensure parity with development environments.
• LLM applications: production Bedrock integrations, prompt lifecycle management.
• Production AI engineering: develop Python services on AWS and migrate to serverless.
• Evaluation and quality: build tests and monitor AI outputs for accuracy.
• Cross-functional collaboration: work with Data Science and Platform Engineering.

Skills

Python

AWS

ML engineering

LLM engineering

Serverless

Tools

FastAPI

Lambda

DynamoDB

SQS

S3

Job description

Health Data Analytics Institute (HDAI) in Dedham, MA is hiring a Senior AI Software Engineer to bridge Data Science and production software. You will own the AI/ML backend, including a high-throughput inference engine and generative LLM pipelines on Amazon Bedrock, powering clinical summaries and diagnostic discovery.

You will work across the backend stack, building production Python services on AWS and integrating with FastAPI and legacy systems during migration to serverless.