LLM Ops Architect & AWS Engineer — Life Sciences

United States Digital Space LLC; United States; Hybrid; USD 150,000 - 190,000; Full time

Job summary

United States Digital Space LLC is seeking an AI Operations Architect & AWS Engineer to design, deploy, and operate production-grade LLM systems on AWS. You will build agentic AI pipelines powering large-scale clinical data extraction from real-world notes, accelerating drug development and patient access.

This role sits at the intersection of ML infrastructure, cloud engineering, and applied NLP, owning the operational backbone that makes LLM capabilities reliable and scalable for data products

Qualifications

• Master's in CS, Data Science, or related field.
• 5+ years in production NLP/ML systems development and operations on AWS.
• Hands-on experience deploying open-weight LLMs (Llama, Gemma, Qwen) at scale with serving infra.
• Expert Python proficiency and LLM orchestration tooling knowledge.
• Experience with AWS ML/compute services and IaC.
• Proven track record deploying NLP/LLM solutions in healthcare or life sciences.

Responsibilities

• Design and maintain AWS cloud architectures for LLM inference and fine-tuning workloads.
• Build and operate agentic AI pipelines with multi-step LLM orchestration and RAG.
• Deploy and manage open-weight LLMs in production with efficient serving and latency optimization.
• Implement evaluation, drift detection, prompt regression tests, and human-in-the-loop QC.
• Develop CI/CD pipelines for prompt/version updates and config management.
• Collaborate with NLP scientists and engineers to productionize extraction logic.
• Ensure HIPAA/PHI compliance in LLM deployment and data processing workflows.
• Analyze resource utilization and optimize GPU hours, storage, and throughput.
• Evaluate emerging LLM serving tech and orchestration frameworks to stay current.

Skills

NLP/ML

Python

AWS

LangChain

LLM orchestration

Education

Master's degree

Tools

vLLM/TGI

Terraform

SageMaker

OpenSearch/Elasticsearch

Job description

United States Digital Space LLC is seeking an AI Operations Architect & AWS Engineer to design, deploy, and operate production-grade LLM systems on AWS. You will build agentic AI pipelines powering large-scale clinical data extraction from real-world notes, accelerating drug development and patient access.

This role sits at the intersection of ML infrastructure, cloud engineering, and applied NLP, owning the operational backbone that makes LLM capabilities reliable and scalable for data products