Senior MLOps / AI Platform Engineer

Socket.dev; Arlington (VA); On-site; USD 180,000 - 240,000; Full time

Job summary

Socket.dev in Arlington, VA is seeking a Senior MLOps/Cloud Engineer to build, deploy, and operate AWS-hosted chatbot and orchestration services. You will connect Databricks, enterprise documents, vector stores, and participating websites to power scalable AI workflows.

The role requires deep hands-on experience with AWS Bedrock/SageMaker, containerization with Docker, Kubernetes ECS/EKS, and building API-driven AI applications using FastAPI or Flask.

Qualifications

• 9+ years in MLOps, cloud/platform engineering, or production AI apps.
• Hands-on AWS AI stack: Bedrock/SageMaker, API Gateway, ECS/EKS, ECR, S3, IAM, CloudWatch.
• Containerize Python apps with Docker, deploy to ECS/EKS/Kubernetes.

Responsibilities

• Build, integrate, deploy, and operate AWS-hosted chatbot and orchestration services.
• Connect to Databricks, enterprise documents, vector stores, and websites.

Skills

MLOps

Cloud engineering

DevSecOps

AI production systems

Python

API design

Docker

Kubernetes

Tools

Docker

AWS ECS/EKS

Databricks API

FastAPI/Flask

LangChain

Kubernetes

S3

Git CI/CD

Job description

Job Description:

Build, integrate, deploy, and operate the AWS-hosted chatbot and orchestration services, including its connections to Databricks, enterprise documents, vector stores, and participating websites.

• 9+ years of experience in MLOps, cloud engineering, platform engineering, DevSecOps, or production AI application development.
• Hands-on experience building and deploying AI/ML applications using the AWS technology stack, including Amazon Bedrock and/or SageMaker, API Gateway, ECS or EKS, ECR, S3, IAM, Secrets Manager, KMS, CloudWatch, and related services.
• Strong experience containerizing Python-based applications and APIs using Docker and deploying them into scalable ECS, EKS, or Kubernetes environments.
• Hands‑on experience integrating applications with Databricks REST APIs, preferably including the Genie Conversation API, SQL Statement Execution API, SQL Warehouses, OAuth authentication, and Unity Catalog‑governed data.
• Experience building API‑based chatbot or agent‑orchestration services using Python and frameworks such as FastAPI, Flask, LangChain, LangGraph, or comparable technologies.
• Experience implementing routing across structured‑data, RAG, and hybrid question‑answering workflows.
• Experience connecting AI applications to vector stores such as Amazon OpenSearch Serverless, Bedrock Knowledge Bases, PostgreSQL/pgvector, or Databricks Vector Search.
• Experience developing document‑ingestion pipelines for SharePoint, S3, file repositories, or other enterprise knowledge sources, including extraction, chunking, embeddings, metadata enrichment, synchronization, and deletion handling.
• Experience implementing secure token handling, OAuth/OIDC flows, service‑principal authentication, secrets management, least‑privilege IAM, and server‑side session management.
• Experience creating CI/CD pipelines for containerized AI applications, including automated testing, vulnerability scanning, image promotion, deployment, rollback, and configuration management.
• Experience load‑testing and scaling chatbot or model‑enabled applications based on concurrent users, request volume, model latency, token utilization, and downstream API constraints.
• Experience implementing production observability, including application logging, distributed correlation IDs, metrics, tracing, API latency monitoring, model usage monitoring, alerting, and audit‑log integration.
• Ability to troubleshoot issues spanning application code, Docker containers, AWS networking, IAM, Databricks APIs, SQL execution, model endpoints, and vector retrieval.
• Ability to implement guardrails that limit data returned to the model, restrict the application to approved Databricks views, prevent credentials from reaching the browser, and preserve end‑to‑end auditability.

Preferred qualifications:

• Experience deploying applications within the War Data Platform, formerly Advana, or integrating with WDP‑hosted Databricks services.
• Experience supporting AWS GovCloud, DoD IL4/IL5, CUI, or other highly regulated environments.
• Experience with Databricks Genie, Unity Catalog, Databricks Vector Search/AI Search, and user‑level OAuth integrations.
• Experience integrating reusable chatbot widgets or APIs into multiple websites, such as PBIS, Jupiter Homepage, Community Portal, or similar enterprise applications.
• Experience with Terraform, CloudFormation, AWS CDK, Helm, Kubernetes, and Git‑based CI/CD platforms.

Infopact is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability, veteran status, or any other characteristic protected by law. We strongly encourage veterans — including those with technical and operational occupational specialties — to apply.