Gen AI Platform Engineer — RAG & MLOps

Photon; United States; On-site; USD 140,000 - 170,000; Full time

Job summary

Photon is seeking a Software Engineer - Gen AI Inferencing to design, build, and operate reusable toolkits for Gen AI RAG capabilities. The role emphasizes scalable AI inference and integration with data science workflows across multi-repo platforms.

You will collaborate with product teams, data scientists, and engineers to deploy models in containers, drive CI/CD, and advance automation. 5+ years of Python/Unix experience and GenAI tooling are preferred.

Qualifications

• 5+ years of OOP in Python/Scala/Java
• Experience with AI/ML/GenAI lifecycle management
• Hands-on with MLOps, fine-tuning and inference
• Deploying models in containers in production
• CI/CD activities and automation

Responsibilities

• Code solutions and unit tests per acceptance criteria
• Design and modify architecture components and interfaces
• Mentor engineers in CI/CD practices and tool automation
• Refine stories, requirements, and estimate work
• Perform spikes and PoC to mitigate risk
• Automate release activities
• Develop automated test suites (integration/performance)
• Collaborate with product, data analysts, and data scientists

Skills

Python development

Scala/Java

GenAI/ML lifecycle

MLOps / CI-CD

Containerization

FastAPI / API

CI/CD automation

NoSQL (MongoDB/Redis)

Git tooling

Tools

Triton Inference Server

vLLM

Jenkins

SonarQube

pytest

Artifactory

Ansible

VS Code

Job description

Photon is seeking a Software Engineer - Gen AI Inferencing to design, build, and operate reusable toolkits for Gen AI RAG capabilities. The role emphasizes scalable AI inference and integration with data science workflows across multi-repo platforms.

You will collaborate with product teams, data scientists, and engineers to deploy models in containers, drive CI/CD, and advance automation. 5+ years of Python/Unix experience and GenAI tooling are preferred.