GenAI Systems Architect — Remote, Scalable ML Infra

Atlassian; San Francisco (CA); Hybrid; USD 196,000 - 309,000; Full time

Job summary

At Atlassian, we’re seeking a Principal Machine Learning Systems Engineer to lead the technical direction of GenAI Products & Knowledge Innovations in the US. You’ll design and scale systems for training, fine-tuning, and serving large language models and embeddings, powering knowledge-grounded search and rapid prototyping.

You will partner with applied scientists to build production-ready pipelines, optimize latency and throughput, and ship end-to-end ML innovations across product teams while

Qualifications

• 6+ years in ML systems engineering, backend engineering, or infrastructure roles.
• Strong track record of building and scaling ML-powered services in production.
• Experience with large-scale model training, inference pipelines, or search/retrieval systems.

Responsibilities

• Architect scalable systems for training, fine-tuning, and serving LLMs and embeddings.
• Build efficient retrieval, hybrid search, and RAG pipelines integrated with knowledge-grounded data.
• Develop tools and infra to support rapid experimentation, evaluation, and deployment of prototypes.
• Partner with applied scientists to bring new ideas to life in production-ready pipelines.
• Build POC systems and evolve them into reliable, scalable services.
• Optimize latency, throughput, and resource efficiency for GenAI workloads.
• Work closely with ML engineers, backend developers, and product teams to ship end-to-end innovations.
• Contribute to best practices in model deployment, monitoring, and evaluation.
• Help establish the team as a world-class hub for GenAI systems innovation.

Skills

Backend systems

ML frameworks

Vector databases

Orchestration frameworks

Coding skills

Cloud environments

Container tooling

Education

Bachelor’s or Master’s in CS/ML

Tools

Python

PyTorch

TensorFlow

Hugging Face

Weaviate

Pinecone

FAISS

LangChain

LlamaIndex

AWS

GCP

Azure

Kubernetes

Docker

Job description

At Atlassian, we’re seeking a Principal Machine Learning Systems Engineer to lead the technical direction of GenAI Products & Knowledge Innovations in the US. You’ll design and scale systems for training, fine-tuning, and serving large language models and embeddings, powering knowledge-grounded search and rapid prototyping.

You will partner with applied scientists to build production-ready pipelines, optimize latency and throughput, and ship end-to-end ML innovations across product teams while