Senior ML Engineer — Agentic Search & Relevance (Remote)

Atlassian; New York (NY); Hybrid; USD 206,000 - 269,000; Full time

Benefits offered by this job

Health and wellbeing resources

Paid volunteer days

Perks and benefits information on Atl 

Equity

Job summary

Atlassian seeks a Senior Machine Learning Engineer to join the Query Intelligence team, working on Agentic Search and Search Relevance. You will build intelligent systems to help users and AI agents understand questions, discover knowledge, and accomplish tasks across Atlassian products and connected tools.

Join a team that spans query understanding, search planning, and agentic retrieval, collaborating with product, modeling, and evaluation teams to improve search quality, reliability, and

Qualifications

• A bachelor’s or master’s degree in Computer Science or a related field, or equivalent practical experience.
• 4+ years of relevant industry experience in machine learning, with experience delivering ML capabilities into production.
• Strong Python programming skills and the ability to write reliable, maintainable, production-quality code.
• Experience in natural language processing, information retrieval, search relevance, or LLM applications.
• Experience designing experiments, building evaluation datasets, analyzing model behavior, and using evidence to guide improvements.
• Understanding of the ML development lifecycle, from data preparation and modeling to deployment, monitoring, and iteration.
• Ability to take ownership of ambiguous problems, make practical technical tradeoffs, and communicate clearly with engineering and product partners.

Responsibilities

• Develop machine learning and LLM capabilities for query intelligence, including intent understanding, query rewriting and decomposition, entity understanding, and translating natural language into structured search constraints.
• Build and improve agentic search planners that turn complex requests into search strategies, select appropriate sources and tools, and adapt based on retrieved evidence.
• Improve model and agent behavior through prompt development, model selection, training data improvements, and fine-tuning where appropriate.
• Own projects from problem definition and prototyping through experimentation, production deployment, and ongoing measurement.
• Build datasets and evaluation methods, partnering with evaluation teams to measure retrieval relevance, evidence coverage, task success, and grounding.
• Use offline analysis and online experiments to diagnose failures and validate improvements.
• Balance search quality with latency, inference cost, and reliability, building systems that operate effectively within enterprise permissions and data boundaries.
• Collaborate with search platform, relevance, Rovo Chat, and other AI teams to integrate query intelligence and agentic search capabilities into customer experiences.
• Contribute to technical design and code reviews, mentor junior engineers, and share learnings that strengthen the team’s engineering and ML practices.

Skills

Python programming

Machine learning

NLP

Information retrieval

LLM applications

Education

Bachelor’s or Master’s in Computer Science or related field

Tools

Spark

AWS

Databricks

Job description

Atlassian seeks a Senior Machine Learning Engineer to join the Query Intelligence team, working on Agentic Search and Search Relevance. You will build intelligent systems to help users and AI agents understand questions, discover knowledge, and accomplish tasks across Atlassian products and connected tools.

Join a team that spans query understanding, search planning, and agentic retrieval, collaborating with product, modeling, and evaluation teams to improve search quality, reliability, and