Senior ML Engineer - AI-Driven Search & Evaluation

Socket.dev; San Francisco (CA); Hybrid; USD 206,000 - 269,000; Full time

Benefits offered by this job

Health & wellbeing resources

Paid volunteer days

Job summary

At Atlassian, a Senior Machine Learning Engineer is sought to develop and productionize ML systems for search, retrieval, ranking, and AI agents. You will own projects across the ML lifecycle—from problem definition and data development through experimentation, evaluation, deployment, and continuous improvement.

You will collaborate with product managers, software engineers, data scientists, research scientists, and platform teams to deliver scalable, evaluation-driven AI solutions and mentor

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field, or equivalent experience.
• At least 4 years of experience developing and deploying machine learning or AI systems in production.
• Strong Python skills and experience with Java, Kotlin, TypeScript, or another production language.
• Experience with SQL and large-scale data processing technologies such as Spark.
• Experience building, evaluating, deploying, and scaling models with large datasets.
• Experience designing evaluation strategies, analyzing model quality, and using results to guide improvements.
• Familiarity with cloud-based ML and data platforms such as AWS or Databricks.
• Ability to independently solve ambiguous problems and deliver practical, production-quality solutions.
• Strong communication and collaboration skills.
• An agile mindset and commitment to continuous improvement.

Responsibilities

• Build and productionize machine learning models and AI systems for Search & Intelligence products.
• Own projects from concept through deployment, monitoring, evaluation, and iteration.
• Develop AI-native experiences across search, retrieval, ranking, recommendations, conversational systems, and agentic workflows.
• Design evaluation-driven development processes, including quality metrics, test cases, benchmarks, and acceptance criteria.
• Build evaluation datasets, regression suites, and pipelines for search, RAG, chat, and agentic systems.
• Conduct offline and online evaluations, human assessments, model-based evaluations, and error analysis.
• Design scalable architectures that meet requirements for quality, reliability, latency, privacy, and cost.
• Apply modern techniques in information retrieval, ranking, embeddings, NLP, deep learning, and large language models.
• Communicate technical decisions and results clearly across technical and non-technical audiences.
• Mentor engineers and contribute to engineering and ML best practices.

Skills

Python

Production ML

Communication

Agile mindset

Problem solving

Collaboration

Education

Bachelor’s or Master’s degree in CS/ML/DS

Tools

Spark

AWS

Databricks

SQL

Java

Kotlin

TypeScript

Job description

At Atlassian, a Senior Machine Learning Engineer is sought to develop and productionize ML systems for search, retrieval, ranking, and AI agents. You will own projects across the ML lifecycle—from problem definition and data development through experimentation, evaluation, deployment, and continuous improvement.

You will collaborate with product managers, software engineers, data scientists, research scientists, and platform teams to deliver scalable, evaluation-driven AI solutions and mentor