Remote Senior ML Engineer - LLM Systems & Evaluation

Grid Dynamics; Fatih; On-site; TRY 5,778,000 - 8,666,000; Full time

Benefits offered by this job

Bleeding-edge projects

Flexible schedule

Competitive salary

Professional development opportunities

Job summary

Grid Dynamics is hiring a Senior Machine Learning Engineer specializing in LLM systems and evaluation. You will own ML projects from problem definition to deployment, design evaluation methodologies, and build benchmarks to measure model and product performance.

You will evaluate and improve LLM-based systems, including RAG applications, agents, safety systems, and end-to-end AI products, translating insights into actionable recommendations.

Qualifications

• 5+ years of experience in Machine Learning Engineering or a related field.
• Strong understanding of machine learning fundamentals and model evaluation.
• Strong Python programming skills and experience with modern ML frameworks such as PyTorch, TensorFlow, or JAX.
• Understanding of retrieval-augmented generation (RAG), agentic systems, and LLM safety concepts.

Responsibilities

• Own machine learning projects from problem definition through implementation.
• Design and implement evaluation methodologies for AI and machine learning systems.
• Create datasets, benchmarks, and metrics to measure model and product performance.
• Evaluate and improve LLM-based systems, including RAG applications, agents, safety systems, and end-to-end AI products.
• Analyse model behaviour, identify failure modes, and recommend practical improvements.
• Build and maintain ML pipelines, tooling, and evaluation infrastructure.
• Collaborate with product, engineering, and research teams to translate business goals into measurable ML objectives.
• Prototype and iterate rapidly to solve business and product challenges.
• Communicate findings, trade-offs, and recommendations to both technical and non-technical stakeholders.

Skills

Python

ML fundamentals

Model evaluation

Communication skills

Tools

PyTorch

TensorFlow

JAX

Job description

Grid Dynamics is hiring a Senior Machine Learning Engineer specializing in LLM systems and evaluation. You will own ML projects from problem definition to deployment, design evaluation methodologies, and build benchmarks to measure model and product performance.

You will evaluate and improve LLM-based systems, including RAG applications, agents, safety systems, and end-to-end AI products, translating insights into actionable recommendations.