Remote ML Engineer: LLMs & Production AI Pipelines

Mimica; United States; Remote; USD 101,000 - 146,000; Full time

Benefits offered by this job

Stock options

Remote-first

Laptop provided

Stipend for setup

Learning budget

Flexible time off

Job summary

Mimica, a remote-first AI company, is seeking a Machine Learning Engineer/Data Scientist for its Data Intelligence team. You’ll own key ML pipelines end to end, improving accuracy, cost efficiency, and trust.

You’ll build evals and LLM judges, run experiments, and translate results into production improvements that power other teams. You’ll work in Python, collaborate with quality engineers, and ship experiments to production, including OCR/vision data and anonymization tasks.

Qualifications

• Solid machine learning/data science background with experimental design, data splits, metrics, bias, and significance.
• Hands-on experience applying LLMs in production or near-production settings, building eval sets, judges, and benchmarks.
• Ability to work with messy data and transform insights into measurable improvements.

Responsibilities

• Own key ML pipelines end-to-end, improving accuracy and efficiency.
• Design, build, and iterate on LLM evals and judge systems with datasets and benchmarks.
• Run rigorous experiments on prompts, models, and inputs; translate results to production improvements.

Skills

Python

ML production

LLM evaluation

Experimentation

Data preprocessing

Education

MS in CS/ML

Tools

PyTorch

TensorFlow

Job description

Mimica, a remote-first AI company, is seeking a Machine Learning Engineer/Data Scientist for its Data Intelligence team. You’ll own key ML pipelines end to end, improving accuracy, cost efficiency, and trust.

You’ll build evals and LLM judges, run experiments, and translate results into production improvements that power other teams. You’ll work in Python, collaborate with quality engineers, and ship experiments to production, including OCR/vision data and anonymization tasks.