Senior ML Architect for Production-Grade AI

Quartile; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

Sciene seeks a Senior ML Specialist to lead model strategy across its agentic AI platform. You will evaluate models, design evaluation methodologies, and build classifiers and fine-tuned models that outperform prompting in routing and detection tasks.

You will ship end-to-end AI solutions, instrument services, and collaborate across data and software teams to ensure robust, scalable deployments with measurable outcomes.

Qualifications

• 5+ years of applied machine learning experience with training, evaluation and deployment
• Strong foundation in statistics and probability with hypothesis testing and calibration
• Deep understanding of LLM and generative AI theory including training pipelines and decoding strategies
• Hands-on ML/NLP experience with embeddings, classification and clustering
• Experience fine-tuning models (LoRA/PEFT) and dataset construction
• Experience designing offline evaluation, LLM-as-judge Bias awareness and significance testing
• Production-grade Python in PyTorch/Scikit-learn, with CI/tests
• Experience with at least one major LLM provider API and structured outputs
• Advanced degree or equivalent depth in ML/CS/Math
• Autonomy to own problems end to end and ship measurable outcomes

Responsibilities

• Own model strategy across the platform, selecting models by task with statistical rigor
• Design and maintain offline evaluation and reliability metrics for AI systems
• Build and fine-tune classifiers and models for routing and detection tasks
• Develop agentic AI products with reusable skills, tools, and structured outputs
• Do prompt engineering and context management aligned with model behavior
• Ensure output quality with deterministic enforcers and quality gates
• Diagnose model behavior and implement fixes in prompts, retrieval, or model choice
• Build tools to query databases and external systems via MCP
• Instrument services with OpenTelemetry and monitor quality, latency, and cost
• Collaborate with data and software engineers to ship end-to-end AI solutions
• Follow and apply research literature to real data and document codebase

Skills

Applied ML

Statistics & probability

LLM theory

Python & ML stack

Fine-tuning models

Evaluation methodology

Databricks & Cloud

Observability & monitoring

Education

Master's or PhD in ML/CS/Statistics

Tools

PyTorch

Hugging Face

Databricks

Azure

Docker

Job description

Sciene seeks a Senior ML Specialist to lead model strategy across its agentic AI platform. You will evaluate models, design evaluation methodologies, and build classifiers and fine-tuned models that outperform prompting in routing and detection tasks.

You will ship end-to-end AI solutions, instrument services, and collaborate across data and software teams to ensure robust, scalable deployments with measurable outcomes.