Senior ML Engineer - Production LLM & Document AI

Box, Inc.; Wrocław; Hybrid; PLN 230,000 - 320,000; Full time

Job summary

Box Poland is seeking a Machine Learning Engineer to design, build, and operate reliable ML systems at enterprise scale. You will combine strong software engineering and applied ML skills to take solutions from idea through production, working with engineering, product, data, and infrastructure partners to develop scalable ML capabilities.

The Metadata Extraction team focuses on transforming unstructured enterprise content into structured metadata using OCR and LLM-based extraction.

Qualifications

• 3+ years of experience building, deploying, or operating production software, data, or ML systems.
• Strong programming skills in Python and production-grade, readable, testable code.
• Experience with the LLM agents lifecycle: data and eval-set prep, prompting, tool schemas, RAG, deployment and monitoring.
• Experience with LLM frameworks and libraries (LangChain, LangGraph, PyTorch, Pydantic, Pandas, NumPy) and LLM APIs (Gemini, Claude, OpenAI).
• Understand core ML concepts and trade-offs between performance, reliability, latency, scalability, and cost.
• Experience building APIs, services, pipelines, or distributed systems in a cloud environment.
• Familiar with CI/CD, observability, testing, and production support.
• Excellent communication with technical and non-technical partners.
• Ownership mindset and collaborative problem solving.

Responsibilities

• Design, build, deploy, and maintain production LLM agents, machine learning models and services.
• Develop robust data preparation pipelines, prompt and tool design, and agentic workflows.
• Write high-quality, maintainable Python code for production systems.
• Partner with Product, Software Engineering, Data, and Infrastructure to translate customer and business needs into ML-powered capabilities.
• Evaluate and improve agents quality using offline and online metrics, eval sets, experiments, and feedback loops.
• Monitor production ML systems for quality, reliability, latency, cost, and drift; investigate and resolve issues.
• Contribute to architecture of scalable services and pipelines for real-time and batch ML workloads.
• Create clear technical designs, documentation, tests, and runbooks.
• Share knowledge and raise the bar for code quality and operational excellence.
• Participate in an on-call rotation and triage production issues.

Skills

Python

LLM agents lifecycle

LangChain

PyTorch

Cloud services

Tools

LangChain

LangGraph

PyTorch

Pydantic

Pandas

NumPy

Kubernetes

Terraform

LLM APIs

Job description

Box Poland is seeking a Machine Learning Engineer to design, build, and operate reliable ML systems at enterprise scale. You will combine strong software engineering and applied ML skills to take solutions from idea through production, working with engineering, product, data, and infrastructure partners to develop scalable ML capabilities.

The Metadata Extraction team focuses on transforming unstructured enterprise content into structured metadata using OCR and LLM-based extraction.