Research Engineer

Datalab; New York (NY); On-site; USD 250,000 - 350,000; Full time

Job summary

Datalab in New York City seeks a Research Engineer to own problems end to end across our models, inference service, and product. You’ll take models from training through benchmarking into our inference stack and collaborate to ship them to customers.

Join a small team shipping the state-of-the-art OCR models like Chandra and contributing to open source tools used by frontier AI labs and Fortune 500s. You’ll balance rapid experimentation with robust, scalable solutions for document extraction.

Qualifications

• Shipped models in production and understand end-to-end lifecycle.
• Experience turning research insights into products used by customers.
• Strong proficiency in PyTorch and Python with deep learning fundamentals.

Responsibilities

• Train task-specific models (OCR, layout, text recognition, extraction); explore architectures.
• Profile and accelerate model inference across hardware setups (H100s, CPUs).
• Integrate models into our API and product, balancing model work with shipping velocity.

Skills

DL model training

Fine-tuning

Model evaluation

PyTorch

Python

Deep learning fundamentals

Benchmarking

Performance profiling

Data engineering

Startup experience

Tools

PyTorch

Python

Job description

Salary range - $250k - $350k | Equity - up to 0.5% | In-person NYC

About Datalab

Datalab trains models that read documents reliably at scale. The world's most important information is trapped in PDFs, scans, and files that can't easily be parsed, and getting it out correctly matters. From frontier AI labs processing training data to Fortune 500s like Siemens extracting decades of engineering records, Datalab is where businesses turn to when extraction has to be right.

We’re at an 8-figure run rate with a team of 7. Anthropic is a customer. And we have hundreds more across FAANG, frontier AI labs, healthcare, finance, government, and legal. Our tools, Chandra, Surya, Marker, and Lift, have 70,000+ GitHub stars and broad developer mindshare. We're backed by founding members of OpenAI, FAIR, and Hugging Face.

Role Overview

We're looking for a Research Engineer to own problems end to end across our models, inference service, and product. You won't just train a model and hand it off. You'll take it from training through benchmarking, into our inference stack, and work with the team to integrate it into our products.

We're a small team that has shipped the current state of the art OCR model, Chandra. Our models collectively have 70k+ Github stars. Our tools are used internally at frontier AI labs like Anthropic, and Fortune 500 enterprises like Siemens.

Our team focuses on training small, efficient models that outperform much larger LLMs on domain-specific tasks (like OCR, structured extraction, tables). We move fast, prioritize practical results, and build tools that are open, reproducible, and built to last. You'll test hypotheses quickly, iterate on results, and balance experimental rigor with shipping to customers.

Day to day:

A typical project might look like: identify a gap in extraction quality on long documents, train and benchmark a new model, optimize it for inference, and work with the team to ship it to users. Concretely:

• Train and evaluate models: Train task-specific models (OCR, layout, text recognition, extraction). Explore architectures and training strategies to optimize task performance. This includes our open source models, like Marker, Surya, and Chandra.

• Optimize inference: Profile and accelerate model inference across different hardware setups (H100s, B200s, L40s, CPUs).

• Ship to product: Work with the team to integrate models into our API and product, helping define how new capabilities surface for end users. You will be involved from model training through integration, although your work will be weighted much more towards the model side than the product side.

• Create and maintain datasets: Source, design, and clean datasets for supervised and synthetic training; create reproducible pipelines for data versioning and evaluation.

• Experiment and benchmark: Run ablations, track metrics, and publish findings that inform model design and internal research direction.

• Engage with users and partners: Occasionally join calls or Slack threads to better understand customer needs and inform your work.

Ideal Candidate

You've shipped models that made it into production. You understand how to balance exploration with delivery, and how to turn research insights into products people actually use.

• 3+ years experience training, fine-tuning, and evaluating deep learning models

• Trained at least one production-grade model or system used in real-world applications

• Deep expertise in PyTorch and Python, with strong fundamentals in deep learning (optimization, evaluation, architecture design)

• Comfortable with data engineering, benchmarking, and performance profiling across hardware setups

• Comfortable with an early stage startup - balance running ablations/benchmarks with shipping velocity

Bonus points if you:

• Have experience with OCR, document AI, or structured extraction

• Have published work, whether that's a paper, a benchmark report, or a deep technical blog post

• Have been a major contributor to open-source projects, especially in ML, vision, or NLP

• Enjoy writing about your work and sharing learnings with the community

Interview process

• A 30-minute video call to evaluate fit

• 90-minute live architecture discussion

• Culture fit interview/team meeting

At this stage of the company, every interview is somewhat custom, so these phases may be rearranged slightly.

We can’t wait to hear from you!