Research Engineer, Data Infrastructure (Language Modeling)

Cartesia; San Francisco (CA); On-site; USD 170,000 - 230,000; Full time

Benefits offered by this job

Compensation

Health Insurance

Parental Leave

401(k)

Commuter Allowance

Flexible PTO

Meals & Snacks

Your own personal Yoshi

Job summary

Cartesia is seeking a Research Engineer, Data Infrastructure to build the datasets and systems powering pretraining. You will write scalable infrastructure to acquire, process, and curate massive datasets, partnering with research to optimize data mixtures.

Your work will shape the capabilities and quality of our foundational models. In this in-person role, you will join an interdisciplinary team based in SF and work closely with researchers and infrastructure engineers to design data loading,

Qualifications

• Experience building ML data infrastructure and datasets for large-scale models.
• Proficiency with data pipelines, versioning, and scalable loading.
• Ability to collaborate with researchers and infrastructure teams.

Responsibilities

• Build scalable data processing infrastructure for acquiring, ingesting, and combining massive text datasets.
• Design and run high-throughput, reproducible data pipelines for ingestion, preprocessing, filtering, deduplication and augmentation.
• Design ablation experiments to understand how data sources and weights affect model quality.
• Partner with research and infra teams to co-design data loading, versioning, and experimentation pipelines.
• Establish and enforce data quality standards with tight feedback between datasets and model behavior.
• Identify and source novel datasets and manage relationships with external data vendors.

Skills

Data pipelines

Dataset versioning

Large-scale data loading

Python/Scala

Collaborative research

Tools

Ray

Spark

Kubernetes

Job description

About Cartesia

Our mission is to architect AI that learns from and interacts with the world like humans do.

We're pioneering the model architectures that will make this possible. Our founding team met as PhDs at the Stanford AI Lab, where we invented State Space Models or SSMs, a new primitive for training efficient, large-scale foundation models. Our team combines deep expertise in model innovation and systems engineering paired with a design-minded product engineering team to build and ship cutting edge models and experiences.

We're funded by leading investors at Index Ventures and Lightspeed Venture Partners, along with Factory, Conviction, A Star, General Catalyst, SV Angel, Databricks and others. We're fortunate to have the support of many amazing advisors, and 90+ angels across many industries, including the world's foremost experts in AI.

About the Role

Data is the lifeblood of our models, and we are looking for a Research Engineer, Data Infrastructure to build the datasets and systems that power pretraining at Cartesia. In this role, you will write performant, scalable infrastructure to acquire, process, and curate massive datasets, and partner closely with research to optimize the characteristics and composition of data mixtures. Your work will directly shape the capabilities and quality of our foundational models.

Your Impact

• Build and operate performant, scalable data processing infrastructure for acquiring, ingesting, and combining massive text datasets.
• Design and operate scalable, high-throughput, and reproducible data pipelines — covering ingestion, preprocessing, filtering, deduplication, and augmentation.
• Design and run ablation experiments to understand how data sources, processing choices, and mixture weights affect model quality.
• Partner closely with research and infrastructure teams to co-design data loading, versioning, and experimentation pipelines.
• Establish and enforce rigorous standards for data quality, with a tight feedback loop between dataset characteristics and model behavior.
• Identify and source novel datasets; manage relationships and budgets with external data vendors and partners.

What You Bring

• Hands-on experience with ML data infrastructure: training data pipelines, dataset versioning, large-scale data loading, and the interplay between data systems and model training and inference.
• Strong modern engineering execution: clean, well-tested code, fluency with current tools, and a willingness to pick the right tool for the problem rather than defaulting to familiar patterns.
• Familiarity with building and evaluating datasets for generative models and reasonable working knowledge of how they're trained and inference.

Nice-To-Haves

• Experience with large-scale data processing using parallel infrastructure such as Ray, Spark, or Kubernetes.
• Experience with pretraining language models.

Note: Cartesia participates in E-Verify and will provide the federal government with Form I-9 information to confirm employment eligibility after hire.

More Details

In-office policy: We’re an in-person team based out of offices in San Francisco, London and Bangalore. We love being in the office, hanging out together, and learning from each other every day.

Visa sponsorship: We provide visa sponsorship support and assess each circumstance on a case-by-case basis. However, visa sponsorship is dependent on many factors, including the role you are applying for, and the location you are going to be based, and so we can't always guarantee success. Your Recruiter will work with you to understand your visa sponsorship needs from the first call.

We ship fast. All of our work is novel and cutting edge, and execution speed is paramount. We have a high bar, and we don’t sacrifice quality or design along the way.

We support each other. We have an open & inclusive culture that’s focused on giving everyone the resources they need to succeed.

Our Benefits (US Employees Only)

• Compensation Competitive base salary alongside attractive equity package.
• Health Insurance Fully covered medical insurance along with dental and vision for you and your family.
• Parental Leave 9 weeks paternity & 12 weeks maternity leave
• 401(k)
• Commuter Allowance A monthly stipend to help you get to and from the office.
• Flexible PTO Take as much time as you need to recharge your batteries.
• Meals & Snacks Lunch, dinner and plenty of snacks, provided daily.
• Your own personal Yoshi

Our Commitment to Equal Opportunity

Cartesia is an equal opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, or any other legally protected status.