Data Infrastructure Engineer for Scalable AI Pipelines

Thinkingmachines; San Francisco (CA); On-site; USD 350,000 - 475,000; Full time

Benefits offered by this job

Health, dental, and vision insurance

Unlimited paid time off (PTO)

Paid parental leave

Relocation support

Job summary

Thinking Machines in San Francisco is seeking an engineer to enhance data infrastructure. You’ll design scalable systems and collaborate with researchers to improve data quality, ensuring robust platform performance. If you thrive in a highly collaborative environment and have a strong background in distributed systems, we encourage you to apply.

The role offers a salary range of $350,000 - $475,000 annually, with generous benefits including unlimited PTO and relocation support.

Qualifications

• Bachelor’s degree or equivalent experience in computer science, engineering, or similar.
• Proficient in at least one backend language (e.g., Python or Rust).
• Fluent in distributed compute frameworks such as Apache Spark or Ray.
• Familiar with cloud infrastructure and data lake architectures.

Responsibilities

• Design, build, and operate scalable, fault-tolerant infrastructure for LLM Research.
• Develop high-throughput systems for data ingestion, processing, and transformation.
• Implement and maintain monitoring and alerting to support platform reliability.

Skills

Backend language proficiency (Python or Rust)

Distributed compute frameworks (Apache Spark or Ray)

Cloud infrastructure knowledge

Data lake architectures

Batch and streaming pipelines

Education

Bachelor's degree in computer science, engineering, or related field

Tools

Kafka

Terraform

Airflow

Job description

Thinking Machines in San Francisco is seeking an engineer to enhance data infrastructure. You’ll design scalable systems and collaborate with researchers to improve data quality, ensuring robust platform performance. If you thrive in a highly collaborative environment and have a strong background in distributed systems, we encourage you to apply.

The role offers a salary range of $350,000 - $475,000 annually, with generous benefits including unlimited PTO and relocation support.