Data Engine Architect for Scalable AI Pipelines

Datacurve; San Francisco (CA); On-site; USD 160,000 - 230,000; Full time

Job summary

Datacurve is building the frontier data engine to power autonomous models. As a Software Engineer, you will own core infrastructure to scale data acquisition and enrichment, turning complex workflows into deterministic systems for large-scale model training.

We seek highly autonomous engineers with a rare blend of generalist breadth and deep specialty in architecting large data-intensive platforms, capable of improving model performance through robust infrastructure.

Qualifications

• Proven ability to design and scale robust infrastructure and data pipelines.
• Ability to understand and define product primitives to support independent products.
• Strong drive to push the boundaries of what machines can do.
• Build tooling that is self-healing, deterministic, and highly legible.
• Tends to question consensus and form independent views.

Responsibilities

• Instantiate new training environments for language models and scale data pipelines.
• Design, build, and maintain parts of the Datacurve platform for researchers to maximize data value.
• Own reliability, performance, and monitoring of the data engine to ensure zero-fault data delivery.
• Collaborate with researchers on challenging problems impacting model improvement.

Skills

Systems thinker

Product intuition

Relentless curiosity

Reliability engineering

Independent thinker

Job description

Datacurve is building the frontier data engine to power autonomous models. As a Software Engineer, you will own core infrastructure to scale data acquisition and enrichment, turning complex workflows into deterministic systems for large-scale model training.

We seek highly autonomous engineers with a rare blend of generalist breadth and deep specialty in architecting large data-intensive platforms, capable of improving model performance through robust infrastructure.