Data Engineer

Baseten; San Francisco (CA); On-site; USD 180,000 - 250,000; Full time

Benefits offered by this job

100% coverage of medical, dental, and vision insurance

Generous PTO policy

Paid parental leave

Company-facilitated 401(k)

Exposure to various ML startups

Job summary

A tech-driven AI company in San Francisco is looking for a Data Engineer to build and scale its internal data platform. The successful candidate will design data models, create data pipelines, and ensure data integrity to support strategic decision-making. This position requires experience in data engineering, analytics, and familiarity with tools like Apache Beam and Kafka. The role offers competitive compensation and an opportunity to work within a dynamic team focused on machine learning.

Qualifications

• Understanding of inference metrics such as latency, throughput, token usage, and model performance.
• Experience supporting B2B SaaS and/or consumption-based platforms.
• Application of forecasting and predictive modeling (e.g., ARIMA, Prophet) to business processes.

Responsibilities

• Design and maintain core data models and semantic layers.
• Develop and orchestrate batch and streaming data pipelines.
• Analyze inference and infrastructure telemetry.
• Define and maintain company-wide metrics.
• Enable self-service analytics through agents and tools.
• Ensure data reliability and quality through testing and governance.

Skills

Data modeling

Data pipeline development

Data analytics

Observation tools

Tools

Apache Beam

Kafka

Airflow

OpenTelemetry

Grafana

Job description

About Baseten

Baseten powers mission‑critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We’re growing quickly and recently raised our $300M Series E, backed by investors including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products.

THE ROLE

We’re hiring a Data Engineer to build and scale Baseten’s internal data platform. This role sits at the intersection of data engineering, analytics, and data science, transforming raw product and business data into reliable datasets that power decision‑making.

You’ll design the data models, pipelines, and analytics infrastructure that enable teams across Product, Engineering, Finance, Marketing, and Sales to understand usage and performance. This includes working with AI inference, infrastructure, and observability data to generate insights about the product, business operations and platform economics.

You’ll partner closely with stakeholders to build robust, scalable pipelines, define company‑wide metrics that inform strategy and planning.

Responsibilities

• Design and maintain core data models and semantic layers
• Develop and orchestrate batch and streaming data pipelines using technologies such as Apache Beam, Kafka, Airflow, or similar frameworks
• Analyze inference and infrastructure telemetry, including data from OpenTelemetry, Grafana, and other observability tools
• Define and maintain company‑wide metrics across product usage, performance, and customer lifecycle
• Enable self‑service analytics through agents and tools, with well‑structured semantic layers and context
• Ensure data reliability and quality through testing, documentation, and governance

Preferred Qualifications

• Understanding of inference metrics such as latency, throughput, token usage, and model performance
• Experience supporting B2B SaaS and/or consumption‑based platforms
• Application of forecasting and predictive modeling (e.g., ARIMA, Prophet) to business processes

Benefits

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Generous PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
• Paid parental leave
• Company‑facilitated 401(k)
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Apply now

Embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward‑thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).

Compensation Range: $180K - $250K