Data Engineer

The Consensus; New York (NY); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Competitive compensation

100% insurance coverage

Flexible PTO policy

Paid parental leave

401(k) plan

Learning opportunities in ML startups

Job summary

The Consensus in New York is seeking a Data Engineer to build and scale its internal data platform. In this role, you will design data models and develop pipelines for product usage insights.

Strong candidates will have experience with B2B SaaS applications, data reliability, and analytics infrastructure. The role offers competitive compensation, comprehensive insurance, and flexible PTO.

Qualifications

• Need to understand inference metrics like latency and throughput.
• Experience with B2B SaaS platforms is preferred.
• Experience in forecasting and predictive modeling is useful.

Responsibilities

• Design and maintain core data models and semantic layers.
• Develop and orchestrate batch and streaming data pipelines.
• Analyze infrastructure telemetry from observability tools.
• Define and maintain company-wide metrics for product usage.
• Enable self-service analytics with well-structured layers.
• Ensure data reliability and quality through testing.

Skills

Understanding of inference metrics

B2B SaaS experience

Forecasting and predictive modeling

Tools

Apache Beam

Kafka

Airflow

OpenTelemetry

Grafana

Job description

About Baseten

Baseten powers mission‑critical inference for the world’s most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting‑edge models into production. We’re growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.

The Role

We’re hiring a Data Engineer to build and scale Baseten’s internal data platform. This role sits at the intersection of data engineering, analytics, and data science, transforming raw product and business data into reliable datasets that power decision–making.

You’ll design the data models, pipelines, and analytics infrastructure that enable teams across Product, Engineering, Finance, Marketing, and Sales to understand usage and performance. This includes working with AI inference, infrastructure, and observability data to generate insights about the product, business operations and platform economics.

You’ll partner closely with stakeholders to build robust, scalable pipelines, define company‑wide metrics that inform strategy and planning.

Responsibilities

• Design and maintain core data models and semantic layers
• Develop and orchestrate batch and streaming data pipelines using technologies such as Apache Beam, Kafka, Airflow, or similar frameworks
• Analyze inference and infrastructure telemetry, including data from OpenTelemetry, Grafana, and other observability tools
• Define and maintain company‑wide metrics across product usage, performance, and customer lifecycle
• Enable self‑service analytics through agents and tools, with well‑structured semantic layers and context
• Ensure data reliability and quality through testing, documentation, and governance

Preferred Qualifications

• Understanding of inference metrics such as latency, throughput, token usage, and model performance
• Experience supporting B2B SaaS and/or consumption‑based platforms
• Application of forecasting and predictive modeling (e.g., ARIMA, Prophet) to business processes

Benefits

• Competitive compensation, including meaningful equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New’s Day)
• Paid parental leave
• Fertility and family–building stipend through Carrot
• Company‑facilitated 401(k)
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities

Apply now to embark on a rewarding journey in shaping the future of AI! If you are a motivated individual with a passion for machine learning and a desire to be part of a collaborative and forward-thinking team, we would love to hear from you.

At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.

We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).