Data Platform Engineer - Pipelines & Analytics

The Consensus; New York (NY); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Competitive compensation

100% insurance coverage

Flexible PTO policy

Paid parental leave

401(k) plan

Learning opportunities in ML startups

Job summary

The Consensus in New York is seeking a Data Engineer to build and scale its internal data platform. In this role, you will design data models and develop pipelines for product usage insights.

Strong candidates will have experience with B2B SaaS applications, data reliability, and analytics infrastructure. The role offers competitive compensation, comprehensive insurance, and flexible PTO.

Qualifications

• Need to understand inference metrics like latency and throughput.
• Experience with B2B SaaS platforms is preferred.
• Experience in forecasting and predictive modeling is useful.

Responsibilities

• Design and maintain core data models and semantic layers.
• Develop and orchestrate batch and streaming data pipelines.
• Analyze infrastructure telemetry from observability tools.
• Define and maintain company-wide metrics for product usage.
• Enable self-service analytics with well-structured layers.
• Ensure data reliability and quality through testing.

Skills

Understanding of inference metrics

B2B SaaS experience

Forecasting and predictive modeling

Tools

Apache Beam

Kafka

Airflow

OpenTelemetry

Grafana

Job description

The Consensus in New York is seeking a Data Engineer to build and scale its internal data platform. In this role, you will design data models and develop pipelines for product usage insights.

Strong candidates will have experience with B2B SaaS applications, data reliability, and analytics infrastructure. The role offers competitive compensation, comprehensive insurance, and flexible PTO.