Senior Data Platform Engineer — AI-Scale Pipelines

Weights & Biases; New York (NY); On-site; USD 165,000 - 242,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) with employer match

Flexible PTO

Parental leave

Tuition reimbursement

Job summary

CoreWeave is seeking a senior data systems engineer to design and maintain scalable data pipelines and analytics platforms. You’ll build distributed batch/streaming pipelines, orchestrate workflows with dbt, Dagster or Airflow, and optimize data warehouses for multi-petabyte workloads.

You will collaborate with software teams to instrument telemetry and define data models, while enabling internal AI applications and secure analytics.

Qualifications

• Bachelor’s degree in CS/CE/DS or related technical field.
• At least five years of professional experience in software engineering, data engineering, or related field.
• Experience designing production data pipelines and distributed data-processing systems.
• Experience with data transformation/workflow tools such as dbt, Dagster, or Airflow.
• Experience designing data models, schemas, and storage for large-scale analytics.
• Proficiency in Python, Go, Java, or Scala for production data systems.
• Experience with SQL, performance tuning, data-quality testing, and monitoring.
• Knowledge of software engineering practices and distributed architectures.

Responsibilities

• Design and implement scalable data systems and pipelines across production.
• Develop data transformation and orchestration frameworks using dbt, Dagster, Airflow, or equivalent tools.
• Improve data warehouse performance, schemas, and storage for large-scale workloads.
• Build product telemetry and data instrumentation for web and backend systems.
• Develop data catalog and semantic-layer capabilities for governance and self-service analytics.
• Support data-powered AI applications and platform integrations.
• Operate and support the platform, including on-call rotation post onboarding.

Skills

Python

Go

Java

Scala

SQL

Distributed systems

Data pipelines

Cloud platforms

Education

Bachelor's degree in CS/Engineering/Data Science

Tools

dbt

Dagster

Airflow

Job description

CoreWeave is seeking a senior data systems engineer to design and maintain scalable data pipelines and analytics platforms. You’ll build distributed batch/streaming pipelines, orchestrate workflows with dbt, Dagster or Airflow, and optimize data warehouses for multi-petabyte workloads.

You will collaborate with software teams to instrument telemetry and define data models, while enabling internal AI applications and secure analytics.