Senior Data Platform Engineer - Weights & Biases

Weights & Biases

Bellevue (WA)

On-site

USD 165,000 - 242,000

Full time

14 hours ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Medical, dental, vision insurance
401(k) with employer match
Equity awards (ESPP)

Job summary

CoreWeave, together with Weights & Biases, is building the AI lifecycle platform to ingest, transform, and analyze data at scale. The role focuses on designing scalable data systems, orchestrating pipelines, and enabling telemetry across production services.

Ideal candidates have 5+ years in data engineering, strong Python/SQL skills, and experience with dbt, Dagster, or Airflow. This on-site role includes a competitive base salary and comprehensive benefits in the US.

Qualifications

  • Bachelor’s degree in Computer Science, Computer Engineering, Data Science, Information Systems, or related field.
  • At least five years of progressive professional experience in software/data engineering.
  • Experience designing and implementing production data pipelines and distributed data-processing systems.
  • Experience with data transformation or workflow-orchestration technologies (dbt, Dagster, Airflow).
  • Experience designing data models, schemas, and storage strategies for large-scale analytics databases or cloud data warehouses.
  • Programming experience in Python, Go, Java, Scala, or similar languages.
  • Experience with SQL, performance optimization, data-quality testing, and production monitoring.
  • Knowledge of software-engineering practices (version control, automated testing, CI/CD).
  • Knowledge of telemetry, logging, APIs, and distributed-service architecture.
  • Ability to communicate designs, risks, and tradeoffs to engineering and business stakeholders.

Responsibilities

  • Design and implement scalable data systems and pipelines across production systems.
  • Develop data transformation and orchestration frameworks (dbt, Dagster, Airflow).
  • Improve data warehouse performance and reliability with scalable models and storage strategies.
  • Build product telemetry and data instrumentation for web apps and services.
  • Develop data catalog and semantic-layer capabilities for secure self-service analytics.
  • Support data-powered AI applications and platform foundations.
  • Operate and support the platform, including monitoring and on-call rotation.

Skills

Python
Go/Java/Scala
SQL
Data pipelines
Data modeling

Education

Bachelor’s degree in Computer Science or related field

Tools

dbt
Dagster
Airflow

Job description

CoreWeave, the AI Hyperscaler™ acquired Weights & Biases to create the most powerful end-to-end platform to develop, deploy, and iterate AI faster. Since 2017, CoreWeave has operated a growing footprint of data centers covering every region of the US and across Europe, and was ranked as one of the TIME100 most influential companies of 2024. By bringing together CoreWeave’s industry-leading cloud infrastructure with the best-in-class tools AI practitioners know and love from Weights & Biases, we’re setting a new standard for how AI is built, trained, and scaled.

The integration of our teams and technologies is accelerating our shared mission: to empower developers with the tools and infrastructure they need to push the boundaries of what AI can do. From experiment tracking and model optimization to high-performance training clusters, agent building, and inference at scale, we’re combining forces to serve the full AI lifecycle — all in one seamless platform.

Weights & Biases has long been trusted by over 1,500 organizations — including AstraZeneca, Canva, Cohere, OpenAI, Meta, Snowflake, Square,Toyota, and Wayve — to build better models, AI agents and applications. Now, as part of CoreWeave, that impact is amplified across a broader ecosystem of AI innovators, researchers, and enterprises.

As we unite under one vision, we’re looking for bold thinkers and agile builders who are excited to shape the future of AI alongside us. If you're passionate about solving complex problems at the intersection of software, hardware, and AI, there's never been a more exciting time to join our team.

What You’ll Do
Responsibilities
  • Design and implement scalable data systems and pipelines — 30%: Architect, develop, test, and maintain distributed batch and streaming pipelines that ingest, transform, validate, and deliver structured and semi-structured data across production systems.
  • Develop data transformation and orchestration frameworks — 20%: Build and optimize workflows using technologies such as dbt, Dagster, Airflow, or comparable tools. Establish testing, deployment, dependency-management, data-quality, and observability standards for these workflows.
  • Improve data warehouse performance and reliability — 15%: Design data models, schemas, partitioning strategies, and storage patterns for large-scale analytical workloads. Diagnose and resolve performance, scalability, availability, and cost-efficiency issues within multi-petabyte data environments.
  • Build product telemetry and data instrumentation — 15%: Partner with software engineering teams to define event schemas and implement reliable logging, telemetry, and instrumentation for web applications, backend services, and distributed systems.
  • Develop data catalog and semantic-layer capabilities — 10%: Design metadata, lineage, governance, and semantic-modeling systems that enable consistent business definitions and secure self-service analytics.
  • Support data-powered AI applications — 5%: Establish data interfaces and platform foundations for internal AI applications, including systems that support automated data discovery, workflow assistance, customer-growth analysis, churn-risk modeling, and abuse detection.
  • Operate and support the platform — 5%: Monitor production systems, troubleshoot incidents, document operational procedures, and participate in an on-call rotation after completing the required onboarding and training.

This position requires independent technical judgment to evaluate architectural alternatives, identify system constraints, and select appropriate data structures, algorithms, database designs, and distributed-processing patterns.

Minimum Qualifications
  • Bachelor’s degree or foreign equivalent in Computer Science, Computer Engineering, Data Science, Information Systems, or a closely related technical or quantitative field involving substantial coursework in Engineering.
  • At least five years of progressive professional experience in software engineering, data engineering, data infrastructure, or a closely related occupation.
  • Professional experience designing and implementing production data pipelines and distributed data-processing systems.
  • Professional experience with data transformation or workflow-orchestration technologies such as dbt, Dagster, Airflow, or comparable platforms.
  • Professional experience designing data models, schemas, and storage strategies for large-scale analytical databases or cloud data warehouses.
  • Professional experience programming in Python, Go, Java, Scala, or another general-purpose programming language used to build production data systems.
  • Professional experience with SQL, database performance optimization, data-quality testing, and production monitoring.
  • Knowledge of software-engineering practices, including version control, automated testing, code review, continuous integration, deployment automation, and technical documentation.
  • Knowledge of web-application telemetry, event instrumentation, logging systems, APIs, and distributed-service architecture.
  • Ability to communicate technical designs, risks, and tradeoffs to engineering, data science, analytics, and business stakeholders.
Preferred Qualifications
  • Experience operating multi-petabyte data platforms or other high-volume, business-critical data systems.
  • Experience with cloud infrastructure and data services on AWS, Google Cloud Platform, or Microsoft Azure.
  • Experience with data catalogs, metadata management, lineage systems, governance frameworks, or semantic layers.
  • Knowledge of machine-learning workflows, model-development terminology, or the data requirements of production AI applications.
  • Experience supporting internal platform users, responding to technical questions, and converting user feedback into platform improvements.
  • Demonstrated ability to work effectively in a self-directed environment, identify opportunities for improvement, and collaborate across engineering and business teams.
Why Us?
About
  • Be Curious at Your Core
  • Act Like an Owner
  • Empower Employees
  • Deliver Best-in-Class Client Experiences
  • Achieve More Together

We support and encourage an entrepreneurial outlook and independent thinking. We foster an environment that encourages collaboration and provides the opportunity to develop innovative solutions to complex problems. As we get set for takeoff, the growth opportunities within the organization are constantly expanding. You will be surrounded by some of the best talent in the industry, who will want to learn from you, too. Come join us!

The base salary range for this role is $165,000 to $242,000. The starting salary will be determined based on job-related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).

What We Offer

The range we’ve posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

In addition to a competitive salary, we offer a variety of benefits to support your needs. The benefits below reflect our US-based offerings; for roles in other locations, benefits vary and are shared during the hiring process. These include:

  • Medical, dental, and vision insurance - 100% paid for by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Ability to Participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health
  • Family-Forming support provided by Carrot
  • Paid Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with a generous employer match
  • Flexible PTO
  • Catered lunch each day in our office and data center locations
  • A casual work environment
  • A work culture focused on innovative disruption
California Applicants

California Consumer Privacy Act

Equal Opportunity & Accommodations

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.

As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: careers@coreweave.com.

Export Control Compliance

This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green card holder), (iii) refugee under 8 U.S.C.

  • 1157, or (iv) asylee under 8 U.S.C.
  • 1158, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. CoreWeave may, for legitimate business reasons, decline to pursue any export licensing process.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Engineering Manager, Artifacts & Registry - W&B
Engineering Manager, Artifacts & Registry - W&B

Weights & Biases • Sunnyvale (CA)

On-site
USD 165,000 - 242,000
Medical, dental, vision
401(k) with company match
Flexible PTO
+5
Senior Data Engineer
Senior Data Engineer

CoreWeave • New York (NY)

On-site
USD 207,000 - 275,000
Medical, dental, and vision insurance
401(k) with employer match
Employee Stock Purchase Program (ESPP)
+3
Staff Software Engineer, Data Infrastructure Services
Staff Software Engineer, Data Infrastructure Services

Socket.dev • Bellevue (WA), Sunnyvale (CA)

On-site
USD 207,000 - 275,000
Medical, dental, and vision insurance
401(k) with generous match
Paid parental leave
+3
Senior Production Engineer: AI Cloud Reliability
Senior Production Engineer: AI Cloud Reliability

CoreWeave • Bellevue (WA)

On-site
USD 139,000 - 204,000
Medical, dental, vision insurance
Company-paid Life Insurance
ESPP
+4
Senior Data Engineer, Fleet Monitoring & Analysis
Senior Data Engineer, Fleet Monitoring & Analysis

CoreWeave • Sunnyvale (CA)

On-site
USD 153,000 - 204,000
Medical, dental, vision insurance
401(k) with employer match
Equity awards
+3
Director, Account Solutions Architecture New San Francisco, CA
Director, Account Solutions Architecture New San Francisco, CA

Marimo Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 227,000 - 303,000
Medical, dental, vision
401(k) with employer match
Equity awards
+3
Senior Data Engineer
Senior Data Engineer

CoreWeave • San Francisco (CA)

On-site
USD 182,000 - 242,000
Medical, dental, and vision insurance
401(k) with generous match
ESPP
+4
Technical Support Engineer - III (Cloud)
Technical Support Engineer - III (Cloud)

CoreWeave • Bellevue (WA)

Hybrid
USD 122,000 - 163,000
Medical Insurance
Dental Insurance
Vision Insurance
+5
Senior Software Engineer, Workspaces- Weights & Biases
Senior Software Engineer, Workspaces- Weights & Biases

Weights & Biases • San Francisco (CA)

Hybrid
USD 165,000 - 242,000
Medical, dental, and vision insurance
Flexible PTO
401(k) with employer match
+2
Senior Data Engineer
Senior Data Engineer

CoreWeave • New York (NY)

On-site
USD 182,000 - 242,000
Medical, dental, and vision insurance
401(k) with match
Paid Parental Leave
+1