Senior Data Engineer, Fleet Monitoring & Analysis

CoreWeave; Sunnyvale (CA); On-site; USD 153,000 - 204,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) with employer match

Equity awards

Flexible PTO

Catered lunch

Parental Leave

Job summary

CoreWeave, a leading AI cloud provider, seeks a Senior Data Engineer to own the data lake and analytics stack powering observability for its global hardware fleet. You will maintain Iceberg, Trino, Airflow, Spark, and Superset, while delivering ETL pipelines, data models, and executive-ready reporting across teams.

You will design robust data pipelines, optimize data products, and create visualizations for internal stakeholders, driving insights and reliability in a fast-paced environment.

Qualifications

• Bachelor's degree in CS or Engineering or related field.
• 4–7 years as a Data Engineer or similar data-focused role.
• Strong SQL for data manipulation and large datasets.
• Proficiency in Python, Java, or Scala for data pipelines.
• Hands-on with Airflow and big data tech (Spark).
• Experience designing data lake/warehouse and data modeling.
• Knowledge of AWS/GCP/Azure and analytics services.

Responsibilities

• Design, develop, and maintain scalable data pipelines from various sources.
• Maintain and upgrade data lake infrastructure (Iceberg, Trino, Airflow, Spark, Superset).
• Develop ETL/ELT pipelines for reliable data flows across batch and streaming workloads.
• Create and optimize data models and data products for analytics and reporting.
• Provide ad-hoc analysis and executive-ready reporting for stakeholders.
• Build visualizations and dashboards to surface KPIs for internal audiences.
• Document runbooks and ensure data security and governance.

Skills

SQL

Python

Java

Scala

Airflow

Spark

Superset

Data Modeling

ETL/ELT

Reporting

Education

Bachelor's degree in CS/Engineering

Tools

Apache Iceberg

Trino

Apache Spark

Apache Superset

Job description

CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at www.coreweave.com.

What You’ll Do

The Fleet Monitoring and Analysis (FMA) team builds and operates the forward‑deployed monitoring and observability layer for CoreWeave’s ever‑expanding global hardware fleet; continually improving node and environmental visibility to support automated provisioning and high‑reliability operations.

About The Role

As a Senior Data Engineer you will own and evolve the data lake and analytics stack that powers observability and decision‑making for CoreWeave’s global hardware fleet. You’ll maintain, monitor, and upgrade our data lake infrastructure (Apache Iceberg, Trino, Apache Airflow, Apache Spark, Apache Superset) and ETL pipelines, while delivering ad‑hoc analysis and executive‑ready reporting for team, director, and leadership stakeholders. You’ll also create visualizations, documentation, and integrations that make fleet monitoring data reliable, discoverable, and actionable across the organization.

In This Role, You Will

• Design, develop, and maintain robust and scalable data pipelines to collect, process, and store data from various sources, including APIs, databases, and third‑party services.
• Maintain, monitor, and upgrade CoreWeave’s data lake infrastructure, including Apache Iceberg, the Trino query layer, Apache Airflow, Apache Spark, and Apache Superset.
• Maintain, monitor, and upgrade ETL/ELT pipelines to ensure reliable, performant, and observable data flows across batch and (where applicable) streaming workloads.
• Create and optimize data models and data products to support analytics and reporting, ensuring data accuracy, consistency, and performance.
• Provide ad‑hoc analysis and reporting for team, director, and executive‑level stakeholders, translating business questions into data‑driven insights and clear narratives.
• Create visualizations and dashboards (e.g., in Apache Superset or similar tools) that surface key metrics, trends, and operational KPIs for a variety of internal audiences.
• Develop and maintain documentation and runbooks for data pipelines, data lake infrastructure, data models, and usage patterns to support knowledge sharing and troubleshooting.
• Implement data security and governance best practices to protect sensitive information and comply with data privacy regulations.
• Collaborate with cross‑functional teams to integrate data into applications and analytics platforms, helping to visualize performance metrics and identify opportunities for improvement.

Who You Are

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 4 - 7 years of experience as a Data Engineer or in a similar data‑focused role in a fast‑paced environment.
• Strong SQL skills for data manipulation, modeling, and querying large datasets.
• Proficiency in at least one programming language commonly used for data engineering such as Python, Java, or Scala.
• Hands‑on experience with data pipeline orchestration tools (e.g., Apache Airflow) and big data technologies (e.g., Apache Spark).
• Experience designing, operating, and optimizing data lake and/or data warehouse solutions, with a solid understanding of data modeling and performance tuning.
• Knowledge of cloud platforms (e.g., AWS, GCP, Azure) and related data services (e.g., object storage, managed databases, analytics services).
• Familiarity with database systems (e.g., SQL and NoSQL) and data warehousing concepts, including partitioning, indexing, and schema design.
• Experience building, maintaining, and monitoring ETL/ELT pipelines in production environments, including alerting and observability.
• Experience creating and maintaining reporting and analytics solutions (dashboards, reports, and metrics) for technical and non‑technical audiences.

Preferred

• Experience with modern data lakehouse technologies and table formats such as Apache Iceberg (or similar technologies like Delta Lake or Apache Hudi).
• Experience with Trino or other distributed SQL query engines at scale.
• Experience with Apache Superset or other BI/visualization tools for building self‑service analytics.
• Experience with data quality frameworks, data observability tooling, and/or metadata management.
• Experience supporting executive‑level reporting and KPI design in partnership with business and finance stakeholders.

Wondering if you’re a good fit?

• You love owning data infrastructure end‑to‑end—from ingestion and modeling to analytics and visualization.
• You’re curious about modern data lake and lakehouse architectures and enjoy working with open‑source data tooling.
• You’re an expert at turning loosely defined business questions into concrete data products, metrics, and dashboards that drive decisions.

What We Offer

The base salary range for this role is $153,000 to $204,000. The starting salary will be determined based on job‑related knowledge, skills, experience, and market location. We strive for both market alignment and internal equity when determining compensation. In addition to base salary, our total rewards package includes a discretionary bonus, equity awards, and a comprehensive benefits program (all based on eligibility).

The range we’ve posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location.

In addition to a competitive salary, we offer a variety of benefits to support your needs. The benefits below reflect our US‑based offerings; for roles in other locations, benefits vary and are shared during the hiring process. These include:

• Medical, dental, and vision insurance - 100% paid for by CoreWeave
• Company‑paid Life Insurance
• Voluntary supplemental life insurance
• Short and long‑term disability insurance
• Flexible Spending Account
• Health Savings Account
• Tuition Reimbursement
• Ability to Participate in Employee Stock Purchase Program (ESPP)
• Mental Wellness Benefits through Spring Health
• Family‑Forming support provided by Carrot
• Paid Parental Leave
• Flexible, full‑service childcare support with Kinside
• 401(k) with a generous employer match
• Flexible PTO
• Catered lunch each day in our office and data center locations
• A casual work environment
• A work culture focused on innovative disruption

California Applicants

California Consumer Privacy Act

Equal Opportunity & Accommodations

CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information. As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: [e-mail].

Export Control Compliance

This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green card holder), (iii) refugee under 8 U.S.C., (iv) asylee under 8 U.S.C., (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. CoreWeave may, for legitimate business reasons, decline to pursue any export licensing process.