Senior Data Engineer: Fleet Analytics & Observability

CoreWeave; New York (NY); On-site; USD 153,000 - 204,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with employer match

Tuition Reimbursement

Stock Purchase Program (ESPP)

Job summary

CoreWeave is seeking a Senior Data Engineer to own and evolve the data lake and analytics stack powering observability for our global hardware fleet. You will maintain and upgrade the data lake infrastructure, ETL pipelines, and BI dashboards to deliver reliable, actionable insights for leadership.

You will design data products, model datasets for analytics, and collaborate across teams to visualize performance metrics and drive improvements in reliability and decision making.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 4–7 years of experience as a Data Engineer or in a similar data‑focused role in a fast‑paced environment.
• Strong SQL skills for data manipulation, modeling, and querying large datasets.
• Proficiency in at least one programming language commonly used for data engineering such as Python, Java, or Scala.
• Hands‑on experience with data pipeline orchestration tools (e.g., Apache Airflow) and big data technologies (e.g., Apache Spark).
• Experience designing, operating, and optimizing data lake and/or data warehouse solutions, with a solid understanding of data modeling and performance tuning.
• Knowledge of cloud platforms (e.g., AWS, GCP, Azure) and related data services.

Responsibilities

• Design, develop, and maintain robust and scalable data pipelines to collect, process, and store data from various sources, including APIs, databases, and third‑party services.
• Maintain, monitor, and upgrade CoreWeave’s data lake infrastructure, including Apache Iceberg, the Trino query layer, Apache Airflow, Apache Spark, and Apache Superset.
• Maintain, monitor, and upgrade ETL/ELT pipelines to ensure reliable, performant, and observable data flows across batch and (where applicable) streaming workloads.
• Create and optimize data models and data products to support analytics and reporting, ensuring data accuracy, consistency, and performance.
• Provide ad‑hoc analysis and reporting for team, director, and executive‑level stakeholders, translating business questions into data‑driven insights and clear narratives.
• Create visualizations and dashboards (e.g., in Apache Superset or similar tools) that surface key metrics, trends, and operational KPIs for a variety of internal audiences.
• Develop and maintain documentation and runbooks for data pipelines, data lake infrastructure, data models, and usage patterns to support knowledge sharing and troubleshooting.
• Implement data security and governance best practices to protect sensitive information and comply with data privacy regulations.
• Collaborate with cross‑functional teams to integrate data into applications and analytics platforms, helping to visualize performance metrics and identify opportunities for improvement.

Skills

SQL

Python

Java/Scala

Airflow

Spark

Superset

Data modeling

ETL/ELT pipelines

Cloud platforms

Education

Bachelor's degree

Tools

Apache Iceberg

Trino

Apache Superset

Apache Spark

Job description

CoreWeave is seeking a Senior Data Engineer to own and evolve the data lake and analytics stack powering observability for our global hardware fleet. You will maintain and upgrade the data lake infrastructure, ETL pipelines, and BI dashboards to deliver reliable, actionable insights for leadership.

You will design data products, model datasets for analytics, and collaborate across teams to visualize performance metrics and drive improvements in reliability and decision making.