Senior Data Engineer - Data Lake & Observability Lead

CoreWeave; San Francisco (CA); On-site; USD 153,000 - 204,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401(k) with match

Competitive PTO

Job summary

CoreWeave, a leader in AI infrastructure, seeks a Senior Data Engineer to own the data lake and analytics stack for observability of a global hardware fleet. You will manage Iceberg, Trino, Airflow, Spark, and Superset, delivering scalable ETL pipelines and executive-ready reporting.

Collaborate across teams to visualize performance and drive data-driven decisions. You will build data models, ensure data quality and security, and contribute to dashboards and documentation that empower

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 4–7 years of experience as a Data Engineer or similar data-focused role in a fast-paced environment.
• Strong SQL skills for data manipulation, modeling, and querying large datasets.
• Proficiency in Python, Java, or Scala for data engineering tasks.
• Hands-on experience with data pipeline orchestration tools (e.g., Apache Airflow) and big data technologies (e.g., Apache Spark).
• Experience designing, operating, and optimizing data lake/warehouse solutions, with data modeling and performance tuning.

Responsibilities

• Design, develop, and maintain scalable data pipelines from various sources.
• Maintain, monitor, and upgrade data lake infrastructure (Iceberg, Trino, Airflow, Spark, Superset).
• Maintain, monitor, and upgrade ETL/ELT pipelines for reliable data flows.
• Create and optimize data models and products to support analytics and reporting.
• Provide ad-hoc analysis and executive-level reporting to stakeholders.
• Create visualizations and dashboards to surface KPIs for internal audiences.
• Develop and maintain documentation and runbooks for data pipelines and models.

Skills

Strong SQL skills

Programming: Python/Java/Scala

ETL/ELT pipelines

Data governance & security

Observability & monitoring

Education

Bachelor’s degree in Computer Science/Engineering

Tools

Apache Iceberg

Trino

Apache Airflow

Apache Spark

Apache Superset

Job description

CoreWeave, a leader in AI infrastructure, seeks a Senior Data Engineer to own the data lake and analytics stack for observability of a global hardware fleet. You will manage Iceberg, Trino, Airflow, Spark, and Superset, delivering scalable ETL pipelines and executive-ready reporting.

Collaborate across teams to visualize performance and drive data-driven decisions. You will build data models, ensure data quality and security, and contribute to dashboards and documentation that empower