Senior Software Engineer (Data Platform)

Crusoe Energy Systems; San Francisco (CA); On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

Health & wellbeing

Time away

401(k) match

Mental wellness

Job summary

Crusoe Energy Systems is seeking a Senior Data Engineer to architect and build foundational data platform infrastructure powering AI and cloud operations. You will design scalable data systems, optimize pipelines, and ensure data quality at scale.

The role emphasizes ownership, collaboration across engineering teams, and mentoring as the team grows, with a focus on AI/ML workloads in a cloud-native environment.

Qualifications

• Bachelor’s degree (or foreign equivalent) in a technical field.
• 5+ years of progressive software or data engineering experience.
• Deep experience designing and building data platforms (warehouses, lakes, streaming).
• Infrastructure-as-Code mindset with CI/CD, containers, and automation.
• GCP data services experience (BigQuery, Dataflow, Pub/Sub, Cloud Storage).
• Experience with Apache Beam and streaming architectures.
• Familiarity with data orchestration tools (Airflow, Dagster, Prefect).
• Experience on growing or early-stage data teams and AI/ML workloads infrastructure.

Responsibilities

• Architect and build scalable data platform infrastructure.
• Develop high-performance data systems and storage solutions.
• Implement data quality, monitoring, and observability.
• Collaborate with engineers, data scientists, and operators.
• Drive technical excellence, establish best practices, and mentor teammates.

Skills

Python

Go

SQL

Data pipelines

Distributed systems

BigQuery

Dataflow

Airflow

Dagster

Prefect

Beam

Cloud infrastructure

CI/CD

Containerization

Education

Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or related field

Tools

Google Cloud Platform (GCP) data services

Apache Beam

Airflow

Dagster

Prefect

BigQuery

Dataflow

Job description

• Join Crusoe Energy as a Senior Data Engineer, an early and pivotal hire on our growing central Data Science and Engineering team
• This full-time position offers you the unique opportunity to architect and build the foundational data platform infrastructure that powers Crusoe’s AI and cloud operations
• You’ll go beyond building pipelines—you’ll design and implement the systems that make those pipelines possible, playing a key role in Crusoe’s mission to meet the ever-increasing demand for AI infrastructure and innovate sustainably
• Architect Data Platform Infrastructure: Design and build scalable, reliable data infrastructure systems that serve as the foundation for analytics, machine learning, and operational intelligence across Crusoe
• Build High-Performance Data Systems: Develop robust data processing frameworks and storage solutions optimized for the unique demands of AI infrastructure and cloud operations
• Champion Data Quality & Reliability: Implement data validation, monitoring, and observability systems that ensure data integrity and platform reliability at scale
• Collaborate Across Engineering Teams: Partner with software engineers, data scientists, and operations teams to understand requirements and deliver infrastructure that accelerates their work
• Drive Technical Excellence: Establish best practices for data engineering, contribute to architectural decisions, and mentor team members as the team grows

Benefits

• Health & wellbeing: Comprehensive health benefits designed to support your overall wellness
• Time away: Paid time off for vacations, family bonding, and unexpected needs
• 401(k) match: Build your financial future with our 401(k) matching program
• Mental wellness: Resources and support for your emotional wellbeing and navigating life’s challenges

• Strong Software Engineering Foundation: Demonstrate proficiency in Python and at least one systems-level language (Go preferred; Java, C, or C++ also valued), with the ability to write production-quality, maintainable code
• SQL Mastery: Exhibit advanced SQL skills for data modeling, query optimization, and database design
• Distributed Systems Knowledge: Show understanding of distributed computing principles, with experience building systems that scale reliably
• Ownership & Autonomy: As an early hire on the data engineering team, you’ll be expected to drive projects from conception to production with minimal supervision
• Collaboration Skills: Communicate effectively with technical and non-technical stakeholders to translate requirements into robust solutions
• Minimum Educational Requirement: Bachelor’s degree (or foreign equivalent) in Computer Science, Data Engineering, Information Systems, or a closely related technical field
• Minimum Experience: 5+ years of progressive, post-baccalaureate experience in software engineering, data infrastructure engineering, or a related role
• Data Infrastructure Expertise: Possess deep experience designing and building data platforms, including data warehouses, data lakes, streaming systems, and ETL/ELT frameworks
• Infrastructure-as-Code Mindset: Demonstrate familiarity with modern DevOps practices including CI/CD, containerization, and infrastructure automation
• Experience with Google Cloud Platform (GCP) data services (BigQuery, Dataflow, Pub/Sub, Cloud Storage)
• Experience with Apache Beam
• Experience with real-time data processing and streaming architectures
• Familiarity with data orchestration tools (e.g., Airflow, Dagster, Prefect)
• Experience on a growing or early-stage data team, contributing to foundational development
• Background in building infrastructure for AI/ML workloads or cloud computing platforms