Senior Data Engineer

Gridware; San Francisco (CA); On-site; USD 153,000 - 210,000; Full time

Job summary

An innovative company is seeking a Senior Data Engineer to design and optimize data pipelines for real-time monitoring of the electrical grid. This role involves managing large-scale sensor data, ensuring data integrity, and collaborating with cross-functional teams to meet data requirements. Join a forward-thinking team dedicated to enhancing grid safety and reliability while contributing to cutting-edge technology. This is an exciting opportunity to work in a dynamic environment where your skills will directly impact the future of energy infrastructure.

Benefits

Health, Dental & Vision Insurance

Paid Parental Leave

Alternating Day Off

"Off the Grid" Paid Break

Commuter Allowance

Company-Paid Training

Qualifications

• 5+ years of experience in data engineering or a similar role.
• Strong proficiency in SQL and experience with relational and time series databases.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures.
• Ensure data quality and integrity across various data sources.

Skills

SQL

Python

Hadoop

Spark

Kafka

Databricks

Grafana

Data Modeling

ETL Processes

Data Warehousing

Tools

Docker

Kubernetes

Job description

Get AI-powered advice on this job and more exclusive features.

Gridware exists to enhance and protect the mother of all networks: the electrical grid. The grid touches everything and the consequences can be dire when it fails: wildfires burn, land is destroyed, property is damaged, and lives are lost.

Our team created an advanced sensing system to continuously analyze critical grid behavior. Utilizing high-precision sensor arrays and intelligence, our system identifies and preemptively mitigates faults. The technology has been proven with utilities to bolster safety, enhance reliability, and reduce outages. The demand for power will only increase. We protect the grid of today while we build the grid of tomorrow.

Gridware is privately held and backed by the best climate-tech and Silicon Valley investors. We are headquartered in San Francisco, California.

Role Description

The Senior Data Engineer is responsible for designing, building, and optimizing data pipelines and infrastructure to support real-time grid monitoring systems. This role involves handling large-scale sensor data, ensuring data integrity, and enabling seamless data flow for analysis and decision-making.

About Gridware

Gridware exists to enhance and protect the mother of all networks: the electrical grid. The grid touches everything and the consequences can be dire when it fails: wildfires burn, land is destroyed, property is damaged, and lives are lost.

Our team created an advanced sensing system to continuously analyze critical grid behavior. Utilizing high-precision sensor arrays and intelligence, our system identifies and preemptively mitigates faults. The technology has been proven with utilities to bolster safety, enhance reliability, and reduce outages. The demand for power will only increase. We protect the grid of today while we build the grid of tomorrow.

Gridware is privately held and backed by the best climate-tech and Silicon Valley investors. We are headquartered in San Francisco, California.

Role Description

The Senior Data Engineer is responsible for designing, building, and optimizing data pipelines and infrastructure to support real-time grid monitoring systems. This role involves handling large-scale sensor data, ensuring data integrity, and enabling seamless data flow for analysis and decision-making.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures.
• Implement data ingestion, transformation, and storage solutions.
• Ensure data quality and integrity across various data sources and destinations.
• Collaborate with software engineers, data scientists, analysts, and other stakeholders to meet data requirements.
• Optimize and tune data workflows for performance and efficiency.
• Monitor, troubleshoot, and resolve issues in data pipelines and related systems.
• Document data processes, architecture, and workflow procedures.

Required Skills

• 5+ years’ proven experience in data engineering or a similar role.
• Strong proficiency in SQL and experience with relational and time series databases
• Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka).
• Proficiency in Python
• Experience with Databricks, Grafana
• Knowledge of data modeling, ETL processes, and data warehousing concepts.
• Knowledge of version control, automated deployments, and testing pipelines
• Familiarity with data governance and data security best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Bonus Skills

• Knowledge of machine learning and data science concepts.
• Experience with real-time data processing frameworks
• Familiarity with IOT / embedded systems
• Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
• Experience in high-growth startup environments where you must wear many hats
• Experience with Protobuf
• Familiarity with monitoring and alerting systems for real-time IoT time series analysis.

This describes the ideal candidate; many of us have picked up this expertise along the way. Even if you meet only part of this list, we encourage you to apply!

Benefits

Health, Dental & Vision (Gold and Platinum with some providers plans fully covered)

Paid parental leave

Alternating day off (every other Monday)

“Off the Grid”, a two week per year paid break for all employees.

Commuter allowance

Company-paid training

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at Gridware by 2x

Get notified about new Senior Data Engineer jobs in San Francisco, CA.

Senior Software Engineer, Handshake Plus - Monetization

San Francisco, CA $153,000.00-$210,000.00 5 months ago

Senior / Staff Software Engineer - Computational Chemistry / Molecular Dynamics

San Francisco, CA $162,000.00-$203,000.00 1 day ago

Senior Software Engineer, Lead - Supply Chain

Senior Staff Software Engineer - Benefits Products

Senior SWE (Web Apps) | #1 Productivity | Series B

San Francisco, CA $160,000.00-$240,000.00 2 weeks ago

Senior Data Scientist - Credit & Lending

Sr. Software Engineer - Investment Manager

San Francisco, CA $138,400.00-$173,000.00 3 days ago

Founding Team Senior Software Engineer Manager for a Social Travel Platform targeting Digital Nomads

San Francisco, CA $150,000.00-$200,000.00 2 months ago

Senior Software Engineer, Simulation Tooling

South San Francisco, CA $170,000.00-$210,000.00 5 days ago

Director, Software Engineering - Data Infrastructure

San Mateo, CA $100,000.00-$125,000.00 2 months ago

Technical Architect, Partner Solutions (Data Cloud & AI)

Client Implementations Data Solutions Architect

Tech Consulting - Cybersecurity - SIEM/SOAR Engineering - Senior

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.