Senior Data Platform Engineer (Python, Spark, Databricks)

TerraForm Power; New York (NY); Hybrid; USD 108,000 - 152,000; Full time

Job summary

The Database Engineer / Senior Database Engineer at TerraForm Power is responsible for designing, developing, and supporting enterprise-scale data and analytics solutions across TerraForm Power's renewable energy portfolio.

This role blends software engineering, data engineering, and cloud technologies to build scalable data platforms, automate workflows, and deliver analytical solutions to optimize renewable energy operations.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Software Engineering, Electrical Engineering, Renewable Energy Engineering, or a related technical discipline.
• 5+ years of experience developing production software, data platforms, or engineering analytics solutions.
• Strong proficiency in Python with experience developing production-quality software.
• Strong SQL skills with experience designing and optimizing analytical data models.
• Experience developing ETL pipelines processing large-scale structured and time-series datasets.
• Strong understanding of distributed data processing concepts and cloud-based analytics platforms.
• Excellent analytical, communication, and problem-solving skills.
• Ability to work independently while collaborating effectively with cross-functional teams.
• Preferred: experience with utility-scale solar, wind, or battery storage operations.
• Preferred: Databricks, Apache Spark, Delta Lake, and cloud-native data platforms.
• Preferred: integrating SCADA systems, OT, and third-party APIs.
• Preferred: Streamlit or similar Python frameworks; forecasting or ML experience.

Responsibilities

• Data Engineering & Platform Development: Design, develop, and maintain enterprise-scale Python data pipelines within Databricks and Delta Lake environments.
• ETL & Ingestion: Build scalable ingestion pipelines integrating SCADA systems, weather providers, market data, and third-party APIs.
• Renewable Energy Performance Analytics: Design analytical solutions supporting lost production, curtailment, availability, degradation, and operational performance analysis.
• Data Quality & Engineering Excellence: Develop data quality frameworks including automated validation, reconciliation, anomaly detection, and monitoring.

Skills

Python

SQL

ETL pipelines

Distributed data processing

Cloud analytics platforms

Communication

Problem-solving

Education

Bachelor's degree in Computer Science, Data Engineering, Software Engineering, Electrical Engineering, Renewable Energy Engineering, or related

Tools

Databricks

Apache Spark

Delta Lake

Streamlit

Job description

The Database Engineer / Senior Database Engineer at TerraForm Power is responsible for designing, developing, and supporting enterprise-scale data and analytics solutions across TerraForm Power's renewable energy portfolio.

This role blends software engineering, data engineering, and cloud technologies to build scalable data platforms, automate workflows, and deliver analytical solutions to optimize renewable energy operations.