Senior Data Pipeline Engineer

Gaiascope; United States; Remote; USD 90,000 - 150,000; Full time

Job summary

Join a rapidly growing climate tech startup at the forefront of sustainable energy! As a Data Pipeline Engineer, you'll be instrumental in developing and scaling cloud-based data pipelines that drive impactful decisions for our clients. Collaborate with a passionate team to enhance data capabilities, ensuring efficient data processing and storage. This role offers the chance to work with cutting-edge technologies in a supportive environment, where your contributions will directly influence the green energy sector. If you are detail-oriented and thrive in a fast-paced setting, this opportunity is perfect for you!

Benefits

Unlimited Paid Time Off

Competitive Medical, Dental, and Life Insurance

Parental and Family Leave Policies

Continued Learning Opportunities

Opportunity for Equity

Work from Home Flexibility

Supportive Investor Base

Diverse Work Environment

Qualifications

• 8-10 years of experience in data pipeline or software engineering.
• Expertise in building high-volume, low-maintenance data pipelines.
• Proficient in Python and SQL, with knowledge of cloud services.

Responsibilities

• Build and maintain scalable and reliable data pipelines.
• Integrate weather and grid data sources for analytics.
• Monitor performance and troubleshoot data pipeline issues.

Skills

Data Pipeline Development

Problem-Solving Skills

Attention to Detail

Cloud Services (AWS, Azure, GCP)

ETL Processes

Distributed Systems

Team Collaboration

Data Governance

Education

Bachelor's Degree in Computer Science or related field

Tools

Python

SQL

Dagster

Prefect

Airflow

CI/CD Tools

Job description

Data is at the heart of Gaiascope's mission to provide its sustainable energy clients with superior insights for making strategic and actionable trading and dispatch decisions. Every day, Gaiascope forecasts more than 38 million individual data points on the electric grid. Each hour we forecast over 700 price points, 900 generating units, 4,400 bus-level loads, and 9,800 line and transformer flows.

To power this mission, we are looking for a highly skilled Data Pipeline Engineer to join our team of Software Engineers and Data Scientists. The ideal candidate is passionate about data, is extremely detail-oriented, self-motivated, curious, and communicative, and has a diverse software background with extensive experience developing and scaling cloud-based pipelines.

You will work closely with data scientists and other stakeholders to understand their data needs and develop solutions that extend the capabilities of our products.

Your role will involve working with a variety of external data sources and ensuring that data is fetched, processed, and stored in a way that is both efficient and scalable.

You will also be responsible for monitoring the performance of data pipelines, troubleshooting issues, and implementing improvements to enhance scalability, reliability, and observability.

Excellent problem-solving skills, attention to detail, and the ability to work in a fast-paced environment are essential for this role. If you are passionate about data and have the skills and experience we are looking for, we would love to hear from you.

Responsibilities Include:

• Building and maintaining scalable, reliable, observable data pipelines.
• Building and maintaining integrations to sources of weather and grid data.
• Supporting data governance and compliance initiatives.
• Building dashboards and tools for monitoring and alerting.
• Contributing to our overall data pipeline architecture.
• Performance tuning and troubleshooting.
• Promoting best practices in data management and pipeline development.
• Participating in code reviews and contributing to team knowledge sharing.

Requirements:

• 8-10 years of industry experience as a data, data pipeline, machine learning, or software engineer.
• A track record of building high-volume, low-maintenance data pipelines for machine learning applications. Experience with reliability and hardening a plus.
• Experience with ETL processes and ingesting data from multiple data sources.
• Experience with source code control tools and CI/CD practices.
• Proficiency in a programming language such as Python and a database query language like SQL.
• Knowledge of cloud services (AWS, Azure, or GCP) and their data-related services, as well as orchestration tools such as Dagster (our choice), Prefect, or Airflow.
• Knowledge of data security and privacy practices.
• Understanding of distributed systems.
• Team-first mentality.
• Attention to detail.

What We Offer:

Gaiascope is an accomplished and rapidly growing climate tech startup in the sustainable energy sector. You’ll be hands-on with emerging technologies that are already revolutionizing the green energy sector, bettering people and planet. Also:

• Opportunity to work with an innovative team on big, impactful problems.
• A fast-growing startup with a supportive investor base.
• Competitive pay and opportunity for equity.
• Ability to work from home.
• Diverse work with a chance to experience all aspects of a premier start-up.

Employee Programs & Benefits:

Gaiascope offers competitive benefits and programs to support our employees and their families. These include:

• Competitive comprehensive medical, dental, and life insurance benefits.
• Parental and family leave policies.
• Unlimited paid time off.
• Continued learning opportunities.

Visit https://gaia-scope.com to learn more.