Senior Data Engineer: Real-Time Energy Analytics & Pipelines

Certus Sales Recruitment; Austin (TX); On-site; Full time

Job description

Senior Data Engineer – Energy Sector
Austin, TX – Hybrid
$160–180k + Excellent Benefits

Our client, a leading innovator in the energy sector, is seeking a Senior Data Engineer to design and deliver large-scale, high-performance data infrastructure powering advanced analytics, forecasting, and real-time decision-making.

This is a hands-on, high-impact role where you’ll build robust pipelines, integrate diverse datasets, and ensure data is available, accurate, and ready to drive mission-critical operations. You’ll work across data science, trading, and engineering teams, shaping the future of energy intelligence.

Role Overview

• Design & build pipelines – Create scalable ETL/ELT workflows to ingest, clean, and transform high-volume energy market, asset, and weather datasets.
• Enable real-time insights – Architect streaming systems for live market forecasting, congestion analysis, and operational decisions.
• Optimise storage & access – Implement efficient lakes and warehouses for fast, secure data delivery.
• Integrate diverse data sources – Combine ISO market feeds, asset telemetry, weather APIs, and historical data into unified platforms.
• Ensure reliability – Establish monitoring, validation, and alerting frameworks to maintain quality and availability.
• Collaborate widely – Partner with commercial, engineering, and data science teams to deliver production-ready solutions.
• Drive innovation – Research and deploy tools and architectures to improve speed, scalability, and maintainability.

About You

• 3+ years’ experience in production-grade ETL/ELT and large dataset management.
• Strong SQL and Python skills.
• Experience with modern data stack tools (Airflow, dbt, Kafka, Spark, Flink).
• Solid AWS knowledge (S3, Redshift, Lambda, Glue, ECS/EKS) plus Terraform or CloudFormation.
• Skilled in warehousing/lake platforms (Snowflake, BigQuery, Delta Lake).
• Familiarity with streaming architectures (Kafka, Kinesis, Pulsar).
• Comfortable with Git workflows, CI/CD, and testing pipelines.
• Energy market knowledge is a plus, not a must.
• Degree in Computer Science, Data Engineering, or related field (advanced degree/certifications welcome).

What’s on Offer

• $160–180k base + benefits
• Generous PTO
• Flexible hybrid working
• Professional development
• Medical, dental, and vision coverage

Certus Recruitment Group is a well-established and experienced specialist consultancy providing sales, marketing, and IT recruitment services. We serve the technology sector across North America, the UK, Europe, and Australia.

If you are ready to take your career to the next level and make a significant impact, apply now!