Data Engineer

VC5 Consulting; Houston (TX); On-site; USD 110,000 - 140,000; Full time

Job summary

VC5 Consulting seeks a Data Engineer to build and maintain data pipelines and models for a centralized data platform serving global energy traders and analysts.

You will write Python to move market and fundamental data to analysts and AI systems, collaborate with senior engineers, and migrate pipelines to a Prefect-based framework while optimizing Snowflake storage and performance.

Qualifications

• 3+ years of hands-on data engineering building and operating production data pipelines.
• Strong Python coding skills with focus on clean, tested, maintainable code.
• Deep understanding of SQL for modeling, querying, and performance tuning.
• Experience with Snowflake or similar cloud data warehouse.
• Familiarity with dbt, pipeline orchestration tools (Prefect preferred), and AWS data services.

Responsibilities

• Develop and maintain robust data pipelines ensuring timely delivery of market and fundamental data to analysts and applications.
• Collaborate with senior engineers to establish best practices and design patterns across a polyglot tech stack.
• Migrate legacy data pipelines to a modern Prefect-based framework with minimal disruption.
• Optimize data storage and exposure methods within a Snowflake warehouse for better accessibility and performance.

Skills

Python

SQL

Tools

Snowflake

dbt

Prefect

AWS data services

Job description

This role is focused on building and maintaining the data pipelines and models that support a centralized data platform for global energy traders and analysts. The Data Engineer will write Python code to facilitate the movement of market and fundamental data to various consumers, including analysts and AI systems. This position offers the chance to work closely with senior engineers and directly engage with users to solve real-world problems, contributing to the platform's evolution and readiness for AI applications.

Key Responsibilities:

• Develop and maintain robust data pipelines that ensure the timely delivery of accurate market and fundamental data to analysts and applications.
• Collaborate with senior engineers to establish best practices and design patterns across a polyglot technology stack.
• Migrate legacy data pipelines to a modern Prefect-based framework, ensuring minimal disruption to ongoing operations.
• Optimize data storage and exposure methods within a Snowflake warehouse to enhance data accessibility and performance.

Required Qualifications:

• A minimum of 3 years of hands-on experience in data engineering, specifically in building and operating production data pipelines.
• Strong proficiency in Python, with a focus on writing clean, tested, and maintainable code.
• Deep understanding of SQL for modeling, querying, and performance tuning.
• Experience with Snowflake or a comparable cloud data warehouse.
• Familiarity with dbt, pipeline orchestration tools (Prefect preferred), and AWS data services.
• Location: Houston, TX 77027

This opportunity allows you to build a platform career while directly impacting the data needs of energy traders. Join a collaborative team of engineers and analysts dedicated to solving real challenges in the energy sector.

#11943