Data Engineer

The Talance Group

Houston (TX)

On-site

USD 110,000 - 160,000

Full time

7 days ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

The Talance Group is seeking a Data Engineer to build and run the pipelines and data models behind a core data platform serving energy traders and analysts in real time. You will write Python that moves market and fundamental data from source to analysts, applications, and AI systems.

This hands-on role covers a polyglot stack: streaming, caching, timeseries, relational, and warehouse tech. You’ll migrate legacy pipelines, implement quality checks, and collaborate with analysts and desk users to

Qualifications

  • 3+ years of hands-on data engineering experience building and operating production data pipelines.
  • Strong Python, clean, tested code with pandas and data-handling ecosystem.
  • SQL depth: modeling, querying, tuning, and understanding expensive queries.

Responsibilities

  • Build, test, and operate production data pipelines in Python on our modern pipeline framework, orchestrated with Prefect.
  • Build and maintain warehouse models in Snowflake using dbt - clean, tested, documented, and cost-aware.
  • Migrate legacy pipelines and Oracle-based components onto current frameworks and standards, retiring technical debt as you go.
  • Work across the platform stack - Kafka, Redis, InfluxDB, Oracle, and Snowflake, following established patterns.
  • Acquire data from external sources - vendor APIs, files, feeds, and web sources, landing it reliably.
  • Implement data quality, freshness, and reconciliation checks so problems surface before users find them.
  • Use AWS data services where our platform patterns call for them.
  • Support what you ship - monitoring and alerting on your components, and investigate when something breaks.
  • Contribute to making platform data AI-ready, and work with catalog and steward teams so what you build is documented, classified, and findable.
  • Engage with analysts and desk users to ensure your work solves real problems.

Skills

Python
SQL
Snowflake
dbt
Prefect
Kafka
AWS data services
Code quality
Communication
Terraform/Docker/API

Education

Bachelor's degree in a related field

Tools

Snowflake
dbt
Prefect
Airflow/Dagster
Kafka
Redis
InfluxDB
Oracle
FastAPI/ Flask

Job description

The Role

We are looking for a Data Engineer to build and run the pipelines and data models behind our core data platform - the centralized data layer that serves global energy traders and analysts in real time.

This is a hands-on delivery role. You will write the Python that moves market and fundamental data from source through to the analysts, applications, and AI systems that consume it, and you will support what you ship.

Python is the core skill, but it is not the whole job. We are standing up a Snowflake warehouse, migrating legacy pipelines onto a Prefect-based framework, and consolidating how the platform stores and exposes data. The work reaches across more of the stack than pipeline code alone.

The platform is polyglot by design: streaming, caching, timeseries, relational, and warehouse technologies each doing what they are good at. You will build to the established patterns across that stack, and we expect you to understand why each technology sits where it does.

You will work alongside senior engineers who set those patterns, and directly with the analysts and desk users your work serves. The scope grows as you do - this is a role you can build a platform career from.

What You Will Do
  • Build, test, and operate production data pipelines in Python on our modern pipeline framework, orchestrated with Prefect
  • Build and maintain warehouse models in Snowflake using dbt - clean, tested, documented, and cost-aware
  • Migrate legacy pipelines and Oracle-based components onto current frameworks and standards, retiring technical debt as you go
  • Work across the platform stack - Kafka, Redis, InfluxDB, Oracle, and Snowflake - building to the established pattern for each rather than reaching for the tool you already know
  • Acquire data from external sources - vendor APIs, files, feeds, and web sources - and land it reliably
  • Implement data quality, freshness, and reconciliation checks so problems surface before users find them
  • Use AWS data services where our platform patterns call for them
  • Support what you ship - monitoring and alerting on your components, and investigating when something breaks
  • Contribute to making platform data AI-ready, and work with the catalog and steward teams so what you build is documented, classified, and findable
  • Engage directly with analysts and desk users to check that what you are building solves the actual problem
What You Bring
  • 3+ years of hands-on data engineering experience building and operating production data pipelines
  • Strong Python - clean, tested, maintainable code, not scripts that happen to run. Fluency with pandas and the wider data-handling ecosystem
  • SQL depth - you can model, query, and tune, and you know what makes a query expensive before you run it
  • Snowflake or a comparable cloud warehouse - dimensional modeling, performance tuning, and cost-aware design. dbt experience is a strong plus
  • Breadth across data technologies - streaming, caching, timeseries, relational, and warehouse, with a view on where each belongs. Kafka, Redis, InfluxDB, Oracle, and Snowflake are what we run; comparable exposure matters more than an exact match
  • Pipeline orchestration experience - Prefect preferred; Airflow, Dagster, or similar considered
  • Sound engineering fundamentals - object-oriented design, design patterns, testing, code review, and version control as habits rather than requirements
  • Working knowledge of AWS data services and how to compose them into something reliable
  • A build-to-operate mindset - monitoring, alerting, and failure recovery are part of how you design, not something added later
  • Clear communication - you can explain a technical trade-off to an analyst, and turn a vague request into the right set of questions
  • Terraform, Docker, or API development (FastAPI, Flask) exposure is welcome - we use all three
  • Experience in financial services, commodities, or energy trading data is a plus; the data volume, latency requirements, and stakes are real
What Success Looks Like in Year One
  • You own several production data components outright and they run reliably with minimal intervention
  • Warehouse models you built in Snowflake are in active use by analysts and downstream applications
  • A meaningful share of the legacy pipelines you inherited have been migrated onto the current framework and standards
  • Data quality and freshness checks you implemented are catching issues before users report them
  • You build to the right platform pattern without being told which one applies - and you say so when none of them fit
  • Analysts on your projects come to you directly, and trust what you deliver
The Environment

This is a global energy trading company - fast-moving, commercially driven, and technically serious. The data platform is core infrastructure, not a side project. Your users are traders and analysts who will tell you directly when something is wrong, and who depend on the platform being right.

We value directness, quality over volume, and engineers who own outcomes - not just tickets.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Vitol • Houston (TX)

On-site
USD 120,000 - 180,000
Medical
Vision
Paid Vacation
+3
Data Engineer
Data Engineer

VC5 Consulting • Houston (TX)

On-site
USD 110,000 - 160,000
Data Engineer - Tier 1 Global Asset Manager
Data Engineer - Tier 1 Global Asset Manager

Mondrian Alpha • New York (NY)

On-site
USD 120,000 - 160,000
Data Engineer
Data Engineer

Ranger Technical Resources • Town of Florida (NY)

On-site
USD 110,000 - 160,000
Data Engineer
Data Engineer

eNGINE • Pittsburgh

On-site
USD 120,000 - 165,000
5% 401(k) match
4% profit-sharing after 1 year
Data Engineer
Data Engineer

Insight Global • Chantilly (VA)

On-site
USD 110,000 - 160,000
Engineering Manager, Data Engineering Experience
Engineering Manager, Data Engineering Experience

Snowflake • United States

On-site
USD 140,000 - 190,000
Data Platform Transformation Architect
Data Platform Transformation Architect

Anvik Technologies • Denver (CO)

On-site
USD 130,000 - 180,000
Senior Data Engineer
Senior Data Engineer

The Phoenix Group • New York (NY)

On-site
USD 120,000 - 170,000
Senior Data Engineer
Senior Data Engineer

SDL Search Partners • Boston (MA)

On-site
USD 130,000 - 185,000
Competitive compensation