Data Engineer / Lead Data Engineer

MSR Cosmos

Houston (TX)

Hybrid

USD 90,000 - 96,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

MSR Cosmos is seeking a Data Engineer / Lead Data Engineer in a hybrid role in Houston, TX to design and deliver data foundations and end-to-end analytics for a complex energy trading environment.

You will lead scalable ingestion and transformation pipelines on Microsoft Azure, build data models, semantic layers, dashboards, and data products, and mentor engineers while collaborating with cross-functional teams to drive data quality and business value.

Qualifications

  • Mandatory: demonstrable data engineering experience in energy trading, commodities trading, or an ETR/CTRM environment.
  • Advanced SQL, including development and optimisation of complex queries for data transformation and analysis.
  • Hands-on experience with Azure Data Factory, Azure SQL, Azure Databricks, Azure Blob Storage, and Azure Data Lake Storage.
  • Strong ETL/ELT and data warehousing experience, including delivery of BI solutions.
  • Experience with GitHub and/or Azure DevOps, including automated build, test, and release pipelines.
  • Ability to gather requirements, shape technical solutions, and communicate clearly with technical and business stakeholders.

Responsibilities

  • Lead scalable data ingestion and transformation pipelines using standard data lake and cloud frameworks.
  • Build solutions for structured and unstructured data in high-volume, high-velocity environments.
  • Develop transformation notebooks, data models, data endpoints, semantic layers, and visualisations.
  • Create reusable data products that improve data accessibility, consistency, and business value.
  • Lead ETL/ELT activities across source systems, data platforms, and downstream BI solutions.
  • Create and publish dashboards and reports for stakeholders with accessible, actionable information.
  • Run trend and correlation analysis; detect data discrepancies and implement data-quality controls.

Skills

ETL/ELT design
Data warehousing
Leadership
Stakeholder communication
SQL optimization

Tools

Azure Data Factory
Azure SQL
Azure Databricks
Azure Blob Storage
Azure Data Lake Storage
GitHub
Azure DevOps

Job description

MSR Cosmos is seeking a Data Engineer / Lead Data Engineer (hybrid) to design and deliver data foundations and end-to-end analytics solutions for a complex energy trading environment.

Responsibilities
  • Lead the design and development of scalable data ingestion and transformation pipelines using standard data lake and cloud engineering frameworks
  • Build solutions for structured and unstructured data in high-volume, high-velocity, high-variety environments
  • Develop transformation notebooks, physical and tabular data models, data endpoints, semantic layers, and visualisations
  • Create reusable data products that improve data accessibility, consistency, and business value
  • Lead ETL/ELT activities across source systems, data platforms, and downstream BI solutions
  • Create and publish dashboards and reports for stakeholders with accessible, actionable information
  • Run trend and correlation analysis; detect data discrepancies and implement controls to protect data quality across platforms
  • Define and enforce engineering standards, reusable patterns, documentation, and development practices
  • Build automated CI and release pipelines and apply disciplined source-control practices
  • Gather functional and non-functional requirements; translate features and Product Backlog Items into technical designs and delivery direction
  • Collaborate with cross-functional teams and mentor engineers where required
Requirements
  • Mandatory: demonstrable data engineering experience in energy trading, commodities trading, or an ETR/CTRM environment
  • Strong hands‑on experience designing production‑grade ingestion, storage, transformation, modelling, and serving layers on Microsoft Azure
  • Advanced SQL, including development and optimisation of complex queries for data transformation and analysis
  • Hands‑on experience with Azure Data Factory, Azure SQL, Azure Databricks, Azure Blob Storage, and Azure Data Lake Storage
  • Strong ETL/ELT and data warehousing experience, including delivery of BI solutions
  • Experience with dimensional, physical, and tabular data modelling and performance optimisation
  • Experience with GitHub and/or Azure DevOps, including automated build, test, and release pipelines
  • Ability to gather requirements, shape technical solutions, and communicate clearly with technical and business stakeholders
  • Proven ability to lead workstreams, manage priorities, and deliver effectively in a collaborative team environment
Preferred Experience
  • Experience with dbt, Azure Analysis Services, Azure Table Storage, and Azure Logic Apps
  • Experience with Power BI, including clear, decision‑oriented dashboards and reports
  • Exposure to Power Apps and broader Microsoft Power Platform capabilities
  • Familiarity with IBM DataStage or comparable enterprise integration tooling
  • Basic understanding of AI engineering, including how governed data products support analytics and AI use cases
  • Knowledge of data governance, lineage, metadata management, observability, and automated data‑quality controls
Technologies
  • SQL
  • Microsoft Azure
  • Azure Data Factory
  • Azure SQL
  • Azure Databricks
  • Azure Blob Storage
  • Azure Data Lake Storage
  • GitHub
  • Azure DevOps

Location: Houston, TX (hybrid)
Compensation: USD 65 - 70 per hour

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer — Energy Trading (Azure, Hybrid)
Lead Data Engineer — Energy Trading (Azure, Hybrid)

MSR Cosmos • Houston (TX)

Hybrid
USD 90,000 - 96,000
Data Engineer (Data Strategy & Platforms)
Data Engineer (Data Strategy & Platforms)

Elios, Inc. • Houston (TX)

Hybrid
USD 110,000 - 150,000
Data Engineer (Data Strategy & Platforms)
Data Engineer (Data Strategy & Platforms)

Elios AI • Houston (TX)

Hybrid
USD 100,000 - 130,000
Azure Data Engineer
Azure Data Engineer

Recru • Fort Worth (TX), Arlington (TX), Dallas (TX)

On-site
USD 120,000 - 150,000
Senior Data Engineer
Senior Data Engineer

RelMap Consulting • United States

Remote
USD 96,000 - 110,000
Data Engineer
Data Engineer

Elios, Inc. • Houston (TX)

On-site
USD 90,000 - 120,000
Data Engineer
Data Engineer

Attractivate Consulting Solutions • Atlanta (GA)

Hybrid
USD 90,000 - 130,000
Data Engineer
Data Engineer

TG Administration LLC • Scottsdale (AZ)

On-site
USD 95,000 - 130,000
Healthcare Benefits
Retirement Benefits
Time Off
Data Engineer
Data Engineer

Robotics Technologies • Columbia Township (MO)

On-site
USD 95,000 - 135,000
Senior Data Engineer
Senior Data Engineer

Foundation Partners Group • Orlando (FL)

On-site
USD 120,000 - 160,000