Senior Data Engineer - Lakehouse & Pipelines Lead (Onsite)

Talentify; Houston (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

INSPYR Solutions in Houston, TX is seeking an experienced Lead Data Engineer to help build an Enterprise Data Lakehouse supporting analytics for midstream oil and gas operations. You will design reliable pipelines and data quality processes, and collaborate with domain experts to reflect business needs in data architecture.

Strong background in Python and SQL, hands-on data engineering lifecycle, and knowledge of Airflow, Iceberg/Delta Lake, and cloud platforms will be essential as you lead

Qualifications

• 8+ years of experience designing and maintaining data pipeline architectures.
• 5+ years of in-depth programming with Python and SQL.
• Experience with data lakehouse technologies and data governance.
• Knowledge of SDLC, version control and deployment processes.

Responsibilities

• Design and implement reliable data pipelines to integrate disparate data sources into a single Data Lakehouse.
• Design and implement data quality pipelines to ensure data correctness and trusted datasets.
• Design and implement a Data Lakehouse solution reflecting business operations.
• Assist with data platform performance tuning and physical data model support including partitioning and optimization.
• Provide guidance in data visualizations and reporting aligned to business objectives.
• Automate and optimize the data lifecycle, applying DevOps principles to data pipelines.
• Collaborate with business leaders to deliver software solutions meeting data needs.
• Build and support a data platform for data engineering teams to build, deploy and manage applications.

Skills

Data pipeline design

Python programming

SQL programming

Software development lifecycle

Data governance

Education

Bachelor's degree in Computer Science or related field

Tools

Apache Iceberg

Delta Lake

Apache Airflow

Kubernetes

Snowflake

DBT

Airbyte

AWS

Job description

INSPYR Solutions in Houston, TX is seeking an experienced Lead Data Engineer to help build an Enterprise Data Lakehouse supporting analytics for midstream oil and gas operations. You will design reliable pipelines and data quality processes, and collaborate with domain experts to reflect business needs in data architecture.

Strong background in Python and SQL, hands-on data engineering lifecycle, and knowledge of Airflow, Iceberg/Delta Lake, and cloud platforms will be essential as you lead