Lead Data Engineer: Lakehouse Architect & Data Platform

INSPYR Solutions

Houston (TX)

On-site

USD 140,000 - 190,000

Full time

5 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

INSPYR Solutions in Houston, TX is seeking an experienced Lead Data Engineer to join our Big Data and Advanced Analytics team. You will design and implement an Enterprise Data Lakehouse to support analytics for oil, gas operations, engineering, and measurements.

You will lead data pipelines, ensure data quality, govern data assets, and work with AWS, Airflow, Iceberg/Delta Lake, and Kubernetes to deliver scalable solutions and enable data-driven decisions across the business.

Qualifications

8+ years designing and maintaining data pipeline architectures.
5+ years Python and SQL programming.
Experience with data governance, security, and compliance.
Experience building a Data Lakehouse with Iceberg or Delta Lake.

Responsibilities

Design and implement reliable data pipelines to integrate disparate data sources into a single Data Lakehouse
Design and implement data quality pipelines to ensure data correctness and building trusted datasets
Design and implement a Data Lakehouse solution which accurately reflects business operations
Assist with data platform performance tuning and physical data model support including partitioning and compaction
Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives
Automate and optimize the data lifecycle, find insights from raw data, and applying DevOps principle to data pipelines
Work with business leaders to deliver custom software solutions meeting data needs
Build and support a data platform for data engineering teams to build, deploy and manage applications