Data Engineering Solutions Lead: Lakehouse Pipelines

Gulf States Financial Services, Inc.; Houston (TX); Remote; USD 150,000 - 210,000; Full time

Job summary

The Friedkin Group seeks a Data Engineering Solutions Lead to architect, implement, and manage scalable data infrastructure supporting analytics, ML, and real-time processing. Lead the Data Management Community of Practice and collaborate with data scientists and business stakeholders.

We value hands-on expertise with Medallion Architecture, Databricks Lakehouse, and cloud services in AWS/Azure, along with strong SQL and Python/Java/Scala skills for data processing and governance.

Qualifications

• Bachelor's degree and 10+ years in data engineering; design and operation of large-scale pipelines.
• Master's degree plus 5+ years in data engineering; proven pipeline/architecture experience.
• Experience implementing Medallion Architecture in a Databricks Lakehouse.
• Expertise in ETL/ELT workflows and data modeling.
• Knowledge of Databricks, Dataiku, AWS native data offerings.
• Strong SQL and programming skills in Python/Java/Scala.

Responsibilities

• Design and implement scalable data pipelines handling diverse data at scale.
• Work in AWS or Azure cloud environments leveraging core services (EC2, S3, Lambda, Data Lake).
• Architect and operationalize Lakehouse pipelines across Bronze/Silver/Gold layers.
• Develop and optimize data models and storage (Databricks, Data Lakehouses).
• Automate data workflows with Airflow or similar tools to ensure timely data delivery.
• Lead the Data Management Community of Practice and coordinate cross-functional alignment.

Skills

Medallion Architecture

Databricks

Spark

Hadoop

Kafka

AWS

Azure

Python

SQL

Java/Scala

RDBMS

ETL/ELT

Data governance

Education

Bachelor's Degree in CS/MIS

Master's Degree in CS/MIS

Tools

Databricks

Dataiku

AWS data services

Job description

The Friedkin Group seeks a Data Engineering Solutions Lead to architect, implement, and manage scalable data infrastructure supporting analytics, ML, and real-time processing. Lead the Data Management Community of Practice and collaborate with data scientists and business stakeholders.

We value hands-on expertise with Medallion Architecture, Databricks Lakehouse, and cloud services in AWS/Azure, along with strong SQL and Python/Java/Scala skills for data processing and governance.