Data Platform Lead: Lakehouse & Pipelines Architect

The Friedkin Group; Houston (TX); On-site; USD 150,000 - 210,000; Full time

Job summary

The Friedkin Group is seeking a Data Engineering Solutions Lead for the Trailblazer initiative to architect, implement, and manage scalable data infrastructure. You will champion lakehouse architecture and data governance, enabling real-time analytics and ML projects across the enterprise.

Lead the Data Management Community of Practice, collaborate with data scientists, and drive best practices in data quality and security within AWS/Azure cloud environments.

Qualifications

• Bachelor’s degree in CS, MIS or related field with strong data engineering background.
• 10+ years of data engineering experience designing large-scale pipelines.
• Experience implementing Medallion Architecture in a Databricks Lakehouse.
• Proficiency in SQL and programming languages (Python/Java/Scala).
• Hands-on with Spark, Hadoop, Kafka and cloud platforms (AWS/Azure).
• Strong communication, leadership, and ability to lead communities of practice.

Responsibilities

• Design and implement scalable data pipelines for ingestion, processing and storage at scale.
• Architect and operationalize Medallion Architecture across Bronze, Silver, Gold layers.
• Develop data models and storage solutions (Databricks, Data Lakehouses) for analytics.
• Automate data workflows using ETL/ELT tools and frameworks (Airflow, Fivetran).
• Lead Data Management Community of Practice and align stakeholders across tech/business.
• Collaborate with data scientists, providing infrastructure and tooling in Python/R.

Skills

Medallion Architecture

Databricks Lakehouse

Apache Spark

Hadoop

Kafka

Python

SQL

AWS

Azure

ETL/ELT

Education

Bachelor's Degree in CS/MIS or related

Master's Degree in CS/MIS (preferred)

Tools

Databricks

Dataiku

AWS services

Azure services

Job description

The Friedkin Group is seeking a Data Engineering Solutions Lead for the Trailblazer initiative to architect, implement, and manage scalable data infrastructure. You will champion lakehouse architecture and data governance, enabling real-time analytics and ML projects across the enterprise.

Lead the Data Management Community of Practice, collaborate with data scientists, and drive best practices in data quality and security within AWS/Azure cloud environments.