Lead Data Engineer: Lakehouse & Data Platform Architect

Recru; Houston (TX); On-site; USD 130,000 - 150,000; Full time

Job summary

A leading IT services company is seeking a Lead Data Engineer to architect and manage robust data infrastructure. The role demands expertise in scalable data pipelines, cloud environments, and Medallion Architecture. Candidates should have considerable experience in data engineering and knowledge of tools like Databricks and Apache Spark. This is a visible leadership role, focusing on data governance and collaboration with data scientists for complex analytics. Strong communication skills and executive presence are essential.

Qualifications

• 10+ years of experience in data engineering with a proven track record.
• Experience with Medallion Architecture in Databricks.
• Strong executive presence and communication skills.

Responsibilities

• Design and implement scalable data pipelines using Apache Spark and Hadoop.
• Lead the Data Management Community of Practice.
• Ensure compliance with data governance policies.

Skills

Data pipeline design

Medallion Architecture

Cloud services (AWS, Azure)

Apache Spark

SQL

Python

Data governance

Education

Bachelor's Degree in Computer Science or related field

Tools

Databricks

Apache Airflow

Fivetran

Job description

A leading IT services company is seeking a Lead Data Engineer to architect and manage robust data infrastructure. The role demands expertise in scalable data pipelines, cloud environments, and Medallion Architecture. Candidates should have considerable experience in data engineering and knowledge of tools like Databricks and Apache Spark. This is a visible leadership role, focusing on data governance and collaboration with data scientists for complex analytics. Strong communication skills and executive presence are essential.