Lead Data Engineer

Experis; Houston (TX); On-site; USD 146,000 - 210,000; Full time

Benefits offered by this job

PTO 27 days

Holidays 10

Bonus 25%

Vehicle program

Job summary

Experis in Houston, TX is seeking a Lead Data Engineer to lead data infrastructure and analytics initiatives. The role emphasizes leadership, innovative thinking, and collaboration across teams.

You will design scalable data pipelines and guide architectural decisions in a cloud environment. The position requires 10+ years in data engineering, expertise in Medallion Architecture within Databricks Lakehouse, and strong knowledge of Spark, Hadoop, Kafka, and cloud services (AWS/Azure).

Qualifications

• Bachelor's Degree in Computer Science, MIS, or related field.
• ],
• job_responsibilities_description

Responsibilities

• Design and implement scalable data pipelines for ingesti ng, processing, and storage at scale using Spark, Hadoop, and Kafka.
• Architect and operationalize data pipelines in a Lakehouse using Medallion Architecture for Bronze/Silver/Gold layers.
• Develop and optimize data models and storage solutions (Databricks, Data Lakehouses) for operational and analytic use cases.
• Lead the Data Management Community of Practice, facilitating knowledge sharing and setting best practices across the organization.

Skills

Leadership

Data engineering

Medallion Architecture

Databricks

Spark

Hadoop

Kafka

AWS

Azure

Data Lakehouse

Education

Bachelor's Degree in CS / related field

Tools

Databricks

Dataiku

AWS services

Azure services

Job description

Experis

Houston, TX 77077

Our client isseeking a Lead Data Engineer to join their team. As a Lead Data Engineer, you will be part of supporting data infrastructure and analytics initiatives. The ideal candidate will demonstrate strong leadership, innovative thinking, and collaborative skills which will align successfully in the organization.

Job Title: Lead Data Engineer

Location:Houston, Texas-(4 days onsite) – Open to relocation w/ 15K sign-on bonus

Pay Range:$146,100 - $210,000 + bonus

What's the Job?

• Design and implement scalable and reliable data pipelines to ingest, process, and store diverse data at scale, utilizing technologies such as Apache Spark, Hadoop, and Kafka.
• Work within cloud environments like AWS or Azure to leverage services including EC2, RDS, S3, Lambda, and Azure Data Lake for efficient data handling and processing.
• Architect and operationalize data pipelines following Medallion Architecture best practices within a Lakehouse framework—ensuring data quality, lineage, and usability across Bronze, Silver, and Gold layers.
• Develop and optimize data models and storage solutions (Databricks, Data Lakehouses) to support operational and analytical applications, ensuring data quality and accessibility.
• Lead the Data Management Community of Practice, serving as the primary facilitator, coordinator, and spokesperson. Drive knowledge sharing, establish best practices, and represent the data engineering discipline across the organization.

What's Needed?

• Bachelor's Degree in Computer Science, MIS, or other business discipline and 10+ years of experience in data engineering, with a proven track record in designing and operating large-scale data pipelines and architectures.
• Demonstrated experience designing and implementing Medallion Architecture in a Databricks Lakehouse environment, including layer transitions, data quality enforcement, and optimization strategies.
• Comprehensive knowledge of platforms and services like Databricks, Dataiku, and AWS native data offerings.
• Solid experience with big data technologies (Apache Spark, Hadoop, Kafka) and cloud services (AWS, Azure) related to data processing and storage.

What's in it for me?

• 27 days of PTO and 10 paid holidays in a full year.
• 25% bonus and the vehicle program.
• Opportunity to work in a dynamic and innovative environment.
• Engage with cutting-edge data technologies and methodologies.
• Collaborate with a diverse and talented team committed to excellence.

Upon completion of waiting period consultants are eligible for:

• Medical and Prescription Drug Plans
• Vision Plan
• Health Savings Account
• Health Flexible Spending Account
• Dependent Care Flexible Spending Account
• Supplemental Life Insurance
• Short Term and Long Term Disability Insurance
• Business Travel Insurance
• Weekly Pay