Lead Data Engineer

Tap Growth ai

North Carolina

On-site

USD 140,000 - 190,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Tap Growth AI in North Carolina seeks a Lead Data Engineer to shape enterprise data platforms with hands-on design and implementation of scalable pipelines. The role emphasizes distributed processing, Spark workloads, and cloud-based data lake architectures.

Candidates should excel in Java and Python, build robust ETL/ELT processes, and collaborate with architecture teams to ensure data quality, governance, and production reliability across AWS-based platforms.

Qualifications

  • 10+ years of relevant experience.
  • Strong Java programming.
  • Python.
  • Apache Spark.
  • AWS.
  • ETL/ELT development.
  • Data lake and lakehouse concepts.
  • Parquet and Avro data formats.
  • Data quality and governance.

Responsibilities

  • Design and develop scalable data engineering solutions.
  • Build and maintain ETL/ELT pipelines.
  • Work with large-scale data processing using Apache Spark.
  • Develop data solutions using Java and Python.
  • Build and support AWS-based data platforms.
  • Work with data lakes and lakehouse architectures.
  • Implement data quality, validation, and governance practices.
  • Optimize data processing and pipeline performance.
  • Collaborate with architecture and engineering teams.
  • Support production data engineering environments.

Skills

Java
Python
Apache Spark
AWS
ETL/ELT
Data lake/lakehouse
Parquet/Avro
Data governance
10+ years experience

Job description

We are looking for a Lead Data Engineer with strong experience in enterprise data engineering, distributed processing, and cloud-based data platforms.

The candidate should have hands-on experience designing and developing scalable data pipelines and data lake/lakehouse solutions.

Key Responsibilities:

Design and develop scalable data engineering solutions.

Build and maintain ETL/ELT pipelines.

Work with large-scale data processing using Apache Spark.

Develop data solutions using Java and Python.

Build and support AWS-based data platforms.

Work with data lakes and lakehouse architectures.

Implement data quality, validation, and governance practices.

Optimize data processing and pipeline performance.

Collaborate with architecture and engineering teams.

Support production data engineering environments.

Required Skills:

10+ years of relevant experience.

Strong Java programming.

Python.

Apache Spark.

AWS.

ETL/ELT development.

Data lake and lakehouse concepts.

Parquet and Avro data formats.

Data quality and governance.

Preferred Skills:

Airflow, Dagster, or Control-M.

Kafka and streaming technologies.

Delta Lake, Apache Iceberg, or Hudi.

Snowflake.

Ideal Candidate:

Senior or Lead Big Data Engineer / Data Platform Engineer with strong hands-on coding capabilities.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer
Lead Data Engineer

Rapsys Technologies Pte Ltd. • North Carolina

On-site
USD 150,000 - 210,000
Lead Data Engineer
Lead Data Engineer

Harnham • United States

On-site
USD 150,000 - 210,000
Lead Data Engineer - Big Data
Lead Data Engineer - Big Data

Compunnel Inc. • Atlanta (GA)

On-site
USD 120,000 - 150,000
Lead Data Engineer
Lead Data Engineer

Good co India • United States

Remote
USD 120,000 - 180,000
Lead Data Engineer
Lead Data Engineer

TechDigital Group • Warsaw (IN)

On-site
USD 80,000 - 120,000
Lead Data Engineer
Lead Data Engineer

Marlabs Inc. • United States

Hybrid
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Peyton Resource Group • Houston (TX)

On-site
USD 120,000 - 150,000
Lead Data Engineer
Lead Data Engineer

Recru • Houston (TX)

On-site
USD 130,000 - 150,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Lead Data Engineer
Lead Data Engineer

Madison-Davis • New York (NY)

On-site
USD 150,000 - 190,000