Data Engineering Tech Lead - Cloud Pipelines & Architecture

Brooksource; Charlotte (NC); On-site; USD 140,000 - 200,000; Full time

Benefits offered by this job

401(k) Matching Plan

6 Paid Holidays

Regular engagement meetings

Job summary

Brooksource seeks a Technical Lead – Data Engineering to provide hands-on technical leadership across our data engineering platform. You will partner with architects and senior engineers to design scalable data solutions and drive best practices.

The role is highly hands-on with AWS Glue, PySpark, Kafka, DMS, Lambda, Redshift, and Aurora PostgreSQL, and you will mentor engineers while guiding platform reliability, performance, and data quality.

Qualifications

• 5+ years in data engineering or backend data platform work.
• 3+ years in a senior or lead role with architectural ownership.
• Senior experience with AWS Glue (PySpark), Python, and distributed processing.
• Experience with realtime streaming architectures and data modeling.

Responsibilities

• Provide hands-on technical leadership across the data engineering platform.
• Design scalable data solutions with architects and senior engineers.
• Lead ETL/ELT pipelines using AWS Glue and Python.
• Develop AWS Lambda orchestration and CDC/integration workflows.
• Ensure platform reliability, performance, and cost optimization.

Skills

Data Eng exp

Leadership

SQL

Data Modeling

ETL Pipelines

Streaming

Cloud AWS

Tools

AWS Glue

PySpark

Kafka

DMS

Lambda

Redshift

Aurora PostgreSQL

Spark

Job description

Brooksource seeks a Technical Lead – Data Engineering to provide hands-on technical leadership across our data engineering platform. You will partner with architects and senior engineers to design scalable data solutions and drive best practices.

The role is highly hands-on with AWS Glue, PySpark, Kafka, DMS, Lambda, Redshift, and Aurora PostgreSQL, and you will mentor engineers while guiding platform reliability, performance, and data quality.