Lead Data Engineer: AI-Driven AWS Data Platform (Remote)

Capital Technology Group

Northern (KY)

Hybrid

USD 150,000 - 200,000

Full time

2 days ago

Be an early applicant

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Remote Work

Medical, Dental, and Vision

401(k) with 4% matching

PTO

Continuing Education

Wellness Budget

Bonus Programs

Job summary

Capital Technology Group is seeking a Lead Data Engineer to design, build, and maintain scalable data pipelines and platforms in a modern AWS-driven environment. You will collaborate with data engineers to prototype tools, assess risks, and deliver value for federal and commercial clients.

The role requires deep expertise in Spark, Python, SQL, and cloud-native data services, with mentorship responsibilities and agile teamwork across stakeholders.

Qualifications

Bachelor’s degree in Computer Science, Engineering, or related field.
8+ years of data engineering experience.
Strong knowledge of Spark (PySpark) and Python.
Experience with AWS data services and data lake design.
Excellent communication and teamwork in Agile.

Responsibilities

Design, build, and maintain scalable data pipelines and models.
Develop AWS-based data platforms using Glue, EMR, MWAA, S3, RDS.
Create ingestion, transformation, and orchestration workflows using Iceberg and Parquet.
Design analytical data platforms using Athena, Trino, Hive, OpenSearch, and data catalogs.
Mentor junior engineers and collaborate in Agile teams.

Skills

Apache Spark

Python

SQL

ETL/ELT

Education

Bachelor's degree in Computer Science

Tools

AWS Glue

Amazon EMR

Airflow

Amazon S3

Amazon RDS

Apache Iceberg

Parquet

Job description

The role requires deep expertise in Spark, Python, SQL, and cloud-native data services, with mentorship responsibilities and agile teamwork across stakeholders.

Get your free, confidential resume review.

or drag and drop your file here.