Lead Data Engineer - Cloud Data Pipelines & AI (Remote)

Capital Technology Group; United States; Hybrid; USD 150,000 - 200,000; Full time

Benefits offered by this job

Remote Work

Medical, Dental, Vision

401(k) with 4% matching

Continuing Education

Bonus incentive programs

Job summary

Capital Technology Group is seeking a Lead Data Engineer to design, build, and maintain scalable data pipelines and analytics platforms in an AWS environment. You will mentor engineers, evaluate new tools, and partner with teams to deliver mission-critical data solutions for federal and commercial clients.

The role requires 15+ years in data engineering, a strong cloud background, and hands-on experience with Spark, Python, SQL, dbt, and AWS services.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical field.
• 15+ years of professional experience in data engineering, data architecture, or related fields.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT workflows using PySpark, SQL, and dbt.
• Develop AWS-native data platforms leveraging Glue, EMR, MWAA, Lambda, Step Functions, S3, Redshift, RDS, DMS, and CloudWatch.
• Build data models and enable ingestion, transformation, and orchestration for structured and semi-structured data.
• Lead modernization and cloud migration of legacy platforms to AWS services.
• Mentor junior engineers and promote engineering best practices within Agile teams.

Skills

Apache Spark (PySpark)

Python

SQL (PostgreSQL)

dbt

AWS Glue

Amazon EMR

Amazon MWAA

AWS Lambda

AWS Step Functions

Amazon S3

Amazon Redshift

Amazon RDS

AWS DMS

Amazon CloudWatch

Education

Bachelor’s degree in Computer Science, Engineering, or a related technical field

Tools

Python

Job description

Capital Technology Group is seeking a Lead Data Engineer to design, build, and maintain scalable data pipelines and analytics platforms in an AWS environment. You will mentor engineers, evaluate new tools, and partner with teams to deliver mission-critical data solutions for federal and commercial clients.

The role requires 15+ years in data engineering, a strong cloud background, and hands-on experience with Spark, Python, SQL, dbt, and AWS services.