Senior Data Engineer — Remote AWS/Databricks Data Platform

Capital-Technology-Group; Silver Spring (MD); Hybrid; USD 130,000 - 165,000; Full time

Benefits offered by this job

Remote work

Medical, dental, vision

401(k) with matching

Wellness budget

Education budget

PTO

Job summary

Capital Technology Group seeks a Senior Data Engineer to design, build, and maintain scalable data pipelines and data platforms on AWS and Spark-based technologies. You will work with PySpark, Databricks, dbt, and SQL to transform data for analytics and reporting.

You will mentor junior engineers, participate in Agile processes, and drive FedRAMP/NIST-aligned data solutions for federal and commercial clients.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related technical field.
• 9+ years of professional experience in data engineering or related domains.
• Strong hands-on experience with Databricks, Apache Spark (PySpark), Python, SQL (PostgreSQL), and dbt for large-scale data engineering, ETL/ELT development, data transformation, and data modeling.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT workflows.
• Develop and optimize AWS-native data platforms leveraging AWS Glue, EMR, MWAA, Lambda, Step Functions, S3, Redshift, RDS, DMS, CloudWatch.
• Integrate data sources across relational and NoSQL databases.
• Mentor junior engineers through technical guidance, architecture discussions, and code reviews.
• Collaborate with cross-functional teams in an Agile environment to define requirements and deliver data solutions.

Skills

Databricks

Apache Spark (PySpark)

Python

SQL (PostgreSQL)

dbt

AWS Glue

Amazon EMR

MWAA (Airflow)

AWS Lambda

Amazon Redshift

Education

Bachelor's degree in Computer Science, Engineering, or related

Tools

AWS

Databricks

Apache Iceberg

Parquet/ORC/Avro

PostgreSQL/Redshift/Oracle

Hadoop

Terraform

Job description

Capital Technology Group seeks a Senior Data Engineer to design, build, and maintain scalable data pipelines and data platforms on AWS and Spark-based technologies. You will work with PySpark, Databricks, dbt, and SQL to transform data for analytics and reporting.

You will mentor junior engineers, participate in Agile processes, and drive FedRAMP/NIST-aligned data solutions for federal and commercial clients.