Senior Data Architect, AWS & Spark for Financial Data

Quantum Technologies. LLC; Atlanta (GA); On-site; USD 150,000 - 210,000; Full time

Job summary

Quantum Technologies. LLC is seeking a hands-on Data Architect to own the design, quality, and performance of an AWS-based data platform. You will define architecture, write production code, and mentor the data engineering team.

You’ll also translate business needs into reliable, compliant data solutions in the financial domain. The role emphasizes end-to-end data modeling, secure data handling, cost optimization, and leadership across data engineers.

Qualifications

• 9+ years in data domain (data engineering, warehousing, big data) with 3–4 years in architect/lead roles.
• Proven experience delivering large-scale data platforms on AWS.
• Strong Python and PySpark programming skills.

Responsibilities

• Design end-to-end data architectures on AWS including ingestion, transformation, storage and consumption layers.
• Lead hands-on development of PySpark/Python pipelines and optimize Spark jobs for performance.
• Build and optimize AWS Glue jobs, Lambda functions, and Airflow DAGs for reliable pipelines.
• Implement data quality checks, governance, lineage, and cost controls across platforms.
• Provide technical leadership, code reviews, and mentoring for the data engineering team.

Skills

Python

PySpark

SQL

Apache Spark

Airflow

Terraform

CloudFormation

Git

CI/CD

Data modeling

Data warehouse

Data lake

ETL

AWS

Tools

AWS Glue

S3

Lambda

IAM

CloudWatch

Apache Airflow

Delta Lake

Job description

Quantum Technologies. LLC is seeking a hands-on Data Architect to own the design, quality, and performance of an AWS-based data platform. You will define architecture, write production code, and mentor the data engineering team.

You’ll also translate business needs into reliable, compliant data solutions in the financial domain. The role emphasizes end-to-end data modeling, secure data handling, cost optimization, and leadership across data engineers.