Senior Data Architect: AWS Lakehouse & Spark Expert

Valiant Technologies LLC; Atlanta (GA); On-site; USD 140,000 - 200,000; Full time

Job summary

Valiant Technologies LLC is seeking a hands-on Data Architect to own the design, quality, and performance of our AWS-based data platform. You will define the architecture, write and review production code, and mentor the data engineering team.

You will translate business needs into reliable, compliant data solutions within the financial domain, ensuring data accuracy, lineage, auditability, and governance while optimizing costs and performance.

Qualifications

• 9+ years in the data domain (data engineering, warehousing, big data).
• Proven experience designing and delivering large-scale data platforms on AWS.
• Strong technical skills in Python, PySpark, SQL, and Spark internals.

Responsibilities

• Design end-to-end data architecture on AWS for ingestion, transformation, storage, and consumption.
• Develop and optimize PySpark/Python pipelines; tune Spark jobs and AWS Glue/Lambda workflows.
• Collaborate with stakeholders on financial data governance, security, and regulatory reporting.

Skills

Python

PySpark

SQL

Apache Spark

Data Modeling

Data Warehousing

Tools

AWS Glue

S3

Lambda

IAM

CloudWatch

Apache Airflow

Terraform

CloudFormation

Git

Job description

Valiant Technologies LLC is seeking a hands-on Data Architect to own the design, quality, and performance of our AWS-based data platform. You will define the architecture, write and review production code, and mentor the data engineering team.

You will translate business needs into reliable, compliant data solutions within the financial domain, ensuring data accuracy, lineage, auditability, and governance while optimizing costs and performance.