AWS Data Engineer: Python, Spark & Security

Eliassen Group; McLean (VA); Hybrid; USD 83,000 - 96,000; Full time

Benefits offered by this job

Medical, Dental, Vision

401k with company matching

Life insurance

Job summary

Eliassen Group seeks a Data Engineer to design and support a Python-based, AWS-native data ingestion platform that moves financial data from source systems into a third‑party app. The role emphasizes testing, security remediation, and data-protection compliance in a hybrid model.

The engineer will work with CDK-provisioned infrastructure, Glue and Spark processing, and Lambda/ECS/Flink pipelines, ensuring robust end-to-end data flows and production readiness.

Qualifications

• Proficiency in Python for data engineering tasks and pipelines.
• Hands-on AWS experience with Lambda, EC2/ECS, Kinesis, S3, DynamoDB, IAM, and CDK.
• Experience with Glue and Spark for data processing.
• Background with streaming and batch pipelines (Flink or similar).
• Strong CI/CD discipline and Git workflows; security/compliance exposure.

Responsibilities

• Build and maintain pipeline stages across ingest, validation, tokenization, reformatting, and publishing.
• Develop and execute unit tests and end-to-end tests for data pipelines and platform components.
• Support end-to-end and system test phases to ensure production readiness.
• Drive compliance with data-protection standards and handle sensitive data securely.
• Remediate security findings across codebase and dependencies.
• Contribute to AWS-native implementations using Lambda, ECS, Kinesis, S3, DynamoDB, IAM, and CDK.
• Follow disciplined Git workflows and CI/CD practices.

Skills

Python

Data engineering

CI/CD

Git

Security/compliance

Tools

AWS

CDK

Glue

Spark

Flink

Kinesis

S3

DynamoDB

IAM

Job description

Eliassen Group seeks a Data Engineer to design and support a Python-based, AWS-native data ingestion platform that moves financial data from source systems into a third‑party app. The role emphasizes testing, security remediation, and data-protection compliance in a hybrid model.

The engineer will work with CDK-provisioned infrastructure, Glue and Spark processing, and Lambda/ECS/Flink pipelines, ensuring robust end-to-end data flows and production readiness.