Data Engineer: Secure AWS Data Pipelines (Python)

Compunnel, Inc.; Richmond (VA); On-site; USD 95,000 - 140,000; Full time

Job summary

Compunnel, Inc. seeks a Data Engineer to design, build, and optimize a Python-based, AWS-native data ingestion platform. You will move financial data from source systems into a third-party app, while ensuring secure, scalable pipelines and strict governance.

You will implement testing strategies and partner with teams to maintain data quality and platform reliability in a regulated environment.

Qualifications

• Proficiency in building production-grade data processing applications.
• Hands-on experience with AWS services and modern data engineering frameworks.
• Experience with event-driven and streaming architectures.
• Ability to design and develop data ingestion and transformation pipelines.
• Experience implementing CI/CD pipelines and deployment automation.
• Strong understanding of data security, governance, and compliance.

Responsibilities

• Design, develop, and maintain data pipeline components across the full data lifecycle.
• Build scalable data processing solutions using AWS-native services.
• Develop unit, integration, and end-to-end testing strategies.
• Collaborate with cross-functional teams for data quality and platform reliability.
• Ensure compliance with data governance, security, and regulatory requirements.
• Identify and remediate security findings across applications and infrastructure.
• Contribute to CI/CD best practices and deployment automation.
• Monitor and optimize cloud-native data pipelines and platforms.
• Support secure, scalable, and reliable data engineering solutions.

Skills

Python

Data pipelines

AWS services

CI/CD pipelines

Testing methodologies

Data security

Regulatory compliance

Cloud-native troubleshooting

Event-driven architectures

Streaming architectures

Tools

AWS Lambda

AWS ECS

AWS S3

DynamoDB

AWS Flink

Job description

Compunnel, Inc. seeks a Data Engineer to design, build, and optimize a Python-based, AWS-native data ingestion platform. You will move financial data from source systems into a third-party app, while ensuring secure, scalable pipelines and strict governance.

You will implement testing strategies and partner with teams to maintain data quality and platform reliability in a regulated environment.