Senior AWS Data Engineer - Full-Stack Cloud Data Platform

Virtue America; Pennsylvania; On-site; USD 140,000 - 190,000; Full time

Job summary

Virtue America in Pennsylvania seeks a Senior Full-Stack AWS Data Engineer to design and maintain scalable cloud-based data platforms and modern pipelines. Expertise in Python, PySpark, SQL, AWS services, and data lake architecture is required to build reliable, production-ready data solutions.

The candidate will drive ETL/ELT development, implement IaC with Terraform, and ensure observability, security, and performance across data workflows in a fast-paced environment.

Qualifications

• Strong experience in designing and maintaining scalable data platforms.
• Proficient in Python, PySpark, and SQL for ETL/ELT.
• Hands-on with AWS services (S3, Glue, IAM, Kinesis) and data lake/warehouse tech.

Responsibilities

• Design, develop, and optimize ETL/ELT pipelines using Python, PySpark, and SQL.
• Build and maintain cloud-based data solutions with AWS services (S3, Glue, IAM, Kinesis, ECS, EKS).
• Implement data warehouses/queries with Snowflake, Redshift, and Athena.
• Develop streaming/in real-time data integration using Kinesis and Confluent.
• Create and manage data lakes with Iceberg and related tech.
• Automate infrastructure with Terraform and IaC practices.
• Establish CI/CD pipelines using GitLab/GitHub; support DevOps tooling.
• Manage containerized workloads with Docker and Kubernetes; support scalable deployments.
• Monitor pipelines, troubleshoot production issues, and implement observability.
• Apply DataOps/DevOps practices to improve data quality, reliability, and security.
• Collaborate with architects, analysts, and engineers to deliver enterprise data solutions.

Skills

Python

PySpark

SQL

Data engineering

Cloud data architecture

CI/CD

Observability

DevOps practices

Communication

Tools

AWS

S3

Glue

IAM

Kinesis

ECS

EKS

Snowflake

Redshift

Athena

Terraform

Docker

Kubernetes

Confluent

Iceberg

dbt Core

GitLab

GitHub

Job description

Virtue America in Pennsylvania seeks a Senior Full-Stack AWS Data Engineer to design and maintain scalable cloud-based data platforms and modern pipelines. Expertise in Python, PySpark, SQL, AWS services, and data lake architecture is required to build reliable, production-ready data solutions.

The candidate will drive ETL/ELT development, implement IaC with Terraform, and ensure observability, security, and performance across data workflows in a fast-paced environment.