Remote AWS Data Engineer - Lakehouse & ETL

System One, Inc.; McLean (VA); Remote; USD 150,000 - 170,000; Full time

Benefits offered by this job

Health benefits

401(k) plan

Remote work

Job summary

System One, Inc. seeks an experienced AWS Data Engineer for a remote contract-to-hire role.

The candidate will build and operate batch and streaming data pipelines, design ETL/ELT processes with Python and PySpark, and implement CDC, data contracts, and governance. You will develop a scalable lakehouse on Amazon S3 with Iceberg, enable fast analytics with Athena/EMR/Glue/Redshift, and ensure reliability and cost efficiency across environments.

Qualifications

• Bachelor's degree in Engineering, IT, CS, Data Engineering or equivalent practical experience.
• 6+ years of hands-on data engineering experience.
• Extensive experience with AWS-native data lake/lakehouse architectures (S3, Glue, Athena, EMR, Lake Formation, Redshift).
• Proven ability to develop production ETL/ELT pipelines using Python and PySpark.
• Hands-on experience with Apache Iceberg (ACID, snapshots, schema evolution).
• Advanced SQL skills for analytical workloads.
• Experience with data governance, cataloging, lineage, access controls.
• IaC-driven provisioning and multi-environment platforms.
• CI/CD for data workflows with testing and rollback.

Responsibilities

• Build and operate data pipelines (batch and streaming) from APIs, databases, file drops, streams, and partners.
• Design and optimize ETL/ELT pipelines with Python and PySpark for analytics-ready datasets.
• Implement CDC, data contracts, schema validation, and reusable transforms.
• Improve reliability via testing, orchestration, monitoring, retries and runbooks.
• Create scalable lakehouse on S3 using Apache Iceberg and Parquet formats.
• Enable fast querying with AWS services (Athena, EMR, Glue, Redshift).
• Optimize partitioning, file sizing, caching, lifecycle policies for cost efficiency.
• Establish environments with consistent config across stages; promote safely.
• Enforce data governance, cataloging, lineage, ownership, and access controls.

Skills

Python

PySpark

AWS

ETL/ELT

SQL

CI/CD

IaC

Iceberg

Data lake

Data governance

Education

Bachelor's degree or 4 years experience

Tools

AWS S3

Athena

EMR

Glue

Redshift

Iceberg

Parquet

IAM

Job description

System One, Inc. seeks an experienced AWS Data Engineer for a remote contract-to-hire role.

The candidate will build and operate batch and streaming data pipelines, design ETL/ELT processes with Python and PySpark, and implement CDC, data contracts, and governance. You will develop a scalable lakehouse on Amazon S3 with Iceberg, enable fast analytics with Athena/EMR/Glue/Redshift, and ensure reliability and cost efficiency across environments.