Data Engineer (AWS, Spark)

Uncover; Washington, Northern (District of Columbia, KY); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Hybrid work model

Sponsored training

Job summary

Peregrine Advisors in the Washington, DC area is seeking a data engineer to build scalable ETL pipelines on AWS. You will ingest, process, store, and govern data while ensuring trust and auditable lineage.

You thrive in a regulated environment, own outcomes, and collaborate with engineers, data scientists, and architects. This hybrid role requires US citizenship and the ability to obtain a Public Trust; we offer onboarding, training, and career growth.

Qualifications

• Sole United States citizenship is required.
• Ability to obtain a Public Trust determination.
• Hybrid role based in the Washington, DC metropolitan area; commute into DC regularly.

Responsibilities

• Build pipelines that ingest, process, and store federal agency data on AWS.
• Design a scalable data lake and fed platform using Spark ETL and PySpark.
• Implement data quality, lineage, monitoring, and infrastructure-as-code.

Skills

AWS data engineering

Python

PySpark

Spark ETL

S3 data lake

Data quality

Data lineage

Infrastructure as code

Event orchestration

Tools

AWS Glue

Amazon EMR

Lambda

Step Functions

Trino

Iceberg

PostgreSQL

Aurora

DynamoDB

Job description

Peregrine Advisors is a firm founded on a simple conviction: the best solutions come from the people closest to the problem, given real ownership and the tools to deliver. We are a data and technology innovation hub and a Benefit Corporation working at the center of the federal government's mission to deliver for client stakeholders and the US public, looking for highly motivated contributors who thrive when trusted to own a hard problem and equipped to deliver the solution.

Your first assignmentYour first assignment is to build the pipelines that move a federal agency's data from source to platform on Amazon Web Services (AWS): ingest, process, store, and keep it clean and trustworthy at scale. The work is real, hard, and it matters. It is also where you start, not the shape of your career here: we hire people, not seats, and we move our best to where the hardest problems are.

What you'll buildIngest-process-store pipelines on AWS: Spark-based extract, transform, and load (ETL) with Glue, Amazon EMR, Lambda, and Step Functions, in Python and PySpark. A data lake that feeds the platform: S3 design (Parquet, partitioning, lifecycle) into Apache Iceberg tables, PostgreSQL on Amazon Aurora, and DynamoDB, with Trino for federated SQL across them, plus event orchestration, secrets and monitoring, and data quality, validation, and lineage built in. In time, the firm itself: new capabilities, tools, and lines of business you help spin up.

Who you areYou are a data engineer who is serious about the craft and eager to go deeper. You care as much about whether the data is trustworthy as whether it arrives, and you do your best work alongside people who push you. You experiment, fail, learn, and repeat quickly. You would rather own an outcome than be handed a task.

What you bring

• Hands-on data engineering on AWS: Spark ETL (Glue, EMR), Python and PySpark, and S3 data-lake design feeding the platform stores. - and if a second lake bullet sits under "What you bring", it becomes: The reliability craft around it: event orchestration, data quality and lineage, monitoring, and infrastructure-as-code.
• The reliability craft around it: event orchestration, data quality and lineage, monitoring, and infrastructure-as-code.
• The reliability craft around it: event orchestration, data quality and lineage, monitoring, and infrastructure-as-code.
• The judgment to build in a regulated environment where accuracy and auditability are not optional.

What you'll needSole United States citizenship and the ability to obtain a Public Trust determination are required for this initial engagement. This is a hybrid role based in the Washington, DC metropolitan area, and it requires commuting into DC regularly. Everything else, the years, the certifications, the specific tools, we ask in the application and get into during the interview

What we offerA high-performing team of developers, engineers, data scientists, architects, and strategists solving complex, real-world problems, with work that runs from strategy formulation to hands-on implementation. We develop people across roles and clients, with extensive onboarding and sponsored training and professional development. And Peregrine has been a Benefit Corporation from day one: public value is built into the work itself, not bolted on afterward. Work worth your best years.

What we commit toAs a Benefit Corporation, our commitment runs three ways: real, measurable value for our clients; government that works better for the public; and a team that makes everyone in it better.

We hire people who want to help build the firm, not just work at it. If that is you, apply.

Peregrine Advisors is an equal opportunity employer.