Staff Data Infrastructure Engineer — Real-Time, Scalable Data

Peregrine Technologies, Inc.; Washington, Northern (District of Columbia, KY); Hybrid; USD 200,000 - 275,000; Full time

Job summary

Peregrine Technologies, Inc. in Washington DC is seeking a Staff Data Infrastructure Engineer to own the data layer, architect real-time ingestion, storage, and serving systems, and enable customers to make fast, informed decisions.

This senior IC role requires deep expertise with Apache Iceberg, Apache Spark, Kafka, Airflow, Kubernetes, and AWS GovCloud. You will collaborate with platform and product teams and drive data contracts, schemas, and best practices while delivering scalable,

Qualifications

• 8+ years of architecting and operating large-scale data infrastructure in production.
• Deep expertise with Apache Iceberg including schema evolution and partitioning.
• Extensive experience with Spark for batch and streaming data processing.

Responsibilities

• Designing and operating a high-throughput real-time data ingestion and serving platform.
• Architecting a scalable data lake layer and petabyte-scale storage.
• Building distributed data pipelines with Spark and streaming tech.
• Driving performance, reliability, and cost efficiency across data infrastructure.

Skills

8+ years exp

Data infrastructure

Open-ended problems

Operational excellence

Education

CS/Engineering degree

Tools

Apache Iceberg

Apache Spark

Apache Kafka

Airflow

Kubernetes

AWS GovCloud

Job description

Peregrine Technologies, Inc. in Washington DC is seeking a Staff Data Infrastructure Engineer to own the data layer, architect real-time ingestion, storage, and serving systems, and enable customers to make fast, informed decisions.

This senior IC role requires deep expertise with Apache Iceberg, Apache Spark, Kafka, Airflow, Kubernetes, and AWS GovCloud. You will collaborate with platform and product teams and drive data contracts, schemas, and best practices while delivering scalable,