Staff Data Infrastructure Engineer — Real-Time Pipelines

Peregrinetechnologies; Washington (District of Columbia); On-site; USD 200,000 - 275,000; Full time

Benefits offered by this job

Competitive salary

Benefits

Equity opportunities

Bonus opportunities

Job summary

Peregrine Technologies is seeking a Staff Data Infrastructure Engineer in Washington DC. In this crucial role, you will design and build systems to ingest, store, and serve massive volumes of real-time operational data, ensuring our clients can make critical decisions swiftly and reliably.

The ideal candidate will have extensive experience in data infrastructure and be skilled in technologies like Apache Spark and AWS GovCloud. The salary range is between $200,000 - $275,000 annually, plus benefits.

Qualifications

• 8+ years of experience architecting and operating large-scale data infrastructure systems.
• Deep expertise with open table formats, particularly Apache Iceberg.
• Extensive hands-on experience with Apache Spark for batch and streaming data.

Responsibilities

• Designing and operating a real-time data integration platform.
• Architecting a scalable storage layer for petabyte scale data.
• Building and optimizing distributed data processing pipelines.

Skills

Data infrastructure design

Real-time data integration

Apache Spark

AWS GovCloud

Education

Degree in Computer Science or related field

Tools

Apache Iceberg

Apache Kafka

Airflow

Kubernetes

Job description

Peregrine Technologies is seeking a Staff Data Infrastructure Engineer in Washington DC. In this crucial role, you will design and build systems to ingest, store, and serve massive volumes of real-time operational data, ensuring our clients can make critical decisions swiftly and reliably.

The ideal candidate will have extensive experience in data infrastructure and be skilled in technologies like Apache Spark and AWS GovCloud. The salary range is between $200,000 - $275,000 annually, plus benefits.