Senior Data Infrastructure Engineer - Real-Time Platform

Peregrine; New York (NY); On-site; USD 200,000 - 275,000; Full time

Job summary

Peregrine is seeking a Staff Data Infrastructure Engineer in New York, NY, to significantly influence our data layer. The ideal candidate will have over 8 years of experience architecting and operating large-scale data infrastructure systems. Responsibilities include designing real-time data integration platforms and optimizing data processing pipelines, with a strong emphasis on Apache technologies. We offer a competitive salary range of $200,000 to $275,000 annually, plus benefits and equity options.

Qualifications

• 8+ years of experience in production environments with data infrastructure.
• Deep expertise with open-table formats, especially Apache Iceberg.
• Strong fundamentals in software engineering using Python and/or Scala.

Responsibilities

• Design and operate a real-time data integration platform.
• Build and optimize distributed data processing pipelines.
• Collaborate with engineering teams to define data contracts.

Skills

Architecting large-scale data infrastructure systems

Apache Spark

Real-time data integration

AWS or comparable cloud platforms

Python

Kubernetes

Education

Degree in Computer Science, Engineering, or related field

Tools

Apache Iceberg

Apache Kafka

Airflow

Job description

Peregrine is seeking a Staff Data Infrastructure Engineer in New York, NY, to significantly influence our data layer. The ideal candidate will have over 8 years of experience architecting and operating large-scale data infrastructure systems. Responsibilities include designing real-time data integration platforms and optimizing data processing pipelines, with a strong emphasis on Apache technologies. We offer a competitive salary range of $200,000 to $275,000 annually, plus benefits and equity options.