Senior Data Processing Engineer - Ingestion at Scale

Protege; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

Protege is seeking a Senior Software Engineer to lead the data processing layer for handling large-scale source data and transforming it into structured datasets. The role involves designing and operating ingestion systems that process multimodal data, ensuring reliability and performance while handling sensitive information.

The ideal candidate has significant experience in production data systems, strong Python skills, and a background in AWS. If you're excited to work with complex data at scale, we want to hear from you!

Qualifications

• 5+ years building and operating production backend or data systems.
• Hands-on experience in designing and running large-scale data pipelines.
• Strong programming skills in Python.

Responsibilities

• Design and operate ingestion systems for large volumes of multimodal data.
• Build for high volume and high throughput systems.
• Implement validation and quality checks for data.

Skills

Backend or data systems experience

Large-scale data pipelines

Programming skills in Python

Distributed data processing

AWS proficiency

Attention to detail

Curiosity and proactivity

Job description

Protege is seeking a Senior Software Engineer to lead the data processing layer for handling large-scale source data and transforming it into structured datasets. The role involves designing and operating ingestion systems that process multimodal data, ensuring reliability and performance while handling sensitive information.

The ideal candidate has significant experience in production data systems, strong Python skills, and a background in AWS. If you're excited to work with complex data at scale, we want to hear from you!