Senior Data Processing Engineer - Ingestion at Scale

Protege; New City (NY); On-site; USD 120,000 - 150,000; Full time

Job summary

Protege is seeking a Senior Software Engineer to lead the data processing layer and manage ingestion systems that handle large-scale, multimodal data. This hands-on role requires building robust pipelines and ensuring data quality and security.

The ideal candidate will have 5+ years of experience, strong Python programming abilities, and proficiency with cloud technologies like AWS. The position offers the opportunity to work on complex data challenges across various industries.

Qualifications

• 5+ years building and operating production backend or data systems.
• Hands-on experience designing and running large-scale data pipelines.
• Strong programming skills in Python.

Responsibilities

• Design, build, and operate ingestion systems for multimodal data.
• Optimize systems for reliability, cost, and speed.
• Build validation and quality checks for data.

Skills

Python

Data processing

AWS

Distributed data processing

Attention to detail

Job description

Protege is seeking a Senior Software Engineer to lead the data processing layer and manage ingestion systems that handle large-scale, multimodal data. This hands-on role requires building robust pipelines and ensuring data quality and security.

The ideal candidate will have 5+ years of experience, strong Python programming abilities, and proficiency with cloud technologies like AWS. The position offers the opportunity to work on complex data challenges across various industries.