Data Acquisition Engineer - Scalable Distributed Systems

OpenAI; San Francisco (CA); On-site; USD 325,000 - 405,000; Full time

Benefits offered by this job

Equity options

Job summary

A leading AI research company in San Francisco seeks a Software Engineer for their Data Acquisition team. You'll lead projects in data collection, collaborate with various teams, and develop scalable distributed systems. Candidates should hold a BS/MS/PhD in computer science with 4+ years of software development experience and strong skills in Kubernetes. The role offers a salary range of $325K to $405K plus equity.

Qualifications

• 4+ years of industry experience in software development.
• Strong expertise in large stateful distributed systems and data processing.
• Willingness and enthusiasm for trying new approaches and technologies.

Responsibilities

• Own and lead engineering projects in the area of data acquisition.
• Collaborate with sub-teams to ensure data flow and system operability.
• Develop and deploy scalable distributed systems for data handling.

Skills

Strong communication skills

Experience with large web crawlers

Proficiency in Kubernetes

Ability to handle multiple tasks

Adaptability to changing priorities

Education

BS/MS/PhD in Computer Science or related field

Tools

Kubernetes

Key-value databases

Job description

A leading AI research company in San Francisco seeks a Software Engineer for their Data Acquisition team. You'll lead projects in data collection, collaborate with various teams, and develop scalable distributed systems. Candidates should hold a BS/MS/PhD in computer science with 4+ years of software development experience and strong skills in Kubernetes. The role offers a salary range of $325K to $405K plus equity.