Full-Stack Data Acquisition Engineer (Foundations)

OpenAI; California (MO); On-site; USD 140,000 - 190,000; Full time

Job summary

OpenAI's Data Acquisition team builds and maintains data pipelines, web crawling, and GPTBot services to power model training. We seek a skilled Full-Stack Engineer to create interfaces and tools for data infrastructure and workflows.

You will collaborate across Data Processing, Architecture, and Scaling teams, design robust APIs, and implement user-friendly dashboards while ensuring security, privacy, and scalable performance in a Kubernetes-based environment.

Qualifications

• BS/MS/PhD in Computer Science or a related field.
• 4+ years of industry experience in full-stack development.
• Proficiency in frontend frameworks (React, Vue, or similar) and backend technologies such as Python, Node.js, or Go.
• Strong expertise in RESTful APIs, GraphQL, and database design (SQL and NoSQL).
• Experience building data-intensive applications that handle large-scale datasets.
• Familiarity with cloud platforms (AWS, GCP, or Azure) and container orchestration (Kubernetes, Docker).
• Prior experience with web crawling and large-scale data processing is a plus.
• Strong problem-solving skills and ability to balance multiple tasks in a fast-moving environment.
• Excellent communication and collaboration skills.

Responsibilities

• Develop and maintain full-stack applications that support data acquisition, including internal tools and dashboards.
• Collaborate closely with cross-functional teams, including Data Processing, Architecture, and Scaling, to ensure seamless data ingestion and workflow management.
• Design and implement APIs to facilitate data interactions between internal services and external data sources.
• Enhance user experience by developing intuitive web-based interfaces for managing and monitoring data pipelines.
• Optimize backend services for performance, scalability, and security in a distributed computing environment.
• Work with legal and compliance teams to ensure our data acquisition processes adhere to privacy regulations and best practices.
• Deploy and maintain infrastructure using Kubernetes and Infrastructure-as-Code (IaC) methodologies.
• Analyze system performance, conduct experiments, and improve data workflows to maximize efficiency.

Skills

React

Vue

Python

Node.js

Go

RESTful APIs

GraphQL

SQL

NoSQL

AWS

GCP

Azure

Kubernetes

Docker

Data processing

Education

BS/MS/PhD in Computer Science

Tools

Docker

Kubernetes

GraphQL tooling

Job description

OpenAI's Data Acquisition team builds and maintains data pipelines, web crawling, and GPTBot services to power model training. We seek a skilled Full-Stack Engineer to create interfaces and tools for data infrastructure and workflows.

You will collaborate across Data Processing, Architecture, and Scaling teams, design robust APIs, and implement user-friendly dashboards while ensuring security, privacy, and scalable performance in a Kubernetes-based environment.