Data Engineer

Stack Exchange Inc.; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote-first culture

Global Hiring HUBs in US/Canada/UK/Ger

Job summary

Stack Overflow is hiring a Data Engineer to design and deliver data capabilities supporting new features. You will work with software engineers and product partners to convert requirements into robust data models and scalable pipelines.

You will help shape data organization, processing changes, and resilient pipelines that power analytics and product features. Join a remote-first team with global Hiring HUBs and a strong culture of collaboration and impact.

Qualifications

• Experience designing data models and pipelines for production use.
• Proficiency in SQL, Python, and PySpark for data processing.
• Experience with cloud data platforms and Databricks.
• Ability to design robust data contracts and interfaces.

Responsibilities

• Embed with engineering teams to translate requirements into data models, pipeline designs, and interfaces.
• Design, build, and operate production data pipelines using SQL, Python, PySpark and Databricks.
• Create ingestion and transformation workflows delivering data to application services.
• Design tenant-aware data flows respecting boundaries, permissions, and regional rules.
• Ensure pipelines are resilient with incremental processing and safe retry mechanisms.

Skills

SQL

Python

PySpark

Databricks

APIs

Data modeling

Education

Bachelor's degree in CS or related field

Tools

Databricks

Job description

Every developer has a tab open on Stack Overflow. We are one of the most popular websites in the world - a community-based space focused on increasing productivity, decreasing cycle times, accelerating time to market, and protecting institutional knowledge. Innovation is at the heart of everything we do. We embrace collaboration, transparency, and believe in leading with empathy; creating an environment where every Stacker knows they belong. We embrace that the unique contributions and points of view of all Stackers contribute to our success. We are a Best Company to Work For, in addition to being recognized for Best Company Leadership, Best Company Happiness, Best Company Perks and Benefits, Best Company Work-Life Balance, Best Company Compensation, and Best Company Outlook. We are a remote-first company with Hiring HUBs based in the US, Canada, UK, and Germany.At Stack Overflow, our mission is to empower the world’s developers. Every day, millions of developers come to us to get answers to their programming questions, collaborate better with their teams, and find their next dream job. As the world continues to transform with technology as a leading force, we’re driven to make Stack Overflow a place where everyone who codes feels welcome to learn, share their knowledge, and build their careers.

We're looking for a Data Engineer to help design and deliver the data capabilities behind new application features, working closely with software engineers and product partners. We are trying to solve problems from scalable connections to bespoke external systems to crafting data contracts between services which reliably create product value.We believe in taking data and transforming it into consistent models, and making it available to application services securely and reliably.

You'll help shape how those systems work: how data is organized, how changes are processed, how pipelines recover when something fails, and how the architecture scales as we grow. You'll also support the shared data foundations used by analysts, data scientists, and engineering teams. We measure success by making sure it is accurate, appropriately accessible, ready when the product needs it, and most importantly: provides value to our users.

What you'll do

• Embed with engineering teams to turn application requirements into data models, pipeline designs, and clear interfaces between systems.
• Design, build, and operate production data operations using SQL, Python, PySpark and cloud data technologies such as Databricks, integrating APIs, databases, and structured, semi-structured, and unstructured content.
• Build ingestion and transformation workflows that deliver usable data to application services and downstream capabilities.
• Design customer-aware data flows that preserve tenant boundaries, source permissions, and data lifecycle requirements, including updates, deletions, and regional constraints.
• Make pipelines resilient through incremental processing, checkpointing, safe retr