Senior Data Engineer II

Openkrill; United States; Remote; USD 189,000 - 255,000; Full time

Job summary

Apartment List is seeking a Senior Data Engineer II to own data pipeline architecture across ingestion, transformation, modeling and serving, balancing data freshness, cost, scalability and simplicity. You will be hands-on, shipping code and debugging production issues, while shaping how Analytics Engineering, Data Science and Engineering partners build on the platform.

This role emphasizes architectural autonomy, cross-team collaboration, reliability, and the thoughtful integration of AI

Qualifications

• 7+ years of data engineering with end-to-end pipeline ownership.
• Deep Airflow experience including tradeoffs across layers.
• Production containerized infra deployment and troubleshooting.
• Ability to communicate architectural tradeoffs to varied stakeholders.
• Experience building/advancing CI/CD for data pipelines.
• Led incident response and monitoring strategies.
• Influenced cross-team technical decisions and mentoring.

Responsibilities

• Own and evolve data pipeline architecture across core domains with independent decisions.
• Design platform-level improvements: cost, compute, access control, reliability.
• Lead initiatives that improve platform health (CI/CD, data access, developer exp).
• Drive large, complex projects spanning teams and outcomes.
• Lead monitoring strategy and close observability gaps; pre-empt failures.
• Influence decisions beyond Data & Analytics; partner with stakeholders.
• Mentor other data engineers and analytics engineers; review designs.
• Integrate AI into workflows and build automation for the team.

Skills

End-to-end pipeline architecture

Airflow orchestration

Containerized production infra

CI/CD for data pipelines

Incident response & monitoring

Influence across teams

Mentoring data engineers

Tools

Datadog

Kubernetes

Job description

About the Role

As Apartment List's data platform grows across more domains, more pipelines, and more stakeholders, the architectural decisions made today determine how much technical debt we're paying down in a year. We're looking for a Senior Data Engineer II (IC4) to own that architecture; end-to-end pipeline design, platform investment tradeoffs, and the technical judgment calls that keep the system reliable as it scales.

This is not a design-from-the-whiteboard role. You'll still be hands-on-keyboard: writing pipelines, debugging production issues, and shipping code alongside the team. What sets this role apart is scope; you'll make architectural decisions independently, influence how Analytics Engineering, Data Science, and Engineering partners build on the platform, and be the person other data engineers come to when a design decision needs a second opinion. You'll work closely with Analytics Engineering, Data Science, and Engineering partners to shape how the data platform evolves.

Here's what you'll do as part of the team

• - Own and evolve data pipeline architecture across core domains — ingestion, transformation, modeling, and serving — making project-level architectural decisions independently and evaluating tradeoffs between freshness, cost, scalability, and simplicity.
• - Lead the design and implementation of platform-level improvements: warehouse cost management, compute efficiency, and access control architecture, treating reliability, observability, and cost efficiency as core design constraints rather than afterthoughts.
• - Identify and lead technical initiatives that improve the platform's long-term health — proactively surfacing investments (orchestration, CI/CD, data access, developer experience) before they become blockers, and making the case for them.
• - Drive large, technically complex projects or multiple concurrent medium-sized initiatives that span teams, taking responsibility for outcomes rather than just execution.
• - Lead monitoring and testing strategy for your domain: proactively close observability gaps across the org, build alerting ahead of failures, and serve as the go-to engineer for the hardest production issues.
• - Influence technical decisions and architectural direction beyond the Data & Analytics team, partnering directly with EPD stakeholders on infrastructure decisions that affect their roadmaps.
• - Actively mentor other data engineers and analytics engineers, reviewing architectural and modeling decisions, and operate as a technical peer to senior engineers across teams.
• - Integrate AI meaningfully into data engineering workflows — building tooling and automation that creates leverage for the whole team, not just individual output, and coaching others on effective, validated use.

Here are the skills and experience you'll need to be successful

Must-haves:

• - 7+ years of data engineering experience, including a demonstrated track record of owning end-to-end pipeline architecture, not just implementing to spec.
• - Deep experience designing orchestration workflows in Apache Airflow, including making architectural tradeoffs across ingestion, transformation, modeling, and serving layers.
• - Experience working with containerized data infrastructure in production, including deploying services, diagnosing operational issues, and contributing to platform reliability and scalability.
• - Demonstrated ability to evaluate and communicate architectural tradeoffs (freshness vs. cost, scalability vs. simplicity) to both technical and non-technical stakeholders.
• - Experience building or significantly improving CI/CD practices for data pipelines, including automated testing, validation, and deployment.
• - A track record of leading incident response and monitoring strategy for a domain, including building alerting and observability ahead of failures rather than reacting to them.
• - Experience influencing technical decisions across multiple teams or functions, including partnering with engineering, product, or data science stakeholders outside your immediate team.
• - Experience mentoring other data engineers, including reviewing architectural and modeling decisions.

Nice-to-haves:

• - Experience with Kubernetes-based data infrastructure
• - Experience leading a legacy ETL-to-modern-orchestration migration end-to-end, not just contributing to one.
• - Familiarity with observability and monitoring tooling such as Datadog at a platform-wide scale.
• - Experience building internal tooling or automation (including AI-assisted) that other engineers rely on.

Here's the Pay Range:

• - Zone 1: $210,000 - $255,000 TTC (including $189,000 - $229,000 base salary) + equity
• - Zone 2: $194,000 - $236,000 TTC (including $175,000 - $212,000 base salary) + equity
• - Zone 3: $179,000 - $217,000 TTC (including $161,000 - $195,000 base salary) + equity

This reflects the compensation target for new hire salaries for the position across all US locations. Please note, the compensation details provided do not include benefits and perks that we offer.

We also rely on market indicators along with considering your work location, job related skills, experience and relevant education and training, to determine compensation that is fair and competitive for you. Apartment List will consider paying compensation near the higher of the range in exceptional circumstances, where candidates have the experience, credentials or expertise that would warrant such consideration. It is always our goal to hire exceptional talent and we would be happy to share more about compensation during the hiring process.