Senior Infrastructure Engineer - Data Layer & Scaling

Compass; New York (NY); On-site; USD 176,000 - 196,100; Full time

Benefits offered by this job

Incentive programs

Paid vacation

Sick time

Parental leave

Recharge leave

Medical benefits

Dental benefits

Vision benefits

401(k) plan

FSAs

Commuter program

Life insurance

Disability insurance

Maven

Carrot fertility benefits

UrbanSitter

Employee Assistance Program

Pet insurance

Job summary

Compass is seeking a Senior Engineer for the Streaming & Durability team. You will design and operate the data infrastructure powering Compass products, including multi-tenant isolation, Go SDKs, and scalable database upgrades.

Responsibilities include building Kafka streaming infra, deep observability, and collaborating with product teams to ensure scalable, reliable systems across thousands of tenants.

Qualifications

• 5+ years of experience building and operating distributed systems in production.
• Experience building shared tooling (SDKs, client libraries, platform APIs).
• Ability to articulate trade-offs between strict boundaries and flexible boundaries in infrastructure.
• Proficiency in Go and comfortable with Terraform, Kubernetes, and IAM-heavy AWS environments.
• Leading cross-team operational programs including change management and migrations.

Responsibilities

• Design and operate the database and caching fleet (RDS/Aurora PostgreSQL, ElastiCache Redis/ValKey, DynamoDB).
• Ship SDKs in Go, Java, and Python that enforce tenant-safe access patterns.
• Own production database upgrades at fleet scale with zero downtime.
• Build and scale Kafka/MSK streaming infrastructure and deployment strategies.
• Develop observability into the data layer with dashboards and telemetry.
• Collaborate with product and platform teams to migrate workloads onto golden-path infrastructure.

Skills

Go programming

Distributed systems design

Cross-team collaboration

Problem solving under latency

Tools

Terraform

Kubernetes

AWS

PostgreSQL

Job description

Compass is seeking a Senior Engineer for the Streaming & Durability team. You will design and operate the data infrastructure powering Compass products, including multi-tenant isolation, Go SDKs, and scalable database upgrades.

Responsibilities include building Kafka streaming infra, deep observability, and collaborating with product teams to ensure scalable, reliable systems across thousands of tenants.