Senior Data Infrastructure Engineer - Multi-Tenant Scale

Compass Real Estate - Peninsula; Boston (MA); On-site; USD 176,000 - 196,100; Full time

Benefits offered by this job

Competitive compensation with equity +

Job summary

Compass in Boston is seeking a Senior Engineer for the Streaming & Durability team to own the data layer that powers our core products. You will design and operate the database and caching fleet across PostgreSQL, Redis/ValKey, and DynamoDB, ensuring low latency and strong tenant isolation.

You will build SDKs in Go, Java, and Python, lead fleet upgrades with zero downtime, scale Kafka/MSK, and create observability dashboards to monitor performance.

Qualifications

• 5+ years building and operating distributed systems at production scale.
• Experience with PostgreSQL or similar in AWS.
• Go, Terraform, Kubernetes, and IAM-heavy AWS experience.
• Built shared tooling (SDKs, client libraries, platform APIs) for engineers.

Responsibilities

• Design and operate database and caching fleet (RDS/Aurora PostgreSQL, ElastiCache Redis/ValKey, DynamoDB).
• Develop multi-tenant data isolation with Go, Java, and Python SDKs for safe access.
• Own production database upgrades at fleet scale with zero downtime.
• Build and scale Kafka/MSK streaming infrastructure and deployment strategies.
• Develop observability into the data layer with dashboards and telemetry.
• Collaborate with product/platform teams to scale workloads and resolve incidents.

Skills

Distributed systems

Go programming

Terraform

Kubernetes

AWS IAM

Cross-team collaboration

Tools

PostgreSQL

Redis

DynamoDB

Kafka/MSK

ElastiCache

Job description

Compass in Boston is seeking a Senior Engineer for the Streaming & Durability team to own the data layer that powers our core products. You will design and operate the database and caching fleet across PostgreSQL, Redis/ValKey, and DynamoDB, ensuring low latency and strong tenant isolation.

You will build SDKs in Go, Java, and Python, lead fleet upgrades with zero downtime, scale Kafka/MSK, and create observability dashboards to monitor performance.