Architect

Bazeta

United States

Remote

USD 180,000 - 260,000

Full time

9 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Twilio is seeking an Architect for its Data Substrate team to define and own the multi-year architecture for our data platform, spanning lake/lakehouse, storage engines, and governance. You will lead design decisions, set reference architectures, and ensure scalability, reliability, and privacy across petabyte-scale data assets.

Ideal candidates bring 15+ years in software with 8+ years in architecture, deep AWS/Kubernetes expertise, and hands-on work with ClickHouse, Elasticsearch/OpenSearch,

Qualifications

  • Bachelor’s or Master’s degree in CS/Engineering or related field, or equivalent practical experience.
  • 15+ years in software development with 8+ years in architecture or senior technical leadership.
  • Proven track record delivering large-scale data platforms on AWS and Kubernetes.

Responsibilities

  • Own multi-year architecture and strategy for Twilio's data platform, including lake/lakehouse and governance.
  • Define ADRs/RFCs for storage, formats, catalogs, compute engines with cost/performance at petabyte scale.
  • Set reference architectures for deployed storage and query engines; ensure reliability and tenancy.
  • Define reliability model: availability targets, disaster recovery, observability, incident response patterns.
  • Incorporate privacy-by-design, deletion/retention, residency across platforms and datasets.
  • Drive data governance: catalog, metadata, lineage, access control integrated with auth systems.
  • Review designs across the org and mentor senior engineers; guide platform roadmaps.
  • Collaborate with product/security/infrastructure to translate business needs into roadmaps.

Skills

Data architecture
Cloud AWS
Kubernetes
Terraform
Helm
ClickHouse
Elasticsearch/OpenSearch
Lakehouse
Data governance
Privacy by design

Education

Bachelor’s or Master’s in CS/Engineering

Tools

AWS
Kubernetes
Terraform
Helm
ClickHouse
Elasticsearch/OpenSearch
Spark/Trino/Flink
Kafka

Job description

# ArchitectUnited States3 hours agoID 5734238Price on request## DetailsEmployment type: Full-timeRemote: YesCompany: Twilio## DescriptionWho we are At Twilio, we’re shaping the future of communications, all from the comfort of our homes. We deliver innovative solutions to hundreds of thousands of businesses and empower millions of developers worldwide to craft personalized customer experiences. Our dedication to remote-first work , and strong culture of connection and global inclusion means that no matter your location, you’re part of a vibrant team with diverse experiences making a global impact each day. As we continue to revolutionize how the world interacts, we’re acquiring new skills and experiences that make work feel truly rewarding. Your career at Twilio is in your hands. . Hiring and how we work We use Artificial Intelligence (AI) to help make our hiring process efficient. That said, every hiring decision is made by real Twilions! Also, while we are a remote-first company, you may be asked to report in person on an ad-hoc basis for team gatherings, functional off-sites or customer meetings. . See yourself at Twilio Join the team as Twilio’s next Architect on our Data Substrate team About the job Twilio runs on data, and the platform underneath it is entering a major shift. Open table formats, the convergence of lakes and warehouses, tightening privacy regulation, and AI workloads are all changing what a data platform has to do. We’re hiring an Architect to set our direction through that shift and to make sure the systems we build over the next 3-5 years are the right ones. You’ll own the technical strategy for our data platform, spanning storage, lake and lakehouse architecture, catalog and governance, and privacy-by-design. You’ll work across org boundaries, setting standards that dozens of teams build on and raising the technical bar for the engineers around you. Responsibilities In this role, you’ll • Own the architecture and multi-year technical strategy for the data platform, including the lake/lakehouse, ClickHouse, Elasticsearch, and governance, and keep them coherent as one platform rather than separate systems. Define where each engine fits (for example, ClickHouse versus open table formats on object storage) and the migration path between them. • Make and document the major design decisions (ADRs, RFCs) on storage and open table formats, catalog strategy, compute engines, tenancy, data placement, and build-versus-adopt tradeoffs, with cost and performance at petabyte scale as explicit design constraints. • Set the reference architectures for how our core storage and query engines (ClickHouse, Elasticsearch, and lake engines) are deployed, tuned, scaled and operated as shared platforms, including capacity, cost, tenant isolation, and upgrade strategy. • Define the reliability model for the platform: availability targets, failure domains, disaster recovery, observability, and incident response patterns that teams can adopt. • Build privacy and compliance into the architecture, not onto it. Design deletion and right-to-erasure, retention, data residency, and PII classification so they work across the platform’s storage layers, backups, and derived datasets, including data that arrives from upstream streaming systems. • Drive data governance: classification, catalog and metadata, lineage, access control integrated with our authentication and authorization systems, data contracts, quality and integrity standards, and a catalog teams actually use. • Review designs and technical direction across the org, and act as the escalation point on hard distributed-systems and performance problems. • Mentor principal and senior engineers, and grow architectural judgment across the org, not only within one squad. • Partner with product, security, infrastructure and consuming teams to turn business needs into platform roadmaps, and say no or re-sequence when the tradeoffs require it. • Track emerging data technologies (such as streaming-first architectures, federated query, and AI-ready data layers) and bring forward the ones worth adopting, with evidence from prototypes or benchmarks. Qualifications Twilio values diverse experiences from all kinds of industries, and we encourage everyone who meets the required qualifications to apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table! Required • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience. • 15+ years of experience in software development or a related field, with at least 8 years in an architecture or senior technical leadership role. • Proven track record of architecting and delivering large-scale data platforms and setting their technical strategy, on cloud infrastructure such as AWS, deployed with Kubernetes, Terraform and Helm. • Deep expertise in storage and compute for analytical data: columnar and open table formats, lake and lakehouse architecture, partitioning, indexing, query planning, and how the choices affect cost and performance at petabyte scale. • Breadth across data storage and retrieval technologies, with hands-on depth in at least two of: analytical/OLAP engines (e.g., ClickHouse), search engines (e.g., ElasticSearch/OpenSearch), and lake or distributed processing engines (e.g., Spark, Trino, Flink). You can reason about when to use each, how they interoperate, and how to migrate between them. • Working knowledge of streaming systems (e.g., Kafka) and how they interact with downstream storage. • Practical experience designing data governance at scale: data classification, catalog and metadata management, lineage, and access control integrated with authentication and authorization systems. • Practical experience implementing privacy and compliance requirements (deletion, retention, residency) across a large, heterogeneous data estate....
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Architect
Architect

Gleexa • United States

Remote
USD 207,000 - 274,000
Health insurance
401(k) retirement plan
Paid time off
Architect
Architect

SendGrid • United States

Remote
USD 207,000 - 274,000
Health care insurance
401(k) retirement account
Paid time off
Architect
Architect

Twilio Inc. • United States

Remote
USD 219,000 - 274,000
Remote-friendly
Competitive compensation
Remote Senior Architect - Data Platform & Governance
Remote Senior Architect - Data Platform & Governance

Bazeta • United States

Remote
USD 180,000 - 260,000
Senior Data Platform Architect - Remote
Senior Data Platform Architect - Remote

Twilio Inc. • United States

Remote
USD 219,000 - 274,000
Remote-friendly
Competitive compensation
Senior Data Platform Architect — Remote
Senior Data Platform Architect — Remote

SendGrid • United States

Remote
USD 207,000 - 274,000
Health care insurance
401(k) retirement account
Paid time off
Principal Software Engineer
Principal Software Engineer

Twilio Inc. • United States

Remote
USD 188,000 - 235,000
Health insurance
401(k) retirement account
Paid sick time
+2
Senior Remote Data Platform Architect
Senior Remote Data Platform Architect

Gleexa • United States

Remote
USD 207,000 - 274,000
Health insurance
401(k) retirement plan
Paid time off
Data Platform Architect: Strategy, Governance & Lakehouse
Data Platform Architect: Strategy, Governance & Lakehouse

Twilio Inc. • United States

Remote
USD 180,000 - 240,000
Sr Architect - Emerging Technologies
Sr Architect - Emerging Technologies

Gleexa • United States

Remote
USD 324,000 - 406,000