Principal Data Platform Engineer — Remote Lead

Twilio; Philippines; Remote; PHP 11,090,572 - 16,019,715; Full time

Job summary

Twilio is seeking a Principal Engineer to lead the design and development of the Data Platform on the Data Substrate team. You will architect scalable data solutions, drive technical innovation, and mentor a team of engineers across distributed data systems.

The role emphasizes leadership in cloud-native data systems, collaboration with cross-functional teams, and maintaining data quality and security. Remote-based with global presence, willingness to travel occasionally may be required.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 10+ years of software development experience, with at least 5 years in a technical leadership role.
• Proven track record of architecting and delivering large-scale data platforms, especially with cloud computing like AWS and deployment via Kubernetes/Terraform/Helm.
• Expertise in big data technologies such as Clickhouse, Kafka, Spark and understanding of partitioning, slicing and dicing big data.
• Proficiency in Python, Java, Bash, Go with strong problem-solving skills.
• Excellent communication and collaboration skills, ability to influence decisions across teams.
• Track record of elevating engineering standards and mentoring across teams.
• Experience in operational excellence, high availability, observability and incident response in distributed systems.
• Ability to thrive in fast-paced environment and deliver under tight timelines.
• Knowledge of integrating with various authorization/authentication systems and network security.
• Deep expertise in Clickhouse: architecture, tuning and operation at scale.

Responsibilities

• Lead design and development of data infrastructure, shaping vision for scalability, reliability, and performance.
• Act as subject matter expert in distributed data systems and cloud-native tech.
• Architect and implement scalable data systems, storage, and processing frameworks.
• Drive innovation and research in data technologies and best practices.
• Mentor and coach engineers, fostering technical excellence and collaboration.
• Collaborate with cross-functional teams to translate business needs into scalable solutions.
• Ensure data quality, integrity, and security across the data lifecycle.

Skills

Python

Java

Bash

Go

Clickhouse

Kafka

Spark

Distributed systems

Leadership

AWS

Kubernetes

Terraform

Helm

Education

Bachelor's or Master's in CS/Engineering or related

Tools

AWS

K8s

Terraform

Helm

Job description

Twilio is seeking a Principal Engineer to lead the design and development of the Data Platform on the Data Substrate team. You will architect scalable data solutions, drive technical innovation, and mentor a team of engineers across distributed data systems.

The role emphasizes leadership in cloud-native data systems, collaboration with cross-functional teams, and maintaining data quality and security. Remote-based with global presence, willingness to travel occasionally may be required.