Principal Data Engineer (L5)

Twilio; United States; Remote; USD 167,000 - 210,000; Full time

Job summary

Join a forward-thinking company as a Principal Data Engineer, where you'll lead the technical direction of core data processing infrastructure. In this remote role, you will build and scale distributed systems that support a cutting-edge customer data platform. Collaborate with cross-functional teams to design scalable data pipelines and optimize compute frameworks using technologies like Apache Spark and Scala. This is an exciting opportunity to influence the future of data engineering in a vibrant, inclusive environment that values diverse experiences and innovative thinking.

Benefits

Generous time off

Parental leave

Healthcare

Retirement savings program

Wellness leave

Qualifications

• 8+ years of software engineering experience, with a focus on data engineering.
• Experience with large-scale data processing and distributed systems.

Responsibilities

• Architect and implement large-scale data processing systems.
• Drive scalability and performance improvements across data pipelines.

Skills

Scala

Java

Apache Spark

Cloud-native tools

Problem-solving

Tools

Apache Kafka

Parquet

Delta Lake

AWS

Apache Flink

Trino

Snowflake

Databricks

Job description

At Twilio, we’re shaping the future of communications, all from the comfort of our homes. We deliver innovative solutions tohundreds of thousands of businesses and empower millions of developers worldwide to craft personalized customer experiences.

Our dedication to remote-first work , and strong culture of connection and global inclusion means that no matter your location, you’re part of a vibrant team with diverse experiences making a global impact each day. As we continue to revolutionize how the world interacts, we’re acquiring new skills and experiences that make work feel truly rewarding. Your career at Twilio is in your hands.

See yourself at Twilio

Join the Segment team as Twilio’s next Principal Data Engineer.

About the job

As a Principal Data Engineer, you will lead the technical direction of our core data processing infrastructure. You’ll be responsible for building and scaling large-scale distributed systems that support Segment’s customer data platform (CDP). This role demands deep expertise in data engineering, a strong product sense, and the ability to make high-leverage architectural decisions.

Our systems handle hundreds of thousands of events per second across real-time and batch processing environments. You'll collaborate closely with cross-functional teams to design and implement scalable data pipelines, high-throughput compute engines, and durable storage solutions that power advanced capabilities like audience segmentation, real-time personalization, and predictive insights

.

Responsibilities

In this role, you’ll:

• Architect and implement large-scale data processing systems that power core Segment capabilities.
• Design and optimize distributed compute frameworks leveraging Apache Spark, Scala, and cloud-native services.
• Drive scalability and performance improvements across our data pipelines, enabling real-time and batch data processing.
• Partner with product, infrastructure, and platform teams to build reusable systems that accelerate development across Segment.
• Mentor and guide a team of data engineers, setting technical standards and fostering a culture of operational excellence.
• Lead end-to-end delivery of major platform features and improvements with measurable business impact.
• Ensure systems are designed for observability, maintainability, security, and compliance.

Qualifications

Twilio values diverse experiences from all kinds of industries, and we encourage everyone who meets the required qualifications to apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!

Required:

• 8+ years of software engineering experience, with at least 5+ years focused on large-scale data engineering.
• Proficiency in Scala or Java, with hands-on experience building systems using Apache Spark or similar distributed compute engines.
• Deep understanding of distributed systems, stream processing, and data pipeline design patterns.
• Experience processing large volumes of data using cloud-native and open-source big data tools (e.g., Spark, Kafka, Parquet, Delta Lake).
• Track record of leading technical initiatives and collaborating across engineering and product teams.
• Strong problem-solving skills and a bias toward ownership and execution.
• Experience with AWS and infrastructure-as-code tools.
• Excellent written and verbal communication skills.
• Experience with other data technologies such as Apache Flink, Trino, Snowflake, or Databricks.
• Familiarity with data governance, quality frameworks, and GDPR/CCPA compliance.
• Exposure to real-time personalization or ML-driven analytics use cases.
• Experience working in globally distributed teams

Location

This role will be remote and based in the U.S.

Travel

We prioritize connection and opportunities to build relationships with our customers and each other. For this role, you may be required to travel occasionally to participate in project or team in-person meetings.

What We Offer

Working at Twilio offers many benefits, including competitive pay, generous time off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

Compensation

*Please note this role is open to candidates outside of California, Colorado, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont, Washington D.C., and Washington State. The information below is provided for candidates hired in those locations only.

The estimated pay ranges for this role are as follows:

• Based in Colorado, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, Vermont or Washington D.C. : $167,800.00 - $209,700.00.
• Based in New York, New Jersey, Washington State, or California (outside of the San Francisco Bay area): $177,700.00 - $222,100.00).
• Based in the San Francisco Bay area, California: $197,400.00 - $246,700.00.
• This role may be eligible to participate in Twilio’s equity plan and corporate bonus plan. All roles are generally eligible for the following benefits: health care insurance, 401(k) retirement account, paid sick time, paid personal time off, paid parental leave.

The successful candidate’s starting salary will be determined based on permissible, non-discriminatory factors such as skills, experience, and geographic location.

Applications for this role are intended to be accepted until June 1st, 2025, but may change based on business needs.

Twilio thinks big. Do you?

We like to solve problems, take initiative, pitch in when needed, and are always up for trying new things. That's why we seek out colleagues who embody our values — something we call Twilio Magic . Additionally, we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.

So, if you're ready to unleash your full potential, do your best work, and be the best version of yourself, apply now! If this role isn't what you're looking for, please consider other open positions .

Twilio is proud to be an equal opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Additionally, Twilio participates in the E-Verify program in certain locations, as required by law.

Twilio is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, please contact us at [e-mail] .

Apply for this job

*

indicates a required field

First Name *

Last Name *

Email *

Phone

Resume/CV *

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

LinkedIn Profile URL

How did you hear about Twilio? *

LinkedIn

Twitter

Indeed

Conference or Event

Other

Please click all that apply

Are you legally authorized to work in the United States? * Select...

Will you now or in the future require sponsorship for employment visa status (e.g., H-1B visa status)? * Select...

Please indicate whether you are either a citizen or resident of any of the following countries: Cuba, Iran, North Korea, Syria or Crimea Region of Ukraine. * Select...

By clicking the "Acknowledge" button, you acknowledge that Twilio processes data in accordance with the Twilio Applicant Privacy Policy. *

Twilio is proud to be an Equal Employment Opportunity employer

We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Additionally, Twilio participates in the E-Verify program in certain locations, as required by law.

Voluntary Self-Identification of Race & Ethnicity and Protected Veterans Status

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary . Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Twilio’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection. As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measure the effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categories is as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Voluntary Self-Identification of Disability

Form CC-305, OMB Control Number 1250-0005, Expires 04/30/2026

Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp .

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

• Alcohol or other substance use disorder (not currently using drugs illegally)
• Blind or low vision
• Cancer (past or present)
• Cardiovascular or heart disease
• Celiac disease
• Cerebral palsy
• Deaf or serious difficulty hearing
• Diabetes
• Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
• Epilepsy or other seizure disorder
• Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
• Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
• Missing limbs or partially missing limbs
• Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
• Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
• Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
• Partial or complete paralysis (any cause)
• Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.

Twilio is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at [e-mail]

Disability Status * Select...

Voluntary Self-Identification of Gender * Select...

Voluntary Self-Identification of Race/Ethnicity * Select...

Select...

Voluntary Self-Identification of Sexual Orientation * Select...