Machine Learning Engineer 2

Twilio Inc.; United States; Remote; USD 129,000 - 170,000; Full time

Benefits offered by this job

Health insurance

401(k) retirement

Paid time off

Parental leave

Sick leave

Job summary

Twilio is hiring a Machine Learning Engineer for the Conversation Memory team. You will build pipelines to turn raw conversation data into structured, searchable memory and maintain evaluation systems that ensure accuracy as the product evolves.

You will work on extracting relevant information, connecting memory to customer context, and delivering fast, accurate responses for agents across millions of conversations.

Qualifications

• Experience building backend services and quickly picking up new languages, frameworks, and tools.
• Curious approach to service management and operating systems with rigor and accountability.
• Experience building or working with evaluation/quality-measurement systems, such as regression detection or quality metrics, or the desire to learn.
• Strong grounding in observability: structured logging, metrics, and debugging distributed systems.
• Fluency with AI-assisted dev tools and critical thinking in applying them.

Responsibilities

• Build the data extraction pipeline to turn raw data into structured memory for fast access.
• Own the retrieval path that answers what we know about a person in milliseconds.
• Contribute to evaluation systems that quantify memory quality and guide improvements.
• Diagnose production issues across ingestion, extraction, and indexing paths using logs and traces.
• Partner with Product and ML teams to translate customer problems into system changes and evaluation criteria.

Skills

Backend services

Production observability

LLM prompts

Go/Python

Kafka

LLM-backed products

Evaluation systems

Job description

At Twilio, we're shaping the future of communications, all from the comfort of our homes. We deliver innovative solutions to hundreds of thousands of businesses and empower millions of developers worldwide to craft personalized customer experiences.

Our dedication to remote-first work , and strong culture of connection and global inclusion means that no matter your location, you're part of a vibrant team with diverse experiences making a global impact each day. As we continue to revolutionize how the world interacts, we're acquiring new skills and experiences that make work feel truly rewarding. Your career at Twilio is in your hands.
.

Hiring and how we work

We use Artificial Intelligence (AI) to help make our hiring process efficient. That said, every hiring decision is made by real Twilions!

Also, while we are a remote-first company, you may be asked to report in person on an ad-hoc basis for team gatherings, functional off-sites or customer meetings.
.

See yourself at Twilio

Join the team as Twilio's next Machine Learning Engineer, Customer Memory.

About the job

This position is needed to build and scale the pipelines that turn raw conversation data into structured, searchable customer memory, and the evaluation systems that keep that memory accurate as the product evolves.

You'll join the Conversation Memory team, which builds the memory layer behind Twilio's Conversational AI platform: the systems that extract what matters from millions of conversations, resolve it to the right customer, and retrieve it in milliseconds when an agent needs it. Memory that is wrong, stale, or crossed between customers is worse than no memory at all, so quality measurement is a first-class part of the work.

Responsibilities

In this role, you'll:

• Build the extraction pipeline that turns raw data into structured memory, tuning the LLM prompts and schemas that decide what an AI agent remembers about a customer and what it forgets.
• Own the retrieval path that answers "what do we know about this person?" in milliseconds, working with embeddings, vector search, and ranking
• Contribute to the eval systems that tell us whether memory is actually getting better, turning a fuzzy question of quality into benchmarks and regression gates that run before every change ships.
• Diagnose production issues across the ingestion, extraction, and indexing path using logs, metrics, and traces.
• Partner with Product and ML teams to translate customer problems into system changes and evaluation criteria.

Qualifications

Twilio values diverse experiences from all kinds of industries, and we encourage everyone who meets the required qualifications to apply. If your career is just starting or hasn't followed a traditional path, don't let that stop you from considering Twilio. We are always looking for people who will bring something new to the table!

Required:

• Experience building backend services, and a demonstrated ability to pick up new languages, frameworks, and tools as the problem demands.
• A curious approach to service management: ability to investigate how systems actually behave in production, and desire to continuously learn how to operate them with rigor and accountability.
• Experience building or working with evaluation/quality-measurement systems, such as regression detection or quality metrics, or the desire to learn.
• Solid grounding in observability practices: structured logging, metrics, and using them to debug distributed systems in production.
• Fluency with AI-assisted dev tools (e.g. agents for code generation, review, debugging), applied with deliberate direction and critical thinking.
• Experience with Go and/or Python.
• Experience with event-streaming systems (e.g. Kafka).
• Experience building LLM-backed products.
• Practical experience applying ML, e.g. building, evaluating, or productionizing models.

Location

• This role will be remote, but is not eligible to be hired in San Francisco, CA, Oakland, CA, San Jose, CA, or the surrounding areas.

Travel

We prioritize connection and opportunities to build relationships with our customers and each other. For this role, you may be required to travel occasionally to participate in project or team in-person meetings.

What We Offer

Working at Twilio offers many benefits, including competitive pay, generous time off, ample parental and wellness leave, healthcare, a retirement savings program, and much more. Offerings vary by location.

Compensation

*Please note the salary range information provided applies only to candidates residing in California, Colorado, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, New Jersey, New York, Vermont, Washington D.C., and Washington State due to local requirements. Compensation for candidates in other locations will be discussed during the hiring process. Please note that hiring for this role is not restricted to the locations listed above.

The estimated pay ranges for this role are as follows:

• Based in Colorado, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, Vermont or Washington D.C. : $128,560 - $160,700
• Based in New York, New Jersey, Washington State, or California (outside of the San Francisco Bay area): $136,000 - $170,000.
• This role may be eligible to participate in Twilio's equity plan and corporate bonus plan. All roles are generally eligible for the following benefits: health care insurance, 401(k) retirement account, paid sick time, paid personal time off, paid parental leave.

The successful candidate’s starting salary will be determined based on permissible, non-discriminatory factors such as skills, experience, and geographic location.

Applications for this role are intended to be accepted until November 13, but may change based on business needs.

Twilio thinks big. Do you?

We like to solve problems, take initiative, pitch in when needed, and are always up for trying new things. That's why we seek out colleagues who embody our values - something we call Twilio Magic . Additionally, we empower employees to build positive change in their communities by supporting their volunteering and donation efforts.

Updated - Twilio is proud to be an Equal Employment Opportunity employer

We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Additionally, Twilio participates in the E-Verify program in certain locations, as required by law.

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.