Staff Software Engineer-AI

DigitalOcean LLC

Hyderabad City Taluka

Hybrid

PKR 11,834,000 - 20,710,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

DigitalOcean is seeking a Staff Software Engineer to lead the architecture of large-scale AI inference and agent-based simulation systems. You will drive multi-agent, multi-turn environments, tool integration, and secure execution pipelines while mentoring engineers and shaping the technical strategy for the Feedback Systems team.

You will design scalable APIs, bridge telemetry with simulation engines, and advance LLM orchestration and behavioral simulation across a globally distributed

Qualifications

  • 5+ years of software engineering experience with deep proficiency in modern AI/ML frameworks, LLM orchestration, and production-grade Python and Go.
  • Behavioral modeling and persona synthesis from historical data.
  • Evaluation frameworks for non-deterministic AI systems with metrics, guardrails and regression testing.
  • Data fluency in asynchronous architectures, streaming tokens, rate limits, and heavy data pipelines.

Responsibilities

  • Lead end-to-end design of multi-agent, multi-turn simulation environments.
  • Design ML pipelines to extract and synthesize realistic personas for simulation.
  • Build evaluation frameworks and scoring for alternative configurations and non-deterministic outputs.
  • Provide architectural leadership across the organization and ensure scalable, secure interfaces.

Skills

LLM orchestration
Distributed systems
Python
Go
Architectural leadership
Mentorship

Tools

LangChain
AutoGen
CrewAI
gRPC APIs

Job description

Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you’ll find your place here. We value winning together—while learning, having fun, and making a profound difference for the dreamers and builders in the world.

About the Role

DigitalOcean's Agentic AI organization provides a powerful inference cloud, Managed Agents, and robust Feedback systems that enable customers to run AI inference confidently at scale. We are looking for a Staff Software Engineer to serve as a technical leader within our Feedback Systems team, driving the architecture for the massive-scale infrastructure that simulates, tests, and evaluates AI agents. As an IC5 Staff Engineer, you will define the architectural vision for systems that simulate multi-agent, multi-turn deployments complete with tool integration. This enables customers to run and analyze 'what-if' scenarios to evaluate alternative configurations for their AI agents. This is a high-impact leadership role where you will solve advanced problems at the intersection of LLM orchestration, synthetic data generation, and behavioral simulation—including defining realistic user personas from historical telemetry and structuring automated evaluation objectives and constraints. You will set the technical standard for the team and guide the engineering strategy across the Agentic AI organization.

What You’ll Do:
  • Simulation Architecture & Orchestration: Leading the end-to-end design and implementation of multi-agent, multi-turn simulation environments. You will architect systems where synthetic users and AI agents interact dynamically, leverage tools, and execute complex workflows to test boundary conditions.
  • Persona & Scenario Generation: Designing ML pipelines that analyze historical user conversations to automatically extract, define, and synthesize realistic user personas and multi-turn simulation goals, mirroring real-world customer behavior.
  • 'What-If' Evaluation Frameworks: Building the core methodology and scoring infrastructure that allows customers to run alternative configuration scenarios, benchmark agent behavior, and safely evaluate non-deterministic agent outputs against defined success criteria.
  • Architectural Leadership: Leading the end-to-end design and architecture of high-throughput, stateful workflow orchestration systems capable of managing complex, multi-turn AI agent simulations at massive scale.
  • System Design & Integration: Defining robust, scalable API contracts and system boundaries bridging upstream telemetry data, asynchronous simulation engines, and secure remote execution environments.
  • Technical Strategy: Driving the technical roadmap for the Feedback Systems team, balancing long-term scalability and resilience with iterative product delivery.
  • Complex Problem Solving: Designing elegant solutions for hard distributed systems challenges, including rate limiting, backpressure, state management, and reliable execution of non-deterministic workflows.
  • Mentorship & Elevation: Mentoring senior engineers, leading cross-organizational architectural reviews, and establishing engineering best practices for code quality, testing, and system observability.
  • AI/ML Infrastructure Integration: Applying your practical experience with AI/ML platforms to design and implement the backend infrastructure that powers our evaluation engines, actively managing the complexities of integrating with LLMs, prompt routing, and non-deterministic agentic workflows.
  • Cross-Functional Influence: Acting as the strategic technical bridge across the Agentic AI organization, partnering closely with Product Managers and peer engineering leaders to translate complex product requirements, evaluation methodologies, and experimental needs into a scalable, future-proof architectural roadmap.
What You’ll Add to DigitalOcean:
  • Agentic Expertise: 5+ years of software engineering experience with deep proficiency in modern AI/ML frameworks, LLM orchestration (e.g., LangChain, AutoGen, CrewAI, or custom multi-agent frameworks), and production-grade Python and Go.
  • Behavioral Modeling & Persona Synthesis: Background in processing natural language data (e.g., historical user chat logs, support tickets) to algorithmically extract user intent, synthesize realistic personas, and generate deterministic goals for simulation.
  • Evaluation & 'What-If' Benchmarking: Solid experience building evaluation frameworks for non-deterministic AI systems, including establishing metrics, guardrails, scoring rubrics, and regression testing methodologies for LLM configurations.
  • Data Fluency & Orchestration: Strong understanding of managing complex state in asynchronous architectures, streaming LLM tokens, handling rate limits, and manipulating heavy data pipelines to feed simulation engines.
  • Ownership & Pragmatism: A strong sense of technical ownership, a passion for balancing cutting-edge ML research with practical product delivery, and excellent communication skills to collaborate across a globally distributed team.
  • Extensive Experience: 10+ years of software engineering experience, with a proven track record operating at a Staff, Principal, or Architect level designing mission-critical distributed systems.
  • Distributed Systems Expertise: Expert-level understanding of designing highly concurrent, fault-tolerant, and globally scalable backend architectures.
  • Advanced Orchestration: Deep architectural experience with stateful, durable workflow orchestration engines and managing complex asynchronous lifecycles at scale.
  • API & Systems Integration: Extensive experience designing resilient, high-performance APIs (e.g., gRPC) and managing high-throughput message/event-driven architectures.
  • AI/ML Engineering Experience: While you do not need to be an ML researcher, you have demonstrable experience building, scaling, or integrating backend infrastructure for AI/ML products. This includes hands-on experience working with LLMs, agentic architectures, and solving the unique infrastructure challenges of testing non-deterministic systems.

*This job is located in Hyderabad, India

#LI-Hybrid

Why You’ll Like Working for DigitalOcean
  • We innovate with purpose. You’ll be a part of a cutting-edge technology company with an upward trajectory, who are proud to simplify cloud and AI so builders can spend more time creating software that changes the world. As a member of the team, you will be a Shark who thinks big, bold, and scrappy, like an owner with a bias for action and a powerful sense of responsibility for customers, products, employees, and decisions.
  • We prioritize career development. At DO, you’ll do the best work of your career. You will work with some of the smartest and most interesting people in the industry. We are a high-performance organization that will always challenge you to think big. Our organizational development team will provide you with resources to ensure you keep growing. We provide employees with reimbursement for relevant conferences, training, and education. All employees have access to LinkedIn Learning's 10,000+ courses to support their continued growth and development.
  • We care about your well-being.Regardless of your location, we will provide you with a competitive array of benefits to support you from our Employee Assistance Program to Local Employee Meetups to flexible time off policy, to name a few. While the philosophy around our benefits is the same worldwide, specific benefits may vary based on local regulations and preferences.
  • We reward our employees. The salary range for this position is based on market data, relevant years of experience, and skills. You may qualify for a bonus in addition to base salary; bonus amounts are determined based on company and individual performance. We also provide equity compensation to eligible employees, including equity grants upon hire and the option to participate in our Employee Stock Purchase Program.
  • DigitalOcean is an equal-opportunity employer. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.

Application Limit: You may apply to a maximum of 3 positions within any 180-day period. This policy promotes better role-candidate matching and encourages thoughtful applications where your qualifications align most strongly.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, AI
Software Engineer, AI

digitalocean98 • Saddar Town

On-site
PKR 2,400,000 - 3,600,000
Staff Software Engineer - Managed Kubernetes products
Staff Software Engineer - Managed Kubernetes products

DigitalOcean LLC • Hyderabad City Taluka

On-site
PKR 11,834,000 - 20,710,000
Annual bonus plan
Equity grants
Hybrid work model
Software Engineer, AI
Software Engineer, AI

DigitalOcean LLC • Karachi Division

On-site
PKR 1,800,000 - 3,600,000
Software Engineer II
Software Engineer II

DigitalOcean, Inc. • Karachi Division

On-site
PKR 33,195,000 - 49,793,000
Conference reimbursement
Well-being support
Equity program
+2
Staff Product Manager, Compute Platform
Staff Product Manager, Compute Platform

DigitalOcean LLC • Hyderabad City Taluka

On-site
PKR 10,171,000 - 17,437,000
Annual bonus plan
New hire equity grant
Revenue System Administrator
Revenue System Administrator

DigitalOcean LLC • Hyderabad City Taluka

Hybrid
PKR 2,663,000 - 4,438,000
Hybrid work arrangement
Senior Customer Success Engineer I
Senior Customer Success Engineer I

DigitalOcean LLC • Hyderabad City Taluka

Remote
PKR 30,429,000 - 47,026,000
Conference reimbursement
Annual bonus eligibility
Remote-friendly
Technical Content Writer
Technical Content Writer

DigitalOcean, Inc. • Karachi Division

On-site
PKR 15,227,000 - 20,764,000
Technical Content Writer
Technical Content Writer

digitalocean98 • Saddar Town

On-site
PKR 1,200,000 - 2,400,000
Equity grants
Employee Stock Purchase Program
Bonus potential
Technical Content Writer
Technical Content Writer

DigitalOcean LLC • Karachi Division

On-site
PKR 1,200,000 - 1,800,000
Top locations