Senior AI Software Development Engineer

F5; Hyderabad; On-site; INR 4,200,000 - 7,000,000; Full time

Job summary

F5 seeks a Senior AI Software Development Engineer to lead production-grade agentic frameworks, integrating Gemini models with Vertex AI, and building secure, observable AI workflows across the organization.

You will design scalable backends, implement robust APIs, and guide engineering teams in deploying high-code agents using Java/Python/Go/TypeScript, while ensuring safety, governance, and performance.

Qualifications

• 6+ years of software engineering with distributed systems
• Strong Python and at least one of Go/Java/TypeScript
• Production experience with LLM-based systems incl. prompting, tool calls, embeddings
• Experience with Vertex AI, Gemini APIs, OpenAI APIs or similar enterprise AI platforms
• API design, microservices, cloud-native architectures (Docker, Kubernetes)
• Experience with orchestration frameworks (LangChain, LlamaIndex, custom layers)
• Familiarity with vector databases, embedding pipelines, and retrieval strategies
• Authentication, authorization, and enterprise security patterns
• Proven ability to build robust, reusable code and clean APIs

Responsibilities

• Build and optimize enterprise-grade agent orchestration frameworks for tool use, memory, RAG and automation
• Develop patterns for multi-agent collaboration, event-driven execution and workflow chaining
• Implement standards for agent lifecycle management, state persistence and context engineering
• Integrate Gemini models via Vertex AI with secure, scalable API consumption
• Develop and maintain internal SDKs and reusable components for Gemini usage
• Implement and refine prompt engineering, token efficiency and structured output patterns
• Develop reference implementations for high-code agents in Java, Python, Go or TypeScript
• Ensure secure integration with enterprise apps (Salesforce, Snowflake, SharePoint, ServiceNow)
• Build observability pipelines, safety guardrails and governance for AI workflows
• Support developer enablement with docs, SDKs and sample code
• Optimize inference latency, parallelization and cost, with caching and batching

Skills

Python

Distributed systems

APIs & microservices

LLM-based systems

Security concepts

Cloud-native

Algorithms & data structures

Tools

Vertex AI

Gemini APIs

OpenAI APIs

Docker

Kubernetes

LangChain

LlamaIndex

Vector databases

Job description

At F5, we strive to bring a better digital world to life. Our teams empower organizations across the globe to create, secure, and run applications that enhance how we experience our evolving digital world. We are passionate about cybersecurity, from protecting consumers from fraud to enabling companies to focus on innovation.

Everything we do centers around people. That means we obsess over how to make the lives of our customers, and their customers, better. And it means we prioritize a diverse F5 community where each individual can thrive.

Job Description: Senior AI Software Development Engineer

F5 Digital is executing an enterprise-scale Agentic AI transformation to enable secure, observable, and production-grade AI agents across the organization. We are seeking a Senior AI Software Development Engineer to lead the implementation, rollout, and optimization of high-code agent development and orchestration frameworks, as well as enterprise AI integrations, as part of our Gemini rollout and adoption.

This is a highly technical, hands-on engineering role. The Senior Engineer will develop scalable agentic systems, apply robust engineering standards for AI workflows, and support engineering teams across F5 in building production-ready agents using Gemini, Vertex AI, and internal AI platform infrastructure.

The ideal candidate has strong backend and distributed systems experience, solid hands-on familiarity with LLM architectures and agent frameworks, and a proven track record of writing secure, high-performance production code.

Key Responsibilities:

Key Responsibilities

• Build and optimize enterprise-grade agent orchestration frameworks supporting tool use, memory, RAG, agentic workflows and automation.
• Develop patterns for multi-agent collaboration, event-driven execution, and workflow chaining across enterprise systems.
• Implement standards for agent lifecycle management, state persistence, and context engineering.

Gemini & Vertex AI Integration

• Integrate Gemini models via Vertex AI, ensuring secure, scalable API consumption and robust model routing.
• Develop and maintain internal SDKs, abstractions, and reusable components to standardize Gemini usage across F5 teams.
• Implement and refine prompt engineering, token efficiency, grounding strategies, and structured output patterns.

High-Code Agent Enablement

• Develop reference implementations and reusable libraries for high-code agents in Java, Python, Go, or TypeScript.
• Implement secure integration patterns for agents interacting with Salesforce, Snowflake, SharePoint, ServiceNow, and internal APIs.
• Build and maintain MCP (Model Context Protocol) servers and secure API integration gateways.

Observability, Safety & Governance

• Build logging, tracing, telemetry, and evaluation pipelines for agent performance and reliability.
• Apply safety guardrails including input/output validation, hallucination mitigation, prompt injection defenses, and policy enforcement.
• Collaborate with Security to ensure secure data handling, RBAC enforcement, and compliance alignment.

Developer Enablement & Technical Support

• Guide and support engineering teams adopting Gemini Code Assist, CLI workflows, and internal AI development platforms.
• Create high-quality technical documentation, internal libraries, and code samples for developer teams.
• Participate in code reviews and provide guidance for AI-enabled applications across F5.

Performance & Scalability

• Optimize inference latency, parallelization, and cost management strategies across agent workflows.
• Implement caching strategies, streaming responses, and batching techniques to improve throughput.
• Conduct performance testing and benchmarking of agents/models across different workloads.

Required Qualifications

• 6+ years of experience in software engineering, with strong experience in distributed systems and backend architecture.
• Deep hands-on coding expertise in Python and at least one of: Go, Java, or TypeScript.
• Hands-on production experience with LLM-based systems, including prompt engineering, tool calling, RAG, embeddings, and agent frameworks.
• Experience with Vertex AI, Gemini APIs, OpenAI APIs, or similar enterprise AI platforms.
• Strong understanding of API design, microservices, and cloud-native architectures (Docker, Kubernetes).
• Experience building or integrating orchestration frameworks (e.g., LangChain, LlamaIndex, custom orchestration layers).
• Familiarity with vector databases, embedding pipelines, and retrieval strategies.
• Strong understanding of authentication, authorization, and enterprise security patterns.
• Proven ability to build robust, reusable code and clean APIs.

Preferred Qualifications

• Experience building multi-agent systems or autonomous workflow engines.
• Experience with model evaluation pipelines and AI quality metrics.
• Familiarity with structured output enforcement (JSON schemas, function calling).
• Experience working with enterprise data systems such as Snowflake, Salesforce, ServiceNow, SharePoint.
• Knowledge of cost modeling and inference optimization techniques.
• Experience contributing to internal developer platforms or SDK ecosystems.

What Success Looks Like:

A successful Senior AI Software Development Engineer in this role will:

• Deliver and optimize a secure, scalable orchestration layer for enterprise agents.
• Enable engineering teams to build production-grade high-code agents with clean, reusable components.
• Maintain robust observability, evaluation, and safety controls for AI-driven workflows.
• Accelerate AI agent rollout by building integrations, SDKs, and ready-to-use reference implementations.

Impact

• This role will directly contribute to how F5 builds and scales agentic AI across engineering, sales, support, finance, and product teams.
• You will build the core technical solutions that enable pro-code AI development while ensuring enterprise-grade reliability, governance, and security.

The Job Description is intended to be a general representation of the responsibilities and requirements of the job. However, the description may not be all-inclusive, and responsibilities and requirements are subject to change.

The Job Description is intended to be a general representation of the responsibilities and requirements of the job. However, the description may not be all-inclusive, and responsibilities and requirements are subject to change.

Please note that F5 only contacts candidates through F5 email address (ending with @f5.com) or auto email notification from Workday (ending with f5.com or @myworkday.com)

Equal Employment Opportunity

It is the policy of F5 to provide equal employment opportunities to all employees and employment applicants without regard to unlawful considerations of race, religion, color, national origin, sex, sexual orientation, gender identity or expression, age, sensory, physical, or mental disability, marital status, veteran or military status, genetic information, or any other classification protected by applicable local, state, or federal laws. This policy applies to all aspects of employment, including, but not limited to, hiring, job assignment, compensation, promotion, benefits, training, discipline, and termination. F5 offers a variety of reasonable accommodations for candidates. Requesting an accommodation is completely voluntary. F5 will assess the need for accommodations in the application process separately from those that may be needed to perform the job. Request by contacting [e-mail].