Staff Software Engineer, Agentic SDLC — AI Agent Platform Lead

Socket.dev; San Jose (CA); On-site; USD 207,000 - 300,000; Full time

Benefits offered by this job

Equity

Bonus target (20%)

Benefits

Job summary

Google in the United States is hiring a Staff Software Engineer to lead architecture and evaluation for the developer agent ecosystem as part of the Agentic SDLC Foundations team. You will drive HITL guardrails, automated evaluation harnesses, and KPI standardization across engineering workflows.

You will shape the technical strategy for scalable AI solutions and oversee end-to-end quality engineering for reliable autonomous systems in Google's Core stack.

Qualifications

• Bachelor’s degree or equivalent practical experience is required.
• 8 years of software development experience.
• 5 years testing and launching software products; 3 years in design/architecture.
• 5 years ML design/infrastructure experience (deployment, evaluation, data processing, debugging, fine-tuning).
• Experience integrating generative AI tools or LLM interfaces into workflows.
• Preferred: advanced degree and leadership experience in tech.
• Experience designing AI/ML evaluations, LLM benchmarks, or quality pipelines.

Responsibilities

• Design and scale production developer agents with trajectory planning and tool selection.
• Implement HITL approval gates and safety-conscious execution of actions.
• Architect evaluation pipelines for multi-step trajectories and tool fidelity.
• Create closed-loop data from failures for dataset refinement and model tuning.
• Develop benchmarks to evaluate KPI across complex developer tasks.

Skills

Software development experience

ML design & infrastructure

Generative AI integration

Technical leadership

AI/ML evaluations planning

LLM benchmarking

Prompt optimization

LLM fine-tuning

Automated dataset generation

Trajectory-based evaluation

Autonomous agent deployment

Education

Bachelor’s degree or equivalent practical experience

Master’s degree or PhD in Engineering, CS, or related field

Job description

Google in the United States is hiring a Staff Software Engineer to lead architecture and evaluation for the developer agent ecosystem as part of the Agentic SDLC Foundations team. You will drive HITL guardrails, automated evaluation harnesses, and KPI standardization across engineering workflows.

You will shape the technical strategy for scalable AI solutions and oversee end-to-end quality engineering for reliable autonomous systems in Google's Core stack.