Senior Go/Python Backend Engineer - LLM Platforms & Streaming

JPMorgan Chase & Co.

McLean (VA)

On-site

USD 120,000 - 190,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

JPMorgan Chase & Co. in McLean, VA seeks a Software Engineer III to help build and scale LLM-enabled backend services. You will design and implement Go-based microservices, leverage gRPC and Protobuf, and integrate with authn/z, caching, and queues to deliver secure, reliable systems.

You will work on end-to-end streaming workloads, contribute to code reviews, and emphasize testing, observability, and secure coding standards in a fast-paced Agile environment.

Qualifications

  • Formal training or certification in software engineering concepts.
  • 3+ years of applied software engineering experience.
  • Proficiency in Go for backend/service development.
  • Experience with gRPC and Protobuf in production.
  • Experience building and operating microservices with a production mindset.
  • Proficiency in automation and CI/CD methods.
  • Secure coding practices and SDLC activities.
  • Hands-on experience with enterprise AI-assisted development tools.
  • Understanding of responsible AI use in engineering workflows.

Responsibilities

  • Execute software solutions for LLM-enabled applications and platforms.
  • Design, build, and maintain backend services in Go.
  • Build gRPC services with Protobuf; API design and compatibility management.
  • Implement bidirectional streaming endpoints for LLM workloads.
  • Integrate LLM services with authn/z, rate limits, caching, queues/streams.
  • Review and debug SDK/service integrations; contribute to standards.
  • Instrument services with observability and runbooks; support alerts/dashboards.
  • Identify issues and drive automation to improve reliability and performance.

Skills

Go backend development
Python
gRPC & Protobuf
Microservices architecture
Security best practices
Testing & CI/CD
Observability & debugging
Enterprise AI tooling usage

Education

Software engineering certification

Tools

Kubernetes
Docker
OpenTelemetry
Kafka/RabbitMQ
Redis
Protobuf tooling

Job description

JPMorgan Chase & Co. in McLean, VA seeks a Software Engineer III to help build and scale LLM-enabled backend services. You will design and implement Go-based microservices, leverage gRPC and Protobuf, and integrate with authn/z, caching, and queues to deliver secure, reliable systems.

You will work on end-to-end streaming workloads, contribute to code reviews, and emphasize testing, observability, and secure coding standards in a fast-paced Agile environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Backend AI/ML Engineer (Go/Python)
Senior Backend AI/ML Engineer (Go/Python)

Aumni • Virginia

On-site
USD 130,000 - 180,000
Software Engineer III - AIML
Software Engineer III - AIML

JPMorgan Chase & Co. • McLean (VA)

On-site
USD 120,000 - 190,000
Software Engineer III - AIML
Software Engineer III - AIML

Aumni • Virginia

On-site
USD 130,000 - 180,000
Senior Golang Engineer — Secure, Scalable Systems
Senior Golang Engineer — Secure, Scalable Systems

JPMorgan Chase & Co. • Chicago (IL)

On-site
USD 140,000 - 170,000
Senior Lead Engineer (Java/Python/Go) - Build Secure Apps
Senior Lead Engineer (Java/Python/Go) - Build Secure Apps

Testing Site - JPMC • Jersey City (NJ)

On-site
USD 140,000 - 190,000
Lead Java Backend Engineer: Scalable, Secure Microservices
Lead Java Backend Engineer: Scalable, Secure Microservices

Testing Site - JPMC • Houston (TX)

On-site
USD 140,000 - 190,000
Senior Software Engineer (Java/Python) - Full Stack/Backend
Senior Software Engineer (Java/Python) - Full Stack/Backend

JPMorgan Chase & Co. • Fairfax (DE)

On-site
USD 120,000 - 160,000
Software Engineer III - Golang
Software Engineer III - Golang

JPMorgan Chase & Co. • Chicago (IL)

On-site
USD 140,000 - 170,000
Lead Software Engineer - Java/Python Microservices on AWS
Lead Software Engineer - Java/Python Microservices on AWS

JPMorgan Chase & Co. • Plano (TX)

On-site
USD 150,000 - 190,000
Senior Software Engineer (Java/Python) - Scalable Systems
Senior Software Engineer (Java/Python) - Scalable Systems

Testing Site - JPMC • Tampa (FL)

On-site
USD 90,000 - 140,000