Lead AI/ML Engineer - GPU-Accelerated Serving

Socket.dev; Palo Alto, Northern (CA, KY); Hybrid; USD 180,000 - 230,000; Full time

Job summary

JPMorgan Chase & Co. in Palo Alto, CA seeks a senior software engineer focused on ML systems and AI-assisted development. You will design, build, and troubleshoot complex software, while ensuring secure, high-quality production code and scalable services.

You will lead and mentor teammates, apply Python ML frameworks, and work with Docker/Kubernetes in a cloud-native environment to ensure reliability and performance across distributed architectures.

Qualifications

• Formal training or certification on software engineering concepts and 5+ years applied experience.
• Professional software development experience with emphasis on ML systems.
• Hands-on experience using enterprise-authorized AI-assisted development tools with QA of outputs.
• Responsible for AI use in engineering workflows, including data sensitivity and security.
• Experience designing and developing scalable systems and services (web services, APIs).
• Proficiency in Python with ML frameworks (TensorFlow, PyTorch, or similar).
• Experience with Docker and Kubernetes in production environments.
• Experience with AWS or GCP cloud platforms.
• Knowledge of system design fundamentals: reliability, scalability, performance tradeoffs.
• Distributed systems concepts, microservices, Cassandra or NoSQL databases.
• Mentorship and technical leadership, elevating team engineering standards.

Responsibilities

• Executes software solutions, design, development, and troubleshooting with ability to break down complex problems.
• Creates secure, high-quality production code and maintains related algorithms.
• Leverages enterprise AI coding tools to boost code quality, speed, and productivity with peer reviews.
• Applies SDLC tools and AI-assisted development to improve automation value.
• Produces architecture and design artifacts for complex applications and ensures constraints are met.
• Gathers and analyzes large data sets to visualize and report for software improvements.
• Proactively identifies hidden data patterns to drive coding hygiene and system improvements.

Skills

ML systems

Python

Distributed systems

Cloud-native

Mentorship

Secure coding

AI-assisted development

Code reviews

Education

Formal training in software engineering

Tools

Docker

Kubernetes

TensorFlow

PyTorch

APIs

Job description

JPMorgan Chase & Co. in Palo Alto, CA seeks a senior software engineer focused on ML systems and AI-assisted development. You will design, build, and troubleshoot complex software, while ensuring secure, high-quality production code and scalable services.

You will lead and mentor teammates, apply Python ML frameworks, and work with Docker/Kubernetes in a cloud-native environment to ensure reliability and performance across distributed architectures.