Gen AI Platform Engineer — AI Systems & Scale

Capital One National Association; New York (NY); Hybrid; USD 197,000 - 246,000; Full time

Benefits offered by this job

Health benefits

Competitive compensation

Job summary

Capital One is creating responsible and reliable AI systems to reimagine banking and deliver human‑centric experiences. The IFX team partners across the company to advance AI engineering and deploy proprietary solutions for millions of customers.

You will design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents, and vector search, while ensuring security and governance.

Qualifications

• Bachelor's or Master's with related field and AI/ML experience.
• 4+ years programming AI/ML algorithms in Python, Go, Scala, CUDA or Java.
• Experience designing scalable and responsible AI systems.

Responsibilities

• Partner with cross‑functional teams to deliver AI products.
• Design, develop, test, deploy, and support AI software components.
• Leverage Open Source and SaaS AI tech such as AWS Ulraclusters, Huggingface, VectorDBs, PyTorch.
• Optimize foundation model performance for scalability, latency, and cost.
• Contribute to long-term AI system roadmap and governance.
• Own end‑to‑end architecture for complex AI systems with observability and ethics.
• Define and maintain SLOs for AI reliability and model performance drift.
• Collaborate with infrastructure to optimize GPU/TPU utilization.
• Lead technical reviews for new AI deployments with security and governance.
• Mentor senior associates on scalable design and production translation.

Skills

Python

Go

Scala

CUDA

Java

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Tools

AWS

Google Cloud

Azure

Job description

Capital One is creating responsible and reliable AI systems to reimagine banking and deliver human‑centric experiences. The IFX team partners across the company to advance AI engineering and deploy proprietary solutions for millions of customers.

You will design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents, and vector search, while ensuring security and governance.