Senior AI Engineer

Jobtailor; California (MO); On-site; USD 130,000 - 190,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Job summary

Jobtailor is seeking a skilled AI/ML Software Engineer to collaborate across engineering, research, and product management to deliver advanced AI-powered solutions.

You will design and deploy AI components, including foundation model training, LLM inference, and guardrails, while optimizing for cost, latency, and scalability across cloud platforms. This role emphasizes staying at the forefront of AI research and applying it to production systems.

Qualifications

• Bachelor's degree in CS/AI/EE/CE or related field plus 3+ years AI/ML experience, or Master's with 1+ year.
• At least 3 years coding in Python, Go, Scala, or Java.
• Preferred: 4 years deploying AI on cloud platforms such as AWS, GCP, Azure, or private cloud.
• Experience delivering AI services and applying state-of-the-art techniques in production.

Responsibilities

• Partner with engineers, researchers, TPMs, and PMs to deliver AI-powered products.
• Design, develop, test, deploy, and support AI software components incl. foundation model training and governance.
• Leverage open-source and SaaS AI tech such as AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, PyTorch.
• Invent state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap of foundational AI systems.

Skills

AI/ML Algorithm Development

Large Language Model Inference

Python Programming

Go Programming

Java Programming

C++ Programming

Cloud Solutions (AWS/GCP/Azure)

VectorDBs/Similarity Search

Model Evaluation

Hardware/Software Foundations in AI

Education

Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Master's degree in those fields

Tools

AWS Ultraclusters

Hugging Face

NeMo Guardrails

PyTorch

Google Cloud

Azure

Job description

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
• Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Leverage open-source and SaaS AI technologies such as AWS Ultraclusters, Hugging Face, VectorDBs, NeMo Guardrails, and PyTorch
• Invent and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput of large-scale production AI systems
• Contribute to the technical vision and long-term roadmap of foundational AI systems at Capital One

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 3 years of experience developing AI and ML algorithms or technologies, OR a Master's degree in those fields plus at least 1 year of such experience
• At least 3 years of experience programming with Python, Go, Scala, or Java
• Preferred: 4 years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud
• Experience developing, delivering, and supporting AI services
• Experience developing AI and ML algorithms or technologies, including LLM Inference, Similarity Search and VectorDBs, Guardrails, and Memory, using Python, C++, C#, Java, or Golang
• Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Passion for staying abreast of the latest research and applying novel techniques in production
• Strong foundation in engineering and mathematics, with expertise in hardware, software, and AI

Core Competencies

Demonstrates expertise in developing and deploying AI and ML algorithms, with a strong focus on large language model optimization and cloud-based solutions. Proficient in leveraging advanced AI technologies and frameworks to enhance system performance and scalability.

Highest-signal resume keywords

• AI And ML Algorithm Development
• Large Language Model Inference
• Python Programming
• AWS Cloud Solutions
• AI Service Delivery

Hard Skills

• AI Software Development
• Machine Learning Algorithms
• Model Evaluation
• Optimization Techniques
• Similarity Search
• VectorDBs
• Foundation Model Training
• C++ Programming
• Java Programming
• Go Programming

Soft Skills

• Collaboration
• Passion For Research

Industry Keywords

• AI Governance
• Observability
• Scalability
• Cost Optimization
• Latency Improvement

Tools & Technologies

• AWS Ultraclusters
• Hugging Face
• NeMo Guardrails
• PyTorch
• Google Cloud
• Azure