A leading global financial institution is seeking a Machine Learning & AI Engineer for the Production Runtime Experience team in New York, NY (Hybrid). The role involves designing ML solutions to improve system reliability and requires strong Python skills, experience with LLMs, and cloud platforms. Ideal candidates should have at least 3 years of relevant experience in software development and production ML systems.
Qualifications
3+ years of software development experience; strong Python experience preferred.
3+ years of experience building and maintaining production ML systems.
Hands-on experience with Large Language Models (LLMs) and prompt engineering.
Responsibilities
Design and implement tool-calling agents for ML solutions.
Build evaluation frameworks for open-source and foundational LLMs.
Integrate agents into observability and incident management systems.
Collaborate with teams to translate operational challenges into AI-driven solutions.
Implement safety and compliance measures in systems.
Optimize model performance and cost through various techniques.
Skills
Software development (Python, C/C++, Go, or Java)
Building and maintaining production ML systems
Experience with Large Language Models (LLMs)
Understanding of commercial and open-source LLMs
Familiarity with applied statistics and core ML concepts
Experience with cloud platforms (AWS preferred)
Strong analytical thinking skills
Strong communication skills
Strong collaboration skills
Tools
AWS
ECS/EKS
Lambda
S3
DynamoDB
SageMaker
Terraform
CloudFormation
Job description
A leading global financial institution is seeking a Machine Learning & AI Engineer for the Production Runtime Experience team in New York, NY (Hybrid). The role involves designing ML solutions to improve system reliability and requires strong Python skills, experience with LLMs, and cloud platforms. Ideal candidates should have at least 3 years of relevant experience in software development and production ML systems.