Applied AI/ML Engineer

OP Recruiting

New York (NY)

On-site

USD 250,000 - 350,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health insurance
Dental insurance
Vision insurance
401(k) with company match

Job summary

OP Recruiting in New York, NY is seeking an Applied AI / Machine Learning Engineer to build the AI platform, agentic workflows, and high-throughput retrieval systems in a fast-paced financial services environment.

You will design production-grade LLM infrastructure, optimize performance, and deploy models across distributed cloud environments with a strong emphasis on reliability and impact.

Qualifications

  • 6+ years of software engineering and ML experience (or 4+ with advanced quantitative degree).
  • Experience building production applications with LLM orchestration tools and protocol-driven integration.
  • Experience deploying on distributed cloud environments (AWS, Azure, GCP).

Responsibilities

  • Design and maintain high-efficiency AI infrastructure with low-latency inference on dedicated hardware.
  • Develop autonomous agentic workflows for complex data tasks and software development.
  • Scale retrieval architectures using RAG models, vector stores, and embedding pipelines.
  • Collaborate with cross-functional teams to deliver AI-driven production applications.
  • Establish robust MLOps practices including CI/CD, monitoring, drift management, and quality metrics.

Skills

Python programming
PyTorch
JAX
LLM orchestration
Vector storage
Containers
Distributed cloud
MLOps
Low-latency inference

Tools

Docker

Job description

Applied AI / Machine Learning Engineer

Location: New York, NY Metro Area (On-Site)

About The Opportunity

Join a high-velocity, centralized technology group building the foundational artificial intelligence platform for a leading financial services organization. This hands-on, code-first role focuses on designing state-of-the-art agentic workflows, custom LLM infrastructure, and high-throughput retrieval systems directly driving business outcomes. You will bridge the gap between bleeding-edge generative models and production-grade execution in a fast-paced, highly quantitative environment.

Responsibilities
  • System Architecture & Deployment: Design and maintain high-efficiency AI infrastructure, including dynamic model routing, automated evaluation frameworks, and low-latency inference setups on dedicated hardware.
  • Agentic Framework Development: Construct autonomous multi-agent systems to automate software development, complex document analysis, and large-scale data workflows across distributed systems.
  • Enterprise Search & Retrieval: Scale search architectures leveraging advanced Retrieval-Augmented Generation (RAG) models, vector storage solutions, and tailored embedding pipelines.
  • Stakeholder Collaboration: Work alongside cross-functional domain experts and analysts to convert complex operational and research challenges into production-ready, AI-driven applications.
  • MLOps Implementation: Establish robust MLOps practices, including continuous deployment pipelines, model monitoring, version control, drift management, and systematic quality evaluation metrics.
Requirements (Must-Have)
  • 6+ years of software engineering and machine learning experience (or 4+ years paired with an advanced quantitative degree).
  • Exceptional Python programming skills paired with deep experience in deep learning frameworks such as PyTorch or JAX.
  • Proven experience building production applications with advanced LLM orchestration tools, structured output architectures, and protocol-driven tool integration.
  • Direct experience utilizing vector storage solutions, container technologies, and deploying applications on distributed cloud environments (AWS, Azure, or GCP).
  • Strong technical focus on system optimization, compute efficiency, latency reduction, and a commitment to shipping reliable production code.
Preferred Qualifications (Nice-to-Have)
  • Prior background delivering advanced AI tools or alternative data pipelines within quantitative finance, investment management, or premier technology firms.
  • Proficiency in a compiled programming language (such as C++, Go, or Java).
  • Solid grounding in traditional statistical machine learning methodologies (time-series analysis, clustering, regression) alongside generative models.
Compensation & Benefits
  • Competitive base compensation package paired with performance-based incentive opportunities.
  • Access to high-performance computational hardware and specialized proprietary data assets.
  • Comprehensive health, dental, and vision insurance coverage.
  • Company-matched 401(k) plan
  • Base salary: $250,000 to $350,000 per year

We are an equal opportunity employer and value diversity at our company. We do not discriminate based on race, religion, color, ethnic origin, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Applied AI/ML Engineer
Applied AI/ML Engineer

Objective Partners • New York (NY)

On-site
USD 150,000 - 260,000
Medical, dental, vision insurance
High-performance hardware access
Competitive base + incentive options
Applied AI Engineer – Agentic AI & LLMs
Applied AI Engineer – Agentic AI & LLMs

Robson Bale Ltd • New York (NY)

On-site
USD 150,000 - 200,000
Competitive base salary
Medical, dental, vision coverage
401(k) with matching
+4
Senior AI Engineer
Senior AI Engineer

Eleven Recruiting • New York (NY)

On-site
USD 229,000 - 312,000
Staff Applied AI Engineer - Enterprise AI Solutions
Staff Applied AI Engineer - Enterprise AI Solutions

snorkelai • United States

Hybrid
USD 230,000 - 360,000
Equity included
Hybrid work model
On-target earnings range
Applied AI Engineer | McLean, VA
Applied AI Engineer | McLean, VA

Aktra Inc • McLean (VA)

On-site
USD 150,000 - 210,000
Applied AI Engineer: Partner-Facing Data & ML Pipelines
Applied AI Engineer: Partner-Facing Data & ML Pipelines

Evbrocks • United States

Hybrid
USD 180,000 - 250,000
Equity compensation
Performance bonuses
Health insurance
+2
Applied AI Engineer
Applied AI Engineer

Cyrad Solutions LLC • New York (NY)

On-site
USD 400,000 - 1,000,000
AI/ML Architect
AI/ML Architect

Quantum Technologies LLC • City of Albany (NY)

On-site
USD 78,000 - 112,000
AI/ML Architect
AI/ML Architect

Ethereum Technologies LLC • City of Albany (NY)

On-site
USD 83,000 - 107,000
AI/ML Architect
AI/ML Architect

Valiant Technologies LLC • City of Albany (NY)

On-site
USD 78,000 - 112,000