Senior ML Engineer — AI Tools & On-Prem Workflows

C2R Ventures

New York (NY)

On-site

USD 150,000 - 190,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

C2R Ventures in NYC seeks a Senior ML Engineer to design and implement internal AI-native tools across the firm. You’ll work with researchers, investment, compliance, and operations to identify automation opportunities and deliver robust, high-leverage tools.

You will build internal AI tools operating on on-prem data, design orchestration components, and integrate with external LLM APIs via secure endpoints, while ensuring low latency and strong security across data boundaries.

Qualifications

  • Requires advanced degree in CS or related field.
  • 5+ years in backend or full-stack with ML exposure.
  • Experience with standard infra tools (Docker, Kubernetes, HAProxy).
  • Design secure, low-latency workflows across data boundaries.

Responsibilities

  • Build internal AI tools and automation workflows on on-prem datasets and infrastructure.
  • Design components for orchestration, vector search, and retrieval-augmented generation (RAG).
  • Interface with external LLM APIs (e.g., OpenAI, Anthropic) via secure endpoints; manage prompts.
  • Develop libraries and APIs to support reusable patterns across user-facing tools.

Skills

ML tooling
Backend development
Full-stack engineering
Security & data governance

Education

BS/MS/PhD in CS

Tools

Docker
Kubernetes
HAProxy
Logging/metrics

Job description

C2R Ventures in NYC seeks a Senior ML Engineer to design and implement internal AI-native tools across the firm. You’ll work with researchers, investment, compliance, and operations to identify automation opportunities and deliver robust, high-leverage tools.

You will build internal AI tools operating on on-prem data, design orchestration components, and integrate with external LLM APIs via secure endpoints, while ensuring low latency and strong security across data boundaries.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Machine Learning Engineer
Machine Learning Engineer

C2R Ventures • New York (NY)

On-site
USD 150,000 - 190,000
Senior ML/AI Engineer – On‑Site NY, Equity & Growth
Senior ML/AI Engineer – On‑Site NY, Equity & Growth

Clera • New York (NY)

On-site
USD 170,000 - 230,000
Early-stage equity
Opportunity to shape product direction
Senior ML Engineer — GenAI Platform & LLMs
Senior ML Engineer — GenAI Platform & LLMs

Citigroup Inc. • Jersey City (NJ)

On-site
USD 142,000 - 214,000
Medical benefits
401(k)
Paid time off
Senior ML Engineer: AI for Market Insights
Senior ML Engineer: AI for Market Insights

Versant Media, LLC • Englewood Cliffs (NJ)

Hybrid
USD 140,000 - 175,000
Free onsite fitness center
Gourmet cafeteria
Shuttle transportation
Senior AI/ML Engineer — Secure Ops & LLM Automation
Senior AI/ML Engineer — Secure Ops & LLM Automation

Columbia Technology Partners, Inc • Annapolis (MD)

On-site
USD 150,000 - 210,000
Medical plans
401k with company contribution
PTO + Leave with flexible plans
+1
Production AI/ML Engineer - LLM & MLOps (NYC On-Site)
Production AI/ML Engineer - LLM & MLOps (NYC On-Site)

OP Recruiting • New York (NY)

On-site
USD 170,000 - 250,000
Senior AI Platform Engineer
Senior AI Platform Engineer

Mlg-Capital • Goerke's Corners (WI)

On-site
USD 150,000 - 210,000
Senior ML Platform Engineer - Scalable, Secure AI Tools
Senior ML Platform Engineer - Scalable, Secure AI Tools

JPMorgan Chase & Co. • New York (NY)

On-site
USD 130,000 - 160,000
Senior ML Engineer - Production-Scale AI Architect
Senior ML Engineer - Production-Scale AI Architect

Capital One National Association • New York (NY)

On-site
USD 215,000 - 246,000
Forward-Deployed AI Solutions Engineer
Forward-Deployed AI Solutions Engineer

Citi • New York (NY)

Hybrid
USD 170,000 - 300,000
Hybrid work model (3 days in office, 2
Director-level impact