AI Engineer & Data Scientist: Production ML & LLM Apps

edkey

New York (NY)

On-site

USD 107,000 - 193,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Confidential Client (Banking) in New York, NY seeks an AI Engineer - Data Scientist I to design and build production-grade AI systems used across the business. This role sits at the intersection of AI research, software engineering, and product development, translating Generative AI and ML techniques into scalable solutions.

You’ll own AI systems end-to-end—from research and prototyping through deployment, evaluation, and monitoring—partnering with product, engineering, and business teams to

Qualifications

  • Bachelor’s degree in CS, mathematics, statistics, physics, or related field.
  • Minimum 2 years of experience developing production-quality software, ML systems, or AI-powered applications using Python and/or C++.
  • Strong foundation in probability, statistics, and applied machine learning (NLP, time-series, Generative AI).
  • Solid software engineering fundamentals: modular design, APIs, testing, version control, and maintainable production code.
  • Ability to communicate complex technical concepts clearly to both technical and non-technical stakeholders.

Responsibilities

  • Frame abstract business problems and convert them into ML/AI solutions.
  • Own AI systems end-to-end: research and prototyping through architecture, implementation, deployment, and ongoing improvement.
  • Design and implement LLM-based applications, retrieval-augmented generation (RAG) systems, and intelligent agents.
  • Experiment with model architectures, retrieval strategies, prompting techniques, and agent workflows.
  • Build rigorous evaluation frameworks, metrics, and tests to measure AI quality and identify improvement opportunities.
  • Partner with product, engineering, and business stakeholders to deliver measurable outcomes.
  • Drive cross-team collaboration to scale AI capabilities and production best practices.

Skills

Python
C++
LLMs
RAG
NLP
PyTorch
TensorFlow
Docker
Kubernetes
AWS
GCP
Azure
SQL
Data engineering
MLOps
CI/CD
Monitoring
Observability

Education

Bachelor's degree in Computer Science, Mathematics, Statistics, Physics, or related field

Tools

Git
APIs

Job description

Confidential Client (Banking) in New York, NY seeks an AI Engineer - Data Scientist I to design and build production-grade AI systems used across the business. This role sits at the intersection of AI research, software engineering, and product development, translating Generative AI and ML techniques into scalable solutions.

You’ll own AI systems end-to-end—from research and prototyping through deployment, evaluation, and monitoring—partnering with product, engineering, and business teams to

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer - Data Scientist
AI Engineer - Data Scientist

edkey • New York (NY)

On-site
USD 107,000 - 193,000
AI Engineer for GenAI & Production ML Systems
AI Engineer for GenAI & Production ML Systems

Bank of America • Charlotte (NC)

Hybrid
USD 120,000 - 150,000
AI Production Systems Engineer
AI Production Systems Engineer

Responsedga Technology And Marketing Inc. • New York (NY)

On-site
USD 100,000 - 150,000
AI Engineer for Production ML/LLM Systems (Finance)
AI Engineer for Production ML/LLM Systems (Finance)

Goldman Sachs Group, Inc. (old) • Dallas (TX)

On-site
USD 140,000 - 190,000
Applied AI Engineer — Production ML & LLMs (Hybrid NYC)
Applied AI Engineer — Production ML & LLMs (Hybrid NYC)

Logicbroker • New York (NY)

Hybrid
USD 102,000 - 138,000
AI Engineer: Generative AI & Production Systems
AI Engineer: Generative AI & Production Systems

NBMBAA • New York (NY)

On-site
USD 107,000 - 193,000
Staff Generative AI Engineer: Production-Ready LLMs & Agents
Staff Generative AI Engineer: Production-Ready LLMs & Agents

Citi • New York (NY)

Hybrid
USD 142,000 - 213,000
Health benefits
401(k)
Gen AI Engineer – Production ML & LLM Solutions
Gen AI Engineer – Production ML & LLM Solutions

Infosys Limited • Austin (TX)

Hybrid
USD 73,000 - 122,000
Disability insurance
Health & Dependent Care Accounts
Insurance (various)
+1
AI Engineer - Generative AI & Production ML
AI Engineer - Generative AI & Production ML

HITEC • Charlotte (NC)

On-site
USD 107,000 - 193,000
Lead AI Engineer & Data Platform Builder - Equity
Lead AI Engineer & Data Platform Builder - Equity

Avacend Inc • New York (NY)

Hybrid
USD 180,000 - 240,000