Senior Associate - AI ML Engineer

Riveron

United States

On-site

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Riveron is seeking an AI/ML Engineer with 3-5 years of hands-on experience building and deploying Generative AI applications. You will contribute across the lifecycle—from data prep to API development, evaluation, deployment, monitoring, and continuous improvement.

The role emphasizes RAG, agent workflows, foundation model integration, prompt engineering, and production services using Python, REST APIs, Docker, and cloud platforms.

Qualifications

  • Advanced degree or equivalent practical experience in CS/AI/Engineering.
  • 3-5 years of professional software/ML development with Generative AI.
  • Strong Python and ML libraries (NumPy, pandas, scikit-learn, PyTorch, TensorFlow).
  • Knowledge of LLM patterns: prompting, embeddings, RAG, vector stores, tool calls, structured outputs, agent workflows.
  • Experience building REST APIs and integrating databases/systems.
  • Software engineering practices: testing, logging, reviews, debugging.
  • Git/GitHub and CI/CD; automated build/test/deploy.
  • Cloud platforms (AWS/Azure/GCP) and Docker; Kubernetes beneficial.
  • Certification in AWS AI/ML or Azure AI is mandatory.

Responsibilities

  • Build end-to-end AI/ML and Generative AI apps including pipelines, APIs, and monitoring.
  • Design RAG solutions with ingestion, embeddings, vector search, and citations.
  • Develop agentic AI workflows with tools, memory, guardrails, and human-in-the-loop approvals.
  • Integrate foundation models; select models by quality, latency, cost, privacy, and deployment constraints.
  • Implement prompt engineering, few-shot patterns, and structured outputs.
  • Create production services using Python, REST APIs, asynchronous processing, and well-defined interfaces.
  • Use Git and GitHub for version control, PRs, reviews, and CI/CD workflows.
  • Containerize and deploy apps with Docker; contribute to Kubernetes-based deployments.

Skills

Python
Pandas
NumPy
Scikit-learn
PyTorch
TensorFlow
LLM patterns
Prompting
Embeddings
RAG
Vector databases
Agent workflows
REST APIs
JSON/Schemas
Databases
Unit testing
Logging
Code review
Git/GitHub
CI/CD
AWS
Azure
GCP
Docker
Kubernetes
MLflow
Experiment tracking
Model versioning
Observability

Education

Bachelor’s or Master’s in CS/DI/AI/Engineering or equivalent
AWS AI/ML certification

Tools

OpenAI Agents SDK
LangChain
Semantic Kernel
LlamaIndex
AutoGen
Pinecone
Weaviate
Milvus
Elasticsearch/OpenSearch
Azure AI Search
MLflow

Job description

Role Overview

We are seeking an AI/ML Engineer with 3-5 years of hands‑on experience building and deploying machine learning and Generative AI applications. You will contribute across the product lifecycle-from data preparation and experimentation to API development, evaluation, deployment, monitoring, and continuous improvement. The ideal candidate combines practical AI/ML knowledge with strong software‑engineering discipline and a demonstrated ability to build reliable enterprise‑grade solutions across multiple industries.

What You Will Do

Build and maintain end‑to‑end AI/ML and Generative AI applications, including data pipelines, model or prompt workflows, APIs, evaluation, deployment, and monitoring.

Design Retrieval‑Augmented Generation (RAG) solutions using document ingestion, chunking, embeddings, vector search, reranking, citations, and access‑aware retrieval.

Develop agentic AI workflows that use tools, structured outputs, state or memory, orchestration, guardrails, human‑in‑the‑loop approvals, and failure recovery.

Integrate foundation models and AI services from commercial and open‑source ecosystems; select models based on quality, latency, cost, privacy, and deployment constraints.

Implement prompt engineering, few‑shot patterns, function/tool calling, structured output validation, and‑where justified‑fine‑tuning or parameter‑efficient tuning.

Create reproducible evaluation pipelines for accuracy, relevance, groundedness, safety, latency, reliability, and cost; maintain regression or "golden" test datasets.

Develop production services using Python, REST APIs, asynchronous processing, and well‑defined interfaces; write clean, modular, documented, and testable code.

Use Git and GitHub for version control, pull requests, code review, issue tracking, and release management; implement CI/CD workflows with GitHub Actions or equivalent tools.

Containerize and deploy applications using Docker and cloud services; contribute to Kubernetes‑based deployments, autoscaling, secrets management, observability, and rollback strategies as needed.

Apply secure AI development practices, including privacy controls, prompt‑injection defenses, authorization checks, secrets handling, content safety, auditability, and responsible AI principles.

Collaborate with product managers, data scientists, software engineers, cloud/platform teams, and business stakeholders to translate requirements into measurable technical outcomes.

Create technical documentation, architecture notes, runbooks, and knowledge‑sharing materials; participate actively in design reviews, code reviews, and agile delivery ceremonies.

Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Data Science, Artificial Intelligence, Machine Learning, Engineering, or a related field-or equivalent practical experience.
  • 3-5 years of professional experience developing software, data, or machine learning solutions, including substantial hands‑on experience with Generative AI or LLM‑based applications.
  • Strong Python programming skills and practical experience with common data and ML libraries such as pandas, NumPy, scikit‑learn, PyTorch, TensorFlow, or equivalent.
  • Working knowledge of LLM application patterns such as prompting, embeddings, RAG, vector databases, tool/function calling, structured outputs, and agent workflows.
  • Experience building and consuming REST APIs, working with JSON and schemas, and integrating databases, enterprise systems, or external services.
  • Understanding of software‑engineering practices: object‑oriented or modular design, unit and integration testing, logging, error handling, code review, documentation, and debugging.
  • Hands‑on experience with Git/GitHub and CI/CD concepts; ability to create or maintain automated build, test, security‑scan, and deployment workflows.
  • Experience with at least one cloud platform (AWS, Azure, or GCP) and containerization using Docker; familiarity with Kubernetes is beneficial.
  • A current, role‑relevant AWS AI/ML certification or Microsoft Azure AI certification is mandatory.
  • Understanding of ML/LLM evaluation, experiment tracking, model or prompt versioning, observability, and production monitoring.
  • Strong analytical, communication, and collaboration skills, with the ability to explain technical trade‑offs to both technical and non‑technical audiences.
Preferred Experience
  • Experience with one or more GenAI/agent frameworks or SDKs, such as OpenAI Agents SDK, LangGraph/LangChain, Semantic Kernel, LlamaIndex, AutoGen, or similar.
  • Experience with vector stores or search platforms such as pgvector, Pinecone, Weaviate, Milvus, Elasticsearch/OpenSearch, Azure AI Search, or equivalent.
  • Exposure to LLMOps/MLOps tooling for experiment tracking, tracing, evaluation, model registry, prompt management, or monitoring (for example, MLflow or comparable platforms).
  • Knowledge of SQL and data modeling; exposure to streaming, queues, workflow orchestration, or distributed processing
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Gen. AI Engineer
Gen. AI Engineer

KALEIDOSCOPE Innovation • Fort Worth (TX)

On-site
USD 140,000 - 190,000
Generative AI Engineer
Generative AI Engineer

The Phoenix Group • New York (NY)

On-site
USD 130,000 - 170,000
AI Engineer – Generative AI & Agentic AI
AI Engineer – Generative AI & Agentic AI

KData Inc. • United States

On-site
USD 140,000 - 190,000
Gen. AI Engineer
Gen. AI Engineer

Kaleidoscope Innovation, Inc. • Fort Worth (TX)

On-site
USD 100,000 - 160,000
Principal Gen AI Scientist — Lead AI Agents & GenAI Apps
Principal Gen AI Scientist — Lead AI Agents & GenAI Apps

Compunnel Inc. • McLean (VA)

On-site
USD 190,000 - 260,000
AI/ML Engineer
AI/ML Engineer

RiskForce LLC • United States

On-site
USD 120,000 - 180,000
Senior AI Engineer - GenAI + Data Platform - AWS
Senior AI Engineer - GenAI + Data Platform - AWS

Compunnel Inc. • Los Angeles (CA)

On-site
USD 120,000 - 160,000
Applied ML and Generative AI Leader - Executive Director
Applied ML and Generative AI Leader - Executive Director

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 180,000 - 240,000
GenAI Engineer
GenAI Engineer

Capgemini • New York (NY)

On-site
USD 140,000 - 200,000
Architect - AI Infrastructure
Architect - AI Infrastructure

Fa Ewjt Saasfaprod1 • United States

Remote
USD 180,000 - 280,000