AI Engineer

Salt; New York (NY); Hybrid; USD 170,000 - 220,000; Full time

Benefits offered by this job

Annual bonus

Healthcare

Hybrid work environment

Training budget

Career progression

Job summary

Salt is seeking an experienced AI Engineer in New York for building production-ready AI and Generative AI solutions. You will design, develop and deploy AI-powered applications with LLMs, RAG, and secure cloud deployments.

Collaborate with engineers, data scientists and product teams to deliver scalable AI features into production. The role focuses on AI orchestration, prompt tuning, data pipelines, and integration with enterprise APIs, using Azure or AWS, Kubernetes, and modern ML tooling.

Qualifications

• Proficient in Python and ML workflows.

Responsibilities

• Design and develop AI-powered applications using Large Language Models (LLMs).
• Build and maintain Retrieval-Augmented Generation (RAG) solutions.
• Integrate AI models into enterprise applications and APIs.
• Develop intelligent AI agents and workflow automation solutions.
• Optimise prompts, model performance and response quality.
• Build scalable data pipelines to support AI applications.
• Deploy AI workloads using Azure or AWS cloud services.
• Work closely with cross-functional teams to deliver AI features into production.
• Evaluate emerging AI technologies and recommend improvements.
• Ensure AI solutions meet security, governance and compliance requirements.

Skills

Python

LLMs

RAG

LangChain

Vector DBs

SQL

REST APIs

Docker/Kubernetes

CI/CD

Stakeholder comms

Tools

Docker

Kubernetes

Azure

AWS

LangGraph

Job description

AI Engineer

Location: New York (Hybrid)

Type: Permanent

Salary: $170,000 - $220,000 + Bonus + Benefits

We're working with a fast-growing technology business that's investing heavily in Artificial Intelligence to transform the way it delivers products and services. As part of this growth, we're looking for an experienced AI Engineer to join a high-performing engineering team building production-ready AI and Generative AI solutions.

This is an opportunity to work on cutting-edge AI initiatives, developing intelligent applications powered by Large Language Models (LLMs), machine learning and modern cloud technologies.

The Role

As an AI Engineer, you'll design, build and deploy AI-powered applications that solve real business problems. You'll collaborate with software engineers, data scientists and product teams to create scalable AI solutions that are secure, reliable and production-ready.

Key Responsibilities

• Design and develop AI-powered applications using Large Language Models (LLMs).
• Build and maintain Retrieval-Augmented Generation (RAG) solutions.
• Integrate AI models into enterprise applications and APIs.
• Develop intelligent AI agents and workflow automation solutions.
• Optimise prompts, model performance and response quality.
• Build scalable data pipelines to support AI applications.
• Deploy AI workloads using Azure or AWS cloud services.
• Work closely with cross-functional teams to deliver AI features into production.
• Evaluate emerging AI technologies and recommend improvements.
• Ensure AI solutions meet security, governance and compliance requirements.

Required Skills

• Strong commercial experience developing AI or Machine Learning solutions.
• Excellent Python development skills.
• Experience working with Large Language Models (OpenAI, Azure OpenAI, Anthropic or similar).
• Experience building RAG applications.
• Knowledge of LangChain, LangGraph or similar AI orchestration frameworks.
• Experience with vector databases such as Pinecone, Weaviate, Chroma or pgvector.
• Strong SQL and data engineering fundamentals.
• Experience building REST APIs.
• Experience with Docker and Kubernetes.
• Familiarity with CI/CD pipelines and Git.
• Strong communication and stakeholder engagement skills.

Nice to Have

• Azure AI Services or Azure OpenAI experience.
• Experience with Databricks, Spark or Microsoft Fabric.
• MLOps experience using MLflow, Azure ML or similar platforms.
• Experience with FastAPI.
• Knowledge of model fine-tuning and evaluation frameworks.
• Financial services, fintech or regulated industry experience.

Benefits

• Competitive salary with annual bonus.
• Comprehensive healthcare and retirement benefits.
• Hybrid working environment.
• Training and certification budget.
• Opportunity to work on innovative AI products using the latest technologies.
• Clear progression within a rapidly growing engineering team.