Software Enginner- Applied AI

HSAD North America; Englewood Cliffs (NJ); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading AI solutions firm is seeking an Applied AI Engineer in Englewood Cliffs, New Jersey. The role focuses on building production-level LLM applications and implementing AI solutions. Candidates should have a software engineering background with a strong emphasis on Python and API development. Responsibilities include optimizing RAG systems, creating APIs, and deploying applications on AWS. Experience with eCommerce is preferred, highlighting a dynamic work environment with cutting-edge technologies.

Qualifications

• 3-5 years experience in software engineering.
• Production experience with RAG systems required.
• Agile/DevOps practices familiarity.

Responsibilities

• Build production LLM applications using FastAPI/Spring Boot.
• Implement and optimize RAG systems.
• Create REST/GraphQL APIs for integration.

Skills

Python

API development

RAG Implementation

Agile/DevOps

Tools

FastAPI

Flask

Django

GitHub Copilot

AWS Bedrock

Job description

We are seeking an Applied AI Engineer with a strong software engineering background to join our AI initiative team, focusing on building production LLM applications and implementing cutting‑edge AI solutions. This role requires hands‑on coding expertise across full‑stack development with emphasis on LLM/RAG systems.

Key Responsibilities

• Build production LLM applications using FastAPI/Spring Boot backends with React/Next.js frontends
• Implement and optimize RAG systems with vector databases (Pinecone, Weaviate, OpenSearch)
• Create REST/GraphQL APIs for AI services integration
• Deploy containerized AI applications on AWS (ECS/EKS, Lambda)
• Assess and evaluate AI tools, making strategic build vs. buy recommendations
• Implement caching, rate limiting, and guardrails for LLM APIs

Required Technical Skills

Programming Languages & Frameworks

• Python: FastAPI, Flask, Django (3+ years required)
• Strong API development and microservices architecture

AI/ML Frameworks & Tools (Required)

• RAG Implementation: MUST HAVE - Production experience with RAG pipelines
• LangChain/LlamaIndex: Building AI applications and chains
• Embedding Models: OpenAI, Cohere, Sentence Transformers
• Data Science: Foundation knowledge

Development Tools (Required)

• GitHub Copilot/CodeWhisperer: AI productivity tools
• AWS Bedrock: Managed foundation models
• Prompt Engineering: Advanced prompt design and optimization
• AI Guardrails: Safety and content filtering mechanisms
• Additional: Lambda, ECS/EKS, API Gateway, S3, DynamoDB

Experience Requirements

• 3-5 years in software engineering
• eCommerce experience strongly preferred (product search, chatbots, personalization)
• Agile/DevOps practices

What You'll Work On

• eCommerce AI features: conversational commerce, semantic search, content generation
• API-first AI microservices following best practices
• POCs demonstrating AI capabilities and ROI
• Technical documentation and implementation guide