Senior AI Engineer: LLM & Generative AI Backend

TechWize; New York, Northern (NY, KY); Hybrid; USD 180,000 - 230,000; Full time

Job summary

TechWize is seeking a Senior AI Engineer to design and deploy scalable AI solutions leveraging LLMs, LangChain, and RAG pipelines. You will build production-grade Python microservices, integrate AI services, and ensure secure cloud deployments on AWS (GCP optional).

Role emphasizes AI backend development, API design (REST/GraphQL), and collaboration with front-end teams to create chat interfaces, copilots, and dashboards. 4–8 years in software/AI engineering with 2+ years in LLMs is typical.

Qualifications

• Solid working experience with Python for AI service development, API integration, and data processing.
• Hands-on experience with LangChain, RAG pipelines, or similar frameworks.
• Familiarity with LLM integration, prompt design, and embedding-based retrieval.
• Experience deploying on AWS (preferred) or GCP, especially with EKS, ECS, or Cloud Run.
• Proficiency with Docker, Kubernetes, and cloud-native service orchestration.
• Experience building RESTful or GraphQL APIs for AI and data services.
• Understanding of cloud security, scalability, and performance optimization.

Responsibilities

• AI Solution Development: Build and maintain production-grade AI systems using LLMs, LangChain, and RAG pipelines to solve enterprise-scale problems.
• Model Integration: Implement, fine-tune, and evaluate LLMs using frameworks such as LangChain, LlamaIndex, Hugging Face, or OpenAI API.
• Backend & API Engineering: Develop scalable Python microservices and APIs for inference and knowledge retrieval.
• Deploy and operate services on AWS (preferred) or GCP using EKS, ECS, or Cloud Run.
• Implement observability, monitoring, and autoscaling for production workloads.
• Retrieval-Augmented Generation (RAG): Design and optimize retrieval workflows using vector databases like FAISS, Pinecone, or Milvus.
• Front-End Integration: Collaborate with UI teams to integrate AI experiences into dashboards or chat UIs using React, Next.js, or TypeScript.
• Cloud & DevOps: Containerize and deploy using Docker and Kubernetes.
• CI/CD pipelines with tools like Jenkins, GitHub Actions, or Terraform.
• Cross-Functional Collaboration: Work closely with product, data science, and platform teams to deliver robust, secure, and impactful AI services.
• Continuous Innovation: Stay current with LLM, RAG, and multi-agent system advancements and drive their adoption across products.

Skills

Python

LangChain

RAG pipelines

LLM integration

Cloud deployment (AWS)

Docker

Kubernetes

APIs: REST/GraphQL

Cloud security

Education

Bachelor's or Master's in CS/Engineering

4–8 years in software/AI engineering

Tools

EKS

Cloud Run

Terraform

CI/CD tooling

Job description

TechWize is seeking a Senior AI Engineer to design and deploy scalable AI solutions leveraging LLMs, LangChain, and RAG pipelines. You will build production-grade Python microservices, integrate AI services, and ensure secure cloud deployments on AWS (GCP optional).

Role emphasizes AI backend development, API design (REST/GraphQL), and collaboration with front-end teams to create chat interfaces, copilots, and dashboards. 4–8 years in software/AI engineering with 2+ years in LLMs is typical.