Senior Staff Engineer, Generative AI

SmartRecruiters, Inc.; United States; Remote; USD 140,000 - 200,000; Full time

Job summary

SmartRecruiters, Inc. is seeking a senior GenAI/Agentic AI engineer to architect and implement scalable AI solutions for enterprise workloads.

You will translate business needs into technical designs and production-ready Python code, collaborating across product and engineering teams. The role requires 8+ years of experience with transformers, RAG, vector databases, and cloud deployments on Azure or AWS, plus strong Python and API skills (FastAPI, ORM).

Qualifications

• 8+ years of experience in AI/GenAI and production deployments.
• Deep understanding of LLMs and Transformer architectures.
• Expert-level prompt engineering with RAG patterns.
• Strong Python and ML library proficiency (LangChain, PyTorch, Transformers).
• Experience deploying GenAI on Azure or AWS and producing enterprise-grade APIs.
• Familiarity with vector databases (Weaviate, Neo4j).
• Ability to write production-grade, well-tested Python code.
• Experience with FastAPI and ORMs (SQLAlchemy/Tortoise).
• Knowledge of evaluation metrics and GenAI safety considerations.
• Contributions to open-source GenAI projects are a plus.

Responsibilities

• Understand client business needs and translate them into technical design.
• Architect and implement scalable GenAI/Agentic AI solutions end-to-end.
• Design guidelines and benchmarks for non-functional requirements.
• Review architecture for extensibility, security, and performance.
• Develop and document the overall solution with chosen tech stack.
• Prototype (POCs) to validate designs and technologies.
• Collaborate with product and engineering teams to translate requirements into implementation.
• Produce production-ready code with strong testing practices.

Skills

LLMs

Prompt engineering

RAG patterns

Python

LangChain

LlamaIndex

LangGraph

LangSmith

Transformers

PyTorch/TensorFlow

AzureML/AWS

Vector databases

Weaviate

Neo4j

APIs (FastAPI)

ORMs (SQLAlchemy, etc.)

MCP

Open-source contributions

React/JS basics

Communication

Education

Bachelor’s or Master’s degree in computer science, Information Technology, or a related field

Tools

LangChain

LlamaIndex

LangGraph

LangSmith

Hugging Face Transformers

Scikit-learn

PyTorch

TensorFlow

Azure ML

AWS

Weaviate

Neo4j

FastAPI

SQLAlchemy

Tortoise ORM

MCP

Open-source GenAI

Job description

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 40 countries, to be exact). Our work culture is dynamic and non-hierarchical. We're looking for great new colleagues. That's where you come in!

Job Description

Requirements

• Total experience 8+ years.
• Deep understanding of LLMs (e.g., GPTs, Llama, Claude, Gemini, Qwen, Mistral, BERT-family models) and their architectures (Transformers)
• Should have expert-level prompt engineering skills and proven experience implementing RAG patterns
• High proficiency in Python and standard AI/ML libraries (e.g., LangChain, LlamaIndex, LangGraph, LangSmith, Hugging Face Transformers, Scikit-learn, PyTorch/TensorFlow).
• Experience implementing RAG architectures and prompt engineering.
• Strong experience with fine-tuning and distillation techniques and evaluation.
• Strong experience using managed AI/ML services on the target cloud platform (e.g., Azure Machine Learning Studio, AI Foundry).
• Strong understanding of vector databases (e.g., Weaviate, Neo4j)
• understanding of GenAI evaluation metrics (e.g., BLEU, ROUGE, perplexity, semantic similarity, human evaluation).
• Architect and implement scalable GenAI and Agentic AI solutions end-to-end.
• Should be able to write high-quality, production-ready Python code with strong testing and maintainability practices.
• Should be able to productionize AI systems on Azure or AWS, ensuring enterprise-grade reliability and performance.
• Should be able to build and expose APIs using FastAPI, integrating with databases through an ORM.
• Should be able to scale GenAI solutions to support enterprise workloads.
• Collaborate across product and engineering teams to convert business needs into AI-driven solutions.
• Strong ability to both architect and code GenAI/Agentic AI solutions.
• Proven production experience with GenAI deployments on Azure or AWS.
• Strong experience in scaling AI solutions in live environments.
• Very strong Python programming skills with a track record of clean, efficient, and maintainable code.
• Should have successfully delivered at least one production GenAI/Agentic AI solution.
• Must have proficiency with FastAPI and at least one ORM (e.g., SQLAlchemy, Tortoise ORM).
• Should have familiarity with Model Context Protocol (MCP).
• Should have contributions to open-source GenAI projects.
• Good to have experience with React (or some other JS frameworks) for building user-facing interfaces and front-end integrations
• Excellent communication skills and the ability to collaborate effectively with cross-functional teams.

Responsibilities

• Understanding the client’s business use cases and technical requirements and be able to convert them into technical design which elegantly meets the requirements.
• Mapping decisions with requirements and be able to translate the same to developers.
• Identifying different solutions and being able to narrow down the best option that meets the clients’ requirements.
• Defining guidelines and benchmarks for NFR considerations during project implementation.
• Writing and reviewing design document explaining overall architecture, framework, and high-level design of the application for the developers.
• Reviewing architecture and design on various aspects like extensibility, scalability, security, design patterns, user experience, NFRs, etc., and ensure that all relevant best practices are followed.
• Developing and designing the overall solution for defined functional and non-functional requirements; and defining technologies, patterns, and frameworks to materialize it.
• Understanding and relating technology integration scenarios and applying these learnings in projects.
• Resolving issues that are raised during code/review, through exhaustive systematic analysis of the root cause, and being able to justify the decision taken.
• Carrying out POCs to make sure that suggested design/technologies meet the requirements.

Qualifications

Bachelor’s or master’s degree in computer science, Information Technology, or a related field.