Senior Staff Engineer, Generative AI

Jobgether SRL; India; On-site; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Enterprise-scale GenAI

Hands-on senior role

Azure & AWS exposure

Snowflake Cortex AI exposure

Open-source GenAI contributions

Job summary

Jobgether SRL in India seeks a Senior Staff Engineer to architect, build, and scale enterprise-grade Generative AI and Agentic AI solutions. You will work across Azure and AWS, implement RAG, prompt engineering, and model evaluation, while remaining hands-on with Python development.

The role combines architecture, coding, reviews, and POC work to deliver reliable AI systems for enterprise workloads. Strong collaboration with product and engineering is essential.

Qualifications

• 8+ years of software/AI experience, data science or related field.
• Deep understanding of LLMs and transformer architectures.
• Hands-on production GenAI/Agentic AI development experience.
• Strong Python and ML library proficiency (PyTorch, TensorFlow).
• Experience deploying on Azure/AWS with RAG and evaluation metrics.

Responsibilities

• Architect end-to-end GenAI and Agentic AI solutions.
• Design RAG architectures and prompt engineering strategies.
• Develop production-grade Python code and FastAPI APIs.
• Evaluate approaches for scalability, security, and reliability.
• Lead proofs of concept and collaborate with cross-functional teams.

Skills

LLMs

Prompt engineering

Python

LangChain

PyTorch

TensorFlow

Model evaluation

RAG architectures

Agentic AI

Production ML

Education

Bachelor's or Master’s degree in Computer Science or related field

Tools

Weaviate

Neo4j

Snowflake Cortex AI

Azure ML / AWS

FastAPI

ORM (SQLAlchemy etc.)

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Staff Engineer, Generative AI based in India.

This senior technical role focuses on architecting, building, and scaling enterprise-grade Generative AI and Agentic AI solutions. You will combine deep expertise in LLMs, RAG, prompt engineering, model evaluation, and AI/ML engineering with hands‑on production development. The role requires the ability to translate complex client requirements into scalable technical architectures, design decisions, and production‑ready implementations. You will work across Azure and AWS environments, leveraging modern AI services, vector databases, APIs, and AI frameworks. Beyond architecture, you will remain deeply involved in coding, technical reviews, proof‑of‑concepts, and resolving complex engineering challenges. You will collaborate closely with product, engineering, developers, and other stakeholders to deliver reliable AI solutions capable of supporting enterprise workloads.

Accountabilities

• Understand client business use cases and technical requirements and translate them into scalable, practical technical designs.
• Architect and implement end‑to‑end Generative AI and Agentic AI solutions aligned with functional and non‑functional requirements.
• Design and implement RAG architectures, prompt engineering solutions, LLM applications, and AI agents for enterprise use cases.
• Evaluate alternative technical approaches and identify solutions that best address client requirements, scalability, security, maintainability, and performance considerations.
• Define technical guidelines, architecture standards, and benchmarks for non‑functional requirements throughout project implementation.
• Create and review architecture, framework, and high‑level design documentation to provide clear implementation guidance to development teams.
• Review solutions across extensibility, scalability, security, design patterns, user experience, performance, and other non‑functional requirements.
• Select appropriate technologies, frameworks, design patterns, AI services, and infrastructure to deliver robust solutions.
• Develop high‑quality, production‑ready Python code and remain hands‑on throughout solution implementation.
• Build and expose APIs using FastAPI and integrate AI applications with databases through ORM‑based approaches.
• Productionize and scale AI systems on Azure or AWS, ensuring enterprise‑grade reliability, performance, security, and maintainability.
• Implement and evaluate RAG, LLM, fine‑tuning, distillation, and model evaluation approaches.
• Conduct proofs of concept to validate proposed architectures, technologies, and approaches before implementation.
• Analyze and resolve complex technical issues through systematic root‑cause analysis and clearly communicate the rationale behind architectural and implementation decisions.
• Translate architecture and design decisions into actionable guidance for developers and engineering teams.
• Collaborate with product and engineering stakeholders to convert business requirements into AI‑driven solutions.
• Establish scalable approaches capable of supporting enterprise GenAI workloads and live production environments.
• Contribute to the adoption of emerging AI technologies and practices, including Model Context Protocol (MCP) and open‑source GenAI initiatives.

Requirements

• 8+ years of total professional experience in software engineering, AI/ML, data science, or closely related technical disciplines.
• Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
• Deep understanding of LLMs and Transformer‑based architectures, including models such as GPT, Llama, Claude, Gemini, Qwen, Mistral, and BERT‑family models.
• Expert‑level prompt engineering skills and strong hands‑on experience implementing RAG patterns.
• Strong proficiency in Python and AI/ML technologies and libraries such as LangChain, LlamaIndex, LangGraph, LangSmith, Hugging Face Transformers, Scikit‑learn, PyTorch, and TensorFlow.
• Strong experience with fine‑tuning, model distillation, model evaluation, and production ML development.
• Strong knowledge of Python, SQL, Pandas, SciPy, and Scikit‑learn, with experience in ML model development, validation, deployment, and tuning.
• Hands‑on experience implementing anomaly‑detection solutions.
• Experience with Snowflake Data Cloud and Snowflake Cortex AI.
• Strong experience with managed AI/ML services on cloud platforms such as Azure Machine Learning Studio or AI Foundry.
• Strong understanding of vector databases and retrieval technologies, including platforms such as Weaviate and Neo4j.
• Knowledge of GenAI evaluation metrics and methodologies, including BLEU, ROUGE, perplexity, semantic similarity, and human evaluation.
• Proven experience architecting and coding scalable GenAI and Agentic AI solutions rather than working solely in an advisory or architecture capacity.
• Ability to write high‑quality, production‑ready Python with strong testing, maintainability, and engineering practices.
• Proven experience productionizing AI systems on Azure or AWS and scaling AI solutions in live enterprise environments.
• Experience building and exposing APIs with FastAPI and integrating applications with databases using ORM technologies.
• Demonstrated delivery of at least one production Generative AI or Agentic AI solution.
• Familiarity with Model Context Protocol (MCP) is required.
• Contributions to open‑source Generative AI projects are an asset.
• Strong architectural thinking, problem‑solving, analytical, and root‑cause analysis skills.
• Excellent communication skills and the ability to collaborate effectively across product, engineering, development, and client‑facing teams.

Benefits

• Opportunity to work on enterprise‑scale Generative AI and Agentic AI solutions.
• Hands‑on senior technical role combining architecture, software engineering, and AI/ML development.
• Exposure to leading LLM technologies, RAG architectures, AI agents, model evaluation, and modern AI frameworks.
• Opportunity to work across Azure and AWS cloud environments and enterprise AI/ML services.
• Exposure to Snowflake Data Cloud and Snowflake Cortex AI.
• Opportunity to contribute to proofs of concept, architectural standards, technical strategy, and production AI implementations.
• Collaborative environment involving product, engineering, developers, and client stakeholders.
• Opportunity to work with emerging technologies such as MCP and contribute to open‑source GenAI initiatives.
• Full‑time opportunity based in India.