Sr. AI/ML Engineer (5 years)

MarsDevs; Pune District; On-site; INR 1,200,000 - 1,500,000; Full time

Job summary

A leading software development company in India is seeking a Mid-Senior level AI engineer to design and implement cutting-edge LLM applications. The role requires expertise in Python, LangChain, and RAG architectures. The ideal candidate will translate business needs into AI solutions, optimizing cost and performance. Strong communication skills and the ability to collaborate with product teams are essential. This full-time position offers an exciting opportunity to shape innovative AI systems.

Qualifications

• Strong problem-solving mindset.
• Clear verbal and written communication.
• Ability to explain complex systems to non-technical stakeholders.
• Ownership and accountability.

Responsibilities

• Design and implement production-grade LLM applications.
• Build and scale Retrieval Augmented Generation (RAG) systems.
• Optimize AI systems for cost, latency, and accuracy.
• Translate business requirements into technical AI solutions.
• Collaborate with Product Managers, Engineers, and Clients.

Skills

Python (advanced)

LangChain

LangGraph

NLP systems and production AI pipelines

RAG architectures

Vector databases (design, scaling, optimization)

Hybrid search (BM25 + vectors)

Agentic AI design

Prompt engineering (advanced)

GPU basics

Model fine-tuning concepts

SQL

Pandas / Polars

Job description

1 day ago Be among the first 25 applicants

Direct message the job poster from MarsDevs

Ending Tech Bottlenecks, Missed Deadlines & Unscalable Builds | We Fix Broken MVPs, Scaling Failures & Delivery Chaos | Turning Failing Products into…

Company Description

MarsDevs specializes in turning ambitious ideas from startups and SMBs into world-class software solutions. As a strategic technology partner, MarsDevs combines product strategy, innovative engineering, and design thinking to deliver scalable digital products. With a focus on custom web and mobile app development, AI solutions, blockchain integrations, and workflow automation, the company helps businesses across industries thrive. Leveraging an agile approach and expertise in modern technologies, MarsDevs has partnered with over 100 startups and SMBs across the Middle East, Europe, and India to build secure and scalable products.

Key Responsibilities

AI & LLM System Development

• Design and implement production-grade LLM applications
• Build and scale Retrieval Augmented Generation (RAG) systems
• Implement tool / function calling, structured outputs, and guardrails
• Develop hybrid retrieval systems (BM25 + vector search)
• Build cross-LLM architectures supporting multiple model providers
• Optimize AI systems for cost, latency, and accuracy

Agentic AI Systems

• Design and implement agent-based architectures
• Understand and apply:
  • Agent planning vs reactive agents
  • Tool execution and retry strategies
  • State management in agents
  • Multi-agent coordination
  • Failure detection and recovery mechanisms
• Use frameworks such as LangChain and LangGraph effectively

Data & Infrastructure

• Work with vector databases and scale them efficiently
• Build and maintain data pipelines for AI systems
• Handle large datasets using Pandas / Polars
• Implement data cleaning and preprocessing workflows
• Apply SQL fundamentals for data querying and analysis
• Design inference pipelines for batch and streaming workloads

Model & Performance Optimization

• Apply prompt engineering techniques in depth
• Understand GPU fundamentals (memory, compute, inference constraints)
• Work with model fine-tuning concepts and evaluate when fine-tuning is needed
• Implement AI cost optimization strategies (model selection, token optimization, caching, architecture decisions)

Product & Collaboration

• Translate business requirements into technical AI solutions
• Clearly communicate trade-offs between cost, accuracy, latency, and complexity
• Know when AI is not the right solution and propose alternatives
• Collaborate with Product Managers, Engineers, and Clients
• Write clear and maintainable technical documentation

Required Skills

Technical

• Python (advanced)
• LangChain, LangGraph
• NLP systems and production AI pipelines
• RAG architectures
• Vector databases (design, scaling, optimization)
• Hybrid search (BM25 + vectors)
• Agentic AI design
• Prompt engineering (advanced)
• GPU basicsModel fine-tuning concepts
• SQLPandas / Polars

Soft Skills

• Strong problem-solving mindset
• Clear verbal and written communication
• Ability to explain complex systems to non-technical stakeholders
• Ownership and accountability

Nice to Have

• Experience deploying AI systems on cloud platforms
• Exposure to MLOps / LLMOps practices
• Experience working with startups or fast-paced environments
• Prior client-facing experience
• eoffs (cost vs accuracy)
• Writes documentation
• Can work with PMs & clients

Seniority Level

Mid-Senior level

Employment Type

Full-time

Job Function

Engineering and Information Technology

Industries

Software Development

Referrals increase your chances of interviewing at MarsDevs by 2x

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.