Software Development Engineer - AI/ML

Aimlroles; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Volga Partners is seeking a Software Development Engineer with strong Python backend systems expertise and AI/LLM experience for a fully remote role. You will build production-grade AI-powered systems, integrating large language models into real-world workflows across backend services, orchestration layers, and data pipelines.

This hands-on position requires problem-solving, system design skills, and the ability to operate in fast-evolving AI environments, collaborating with cross-functional

Qualifications

• Bachelor's degree in Computer Science or related field.
• 3+ years of backend or systems engineering experience.
• Experience integrating LLM APIs or AI-driven services.
• Strong Python development experience for production systems.

Responsibilities

• Build and maintain backend services and internal tools in Python for AI-powered applications.
• Integrate LLM APIs into production workflows, including prompt handling, response processing, validation, and retries.
• Design scalable REST APIs, async workflows, and background job systems.
• Maintain components of a multi-language codebase (C#/C++, Python, web technologies) where applicable.
• Work with structured and unstructured data to prepare inputs, transform outputs, and support downstream systems.
• Develop systems for prompt management, model routing, response validation, and failure handling.
• Debug complex issues across backend logic, API integrations, and distributed services.
• Monitor system performance using telemetry tools and proactively identify and resolve bottlenecks.
• Automate recurring workflows related to data processing, evaluation, and reporting.
• Collaborate with cross-functional teams to turn ambiguous product ideas into production-ready features.
• Contribute to architecture decisions around scalability, performance, and safe use of AI systems.
• Write clean, testable, and maintainable code while helping establish engineering best practices for AI systems.

Skills

Python development

Backend system design

API development

Async workflows

LLM / AI integration

Docker

Azure/AWS

Education

Bachelor's degree in Computer Science

Tools

Azure DevOps

Git

Docker

Terraform

SQL Server

Elastic Stack

Postman

Swagger

AWS

Azure

Job description

Company: Volga Partners
Location: Fully Remote (Occasional office visits 1–2 times per year)
Compensation: ₹19–₹24 LPA (based on experience)
Job Type: Full-time, Project-Based
Start Date: Urgently hiring — must be available to start within 1–2 weeks
Work Hours: 8:00 AM – 5:00 PM IST or 9:00 AM – 6:00 PM IST
(Collaboration with USA Pacific Time teams)

About the Role

Volga Partners is looking for a skilled Software Development Engineer with strongexpertisein Python backend systems and AI/LLM applications.

In this role, you will build andmaintainproduction-grade AI-powered systems, integrating large language models into real-world workflows. You will work across backend services, orchestration layers, and data pipelines—ensuring that AI features are reliable, scalable, and performant.

This is a hands-on engineering role requiring strong problem-solving, system design, and the ability tooperatein fast-evolving AI environments.

Key Responsibilities

• Build andmaintainbackend services and internal tools in Python for AI-powered applications.

• Integrate LLM APIs into production workflows, including prompt handling, response processing, validation, and retries.

• Design and implement scalable REST APIs, async workflows, and background job systems.

• Maintain and enhance components of a multi-language codebase (C#/C++, Python, web technologies) where applicable.

• Work with structured and unstructured data to prepare inputs, transform outputs, and support downstream systems.

• Develop systems for prompt management, model routing, response validation, and failure handling.

• Debug complex issues across backend logic, API integrations, and distributed services.

• Monitor system performance using telemetry tools and proactivelyidentifyand resolve bottlenecks.

• Automate recurring workflows related to data processing, evaluation, and reporting.

• Collaborate with cross-functional teams to turn ambiguous product ideas into production-ready features.

• Contribute to architecture decisions around scalability, performance, and safe use of AI systems.

• Write clean, testable, and maintainable code while helpingestablishengineering best practices for AI systems.

What You Bring

Education

• Bachelor’s degree in Computer Scienceor a related field.

Experience

• 3+ years of professional experience in backend or systems engineering.

• Strong experience in Python development for production systems.

• Experience integrating LLM APIs or AI-driven services into real applications.

• Proven ability to work within large codebases and collaborative environments.

Technical Skillset

Core Skills

• Python (strong), backend system design, API development

• Async workflows, job queues, and service orchestration

• Debugging across APIs, services, and data pipelines

Languages

• Python, C#, C/C++, JavaScript/TypeScript, SQL

Frameworks & Libraries

• .NET Web API, ASP.NET (MVC &WebForms), Entity Framework

• React, Bootstrap, Ajax

• Testing frameworks (xUnitor similar)

AI / LLM Systems

• Prompt design, response parsing, and guardrails

• Model integration patterns and failure handling

• Understanding of LLM limitations and production constraints

Tools & Platforms

• Azure DevOps, Git, Docker, Terraform

• SQL Server or similar databases

• Elastic Stack, Postman, Swagger

• AWS or Azure cloud environments

Architecture

• Microservices, distributed systems, modular architectures

Operating Systems

• Windows, Linux

Build Tools

• Make, Ninja (preferred)

Nice to Have

• Experience with RAG, embeddings, vector databases, or retrieval systems

• Familiarity with agent workflows or multi-step orchestration

• Experience with model monitoring, prompt versioning, or evaluation systems

• Understanding of AI safety, privacy, and secure data handling

• Exposure to cloud-native deployments and scalable infrastructure

Why Join Us

• Remote-first culture with minimal in-person requirements

• Work with global teams oncutting-edgeAI systems

• Opportunity to build real-world LLM applications at scale

• High ownership, fast-moving environment withstrong growthpotential