Remote Senior Python Backend Architect for AI & ML Platform

Intellectsoft; United States; Remote; USD 150,000 - 230,000; Full time

Benefits offered by this job

Awesome projects with impact

Udemy courses of your choice

Team-building events

Workshops and knowledge sharing

Clear career path

Flexible hours & remote setup

Job summary

Intellectsoft is seeking an experienced ML Engineer to join a fast-paced AI platform focused on analytics and decision support. The role emphasizes building scalable backend services, integrating LLMs, and delivering production-grade ML pipelines using Python, FastAPI, and modern MLOps tooling.

You will work with LangChain, LangGraph, and cloud AI services to deploy reliable AI features, while collaborating with teams to meet SLAs and ensure robust data protection and observability.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or a related field.
• 7+ years of strong Python coding experience.
• 2+ years hands-on with ML and production LLM systems.
• 3+ years building backend APIs with FastAPI, async patterns, rate limiting, SQLAlchemy.

Responsibilities

• Build, refine, and operate ML engineering platforms, APIs, and microservices using FastAPI.
• Implement MLOps: KPI measurement, drift detection, feedback loops.
• Deploy ML/Deep Learning models with focus on LLMs and GenAI.
• Integrate Azure OpenAI (GPT-4, GPT-4 Vision) and other LLMs with retry and error handling.
• Maintain up-to-date knowledge of leading technologies (LLMs, GenAI, transformers).
• Scale ML algorithms for massive data under strict SLAs.
• Create model pipelines with feature engineering, inference, and continuous training.
• Write production-grade Python and SQL, with async patterns and DI.

Skills

Python

FastAPI

Async programming

LangChain

LangGraph

LLMs

MLOps

NLP

Computer Vision

HuggingFace

LlamaIndex

SQL

Education

Bachelor’s or Master’s in CS or related

Tools

Azure OpenAI

Docker

Kubernetes

GitHub Actions

Langfuse

MLflow

Job description

Our customer's product is an AI-powered platform that helps businesses make better decisions and work more efficiently. It uses advanced analytics and machine learning to analyze large amounts of data and provide useful insights and predictions. The platform is widely used in various industries, including healthcare, to optimize processes, improve customer experiences, and support innovation. It integrates easily with existing systems, making it easier for teams to make quick, data-driven decisions to deliver cutting-edge solutions.

• Bachelor’s or Master’s degree in Computer Science or a related field.
• Strong Python coding skills - 7+ years.
• 2+ years of hands-on experience with machine learning and production LLM systems.
• Experience building backend APIs with FastAPI, async patterns, rate limiting, and SQLAlchemy - 3+ years.
• Experience designing maintainable and extensible systems using dependency injection, interfaces, and abstract base classes.
• Experience with vector databases such as Pinecone, Weaviate, or Chroma, as well as hybrid search.
• Strong understanding of RAG architectures, including retrieval, reranking, context assembly, and response generation.
• Hands-on experience with LangChain and LangGraph for building and orchestrating LLM workflows.
• Advanced Python skills, including async/await, type hints, Pydantic, and SOLID principles.
• MLOps experience with MLflow, model versioning, and A/B testing; experience with Langfuse is a plus.
• Experience in NLP and computer vision, including document understanding, OCR, and GPT-4 Vision.
• Experience building feature pipelines, real-time and batch inference systems, and model serving.
• Hands-on experience with Hugging Face is required; experience with LlamaIndex is a plus.
• Familiarity with database technologies such as SQL.
• Good problem-solving skills and the ability to work in a fast-paced, team-oriented environment.

Nice to have skills:

• Understanding of DevOps, CI / CD including: Docker containerization, Azure DevOps pipelines or GitHub Actions, Kubernetes (nice to have);
• Data security including: Multi-tenant data isolation, Secure key management (Azure Key Vault), Audit trail implementation;
• Experience in designing on cloud platform including: Azure (strongly preferred): Azure OpenAI, Blob Storage, Key Vault, Container Registry, AWS or GCP;
• Experience in data engineering in Big Data systems including: Large-scale data processing, ETL/ELT pipelines.
• Rate limiting and quota management for high-throughput API usage.
• Cost management and optimization for LLM usage at scale.
• Document processing expertise (PDF extraction, OCR tooling).
• Production incident management and on-call experience.
• Testing strategies for non-deterministic LLM outputs (e.g., golden datasets, fuzzy matching).
• Domain knowledge in regulated industries (e.g., healthcare/pharma workflows, regulatory compliance) is a plus.

Responsibilities:

• Build, refine, and use ML Engineering platforms and components; develop and implement scalable backend systems, APIs, and microservices using FastAPI.
• Implement MLOps including model KPI measurement, tracking, model drift detection, and model feedback loops.
• Deploy and operationalize ML and Deep Learning models, with a strong focus on LLMs and Generative AI.
• Integrate Azure OpenAI (GPT-4, GPT-4 Vision) and other LLM providers with proper retry logic and error handling.
• Maintain up-to-date knowledge of state-of-the-art technologies such as LLMs, GenAI, and transformer architectures.
• Scale machine learning algorithms to work on massive data sets under strict SLAs.
• Build and orchestrate model pipelines including feature engineering, inferencing, and continuous model training.
• Write backend application code in Python and SQL using strong object-oriented principles and asynchronous programming (asyncio, async/await).
• Implement dependency injection patterns and layered architecture (Service, Foundation, Orchestration, DAL).
• Build LLM observability (e.g., Langfuse) to track prompts, tokens, costs, and latency.
• Develop prompt management systems with versioning and fallback mechanisms.
• Implement Celery (or similar) workflows for asynchronous task processing and complex pipelines.
• Build multi-tenant architectures with client data isolation.
• Implement cost optimization strategies for LLM usage (prompt caching, batch processing, token optimization).
• Integrate third-party APIs and services (e.g., document/OCR services, cloud storage, enterprise systems).
• Collaborate with client-facing teams to understand business context and contribute to technical requirement gathering.
• Write production-ready code that is testable, maintainable, and accounts for edge cases and errors.
• Ensure high quality of deliverables by following architecture/design guidelines, coding best practices, and periodic design/code reviews.
• Write unit tests and higher-level tests to handle expected edge cases and errors gracefully.
• Troubleshoot backend application code using structured logging and distributed tracing.
• Use bug tracking, code review, version control, and other tools to organize and deliver work.
• Participate in scrum calls and agile ceremonies, communicating progress, issues, and dependencies.
• Document application changes and updates, including API documentation via OpenAPI/Swagger.
• Research and evaluate emerging architecture patterns and technologies through rapid learning, proofs-of-concept, and prototypes.

• Awesome projects with an impact
• Udemy courses of your choice
• Team-buildings, events, marathons & charity activities to connect and recharge
• Workshops, trainings, expert knowledge-sharing that keep you growing
• Clear career path
• Absence days for work-life balance
• Flexible hours & work setup - work from anywhere and organize your day your way