AI Platform Staff Engineer

Accrete; Maharashtra; On-site; INR 3,500,000 - 6,000,000; Full time

Benefits offered by this job

Competitive Salary

Mediclaim 10 Lacs coverage

Flexible PTO & Hybrid Work

Growth & Development

Team Bonding

Job summary

Accrete is building an AI-native platform with agent-first architecture. We seek an AI Staff Engineer to design and ship scalable backend services, data pipelines, and agentic systems where LLMs reason, plan, and act alongside deterministic workflows.

You’ll work across product, ML, and platform teams to deliver enterprise-scale solutions, improve backend performance, and raise the technical bar through thoughtful design and execution.

Qualifications

• 10+ years of backend and data engineering experience
• Strong hands-on experience with Python and frameworks
• Experience building cloud-native microservices
• Knowledge of data pipelines and distributed systems
• Proficiency with CI/CD practices

Responsibilities

• Design and implement backend services, data integration layers, and distributed systems using Python and modern frameworks.
• Build scalable microservices and REST/gRPC APIs for real-time and batch workloads.
• Lead design reviews and remain hands-on with code.
• Create and maintain technical docs, architecture diagrams, and API specs.
• Mentor engineers and raise engineering standards across teams.

Skills

Python

Microservices

Distributed systems

Cloud-native

Education

Bachelor’s or Master’s in CS/Engineering

Tools

Docker

Kubernetes

Git

Apache Kafka

Airflow

Job description

About Accrete:

Accrete is an agentic managed services company: an AI workforce that does high-stakes, judgement-heavy work for government and enterprise clients — at the economics of software, not labor.

At the core is Accrete’s Knowledge Engine, a dynamic context graph that captures an organization’s tacit knowledge, resolves data across silos, and builds a living, auditable ground truth. Expert agents reason against that ground truth to act on complex, high-stakes decisions — not just answer questions about them.

From national security to commercial operations, Accrete delivers the work on one platform, with unlimited expert agents and expert judgement.

About Role:

We are seeking an AI Staff Engineer who is excited about building the next phase of our platform with an agent-first, AI-native approach, grounded in clean code and strong architectural thinking. This role goes beyond traditional backend or data engineering. You will design and build systems where LLMs can reason, plan, and act, working alongside well-structured, deterministic services and workflows. The goal is simple and demanding at the same time: ship systems that work reliably in production, scale with real usage, and solve real customer problems. This is a hands-on role for someone who enjoys building, not just designing on paper. You should be deeply comfortable with Python-based systems, and have strong experience building cloud-native, microservices-driven platforms, including data pipelines and distributed systems. You will work closely with product, ML, and platform teams to deliver enterprise-scale solutions, improve backend performance and reliability, and raise the technical bar through thoughtful design, ownership, and execution across teams.

Key Responsibilities:

Technical Leadership & Hands-On Contribution

• Design and implement backend services, data integration layers, and distributed systems using Python and modern frameworks.
• Build scalable microservices and REST/gRPC APIs for both real-time and batch workloads.
• Lead technical design and architecture reviews while remaining deeply hands-on with code.
• Create and maintain clear technical documentation, including architecture diagrams, component flows, design docs, and API specs.
• Communicate technical decisions clearly to engineers, product partners, and non-technical stakeholders.

Agentic Systems & AI-Native Architecture

• Design and build agent-first systems where LLMs reason, plan, and act alongside deterministic services.
• Implement and evaluate agentic frameworks such as LangGraph, CrewAI, AutoGen, or similar open-source tools.
• Apply agentic design patterns including planners, routers, evaluators, memory, tool-use, and feedback loops.
• Integrate Model Context Protocols (MCP) or equivalent mechanisms to standardize tool access, context sharing, and orchestration across agents.
• Balance probabilistic AI behavior with deterministic workflows to ensure reliability, observability, and production safety.
• Collaborate closely with ML teams to move models from experimentation into scalable, production-grade systems.

Cloud-Native Development

• Build and deploy services on AWS using EC2, Lambda, RDS, S3, DynamoDB, and managed AI services where appropriate.
• Design systems using Kubernetes, containers, serverless, and event-driven patterns.
• Ensure reliability, observability, security, and cost awareness across cloud workloads.
• Design data-intensive systems including ingestion pipelines, stream processing, and transformation workflows.
• Work with tools such as Apache Kafka, Airflow, Dagster, AWS Step Functions, or equivalent orchestration frameworks.
• Design and operate systems using multiple databases such as MongoDB, OpenSearch/Elasticsearch, PostgreSQL, and similar technologies.

Code Quality, CI/CD & Operational Excellence

• Write high-quality, testable code with strong unit and integration test coverage.
• Build and maintain Git-based CI/CD pipelines to support fast, reliable releases.
• Own production outcomes by monitoring systems, diagnosing issues, and fixing root causes.
• Work closely with product managers, ML engineers, platform teams, and stakeholders to align on outcomes.
• Mentor engineers, lead code reviews, and raise the engineering bar through example.
• Advocate for security-first development, operational discipline, and strong engineering culture.

Qualifications & Experience:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 10+ years of backend and data engineering experience with a strong focus on microservices and distributed systems.
• Hands-on experience with cloud platforms such as AWS (Lambda, S3, EC2, RDS), Azure (Azure Functions, Blob Storage, Virtual Machines), or GCP (Cloud Functions, Cloud Storage, Compute Engine).
• Strong hands-on experience with Python and frameworks like Flask, FastAPI, or Django and related libraries/frameworks such as NumPy, Pandas, PyDantic etc.
• Strong knowledge of data engineering technologies, including ETL tools (Apache Spark, Apache Airflow, AWS Glue, Google Dataflow), data warehouses (Amazon Redshift, Google BigQuery, Snowflake), and big data platforms (Hadoop, Apache Kafka, Apache HBase).
• Familiarity with asynchronous and synchronous integration patterns and frameworks (RESTful APIs, GraphQL, WebSockets).
• Strong understanding of system design patterns, caching, rate-limiting, and queuing mechanisms.
• Proficiency in backend and server-side technologies such as: Web frameworks: Flask, Django, FastAPI
• Messaging protocols: HTTP, AMQP
• Caching systems: Redis, Memcached
• Containerization and orchestration: Docker, Kubernetes
• Knowledge of microservices architecture and design principles.
• Experience with version control systems such as Git and CI/CD pipelines.
• Experience in setting up and using automated testing tools and frameworks, such as Selenium, PyTest, or JUnit.
• Ability to create and maintain detailed sequence diagrams and architectural documentation. Proficiency in developing effective strategies to debug issues that arise in production environments.
• Ability to work collaboratively with cross-functional teams. Ability to adapt to new technologies and methodologies quickly.
• Strong problem-solving skills and attention to detail.
• Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.

Impact

You take full ownership and accountability for your work, consistently seeing projects through from inception to completion with a strong bias for action. Proactively identifying challenges, you drive solutions rather than waiting for direction, and hold yourself and others to the highest standards for delivering results. With strategic thinking and a problem-solving mindset, you make informed decisions leveraging data and expertise, always looking for ways to improve processes, optimize workflows, and enhance outcomes beyond your immediate responsibilities.

You work seamlessly across teams, prioritizing shared goals and team success over individual credit. Engaged listening and open, candid communication are at the heart of your approach, ensuring alignment and synergy throughout the organization. You value diverse perspectives, seeking input from others to drive better results. By treating colleagues with respect and professionalism, you help build a culture of trust, supporting each other through challenges, celebrating successes, and constructively addressing conflicts to strengthen relationships and improve outcomes.

Passion for AI & Innovation

You are deeply excited about the transformative potential of AI and committed to contributing to a company shaping the future of work. With curiosity and a growth mindset, you continuously seek to learn, adapt, and stay at the forefront of new developments. Your enthusiasm for innovation drives you to explore new ideas, challenge the status quo, and find creative solutions that deliver meaningful impact. You approach your work with energy and a desire to advance both technology and the way we work.

At Accrete we value professional growth and development of our employees. As a AI Staff Engineer - Application, you will have access to a variety of career advancement opportunities and growth within the organization. We provide ongoing training, mentorship, and opportunities to take on leadership roles within your team and work with leaders across departments.

Company Benefits

• Competitive Salary: Aligned with experience and market standards
• Mediclaim: 10 Lacs coverage for you and your family
• Flexible PTO & Hybrid Work: Take time off when needed and enjoy remote flexibility per company guidelines
• Growth & Development: Access professional learning opportunities and career advancement support
• Team Bonding: Company-sponsored social events to connect and unwind