Senior AIML/ Gen AI Engineer

Quadratyx; Chennai; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Quadratyx is seeking aSenior AI ML/ GenAI Engineer to lead data engineering for big data and GenAI projects in Hyderabad/Chennai. You will design scalable data pipelines, develop real-time streaming solutions, and build backend services with Python microservice frameworks while collaborating with AI/ML teams.

The role emphasizes hands-on coding, distributed systems, and integration with GenAI tools, LangChain, and vector databases. Strong Python and PySpark skills are essential.

Qualifications

• Strong hands-on PySpark and distributed data processing.
• Proficient in Python and building APIs/microservices.
• Experience with modern backend frameworks (Flask/FastAPI).
• Understanding of Big Data ecosystem and streaming architectures.

Responsibilities

• Design, develop, and optimize scalable batch and streaming data pipelines.
• Build large-scale distributed data processing systems using PySpark.
• Develop real-time streaming solutions using Kafka and/or Apache Flink.
• Build and maintain APIs and backend services using Python-based microservice frameworks.
• Collaborate with AI/GenAI teams to support LLM/RAG-based applications.

Skills

PySpark

Python

Microservices

Kafka

Flink

Flask

FastAPI

PostgreSQL

Linux

Docker

LangChain

Tools

Kafka

Flink

PostgreSQL

LangChain

LlamaIndex

Docker

Job description

About Quadratyx

We are a product-centric insight & automation services company globally. We help the world’s organizations make better & faster decisions using the power of insight & intelligent automation. We build and operationalize their next-gen strategy, through Big Data, Artificial Intelligence, Machine Learning, Unstructured Data Processing and Advanced Analytics. Quadratyx can boast of more extensive experience in data sciences & analytics than most other companies in India. We firmly believe in

About Quadratyx

We are a product-centric insight & automation services company globally. We help the world’s organizations make better & faster decisions using the power of insight & intelligent automation. We build and operationalize their next-gen strategy, through Big Data, Artificial Intelligence, Machine Learning, Unstructured Data Processing and Advanced Analytics. Quadratyx can boast of more extensive experience in data sciences & analytics than most other companies in India. We firmly believe in Excellence Everywhere.

Senior AI ML/ Gen AI Engineer

Job / Role Information

Designation

• Senior Data Engineer – Big Data & GenAI

Function

• Technical

Location

• Hyderabad, Chennai

Job Description

Purpose of the Job/ Role:

• We are looking for a highly skilled and hands-on Data Engineer with strong expertise in Big Data technologies, distributed data processing, and backend engineering. The ideal candidate should have practical experience in building scalable batch and real-time data pipelines using frameworks such as PySpark, Kafka, and streaming platforms.
• The candidate should also possess strong Python programming skills and experience building APIs/microservices using modern backend frameworks.
• This role is best suited for engineers who enjoy solving large-scale data engineering problems and working closely with AI/GenAI-driven applications.
• We are specifically looking for candidates with strong hands-on coding and distributed systems experience, and not candidates whose experience is predominantly limited to traditional ETL tools, low-code cloud pipelines, or Snowflake-centric workflows.

Key Requisites

• Design, develop, and optimize scalable batch and streaming data pipelines
• Build large-scale distributed data processing systems using PySpark
• Develop real-time streaming solutions using Kafka and/or Apache Flink
• Build and maintain APIs and backend services using Python-based microservice frameworks
• Work with structured and semi-structured datasets across multiple storage systems
• Optimize pipeline performance, scalability, and fault tolerance
• Collaborate with AI/ML and GenAI teams to support LLM and RAG-based applications
• Participate in architecture discussions, debugging, code reviews, and production deployments
• Ensure reliability, monitoring, and maintainability of data engineering systems

Mandatory Skills

• Strong hands-on experience with PySpark and distributed data processing (must-have)
• Strong programming expertise in Python
• Hands-on experience building APIs and backend services using:
• Flask
• FastAPI
• or similar microservice frameworks
• Good understanding of Big Data ecosystem and streaming architectures

Experience With

• Apache Kafka
• Apache Flink (preferred)
• PostgreSQL
• Experience building end-to-end batch and real-time data engineering pipelines
• Good understanding of scalable system design, partitioning, optimization, and distributed processing concepts
• Understanding of microservices architecture and API integrations
• Experience working in Linux-based environments
• Strong analytical and problem-solving skills

GenAI / AI Engineering Expectations

• Strong analytical and problem-solving skills
• Working knowledge of LLMs and prompt engineering
• Understanding of RAG (Retrieval-Augmented Generation) concepts

Experience Using GenAI Frameworks/tools Such As

• LangChain
• LlamaIndex (good to have)
• Exposure to vector databases, embeddings, or AI-assisted workflows is a plus

Good to Have / Bonus Skills

• Experience with QuestDB
• Exposure to real-time analytics and streaming systems
• Understanding of distributed systems internals
• Experience with Docker/containerization and deployment workflows
• Familiarity with monitoring and logging frameworks
• Knowledge of cloud platforms is an added advantage

Important Note

• This role is focused on core data engineering, distributed systems, and backend engineering.

Candidates With Predominantly

• Snowflake-only experience
• Low-code ETL pipeline development
• Pure cloud ETL orchestration backgrounds
• may not be the right fit for this requirement unless they also possess strong hands-on Big Data engineering and programming experience.

Working Relationships

Reporting to

• Vice President

External Stakeholders

• Clients

Preferred Candidate Profile

• Strong ownership mindset and problem-solving ability
• Minimum 5-8 years of work experience as a Data Manager in an IT organization (preferably Analytics / Big Data/ Data Science / AI background).
• Comfortable working independently on complex engineering problems
• Ability to work in fast-paced product/research-oriented environments
• Passion for learning modern AI and data technologies
• Good communication and collaboration skills

Quadratyx is an equal opportunity employer - we will never differentiate candidates on the basis of religion, caste, gender, language, disabilities or ethnic group.

Quadratyx reserves the right to place/move any candidate to any company location, partner location or customer location globally, in the best interest of Quadratyx business.