Principal Data Engineer / Data & AI Platform Engineer

Srinav; Chennai District; Hybrid; INR 3,000,000 - 4,200,000; Full time

Job summary

Srinav invites applications for a Principal Data Engineer / Data & AI Platform Engineer based in Chennai with a hybrid work model. The role focuses on scalable data pipelines, AI agent deployment, and data analytics across the enterprise risk technology platform.

The ideal candidate has 8+ years of experience, strong Python and PySpark skills, and hands-on work with Databricks, AI tools, and modern data architectures. Immediate notice period is preferred.

Qualifications

• 8+ years of overall experience in large-scale application development with recent mandatory platform for the secure and scalable deployment of AI agents into application contexts.
• Minimum of 5+ years of proven experience in a Python and pyspark Engineering lead role focused on building enterprise-grade, high-volume ELT/ETL processes using the PySpark and Databricks ecosystem.
• Hands-on experience with agentic AI development using YAML, JSON, FAST API or Spring boot, Google ADK, LLM integrations, including Devin.AI or Github Copilot, and integrating models via platforms like MCP using advanced prompt engineering.

Responsibilities

• Design, develop, and maintain scalable, enterprise-grade AI agents, supporting ELT/ETL processes to handle large data volumes using Python, FAST API, Microservices, PySpark, Kafka and Databricks ecosystem.
• Build and Deploy GEN AI Agents using Google ADK and Google Flash 2.5+ LLMs to support automation and insights with human-in-the-loop architecture.
• Create data federation layers for lambda and Data Mesh architectures using Starburst, guiding AI-based use cases to drive efficiency.
• Develop, deploy, and automate microservice integrations for data-intensive apps with cloud-native infrastructure, OpenShift or Kubernetes and CI/CD pipelines.
• Integrate agentic AI tools and platforms through advanced prompt engineering to boost development and operations.

Skills

Python

PySpark

Databricks

Kafka

FAST API

Microservices

Agentic AI

Google ADK

AI agents

Tools

Starburst

Kubernetes

OpenShift

CI/CD

Google ADK

Job description

Dear Candidates,

Hope your doing well,

We are currently hiring for an exciting role of Principal Data Engineer / Data & AI Platform Engineer with one of our best client based in Chennai location with Hybrid work model.

Role: Principal Data Engineer / Data & AI Platform Engineer

Exp: 8+ years

Location: only Chennai

Notice period: Immediate/Serving NP

Job Description

We are seeking a highly motivated and experienced Principal Engineer to join our Retail and Wealth Risk Engineering team under the Enterprise Risk Technology platform. This is an intermediate-level position responsible for designing, building, and maintaining robust, scalable data pipelines and solutions that leverage cutting-edge Mandatory platform for the secure and scalable deployment of AI agents, Big Data, Databrick and AI technologies. The ideal candidate is a high-impact individual with a passion for data, analytics, and problem-solving. You will play a key role in driving business engagement and growth by building the next generation of data and analytics platforms.

Responsibilities

• Design, develop, and maintain scalable, enterprise-grade AI agents , supporting ELT/ETL processes to handle large data volumes using the Python, FAST API, Microservices , PySpark, Kafka and Databricks ecosystem.
• Build and Deploy GEN AI Agents using Googles ADK and Google Flash 2.5+ LLMs to support application automation supports and its deep insights, workflow support with HIL - Human in loop architecture.
• Build and maintain data federation layers for lambda and Data Mesh architectures using tools like Starburst, with a strategy for adopting AI-based use cases (e.g., machine learning, deep learning, NLP) to drive efficiency.
• Develop, deploy, and automate microservice integrations to support data-intensive applications, ensuring scalability, resilience, and maintainability using cloud native infrastructure and openshift or Kubernates architecture including CI/CD pipelines.
• Integrate and leverage agentic AI tools (e.g., Devin.AI, Github Copilot) and platforms (e.g., MCP) through advanced prompt engineering to enhance development and operational efficiency.
• Ensure data quality, integrity, and security throughout the entire data lifecycle.
• Contribute to the continuous improvement of data engineering processes, standards, and best practices within the team.
• Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citi, its clients, and assets by driving compliance with applicable laws, rules, and regulations. Adhere to Policy, apply sound ethical judgment, and elevate, manage, and report control issues with transparency.

Qualifications

Required

• 8+ years of overall experience in large-scale application development with recent mandatory platform for the secure and scalable deployment of AI agents into application contexts
• Minimum of 5+ years of proven experience in a Python and pyspark Engineering lead role focused on building enterprise-grade, high-volume ELT/ETL processes using the PySpark and Databricks ecosystem.
• Hands-on experience with agentic AI development using YAML, JSON, FAST API or Spring boot, Google ADK, LLM itegrations, including Devin.AI or Github Copilot, and integrating models via platforms like MCP using advanced prompt engineering.