Lead AWS Databricks Data & AI Engineer

Persistent Systems; Bengaluru; Hybrid; INR 4,500,000 - 7,000,000; Full time

Benefits offered by this job

Group term life insurance

Personal accident insurance

Mediclaim hospitalization for family

Flexible work hours

Long Service awards

Education sponsorship and courses

Job summary

Persistent Systems is seeking a Lead AWS Databricks Data & AI Engineer in Bengaluru to design and deliver enterprise-scale data engineering and GenAI solutions on AWS. You will lead AI-ready data ecosystems, scalable data pipelines, and analytics solutions, collaborating with stakeholders, architects, data scientists, and engineers to drive data-driven decision-making.

The role emphasizes cloud-native architectures, GenAI/ML deployment, and an agile, DevOps-driven approach within a diverse,

Qualifications

• 12+ years of data engineering experience with enterprise-scale implementations.
• Strong AWS, SQL, Python, and PySpark expertise.
• Hands-on data modeling and large-scale data processing.
• Experience with GenAI, RAG, embeddings, vector stores, and ML solutions.
• Knowledge of MLOps/LLMOps and AI model deployment practices.
• Strong stakeholder management, communication, and problem-solving skills.

Responsibilities

• Build and optimize data pipelines for analytics, ML, and GenAI workloads.
• Translate business requirements into scalable AWS-based data solutions.
• Support Enterprise Data Platform (EDP) architecture and roadmap initiatives.
• Provide technical guidance across data and AI projects.
• Ensure data quality, governance, and compliance with best practices.
• Drive Agile delivery using DevOps, DataOps, and MLOps practices.

Skills

AWS

SQL

Python

PySpark

GenAI/LLMOps

MLOps

Data Modeling

Data Pipelines

Stakeholder Management

Job description

We are seeking a highly experienced Lead AWS Databricks Data & AI Engineer to design, build, and deliver enterprise-scale data engineering and Generative AI solutions on AWS. The ideal candidate will have deep expertise in modern data platforms, cloud-native architectures, advanced analytics, and AI/ML technologies. In this role, you will lead the development of AI-ready data ecosystems, scalable data pipelines, and intelligent analytics solutions that support business transformation initiatives. You will work closely with business stakeholders, architects, data scientists, and engineering teams to drive innovation and enable data-driven decision-making across the organization.

• Experience: 12 to 14 years
• Job Type: Full Time Employment

What You'll Do:

• Build and optimize data pipelines for analytics, ML, and GenAI workloads.
• Translate business requirements into scalable AWS-based data solutions.
• Support Enterprise Data Platform (EDP) architecture and roadmap initiatives.
• Provide technical guidance across data and AI projects.
• Ensure data quality, governance, and compliance with best practices.
• Drive Agile delivery using DevOps, DataOps, and MLOps practices.

Expertise You'll Bring:

• 12+ years of data engineering experience with enterprise-scale implementations.
• Strong AWS, SQL, Python, and PySpark expertise.
• Hands-on experience with data modeling and large-scale data processing.
• Experience with GenAI, RAG, embeddings, vector stores, and ML solutions.
• Knowledge of MLOps/LLMOps and AI model deployment practices.
• Strong stakeholder management, communication, and problem-solving skills.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."