Databricks Engineer

Persistent; Bengaluru; Hybrid; INR 2,400,000 - 3,600,000; Full time

Benefits offered by this job

Competitive salary

Growth opportunities

Hybrid work

Education support

Job summary

Persistent in Bengaluru is seeking a Data Engineer - AI & Analytics focusing on Databricks to design scalable cloud data solutions, optimize pipelines, and enable GenAI use cases.

You will work with Python, PySpark, SQL and collaborate with stakeholders to deliver data platforms on AWS/Azure, following Agile and DataOps practices.

The role offers full-time employment with growth opportunities and exposure to cutting-edge technologies.

Qualifications

• 6+ years of data engineering experience with SQL, Python and PySpark.
• Experience building cloud-based data and BI solutions on AWS or Azure.
• Knowledge of ETL/ELT, data modeling and data warehousing concepts.

Responsibilities

• Design, build and optimize batch and real-time data pipelines using Python, PySpark and SQL.
• Perform source-to-target data analysis, mapping and requirement gathering.
• Collaborate with stakeholders, data engineers and project teams to deliver data solutions.
• Support cloud data platforms, architecture enhancements and AWS/Azure analytics initiatives.
• Develop GenAI/LLM use cases, including RAG-based productivity enhancements.
• Follow Agile, DevOps, DataOps and DevSecOps practices for project delivery.

Skills

SQL

Python

PySpark

Tools

AWS

Azure

Job description

About Position:

We are seeking a Data Engineer - AI & Analytics to design and deliver scalable cloud-based data solutions, optimize data pipelines, and support AI-driven initiatives. The role combines data engineering, cloud technologies, and Generative AI capabilities to build high-quality, cost-efficient data platforms.

• Role: Databricks Engineer
• Location: Bangalore
• Experience: 6 to 8 years
• Job Type: Full Time Employment

What You'll Do:

• Design, build, and optimize batch and real-time data pipelines using Python, PySpark, and SQL.
• Perform source-to-target data analysis, mapping, and requirement gathering.
• Collaborate with business stakeholders, data engineers, and project teams to deliver data solutions.
• Support cloud data platforms, architecture enhancements, and AWS/Azure-based analytics initiatives.
• Develop and enable GenAI/LLM use cases, including RAG-based solutions for improved productivity.
• Follow Agile, DevOps, DataOps, and DevSecOps practices to ensure successful project delivery.

Expertise You'll Bring:

• 6+ years of experience in data engineering with strong expertise in SQL, Python, and PySpark.
• Experience building cloud-based data and BI solutions on AWS or Azure.
• Strong understanding of data pipelines, ETL/ELT, data modeling, and data warehousing concepts.
• Knowledge of Generative AI, Large Language Models (LLMs), GPT, and Retrieval-Augmented Generation (RAG).
• Excellent analytical, problem-solving, stakeholder management, and communication skills.
• Experience working in Agile environments and collaborating with globally distributed teams.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalisation for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.