Databricks Data Engineer

Exponentia.ai Private Limited; Navi Mumbai; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

Exponentia.ai is seeking skilled Data Engineers in Navi Mumbai to design, build, and optimize scalable data pipelines using Python, PySpark, and SQL. You will work on end-to-end ETL, data migrations (including LMS transitions), and data architecture in cloud-based environments, collaborating with AI and analytics teams.

The role emphasizes data quality, governance, and performance across platforms, with opportunities to lead significant data transformation initiatives and contribute to

Qualifications

• Strong Python programming skills and hands-on PySpark experience.
• Experience building end-to-end data pipelines and ETL solutions.
• Proficient in SQL and data modeling for large-scale datasets.
• Knowledge of data migration projects and LMS migrations is a plus.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines and data processing workflows.
• Build robust data aggregation and transformation workflows using Python and PySpark.
• Develop optimized SQL queries for large datasets and ensure data quality and governance.
• Collaborate with analytics, AI, and BI teams to enable data-driven decision making.

Skills

Python

PySpark

SQL

ETL Development

Data Engineering

Pipeline Development

Data Aggregation

Data Transformation & Processing

Data Modeling Fundamentals

Tools

Databricks

AWS Glue

Apache Spark

Airflow

Data Lake Technologies

Job description

About Exponentia.ai

Exponentia.ai is a fast-growing AI-first technology services company, partnering with enterprises to shape and accelerate their journey to AI maturity. With a presence across the US, UK, UAE, India, and Singapore, we bring together deep domain knowledge, cloud-scale engineering, and cutting-edge artificial intelligence to help our clients transform into agile, insight-driven organizations.

We are proud partners with global technology leaders such as Databricks, Microsoft, AWS, and Qlik, and have been consistently recognized for innovation, delivery excellence, and trusted advisories.

Awards & Recognitions

• Innovation Partner of the Year, Databricks 2024
• Digital Impact Award, UK 2024 (TMT Sector)
• Rising Star, APJ Databricks Partner Awards 2023
• Qlik’s Most Enabled Partner, APAC

With a team of 450+ AI engineers, data scientists, and consultants, we are on a mission to redefine how work is done, by combining human intelligence with AI agents to deliver exponential outcomes.

Learn more: www.exponentia.ai

About the Role:

We are looking for skilled Data Engineers with strong expertise in Python, PySpark, SQL, and Data
Engineering to design, develop, and optimize scalable data pipelines and data processing solutions.
The ideal candidate will have hands-on experience in building end-to-end data pipelines, data
aggregation frameworks, and ETL solutions within cloud-based environments. Experience with data
migration projects, data architecture, and schema design will be highly valued, as the organization is
undertaking significant data transformation initiatives, including migration from one Learning
Management System (LMS) to another.
This role offers an opportunity to contribute to large-scale data engineering projects while collaborating
with analytics, AI, and business teams.

Key Responsibilities

• Design, develop, and maintain scalable ETL and data processing pipelines.
• Build robust data aggregation and transformation workflows using Python and PySpark.
• Develop and optimize SQL queries for large-scale datasets.
• Implement end-to-end data pipelines for ingestion, transformation, and consumption.
• Support data migration initiatives, including platform and LMS migrations.
• Collaborate with stakeholders to understand business requirements and translate them intoefficient data solutions.
• Design and maintain data models, schemas, and architecture components.
• Ensure data quality, governance, and performance across data platforms.
• Troubleshoot and optimize existing data pipelines and workflows.
• Work closely with AI, Analytics, and Business Intelligence teams to enable data-driven decisionmakin

Roles and Responsibilities

Required Skillset

• Strong Python Programming
• PySpark
• SQL
• ETL Development
• Data Engineering
• Pipeline Development
• Data Aggregation
• Data Transformation & Processing
• Data Modeling Fundamentals

Preferred Experience

• Data Migration Projects
• LMS Migration Experience
• Data Architecture Design
• Schema Design & Optimization
• End-to-End Data Pipeline Implementation
• AWS Data Ecosystem
• Large-Scale Data Processing Frameworks

Good to Have Skills

• Databricks
• AWS Glue
• Apache Spark
• Airflow or Similar Workflow Orchestration Tools
• Data Lake Technologies
• CI/CD for Data Engineering Workflows

Why Join Exponentia.ai?

• Innovate with Purpose: Opportunity to create pioneering AI solutions in partnership with leading cloud and data platforms
• Shape the Practice: Build a marquee capability from the ground up with full ownership
• Work with the Best: Collaborate with top-tier talent and learn from industry leaders in AI
• Global Exposure: Be part of a high-growth firm operating across US, UK, UAE, India, and Singapore
• Continuous Growth: Access to certifications, tech events, and partner-led innovation labs
• Inclusive Culture: A supportive and diverse workplace that values learning, initiative, and ownership

Ready to build the future of AI with us?