Databricks Data Engineer

Exponentia.ai Private Limited; Mumbai; On-site; INR 2,800,000 - 4,000,000; Full time

Benefits offered by this job

Global exposure

Continuous growth

Inclusive culture

Certifications & events

Job summary

Exponentia.ai is seeking a skilled Data Engineer with hands-on Databricks experience to design, build, and maintain scalable data pipelines and transformation workflows. You will work with large datasets using Spark, develop data models for analytics, and ensure data quality across end-to-end pipelines.

The role emphasizes ETL/ELT development, knowledge of data warehousing concepts, and cloud platform familiarity (Azure preferred; AWS/GCP acceptable), with collaboration across stakeholders to

Qualifications

• 4+ years of experience in Data Engineering / Big Data development.
• Hands-on experience with Azure Databricks, Apache Spark (PySpark), and SQL.
• Experience building ETL pipelines and data workflows.
• Knowledge of data warehousing concepts and data modeling.
• Experience with cloud platforms (Azure preferred; AWS/GCP acceptable).
• Familiarity with data pipeline orchestration tools (ADF, Airflow).

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build and optimize ETL/ELT workflows for data ingestion and transformation.
• Work with large datasets using distributed computing frameworks (Spark).
• Develop and maintain data models to support analytics and reporting needs.
• Collaborate with stakeholders to gather requirements and translate them into technical solutions.
• Ensure data quality, governance, and reliability across pipelines.
• Optimize performance of Databricks jobs and data processes.
• Integrate data from multiple sources (APIs, databases, files, etc.).
• Support production deployments and troubleshoot data-related issues.

Skills

ETL pipelines

Data warehousing

Cloud platforms

Airflow/ADF

Data modeling

Tools

Azure Databricks

Apache Spark(PySpark)

SQL

Job description

About Exponentia.ai

Exponentia.ai is a fast-growing AI-first technology services company, partnering with enterprises to shape and accelerate their journey to AI maturity. With a presence across the US, UK, UAE, India, and Singapore, we bring together deep domain knowledge, cloud-scale engineering, and cutting-edge artificial intelligence to help our clients transform into agile, insight-driven organizations.

Awards & Recognitions

• Innovation Partner of the Year – Databricks, 2024
• Digital Impact Award, UK – 2024 (TMT Sector)
• Rising Star – APJ Databricks Partner Awards 2023
• Qlik’s Most Enabled Partner – APAC

With a team of 450+ AI engineers, data scientists, and consultants, we are on a mission to redefine how work is done, by combining human intelligence with AI agents to deliver exponential outcomes.

Learn more: www.exponentia.ai

About the role

We are looking for a skilled Data Engineer with hands-on experience in Databricks to design, build, and maintain scalable data pipelines and transformation workflows. The ideal candidate will have strong expertise in big data processing, ETL development, and cloud-based data platforms, enabling efficient data-driven decision-making.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks
• Build and optimize ETL/ELT workflows for data ingestion and transformation
• Work with large datasets using distributed computing frameworks (Spark)
• Develop and maintain data models to support analytics and reporting needs
• Collaborate with stakeholders to gather requirements and translate them into technical solutions
• Ensure data quality, governance, and reliability across pipelines
• Optimize performance of Databricks jobs and data processes
• Integrate data from multiple sources (APIs, databases, files, etc.)
• Support production deployments and troubleshoot data-related issues

Required Skills & Qualifications

• 4+ years of experience in Data Engineering / Big Data development
• Strong hands-on experience with:
  • Azure Databricks / Databricks platform
  • Apache Spark (PySpark preferred)
  • SQL (advanced queries and optimization)
• Experience building ETL pipelines and data workflows
• Solid understanding of data warehousing concepts
• Experience working with structured and unstructured data
• Familiarity with cloud platforms (Azure preferred; AWS/GCP acceptable)
• Knowledge of data pipeline orchestration tools (ADF, Airflow, etc.)
• Strong problem-solving and analytical skills

Why Join Exponentia.ai?

• Innovate with Purpose: Opportunity to create pioneering AI solutions in partnership with leading cloud and data platforms
• Shape the Practice: Build a marquee capability from the ground up with full ownership
• Work with the Best: Collaborate with top-tier talent and learn from industry leaders in AI
• Global Exposure: Be part of a high-growth firm operating across US, UK, UAE, India, and Singapore
• Continuous Growth: Access to certifications, tech events, and partner-led innovation labs
• Inclusive Culture: A supportive and diverse workplace that values learning, initiative, and ownership.